[2025-09-14T16:30:07.763413] [INFO ] [MAIN ] Using last completed trading day: 2025-09-12 [2025-09-14T16:30:07.763586] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-14T16:30:07.763714] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-14T16:30:07.763783] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-14T16:30:09.515710] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-09-14T16:30:09.515873] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-14T16:30:09.516078] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-14T16:30:09.516634] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-09-14T16:30:09.516712] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-14T16:30:09.516754] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-14T16:30:09.516824] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-14T16:30:09.516948] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-14T16:30:09.517310] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-09-14T16:30:09.517356] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-14T16:30:09.517514] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-14T16:30:09.517557] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-09-14T16:30:09.517597] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-14T16:30:09.517655] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-14T16:30:09.519993] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/JBK.csv (symbol JBK no longer active). [2025-09-14T16:30:09.520660] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/KTH.csv (symbol KTH no longer active). [2025-09-14T16:30:09.520940] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/KTN.csv (symbol KTN no longer active). [2025-09-14T16:30:09.521684] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ECCF.csv (symbol ECCF no longer active). [2025-09-14T16:30:09.523048] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/MOGU.csv (symbol MOGU no longer active). [2025-09-14T16:30:09.524120] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/MFSM.csv (symbol MFSM no longer active). [2025-09-14T16:30:09.524976] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/GJH.csv (symbol GJH no longer active). [2025-09-14T16:30:09.526754] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/HTFB.csv (symbol HTFB no longer active). [2025-09-14T16:30:09.531391] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/JENA.csv (symbol JENA no longer active). [2025-09-14T16:30:09.532030] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/HG.csv (symbol HG no longer active). [2025-09-14T16:30:09.533150] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/GJR.csv (symbol GJR no longer active). [2025-09-14T16:30:09.533411] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/EIIA.csv (symbol EIIA no longer active). [2025-09-14T16:30:09.533870] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/WLYB.csv (symbol WLYB no longer active). [2025-09-14T16:30:09.534474] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/MHNC.csv (symbol MHNC no longer active). [2025-09-14T16:30:09.535723] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/SPMA.csv (symbol SPMA no longer active). [2025-09-14T16:30:09.536545] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/EVAC.csv (symbol EVAC no longer active). [2025-09-14T16:30:09.537343] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/NTZ.csv (symbol NTZ no longer active). [2025-09-14T16:30:09.537706] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/RAC.csv (symbol RAC no longer active). [2025-09-14T16:30:09.539380] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/IGCB.csv (symbol IGCB no longer active). [2025-09-14T16:30:09.540341] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/PDPA.csv (symbol PDPA no longer active). [2025-09-14T16:30:09.543143] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/PYT.csv (symbol PYT no longer active). [2025-09-14T16:30:09.544272] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/AOMN.csv (symbol AOMN no longer active). [2025-09-14T16:30:09.545814] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/RCC.csv (symbol RCC no longer active). [2025-09-14T16:30:09.547690] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ECCV.csv (symbol ECCV no longer active). [2025-09-14T16:30:09.548686] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/STXI.csv (symbol STXI no longer active). [2025-09-14T16:30:09.550993] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-14T16:30:09.552209] [DEBUG] [LOCAL ] RCC: Removed from QA tracker. [2025-09-14T16:30:09.553386] [DEBUG] [LOCAL ] ECCV: Removed from QA tracker. [2025-09-14T16:30:09.554296] [DEBUG] [LOCAL ] IGCB: Removed from QA tracker. [2025-09-14T16:30:09.555361] [DEBUG] [LOCAL ] JBK: Removed from QA tracker. [2025-09-14T16:30:09.556214] [DEBUG] [LOCAL ] MFSM: Removed from QA tracker. [2025-09-14T16:30:09.557067] [DEBUG] [LOCAL ] STXI: Removed from QA tracker. [2025-09-14T16:30:09.557889] [DEBUG] [LOCAL ] GJR: Removed from QA tracker. [2025-09-14T16:30:09.558678] [DEBUG] [LOCAL ] GJH: Removed from QA tracker. [2025-09-14T16:30:09.559462] [DEBUG] [LOCAL ] KTN: Removed from QA tracker. [2025-09-14T16:30:09.560200] [DEBUG] [LOCAL ] KTH: Removed from QA tracker. [2025-09-14T16:30:09.560965] [DEBUG] [LOCAL ] EIIA: Removed from QA tracker. [2025-09-14T16:30:09.561764] [DEBUG] [LOCAL ] MOGU: Removed from QA tracker. [2025-09-14T16:30:09.562501] [DEBUG] [LOCAL ] WLYB: Removed from QA tracker. [2025-09-14T16:30:09.563195] [DEBUG] [LOCAL ] RAC: Removed from QA tracker. [2025-09-14T16:30:09.563919] [DEBUG] [LOCAL ] PYT: Removed from QA tracker. [2025-09-14T16:30:09.564565] [DEBUG] [LOCAL ] SPMA: Removed from QA tracker. [2025-09-14T16:30:09.565197] [DEBUG] [LOCAL ] JENA: Removed from QA tracker. [2025-09-14T16:30:09.565851] [DEBUG] [LOCAL ] NTZ: Removed from QA tracker. [2025-09-14T16:30:09.566459] [DEBUG] [LOCAL ] ECCF: Removed from QA tracker. [2025-09-14T16:30:09.567061] [DEBUG] [LOCAL ] MHNC: Removed from QA tracker. [2025-09-14T16:30:09.567632] [DEBUG] [LOCAL ] EVAC: Removed from QA tracker. [2025-09-14T16:30:09.568189] [DEBUG] [LOCAL ] HTFB: Removed from QA tracker. [2025-09-14T16:30:09.568740] [DEBUG] [LOCAL ] AOMN: Removed from QA tracker. [2025-09-14T16:30:09.569244] [DEBUG] [LOCAL ] PDPA: Removed from QA tracker. [2025-09-14T16:30:09.569304] [INFO ] [LOCAL ] Deleted 25 obsolete data files. [2025-09-14T16:30:09.569354] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-14T16:30:09.569426] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-14T16:30:09.569474] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-14T16:30:09.569689] [WARN ] [STATE ] State set to: RUNNING [2025-09-14T16:30:09.569811] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-14T16:30:09.570183] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-09-14T16:30:09.570237] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-14T16:30:09.570291] [INFO ] [MAIN ] Starting incremental update for 2370 symbols. [2025-09-14T16:30:09.570326] [INFO ] [MAIN ] Running in parallel mode [2025-09-14T16:30:09.570515] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2370 symbols [2025-09-14T16:30:10.111589] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:10.231920] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:10.266867] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:10.330126] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:10.335315] [DEBUG] [LOCAL ] AAM: Loaded 324 existing records from primary storage. [2025-09-14T16:30:10.336403] [INFO ] [MAIN ] AAM: Loaded 324 existing records. [2025-09-14T16:30:10.461568] [DEBUG] [LOCAL ] AACT: Loaded 4723 existing records from primary storage. [2025-09-14T16:30:10.472211] [INFO ] [MAIN ] AACT: Loaded 4723 existing records. [2025-09-14T16:30:10.483743] [DEBUG] [LOCAL ] A: Loaded 22259 existing records from primary storage. [2025-09-14T16:30:10.546330] [INFO ] [MAIN ] A: Loaded 22259 existing records. [2025-09-14T16:30:10.640701] [DEBUG] [LOCAL ] AA: Loaded 23992 existing records from primary storage. [2025-09-14T16:30:10.695531] [INFO ] [MAIN ] AA: Loaded 23992 existing records. [2025-09-14T16:30:10.733674] [INFO ] [MAIN ] AAM: No missing trading days found. Data is up to date. [2025-09-14T16:30:10.781097] [INFO ] [MAIN ] Update Progress: 1/2370 symbols completed. AAM took 1.1s. Estimated remaining: 47m 48s. Rate: 49.6 symbols/min [2025-09-14T16:30:11.073057] [INFO ] [MAIN ] AACT: No missing trading days found. Data is up to date. [2025-09-14T16:30:11.160498] [INFO ] [MAIN ] A: No missing trading days found. Data is up to date. [2025-09-14T16:30:11.177039] [INFO ] [MAIN ] Update Progress: 2/2370 symbols completed. AACT took 1.6s. Estimated remaining: 31m 42s. Rate: 74.7 symbols/min [2025-09-14T16:30:11.179154] [INFO ] [MAIN ] Update Progress: 3/2370 symbols completed. A took 1.6s. Estimated remaining: 21m 9s. Rate: 111.9 symbols/min [2025-09-14T16:30:11.453442] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:11.415036] [INFO ] [MAIN ] AA: No missing trading days found. Data is up to date. [2025-09-14T16:30:11.513398] [INFO ] [MAIN ] Update Progress: 4/2370 symbols completed. AA took 1.9s. Estimated remaining: 19m 9s. Rate: 123.5 symbols/min [2025-09-14T16:30:11.819793] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:11.820788] [DEBUG] [LOCAL ] AAMI: Loaded 11127 existing records from primary storage. [2025-09-14T16:30:11.831674] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:11.847705] [INFO ] [MAIN ] AAMI: Loaded 11127 existing records. [2025-09-14T16:30:11.995667] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:12.077127] [DEBUG] [LOCAL ] AAP: Loaded 23111 existing records from primary storage. [2025-09-14T16:30:12.082899] [INFO ] [MAIN ] AAP: Loaded 23111 existing records. [2025-09-14T16:30:12.111216] [DEBUG] [LOCAL ] AAT: Loaded 13479 existing records from primary storage. [2025-09-14T16:30:12.144500] [INFO ] [MAIN ] AAT: Loaded 13479 existing records. [2025-09-14T16:30:12.213258] [INFO ] [MAIN ] AAMI: No missing trading days found. Data is up to date. [2025-09-14T16:30:12.180473] [DEBUG] [LOCAL ] AAUC: Loaded 5794 existing records from primary storage. [2025-09-14T16:30:12.267896] [INFO ] [MAIN ] AAUC: Loaded 5794 existing records. [2025-09-14T16:30:12.282282] [INFO ] [MAIN ] Update Progress: 5/2370 symbols completed. AAMI took 1.4s. Estimated remaining: 21m 23s. Rate: 110.6 symbols/min [2025-09-14T16:30:12.720802] [INFO ] [MAIN ] AAP: No missing trading days found. Data is up to date. [2025-09-14T16:30:12.774226] [INFO ] [MAIN ] Update Progress: 6/2370 symbols completed. AAP took 1.6s. Estimated remaining: 21m 2s. Rate: 112.4 symbols/min [2025-09-14T16:30:12.852285] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:12.906329] [INFO ] [MAIN ] AAUC: No missing trading days found. Data is up to date. [2025-09-14T16:30:12.866021] [INFO ] [MAIN ] AAT: No missing trading days found. Data is up to date. [2025-09-14T16:30:12.941724] [INFO ] [MAIN ] Update Progress: 7/2370 symbols completed. AAUC took 1.4s. Estimated remaining: 18m 58s. Rate: 124.6 symbols/min [2025-09-14T16:30:12.988123] [INFO ] [MAIN ] Update Progress: 8/2370 symbols completed. AAT took 1.7s. Estimated remaining: 16m 49s. Rate: 140.4 symbols/min [2025-09-14T16:30:13.125325] [DEBUG] [LOCAL ] AB: Loaded 10001 existing records from primary storage. [2025-09-14T16:30:13.262249] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:13.259754] [INFO ] [MAIN ] AB: Loaded 10001 existing records. [2025-09-14T16:30:13.400233] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:13.492231] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:13.657387] [DEBUG] [LOCAL ] ABBV: Loaded 24058 existing records from primary storage. [2025-09-14T16:30:13.664897] [INFO ] [MAIN ] ABBV: Loaded 24058 existing records. [2025-09-14T16:30:13.656214] [INFO ] [MAIN ] AB: No missing trading days found. Data is up to date. [2025-09-14T16:30:13.679195] [INFO ] [MAIN ] Update Progress: 9/2370 symbols completed. AB took 1.4s. Estimated remaining: 17m 58s. Rate: 131.4 symbols/min [2025-09-14T16:30:13.703524] [DEBUG] [LOCAL ] ABCB: Loaded 13335 existing records from primary storage. [2025-09-14T16:30:13.734607] [INFO ] [MAIN ] ABCB: Loaded 13335 existing records. [2025-09-14T16:30:13.734462] [DEBUG] [LOCAL ] ABEV: Loaded 23949 existing records from primary storage. [2025-09-14T16:30:13.805028] [INFO ] [MAIN ] ABEV: Loaded 23949 existing records. [2025-09-14T16:30:14.254232] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:14.351933] [INFO ] [MAIN ] ABBV: No missing trading days found. Data is up to date. [2025-09-14T16:30:14.449298] [INFO ] [MAIN ] ABCB: No missing trading days found. Data is up to date. [2025-09-14T16:30:14.476286] [INFO ] [MAIN ] ABEV: No missing trading days found. Data is up to date. [2025-09-14T16:30:14.478313] [INFO ] [MAIN ] Update Progress: 10/2370 symbols completed. ABBV took 1.6s. Estimated remaining: 19m 18s. Rate: 122.3 symbols/min [2025-09-14T16:30:14.484079] [INFO ] [MAIN ] Update Progress: 11/2370 symbols completed. ABCB took 1.5s. Estimated remaining: 17m 34s. Rate: 134.3 symbols/min [2025-09-14T16:30:14.537208] [DEBUG] [LOCAL ] ABG: Loaded 8212 existing records from primary storage. [2025-09-14T16:30:14.552623] [INFO ] [MAIN ] Update Progress: 12/2370 symbols completed. ABEV took 1.5s. Estimated remaining: 16m 19s. Rate: 144.5 symbols/min [2025-09-14T16:30:14.598576] [INFO ] [MAIN ] ABG: Loaded 8212 existing records. [2025-09-14T16:30:15.069440] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:15.148441] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:15.203921] [INFO ] [MAIN ] ABG: No missing trading days found. Data is up to date. [2025-09-14T16:30:15.266478] [INFO ] [MAIN ] Update Progress: 13/2370 symbols completed. ABG took 1.6s. Estimated remaining: 17m 13s. Rate: 136.9 symbols/min [2025-09-14T16:30:15.268700] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:15.394261] [DEBUG] [LOCAL ] ABM: Loaded 14683 existing records from primary storage. [2025-09-14T16:30:15.407634] [INFO ] [MAIN ] ABM: Loaded 14683 existing records. [2025-09-14T16:30:15.435613] [DEBUG] [LOCAL ] ABR: Loaded 23060 existing records from primary storage. [2025-09-14T16:30:15.519612] [INFO ] [MAIN ] ABR: Loaded 23060 existing records. [2025-09-14T16:30:15.582846] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:15.720784] [DEBUG] [LOCAL ] ABT: Loaded 24020 existing records from primary storage. [2025-09-14T16:30:15.794036] [INFO ] [MAIN ] ABT: Loaded 24020 existing records. [2025-09-14T16:30:15.827751] [INFO ] [MAIN ] ABM: No missing trading days found. Data is up to date. [2025-09-14T16:30:15.883663] [INFO ] [MAIN ] Update Progress: 14/2370 symbols completed. ABM took 1.4s. Estimated remaining: 17m 42s. Rate: 133.1 symbols/min [2025-09-14T16:30:15.900409] [DEBUG] [LOCAL ] ACA: Loaded 10019 existing records from primary storage. [2025-09-14T16:30:16.026728] [INFO ] [MAIN ] ACA: Loaded 10019 existing records. [2025-09-14T16:30:16.107314] [INFO ] [MAIN ] ABR: No missing trading days found. Data is up to date. [2025-09-14T16:30:16.143171] [INFO ] [MAIN ] Update Progress: 15/2370 symbols completed. ABR took 1.6s. Estimated remaining: 17m 12s. Rate: 136.9 symbols/min [2025-09-14T16:30:16.464325] [INFO ] [MAIN ] ABT: No missing trading days found. Data is up to date. [2025-09-14T16:30:16.604754] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:16.629812] [INFO ] [MAIN ] Update Progress: 16/2370 symbols completed. ABT took 2.0s. Estimated remaining: 17m 19s. Rate: 136.0 symbols/min [2025-09-14T16:30:16.662291] [INFO ] [MAIN ] ACA: No missing trading days found. Data is up to date. [2025-09-14T16:30:16.692390] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:16.704785] [INFO ] [MAIN ] Update Progress: 17/2370 symbols completed. ACA took 1.4s. Estimated remaining: 16m 27s. Rate: 143.0 symbols/min [2025-09-14T16:30:16.927725] [DEBUG] [LOCAL ] ACCO: Loaded 15942 existing records from primary storage. [2025-09-14T16:30:16.932111] [DEBUG] [LOCAL ] ACEL: Loaded 11135 existing records from primary storage. [2025-09-14T16:30:16.964018] [INFO ] [MAIN ] ACCO: Loaded 15942 existing records. [2025-09-14T16:30:16.948595] [INFO ] [MAIN ] ACEL: Loaded 11135 existing records. [2025-09-14T16:30:17.097134] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:17.176954] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:17.424701] [INFO ] [MAIN ] ACEL: No missing trading days found. Data is up to date. [2025-09-14T16:30:17.469230] [INFO ] [MAIN ] ACCO: No missing trading days found. Data is up to date. [2025-09-14T16:30:17.469513] [INFO ] [MAIN ] Update Progress: 18/2370 symbols completed. ACEL took 1.3s. Estimated remaining: 17m 12s. Rate: 136.7 symbols/min [2025-09-14T16:30:17.486722] [DEBUG] [LOCAL ] ACI: Loaded 23796 existing records from primary storage. [2025-09-14T16:30:17.485880] [INFO ] [MAIN ] Update Progress: 19/2370 symbols completed. ACCO took 1.5s. Estimated remaining: 16m 19s. Rate: 144.0 symbols/min [2025-09-14T16:30:17.545401] [DEBUG] [LOCAL ] ACHR: Loaded 24180 existing records from primary storage. [2025-09-14T16:30:17.576049] [INFO ] [MAIN ] ACI: Loaded 23796 existing records. [2025-09-14T16:30:17.576228] [INFO ] [MAIN ] ACHR: Loaded 24180 existing records. [2025-09-14T16:30:17.919725] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:18.147105] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:18.153718] [INFO ] [MAIN ] ACI: No missing trading days found. Data is up to date. [2025-09-14T16:30:18.175332] [INFO ] [MAIN ] Update Progress: 20/2370 symbols completed. ACI took 1.4s. Estimated remaining: 16m 51s. Rate: 139.5 symbols/min [2025-09-14T16:30:18.279012] [INFO ] [MAIN ] ACHR: No missing trading days found. Data is up to date. [2025-09-14T16:30:18.333178] [INFO ] [MAIN ] Update Progress: 21/2370 symbols completed. ACHR took 1.6s. Estimated remaining: 16m 20s. Rate: 143.8 symbols/min [2025-09-14T16:30:18.360855] [DEBUG] [LOCAL ] ACM: Loaded 18918 existing records from primary storage. [2025-09-14T16:30:18.412748] [INFO ] [MAIN ] ACM: Loaded 18918 existing records. [2025-09-14T16:30:18.548160] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:18.439737] [DEBUG] [LOCAL ] ACN: Loaded 23971 existing records from primary storage. [2025-09-14T16:30:18.584889] [INFO ] [MAIN ] ACN: Loaded 23971 existing records. [2025-09-14T16:30:18.862997] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:18.930588] [DEBUG] [LOCAL ] ACP: Loaded 13507 existing records from primary storage. [2025-09-14T16:30:19.020269] [INFO ] [MAIN ] ACP: Loaded 13507 existing records. [2025-09-14T16:30:19.065292] [DEBUG] [LOCAL ] ACR: Loaded 2258 existing records from primary storage. [2025-09-14T16:30:19.064767] [INFO ] [MAIN ] ACN: No missing trading days found. Data is up to date. [2025-09-14T16:30:19.116134] [INFO ] [MAIN ] ACM: No missing trading days found. Data is up to date. [2025-09-14T16:30:19.142208] [INFO ] [MAIN ] Update Progress: 22/2370 symbols completed. ACN took 1.6s. Estimated remaining: 17m 2s. Rate: 137.9 symbols/min [2025-09-14T16:30:19.132577] [INFO ] [MAIN ] ACR: Loaded 2258 existing records. [2025-09-14T16:30:19.158787] [INFO ] [MAIN ] Update Progress: 23/2370 symbols completed. ACM took 1.7s. Estimated remaining: 16m 18s. Rate: 143.9 symbols/min [2025-09-14T16:30:19.570405] [INFO ] [MAIN ] ACP: No missing trading days found. Data is up to date. [2025-09-14T16:30:19.622527] [INFO ] [MAIN ] Update Progress: 24/2370 symbols completed. ACP took 1.4s. Estimated remaining: 16m 23s. Rate: 143.3 symbols/min [2025-09-14T16:30:19.763900] [INFO ] [MAIN ] ACR: No missing trading days found. Data is up to date. [2025-09-14T16:30:19.775196] [INFO ] [MAIN ] Update Progress: 25/2370 symbols completed. ACR took 1.4s. Estimated remaining: 15m 57s. Rate: 147.0 symbols/min [2025-09-14T16:30:19.889218] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:20.013513] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:20.239537] [DEBUG] [LOCAL ] ACV: Loaded 2675 existing records from primary storage. [2025-09-14T16:30:20.246717] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:20.247387] [INFO ] [MAIN ] ACV: Loaded 2675 existing records. [2025-09-14T16:30:20.268032] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:20.350336] [DEBUG] [LOCAL ] ACRE: Loaded 14580 existing records from primary storage. [2025-09-14T16:30:20.374549] [DEBUG] [LOCAL ] AD: Loaded 4587 existing records from primary storage. [2025-09-14T16:30:20.379901] [INFO ] [MAIN ] ACRE: Loaded 14580 existing records. [2025-09-14T16:30:20.404760] [INFO ] [MAIN ] AD: Loaded 4587 existing records. [2025-09-14T16:30:20.715107] [INFO ] [MAIN ] ACV: No missing trading days found. Data is up to date. [2025-09-14T16:30:20.746459] [DEBUG] [LOCAL ] ACVA: Loaded 21723 existing records from primary storage. [2025-09-14T16:30:20.756608] [INFO ] [MAIN ] Update Progress: 26/2370 symbols completed. ACV took 1.5s. Estimated remaining: 16m 48s. Rate: 139.5 symbols/min [2025-09-14T16:30:20.763015] [INFO ] [MAIN ] ACVA: Loaded 21723 existing records. [2025-09-14T16:30:21.065173] [INFO ] [MAIN ] ACRE: No missing trading days found. Data is up to date. [2025-09-14T16:30:21.161580] [INFO ] [MAIN ] Update Progress: 27/2370 symbols completed. ACRE took 2.0s. Estimated remaining: 16m 46s. Rate: 139.8 symbols/min [2025-09-14T16:30:21.158410] [INFO ] [MAIN ] AD: No missing trading days found. Data is up to date. [2025-09-14T16:30:21.203311] [INFO ] [MAIN ] Update Progress: 28/2370 symbols completed. AD took 1.4s. Estimated remaining: 16m 13s. Rate: 144.4 symbols/min [2025-09-14T16:30:21.328884] [INFO ] [MAIN ] ACVA: No missing trading days found. Data is up to date. [2025-09-14T16:30:21.466189] [INFO ] [MAIN ] Update Progress: 29/2370 symbols completed. ACVA took 1.7s. Estimated remaining: 16m 0s. Rate: 146.3 symbols/min [2025-09-14T16:30:21.488797] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:21.838072] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:21.863632] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:21.875489] [DEBUG] [LOCAL ] ADC: Loaded 20466 existing records from primary storage. [2025-09-14T16:30:21.914025] [INFO ] [MAIN ] ADC: Loaded 20466 existing records. [2025-09-14T16:30:21.975407] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:22.153387] [INFO ] [MAIN ] ADC: No missing trading days found. Data is up to date. [2025-09-14T16:30:22.154997] [DEBUG] [LOCAL ] ADM: Loaded 23929 existing records from primary storage. [2025-09-14T16:30:22.154221] [INFO ] [MAIN ] Update Progress: 30/2370 symbols completed. ADC took 1.4s. Estimated remaining: 16m 22s. Rate: 143.0 symbols/min [2025-09-14T16:30:22.154459] [DEBUG] [LOCAL ] ADCT: Loaded 16452 existing records from primary storage. [2025-09-14T16:30:22.155470] [INFO ] [MAIN ] ADM: Loaded 23929 existing records. [2025-09-14T16:30:22.166414] [INFO ] [MAIN ] ADCT: Loaded 16452 existing records. [2025-09-14T16:30:22.437718] [DEBUG] [LOCAL ] ADNT: Loaded 20986 existing records from primary storage. [2025-09-14T16:30:22.438007] [INFO ] [MAIN ] ADNT: Loaded 20986 existing records. [2025-09-14T16:30:22.636876] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:22.686907] [INFO ] [MAIN ] ADCT: No missing trading days found. Data is up to date. [2025-09-14T16:30:22.768519] [INFO ] [MAIN ] Update Progress: 31/2370 symbols completed. ADCT took 1.6s. Estimated remaining: 16m 36s. Rate: 140.9 symbols/min [2025-09-14T16:30:22.780315] [INFO ] [MAIN ] ADM: No missing trading days found. Data is up to date. [2025-09-14T16:30:22.810353] [INFO ] [MAIN ] Update Progress: 32/2370 symbols completed. ADM took 1.6s. Estimated remaining: 16m 7s. Rate: 145.0 symbols/min [2025-09-14T16:30:23.033343] [INFO ] [MAIN ] ADNT: No missing trading days found. Data is up to date. [2025-09-14T16:30:23.065941] [INFO ] [MAIN ] Update Progress: 33/2370 symbols completed. ADNT took 1.6s. Estimated remaining: 15m 56s. Rate: 146.7 symbols/min [2025-09-14T16:30:23.180711] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:23.189233] [DEBUG] [LOCAL ] ADT: Loaded 23933 existing records from primary storage. [2025-09-14T16:30:23.208631] [INFO ] [MAIN ] ADT: Loaded 23933 existing records. [2025-09-14T16:30:23.371803] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:23.513828] [DEBUG] [LOCAL ] ADX: Loaded 12600 existing records from primary storage. [2025-09-14T16:30:23.569960] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:23.575826] [INFO ] [MAIN ] ADX: Loaded 12600 existing records. [2025-09-14T16:30:23.611061] [INFO ] [MAIN ] ADT: No missing trading days found. Data is up to date. [2025-09-14T16:30:23.618291] [INFO ] [MAIN ] Update Progress: 34/2370 symbols completed. ADT took 1.5s. Estimated remaining: 16m 5s. Rate: 145.2 symbols/min [2025-09-14T16:30:23.680978] [DEBUG] [LOCAL ] AEFC: Loaded 3302 existing records from primary storage. [2025-09-14T16:30:23.764967] [INFO ] [MAIN ] AEFC: Loaded 3302 existing records. [2025-09-14T16:30:23.784543] [DEBUG] [LOCAL ] AEE: Loaded 22433 existing records from primary storage. [2025-09-14T16:30:23.800929] [INFO ] [MAIN ] AEE: Loaded 22433 existing records. [2025-09-14T16:30:24.163244] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:24.206129] [INFO ] [MAIN ] ADX: No missing trading days found. Data is up to date. [2025-09-14T16:30:24.252208] [INFO ] [MAIN ] Update Progress: 35/2370 symbols completed. ADX took 1.5s. Estimated remaining: 16m 19s. Rate: 143.0 symbols/min [2025-09-14T16:30:24.371095] [INFO ] [MAIN ] AEE: No missing trading days found. Data is up to date. [2025-09-14T16:30:24.373517] [INFO ] [MAIN ] AEFC: No missing trading days found. Data is up to date. [2025-09-14T16:30:24.399711] [INFO ] [MAIN ] Update Progress: 36/2370 symbols completed. AEE took 1.6s. Estimated remaining: 16m 1s. Rate: 145.7 symbols/min [2025-09-14T16:30:24.459497] [INFO ] [MAIN ] Update Progress: 37/2370 symbols completed. AEFC took 1.3s. Estimated remaining: 15m 39s. Rate: 149.1 symbols/min [2025-09-14T16:30:24.563956] [DEBUG] [LOCAL ] AEG: Loaded 21976 existing records from primary storage. [2025-09-14T16:30:24.597093] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:24.619327] [INFO ] [MAIN ] AEG: Loaded 21976 existing records. [2025-09-14T16:30:24.834206] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:24.927917] [INFO ] [MAIN ] AEG: No missing trading days found. Data is up to date. [2025-09-14T16:30:24.930388] [INFO ] [MAIN ] Update Progress: 38/2370 symbols completed. AEG took 1.3s. Estimated remaining: 15m 43s. Rate: 148.4 symbols/min [2025-09-14T16:30:24.931935] [DEBUG] [LOCAL ] AEM: Loaded 23918 existing records from primary storage. [2025-09-14T16:30:24.932036] [INFO ] [MAIN ] AEM: Loaded 23918 existing records. [2025-09-14T16:30:25.111960] [DEBUG] [LOCAL ] AEO: Loaded 24035 existing records from primary storage. [2025-09-14T16:30:25.120086] [INFO ] [MAIN ] AEO: Loaded 24035 existing records. [2025-09-14T16:30:25.120031] [INFO ] [MAIN ] AEM: No missing trading days found. Data is up to date. [2025-09-14T16:30:25.182880] [INFO ] [MAIN ] Update Progress: 39/2370 symbols completed. AEM took 0.9s. Estimated remaining: 15m 33s. Rate: 149.9 symbols/min [2025-09-14T16:30:25.304136] [INFO ] [MAIN ] AEO: No missing trading days found. Data is up to date. [2025-09-14T16:30:25.305014] [INFO ] [MAIN ] Update Progress: 40/2370 symbols completed. AEO took 0.8s. Estimated remaining: 15m 17s. Rate: 152.5 symbols/min [2025-09-14T16:30:26.214492] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:26.264966] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:26.339467] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:26.396393] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:26.424845] [DEBUG] [LOCAL ] AFB: Loaded 4658 existing records from primary storage. [2025-09-14T16:30:26.425447] [INFO ] [MAIN ] AFB: Loaded 4658 existing records. [2025-09-14T16:30:26.560311] [DEBUG] [LOCAL ] AES: Loaded 24036 existing records from primary storage. [2025-09-14T16:30:26.590474] [INFO ] [MAIN ] AES: Loaded 24036 existing records. [2025-09-14T16:30:26.590845] [DEBUG] [LOCAL ] AER: Loaded 21504 existing records from primary storage. [2025-09-14T16:30:26.591422] [DEBUG] [LOCAL ] AESI: Loaded 21926 existing records from primary storage. [2025-09-14T16:30:26.648924] [INFO ] [MAIN ] AER: Loaded 21504 existing records. [2025-09-14T16:30:26.724838] [INFO ] [MAIN ] AESI: Loaded 21926 existing records. [2025-09-14T16:30:26.835785] [INFO ] [MAIN ] AFB: No missing trading days found. Data is up to date. [2025-09-14T16:30:26.877106] [INFO ] [MAIN ] Update Progress: 41/2370 symbols completed. AFB took 1.6s. Estimated remaining: 16m 23s. Rate: 142.1 symbols/min [2025-09-14T16:30:27.122357] [INFO ] [MAIN ] AES: No missing trading days found. Data is up to date. [2025-09-14T16:30:27.261017] [INFO ] [MAIN ] AER: No missing trading days found. Data is up to date. [2025-09-14T16:30:27.259946] [INFO ] [MAIN ] Update Progress: 42/2370 symbols completed. AES took 2.0s. Estimated remaining: 16m 21s. Rate: 142.5 symbols/min [2025-09-14T16:30:27.318507] [INFO ] [MAIN ] AESI: No missing trading days found. Data is up to date. [2025-09-14T16:30:27.324358] [INFO ] [MAIN ] Update Progress: 43/2370 symbols completed. AER took 2.0s. Estimated remaining: 16m 1s. Rate: 145.3 symbols/min [2025-09-14T16:30:27.398255] [INFO ] [MAIN ] Update Progress: 44/2370 symbols completed. AESI took 2.0s. Estimated remaining: 15m 42s. Rate: 148.1 symbols/min [2025-09-14T16:30:27.678529] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:27.914092] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:27.946670] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:27.980134] [DEBUG] [LOCAL ] AFG: Loaded 14359 existing records from primary storage. [2025-09-14T16:30:28.007091] [INFO ] [MAIN ] AFG: Loaded 14359 existing records. [2025-09-14T16:30:28.075921] [DEBUG] [LOCAL ] AFGC: Loaded 1425 existing records from primary storage. [2025-09-14T16:30:28.070546] [DEBUG] [LOCAL ] AFGB: Loaded 928 existing records from primary storage. [2025-09-14T16:30:28.091721] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:28.091837] [INFO ] [MAIN ] AFGC: Loaded 1425 existing records. [2025-09-14T16:30:28.112777] [INFO ] [MAIN ] AFGB: Loaded 928 existing records. [2025-09-14T16:30:28.161573] [DEBUG] [LOCAL ] AFGD: Loaded 700 existing records from primary storage. [2025-09-14T16:30:28.240876] [INFO ] [MAIN ] AFGD: Loaded 700 existing records. [2025-09-14T16:30:28.407339] [INFO ] [MAIN ] AFG: No missing trading days found. Data is up to date. [2025-09-14T16:30:28.476947] [INFO ] [MAIN ] Update Progress: 45/2370 symbols completed. AFG took 1.5s. Estimated remaining: 16m 17s. Rate: 142.8 symbols/min [2025-09-14T16:30:28.840169] [INFO ] [MAIN ] AFGB: No missing trading days found. Data is up to date. [2025-09-14T16:30:28.780908] [INFO ] [MAIN ] AFGC: No missing trading days found. Data is up to date. [2025-09-14T16:30:28.893638] [INFO ] [MAIN ] AFGD: No missing trading days found. Data is up to date. [2025-09-14T16:30:28.899377] [INFO ] [MAIN ] Update Progress: 46/2370 symbols completed. AFGB took 1.6s. Estimated remaining: 16m 17s. Rate: 142.8 symbols/min [2025-09-14T16:30:28.934603] [INFO ] [MAIN ] Update Progress: 47/2370 symbols completed. AFGC took 1.5s. Estimated remaining: 15m 57s. Rate: 145.6 symbols/min [2025-09-14T16:30:28.984522] [INFO ] [MAIN ] Update Progress: 48/2370 symbols completed. AFGD took 1.5s. Estimated remaining: 15m 39s. Rate: 148.3 symbols/min [2025-09-14T16:30:29.440439] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:29.404081] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:29.547398] [DEBUG] [LOCAL ] AFGE: Loaded 1199 existing records from primary storage. [2025-09-14T16:30:29.585135] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:29.595750] [INFO ] [MAIN ] AFGE: Loaded 1199 existing records. [2025-09-14T16:30:29.657468] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:29.779204] [DEBUG] [LOCAL ] AG: Loaded 6234 existing records from primary storage. [2025-09-14T16:30:29.786829] [DEBUG] [LOCAL ] AFL: Loaded 23755 existing records from primary storage. [2025-09-14T16:30:29.805936] [INFO ] [MAIN ] AG: Loaded 6234 existing records. [2025-09-14T16:30:29.806323] [DEBUG] [LOCAL ] AGCO: Loaded 4654 existing records from primary storage. [2025-09-14T16:30:29.834075] [INFO ] [MAIN ] AFL: Loaded 23755 existing records. [2025-09-14T16:30:29.881190] [INFO ] [MAIN ] AFGE: No missing trading days found. Data is up to date. [2025-09-14T16:30:29.873709] [INFO ] [MAIN ] AGCO: Loaded 4654 existing records. [2025-09-14T16:30:29.928062] [INFO ] [MAIN ] Update Progress: 49/2370 symbols completed. AFGE took 1.4s. Estimated remaining: 16m 4s. Rate: 144.4 symbols/min [2025-09-14T16:30:30.406855] [INFO ] [MAIN ] AG: No missing trading days found. Data is up to date. [2025-09-14T16:30:30.449063] [INFO ] [MAIN ] Update Progress: 50/2370 symbols completed. AG took 1.5s. Estimated remaining: 16m 9s. Rate: 143.7 symbols/min [2025-09-14T16:30:30.577743] [INFO ] [MAIN ] AGCO: No missing trading days found. Data is up to date. [2025-09-14T16:30:30.642785] [INFO ] [MAIN ] Update Progress: 51/2370 symbols completed. AGCO took 1.5s. Estimated remaining: 15m 58s. Rate: 145.2 symbols/min [2025-09-14T16:30:30.683089] [INFO ] [MAIN ] AFL: No missing trading days found. Data is up to date. [2025-09-14T16:30:30.721266] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:30.737141] [INFO ] [MAIN ] Update Progress: 52/2370 symbols completed. AFL took 1.8s. Estimated remaining: 15m 44s. Rate: 147.4 symbols/min [2025-09-14T16:30:30.911106] [DEBUG] [LOCAL ] AGD: Loaded 2313 existing records from primary storage. [2025-09-14T16:30:30.990012] [INFO ] [MAIN ] AGD: Loaded 2313 existing records. [2025-09-14T16:30:31.316526] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:31.278237] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:31.375737] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:31.471943] [INFO ] [MAIN ] AGD: No missing trading days found. Data is up to date. [2025-09-14T16:30:31.472345] [DEBUG] [LOCAL ] AGM: Loaded 4970 existing records from primary storage. [2025-09-14T16:30:31.474970] [INFO ] [MAIN ] Update Progress: 53/2370 symbols completed. AGD took 1.4s. Estimated remaining: 15m 58s. Rate: 145.2 symbols/min [2025-09-14T16:30:31.476175] [INFO ] [MAIN ] AGM: Loaded 4970 existing records. [2025-09-14T16:30:31.572366] [DEBUG] [LOCAL ] AGI: Loaded 23883 existing records from primary storage. [2025-09-14T16:30:31.589270] [DEBUG] [LOCAL ] AGL: Loaded 23346 existing records from primary storage. [2025-09-14T16:30:31.618786] [INFO ] [MAIN ] AGL: Loaded 23346 existing records. [2025-09-14T16:30:31.609617] [INFO ] [MAIN ] AGI: Loaded 23883 existing records. [2025-09-14T16:30:32.099188] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:32.070857] [INFO ] [MAIN ] AGM: No missing trading days found. Data is up to date. [2025-09-14T16:30:32.140469] [INFO ] [MAIN ] Update Progress: 54/2370 symbols completed. AGM took 1.3s. Estimated remaining: 16m 8s. Rate: 143.6 symbols/min [2025-09-14T16:30:32.210938] [INFO ] [MAIN ] AGI: No missing trading days found. Data is up to date. [2025-09-14T16:30:32.249659] [INFO ] [MAIN ] AGL: No missing trading days found. Data is up to date. [2025-09-14T16:30:32.269630] [INFO ] [MAIN ] Update Progress: 55/2370 symbols completed. AGI took 1.7s. Estimated remaining: 15m 55s. Rate: 145.4 symbols/min [2025-09-14T16:30:32.299688] [INFO ] [MAIN ] Update Progress: 56/2370 symbols completed. AGL took 1.6s. Estimated remaining: 15m 39s. Rate: 147.8 symbols/min [2025-09-14T16:30:32.404373] [DEBUG] [LOCAL ] AGO: Loaded 12293 existing records from primary storage. [2025-09-14T16:30:32.538695] [INFO ] [MAIN ] AGO: Loaded 12293 existing records. [2025-09-14T16:30:32.710213] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:32.847732] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:32.950542] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:33.017659] [INFO ] [MAIN ] AGO: No missing trading days found. Data is up to date. [2025-09-14T16:30:33.019032] [INFO ] [MAIN ] Update Progress: 57/2370 symbols completed. AGO took 1.5s. Estimated remaining: 15m 52s. Rate: 145.9 symbols/min [2025-09-14T16:30:33.020136] [DEBUG] [LOCAL ] AGX: Loaded 14694 existing records from primary storage. [2025-09-14T16:30:33.032302] [INFO ] [MAIN ] AGX: Loaded 14694 existing records. [2025-09-14T16:30:33.048872] [WARN ] [STATE ] Received SIGINT signal. Initiating graceful shutdown... [2025-09-14T16:30:33.083334] [DEBUG] [LOCAL ] AGRO: Loaded 13326 existing records from primary storage. [2025-09-14T16:30:33.140243] [WARN ] [STATE ] Operation was interrupted, setting state to COMPLETED_ERROR [2025-09-14T16:30:33.257670] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-14T16:30:33.313507] [DEBUG] [LOCAL ] AHH: Loaded 17265 existing records from primary storage. [2025-09-14T16:30:33.333221] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:33.354676] [INFO ] [STATE ] Last completion updated: 2025-09-14T16:30:33.310668 [2025-09-14T16:30:33.376153] [WARN ] [MAIN ] Main thread: Shutdown detected, cancelling 2 pending tasks [2025-09-14T16:30:33.405033] [WARN ] [MAIN ] Shutting down thread pool executor... [2025-09-14T16:30:33.423785] [DEBUG] [LOCAL ] AHL: Loaded 10934 existing records from primary storage. [2025-09-14T16:30:33.424073] [WARN ] [MAIN ] Update INTERRUPTED after 23.9s. Processed 61/2370 symbols before shutdown. [2025-09-14T16:30:33.871610] [WARN ] [STATE ] Already shutting down, please wait... [2025-09-14T16:30:33.918481] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Update Failed' [2025-09-14T16:30:33.919312] [WARN ] [STATE ] State set to: RUNNING [2025-09-14T16:30:33.919391] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-14T16:30:33.919540] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-14T16:30:33.919624] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-14T16:30:33.919809] [INFO ] [LOCAL ] Deleted 0 derivative data files. [2025-09-14T16:30:33.919866] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-14T16:30:33.922315] [INFO ] [LOCAL ] Found 2360 symbols with primary data. [2025-09-14T16:30:33.922565] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2360 symbols [2025-09-14T16:30:33.922680] [WARN ] [MAIN ] Main thread: Shutdown detected, stopping task submission [2025-09-14T16:30:33.922734] [WARN ] [MAIN ] Shutting down thread pool executor... [2025-09-14T16:30:33.922797] [WARN ] [MAIN ] Derivative generation INTERRUPTED after 0.0s. Processed 0/2360 symbols before shutdown. [2025-09-14T16:30:34.419198] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Derivative Generation Failed' [2025-09-14T16:30:34.419730] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-14T16:30:34.419881] [INFO ] [STATE ] Last completion updated: 2025-09-14T16:30:34.419798 [2025-09-14T16:30:34.420213] [INFO ] [STATE ] TDM shutdown complete. [2025-09-14T16:37:10.662735] [INFO ] [MAIN ] Using last completed trading day: 2025-09-12 [2025-09-14T16:37:10.662905] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-14T16:37:10.663012] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-14T16:37:10.663075] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-14T16:37:11.657847] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-09-14T16:37:11.658019] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-14T16:37:11.658227] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-14T16:37:11.658746] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-09-14T16:37:11.658805] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-14T16:37:11.658838] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-14T16:37:11.658902] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-14T16:37:11.659009] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-14T16:37:11.659385] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-09-14T16:37:11.659434] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-14T16:37:11.659602] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-14T16:37:11.659667] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-09-14T16:37:11.659711] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-14T16:37:11.659754] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-14T16:37:11.688396] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-14T16:37:11.688550] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-14T16:37:11.688626] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-14T16:37:11.688696] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-14T16:37:11.688735] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-14T16:37:11.688913] [WARN ] [STATE ] State set to: RUNNING [2025-09-14T16:37:11.689004] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-14T16:37:11.689374] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-09-14T16:37:11.689423] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-14T16:37:11.689468] [INFO ] [MAIN ] Starting incremental update for 2370 symbols. [2025-09-14T16:37:11.689506] [INFO ] [MAIN ] Running in parallel mode [2025-09-14T16:37:11.689613] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2370 symbols [2025-09-14T16:37:12.293274] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:12.426685] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:12.423865] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:12.428224] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:12.437108] [DEBUG] [LOCAL ] AAM: Loaded 324 existing records from primary storage. [2025-09-14T16:37:12.437519] [INFO ] [MAIN ] AAM: Loaded 324 existing records. [2025-09-14T16:37:12.563232] [DEBUG] [LOCAL ] AACT: Loaded 4723 existing records from primary storage. [2025-09-14T16:37:12.590225] [INFO ] [MAIN ] AACT: Loaded 4723 existing records. [2025-09-14T16:37:12.686085] [WARN ] [MAIN ] AAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:12.771188] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-14T16:37:12.752813] [DEBUG] [LOCAL ] AA: Loaded 23992 existing records from primary storage. [2025-09-14T16:37:12.774663] [INFO ] [MAIN ] AA: Loaded 23992 existing records. [2025-09-14T16:37:12.753445] [DEBUG] [LOCAL ] A: Loaded 22259 existing records from primary storage. [2025-09-14T16:37:12.774749] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-14T16:37:12.800797] [INFO ] [MAIN ] A: Loaded 22259 existing records. [2025-09-14T16:37:12.840765] [DEBUG] [LOCAL ] AAM: Deleted primary data file. [2025-09-14T16:37:13.026448] [WARN ] [MAIN ] AACT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:13.042675] [DEBUG] [LOCAL ] AAM: Removed from QA tracker. [2025-09-14T16:37:13.080351] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-14T16:37:13.068674] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-14T16:37:13.129571] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-14T16:37:13.283844] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:13.302412] [DEBUG] [LOCAL ] AACT: Deleted primary data file. [2025-09-14T16:37:13.302803] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-14T16:37:13.358508] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-14T16:37:13.358419] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:13.391769] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-14T16:37:13.386336] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-14T16:37:13.397075] [DEBUG] [LOCAL ] AACT: Removed from QA tracker. [2025-09-14T16:37:13.416829] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-14T16:37:13.416540] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-14T16:37:13.439284] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-14T16:37:13.490319] [DEBUG] [LOCAL ] AA: Removed from QA tracker. [2025-09-14T16:37:13.563413] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-14T16:37:13.594748] [DEBUG] [LOCAL ] A: Removed from QA tracker. [2025-09-14T16:37:13.653690] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-14T16:37:14.734905] [INFO ] [REMOTE ] AAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:14.958697] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-14T16:37:15.063125] [INFO ] [REMOTE ] AA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:15.126231] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-14T16:37:15.161447] [INFO ] [REMOTE ] AACT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:15.198514] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-14T16:37:15.230163] [INFO ] [REMOTE ] A: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:15.230923] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-14T16:37:15.592626] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T16:37:15.595543] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-14T16:37:15.595657] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-14T16:37:15.597425] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-14T16:37:16.148404] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T16:37:16.149498] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-14T16:37:16.183048] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T16:37:16.184766] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-14T16:37:16.562725] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-14T16:37:16.563810] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-14T16:37:16.859104] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T16:37:16.888186] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-14T16:37:16.900033] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-14T16:37:16.888959] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-14T16:37:16.903539] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T16:37:16.914039] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-14T16:37:17.101910] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T16:37:17.104553] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-14T16:37:17.189525] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-14T16:37:17.190473] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-14T16:37:17.473407] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-14T16:37:17.474366] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-14T16:37:17.806570] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-14T16:37:17.807703] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-14T16:37:17.930250] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T16:37:17.932864] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-14T16:37:18.110938] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T16:37:18.111669] [INFO ] [REMOTE ] AAM: Full fetch complete (708 records). [2025-09-14T16:37:18.111766] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-14T16:37:18.293450] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-14T16:37:18.293676] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:37:18.293730] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:37:18.293789] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-14T16:37:18.293865] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-14T16:37:18.293916] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-14T16:37:18.293962] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-14T16:37:18.294062] [INFO ] [MAIN ] Update Progress: 1/2370 symbols completed. AAM took 6.6s. Estimated remaining: 4h 20m 46s. Rate: 9.1 symbols/min [2025-09-14T16:37:18.464874] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:18.480282] [DEBUG] [LOCAL ] AAMI: Loaded 11127 existing records from primary storage. [2025-09-14T16:37:18.480427] [INFO ] [MAIN ] AAMI: Loaded 11127 existing records. [2025-09-14T16:37:18.659185] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:18.659572] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-14T16:37:18.659659] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-14T16:37:18.660296] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-09-14T16:37:18.660895] [DEBUG] [LOCAL ] AAMI: Removed from QA tracker. [2025-09-14T16:37:18.660963] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-14T16:37:18.793745] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T16:37:18.952415] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-14T16:37:18.995816] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T16:37:19.078873] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:19.079200] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-14T16:37:19.079748] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-14T16:37:19.159227] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-14T16:37:19.170619] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-14T16:37:19.942218] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T16:37:19.945300] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-14T16:37:20.049736] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T16:37:20.053561] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-14T16:37:20.517604] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T16:37:20.520544] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-14T16:37:20.894729] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T16:37:20.906385] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-14T16:37:21.173798] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T16:37:21.178906] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-14T16:37:21.236153] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T16:37:21.238257] [INFO ] [REMOTE ] AACT: Full fetch complete (9334 records). [2025-09-14T16:37:21.238358] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-14T16:37:21.636535] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-14T16:37:21.669392] [DEBUG] [VALIDATOR ] AACT: All expected trading days are present. [2025-09-14T16:37:21.669793] [DEBUG] [VALIDATOR ] AACT: Primary data validation passed. [2025-09-14T16:37:21.670006] [INFO ] [MAIN ] AACT: Fetched primary data is valid. [2025-09-14T16:37:21.670289] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-14T16:37:21.670420] [DEBUG] [LOCAL ] AACT: Saving primary data. [2025-09-14T16:37:21.671997] [DEBUG] [LOCAL ] AACT: Trimmed 9334 records to 8258 (keeping 150 days of data) [2025-09-14T16:37:21.724419] [DEBUG] [LOCAL ] AACT: Primary data saved (8258 records). [2025-09-14T16:37:21.724576] [INFO ] [MAIN ] AACT: Full history saved. [2025-09-14T16:37:21.724716] [INFO ] [MAIN ] Update Progress: 2/2370 symbols completed. AACT took 10.0s. Estimated remaining: 3h 18m 2s. Rate: 12.0 symbols/min [2025-09-14T16:37:21.897259] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:21.920466] [DEBUG] [LOCAL ] AAP: Loaded 23111 existing records from primary storage. [2025-09-14T16:37:21.920634] [INFO ] [MAIN ] AAP: Loaded 23111 existing records. [2025-09-14T16:37:22.101722] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:22.102003] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-14T16:37:22.102068] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-14T16:37:22.102730] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-14T16:37:22.103297] [DEBUG] [LOCAL ] AAP: Removed from QA tracker. [2025-09-14T16:37:22.103364] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-14T16:37:22.511866] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T16:37:22.517249] [INFO ] [REMOTE ] AAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:22.523571] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-14T16:37:22.524385] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-14T16:37:22.606605] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T16:37:22.618301] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-14T16:37:23.495802] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T16:37:23.501431] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-14T16:37:23.734044] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T16:37:23.745635] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-14T16:37:23.992514] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T16:37:24.002567] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-14T16:37:24.030765] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T16:37:24.041736] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-14T16:37:24.684474] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T16:37:24.689757] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-14T16:37:25.693110] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T16:37:25.704284] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-14T16:37:25.842623] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T16:37:25.854165] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-14T16:37:25.889797] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T16:37:25.896344] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-14T16:37:26.016551] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T16:37:26.027962] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-14T16:37:27.079495] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T16:37:27.085311] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-14T16:37:27.350475] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T16:37:27.356523] [INFO ] [REMOTE ] AAMI: Full fetch complete (26022 records). [2025-09-14T16:37:27.356725] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-14T16:37:27.778458] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-09-14T16:37:27.780375] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T16:37:27.780441] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-09-14T16:37:27.791950] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-09-14T16:37:27.792278] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-09-14T16:37:27.794092] [DEBUG] [LOCAL ] AAMI: Trimmed 26022 records to 18336 (keeping 150 days of data) [2025-09-14T16:37:27.793965] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-14T16:37:27.936449] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T16:37:27.977444] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-14T16:37:27.983090] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T16:37:27.997619] [DEBUG] [LOCAL ] AAMI: Primary data saved (18336 records). [2025-09-14T16:37:27.998395] [INFO ] [MAIN ] AAMI: Full history saved. [2025-09-14T16:37:27.998676] [INFO ] [MAIN ] Update Progress: 3/2370 symbols completed. AAMI took 9.7s. Estimated remaining: 3h 34m 28s. Rate: 11.0 symbols/min [2025-09-14T16:37:28.004838] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-14T16:37:28.174284] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:28.190460] [DEBUG] [LOCAL ] AAT: Loaded 13479 existing records from primary storage. [2025-09-14T16:37:28.190636] [INFO ] [MAIN ] AAT: Loaded 13479 existing records. [2025-09-14T16:37:28.368917] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:28.369164] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-14T16:37:28.369225] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-14T16:37:28.369728] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-14T16:37:28.370333] [DEBUG] [LOCAL ] AAT: Removed from QA tracker. [2025-09-14T16:37:28.370393] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-14T16:37:28.733133] [INFO ] [REMOTE ] AAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:28.733540] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-14T16:37:28.747596] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T16:37:28.753289] [INFO ] [REMOTE ] A: Full fetch complete (55286 records). [2025-09-14T16:37:28.753415] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-14T16:37:29.138906] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-14T16:37:29.139018] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-14T16:37:29.139619] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-14T16:37:29.139710] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-14T16:37:29.141114] [DEBUG] [LOCAL ] A: Trimmed 55286 records to 38079 (keeping 150 days of data) [2025-09-14T16:37:29.397225] [DEBUG] [LOCAL ] A: Primary data saved (38079 records). [2025-09-14T16:37:29.397394] [INFO ] [MAIN ] A: Full history saved. [2025-09-14T16:37:29.397508] [INFO ] [MAIN ] Update Progress: 4/2370 symbols completed. A took 17.7s. Estimated remaining: 2h 54m 34s. Rate: 13.6 symbols/min [2025-09-14T16:37:29.566845] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:29.574757] [DEBUG] [LOCAL ] AAUC: Loaded 5794 existing records from primary storage. [2025-09-14T16:37:29.574900] [INFO ] [MAIN ] AAUC: Loaded 5794 existing records. [2025-09-14T16:37:29.755706] [WARN ] [MAIN ] AAUC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:29.756232] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-14T16:37:29.756340] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-14T16:37:29.756907] [DEBUG] [LOCAL ] AAUC: Deleted primary data file. [2025-09-14T16:37:29.757685] [DEBUG] [LOCAL ] AAUC: Removed from QA tracker. [2025-09-14T16:37:29.757755] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-14T16:37:30.095705] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-14T16:37:30.199949] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:30.179312] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-14T16:37:30.200517] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-14T16:37:30.217939] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T16:37:30.224112] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-14T16:37:30.264346] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-14T16:37:30.277700] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-14T16:37:30.497101] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:37:30.497507] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-14T16:37:30.498011] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-14T16:37:30.741700] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:37:30.742085] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-14T16:37:30.742582] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-14T16:37:30.811197] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:37:30.817145] [INFO ] [REMOTE ] AA: Full fetch complete (58254 records). [2025-09-14T16:37:30.817309] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-14T16:37:31.009490] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:37:31.071211] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-14T16:37:31.094950] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-14T16:37:31.241484] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-14T16:37:31.241844] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-14T16:37:31.242459] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-14T16:37:31.242681] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-14T16:37:31.244593] [DEBUG] [LOCAL ] AA: Trimmed 58254 records to 40362 (keeping 150 days of data) [2025-09-14T16:37:31.373706] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T16:37:31.384434] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-14T16:37:31.473966] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:37:31.508709] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-14T16:37:31.510167] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-14T16:37:31.548509] [DEBUG] [LOCAL ] AA: Primary data saved (40362 records). [2025-09-14T16:37:31.548709] [INFO ] [MAIN ] AA: Full history saved. [2025-09-14T16:37:31.548821] [INFO ] [MAIN ] Update Progress: 5/2370 symbols completed. AA took 19.9s. Estimated remaining: 2h 36m 33s. Rate: 15.1 symbols/min [2025-09-14T16:37:31.732787] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:31.745824] [DEBUG] [LOCAL ] AB: Loaded 10001 existing records from primary storage. [2025-09-14T16:37:31.746035] [INFO ] [MAIN ] AB: Loaded 10001 existing records. [2025-09-14T16:37:31.924895] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:31.925216] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-14T16:37:31.925301] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-14T16:37:31.925762] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-14T16:37:31.926450] [DEBUG] [LOCAL ] AB: Removed from QA tracker. [2025-09-14T16:37:31.926514] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-14T16:37:32.289603] [INFO ] [REMOTE ] AB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:32.290313] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-14T16:37:32.298412] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T16:37:32.301403] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-14T16:37:32.332499] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-14T16:37:32.345503] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-14T16:37:32.789959] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T16:37:32.797822] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-14T16:37:32.832522] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T16:37:32.835265] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-14T16:37:33.835044] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T16:37:33.856624] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T16:37:33.856030] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-14T16:37:33.862387] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-14T16:37:33.895533] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T16:37:33.907747] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-14T16:37:34.104715] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T16:37:34.111666] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-14T16:37:34.556287] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T16:37:34.558696] [INFO ] [REMOTE ] AAUC: Full fetch complete (6222 records). [2025-09-14T16:37:34.558809] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-14T16:37:34.742459] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 67 unique days, need 150 days [2025-09-14T16:37:34.742735] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:37:34.742798] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:37:34.742843] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-14T16:37:34.742917] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-14T16:37:34.742971] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-14T16:37:34.743017] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-14T16:37:34.743110] [INFO ] [MAIN ] Update Progress: 6/2370 symbols completed. AAUC took 5.3s. Estimated remaining: 2h 31m 23s. Rate: 15.6 symbols/min [2025-09-14T16:37:34.915160] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:34.939149] [DEBUG] [LOCAL ] ABBV: Loaded 24058 existing records from primary storage. [2025-09-14T16:37:34.939313] [INFO ] [MAIN ] ABBV: Loaded 24058 existing records. [2025-09-14T16:37:35.124576] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:35.125340] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-14T16:37:35.125537] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-14T16:37:35.126430] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-14T16:37:35.127227] [DEBUG] [LOCAL ] ABBV: Removed from QA tracker. [2025-09-14T16:37:35.127294] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-14T16:37:35.364697] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T16:37:35.465276] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-14T16:37:35.508187] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T16:37:35.574469] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:35.575008] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-14T16:37:35.576722] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-14T16:37:35.702424] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T16:37:35.713802] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-14T16:37:36.070665] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T16:37:36.075981] [INFO ] [REMOTE ] AAP: Full fetch complete (56703 records). [2025-09-14T16:37:36.076131] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-14T16:37:36.475758] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-14T16:37:36.475907] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-14T16:37:36.476748] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-14T16:37:36.476829] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-14T16:37:36.478578] [DEBUG] [LOCAL ] AAP: Trimmed 56703 records to 39164 (keeping 150 days of data) [2025-09-14T16:37:36.736465] [DEBUG] [LOCAL ] AAP: Primary data saved (39164 records). [2025-09-14T16:37:36.736761] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-14T16:37:36.736904] [INFO ] [MAIN ] Update Progress: 7/2370 symbols completed. AAP took 15.0s. Estimated remaining: 2h 20m 55s. Rate: 16.8 symbols/min [2025-09-14T16:37:36.915411] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:36.933310] [DEBUG] [LOCAL ] ABCB: Loaded 13335 existing records from primary storage. [2025-09-14T16:37:36.933562] [INFO ] [MAIN ] ABCB: Loaded 13335 existing records. [2025-09-14T16:37:37.139499] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:37.161987] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T16:37:37.162124] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-14T16:37:37.162305] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-14T16:37:37.172507] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-14T16:37:37.172678] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-14T16:37:37.193467] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T16:37:37.200503] [DEBUG] [LOCAL ] ABCB: Removed from QA tracker. [2025-09-14T16:37:37.201371] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-14T16:37:37.234309] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-14T16:37:37.565322] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:37.566003] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-14T16:37:37.619430] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T16:37:37.629901] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-14T16:37:38.482620] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T16:37:38.489123] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-14T16:37:38.566742] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T16:37:38.574045] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-14T16:37:38.603076] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T16:37:38.612629] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-14T16:37:39.271207] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T16:37:39.274552] [INFO ] [REMOTE ] AAT: Full fetch complete (33027 records). [2025-09-14T16:37:39.274698] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-14T16:37:39.658045] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-14T16:37:39.658236] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-14T16:37:39.658620] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-14T16:37:39.658697] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-14T16:37:39.659631] [DEBUG] [LOCAL ] AAT: Trimmed 33027 records to 22768 (keeping 150 days of data) [2025-09-14T16:37:39.786229] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T16:37:39.793032] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-14T16:37:39.863315] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-14T16:37:39.884038] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-14T16:37:39.887539] [DEBUG] [LOCAL ] AAT: Primary data saved (22768 records). [2025-09-14T16:37:39.887849] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-14T16:37:39.888111] [INFO ] [MAIN ] Update Progress: 8/2370 symbols completed. AAT took 11.9s. Estimated remaining: 2h 18m 46s. Rate: 17.0 symbols/min [2025-09-14T16:37:40.068106] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T16:37:40.093432] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:40.094359] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-14T16:37:40.119453] [DEBUG] [LOCAL ] ABEV: Loaded 23949 existing records from primary storage. [2025-09-14T16:37:40.119617] [INFO ] [MAIN ] ABEV: Loaded 23949 existing records. [2025-09-14T16:37:40.298908] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:40.299182] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-14T16:37:40.299243] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-14T16:37:40.299948] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-14T16:37:40.300463] [DEBUG] [LOCAL ] ABEV: Removed from QA tracker. [2025-09-14T16:37:40.300522] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-14T16:37:40.661055] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:40.661429] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-14T16:37:41.064385] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T16:37:41.070355] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-14T16:37:41.569682] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T16:37:41.582172] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-14T16:37:41.670764] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T16:37:41.682250] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-14T16:37:41.964715] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T16:37:41.970783] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-14T16:37:42.433447] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:37:42.443792] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-14T16:37:42.900170] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T16:37:42.914593] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-14T16:37:42.916425] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T16:37:42.919929] [INFO ] [REMOTE ] AB: Full fetch complete (33796 records). [2025-09-14T16:37:42.920077] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-14T16:37:43.295370] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-14T16:37:43.295483] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-14T16:37:43.295953] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-14T16:37:43.296014] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-14T16:37:43.296925] [DEBUG] [LOCAL ] AB: Trimmed 33796 records to 18396 (keeping 150 days of data) [2025-09-14T16:37:43.411872] [DEBUG] [LOCAL ] AB: Primary data saved (18396 records). [2025-09-14T16:37:43.412140] [INFO ] [MAIN ] AB: Full history saved. [2025-09-14T16:37:43.412289] [INFO ] [MAIN ] Update Progress: 9/2370 symbols completed. AB took 11.9s. Estimated remaining: 2h 18m 42s. Rate: 17.0 symbols/min [2025-09-14T16:37:43.595307] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:43.605214] [DEBUG] [LOCAL ] ABG: Loaded 8212 existing records from primary storage. [2025-09-14T16:37:43.605371] [INFO ] [MAIN ] ABG: Loaded 8212 existing records. [2025-09-14T16:37:43.767457] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T16:37:43.830477] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:43.831003] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-14T16:37:43.831118] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-14T16:37:43.832038] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-14T16:37:43.832439] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-14T16:37:43.833169] [DEBUG] [LOCAL ] ABG: Removed from QA tracker. [2025-09-14T16:37:43.833233] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-14T16:37:44.164546] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:37:44.239565] [INFO ] [REMOTE ] ABG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:44.234337] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-14T16:37:44.241493] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-14T16:37:44.446690] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T16:37:44.458260] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-14T16:37:45.311706] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T16:37:45.315942] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-14T16:37:45.517467] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T16:37:45.525516] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-14T16:37:45.689202] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T16:37:45.700842] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-14T16:37:46.428740] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T16:37:46.433939] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-14T16:37:46.476356] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T16:37:46.489067] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-14T16:37:46.574047] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T16:37:46.581204] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-14T16:37:46.838105] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-14T16:37:46.842937] [INFO ] [REMOTE ] ABCB: Full fetch complete (33236 records). [2025-09-14T16:37:46.843124] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-14T16:37:47.242078] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-14T16:37:47.242236] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-14T16:37:47.242729] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-14T16:37:47.242818] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-14T16:37:47.243972] [DEBUG] [LOCAL ] ABCB: Trimmed 33236 records to 22109 (keeping 150 days of data) [2025-09-14T16:37:47.377108] [DEBUG] [LOCAL ] ABCB: Primary data saved (22109 records). [2025-09-14T16:37:47.377280] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-14T16:37:47.377411] [INFO ] [MAIN ] Update Progress: 10/2370 symbols completed. ABCB took 10.6s. Estimated remaining: 2h 20m 22s. Rate: 16.8 symbols/min [2025-09-14T16:37:47.580619] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:47.596285] [DEBUG] [LOCAL ] ABM: Loaded 14683 existing records from primary storage. [2025-09-14T16:37:47.596441] [INFO ] [MAIN ] ABM: Loaded 14683 existing records. [2025-09-14T16:37:47.780730] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:47.781200] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-14T16:37:47.781300] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-14T16:37:47.781975] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-14T16:37:47.782546] [DEBUG] [LOCAL ] ABM: Removed from QA tracker. [2025-09-14T16:37:47.782619] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-14T16:37:47.955931] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T16:37:48.045835] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-14T16:37:48.190438] [INFO ] [REMOTE ] ABM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:48.190871] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-14T16:37:48.324909] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T16:37:48.336665] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-14T16:37:48.868394] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T16:37:48.872044] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-14T16:37:49.249585] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T16:37:49.255092] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-14T16:37:49.671516] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T16:37:49.675479] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-14T16:37:50.024507] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T16:37:50.035547] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-14T16:37:50.297434] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:37:50.304635] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-14T16:37:50.771513] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T16:37:50.776559] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-14T16:37:51.179897] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (5.48 seconds). [2025-09-14T16:37:51.192345] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-14T16:37:51.614158] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T16:37:51.627685] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-14T16:37:51.898471] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T16:37:51.903924] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-14T16:37:51.927052] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T16:37:51.935385] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-14T16:37:52.363708] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T16:37:52.365740] [INFO ] [REMOTE ] ABG: Full fetch complete (20418 records). [2025-09-14T16:37:52.365846] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-14T16:37:52.739412] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-14T16:37:52.739538] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-14T16:37:52.739909] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-14T16:37:52.740010] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-14T16:37:52.740946] [DEBUG] [LOCAL ] ABG: Trimmed 20418 records to 13231 (keeping 150 days of data) [2025-09-14T16:37:52.823759] [DEBUG] [LOCAL ] ABG: Primary data saved (13231 records). [2025-09-14T16:37:52.823942] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-14T16:37:52.824103] [INFO ] [MAIN ] Update Progress: 11/2370 symbols completed. ABG took 9.4s. Estimated remaining: 2h 27m 1s. Rate: 16.0 symbols/min [2025-09-14T16:37:52.997733] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:53.020972] [DEBUG] [LOCAL ] ABR: Loaded 23060 existing records from primary storage. [2025-09-14T16:37:53.021148] [INFO ] [MAIN ] ABR: Loaded 23060 existing records. [2025-09-14T16:37:53.202635] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:53.202966] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-14T16:37:53.203157] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-14T16:37:53.209035] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-14T16:37:53.218284] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T16:37:53.223689] [DEBUG] [LOCAL ] ABR: Removed from QA tracker. [2025-09-14T16:37:53.224122] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-14T16:37:53.255829] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-14T16:37:53.590217] [INFO ] [REMOTE ] ABR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:53.590700] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-14T16:37:53.622834] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T16:37:53.665119] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-14T16:37:53.672280] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-14T16:37:53.684784] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-14T16:37:54.325473] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:37:54.331215] [INFO ] [REMOTE ] ABBV: Full fetch complete (58362 records). [2025-09-14T16:37:54.331381] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-14T16:37:54.730601] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-14T16:37:54.730873] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-14T16:37:54.731573] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-14T16:37:54.731687] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-14T16:37:54.733233] [DEBUG] [LOCAL ] ABBV: Trimmed 58362 records to 40433 (keeping 150 days of data) [2025-09-14T16:37:54.859047] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T16:37:54.870076] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-14T16:37:54.985390] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T16:37:55.019755] [INFO ] [REMOTE ] ABEV: Full fetch complete (57892 records). [2025-09-14T16:37:55.021389] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-14T16:37:55.432173] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-14T16:37:55.433155] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-14T16:37:55.435187] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-14T16:37:55.436107] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-14T16:37:55.441616] [DEBUG] [LOCAL ] ABEV: Trimmed 57892 records to 40061 (keeping 150 days of data) [2025-09-14T16:37:55.583144] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T16:37:55.584685] [DEBUG] [LOCAL ] ABBV: Primary data saved (40433 records). [2025-09-14T16:37:55.595225] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-14T16:37:55.595935] [INFO ] [MAIN ] Update Progress: 12/2370 symbols completed. ABBV took 20.9s. Estimated remaining: 2h 23m 48s. Rate: 16.4 symbols/min [2025-09-14T16:37:55.596763] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-14T16:37:55.780424] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:55.811785] [DEBUG] [LOCAL ] ABT: Loaded 24020 existing records from primary storage. [2025-09-14T16:37:55.813954] [INFO ] [MAIN ] ABT: Loaded 24020 existing records. [2025-09-14T16:37:56.093516] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:56.095528] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-14T16:37:56.104341] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-14T16:37:56.105714] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-14T16:37:56.119999] [DEBUG] [LOCAL ] ABT: Removed from QA tracker. [2025-09-14T16:37:56.134387] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-14T16:37:56.136034] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T16:37:56.183171] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-14T16:37:56.371914] [DEBUG] [LOCAL ] ABEV: Primary data saved (40061 records). [2025-09-14T16:37:56.430795] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-14T16:37:56.441100] [INFO ] [MAIN ] Update Progress: 13/2370 symbols completed. ABEV took 16.6s. Estimated remaining: 2h 15m 14s. Rate: 17.4 symbols/min [2025-09-14T16:37:56.621856] [INFO ] [REMOTE ] ABT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:56.622475] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-14T16:37:56.698123] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:56.710338] [DEBUG] [LOCAL ] ACA: Loaded 10019 existing records from primary storage. [2025-09-14T16:37:56.710501] [INFO ] [MAIN ] ACA: Loaded 10019 existing records. [2025-09-14T16:37:56.887472] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:56.887794] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-14T16:37:56.887880] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-14T16:37:56.888302] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-14T16:37:56.888905] [DEBUG] [LOCAL ] ACA: Removed from QA tracker. [2025-09-14T16:37:56.888966] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-14T16:37:57.256870] [INFO ] [REMOTE ] ACA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:57.257288] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-14T16:37:57.410546] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T16:37:57.421922] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-14T16:37:57.573943] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:37:57.581188] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-14T16:37:58.227590] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:37:58.232235] [INFO ] [REMOTE ] ABM: Full fetch complete (34054 records). [2025-09-14T16:37:58.232424] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-14T16:37:58.652131] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-14T16:37:58.652786] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T16:37:58.658497] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-14T16:37:58.659516] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-14T16:37:58.660197] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-14T16:37:58.660324] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-14T16:37:58.661758] [DEBUG] [LOCAL ] ABM: Trimmed 34054 records to 23534 (keeping 150 days of data) [2025-09-14T16:37:58.783314] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-14T16:37:58.795135] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-14T16:37:58.849032] [DEBUG] [LOCAL ] ABM: Primary data saved (23534 records). [2025-09-14T16:37:58.849212] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-14T16:37:58.849335] [INFO ] [MAIN ] Update Progress: 14/2370 symbols completed. ABM took 11.5s. Estimated remaining: 2h 12m 16s. Rate: 17.8 symbols/min [2025-09-14T16:37:59.046222] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:59.065908] [DEBUG] [LOCAL ] ACCO: Loaded 15942 existing records from primary storage. [2025-09-14T16:37:59.066132] [INFO ] [MAIN ] ACCO: Loaded 15942 existing records. [2025-09-14T16:37:59.256019] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:59.256430] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-14T16:37:59.256511] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-14T16:37:59.257459] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-14T16:37:59.258476] [DEBUG] [LOCAL ] ACCO: Removed from QA tracker. [2025-09-14T16:37:59.258542] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-14T16:37:59.641934] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:59.642589] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-14T16:37:59.677944] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-14T16:37:59.691078] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-14T16:38:00.070492] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T16:38:00.077550] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-14T16:38:00.915404] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T16:38:00.927305] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-14T16:38:01.289415] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T16:38:01.295735] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-14T16:38:01.507681] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T16:38:01.510264] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T16:38:01.518489] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-14T16:38:01.530797] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-14T16:38:02.506351] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T16:38:02.513225] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-14T16:38:02.755601] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T16:38:02.767312] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-14T16:38:02.995941] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T16:38:03.006874] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-14T16:38:03.191078] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T16:38:03.199926] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-14T16:38:03.292448] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T16:38:03.297902] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-14T16:38:04.104543] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T16:38:04.110311] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-14T16:38:04.693110] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T16:38:04.709126] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-14T16:38:04.773736] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T16:38:04.782763] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-14T16:38:04.918842] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T16:38:04.925072] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-14T16:38:04.980757] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T16:38:04.992472] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-14T16:38:05.148182] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T16:38:05.150758] [INFO ] [REMOTE ] ACA: Full fetch complete (26635 records). [2025-09-14T16:38:05.150869] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-14T16:38:05.533861] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-14T16:38:05.534012] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-14T16:38:05.534506] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-14T16:38:05.534595] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-14T16:38:05.540276] [DEBUG] [LOCAL ] ACA: Trimmed 26635 records to 17137 (keeping 150 days of data) [2025-09-14T16:38:05.663206] [DEBUG] [LOCAL ] ACA: Primary data saved (17137 records). [2025-09-14T16:38:05.663680] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-14T16:38:05.663839] [INFO ] [MAIN ] Update Progress: 15/2370 symbols completed. ACA took 9.2s. Estimated remaining: 2h 21m 14s. Rate: 16.7 symbols/min [2025-09-14T16:38:05.890708] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:05.908566] [DEBUG] [LOCAL ] ACEL: Loaded 11135 existing records from primary storage. [2025-09-14T16:38:05.908813] [INFO ] [MAIN ] ACEL: Loaded 11135 existing records. [2025-09-14T16:38:06.192194] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:06.214384] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-14T16:38:06.219400] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-14T16:38:06.220236] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-14T16:38:06.223189] [DEBUG] [LOCAL ] ACEL: Removed from QA tracker. [2025-09-14T16:38:06.226919] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T16:38:06.227311] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-14T16:38:06.277350] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-14T16:38:06.493710] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T16:38:06.563910] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-14T16:38:06.866414] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:06.892571] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-14T16:38:06.896683] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T16:38:06.958862] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-14T16:38:07.387937] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T16:38:07.598831] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:38:07.604604] [INFO ] [REMOTE ] ABR: Full fetch complete (56755 records). [2025-09-14T16:38:07.604831] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-14T16:38:07.762408] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-14T16:38:08.005520] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-14T16:38:08.005741] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-14T16:38:08.006555] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-14T16:38:08.006755] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-14T16:38:08.024146] [DEBUG] [LOCAL ] ABR: Trimmed 56755 records to 39178 (keeping 150 days of data) [2025-09-14T16:38:08.024715] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T16:38:08.277171] [DEBUG] [LOCAL ] ABR: Primary data saved (39178 records). [2025-09-14T16:38:08.277386] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-14T16:38:08.277519] [INFO ] [MAIN ] Update Progress: 16/2370 symbols completed. ABR took 15.5s. Estimated remaining: 2h 18m 46s. Rate: 17.0 symbols/min [2025-09-14T16:38:08.451199] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:08.475811] [DEBUG] [LOCAL ] ACHR: Loaded 24180 existing records from primary storage. [2025-09-14T16:38:08.475992] [INFO ] [MAIN ] ACHR: Loaded 24180 existing records. [2025-09-14T16:38:08.567277] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-14T16:38:08.656017] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:08.656298] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-14T16:38:08.656372] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-14T16:38:08.657195] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-14T16:38:08.657788] [DEBUG] [LOCAL ] ACHR: Removed from QA tracker. [2025-09-14T16:38:08.657850] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-14T16:38:09.018695] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:09.056154] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T16:38:09.358886] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-14T16:38:09.438618] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T16:38:09.747438] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T16:38:10.158818] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-14T16:38:10.958843] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-14T16:38:11.146559] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T16:38:11.583823] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T16:38:11.758843] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-14T16:38:12.563998] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-14T16:38:12.568688] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T16:38:12.810406] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T16:38:13.358874] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-14T16:38:14.158840] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-14T16:38:14.396792] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T16:38:14.882576] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-14T16:38:14.958832] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-14T16:38:15.465045] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T16:38:15.468807] [INFO ] [REMOTE ] ACCO: Full fetch complete (41475 records). [2025-09-14T16:38:15.468920] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-14T16:38:15.759325] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-14T16:38:15.846406] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-14T16:38:15.846519] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-14T16:38:15.847047] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-14T16:38:15.847116] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-14T16:38:15.848122] [DEBUG] [LOCAL ] ACCO: Trimmed 41475 records to 27964 (keeping 150 days of data) [2025-09-14T16:38:16.012455] [DEBUG] [LOCAL ] ACCO: Primary data saved (27964 records). [2025-09-14T16:38:16.012629] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-14T16:38:16.012748] [INFO ] [MAIN ] Update Progress: 17/2370 symbols completed. ACCO took 17.2s. Estimated remaining: 2h 28m 23s. Rate: 15.9 symbols/min [2025-09-14T16:38:16.186163] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:16.201766] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T16:38:16.207806] [INFO ] [REMOTE ] ABT: Full fetch complete (58289 records). [2025-09-14T16:38:16.207960] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-14T16:38:16.389135] [DEBUG] [LOCAL ] ACI: Loaded 23796 existing records from primary storage. [2025-09-14T16:38:16.425725] [INFO ] [MAIN ] ACI: Loaded 23796 existing records. [2025-09-14T16:38:16.561532] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-14T16:38:16.786282] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-14T16:38:16.807567] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-14T16:38:16.807728] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:16.808369] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-14T16:38:16.808495] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-14T16:38:16.808683] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-14T16:38:16.808856] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-14T16:38:16.809513] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-14T16:38:16.810184] [DEBUG] [LOCAL ] ABT: Trimmed 58289 records to 40373 (keeping 150 days of data) [2025-09-14T16:38:16.810604] [DEBUG] [LOCAL ] ACI: Removed from QA tracker. [2025-09-14T16:38:16.810913] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-14T16:38:17.288730] [INFO ] [REMOTE ] ACI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:17.371193] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-14T16:38:17.447382] [DEBUG] [LOCAL ] ABT: Primary data saved (40373 records). [2025-09-14T16:38:17.447633] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-14T16:38:17.447820] [INFO ] [MAIN ] Update Progress: 18/2370 symbols completed. ABT took 21.9s. Estimated remaining: 2h 23m 12s. Rate: 16.4 symbols/min [2025-09-14T16:38:17.639049] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:17.672057] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-14T16:38:17.699890] [DEBUG] [LOCAL ] ACM: Loaded 18918 existing records from primary storage. [2025-09-14T16:38:17.700076] [INFO ] [MAIN ] ACM: Loaded 18918 existing records. [2025-09-14T16:38:17.877151] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:17.877448] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-14T16:38:17.877519] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-14T16:38:17.878098] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-14T16:38:17.878728] [DEBUG] [LOCAL ] ACM: Removed from QA tracker. [2025-09-14T16:38:17.878790] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-14T16:38:18.167431] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-14T16:38:18.264802] [INFO ] [REMOTE ] ACM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:18.266602] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T16:38:18.958894] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-14T16:38:19.063812] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:38:19.758859] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-14T16:38:20.558795] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-14T16:38:20.650038] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:38:20.838275] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-14T16:38:21.090548] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T16:38:21.358854] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-14T16:38:22.158894] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-14T16:38:22.269897] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T16:38:22.958848] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-14T16:38:23.687279] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T16:38:23.690314] [INFO ] [REMOTE ] ACEL: Full fetch complete (30275 records). [2025-09-14T16:38:23.690434] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-14T16:38:23.761313] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-14T16:38:23.882606] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T16:38:24.109792] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-14T16:38:24.109940] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-14T16:38:24.110343] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-14T16:38:24.110564] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-14T16:38:24.111775] [DEBUG] [LOCAL ] ACEL: Trimmed 30275 records to 19768 (keeping 150 days of data) [2025-09-14T16:38:24.238664] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-09-14T16:38:24.285085] [DEBUG] [LOCAL ] ACEL: Primary data saved (19768 records). [2025-09-14T16:38:24.285317] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-14T16:38:24.285483] [INFO ] [MAIN ] Update Progress: 19/2370 symbols completed. ACEL took 18.6s. Estimated remaining: 2h 29m 43s. Rate: 15.7 symbols/min [2025-09-14T16:38:24.454814] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:24.479320] [DEBUG] [LOCAL ] ACN: Loaded 23971 existing records from primary storage. [2025-09-14T16:38:24.479507] [INFO ] [MAIN ] ACN: Loaded 23971 existing records. [2025-09-14T16:38:24.568373] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-14T16:38:24.656976] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:24.657245] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-14T16:38:24.657316] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-14T16:38:24.657953] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-14T16:38:24.658607] [DEBUG] [LOCAL ] ACN: Removed from QA tracker. [2025-09-14T16:38:24.658691] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-14T16:38:25.013860] [INFO ] [REMOTE ] ACN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:25.353488] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T16:38:25.363995] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-14T16:38:26.158861] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-14T16:38:26.208606] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T16:38:26.882218] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T16:38:26.958805] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-14T16:38:27.758833] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-14T16:38:27.892037] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:38:28.424118] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:38:28.558838] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-14T16:38:29.358882] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-14T16:38:29.682267] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T16:38:30.158919] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-14T16:38:30.229409] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T16:38:30.512037] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T16:38:30.958854] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-14T16:38:31.758883] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-14T16:38:32.323169] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-14T16:38:32.529094] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T16:38:32.558781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-14T16:38:33.358834] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-14T16:38:33.605512] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T16:38:34.119430] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T16:38:34.158777] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-14T16:38:34.814117] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:38:34.819636] [INFO ] [REMOTE ] ACM: Full fetch complete (47141 records). [2025-09-14T16:38:34.819793] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-14T16:38:34.962141] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-14T16:38:35.209661] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-14T16:38:35.209912] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-14T16:38:35.210448] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-14T16:38:35.210522] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-14T16:38:35.212130] [DEBUG] [LOCAL ] ACM: Trimmed 47141 records to 31709 (keeping 150 days of data) [2025-09-14T16:38:35.346902] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T16:38:35.454751] [DEBUG] [LOCAL ] ACM: Primary data saved (31709 records). [2025-09-14T16:38:35.454928] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-14T16:38:35.455035] [INFO ] [MAIN ] Update Progress: 20/2370 symbols completed. ACM took 18.0s. Estimated remaining: 2h 44m 2s. Rate: 14.3 symbols/min [2025-09-14T16:38:35.630120] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:35.644914] [DEBUG] [LOCAL ] ACP: Loaded 13507 existing records from primary storage. [2025-09-14T16:38:35.645071] [INFO ] [MAIN ] ACP: Loaded 13507 existing records. [2025-09-14T16:38:35.763985] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-14T16:38:35.836215] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:35.836479] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-14T16:38:35.836553] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-14T16:38:35.837057] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-14T16:38:35.837665] [DEBUG] [LOCAL ] ACP: Removed from QA tracker. [2025-09-14T16:38:35.837732] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-14T16:38:36.203971] [INFO ] [REMOTE ] ACP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:36.558843] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-14T16:38:36.982253] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T16:38:37.358861] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-14T16:38:37.714148] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T16:38:37.906504] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T16:38:38.008635] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:38:38.014170] [INFO ] [REMOTE ] ACI: Full fetch complete (57864 records). [2025-09-14T16:38:38.014300] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-14T16:38:38.166567] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-14T16:38:38.398175] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-14T16:38:38.398289] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-14T16:38:38.398880] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-14T16:38:38.398938] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-14T16:38:38.400217] [DEBUG] [LOCAL ] ACI: Trimmed 57864 records to 40065 (keeping 150 days of data) [2025-09-14T16:38:38.670454] [DEBUG] [LOCAL ] ACI: Primary data saved (40065 records). [2025-09-14T16:38:38.670670] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-14T16:38:38.670817] [INFO ] [MAIN ] Update Progress: 21/2370 symbols completed. ACI took 22.7s. Estimated remaining: 2h 42m 9s. Rate: 14.5 symbols/min [2025-09-14T16:38:38.840591] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:38.844858] [DEBUG] [LOCAL ] ACR: Loaded 2258 existing records from primary storage. [2025-09-14T16:38:38.844973] [INFO ] [MAIN ] ACR: Loaded 2258 existing records. [2025-09-14T16:38:38.963925] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-14T16:38:39.027860] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:39.028273] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-14T16:38:39.028353] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-14T16:38:39.028632] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-14T16:38:39.029200] [DEBUG] [LOCAL ] ACR: Removed from QA tracker. [2025-09-14T16:38:39.029261] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-14T16:38:39.401929] [INFO ] [REMOTE ] ACR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:39.663205] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T16:38:39.758839] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-14T16:38:40.558891] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-14T16:38:40.855401] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T16:38:41.358886] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-14T16:38:41.653755] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-14T16:38:42.158796] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-14T16:38:42.519893] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T16:38:42.649231] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T16:38:42.958852] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-14T16:38:43.758872] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-14T16:38:44.329264] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T16:38:44.340504] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T16:38:44.558839] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-14T16:38:44.988979] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-14T16:38:45.141485] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T16:38:45.358838] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-14T16:38:46.158843] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-14T16:38:46.791525] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T16:38:46.958845] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-14T16:38:47.758843] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-14T16:38:48.462897] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T16:38:48.558842] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-14T16:38:48.708103] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T16:38:48.940665] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-14T16:38:49.286590] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T16:38:49.358795] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-14T16:38:50.120032] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T16:38:50.158788] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-14T16:38:50.958839] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-14T16:38:51.522763] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T16:38:51.528536] [INFO ] [REMOTE ] ACN: Full fetch complete (58010 records). [2025-09-14T16:38:51.528710] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-14T16:38:51.765486] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-14T16:38:51.930196] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-14T16:38:51.930312] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-14T16:38:51.930965] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-14T16:38:51.931028] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-14T16:38:51.933704] [DEBUG] [LOCAL ] ACN: Trimmed 58010 records to 40185 (keeping 150 days of data) [2025-09-14T16:38:52.188271] [DEBUG] [LOCAL ] ACN: Primary data saved (40185 records). [2025-09-14T16:38:52.188431] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-14T16:38:52.188529] [INFO ] [MAIN ] Update Progress: 22/2370 symbols completed. ACN took 27.9s. Estimated remaining: 2h 58m 46s. Rate: 13.1 symbols/min [2025-09-14T16:38:52.326216] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T16:38:52.380916] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:52.399456] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-14T16:38:52.409994] [INFO ] [REMOTE ] ACHR: Full fetch complete (58498 records). [2025-09-14T16:38:52.410258] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-14T16:38:52.492865] [DEBUG] [LOCAL ] ACRE: Loaded 14580 existing records from primary storage. [2025-09-14T16:38:52.519122] [INFO ] [MAIN ] ACRE: Loaded 14580 existing records. [2025-09-14T16:38:52.567618] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-14T16:38:52.919356] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:52.920314] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-14T16:38:52.946569] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-14T16:38:53.014241] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-14T16:38:53.017600] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-14T16:38:53.017780] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-14T16:38:53.018536] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-14T16:38:53.019054] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-14T16:38:53.019378] [DEBUG] [LOCAL ] ACRE: Removed from QA tracker. [2025-09-14T16:38:53.019467] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-14T16:38:53.127890] [DEBUG] [LOCAL ] ACHR: Trimmed 58498 records to 40558 (keeping 150 days of data) [2025-09-14T16:38:53.359911] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-14T16:38:53.428873] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T16:38:53.492119] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:53.649921] [DEBUG] [LOCAL ] ACHR: Primary data saved (40558 records). [2025-09-14T16:38:53.650105] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-14T16:38:53.650239] [INFO ] [MAIN ] Update Progress: 23/2370 symbols completed. ACHR took 45.4s. Estimated remaining: 2h 53m 24s. Rate: 13.5 symbols/min [2025-09-14T16:38:53.827134] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:53.831615] [DEBUG] [LOCAL ] ACV: Loaded 2675 existing records from primary storage. [2025-09-14T16:38:53.831755] [INFO ] [MAIN ] ACV: Loaded 2675 existing records. [2025-09-14T16:38:54.019955] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:54.020214] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-14T16:38:54.020280] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-14T16:38:54.020575] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-14T16:38:54.021124] [DEBUG] [LOCAL ] ACV: Removed from QA tracker. [2025-09-14T16:38:54.021186] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-14T16:38:54.166187] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-14T16:38:54.389266] [INFO ] [REMOTE ] ACV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:54.558298] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T16:38:54.958839] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-14T16:38:55.455986] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T16:38:55.456971] [INFO ] [REMOTE ] ACR: Full fetch complete (7108 records). [2025-09-14T16:38:55.457056] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-14T16:38:55.775308] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-14T16:38:55.813824] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-14T16:38:55.813985] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-14T16:38:55.814337] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-14T16:38:55.814438] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-14T16:38:55.815463] [DEBUG] [LOCAL ] ACR: Trimmed 7108 records to 4230 (keeping 150 days of data) [2025-09-14T16:38:55.835739] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T16:38:55.869458] [DEBUG] [LOCAL ] ACR: Primary data saved (4230 records). [2025-09-14T16:38:55.869605] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-14T16:38:55.869749] [INFO ] [MAIN ] Update Progress: 24/2370 symbols completed. ACR took 17.2s. Estimated remaining: 2h 49m 44s. Rate: 13.8 symbols/min [2025-09-14T16:38:56.041298] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:56.068864] [DEBUG] [LOCAL ] ACVA: Loaded 21723 existing records from primary storage. [2025-09-14T16:38:56.069039] [INFO ] [MAIN ] ACVA: Loaded 21723 existing records. [2025-09-14T16:38:56.243674] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:56.243948] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-14T16:38:56.244026] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-14T16:38:56.244667] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-14T16:38:56.245167] [DEBUG] [LOCAL ] ACVA: Removed from QA tracker. [2025-09-14T16:38:56.245227] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-14T16:38:56.563904] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-14T16:38:56.657697] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:56.663020] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T16:38:57.358846] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-14T16:38:57.920093] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:38:58.158832] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-14T16:38:58.220339] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T16:38:58.223533] [INFO ] [REMOTE ] ACP: Full fetch complete (34364 records). [2025-09-14T16:38:58.223664] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-14T16:38:58.599683] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-14T16:38:58.599836] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-14T16:38:58.600304] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-14T16:38:58.600368] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-14T16:38:58.601722] [DEBUG] [LOCAL ] ACP: Trimmed 34364 records to 23365 (keeping 150 days of data) [2025-09-14T16:38:58.747468] [DEBUG] [LOCAL ] ACP: Primary data saved (23365 records). [2025-09-14T16:38:58.747683] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-14T16:38:58.747823] [INFO ] [MAIN ] Update Progress: 25/2370 symbols completed. ACP took 23.3s. Estimated remaining: 2h 47m 22s. Rate: 14.0 symbols/min [2025-09-14T16:38:58.929018] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:58.936184] [DEBUG] [LOCAL ] AD: Loaded 4587 existing records from primary storage. [2025-09-14T16:38:58.936323] [INFO ] [MAIN ] AD: Loaded 4587 existing records. [2025-09-14T16:38:58.969818] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-14T16:38:59.124127] [WARN ] [MAIN ] AD: Insufficient historical data. Have data from 2025-08-12, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:59.124391] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-14T16:38:59.124472] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-14T16:38:59.124773] [DEBUG] [LOCAL ] AD: Deleted primary data file. [2025-09-14T16:38:59.125371] [DEBUG] [LOCAL ] AD: Removed from QA tracker. [2025-09-14T16:38:59.125472] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-14T16:38:59.486751] [INFO ] [REMOTE ] AD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:59.590045] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T16:38:59.734593] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T16:38:59.758880] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-14T16:39:00.011118] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:00.011531] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-14T16:39:00.558829] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-14T16:39:01.358844] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-14T16:39:01.632169] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:01.632549] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-14T16:39:02.158828] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-14T16:39:02.228725] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T16:39:02.958837] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-14T16:39:03.758895] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-14T16:39:03.995831] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T16:39:04.009960] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T16:39:04.055713] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:04.056083] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-14T16:39:04.558851] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-14T16:39:04.817165] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:04.817560] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-14T16:39:05.358829] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-14T16:39:06.158833] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-14T16:39:06.451263] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T16:39:06.958836] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-14T16:39:07.027095] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T16:39:07.286317] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:07.286682] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-14T16:39:07.758829] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-14T16:39:08.558840] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-14T16:39:09.233021] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T16:39:09.353266] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T16:39:09.363680] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-14T16:39:10.158810] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-14T16:39:10.845094] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T16:39:10.958818] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-14T16:39:11.256494] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:11.256881] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-14T16:39:11.731070] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T16:39:11.758796] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-14T16:39:12.558851] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-14T16:39:13.358850] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-14T16:39:13.404374] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:39:13.729200] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T16:39:13.811158] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T16:39:14.158840] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-14T16:39:14.958824] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-14T16:39:14.986150] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T16:39:14.988576] [INFO ] [REMOTE ] AD: Full fetch complete (4587 records). [2025-09-14T16:39:14.988685] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-14T16:39:15.171440] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 23 unique days, need 150 days [2025-09-14T16:39:15.171700] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:39:15.171797] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:39:15.171850] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-14T16:39:15.171942] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-14T16:39:15.172002] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-14T16:39:15.172125] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-14T16:39:15.172209] [INFO ] [MAIN ] Update Progress: 26/2370 symbols completed. AD took 16.4s. Estimated remaining: 3h 5m 32s. Rate: 12.6 symbols/min [2025-09-14T16:39:15.344148] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:15.364191] [DEBUG] [LOCAL ] ADC: Loaded 20466 existing records from primary storage. [2025-09-14T16:39:15.364365] [INFO ] [MAIN ] ADC: Loaded 20466 existing records. [2025-09-14T16:39:15.535833] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:15.536120] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-14T16:39:15.536181] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-14T16:39:15.536925] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-14T16:39:15.537451] [DEBUG] [LOCAL ] ADC: Removed from QA tracker. [2025-09-14T16:39:15.537509] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-14T16:39:15.764070] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-14T16:39:15.891307] [INFO ] [REMOTE ] ADC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:16.365619] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T16:39:16.468761] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T16:39:16.558809] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-14T16:39:17.002152] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-14T16:39:17.358890] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-14T16:39:18.158842] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-14T16:39:18.519086] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-14T16:39:18.523127] [INFO ] [REMOTE ] ACRE: Full fetch complete (37317 records). [2025-09-14T16:39:18.523285] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-14T16:39:18.903769] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-14T16:39:18.908323] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-14T16:39:18.908605] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T16:39:18.909226] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-14T16:39:18.909431] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-14T16:39:18.911834] [INFO ] [REMOTE ] ACV: Full fetch complete (7385 records). [2025-09-14T16:39:18.912102] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-14T16:39:18.912605] [DEBUG] [LOCAL ] ACRE: Trimmed 37317 records to 24833 (keeping 150 days of data) [2025-09-14T16:39:18.959701] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-14T16:39:19.565178] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-14T16:39:19.567365] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-14T16:39:19.567866] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-14T16:39:19.569080] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-14T16:39:19.610505] [DEBUG] [LOCAL ] ACV: Trimmed 7385 records to 4645 (keeping 150 days of data) [2025-09-14T16:39:19.620444] [DEBUG] [LOCAL ] ACRE: Primary data saved (24833 records). [2025-09-14T16:39:19.620625] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-14T16:39:19.620780] [INFO ] [MAIN ] Update Progress: 27/2370 symbols completed. ACRE took 27.4s. Estimated remaining: 3h 5m 2s. Rate: 12.7 symbols/min [2025-09-14T16:39:19.767225] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-14T16:39:19.845962] [DEBUG] [LOCAL ] ACV: Primary data saved (4645 records). [2025-09-14T16:39:19.846309] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-14T16:39:19.857748] [INFO ] [MAIN ] Update Progress: 28/2370 symbols completed. ACV took 26.2s. Estimated remaining: 2h 58m 40s. Rate: 13.1 symbols/min [2025-09-14T16:39:20.049723] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:20.212763] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:20.225569] [DEBUG] [LOCAL ] ADCT: Loaded 16452 existing records from primary storage. [2025-09-14T16:39:20.226074] [INFO ] [MAIN ] ADCT: Loaded 16452 existing records. [2025-09-14T16:39:20.453912] [DEBUG] [LOCAL ] ADM: Loaded 23929 existing records from primary storage. [2025-09-14T16:39:20.454049] [INFO ] [MAIN ] ADM: Loaded 23929 existing records. [2025-09-14T16:39:20.453375] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:20.528301] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-14T16:39:20.551742] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-14T16:39:20.564951] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-14T16:39:20.634553] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:20.634888] [DEBUG] [LOCAL ] ADCT: Removed from QA tracker. [2025-09-14T16:39:20.635052] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-14T16:39:20.640515] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-14T16:39:20.678070] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-14T16:39:20.740169] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-14T16:39:20.781980] [DEBUG] [LOCAL ] ADM: Removed from QA tracker. [2025-09-14T16:39:20.850965] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-14T16:39:21.061469] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T16:39:21.223608] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:21.223994] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-14T16:39:21.372851] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-14T16:39:21.400067] [INFO ] [REMOTE ] ADM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:21.428568] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T16:39:22.158851] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-14T16:39:22.532618] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T16:39:22.961943] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-14T16:39:22.967410] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T16:39:23.758886] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-14T16:39:24.133288] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T16:39:24.319784] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:39:24.558839] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-14T16:39:25.358857] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-14T16:39:25.397552] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T16:39:25.649398] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T16:39:26.158888] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-14T16:39:26.958865] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-14T16:39:27.221784] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T16:39:27.539150] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T16:39:27.758859] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-14T16:39:28.558864] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-14T16:39:28.761805] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T16:39:29.358783] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-14T16:39:29.547463] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T16:39:29.775981] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T16:39:30.158826] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-14T16:39:30.958839] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-14T16:39:31.144915] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T16:39:31.356973] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T16:39:31.758874] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-14T16:39:32.558837] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-14T16:39:32.833021] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T16:39:32.911451] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T16:39:33.358864] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-14T16:39:33.689030] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T16:39:33.695923] [INFO ] [REMOTE ] ACVA: Full fetch complete (53547 records). [2025-09-14T16:39:33.696105] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-14T16:39:34.086461] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-14T16:39:34.086579] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-14T16:39:34.087140] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-14T16:39:34.087202] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-14T16:39:34.088504] [DEBUG] [LOCAL ] ACVA: Trimmed 53547 records to 36553 (keeping 150 days of data) [2025-09-14T16:39:34.179994] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-14T16:39:34.325510] [DEBUG] [LOCAL ] ACVA: Primary data saved (36553 records). [2025-09-14T16:39:34.325740] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-14T16:39:34.325864] [INFO ] [MAIN ] Update Progress: 29/2370 symbols completed. ACVA took 38.5s. Estimated remaining: 3h 11m 54s. Rate: 12.2 symbols/min [2025-09-14T16:39:34.499040] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:34.520108] [DEBUG] [LOCAL ] ADNT: Loaded 20986 existing records from primary storage. [2025-09-14T16:39:34.520317] [INFO ] [MAIN ] ADNT: Loaded 20986 existing records. [2025-09-14T16:39:34.711433] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:34.711761] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-14T16:39:34.711841] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-14T16:39:34.712575] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-14T16:39:34.713184] [DEBUG] [LOCAL ] ADNT: Removed from QA tracker. [2025-09-14T16:39:34.713257] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-14T16:39:34.963147] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-14T16:39:35.081316] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:35.111209] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T16:39:35.758872] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-14T16:39:35.995007] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T16:39:36.323209] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T16:39:36.327210] [INFO ] [REMOTE ] ADCT: Full fetch complete (36721 records). [2025-09-14T16:39:36.327315] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-14T16:39:36.571634] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-14T16:39:36.698393] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-14T16:39:36.698515] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-14T16:39:36.699061] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-14T16:39:36.699130] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-14T16:39:36.700161] [DEBUG] [LOCAL ] ADCT: Trimmed 36721 records to 25869 (keeping 150 days of data) [2025-09-14T16:39:36.845529] [DEBUG] [LOCAL ] ADCT: Primary data saved (25869 records). [2025-09-14T16:39:36.845709] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-14T16:39:36.845880] [INFO ] [MAIN ] Update Progress: 30/2370 symbols completed. ADCT took 17.2s. Estimated remaining: 3h 8m 42s. Rate: 12.4 symbols/min [2025-09-14T16:39:37.022031] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:37.047184] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T16:39:37.074124] [DEBUG] [LOCAL ] ADT: Loaded 23933 existing records from primary storage. [2025-09-14T16:39:37.074297] [INFO ] [MAIN ] ADT: Loaded 23933 existing records. [2025-09-14T16:39:37.255838] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:37.256116] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-14T16:39:37.256177] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-14T16:39:37.256874] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-14T16:39:37.257394] [DEBUG] [LOCAL ] ADT: Removed from QA tracker. [2025-09-14T16:39:37.257455] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-14T16:39:37.364173] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-14T16:39:37.625521] [INFO ] [REMOTE ] ADT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:38.158814] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-14T16:39:38.732929] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T16:39:38.958803] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-14T16:39:39.184253] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T16:39:39.613721] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T16:39:39.758791] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-14T16:39:40.558803] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-14T16:39:40.946471] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T16:39:41.078622] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T16:39:41.358922] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-14T16:39:41.887317] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T16:39:41.888224] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T16:39:41.902985] [INFO ] [REMOTE ] ADM: Full fetch complete (58069 records). [2025-09-14T16:39:41.903227] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-14T16:39:42.163938] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-14T16:39:42.296759] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-14T16:39:42.296889] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-14T16:39:42.297545] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-14T16:39:42.297657] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-14T16:39:42.299136] [DEBUG] [LOCAL ] ADM: Trimmed 58069 records to 40170 (keeping 150 days of data) [2025-09-14T16:39:42.545088] [DEBUG] [LOCAL ] ADM: Primary data saved (40170 records). [2025-09-14T16:39:42.545279] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-14T16:39:42.545400] [INFO ] [MAIN ] Update Progress: 31/2370 symbols completed. ADM took 22.7s. Estimated remaining: 3h 9m 42s. Rate: 12.3 symbols/min [2025-09-14T16:39:42.722476] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:42.736597] [DEBUG] [LOCAL ] ADX: Loaded 12600 existing records from primary storage. [2025-09-14T16:39:42.736760] [INFO ] [MAIN ] ADX: Loaded 12600 existing records. [2025-09-14T16:39:42.917332] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:42.917580] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-14T16:39:42.917657] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-14T16:39:42.918069] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-14T16:39:42.918508] [DEBUG] [LOCAL ] ADX: Removed from QA tracker. [2025-09-14T16:39:42.918566] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-14T16:39:42.964031] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-14T16:39:43.272428] [INFO ] [REMOTE ] ADX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:43.758874] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-14T16:39:43.939606] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T16:39:44.064868] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T16:39:44.069973] [INFO ] [REMOTE ] ADC: Full fetch complete (50730 records). [2025-09-14T16:39:44.070114] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-14T16:39:44.442089] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-14T16:39:44.442197] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-14T16:39:44.442810] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-14T16:39:44.442887] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-14T16:39:44.444064] [DEBUG] [LOCAL ] ADC: Trimmed 50730 records to 35023 (keeping 150 days of data) [2025-09-14T16:39:44.563707] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-14T16:39:44.664031] [DEBUG] [LOCAL ] ADC: Primary data saved (35023 records). [2025-09-14T16:39:44.664216] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-14T16:39:44.664338] [INFO ] [MAIN ] Update Progress: 32/2370 symbols completed. ADC took 29.5s. Estimated remaining: 3h 6m 17s. Rate: 12.6 symbols/min [2025-09-14T16:39:44.836246] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:44.879303] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T16:39:44.908125] [DEBUG] [LOCAL ] AEE: Loaded 22433 existing records from primary storage. [2025-09-14T16:39:44.908341] [INFO ] [MAIN ] AEE: Loaded 22433 existing records. [2025-09-14T16:39:45.083506] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:45.083807] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-14T16:39:45.083867] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-14T16:39:45.084474] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-14T16:39:45.084978] [DEBUG] [LOCAL ] AEE: Removed from QA tracker. [2025-09-14T16:39:45.085039] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-14T16:39:45.363978] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-14T16:39:45.433992] [INFO ] [REMOTE ] AEE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:45.911914] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T16:39:46.158847] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-14T16:39:46.958865] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-14T16:39:47.000476] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T16:39:47.759162] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T16:39:47.759373] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-14T16:39:48.389961] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T16:39:48.558901] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-14T16:39:49.358890] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-14T16:39:49.433318] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T16:39:50.161274] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-14T16:39:50.164676] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T16:39:50.958890] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-14T16:39:51.098162] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T16:39:51.229452] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:39:51.758890] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-14T16:39:52.558903] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-14T16:39:52.788931] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T16:39:53.061389] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T16:39:53.358886] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-14T16:39:54.012409] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:39:54.017171] [INFO ] [REMOTE ] ADNT: Full fetch complete (51532 records). [2025-09-14T16:39:54.017296] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-14T16:39:54.167616] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-14T16:39:54.404345] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-14T16:39:54.404719] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-14T16:39:54.405308] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-14T16:39:54.405457] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-14T16:39:54.407038] [DEBUG] [LOCAL ] ADNT: Trimmed 51532 records to 35484 (keeping 150 days of data) [2025-09-14T16:39:54.536600] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T16:39:54.657766] [DEBUG] [LOCAL ] ADNT: Primary data saved (35484 records). [2025-09-14T16:39:54.657942] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-14T16:39:54.658044] [INFO ] [MAIN ] Update Progress: 33/2370 symbols completed. ADNT took 20.3s. Estimated remaining: 3h 12m 21s. Rate: 12.1 symbols/min [2025-09-14T16:39:54.829280] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:54.834168] [DEBUG] [LOCAL ] AEFC: Loaded 3302 existing records from primary storage. [2025-09-14T16:39:54.834264] [INFO ] [MAIN ] AEFC: Loaded 3302 existing records. [2025-09-14T16:39:54.975080] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-14T16:39:55.014030] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:55.014480] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-14T16:39:55.014556] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-14T16:39:55.014873] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-14T16:39:55.015489] [DEBUG] [LOCAL ] AEFC: Removed from QA tracker. [2025-09-14T16:39:55.015550] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-14T16:39:55.362531] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:55.758841] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-14T16:39:56.133283] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T16:39:56.211701] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-14T16:39:56.529997] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T16:39:56.558863] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-14T16:39:57.358846] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-14T16:39:57.813566] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T16:39:58.158900] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-14T16:39:58.958879] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-14T16:39:59.243123] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T16:39:59.277044] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T16:39:59.758840] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-14T16:40:00.564615] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-14T16:40:00.565830] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T16:40:00.690570] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:40:01.358853] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-14T16:40:02.006543] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T16:40:02.158819] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-14T16:40:02.221103] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T16:40:02.958824] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-14T16:40:03.758848] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-14T16:40:04.035513] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T16:40:04.558794] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-14T16:40:04.745978] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T16:40:05.046250] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-14T16:40:05.358832] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-14T16:40:05.814773] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T16:40:06.158823] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-14T16:40:06.958831] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-14T16:40:07.006436] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T16:40:07.338683] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T16:40:07.758840] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-14T16:40:07.843211] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T16:40:07.847945] [INFO ] [REMOTE ] ADX: Full fetch complete (30809 records). [2025-09-14T16:40:07.848151] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-14T16:40:08.242000] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-14T16:40:08.242111] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-14T16:40:08.242466] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-14T16:40:08.242519] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-14T16:40:08.243353] [DEBUG] [LOCAL ] ADX: Trimmed 30809 records to 20648 (keeping 150 days of data) [2025-09-14T16:40:08.372768] [DEBUG] [LOCAL ] ADX: Primary data saved (20648 records). [2025-09-14T16:40:08.372933] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-14T16:40:08.373059] [INFO ] [MAIN ] Update Progress: 34/2370 symbols completed. ADX took 25.8s. Estimated remaining: 3h 22m 19s. Rate: 11.5 symbols/min [2025-09-14T16:40:08.541762] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:08.564046] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-14T16:40:08.566568] [DEBUG] [LOCAL ] AEG: Loaded 21976 existing records from primary storage. [2025-09-14T16:40:08.566864] [INFO ] [MAIN ] AEG: Loaded 21976 existing records. [2025-09-14T16:40:08.744418] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:08.744690] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-14T16:40:08.744755] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-14T16:40:08.745383] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-14T16:40:08.745977] [DEBUG] [LOCAL ] AEG: Removed from QA tracker. [2025-09-14T16:40:08.746042] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-14T16:40:09.101848] [INFO ] [REMOTE ] AEG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:09.355931] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T16:40:09.360925] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-14T16:40:09.362551] [INFO ] [REMOTE ] ADT: Full fetch complete (58058 records). [2025-09-14T16:40:09.362667] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-14T16:40:09.740658] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-14T16:40:09.740769] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-14T16:40:09.741339] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-14T16:40:09.741397] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-14T16:40:09.742610] [DEBUG] [LOCAL ] ADT: Trimmed 58058 records to 40255 (keeping 150 days of data) [2025-09-14T16:40:09.992126] [DEBUG] [LOCAL ] ADT: Primary data saved (40255 records). [2025-09-14T16:40:09.992287] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-14T16:40:09.992385] [INFO ] [MAIN ] Update Progress: 35/2370 symbols completed. ADT took 33.1s. Estimated remaining: 3h 18m 15s. Rate: 11.8 symbols/min [2025-09-14T16:40:10.137552] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-14T16:40:10.162886] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-14T16:40:10.188705] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:10.215320] [DEBUG] [LOCAL ] AEM: Loaded 23918 existing records from primary storage. [2025-09-14T16:40:10.215495] [INFO ] [MAIN ] AEM: Loaded 23918 existing records. [2025-09-14T16:40:10.405697] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:10.422700] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-14T16:40:10.423388] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-14T16:40:10.424534] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T16:40:10.436435] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-14T16:40:10.437141] [DEBUG] [LOCAL ] AEM: Removed from QA tracker. [2025-09-14T16:40:10.437209] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-14T16:40:10.841398] [INFO ] [REMOTE ] AEM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:10.958824] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-14T16:40:11.480307] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:40:11.486835] [INFO ] [REMOTE ] AEE: Full fetch complete (54975 records). [2025-09-14T16:40:11.487140] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-14T16:40:11.821160] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-14T16:40:12.044567] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T16:40:12.214449] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-14T16:40:12.214632] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-14T16:40:12.216788] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-14T16:40:12.216959] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-14T16:40:12.219237] [DEBUG] [LOCAL ] AEE: Trimmed 54975 records to 37637 (keeping 150 days of data) [2025-09-14T16:40:12.497805] [DEBUG] [LOCAL ] AEE: Primary data saved (37637 records). [2025-09-14T16:40:12.498008] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-14T16:40:12.498115] [INFO ] [MAIN ] Update Progress: 36/2370 symbols completed. AEE took 27.8s. Estimated remaining: 3h 15m 22s. Rate: 11.9 symbols/min [2025-09-14T16:40:12.568577] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-14T16:40:12.690399] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:12.716600] [DEBUG] [LOCAL ] AEO: Loaded 24035 existing records from primary storage. [2025-09-14T16:40:12.716812] [INFO ] [MAIN ] AEO: Loaded 24035 existing records. [2025-09-14T16:40:12.899372] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:12.899683] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-14T16:40:12.899748] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-14T16:40:12.900508] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-14T16:40:12.901045] [DEBUG] [LOCAL ] AEO: Removed from QA tracker. [2025-09-14T16:40:12.901107] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-14T16:40:13.260183] [INFO ] [REMOTE ] AEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:13.358846] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-14T16:40:13.453847] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T16:40:13.506968] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:40:14.158836] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-14T16:40:14.958877] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-14T16:40:15.134356] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T16:40:15.758893] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-14T16:40:15.938055] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T16:40:16.558836] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-14T16:40:16.676455] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T16:40:17.358822] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-14T16:40:17.669798] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T16:40:17.810815] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T16:40:17.812292] [INFO ] [REMOTE ] AEFC: Full fetch complete (9422 records). [2025-09-14T16:40:17.812397] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-14T16:40:18.159682] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-14T16:40:18.182663] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-14T16:40:18.182782] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-14T16:40:18.182999] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-14T16:40:18.183045] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-14T16:40:18.183492] [DEBUG] [LOCAL ] AEFC: Trimmed 9422 records to 5954 (keeping 150 days of data) [2025-09-14T16:40:18.222160] [DEBUG] [LOCAL ] AEFC: Primary data saved (5954 records). [2025-09-14T16:40:18.222339] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-14T16:40:18.222446] [INFO ] [MAIN ] Update Progress: 37/2370 symbols completed. AEFC took 23.6s. Estimated remaining: 3h 16m 2s. Rate: 11.9 symbols/min [2025-09-14T16:40:18.401882] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T16:40:18.958891] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-14T16:40:19.758902] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-14T16:40:20.062856] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T16:40:20.485846] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T16:40:20.558776] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-14T16:40:21.225626] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:40:21.358831] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-14T16:40:22.158802] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-14T16:40:22.241307] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T16:40:22.958884] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-14T16:40:23.144119] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T16:40:23.758860] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-14T16:40:24.343258] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T16:40:24.558794] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-14T16:40:24.641571] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T16:40:25.199627] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T16:40:25.358851] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-14T16:40:26.158854] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-14T16:40:26.550711] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T16:40:26.958869] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-14T16:40:27.066715] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T16:40:27.758842] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-14T16:40:28.330233] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T16:40:28.558844] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-14T16:40:28.654253] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T16:40:28.879717] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T16:40:28.884875] [INFO ] [REMOTE ] AEG: Full fetch complete (53612 records). [2025-09-14T16:40:28.885002] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-14T16:40:29.297037] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-14T16:40:29.297201] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-14T16:40:29.297954] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-14T16:40:29.298033] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-14T16:40:29.299953] [DEBUG] [LOCAL ] AEG: Trimmed 53612 records to 37400 (keeping 150 days of data) [2025-09-14T16:40:29.363829] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-14T16:40:29.537791] [DEBUG] [LOCAL ] AEG: Primary data saved (37400 records). [2025-09-14T16:40:29.538056] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-14T16:40:29.538191] [INFO ] [MAIN ] Update Progress: 38/2370 symbols completed. AEG took 21.2s. Estimated remaining: 3h 22m 22s. Rate: 11.5 symbols/min [2025-09-14T16:40:30.824889] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-14T16:40:30.836754] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-14T16:40:31.372564] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T16:40:31.378160] [INFO ] [REMOTE ] AEO: Full fetch complete (58193 records). [2025-09-14T16:40:31.378320] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-14T16:40:31.802114] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-14T16:40:31.802284] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-14T16:40:31.803526] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-14T16:40:31.804682] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-14T16:40:31.804825] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-14T16:40:31.816899] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-14T16:40:31.818522] [DEBUG] [LOCAL ] AEO: Trimmed 58193 records to 40310 (keeping 150 days of data) [2025-09-14T16:40:32.062626] [DEBUG] [LOCAL ] AEO: Primary data saved (40310 records). [2025-09-14T16:40:32.062815] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-14T16:40:32.062921] [INFO ] [MAIN ] Update Progress: 39/2370 symbols completed. AEO took 19.6s. Estimated remaining: 3h 19m 36s. Rate: 11.7 symbols/min [2025-09-14T16:40:33.649550] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-14T16:40:33.655453] [INFO ] [REMOTE ] AEM: Full fetch complete (58133 records). [2025-09-14T16:40:33.655670] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-14T16:40:34.040406] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-14T16:40:34.040521] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-14T16:40:34.041164] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-14T16:40:34.041230] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-14T16:40:34.042618] [DEBUG] [LOCAL ] AEM: Trimmed 58133 records to 40246 (keeping 150 days of data) [2025-09-14T16:40:34.322271] [DEBUG] [LOCAL ] AEM: Primary data saved (40246 records). [2025-09-14T16:40:34.322469] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-14T16:40:34.322600] [INFO ] [MAIN ] Update Progress: 40/2370 symbols completed. AEM took 24.3s. Estimated remaining: 3h 16m 43s. Rate: 11.8 symbols/min [2025-09-14T16:40:34.945617] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:35.010511] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:35.055019] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:35.052181] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:35.065714] [DEBUG] [LOCAL ] AFB: Loaded 4658 existing records from primary storage. [2025-09-14T16:40:35.066095] [INFO ] [MAIN ] AFB: Loaded 4658 existing records. [2025-09-14T16:40:35.208447] [DEBUG] [LOCAL ] AER: Loaded 21504 existing records from primary storage. [2025-09-14T16:40:35.232119] [DEBUG] [LOCAL ] AESI: Loaded 21926 existing records from primary storage. [2025-09-14T16:40:35.242612] [INFO ] [MAIN ] AER: Loaded 21504 existing records. [2025-09-14T16:40:35.256971] [INFO ] [MAIN ] AESI: Loaded 21926 existing records. [2025-09-14T16:40:35.321054] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:35.300900] [DEBUG] [LOCAL ] AES: Loaded 24036 existing records from primary storage. [2025-09-14T16:40:35.385385] [INFO ] [MAIN ] AES: Loaded 24036 existing records. [2025-09-14T16:40:35.404997] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-14T16:40:35.575512] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-14T16:40:35.606283] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-14T16:40:35.765729] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:35.799065] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:35.815462] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-14T16:40:35.799110] [DEBUG] [LOCAL ] AFB: Removed from QA tracker. [2025-09-14T16:40:35.831500] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-14T16:40:35.836175] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:35.836032] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-14T16:40:35.836705] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-14T16:40:35.836395] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-14T16:40:35.836426] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-14T16:40:35.836924] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-14T16:40:35.865377] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-14T16:40:35.870795] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-14T16:40:35.879222] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-14T16:40:35.931499] [DEBUG] [LOCAL ] AESI: Removed from QA tracker. [2025-09-14T16:40:35.940659] [DEBUG] [LOCAL ] AER: Removed from QA tracker. [2025-09-14T16:40:35.951961] [DEBUG] [LOCAL ] AES: Removed from QA tracker. [2025-09-14T16:40:35.940889] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-14T16:40:35.952066] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-14T16:40:35.952312] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-14T16:40:36.867406] [INFO ] [REMOTE ] AFB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:36.970850] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-14T16:40:37.179498] [INFO ] [REMOTE ] AESI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:37.198782] [INFO ] [REMOTE ] AER: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:37.204601] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-14T16:40:37.210055] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-14T16:40:37.281877] [INFO ] [REMOTE ] AES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:37.282178] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-14T16:40:37.919751] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T16:40:37.922527] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-14T16:40:38.643285] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T16:40:38.653406] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-14T16:40:38.967412] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:40:38.970813] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-14T16:40:39.018129] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:40:39.031804] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-14T16:40:39.158013] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T16:40:39.168450] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-14T16:40:39.764027] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T16:40:39.771860] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-14T16:40:40.163680] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T16:40:40.174671] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-14T16:40:40.396246] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:40:40.558875] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-14T16:40:40.623722] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T16:40:40.775322] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T16:40:41.358829] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-14T16:40:41.957359] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T16:40:42.158900] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-14T16:40:42.541907] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T16:40:42.958883] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-14T16:40:43.098506] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T16:40:43.758839] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-14T16:40:43.969572] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T16:40:44.558867] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-14T16:40:44.817972] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T16:40:45.358894] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-14T16:40:45.449694] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T16:40:46.158841] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-14T16:40:46.217945] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T16:40:46.925514] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T16:40:46.958781] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-14T16:40:47.758852] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-14T16:40:47.941012] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T16:40:48.558879] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-14T16:40:48.754780] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T16:40:49.358847] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-14T16:40:49.561271] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T16:40:49.925541] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-14T16:40:50.158863] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-14T16:40:50.790764] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T16:40:50.958809] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-14T16:40:51.758836] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-14T16:40:51.941144] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T16:40:52.463749] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T16:40:52.558851] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-14T16:40:52.951063] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T16:40:53.358849] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-14T16:40:54.158795] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-14T16:40:54.174172] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T16:40:54.238097] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T16:40:54.803623] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:40:54.809204] [INFO ] [REMOTE ] AES: Full fetch complete (58353 records). [2025-09-14T16:40:54.809345] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-14T16:40:54.963925] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-14T16:40:55.195907] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-14T16:40:55.196016] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-14T16:40:55.196622] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-14T16:40:55.196714] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-14T16:40:55.198158] [DEBUG] [LOCAL ] AES: Trimmed 58353 records to 40415 (keeping 150 days of data) [2025-09-14T16:40:55.447690] [DEBUG] [LOCAL ] AES: Primary data saved (40415 records). [2025-09-14T16:40:55.447848] [INFO ] [MAIN ] AES: Full history saved. [2025-09-14T16:40:55.447952] [INFO ] [MAIN ] Update Progress: 41/2370 symbols completed. AES took 21.1s. Estimated remaining: 3h 31m 51s. Rate: 11.0 symbols/min [2025-09-14T16:40:55.622243] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:55.639163] [DEBUG] [LOCAL ] AFG: Loaded 14359 existing records from primary storage. [2025-09-14T16:40:55.639346] [INFO ] [MAIN ] AFG: Loaded 14359 existing records. [2025-09-14T16:40:55.763918] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-14T16:40:55.828737] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:55.829088] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-14T16:40:55.834430] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-14T16:40:55.835172] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T16:40:55.837410] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-14T16:40:55.837725] [INFO ] [REMOTE ] AFB: Full fetch complete (12388 records). [2025-09-14T16:40:55.837931] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-14T16:40:55.838394] [DEBUG] [LOCAL ] AFG: Removed from QA tracker. [2025-09-14T16:40:55.843937] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-14T16:40:56.592033] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-14T16:40:56.622125] [INFO ] [REMOTE ] AFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:56.622379] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-14T16:40:56.623084] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-14T16:40:56.623196] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-14T16:40:56.591830] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-14T16:40:56.623924] [DEBUG] [LOCAL ] AFB: Trimmed 12388 records to 8175 (keeping 150 days of data) [2025-09-14T16:40:56.679551] [DEBUG] [LOCAL ] AFB: Primary data saved (8175 records). [2025-09-14T16:40:56.679768] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-14T16:40:56.679933] [INFO ] [MAIN ] Update Progress: 42/2370 symbols completed. AFB took 22.4s. Estimated remaining: 3h 27m 51s. Rate: 11.2 symbols/min [2025-09-14T16:40:56.866100] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:56.869061] [DEBUG] [LOCAL ] AFGB: Loaded 928 existing records from primary storage. [2025-09-14T16:40:56.869156] [INFO ] [MAIN ] AFGB: Loaded 928 existing records. [2025-09-14T16:40:57.052418] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:57.052718] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-14T16:40:57.052794] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-14T16:40:57.053050] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-14T16:40:57.053582] [DEBUG] [LOCAL ] AFGB: Removed from QA tracker. [2025-09-14T16:40:57.053710] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-14T16:40:57.360621] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-14T16:40:57.428776] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:57.444571] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T16:40:57.450330] [INFO ] [REMOTE ] AESI: Full fetch complete (53869 records). [2025-09-14T16:40:57.450670] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-14T16:40:57.567384] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-14T16:40:57.621788] [INFO ] [REMOTE ] AER: Full fetch complete (53141 records). [2025-09-14T16:40:57.659599] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-14T16:40:58.012894] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-14T16:40:58.034092] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-14T16:40:58.034767] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-14T16:40:58.072695] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-14T16:40:58.163945] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-14T16:40:58.169306] [DEBUG] [LOCAL ] AESI: Trimmed 53869 records to 37122 (keeping 150 days of data) [2025-09-14T16:40:58.303127] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-14T16:40:58.303273] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-14T16:40:58.303900] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-14T16:40:58.312165] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-14T16:40:58.343741] [DEBUG] [LOCAL ] AER: Trimmed 53141 records to 36323 (keeping 150 days of data) [2025-09-14T16:40:58.610905] [DEBUG] [LOCAL ] AESI: Primary data saved (37122 records). [2025-09-14T16:40:58.612278] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-14T16:40:58.613368] [INFO ] [MAIN ] Update Progress: 43/2370 symbols completed. AESI took 24.3s. Estimated remaining: 3h 24m 40s. Rate: 11.4 symbols/min [2025-09-14T16:40:58.770128] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T16:40:58.859882] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T16:40:58.959308] [DEBUG] [LOCAL ] AER: Primary data saved (36323 records). [2025-09-14T16:40:58.959066] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-14T16:40:58.980940] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:58.983248] [INFO ] [MAIN ] AER: Full history saved. [2025-09-14T16:40:58.984135] [INFO ] [MAIN ] Update Progress: 44/2370 symbols completed. AER took 24.7s. Estimated remaining: 3h 20m 16s. Rate: 11.6 symbols/min [2025-09-14T16:40:59.094367] [DEBUG] [LOCAL ] AFGC: Loaded 1425 existing records from primary storage. [2025-09-14T16:40:59.097127] [INFO ] [MAIN ] AFGC: Loaded 1425 existing records. [2025-09-14T16:40:59.297256] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:59.363274] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:59.366084] [DEBUG] [LOCAL ] AFGD: Loaded 700 existing records from primary storage. [2025-09-14T16:40:59.366342] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-14T16:40:59.366545] [INFO ] [MAIN ] AFGD: Loaded 700 existing records. [2025-09-14T16:40:59.371803] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-14T16:40:59.439688] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-14T16:40:59.479578] [DEBUG] [LOCAL ] AFGC: Removed from QA tracker. [2025-09-14T16:40:59.494759] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-14T16:40:59.500130] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T16:40:59.636281] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:59.665260] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-14T16:40:59.670997] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-14T16:40:59.721918] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-14T16:40:59.767973] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-14T16:40:59.825327] [DEBUG] [LOCAL ] AFGD: Removed from QA tracker. [2025-09-14T16:40:59.830631] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-14T16:41:00.084039] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:00.366229] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:00.558838] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-14T16:41:01.358851] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-14T16:41:01.372490] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T16:41:01.485907] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T16:41:02.064673] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T16:41:02.158807] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-14T16:41:02.685076] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T16:41:02.958843] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-14T16:41:03.340213] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-14T16:41:03.758843] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-14T16:41:04.264237] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T16:41:04.558930] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-14T16:41:05.094065] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T16:41:05.358823] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-14T16:41:05.782532] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T16:41:06.158815] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-14T16:41:06.657183] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-14T16:41:06.958839] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-14T16:41:07.373900] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T16:41:07.758828] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-14T16:41:08.558895] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-14T16:41:08.924865] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T16:41:09.231558] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T16:41:09.358846] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-14T16:41:10.158839] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-14T16:41:10.567723] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-14T16:41:10.824505] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:41:10.958836] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-14T16:41:11.483335] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T16:41:11.758874] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-14T16:41:12.274231] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:41:12.275152] [INFO ] [REMOTE ] AFGD: Full fetch complete (2037 records). [2025-09-14T16:41:12.275261] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-14T16:41:12.563984] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-14T16:41:12.630856] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-14T16:41:12.630950] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-14T16:41:12.631059] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-14T16:41:12.631111] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-14T16:41:12.631476] [DEBUG] [LOCAL ] AFGD: Trimmed 2037 records to 1355 (keeping 150 days of data) [2025-09-14T16:41:12.641068] [DEBUG] [LOCAL ] AFGD: Primary data saved (1355 records). [2025-09-14T16:41:12.641149] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-14T16:41:12.641241] [INFO ] [MAIN ] Update Progress: 45/2370 symbols completed. AFGD took 13.7s. Estimated remaining: 3h 27m 29s. Rate: 11.2 symbols/min [2025-09-14T16:41:12.809676] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:12.812822] [DEBUG] [LOCAL ] AFGE: Loaded 1199 existing records from primary storage. [2025-09-14T16:41:12.812912] [INFO ] [MAIN ] AFGE: Loaded 1199 existing records. [2025-09-14T16:41:12.986469] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:12.986770] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-14T16:41:12.986831] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-14T16:41:12.987141] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-14T16:41:12.988539] [DEBUG] [LOCAL ] AFGE: Removed from QA tracker. [2025-09-14T16:41:12.988610] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-14T16:41:13.220460] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T16:41:13.355426] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:13.358793] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-14T16:41:14.158848] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-14T16:41:14.690110] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T16:41:14.896612] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T16:41:14.958865] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-14T16:41:15.445880] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T16:41:15.758877] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-14T16:41:16.145031] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-14T16:41:16.558832] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-14T16:41:17.068045] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T16:41:17.358854] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-14T16:41:17.874500] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T16:41:18.158825] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-14T16:41:18.606150] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T16:41:18.958826] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-14T16:41:19.447479] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T16:41:19.758850] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-14T16:41:20.402867] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T16:41:20.558857] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-14T16:41:21.064399] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T16:41:21.358885] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-14T16:41:21.971077] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T16:41:22.158822] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-14T16:41:22.629180] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T16:41:22.630118] [INFO ] [REMOTE ] AFGC: Full fetch complete (2701 records). [2025-09-14T16:41:22.630204] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-14T16:41:22.964710] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-14T16:41:22.994357] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-14T16:41:22.994475] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-14T16:41:22.994604] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-14T16:41:22.994727] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-14T16:41:22.995095] [DEBUG] [LOCAL ] AFGC: Trimmed 2701 records to 2041 (keeping 150 days of data) [2025-09-14T16:41:23.009223] [DEBUG] [LOCAL ] AFGC: Primary data saved (2041 records). [2025-09-14T16:41:23.009307] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-14T16:41:23.009392] [INFO ] [MAIN ] Update Progress: 46/2370 symbols completed. AFGC took 24.4s. Estimated remaining: 3h 31m 37s. Rate: 11.0 symbols/min [2025-09-14T16:41:23.181917] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:23.208052] [DEBUG] [LOCAL ] AFL: Loaded 23755 existing records from primary storage. [2025-09-14T16:41:23.208227] [INFO ] [MAIN ] AFL: Loaded 23755 existing records. [2025-09-14T16:41:23.382773] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:23.383072] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-14T16:41:23.383131] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-14T16:41:23.383878] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-14T16:41:23.384376] [DEBUG] [LOCAL ] AFL: Removed from QA tracker. [2025-09-14T16:41:23.384436] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-14T16:41:23.740014] [INFO ] [REMOTE ] AFL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:23.758835] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-14T16:41:24.149696] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T16:41:24.558844] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-14T16:41:25.007328] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T16:41:25.008228] [INFO ] [REMOTE ] AFGB: Full fetch complete (2656 records). [2025-09-14T16:41:25.008322] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-14T16:41:25.368337] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-14T16:41:25.375323] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-14T16:41:25.376615] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-14T16:41:25.376895] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-14T16:41:25.377005] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-14T16:41:25.377744] [DEBUG] [LOCAL ] AFGB: Trimmed 2656 records to 1672 (keeping 150 days of data) [2025-09-14T16:41:25.390543] [DEBUG] [LOCAL ] AFGB: Primary data saved (1672 records). [2025-09-14T16:41:25.390693] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-14T16:41:25.390823] [INFO ] [MAIN ] Update Progress: 47/2370 symbols completed. AFGB took 28.7s. Estimated remaining: 3h 28m 59s. Rate: 11.1 symbols/min [2025-09-14T16:41:25.569778] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:41:25.606359] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:25.619370] [DEBUG] [LOCAL ] AG: Loaded 6234 existing records from primary storage. [2025-09-14T16:41:25.619529] [INFO ] [MAIN ] AG: Loaded 6234 existing records. [2025-09-14T16:41:25.799009] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-08-21, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:25.799312] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-14T16:41:25.799376] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-14T16:41:25.799744] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-14T16:41:25.800249] [DEBUG] [LOCAL ] AG: Removed from QA tracker. [2025-09-14T16:41:25.800317] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-14T16:41:26.152364] [INFO ] [REMOTE ] AG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:26.158778] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-14T16:41:26.783952] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T16:41:26.958837] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-14T16:41:27.562615] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T16:41:27.566111] [INFO ] [REMOTE ] AFG: Full fetch complete (35773 records). [2025-09-14T16:41:27.566240] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-14T16:41:27.760681] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-14T16:41:27.950530] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-14T16:41:27.950675] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-14T16:41:27.951189] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-14T16:41:27.951269] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-14T16:41:27.952516] [DEBUG] [LOCAL ] AFG: Trimmed 35773 records to 23793 (keeping 150 days of data) [2025-09-14T16:41:28.109038] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T16:41:28.174907] [DEBUG] [LOCAL ] AFG: Primary data saved (23793 records). [2025-09-14T16:41:28.175200] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-14T16:41:28.175430] [INFO ] [MAIN ] Update Progress: 48/2370 symbols completed. AFG took 32.7s. Estimated remaining: 3h 26m 48s. Rate: 11.2 symbols/min [2025-09-14T16:41:28.364089] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:28.372274] [DEBUG] [LOCAL ] AGCO: Loaded 4654 existing records from primary storage. [2025-09-14T16:41:28.372475] [INFO ] [MAIN ] AGCO: Loaded 4654 existing records. [2025-09-14T16:41:28.557924] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-08-21, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:28.558256] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-14T16:41:28.558362] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-14T16:41:28.558821] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-14T16:41:28.558716] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-14T16:41:28.560835] [DEBUG] [LOCAL ] AGCO: Removed from QA tracker. [2025-09-14T16:41:28.560910] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-14T16:41:28.927825] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:28.967978] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-14T16:41:29.358870] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-14T16:41:29.526730] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:41:29.903804] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T16:41:30.158832] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-14T16:41:30.728044] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T16:41:30.958857] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-14T16:41:31.758878] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-14T16:41:32.558884] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-14T16:41:32.986361] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T16:41:32.987270] [INFO ] [REMOTE ] AFGE: Full fetch complete (2650 records). [2025-09-14T16:41:32.987380] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-14T16:41:33.361489] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-14T16:41:33.407876] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-14T16:41:33.397409] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-14T16:41:33.420679] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-14T16:41:33.422545] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-14T16:41:33.422864] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-14T16:41:33.424314] [DEBUG] [LOCAL ] AFGE: Trimmed 2650 records to 1893 (keeping 150 days of data) [2025-09-14T16:41:33.437938] [DEBUG] [LOCAL ] AFGE: Primary data saved (1893 records). [2025-09-14T16:41:33.438463] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-14T16:41:33.438614] [INFO ] [MAIN ] Update Progress: 49/2370 symbols completed. AFGE took 20.8s. Estimated remaining: 3h 26m 38s. Rate: 11.2 symbols/min [2025-09-14T16:41:33.588087] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T16:41:33.667577] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:33.672941] [DEBUG] [LOCAL ] AGD: Loaded 2313 existing records from primary storage. [2025-09-14T16:41:33.673128] [INFO ] [MAIN ] AGD: Loaded 2313 existing records. [2025-09-14T16:41:33.858923] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-08-21, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:33.859247] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-14T16:41:33.859312] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-14T16:41:33.859697] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-14T16:41:33.860211] [DEBUG] [LOCAL ] AGD: Removed from QA tracker. [2025-09-14T16:41:33.860275] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-14T16:41:34.163944] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-14T16:41:34.219986] [INFO ] [REMOTE ] AGD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:34.958813] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-14T16:41:35.307063] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T16:41:35.758921] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-14T16:41:35.958893] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T16:41:36.418787] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T16:41:36.558853] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-14T16:41:36.752198] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T16:41:37.358866] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-14T16:41:37.469232] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T16:41:38.158869] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-14T16:41:38.912169] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T16:41:38.958838] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-14T16:41:39.758809] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-14T16:41:40.283490] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-14T16:41:40.383825] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T16:41:40.558799] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-14T16:41:40.771720] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T16:41:41.358836] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-14T16:41:42.158820] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-14T16:41:42.357918] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T16:41:42.958880] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-14T16:41:43.141619] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T16:41:43.758888] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-14T16:41:44.028836] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T16:41:44.094151] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T16:41:44.558950] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-14T16:41:45.358983] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-14T16:41:45.485031] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:41:45.689768] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T16:41:46.158861] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-14T16:41:46.958957] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-14T16:41:47.169039] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T16:41:47.609441] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-14T16:41:47.758829] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-14T16:41:48.213522] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:41:48.558841] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-14T16:41:48.864313] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T16:41:49.358841] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-14T16:41:50.158831] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-14T16:41:50.302086] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T16:41:50.304517] [INFO ] [REMOTE ] AGD: Full fetch complete (18500 records). [2025-09-14T16:41:50.304609] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-14T16:41:50.674314] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-14T16:41:50.674544] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-14T16:41:50.675003] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-14T16:41:50.675099] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-14T16:41:50.676259] [DEBUG] [LOCAL ] AGD: Trimmed 18500 records to 13696 (keeping 150 days of data) [2025-09-14T16:41:50.777678] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-14T16:41:50.806572] [DEBUG] [LOCAL ] AGD: Primary data saved (13696 records). [2025-09-14T16:41:50.806808] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-14T16:41:50.806932] [INFO ] [MAIN ] Update Progress: 50/2370 symbols completed. AGD took 17.4s. Estimated remaining: 3h 35m 51s. Rate: 10.7 symbols/min [2025-09-14T16:41:50.963882] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-14T16:41:50.981008] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:51.005858] [DEBUG] [LOCAL ] AGI: Loaded 23883 existing records from primary storage. [2025-09-14T16:41:51.006031] [INFO ] [MAIN ] AGI: Loaded 23883 existing records. [2025-09-14T16:41:51.198065] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:51.198342] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-14T16:41:51.198429] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-14T16:41:51.199130] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-14T16:41:51.200432] [DEBUG] [LOCAL ] AGI: Removed from QA tracker. [2025-09-14T16:41:51.200495] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-14T16:41:51.587714] [INFO ] [REMOTE ] AGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:51.705371] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T16:41:51.758779] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-14T16:41:52.104557] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T16:41:52.110611] [INFO ] [REMOTE ] AFL: Full fetch complete (57757 records). [2025-09-14T16:41:52.110789] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-14T16:41:52.507735] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-14T16:41:52.507928] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-14T16:41:52.508577] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-14T16:41:52.508716] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-14T16:41:52.510271] [DEBUG] [LOCAL ] AFL: Trimmed 57757 records to 39995 (keeping 150 days of data) [2025-09-14T16:41:52.571009] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-14T16:41:52.654358] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T16:41:52.821637] [DEBUG] [LOCAL ] AFL: Primary data saved (39995 records). [2025-09-14T16:41:52.821969] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-14T16:41:52.822081] [INFO ] [MAIN ] Update Progress: 51/2370 symbols completed. AFL took 29.8s. Estimated remaining: 3h 33m 3s. Rate: 10.9 symbols/min [2025-09-14T16:41:52.991988] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:53.014780] [DEBUG] [LOCAL ] AGL: Loaded 23346 existing records from primary storage. [2025-09-14T16:41:53.014951] [INFO ] [MAIN ] AGL: Loaded 23346 existing records. [2025-09-14T16:41:53.194130] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:53.194503] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-14T16:41:53.194574] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-14T16:41:53.195407] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-14T16:41:53.196190] [DEBUG] [LOCAL ] AGL: Removed from QA tracker. [2025-09-14T16:41:53.196258] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-14T16:41:53.371998] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-14T16:41:53.563936] [INFO ] [REMOTE ] AGL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:54.158817] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-14T16:41:54.380250] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:41:54.958863] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-14T16:41:55.108756] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T16:41:55.570266] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:41:55.758848] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-14T16:41:56.170452] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T16:41:56.174959] [INFO ] [REMOTE ] AGCO: Full fetch complete (46629 records). [2025-09-14T16:41:56.175074] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-14T16:41:56.558411] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-14T16:41:56.558601] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-14T16:41:56.559158] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-14T16:41:56.559213] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-14T16:41:56.559366] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-14T16:41:56.562590] [DEBUG] [LOCAL ] AGCO: Trimmed 46629 records to 31794 (keeping 150 days of data) [2025-09-14T16:41:56.832152] [DEBUG] [LOCAL ] AGCO: Primary data saved (31794 records). [2025-09-14T16:41:56.832396] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-14T16:41:56.832532] [INFO ] [MAIN ] Update Progress: 52/2370 symbols completed. AGCO took 28.7s. Estimated remaining: 3h 31m 51s. Rate: 10.9 symbols/min [2025-09-14T16:41:57.075577] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:57.140243] [DEBUG] [LOCAL ] AGM: Loaded 4970 existing records from primary storage. [2025-09-14T16:41:57.140469] [INFO ] [MAIN ] AGM: Loaded 4970 existing records. [2025-09-14T16:41:57.169496] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T16:41:57.364249] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-14T16:41:57.464837] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:57.465255] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-14T16:41:57.465335] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-14T16:41:57.466105] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-14T16:41:57.467131] [DEBUG] [LOCAL ] AGM: Removed from QA tracker. [2025-09-14T16:41:57.467227] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-14T16:41:57.900527] [INFO ] [REMOTE ] AGM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:58.158828] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-14T16:41:58.634220] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-14T16:41:58.640173] [INFO ] [REMOTE ] AG: Full fetch complete (58316 records). [2025-09-14T16:41:58.640353] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-14T16:41:58.959451] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-14T16:41:58.964833] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T16:41:59.047274] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-14T16:41:59.047380] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-14T16:41:59.048020] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-14T16:41:59.048085] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-14T16:41:59.049471] [DEBUG] [LOCAL ] AG: Trimmed 58316 records to 40385 (keeping 150 days of data) [2025-09-14T16:41:59.198865] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T16:41:59.341686] [DEBUG] [LOCAL ] AG: Primary data saved (40385 records). [2025-09-14T16:41:59.341851] [INFO ] [MAIN ] AG: Full history saved. [2025-09-14T16:41:59.341954] [INFO ] [MAIN ] Update Progress: 53/2370 symbols completed. AG took 34.0s. Estimated remaining: 3h 29m 35s. Rate: 11.1 symbols/min [2025-09-14T16:41:59.509345] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:59.522809] [DEBUG] [LOCAL ] AGO: Loaded 12293 existing records from primary storage. [2025-09-14T16:41:59.522971] [INFO ] [MAIN ] AGO: Loaded 12293 existing records. [2025-09-14T16:41:59.696920] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:59.697232] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-14T16:41:59.697294] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-14T16:41:59.697773] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-14T16:41:59.698252] [DEBUG] [LOCAL ] AGO: Removed from QA tracker. [2025-09-14T16:41:59.698318] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-14T16:41:59.764964] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-14T16:42:00.086780] [INFO ] [REMOTE ] AGO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:00.484060] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-14T16:42:00.558777] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-14T16:42:00.961603] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T16:42:01.358878] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-14T16:42:01.729860] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T16:42:01.930397] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-14T16:42:02.158821] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-14T16:42:02.958829] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-14T16:42:03.758837] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-14T16:42:03.993037] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T16:42:04.054114] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T16:42:04.558835] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-14T16:42:05.358782] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-14T16:42:05.667476] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T16:42:05.800466] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T16:42:05.929981] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T16:42:06.158815] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-14T16:42:06.958832] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-14T16:42:07.758832] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-14T16:42:08.098079] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T16:42:08.558798] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-14T16:42:08.688794] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:42:08.860970] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T16:42:09.358831] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-14T16:42:10.158826] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-14T16:42:10.339521] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T16:42:10.436717] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T16:42:10.958922] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-14T16:42:11.047067] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T16:42:11.758890] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-14T16:42:12.348405] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T16:42:12.558856] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-14T16:42:13.346997] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T16:42:13.358935] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-14T16:42:13.423628] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T16:42:14.158833] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-14T16:42:14.463492] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T16:42:14.958870] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-14T16:42:15.758910] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-14T16:42:15.951505] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T16:42:16.514584] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T16:42:16.516420] [INFO ] [REMOTE ] AGM: Full fetch complete (10249 records). [2025-09-14T16:42:16.516517] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-14T16:42:16.564085] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-14T16:42:16.900942] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-14T16:42:16.907020] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-14T16:42:16.915855] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-14T16:42:16.916632] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-14T16:42:16.917498] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-14T16:42:16.923271] [DEBUG] [LOCAL ] AGM: Trimmed 10249 records to 8023 (keeping 150 days of data) [2025-09-14T16:42:16.924361] [INFO ] [REMOTE ] AGI: Full fetch complete (58053 records). [2025-09-14T16:42:16.924776] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-14T16:42:17.201409] [DEBUG] [LOCAL ] AGM: Primary data saved (8023 records). [2025-09-14T16:42:17.238715] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-14T16:42:17.260026] [INFO ] [MAIN ] Update Progress: 54/2370 symbols completed. AGM took 20.4s. Estimated remaining: 3h 38m 26s. Rate: 10.6 symbols/min [2025-09-14T16:42:17.362232] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-14T16:42:17.465497] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-14T16:42:17.481463] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-14T16:42:17.492561] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-14T16:42:17.519299] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-14T16:42:17.538938] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:17.541044] [DEBUG] [LOCAL ] AGI: Trimmed 58053 records to 40181 (keeping 150 days of data) [2025-09-14T16:42:17.647331] [DEBUG] [LOCAL ] AGRO: Loaded 13326 existing records from primary storage. [2025-09-14T16:42:17.648531] [INFO ] [MAIN ] AGRO: Loaded 13326 existing records. [2025-09-14T16:42:17.836892] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:17.840494] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-14T16:42:17.842869] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-14T16:42:17.845419] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-14T16:42:17.849868] [DEBUG] [LOCAL ] AGRO: Removed from QA tracker. [2025-09-14T16:42:17.851063] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-14T16:42:18.330308] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:18.331784] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-14T16:42:18.361200] [DEBUG] [LOCAL ] AGI: Primary data saved (40181 records). [2025-09-14T16:42:18.361369] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-14T16:42:18.361479] [INFO ] [MAIN ] Update Progress: 55/2370 symbols completed. AGI took 27.6s. Estimated remaining: 3h 35m 8s. Rate: 10.8 symbols/min [2025-09-14T16:42:18.573545] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:18.576273] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T16:42:18.604183] [DEBUG] [LOCAL ] AGX: Loaded 14694 existing records from primary storage. [2025-09-14T16:42:18.604346] [INFO ] [MAIN ] AGX: Loaded 14694 existing records. [2025-09-14T16:42:18.782916] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:18.783369] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-14T16:42:18.783517] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-14T16:42:18.790094] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-14T16:42:18.801930] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T16:42:18.808496] [DEBUG] [LOCAL ] AGX: Removed from QA tracker. [2025-09-14T16:42:18.808908] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-14T16:42:18.965202] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-14T16:42:19.161468] [INFO ] [REMOTE ] AGX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:19.743543] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:42:19.758777] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-14T16:42:20.345403] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T16:42:20.558829] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-14T16:42:21.073748] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T16:42:21.076938] [INFO ] [REMOTE ] AGO: Full fetch complete (30302 records). [2025-09-14T16:42:21.077151] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-14T16:42:21.210221] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T16:42:21.365729] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-14T16:42:21.498548] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-14T16:42:21.498710] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-14T16:42:21.499215] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-14T16:42:21.499281] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-14T16:42:21.500670] [DEBUG] [LOCAL ] AGO: Trimmed 30302 records to 20744 (keeping 150 days of data) [2025-09-14T16:42:21.637133] [DEBUG] [LOCAL ] AGO: Primary data saved (20744 records). [2025-09-14T16:42:21.637340] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-14T16:42:21.637469] [INFO ] [MAIN ] Update Progress: 56/2370 symbols completed. AGO took 22.3s. Estimated remaining: 3h 33m 27s. Rate: 10.8 symbols/min [2025-09-14T16:42:21.822236] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:21.841495] [DEBUG] [LOCAL ] AHH: Loaded 17265 existing records from primary storage. [2025-09-14T16:42:21.841802] [INFO ] [MAIN ] AHH: Loaded 17265 existing records. [2025-09-14T16:42:22.042725] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:22.043099] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-14T16:42:22.043199] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-14T16:42:22.043709] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-14T16:42:22.044219] [DEBUG] [LOCAL ] AHH: Removed from QA tracker. [2025-09-14T16:42:22.044280] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-14T16:42:22.159227] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-14T16:42:22.421076] [INFO ] [REMOTE ] AHH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:22.699164] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T16:42:22.958900] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-14T16:42:23.698636] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T16:42:23.704557] [INFO ] [REMOTE ] AGL: Full fetch complete (56909 records). [2025-09-14T16:42:23.704824] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-14T16:42:23.769296] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-14T16:42:24.111543] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-14T16:42:24.111714] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-14T16:42:24.112411] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-14T16:42:24.112484] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-14T16:42:24.114190] [DEBUG] [LOCAL ] AGL: Trimmed 56909 records to 39444 (keeping 150 days of data) [2025-09-14T16:42:24.356793] [DEBUG] [LOCAL ] AGL: Primary data saved (39444 records). [2025-09-14T16:42:24.357056] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-14T16:42:24.357243] [INFO ] [MAIN ] Update Progress: 57/2370 symbols completed. AGL took 31.5s. Estimated remaining: 3h 31m 28s. Rate: 10.9 symbols/min [2025-09-14T16:42:24.542016] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:24.555068] [DEBUG] [LOCAL ] AHL: Loaded 10934 existing records from primary storage. [2025-09-14T16:42:24.555308] [INFO ] [MAIN ] AHL: Loaded 10934 existing records. [2025-09-14T16:42:24.589668] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-14T16:42:24.778376] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T16:42:24.785172] [WARN ] [MAIN ] AHL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:24.793594] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-14T16:42:24.793701] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-14T16:42:24.794124] [DEBUG] [LOCAL ] AHL: Deleted primary data file. [2025-09-14T16:42:24.794639] [DEBUG] [LOCAL ] AHL: Removed from QA tracker. [2025-09-14T16:42:24.794731] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-14T16:42:25.184793] [INFO ] [REMOTE ] AHL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:25.217943] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T16:42:25.358863] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-14T16:42:25.981708] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T16:42:26.158814] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-14T16:42:26.449604] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:42:26.450152] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-14T16:42:26.557252] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T16:42:26.958836] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-14T16:42:27.758833] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-14T16:42:28.414401] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T16:42:28.558873] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-14T16:42:29.366296] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-14T16:42:29.384836] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T16:42:30.032611] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:42:30.033021] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-14T16:42:30.138023] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T16:42:30.158781] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-14T16:42:30.958876] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-14T16:42:31.223450] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:42:31.223823] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-14T16:42:31.659140] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T16:42:31.758880] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-14T16:42:32.558852] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-14T16:42:33.365009] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-14T16:42:33.370034] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T16:42:33.952158] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T16:42:34.149009] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T16:42:34.158791] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-14T16:42:34.958857] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-14T16:42:35.244915] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T16:42:35.758882] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-14T16:42:36.559859] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-14T16:42:36.561509] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T16:42:37.043524] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T16:42:37.358875] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-14T16:42:38.005012] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T16:42:38.048305] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T16:42:38.158803] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-14T16:42:38.958832] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-14T16:42:39.431025] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T16:42:39.758833] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-14T16:42:40.558834] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-14T16:42:40.607792] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:42:41.120246] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T16:42:41.123967] [INFO ] [REMOTE ] AGX: Full fetch complete (36572 records). [2025-09-14T16:42:41.124068] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-14T16:42:41.371901] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-14T16:42:41.523555] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-14T16:42:41.523695] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-14T16:42:41.524200] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-14T16:42:41.524290] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-14T16:42:41.525270] [DEBUG] [LOCAL ] AGX: Trimmed 36572 records to 25055 (keeping 150 days of data) [2025-09-14T16:42:41.667605] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:42:41.710282] [DEBUG] [LOCAL ] AGX: Primary data saved (25055 records). [2025-09-14T16:42:41.710456] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-14T16:42:41.710562] [INFO ] [MAIN ] Update Progress: 58/2370 symbols completed. AGX took 23.3s. Estimated remaining: 3h 39m 15s. Rate: 10.5 symbols/min [2025-09-14T16:42:41.882962] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:41.906063] [DEBUG] [LOCAL ] AHR: Loaded 22179 existing records from primary storage. [2025-09-14T16:42:41.906264] [INFO ] [MAIN ] AHR: Loaded 22179 existing records. [2025-09-14T16:42:42.088610] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:42.088934] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-14T16:42:42.089012] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-14T16:42:42.089580] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-14T16:42:42.090206] [DEBUG] [LOCAL ] AHR: Removed from QA tracker. [2025-09-14T16:42:42.090290] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-14T16:42:42.164009] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-14T16:42:42.455761] [INFO ] [REMOTE ] AHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:42.467211] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T16:42:42.471317] [INFO ] [REMOTE ] AHL: Full fetch complete (15407 records). [2025-09-14T16:42:42.471438] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-14T16:42:42.659044] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 88 unique days, need 150 days [2025-09-14T16:42:42.659374] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:42:42.659452] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:42:42.659514] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-14T16:42:42.659605] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-14T16:42:42.659681] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-14T16:42:42.659750] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-14T16:42:42.659934] [INFO ] [MAIN ] Update Progress: 59/2370 symbols completed. AHL took 18.3s. Estimated remaining: 3h 36m 4s. Rate: 10.7 symbols/min [2025-09-14T16:42:42.829807] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:42.834596] [DEBUG] [LOCAL ] AHT: Loaded 3243 existing records from primary storage. [2025-09-14T16:42:42.834737] [INFO ] [MAIN ] AHT: Loaded 3243 existing records. [2025-09-14T16:42:42.974886] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-14T16:42:43.017075] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:43.017602] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-14T16:42:43.017700] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-14T16:42:43.018093] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-14T16:42:43.018602] [DEBUG] [LOCAL ] AHT: Removed from QA tracker. [2025-09-14T16:42:43.018696] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-14T16:42:43.380170] [INFO ] [REMOTE ] AHT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:43.647819] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T16:42:43.758831] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-14T16:42:44.558835] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-14T16:42:44.633914] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T16:42:44.661159] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:42:45.358832] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-14T16:42:45.721778] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-14T16:42:45.725552] [INFO ] [REMOTE ] AGRO: Full fetch complete (37403 records). [2025-09-14T16:42:45.725794] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-14T16:42:45.979414] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T16:42:46.130293] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-14T16:42:46.130429] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-14T16:42:46.130951] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-14T16:42:46.131014] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-14T16:42:46.131978] [DEBUG] [LOCAL ] AGRO: Trimmed 37403 records to 24450 (keeping 150 days of data) [2025-09-14T16:42:46.183914] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-14T16:42:46.281822] [DEBUG] [LOCAL ] AGRO: Primary data saved (24450 records). [2025-09-14T16:42:46.282010] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-14T16:42:46.282183] [INFO ] [MAIN ] Update Progress: 60/2370 symbols completed. AGRO took 29.0s. Estimated remaining: 3h 34m 42s. Rate: 10.8 symbols/min [2025-09-14T16:42:46.453361] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:46.476983] [DEBUG] [LOCAL ] AI: Loaded 24148 existing records from primary storage. [2025-09-14T16:42:46.477208] [INFO ] [MAIN ] AI: Loaded 24148 existing records. [2025-09-14T16:42:46.656705] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:46.657051] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-14T16:42:46.657133] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-14T16:42:46.657988] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-14T16:42:46.658460] [DEBUG] [LOCAL ] AI: Removed from QA tracker. [2025-09-14T16:42:46.658530] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-14T16:42:46.964022] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-14T16:42:47.021584] [INFO ] [REMOTE ] AI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:47.641175] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T16:42:47.753844] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T16:42:47.758763] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-14T16:42:48.270373] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T16:42:48.558835] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-14T16:42:49.358833] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-14T16:42:50.158829] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-14T16:42:50.201545] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T16:42:50.958878] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-14T16:42:51.579404] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T16:42:51.758882] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-14T16:42:51.805333] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-14T16:42:51.850139] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T16:42:52.558850] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-14T16:42:53.258709] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T16:42:53.358874] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-14T16:42:53.827088] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T16:42:53.831015] [INFO ] [REMOTE ] AHH: Full fetch complete (45220 records). [2025-09-14T16:42:53.831142] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-14T16:42:54.165522] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-14T16:42:54.224616] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-14T16:42:54.224764] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-14T16:42:54.225312] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-14T16:42:54.225386] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-14T16:42:54.226450] [DEBUG] [LOCAL ] AHH: Trimmed 45220 records to 30344 (keeping 150 days of data) [2025-09-14T16:42:54.421337] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T16:42:54.444740] [DEBUG] [LOCAL ] AHH: Primary data saved (30344 records). [2025-09-14T16:42:54.444927] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-14T16:42:54.445033] [INFO ] [MAIN ] Update Progress: 61/2370 symbols completed. AHH took 32.8s. Estimated remaining: 3h 36m 14s. Rate: 10.7 symbols/min [2025-09-14T16:42:54.620375] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:54.645608] [DEBUG] [LOCAL ] AIG: Loaded 23943 existing records from primary storage. [2025-09-14T16:42:54.645814] [INFO ] [MAIN ] AIG: Loaded 23943 existing records. [2025-09-14T16:42:54.794441] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T16:42:54.835597] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:54.835881] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-14T16:42:54.835960] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-14T16:42:54.836603] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-14T16:42:54.837165] [DEBUG] [LOCAL ] AIG: Removed from QA tracker. [2025-09-14T16:42:54.837226] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-14T16:42:54.963990] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-14T16:42:55.197366] [INFO ] [REMOTE ] AIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:55.758841] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-14T16:42:56.558853] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-14T16:42:57.358847] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-14T16:42:57.409167] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-14T16:42:57.531497] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T16:42:58.151153] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T16:42:58.158767] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-14T16:42:58.373750] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:42:58.652726] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T16:42:58.654299] [INFO ] [REMOTE ] AHT: Full fetch complete (6607 records). [2025-09-14T16:42:58.654457] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-14T16:42:58.964053] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-14T16:42:59.073712] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-14T16:42:59.073831] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-14T16:42:59.074080] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-14T16:42:59.074170] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-14T16:42:59.074679] [DEBUG] [LOCAL ] AHT: Trimmed 6607 records to 4581 (keeping 150 days of data) [2025-09-14T16:42:59.102451] [DEBUG] [LOCAL ] AHT: Primary data saved (4581 records). [2025-09-14T16:42:59.102619] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-14T16:42:59.102785] [INFO ] [MAIN ] Update Progress: 62/2370 symbols completed. AHT took 16.4s. Estimated remaining: 3h 35m 33s. Rate: 10.7 symbols/min [2025-09-14T16:42:59.281600] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:59.290768] [DEBUG] [LOCAL ] AII: Loaded 5786 existing records from primary storage. [2025-09-14T16:42:59.291067] [INFO ] [MAIN ] AII: Loaded 5786 existing records. [2025-09-14T16:42:59.472830] [WARN ] [MAIN ] AII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:59.473114] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-14T16:42:59.473175] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-14T16:42:59.473518] [DEBUG] [LOCAL ] AII: Deleted primary data file. [2025-09-14T16:42:59.474001] [DEBUG] [LOCAL ] AII: Removed from QA tracker. [2025-09-14T16:42:59.474073] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-14T16:42:59.764288] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-14T16:42:59.842798] [INFO ] [REMOTE ] AII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:00.558883] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-14T16:43:00.695315] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T16:43:00.928332] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:43:00.928706] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-14T16:43:01.358813] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-14T16:43:01.871279] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T16:43:02.158839] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-14T16:43:02.958846] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-14T16:43:03.279244] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T16:43:03.758831] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-14T16:43:04.008562] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:43:04.008919] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-14T16:43:04.128585] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T16:43:04.558840] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-14T16:43:04.920101] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T16:43:05.358865] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-14T16:43:06.132136] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T16:43:06.158785] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-14T16:43:06.958929] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-14T16:43:07.758853] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-14T16:43:07.828072] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-14T16:43:08.025877] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:43:08.038629] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-14T16:43:08.040058] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T16:43:08.089292] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T16:43:08.094734] [INFO ] [REMOTE ] AHR: Full fetch complete (53661 records). [2025-09-14T16:43:08.094913] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-14T16:43:08.492137] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-14T16:43:08.492287] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-14T16:43:08.492982] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-14T16:43:08.493098] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-14T16:43:08.494766] [DEBUG] [LOCAL ] AHR: Trimmed 53661 records to 37011 (keeping 150 days of data) [2025-09-14T16:43:08.582715] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-14T16:43:08.810839] [DEBUG] [LOCAL ] AHR: Primary data saved (37011 records). [2025-09-14T16:43:08.811120] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-14T16:43:08.811360] [INFO ] [MAIN ] Update Progress: 63/2370 symbols completed. AHR took 27.1s. Estimated remaining: 3h 37m 57s. Rate: 10.6 symbols/min [2025-09-14T16:43:09.096769] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:09.113546] [DEBUG] [LOCAL ] AIN: Loaded 11037 existing records from primary storage. [2025-09-14T16:43:09.113801] [INFO ] [MAIN ] AIN: Loaded 11037 existing records. [2025-09-14T16:43:09.363983] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-14T16:43:09.413304] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:09.413884] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-14T16:43:09.413982] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-14T16:43:09.414503] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-14T16:43:09.415244] [DEBUG] [LOCAL ] AIN: Removed from QA tracker. [2025-09-14T16:43:09.415405] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-14T16:43:09.830604] [INFO ] [REMOTE ] AIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:10.158842] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-14T16:43:10.958873] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-14T16:43:11.022243] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-14T16:43:11.150940] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T16:43:11.175721] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T16:43:11.758847] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-14T16:43:11.955292] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T16:43:12.558911] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-14T16:43:12.759080] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T16:43:13.358901] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-14T16:43:13.635167] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:43:14.158912] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-14T16:43:14.958873] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-14T16:43:15.211187] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T16:43:15.758860] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-14T16:43:15.891849] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T16:43:16.440005] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-14T16:43:16.558856] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-14T16:43:16.740603] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T16:43:17.358846] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-14T16:43:18.158856] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-14T16:43:18.610931] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T16:43:18.958854] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-14T16:43:19.002300] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T16:43:19.187128] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-14T16:43:19.605052] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:43:19.610549] [INFO ] [REMOTE ] AIG: Full fetch complete (58149 records). [2025-09-14T16:43:19.610710] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-14T16:43:19.763552] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-14T16:43:20.003199] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-14T16:43:20.003343] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-14T16:43:20.004070] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-14T16:43:20.004151] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-14T16:43:20.005803] [DEBUG] [LOCAL ] AIG: Trimmed 58149 records to 40230 (keeping 150 days of data) [2025-09-14T16:43:20.258244] [DEBUG] [LOCAL ] AIG: Primary data saved (40230 records). [2025-09-14T16:43:20.258411] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-14T16:43:20.258553] [INFO ] [MAIN ] Update Progress: 64/2370 symbols completed. AIG took 25.8s. Estimated remaining: 3h 41m 20s. Rate: 10.4 symbols/min [2025-09-14T16:43:20.425127] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:20.432686] [DEBUG] [LOCAL ] AIO: Loaded 4409 existing records from primary storage. [2025-09-14T16:43:20.432822] [INFO ] [MAIN ] AIO: Loaded 4409 existing records. [2025-09-14T16:43:20.571397] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-14T16:43:20.609461] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-07-01, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:20.609796] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-14T16:43:20.609863] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-14T16:43:20.610198] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-14T16:43:20.610676] [DEBUG] [LOCAL ] AIO: Removed from QA tracker. [2025-09-14T16:43:20.610735] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-14T16:43:20.976673] [INFO ] [REMOTE ] AIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:20.991401] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T16:43:21.358847] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-14T16:43:21.505607] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T16:43:21.507809] [INFO ] [REMOTE ] AII: Full fetch complete (9345 records). [2025-09-14T16:43:21.507911] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-14T16:43:21.687372] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 88 unique days, need 150 days [2025-09-14T16:43:21.687688] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:43:21.687762] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:43:21.687834] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-14T16:43:21.687950] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-14T16:43:21.688030] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-14T16:43:21.688123] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-14T16:43:21.688241] [INFO ] [MAIN ] Update Progress: 65/2370 symbols completed. AII took 22.6s. Estimated remaining: 3h 38m 41s. Rate: 10.5 symbols/min [2025-09-14T16:43:21.866596] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:21.880456] [DEBUG] [LOCAL ] AIR: Loaded 12527 existing records from primary storage. [2025-09-14T16:43:21.880618] [INFO ] [MAIN ] AIR: Loaded 12527 existing records. [2025-09-14T16:43:22.056130] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:22.056442] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-14T16:43:22.056502] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-14T16:43:22.057028] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-14T16:43:22.057481] [DEBUG] [LOCAL ] AIR: Removed from QA tracker. [2025-09-14T16:43:22.057543] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-14T16:43:22.163934] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-14T16:43:22.411126] [INFO ] [REMOTE ] AIR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:22.464569] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:43:22.958841] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-14T16:43:23.758834] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-14T16:43:24.278140] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T16:43:24.497618] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-14T16:43:24.503302] [INFO ] [REMOTE ] AI: Full fetch complete (58427 records). [2025-09-14T16:43:24.503464] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-14T16:43:24.567229] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-14T16:43:24.891491] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-14T16:43:24.891633] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-14T16:43:24.892395] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-14T16:43:24.892479] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-14T16:43:24.900469] [DEBUG] [LOCAL ] AI: Trimmed 58427 records to 40507 (keeping 150 days of data) [2025-09-14T16:43:24.912960] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T16:43:25.171910] [DEBUG] [LOCAL ] AI: Primary data saved (40507 records). [2025-09-14T16:43:25.172072] [INFO ] [MAIN ] AI: Full history saved. [2025-09-14T16:43:25.172189] [INFO ] [MAIN ] Update Progress: 66/2370 symbols completed. AI took 38.9s. Estimated remaining: 3h 37m 18s. Rate: 10.6 symbols/min [2025-09-14T16:43:25.344768] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:25.354090] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T16:43:25.358772] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-14T16:43:25.369358] [DEBUG] [LOCAL ] AIT: Loaded 11568 existing records from primary storage. [2025-09-14T16:43:25.369530] [INFO ] [MAIN ] AIT: Loaded 11568 existing records. [2025-09-14T16:43:25.556158] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:25.556487] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-14T16:43:25.556560] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-14T16:43:25.557217] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-14T16:43:25.558022] [DEBUG] [LOCAL ] AIT: Removed from QA tracker. [2025-09-14T16:43:25.558086] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-14T16:43:25.910639] [INFO ] [REMOTE ] AIT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:26.158825] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-14T16:43:26.170595] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T16:43:26.958840] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-14T16:43:27.407678] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T16:43:27.758849] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-14T16:43:27.976852] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T16:43:28.558834] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-14T16:43:28.859852] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T16:43:28.862459] [INFO ] [REMOTE ] AIN: Full fetch complete (25965 records). [2025-09-14T16:43:28.862595] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-14T16:43:29.250668] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-14T16:43:29.250842] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-14T16:43:29.251424] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-14T16:43:29.251582] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-14T16:43:29.252846] [DEBUG] [LOCAL ] AIN: Trimmed 25965 records to 18249 (keeping 150 days of data) [2025-09-14T16:43:29.273410] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T16:43:29.366089] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-14T16:43:29.403034] [DEBUG] [LOCAL ] AIN: Primary data saved (18249 records). [2025-09-14T16:43:29.403299] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-14T16:43:29.403432] [INFO ] [MAIN ] Update Progress: 67/2370 symbols completed. AIN took 20.6s. Estimated remaining: 3h 36m 23s. Rate: 10.6 symbols/min [2025-09-14T16:43:29.587700] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:29.606413] [DEBUG] [LOCAL ] AIV: Loaded 18534 existing records from primary storage. [2025-09-14T16:43:29.606626] [INFO ] [MAIN ] AIV: Loaded 18534 existing records. [2025-09-14T16:43:29.789925] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:29.790291] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-14T16:43:29.790360] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-14T16:43:29.790989] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-14T16:43:29.791496] [DEBUG] [LOCAL ] AIV: Removed from QA tracker. [2025-09-14T16:43:29.791560] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-14T16:43:30.165327] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-14T16:43:30.171596] [INFO ] [REMOTE ] AIV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:30.584210] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T16:43:30.958894] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-14T16:43:31.661765] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T16:43:31.758880] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-14T16:43:32.036453] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T16:43:32.558855] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-14T16:43:32.995177] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T16:43:33.358884] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-14T16:43:33.780307] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T16:43:34.158896] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-14T16:43:34.286839] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T16:43:34.958885] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-14T16:43:35.478976] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T16:43:35.567976] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T16:43:35.758872] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-14T16:43:36.558828] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-14T16:43:36.662761] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T16:43:37.358888] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-14T16:43:38.060615] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T16:43:38.089211] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T16:43:38.158805] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-14T16:43:38.798707] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T16:43:38.958847] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-14T16:43:39.758837] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-14T16:43:40.320056] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T16:43:40.558839] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-14T16:43:40.890873] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T16:43:41.358881] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-14T16:43:41.546269] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T16:43:42.099372] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T16:43:42.101100] [INFO ] [REMOTE ] AIO: Full fetch complete (14700 records). [2025-09-14T16:43:42.101191] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-14T16:43:42.165415] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-14T16:43:42.471533] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-14T16:43:42.471703] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-14T16:43:42.472140] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-14T16:43:42.472212] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-14T16:43:42.473134] [DEBUG] [LOCAL ] AIO: Trimmed 14700 records to 9333 (keeping 150 days of data) [2025-09-14T16:43:42.535918] [DEBUG] [LOCAL ] AIO: Primary data saved (9333 records). [2025-09-14T16:43:42.536169] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-14T16:43:42.536302] [INFO ] [MAIN ] Update Progress: 68/2370 symbols completed. AIO took 22.3s. Estimated remaining: 3h 40m 31s. Rate: 10.4 symbols/min [2025-09-14T16:43:42.725423] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:42.741707] [DEBUG] [LOCAL ] AIZ: Loaded 12691 existing records from primary storage. [2025-09-14T16:43:42.741969] [INFO ] [MAIN ] AIZ: Loaded 12691 existing records. [2025-09-14T16:43:42.943021] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:42.943342] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-14T16:43:42.943406] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-14T16:43:42.943989] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-14T16:43:42.944477] [DEBUG] [LOCAL ] AIZ: Removed from QA tracker. [2025-09-14T16:43:42.944538] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-14T16:43:42.965927] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-14T16:43:43.302222] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:43.308562] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T16:43:43.310860] [INFO ] [REMOTE ] AIT: Full fetch complete (30633 records). [2025-09-14T16:43:43.310950] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-14T16:43:43.675833] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-14T16:43:43.676183] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-14T16:43:43.676626] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-14T16:43:43.676738] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-14T16:43:43.678063] [DEBUG] [LOCAL ] AIT: Trimmed 30633 records to 20843 (keeping 150 days of data) [2025-09-14T16:43:43.697744] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T16:43:43.762560] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-14T16:43:43.842024] [DEBUG] [LOCAL ] AIT: Primary data saved (20843 records). [2025-09-14T16:43:43.842217] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-14T16:43:43.842330] [INFO ] [MAIN ] Update Progress: 69/2370 symbols completed. AIT took 18.7s. Estimated remaining: 3h 37m 57s. Rate: 10.6 symbols/min [2025-09-14T16:43:44.014079] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:44.018056] [DEBUG] [LOCAL ] AIZN: Loaded 1744 existing records from primary storage. [2025-09-14T16:43:44.018198] [INFO ] [MAIN ] AIZN: Loaded 1744 existing records. [2025-09-14T16:43:44.200857] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:44.201357] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-14T16:43:44.201419] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-14T16:43:44.201769] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-14T16:43:44.202298] [DEBUG] [LOCAL ] AIZN: Removed from QA tracker. [2025-09-14T16:43:44.202358] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-14T16:43:44.548117] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:44.558789] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-14T16:43:45.140559] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T16:43:45.206919] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T16:43:45.358858] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-14T16:43:46.158863] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-14T16:43:46.658039] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T16:43:46.958882] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-14T16:43:47.216633] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T16:43:47.693017] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T16:43:47.758798] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-14T16:43:48.230814] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-14T16:43:48.558882] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-14T16:43:49.358894] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-14T16:43:50.085153] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T16:43:50.158799] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-14T16:43:50.436381] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:43:50.751258] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T16:43:50.958838] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-14T16:43:51.582444] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T16:43:51.758852] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-14T16:43:52.558836] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-14T16:43:52.974342] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T16:43:53.358842] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-14T16:43:54.129097] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T16:43:54.158788] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-14T16:43:54.801293] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T16:43:54.958911] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-14T16:43:55.758840] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-14T16:43:55.802859] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T16:43:55.835483] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T16:43:56.558886] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-14T16:43:56.838851] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T16:43:57.358829] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-14T16:43:57.757940] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T16:43:57.841089] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T16:43:57.845885] [INFO ] [REMOTE ] AIV: Full fetch complete (43443 records). [2025-09-14T16:43:57.846036] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-14T16:43:58.164255] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-14T16:43:58.249236] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-14T16:43:58.249362] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-14T16:43:58.250434] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-14T16:43:58.250500] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-14T16:43:58.251968] [DEBUG] [LOCAL ] AIV: Trimmed 43443 records to 30028 (keeping 150 days of data) [2025-09-14T16:43:58.430249] [DEBUG] [LOCAL ] AIV: Primary data saved (30028 records). [2025-09-14T16:43:58.430467] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-14T16:43:58.430605] [INFO ] [MAIN ] Update Progress: 70/2370 symbols completed. AIV took 29.0s. Estimated remaining: 3h 42m 44s. Rate: 10.3 symbols/min [2025-09-14T16:43:58.616964] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:58.640366] [DEBUG] [LOCAL ] AJG: Loaded 20742 existing records from primary storage. [2025-09-14T16:43:58.640607] [INFO ] [MAIN ] AJG: Loaded 20742 existing records. [2025-09-14T16:43:58.825068] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:43:58.852888] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:58.857035] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-14T16:43:58.857132] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-14T16:43:58.857274] [INFO ] [REMOTE ] AIR: Full fetch complete (28570 records). [2025-09-14T16:43:58.857603] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-14T16:43:58.886680] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-14T16:43:58.905997] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-14T16:43:58.978949] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-14T16:43:59.691184] [INFO ] [REMOTE ] AJG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:59.691502] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-14T16:43:59.691833] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-14T16:43:59.693613] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-14T16:43:59.693835] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-14T16:43:59.695371] [DEBUG] [LOCAL ] AIR: Trimmed 28570 records to 19592 (keeping 150 days of data) [2025-09-14T16:43:59.760867] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-14T16:43:59.821906] [DEBUG] [LOCAL ] AIR: Primary data saved (19592 records). [2025-09-14T16:43:59.822125] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-14T16:43:59.822238] [INFO ] [MAIN ] Update Progress: 71/2370 symbols completed. AIR took 38.1s. Estimated remaining: 3h 40m 15s. Rate: 10.4 symbols/min [2025-09-14T16:44:00.001366] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:00.004801] [DEBUG] [LOCAL ] AKA: Loaded 370 existing records from primary storage. [2025-09-14T16:44:00.004890] [INFO ] [MAIN ] AKA: Loaded 370 existing records. [2025-09-14T16:44:00.181447] [WARN ] [MAIN ] AKA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:00.181941] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-14T16:44:00.182012] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-14T16:44:00.182577] [DEBUG] [LOCAL ] AKA: Deleted primary data file. [2025-09-14T16:44:00.183327] [DEBUG] [LOCAL ] AKA: Removed from QA tracker. [2025-09-14T16:44:00.183390] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-14T16:44:00.364942] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T16:44:00.562384] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-14T16:44:00.574800] [INFO ] [REMOTE ] AKA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:01.082917] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:44:01.084068] [INFO ] [REMOTE ] AIZN: Full fetch complete (4188 records). [2025-09-14T16:44:01.084173] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-14T16:44:01.361862] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-14T16:44:01.533816] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-14T16:44:01.534065] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-14T16:44:01.534348] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-14T16:44:01.534491] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-14T16:44:01.535438] [DEBUG] [LOCAL ] AIZN: Trimmed 4188 records to 2657 (keeping 150 days of data) [2025-09-14T16:44:01.554296] [DEBUG] [LOCAL ] AIZN: Primary data saved (2657 records). [2025-09-14T16:44:01.554482] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-14T16:44:01.554596] [INFO ] [MAIN ] Update Progress: 72/2370 symbols completed. AIZN took 17.7s. Estimated remaining: 3h 38m 2s. Rate: 10.5 symbols/min [2025-09-14T16:44:01.804979] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:01.833928] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T16:44:01.883190] [DEBUG] [LOCAL ] AKR: Loaded 21150 existing records from primary storage. [2025-09-14T16:44:01.883490] [INFO ] [MAIN ] AKR: Loaded 21150 existing records. [2025-09-14T16:44:02.164943] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-14T16:44:02.176688] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:02.177085] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-14T16:44:02.177185] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-14T16:44:02.178087] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-14T16:44:02.178196] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-14T16:44:02.699484] [INFO ] [REMOTE ] AKR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:02.800306] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T16:44:02.958876] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-14T16:44:03.758886] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-14T16:44:04.092742] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T16:44:04.525484] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T16:44:04.558830] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-14T16:44:04.839765] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T16:44:05.358822] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-14T16:44:06.158831] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-14T16:44:06.230495] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T16:44:06.669159] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T16:44:06.958833] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-14T16:44:07.026565] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T16:44:07.478799] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T16:44:07.758825] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-14T16:44:08.558873] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-14T16:44:09.358847] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-14T16:44:09.571199] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T16:44:09.916020] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T16:44:10.158851] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-14T16:44:10.375466] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T16:44:10.958890] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-14T16:44:11.758837] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-14T16:44:11.823914] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T16:44:12.323461] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T16:44:12.327188] [INFO ] [REMOTE ] AIZ: Full fetch complete (33323 records). [2025-09-14T16:44:12.327310] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-14T16:44:12.569183] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-14T16:44:12.731460] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-14T16:44:12.731611] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-14T16:44:12.732089] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-14T16:44:12.732155] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-14T16:44:12.733239] [DEBUG] [LOCAL ] AIZ: Trimmed 33323 records to 22672 (keeping 150 days of data) [2025-09-14T16:44:12.875411] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T16:44:12.920759] [DEBUG] [LOCAL ] AIZ: Primary data saved (22672 records). [2025-09-14T16:44:12.920930] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-14T16:44:12.921057] [INFO ] [MAIN ] Update Progress: 73/2370 symbols completed. AIZ took 30.4s. Estimated remaining: 3h 40m 54s. Rate: 10.4 symbols/min [2025-09-14T16:44:13.088055] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:13.106935] [DEBUG] [LOCAL ] AL: Loaded 19109 existing records from primary storage. [2025-09-14T16:44:13.107122] [INFO ] [MAIN ] AL: Loaded 19109 existing records. [2025-09-14T16:44:13.286738] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:13.287120] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-14T16:44:13.287213] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-14T16:44:13.288049] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-14T16:44:13.288131] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-14T16:44:13.364018] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-14T16:44:13.639352] [INFO ] [REMOTE ] AL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:14.039539] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T16:44:14.158820] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-14T16:44:14.958814] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-14T16:44:15.326534] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T16:44:15.508836] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T16:44:15.599150] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T16:44:15.758860] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-14T16:44:16.107428] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-14T16:44:16.558850] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-14T16:44:17.358839] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-14T16:44:17.724769] [DEBUG] [REMOTE ] AKR: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-14T16:44:17.725032] [WARN ] [REMOTE ] AKR: No data returned for month 2025-08 [2025-09-14T16:44:18.158900] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-14T16:44:18.243446] [DEBUG] [REMOTE ] AL: Error fetching primary data for 2025-02: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) [2025-09-14T16:44:18.243667] [WARN ] [REMOTE ] AL: No data returned for month 2025-02 [2025-09-14T16:44:18.683292] [DEBUG] [REMOTE ] AJG: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-14T16:44:18.683518] [WARN ] [REMOTE ] AJG: No data returned for month 2025-08 [2025-09-14T16:44:18.958839] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-14T16:44:19.758881] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-14T16:44:20.291865] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T16:44:20.420149] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:44:20.425086] [INFO ] [REMOTE ] AJG: Full fetch complete (44366 records). [2025-09-14T16:44:20.425204] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-14T16:44:20.570216] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-14T16:44:20.618702] [WARN ] [VALIDATOR ] AJG: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T16:44:20.619193] [FATAL] [MAIN ] AJG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:44:20.619245] [WARN ] [MAIN ] AJG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:44:20.619293] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-14T16:44:20.619362] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-14T16:44:20.619408] [INFO ] [LOCAL ] AJG: Starting deletion of derivative data. [2025-09-14T16:44:20.619452] [DEBUG] [LOCAL ] AJG: No derivative data file found to delete. [2025-09-14T16:44:20.619557] [INFO ] [MAIN ] Update Progress: 74/2370 symbols completed. AJG took 22.2s. Estimated remaining: 3h 41m 48s. Rate: 10.4 symbols/min [2025-09-14T16:44:20.794457] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:20.819086] [DEBUG] [LOCAL ] ALB: Loaded 23907 existing records from primary storage. [2025-09-14T16:44:20.819265] [INFO ] [MAIN ] ALB: Loaded 23907 existing records. [2025-09-14T16:44:20.994616] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:20.995149] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-14T16:44:20.995237] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-14T16:44:21.001131] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-14T16:44:21.007241] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-14T16:44:21.040085] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T16:44:21.114921] [INFO ] [REMOTE ] AKR: Full fetch complete (42243 records). [2025-09-14T16:44:21.135978] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-14T16:44:21.365816] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-14T16:44:21.577940] [WARN ] [VALIDATOR ] AKR: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T16:44:21.582284] [INFO ] [REMOTE ] ALB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:21.582818] [FATAL] [MAIN ] AKR: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:44:21.583155] [WARN ] [MAIN ] AKR: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:44:21.583228] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-14T16:44:21.583320] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-14T16:44:21.583377] [INFO ] [LOCAL ] AKR: Starting deletion of derivative data. [2025-09-14T16:44:21.583443] [DEBUG] [LOCAL ] AKR: No derivative data file found to delete. [2025-09-14T16:44:21.583538] [INFO ] [MAIN ] Update Progress: 75/2370 symbols completed. AKR took 20.0s. Estimated remaining: 3h 39m 15s. Rate: 10.5 symbols/min [2025-09-14T16:44:21.755726] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:21.779129] [DEBUG] [LOCAL ] ALC: Loaded 22893 existing records from primary storage. [2025-09-14T16:44:21.779311] [INFO ] [MAIN ] ALC: Loaded 22893 existing records. [2025-09-14T16:44:21.954290] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:21.954582] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-14T16:44:21.954682] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-14T16:44:21.955307] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-14T16:44:21.955372] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-14T16:44:22.163878] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-14T16:44:22.318283] [INFO ] [REMOTE ] ALC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:22.879873] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T16:44:22.958780] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-14T16:44:23.366074] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T16:44:23.758807] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-14T16:44:24.237216] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T16:44:24.558830] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-14T16:44:25.358888] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-14T16:44:25.535331] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T16:44:26.134827] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T16:44:26.158780] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-14T16:44:26.720812] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T16:44:26.958864] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-14T16:44:27.758833] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-14T16:44:27.949868] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T16:44:28.449572] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T16:44:28.558813] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-14T16:44:29.358837] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-14T16:44:29.517784] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T16:44:29.744822] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-14T16:44:30.152692] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T16:44:30.161252] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-14T16:44:30.958877] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-14T16:44:31.758891] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-14T16:44:32.305068] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-14T16:44:32.558835] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-14T16:44:32.868598] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T16:44:33.302373] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T16:44:33.358806] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-14T16:44:33.742697] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T16:44:33.748487] [INFO ] [REMOTE ] AL: Full fetch complete (42828 records). [2025-09-14T16:44:33.748658] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-14T16:44:33.939756] [WARN ] [VALIDATOR ] AL: Validation failed - insufficient historical data. Have 135 unique days, need 150 days [2025-09-14T16:44:33.940251] [FATAL] [MAIN ] AL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:44:33.940306] [WARN ] [MAIN ] AL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:44:33.940362] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-14T16:44:33.940434] [DEBUG] [LOCAL ] AL: No primary data file found to delete. [2025-09-14T16:44:33.940482] [INFO ] [LOCAL ] AL: Starting deletion of derivative data. [2025-09-14T16:44:33.940538] [DEBUG] [LOCAL ] AL: No derivative data file found to delete. [2025-09-14T16:44:33.940625] [INFO ] [MAIN ] Update Progress: 76/2370 symbols completed. AL took 21.0s. Estimated remaining: 3h 42m 29s. Rate: 10.3 symbols/min [2025-09-14T16:44:34.115190] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:34.131095] [DEBUG] [LOCAL ] ALE: Loaded 14802 existing records from primary storage. [2025-09-14T16:44:34.131246] [INFO ] [MAIN ] ALE: Loaded 14802 existing records. [2025-09-14T16:44:34.163987] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-14T16:44:34.315018] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:34.315457] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-14T16:44:34.315587] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-14T16:44:34.316116] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-14T16:44:34.316179] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-14T16:44:34.551485] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T16:44:34.572543] [INFO ] [REMOTE ] AKA: Full fetch complete (1783 records). [2025-09-14T16:44:34.596990] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-14T16:44:34.803186] [INFO ] [REMOTE ] ALE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:34.809490] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-14T16:44:34.898860] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T16:44:34.899292] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:44:34.899347] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:44:34.899403] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-14T16:44:34.899490] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-14T16:44:34.899539] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-14T16:44:34.899679] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-14T16:44:34.899770] [INFO ] [MAIN ] Update Progress: 77/2370 symbols completed. AKA took 35.1s. Estimated remaining: 3h 39m 58s. Rate: 10.4 symbols/min [2025-09-14T16:44:34.958778] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-14T16:44:35.758847] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-14T16:44:36.135510] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T16:44:36.558896] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-14T16:44:37.358789] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-14T16:44:37.753283] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T16:44:38.088398] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-14T16:44:38.158783] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-14T16:44:38.856857] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T16:44:38.958874] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-14T16:44:39.507016] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T16:44:39.758855] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-14T16:44:40.403300] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T16:44:40.558811] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-14T16:44:41.358927] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-14T16:44:42.130986] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-14T16:44:42.158810] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-14T16:44:42.194900] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T16:44:42.539918] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T16:44:42.630355] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T16:44:42.636172] [INFO ] [REMOTE ] ALB: Full fetch complete (57870 records). [2025-09-14T16:44:42.636362] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-14T16:44:42.964040] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-14T16:44:43.041800] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-14T16:44:43.041936] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-14T16:44:43.042753] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-14T16:44:43.042835] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-14T16:44:43.044681] [DEBUG] [LOCAL ] ALB: Trimmed 57870 records to 40199 (keeping 150 days of data) [2025-09-14T16:44:43.308705] [DEBUG] [LOCAL ] ALB: Primary data saved (40199 records). [2025-09-14T16:44:43.308916] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-14T16:44:43.309030] [INFO ] [MAIN ] Update Progress: 78/2370 symbols completed. ALB took 22.7s. Estimated remaining: 3h 41m 11s. Rate: 10.4 symbols/min [2025-09-14T16:44:43.758911] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-14T16:44:44.978479] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T16:44:44.984694] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-14T16:44:45.027290] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T16:44:45.358930] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-14T16:44:46.292772] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T16:44:46.301000] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-14T16:44:46.788626] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T16:44:46.794384] [INFO ] [REMOTE ] ALC: Full fetch complete (55353 records). [2025-09-14T16:44:46.794563] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-14T16:44:47.188023] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-14T16:44:47.188155] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-14T16:44:47.188799] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-14T16:44:47.188871] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-14T16:44:47.190257] [DEBUG] [LOCAL ] ALC: Trimmed 55353 records to 38195 (keeping 150 days of data) [2025-09-14T16:44:47.431811] [DEBUG] [LOCAL ] ALC: Primary data saved (38195 records). [2025-09-14T16:44:47.431998] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-14T16:44:47.432192] [INFO ] [MAIN ] Update Progress: 79/2370 symbols completed. ALC took 25.8s. Estimated remaining: 3h 40m 17s. Rate: 10.4 symbols/min [2025-09-14T16:44:47.736470] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T16:44:47.744771] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-14T16:44:48.361363] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:44:48.365208] [INFO ] [REMOTE ] ALE: Full fetch complete (31751 records). [2025-09-14T16:44:48.365348] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-14T16:44:48.761541] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-14T16:44:48.761726] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-14T16:44:48.762184] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-14T16:44:48.762246] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-14T16:44:48.763598] [DEBUG] [LOCAL ] ALE: Trimmed 31751 records to 22557 (keeping 150 days of data) [2025-09-14T16:44:48.912333] [DEBUG] [LOCAL ] ALE: Primary data saved (22557 records). [2025-09-14T16:44:48.912582] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-14T16:44:48.912747] [INFO ] [MAIN ] Update Progress: 80/2370 symbols completed. ALE took 15.0s. Estimated remaining: 3h 38m 8s. Rate: 10.5 symbols/min [2025-09-14T16:44:49.639197] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:49.635006] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:49.671820] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:49.695708] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:49.711818] [DEBUG] [LOCAL ] ALEX: Loaded 12990 existing records from primary storage. [2025-09-14T16:44:49.712252] [INFO ] [MAIN ] ALEX: Loaded 12990 existing records. [2025-09-14T16:44:49.722096] [DEBUG] [LOCAL ] ALG: Loaded 4373 existing records from primary storage. [2025-09-14T16:44:49.769286] [INFO ] [MAIN ] ALG: Loaded 4373 existing records. [2025-09-14T16:44:49.925238] [DEBUG] [LOCAL ] ALIT: Loaded 23581 existing records from primary storage. [2025-09-14T16:44:50.008112] [INFO ] [MAIN ] ALIT: Loaded 23581 existing records. [2025-09-14T16:44:50.060853] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:50.023681] [DEBUG] [LOCAL ] ALK: Loaded 23595 existing records from primary storage. [2025-09-14T16:44:50.110432] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-14T16:44:50.110268] [INFO ] [MAIN ] ALK: Loaded 23595 existing records. [2025-09-14T16:44:50.154110] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-14T16:44:50.324846] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:50.315102] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-14T16:44:50.367887] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-14T16:44:50.371697] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-14T16:44:50.438572] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-14T16:44:50.463089] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:50.468408] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-14T16:44:50.503250] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-14T16:44:50.659750] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:50.625528] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-14T16:44:50.704350] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-14T16:44:50.735499] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-14T16:44:50.795241] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-14T16:44:50.795088] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-14T16:44:50.917199] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-14T16:44:50.958109] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-14T16:44:51.051512] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-14T16:44:51.445725] [INFO ] [REMOTE ] ALG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:51.413344] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:51.446440] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-14T16:44:51.446958] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-14T16:44:51.950366] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:51.967815] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-14T16:44:51.971349] [INFO ] [REMOTE ] ALK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:51.972768] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-14T16:44:52.395453] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T16:44:52.401036] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-14T16:44:52.460189] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T16:44:52.463493] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-14T16:44:53.212551] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T16:44:53.216179] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-14T16:44:53.660255] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:44:53.670749] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-14T16:44:53.739625] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:44:53.828222] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T16:44:53.845329] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T16:44:54.158879] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-14T16:44:54.958934] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-14T16:44:55.174671] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T16:44:55.505457] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T16:44:55.659666] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T16:44:55.758855] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-14T16:44:56.558839] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-14T16:44:57.358852] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-14T16:44:57.635357] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T16:44:58.158836] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-14T16:44:58.499576] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T16:44:58.869709] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T16:44:58.958818] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-14T16:44:59.704377] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T16:44:59.758782] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-14T16:44:59.884771] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T16:45:00.558841] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-14T16:45:01.219012] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T16:45:01.358829] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-14T16:45:02.134537] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-14T16:45:02.158841] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-14T16:45:02.913454] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T16:45:02.958836] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-14T16:45:03.081881] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T16:45:03.758859] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-14T16:45:04.558840] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-14T16:45:04.934372] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T16:45:05.104057] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T16:45:05.187681] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T16:45:05.358846] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-14T16:45:06.158834] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-14T16:45:06.958815] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-14T16:45:07.092095] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T16:45:07.758849] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-14T16:45:08.010133] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T16:45:08.068320] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:45:08.558868] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-14T16:45:08.782921] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T16:45:08.784954] [INFO ] [REMOTE ] ALG: Full fetch complete (11833 records). [2025-09-14T16:45:08.785101] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-14T16:45:09.173971] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-14T16:45:09.174087] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-14T16:45:09.174372] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-14T16:45:09.174434] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-14T16:45:09.174975] [DEBUG] [LOCAL ] ALG: Trimmed 11833 records to 7527 (keeping 150 days of data) [2025-09-14T16:45:09.226677] [DEBUG] [LOCAL ] ALG: Primary data saved (7527 records). [2025-09-14T16:45:09.226844] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-14T16:45:09.226978] [INFO ] [MAIN ] Update Progress: 81/2370 symbols completed. ALG took 20.3s. Estimated remaining: 3h 44m 55s. Rate: 10.2 symbols/min [2025-09-14T16:45:09.366836] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-14T16:45:09.399378] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:09.415959] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T16:45:09.422868] [INFO ] [REMOTE ] ALIT: Full fetch complete (57375 records). [2025-09-14T16:45:09.423123] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-14T16:45:09.576920] [DEBUG] [LOCAL ] ALL: Loaded 22425 existing records from primary storage. [2025-09-14T16:45:09.610190] [INFO ] [MAIN ] ALL: Loaded 22425 existing records. [2025-09-14T16:45:10.042973] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:10.043180] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-14T16:45:10.043493] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-14T16:45:10.043384] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-14T16:45:10.043603] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-14T16:45:10.044531] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-14T16:45:10.044747] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-14T16:45:10.045524] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-14T16:45:10.045794] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-14T16:45:10.120857] [DEBUG] [LOCAL ] ALIT: Trimmed 57375 records to 39630 (keeping 150 days of data) [2025-09-14T16:45:10.216728] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-14T16:45:10.544735] [INFO ] [REMOTE ] ALL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:10.566134] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T16:45:10.715596] [DEBUG] [LOCAL ] ALIT: Primary data saved (39630 records). [2025-09-14T16:45:10.715828] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-14T16:45:10.715950] [INFO ] [MAIN ] Update Progress: 82/2370 symbols completed. ALIT took 21.8s. Estimated remaining: 3h 42m 46s. Rate: 10.3 symbols/min [2025-09-14T16:45:10.888142] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:10.913110] [DEBUG] [LOCAL ] ALLE: Loaded 19831 existing records from primary storage. [2025-09-14T16:45:10.913307] [INFO ] [MAIN ] ALLE: Loaded 19831 existing records. [2025-09-14T16:45:10.970760] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-14T16:45:11.102521] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:11.102817] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-14T16:45:11.102882] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-14T16:45:11.103484] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-14T16:45:11.103550] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-14T16:45:11.479879] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:11.758808] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-14T16:45:12.241927] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T16:45:12.368694] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:45:12.372605] [INFO ] [REMOTE ] ALEX: Full fetch complete (33412 records). [2025-09-14T16:45:12.372832] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-14T16:45:12.565944] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-14T16:45:12.778515] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-14T16:45:12.802633] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-14T16:45:12.803275] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-14T16:45:12.803404] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-14T16:45:12.805286] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T16:45:12.816058] [DEBUG] [LOCAL ] ALEX: Trimmed 33412 records to 22143 (keeping 150 days of data) [2025-09-14T16:45:12.964632] [DEBUG] [LOCAL ] ALEX: Primary data saved (22143 records). [2025-09-14T16:45:12.964925] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-14T16:45:12.965092] [INFO ] [MAIN ] Update Progress: 83/2370 symbols completed. ALEX took 24.1s. Estimated remaining: 3h 41m 1s. Rate: 10.3 symbols/min [2025-09-14T16:45:13.148507] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:13.176669] [DEBUG] [LOCAL ] ALLY: Loaded 23761 existing records from primary storage. [2025-09-14T16:45:13.176938] [INFO ] [MAIN ] ALLY: Loaded 23761 existing records. [2025-09-14T16:45:13.355218] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:13.355489] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-14T16:45:13.355556] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-14T16:45:13.356584] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-14T16:45:13.356928] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-14T16:45:13.369710] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-14T16:45:13.730387] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:14.158846] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-14T16:45:14.777416] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-14T16:45:14.958849] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-14T16:45:15.561865] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-14T16:45:15.606365] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:45:15.612335] [INFO ] [REMOTE ] ALK: Full fetch complete (57645 records). [2025-09-14T16:45:15.612500] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-14T16:45:15.763931] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-14T16:45:16.005315] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-14T16:45:16.005444] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-14T16:45:16.006126] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-14T16:45:16.006191] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-14T16:45:16.007982] [DEBUG] [LOCAL ] ALK: Trimmed 57645 records to 39879 (keeping 150 days of data) [2025-09-14T16:45:16.250710] [DEBUG] [LOCAL ] ALK: Primary data saved (39879 records). [2025-09-14T16:45:16.250893] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-14T16:45:16.251009] [INFO ] [MAIN ] Update Progress: 84/2370 symbols completed. ALK took 27.3s. Estimated remaining: 3h 39m 47s. Rate: 10.4 symbols/min [2025-09-14T16:45:16.424998] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:16.454263] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T16:45:16.479859] [DEBUG] [LOCAL ] ALSN: Loaded 19789 existing records from primary storage. [2025-09-14T16:45:16.480063] [INFO ] [MAIN ] ALSN: Loaded 19789 existing records. [2025-09-14T16:45:16.563959] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-14T16:45:16.662976] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:16.663271] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-14T16:45:16.663333] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-14T16:45:16.663945] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-14T16:45:16.664008] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-14T16:45:17.022416] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:17.358838] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-14T16:45:17.661156] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T16:45:18.158808] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-14T16:45:18.679082] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T16:45:18.967763] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-14T16:45:18.973790] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T16:45:19.549453] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T16:45:19.758865] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-14T16:45:20.558873] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-14T16:45:20.719393] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T16:45:21.358865] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-14T16:45:21.608302] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T16:45:22.100796] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T16:45:22.158854] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-14T16:45:22.965018] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-14T16:45:22.971553] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T16:45:23.758870] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-14T16:45:24.132536] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T16:45:24.558843] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-14T16:45:24.764744] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T16:45:25.358827] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-14T16:45:25.546200] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T16:45:26.035253] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T16:45:26.158819] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-14T16:45:26.767581] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T16:45:26.958887] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-14T16:45:27.758825] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-14T16:45:27.819270] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T16:45:28.201293] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T16:45:28.558905] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-14T16:45:29.195503] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T16:45:29.358847] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-14T16:45:30.158812] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-14T16:45:30.599697] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T16:45:30.958883] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-14T16:45:31.292713] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T16:45:31.504541] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T16:45:31.758859] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-14T16:45:32.372779] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T16:45:32.558876] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-14T16:45:33.132631] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T16:45:33.358840] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-14T16:45:34.158842] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-14T16:45:34.239262] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T16:45:34.798290] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:45:34.804252] [INFO ] [REMOTE ] ALL: Full fetch complete (54509 records). [2025-09-14T16:45:34.804407] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-14T16:45:34.961035] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-14T16:45:35.213450] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-14T16:45:35.213697] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-14T16:45:35.214372] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-14T16:45:35.214443] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-14T16:45:35.240148] [DEBUG] [LOCAL ] ALL: Trimmed 54509 records to 37481 (keeping 150 days of data) [2025-09-14T16:45:35.241052] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T16:45:35.381359] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T16:45:35.389565] [INFO ] [REMOTE ] ALLY: Full fetch complete (57839 records). [2025-09-14T16:45:35.390764] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-14T16:45:35.761502] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-14T16:45:35.807021] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-14T16:45:35.807824] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-14T16:45:35.809259] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-14T16:45:35.809399] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-14T16:45:35.813750] [DEBUG] [LOCAL ] ALLY: Trimmed 57839 records to 40000 (keeping 150 days of data) [2025-09-14T16:45:36.052218] [DEBUG] [LOCAL ] ALL: Primary data saved (37481 records). [2025-09-14T16:45:36.053322] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-14T16:45:36.053678] [INFO ] [MAIN ] Update Progress: 85/2370 symbols completed. ALL took 26.8s. Estimated remaining: 3h 45m 58s. Rate: 10.1 symbols/min [2025-09-14T16:45:36.316803] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:36.340394] [DEBUG] [LOCAL ] ALTG: Loaded 11273 existing records from primary storage. [2025-09-14T16:45:36.341525] [INFO ] [MAIN ] ALTG: Loaded 11273 existing records. [2025-09-14T16:45:36.555035] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:36.557073] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-14T16:45:36.558048] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-14T16:45:36.559691] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-14T16:45:36.561035] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-14T16:45:36.559526] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-14T16:45:36.676007] [DEBUG] [LOCAL ] ALLY: Primary data saved (40000 records). [2025-09-14T16:45:36.678492] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-14T16:45:36.689448] [INFO ] [MAIN ] Update Progress: 86/2370 symbols completed. ALLY took 23.7s. Estimated remaining: 3h 43m 32s. Rate: 10.2 symbols/min [2025-09-14T16:45:37.151169] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:37.153481] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:37.162234] [DEBUG] [LOCAL ] ALUR: Loaded 3785 existing records from primary storage. [2025-09-14T16:45:37.162364] [INFO ] [MAIN ] ALUR: Loaded 3785 existing records. [2025-09-14T16:45:37.338276] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:37.338552] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-14T16:45:37.338614] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-14T16:45:37.338961] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-14T16:45:37.339023] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-14T16:45:37.369395] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-14T16:45:37.710579] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:37.745340] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T16:45:38.158801] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-14T16:45:38.389875] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T16:45:38.438747] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-14T16:45:38.443181] [INFO ] [REMOTE ] ALLE: Full fetch complete (49510 records). [2025-09-14T16:45:38.443330] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-14T16:45:38.767860] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T16:45:38.842264] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-14T16:45:38.842370] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-14T16:45:38.842884] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-14T16:45:38.842943] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-14T16:45:38.844048] [DEBUG] [LOCAL ] ALLE: Trimmed 49510 records to 33449 (keeping 150 days of data) [2025-09-14T16:45:38.963342] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-14T16:45:39.056069] [DEBUG] [LOCAL ] ALLE: Primary data saved (33449 records). [2025-09-14T16:45:39.056255] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-14T16:45:39.056363] [INFO ] [MAIN ] Update Progress: 87/2370 symbols completed. ALLE took 28.3s. Estimated remaining: 3h 41m 54s. Rate: 10.3 symbols/min [2025-09-14T16:45:39.226128] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:39.247428] [DEBUG] [LOCAL ] ALV: Loaded 19075 existing records from primary storage. [2025-09-14T16:45:39.247602] [INFO ] [MAIN ] ALV: Loaded 19075 existing records. [2025-09-14T16:45:39.425350] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:39.425617] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-14T16:45:39.425694] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-14T16:45:39.426374] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-14T16:45:39.426436] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-14T16:45:39.761059] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-14T16:45:39.782704] [INFO ] [REMOTE ] ALV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:40.057447] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-14T16:45:40.558845] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-14T16:45:41.071675] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T16:45:41.077440] [INFO ] [REMOTE ] ALSN: Full fetch complete (47498 records). [2025-09-14T16:45:41.077598] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-14T16:45:41.363929] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-14T16:45:41.481433] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-14T16:45:41.481574] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-14T16:45:41.482113] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-14T16:45:41.482175] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-14T16:45:41.483532] [DEBUG] [LOCAL ] ALSN: Trimmed 47498 records to 32125 (keeping 150 days of data) [2025-09-14T16:45:41.684866] [DEBUG] [LOCAL ] ALSN: Primary data saved (32125 records). [2025-09-14T16:45:41.685053] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-14T16:45:41.685160] [INFO ] [MAIN ] Update Progress: 88/2370 symbols completed. ALSN took 25.4s. Estimated remaining: 3h 40m 25s. Rate: 10.4 symbols/min [2025-09-14T16:45:41.868065] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:41.899233] [DEBUG] [LOCAL ] ALX: Loaded 3868 existing records from primary storage. [2025-09-14T16:45:41.901597] [INFO ] [MAIN ] ALX: Loaded 3868 existing records. [2025-09-14T16:45:41.901487] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T16:45:42.100736] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:42.100993] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-14T16:45:42.101053] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-14T16:45:42.101336] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-14T16:45:42.101395] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-14T16:45:42.164909] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-14T16:45:42.518402] [INFO ] [REMOTE ] ALX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:42.574872] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T16:45:42.958891] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-14T16:45:43.188920] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T16:45:43.497737] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T16:45:43.758853] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-14T16:45:44.558834] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-14T16:45:45.126217] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T16:45:45.358818] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-14T16:45:45.830669] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T16:45:46.158862] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-14T16:45:46.376563] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T16:45:46.701059] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T16:45:46.958855] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-14T16:45:47.758982] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-14T16:45:48.031715] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T16:45:48.559030] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-14T16:45:49.102863] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T16:45:49.358924] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-14T16:45:49.519335] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T16:45:49.934953] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-14T16:45:50.158840] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-14T16:45:50.958822] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-14T16:45:51.387227] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T16:45:51.425068] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T16:45:51.758844] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-14T16:45:52.558869] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-14T16:45:53.253342] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T16:45:53.358819] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-14T16:45:53.664176] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:45:54.158850] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-14T16:45:54.395853] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T16:45:54.958869] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-14T16:45:55.662856] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T16:45:55.744064] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T16:45:55.747506] [INFO ] [REMOTE ] ALTG: Full fetch complete (26054 records). [2025-09-14T16:45:55.747636] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-14T16:45:55.764059] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-14T16:45:56.116951] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-14T16:45:56.117087] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-14T16:45:56.117454] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-14T16:45:56.117513] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-14T16:45:56.118520] [DEBUG] [LOCAL ] ALTG: Trimmed 26054 records to 17492 (keeping 150 days of data) [2025-09-14T16:45:56.223191] [DEBUG] [LOCAL ] ALTG: Primary data saved (17492 records). [2025-09-14T16:45:56.223409] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-14T16:45:56.223549] [INFO ] [MAIN ] Update Progress: 89/2370 symbols completed. ALTG took 20.2s. Estimated remaining: 3h 44m 3s. Rate: 10.2 symbols/min [2025-09-14T16:45:56.401210] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:56.425691] [DEBUG] [LOCAL ] AM: Loaded 23179 existing records from primary storage. [2025-09-14T16:45:56.425872] [INFO ] [MAIN ] AM: Loaded 23179 existing records. [2025-09-14T16:45:56.570907] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-14T16:45:56.610497] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:56.610789] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-14T16:45:56.610883] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-14T16:45:56.611597] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-14T16:45:56.611690] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-14T16:45:56.920851] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T16:45:56.996202] [INFO ] [REMOTE ] AM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:57.358844] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-14T16:45:58.087207] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-14T16:45:58.158837] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-14T16:45:58.343409] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T16:45:58.958838] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-14T16:45:59.758807] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-14T16:45:59.849883] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:46:00.511564] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T16:46:00.558802] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-14T16:46:00.607451] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T16:46:01.358831] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-14T16:46:01.395040] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T16:46:02.158837] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-14T16:46:02.230111] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T16:46:02.958834] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-14T16:46:03.758837] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-14T16:46:03.780821] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T16:46:04.050245] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T16:46:04.072450] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T16:46:04.076827] [INFO ] [REMOTE ] ALV: Full fetch complete (46917 records). [2025-09-14T16:46:04.076951] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-14T16:46:04.451234] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-14T16:46:04.451406] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-14T16:46:04.452182] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-14T16:46:04.452258] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-14T16:46:04.454019] [DEBUG] [LOCAL ] ALV: Trimmed 46917 records to 31582 (keeping 150 days of data) [2025-09-14T16:46:04.559319] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-14T16:46:04.673296] [DEBUG] [LOCAL ] ALV: Primary data saved (31582 records). [2025-09-14T16:46:04.673521] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-14T16:46:04.673738] [INFO ] [MAIN ] Update Progress: 90/2370 symbols completed. ALV took 25.6s. Estimated remaining: 3h 45m 2s. Rate: 10.1 symbols/min [2025-09-14T16:46:04.849129] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:04.867174] [DEBUG] [LOCAL ] AMBC: Loaded 15715 existing records from primary storage. [2025-09-14T16:46:04.867370] [INFO ] [MAIN ] AMBC: Loaded 15715 existing records. [2025-09-14T16:46:05.042594] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:05.042854] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-14T16:46:05.042993] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-14T16:46:05.043861] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-14T16:46:05.043937] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-14T16:46:05.261212] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T16:46:05.311144] [INFO ] [REMOTE ] ALUR: Full fetch complete (13305 records). [2025-09-14T16:46:05.331685] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-14T16:46:05.364083] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-14T16:46:05.499902] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:05.774477] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-14T16:46:05.774587] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-14T16:46:05.774874] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-14T16:46:05.774930] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-14T16:46:05.775459] [DEBUG] [LOCAL ] ALUR: Trimmed 13305 records to 7481 (keeping 150 days of data) [2025-09-14T16:46:05.819473] [DEBUG] [LOCAL ] ALUR: Primary data saved (7481 records). [2025-09-14T16:46:05.819634] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-14T16:46:05.819758] [INFO ] [MAIN ] Update Progress: 91/2370 symbols completed. ALUR took 29.1s. Estimated remaining: 3h 42m 57s. Rate: 10.2 symbols/min [2025-09-14T16:46:05.993997] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:05.997446] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:46:05.999218] [INFO ] [REMOTE ] ALX: Full fetch complete (5844 records). [2025-09-14T16:46:05.999314] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-14T16:46:06.163968] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-14T16:46:06.226245] [DEBUG] [LOCAL ] AMBP: Loaded 19703 existing records from primary storage. [2025-09-14T16:46:06.259968] [INFO ] [MAIN ] AMBP: Loaded 19703 existing records. [2025-09-14T16:46:06.479951] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-14T16:46:06.485576] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-14T16:46:06.501209] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-14T16:46:06.535778] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-14T16:46:06.557709] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:06.558133] [DEBUG] [LOCAL ] ALX: Trimmed 5844 records to 5134 (keeping 150 days of data) [2025-09-14T16:46:06.558298] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-14T16:46:06.558694] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-14T16:46:06.559278] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-14T16:46:06.559352] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-14T16:46:06.935362] [DEBUG] [LOCAL ] ALX: Primary data saved (5134 records). [2025-09-14T16:46:06.938923] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-14T16:46:06.957393] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:06.957556] [INFO ] [MAIN ] Update Progress: 92/2370 symbols completed. ALX took 25.3s. Estimated remaining: 3h 40m 54s. Rate: 10.3 symbols/min [2025-09-14T16:46:06.978124] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-14T16:46:07.134063] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:07.143530] [DEBUG] [LOCAL ] AMBQ: Loaded 6757 existing records from primary storage. [2025-09-14T16:46:07.143748] [INFO ] [MAIN ] AMBQ: Loaded 6757 existing records. [2025-09-14T16:46:07.319343] [WARN ] [MAIN ] AMBQ: Insufficient historical data. Have data from 2025-07-30, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:07.319612] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-14T16:46:07.319689] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-14T16:46:07.320023] [DEBUG] [LOCAL ] AMBQ: Deleted primary data file. [2025-09-14T16:46:07.320087] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-14T16:46:07.672182] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:07.688968] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T16:46:07.758798] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-14T16:46:08.011719] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:08.012064] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-14T16:46:08.559222] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-14T16:46:08.559155] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T16:46:09.358898] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-14T16:46:09.609717] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:09.610070] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-14T16:46:10.158871] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-14T16:46:10.217974] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T16:46:10.958842] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-14T16:46:11.758901] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-14T16:46:12.028576] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:12.029039] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-14T16:46:12.060534] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T16:46:12.351065] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T16:46:12.558864] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-14T16:46:12.841845] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:12.842346] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-14T16:46:13.358847] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-14T16:46:14.158866] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-14T16:46:14.865734] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T16:46:14.958856] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-14T16:46:15.702848] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T16:46:15.758773] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-14T16:46:16.058529] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T16:46:16.558832] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-14T16:46:16.819322] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:16.819704] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-14T16:46:17.267806] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T16:46:17.358897] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-14T16:46:18.158843] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-14T16:46:18.810083] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T16:46:18.958835] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-14T16:46:19.758871] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-14T16:46:19.970177] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T16:46:20.350037] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T16:46:20.558871] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-14T16:46:21.190594] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T16:46:21.358842] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-14T16:46:21.834196] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T16:46:22.158864] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-14T16:46:22.745611] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T16:46:22.828245] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T16:46:22.958817] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-14T16:46:23.211910] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T16:46:23.215440] [INFO ] [REMOTE ] AMBC: Full fetch complete (40605 records). [2025-09-14T16:46:23.215571] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-14T16:46:23.581317] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-14T16:46:23.581422] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-14T16:46:23.581892] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-14T16:46:23.581947] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-14T16:46:23.582863] [DEBUG] [LOCAL ] AMBC: Trimmed 40605 records to 27132 (keeping 150 days of data) [2025-09-14T16:46:23.738741] [DEBUG] [LOCAL ] AMBC: Primary data saved (27132 records). [2025-09-14T16:46:23.738935] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-14T16:46:23.739071] [INFO ] [MAIN ] Update Progress: 93/2370 symbols completed. AMBC took 19.1s. Estimated remaining: 3h 45m 16s. Rate: 10.1 symbols/min [2025-09-14T16:46:23.768685] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-14T16:46:23.912170] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:23.935895] [DEBUG] [LOCAL ] AMC: Loaded 24163 existing records from primary storage. [2025-09-14T16:46:23.936080] [INFO ] [MAIN ] AMC: Loaded 24163 existing records. [2025-09-14T16:46:24.112124] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:24.112398] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-14T16:46:24.112487] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-14T16:46:24.113143] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-14T16:46:24.113219] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-14T16:46:24.468047] [INFO ] [REMOTE ] AMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:24.558811] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-14T16:46:25.358832] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-14T16:46:25.520822] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T16:46:26.158907] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-14T16:46:26.789617] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T16:46:26.859107] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T16:46:26.866025] [INFO ] [REMOTE ] AM: Full fetch complete (56821 records). [2025-09-14T16:46:26.896453] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-14T16:46:26.933597] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-14T16:46:26.964662] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-14T16:46:27.317690] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-14T16:46:27.317800] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-14T16:46:27.318374] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-14T16:46:27.318439] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-14T16:46:27.319715] [DEBUG] [LOCAL ] AM: Trimmed 56821 records to 39021 (keeping 150 days of data) [2025-09-14T16:46:27.559152] [DEBUG] [LOCAL ] AM: Primary data saved (39021 records). [2025-09-14T16:46:27.559337] [INFO ] [MAIN ] AM: Full history saved. [2025-09-14T16:46:27.559439] [INFO ] [MAIN ] Update Progress: 94/2370 symbols completed. AM took 31.3s. Estimated remaining: 3h 44m 19s. Rate: 10.1 symbols/min [2025-09-14T16:46:27.732444] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:27.755420] [DEBUG] [LOCAL ] AMCR: Loaded 24035 existing records from primary storage. [2025-09-14T16:46:27.755601] [INFO ] [MAIN ] AMCR: Loaded 24035 existing records. [2025-09-14T16:46:27.766761] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-14T16:46:27.940991] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:27.941300] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-14T16:46:27.941377] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-14T16:46:27.942151] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-14T16:46:27.942217] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-14T16:46:28.283782] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T16:46:28.303967] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:28.307458] [INFO ] [REMOTE ] AMBQ: Full fetch complete (6736 records). [2025-09-14T16:46:28.307575] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-14T16:46:28.489417] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 32 unique days, need 150 days [2025-09-14T16:46:28.489690] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:46:28.489746] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:46:28.489802] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-14T16:46:28.489871] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-14T16:46:28.489920] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-14T16:46:28.489970] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-14T16:46:28.490093] [INFO ] [MAIN ] Update Progress: 95/2370 symbols completed. AMBQ took 21.5s. Estimated remaining: 3h 42m 14s. Rate: 10.2 symbols/min [2025-09-14T16:46:28.563906] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-14T16:46:28.670717] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:28.697257] [DEBUG] [LOCAL ] AME: Loaded 21800 existing records from primary storage. [2025-09-14T16:46:28.697505] [INFO ] [MAIN ] AME: Loaded 21800 existing records. [2025-09-14T16:46:28.886336] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:28.886696] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-14T16:46:28.886766] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-14T16:46:28.887536] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-14T16:46:28.887618] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-14T16:46:29.253000] [INFO ] [REMOTE ] AME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:29.358854] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-14T16:46:30.154093] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T16:46:30.162804] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-14T16:46:30.196663] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-14T16:46:30.958868] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-14T16:46:31.173137] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:46:31.598541] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T16:46:31.758841] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-14T16:46:32.558847] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-14T16:46:33.176153] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T16:46:33.358848] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-14T16:46:33.711043] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T16:46:34.158855] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-14T16:46:34.374518] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T16:46:34.958832] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-14T16:46:35.712920] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T16:46:35.758810] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-14T16:46:35.848279] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-14T16:46:36.354749] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T16:46:36.558830] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-14T16:46:37.303858] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T16:46:37.358785] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-14T16:46:38.158839] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-14T16:46:38.242110] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T16:46:38.622474] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T16:46:38.627569] [INFO ] [REMOTE ] AMBP: Full fetch complete (49456 records). [2025-09-14T16:46:38.627728] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-14T16:46:38.964093] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-14T16:46:39.036561] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-14T16:46:39.036770] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-14T16:46:39.037330] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-14T16:46:39.037388] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-14T16:46:39.038503] [DEBUG] [LOCAL ] AMBP: Trimmed 49456 records to 34048 (keeping 150 days of data) [2025-09-14T16:46:39.244857] [DEBUG] [LOCAL ] AMBP: Primary data saved (34048 records). [2025-09-14T16:46:39.245065] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-14T16:46:39.245181] [INFO ] [MAIN ] Update Progress: 96/2370 symbols completed. AMBP took 33.4s. Estimated remaining: 3h 44m 4s. Rate: 10.1 symbols/min [2025-09-14T16:46:39.416437] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:39.426043] [DEBUG] [LOCAL ] AMG: Loaded 8334 existing records from primary storage. [2025-09-14T16:46:39.426163] [INFO ] [MAIN ] AMG: Loaded 8334 existing records. [2025-09-14T16:46:39.600952] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:39.601236] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-14T16:46:39.601298] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-14T16:46:39.601688] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-14T16:46:39.601754] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-14T16:46:39.765465] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-14T16:46:39.971660] [INFO ] [REMOTE ] AMG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:40.002085] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T16:46:40.558867] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-14T16:46:40.712013] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T16:46:41.358833] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-14T16:46:41.686797] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T16:46:42.158857] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-14T16:46:42.393428] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T16:46:42.868461] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T16:46:42.958835] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-14T16:46:43.308490] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T16:46:43.758837] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-14T16:46:44.148045] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T16:46:44.558869] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-14T16:46:44.803746] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:46:45.358838] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-14T16:46:46.158836] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-14T16:46:46.588682] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T16:46:46.876724] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-14T16:46:46.958875] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-14T16:46:47.758859] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-14T16:46:48.060294] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T16:46:48.558851] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-14T16:46:48.751001] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T16:46:49.358845] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-14T16:46:49.382268] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T16:46:50.158819] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-14T16:46:50.201736] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-14T16:46:50.814011] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:46:50.821948] [INFO ] [REMOTE ] AMCR: Full fetch complete (58347 records). [2025-09-14T16:46:50.822083] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-14T16:46:50.964106] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-14T16:46:51.223662] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-14T16:46:51.223972] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-14T16:46:51.224901] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-14T16:46:51.225109] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-14T16:46:51.242948] [DEBUG] [LOCAL ] AMCR: Trimmed 58347 records to 40412 (keeping 150 days of data) [2025-09-14T16:46:51.255966] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T16:46:51.547859] [DEBUG] [LOCAL ] AMCR: Primary data saved (40412 records). [2025-09-14T16:46:51.548101] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-14T16:46:51.548287] [INFO ] [MAIN ] Update Progress: 97/2370 symbols completed. AMCR took 24.0s. Estimated remaining: 3h 46m 28s. Rate: 10.0 symbols/min [2025-09-14T16:46:51.741501] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:51.759949] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-14T16:46:51.773093] [DEBUG] [LOCAL ] AMH: Loaded 23144 existing records from primary storage. [2025-09-14T16:46:51.773342] [INFO ] [MAIN ] AMH: Loaded 23144 existing records. [2025-09-14T16:46:52.026267] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:52.026701] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-14T16:46:52.026774] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-14T16:46:52.027548] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-14T16:46:52.027618] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-14T16:46:52.407305] [INFO ] [REMOTE ] AMH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:52.423219] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:46:52.431277] [INFO ] [REMOTE ] AME: Full fetch complete (52757 records). [2025-09-14T16:46:52.431530] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-14T16:46:52.571957] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-14T16:46:52.824017] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-14T16:46:52.824129] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-14T16:46:52.824764] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-14T16:46:52.824827] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-14T16:46:52.827084] [DEBUG] [LOCAL ] AME: Trimmed 52757 records to 36349 (keeping 150 days of data) [2025-09-14T16:46:52.977420] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-14T16:46:52.987228] [INFO ] [REMOTE ] AMC: Full fetch complete (58432 records). [2025-09-14T16:46:53.032638] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-14T16:46:53.359592] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-14T16:46:53.490565] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-14T16:46:53.492510] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-14T16:46:53.493735] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-14T16:46:53.495407] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-14T16:46:53.498345] [DEBUG] [LOCAL ] AME: Primary data saved (36349 records). [2025-09-14T16:46:53.499034] [INFO ] [MAIN ] AME: Full history saved. [2025-09-14T16:46:53.499838] [INFO ] [MAIN ] Update Progress: 98/2370 symbols completed. AME took 25.0s. Estimated remaining: 3h 44m 48s. Rate: 10.1 symbols/min [2025-09-14T16:46:53.564728] [DEBUG] [LOCAL ] AMC: Trimmed 58432 records to 40510 (keeping 150 days of data) [2025-09-14T16:46:53.673912] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T16:46:53.786032] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:53.813804] [DEBUG] [LOCAL ] AMN: Loaded 19177 existing records from primary storage. [2025-09-14T16:46:53.815059] [INFO ] [MAIN ] AMN: Loaded 19177 existing records. [2025-09-14T16:46:54.007585] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:54.009759] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-14T16:46:54.010151] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-14T16:46:54.011297] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-14T16:46:54.012206] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-14T16:46:54.163570] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-14T16:46:54.477419] [INFO ] [REMOTE ] AMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:54.506205] [DEBUG] [LOCAL ] AMC: Primary data saved (40510 records). [2025-09-14T16:46:54.506397] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-14T16:46:54.506550] [INFO ] [MAIN ] Update Progress: 99/2370 symbols completed. AMC took 30.8s. Estimated remaining: 3h 42m 49s. Rate: 10.2 symbols/min [2025-09-14T16:46:54.691115] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:54.707469] [DEBUG] [LOCAL ] AMP: Loaded 13860 existing records from primary storage. [2025-09-14T16:46:54.707657] [INFO ] [MAIN ] AMP: Loaded 13860 existing records. [2025-09-14T16:46:54.882382] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:54.882709] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-14T16:46:54.882862] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-14T16:46:54.883411] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-14T16:46:54.883570] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-14T16:46:54.966051] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-14T16:46:55.202184] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T16:46:55.285054] [INFO ] [REMOTE ] AMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:55.503961] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T16:46:55.758835] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-14T16:46:56.295749] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T16:46:56.558902] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-14T16:46:57.354042] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T16:46:57.364309] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-14T16:46:57.562282] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T16:46:58.092853] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T16:46:58.158854] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-14T16:46:58.958846] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-14T16:46:59.255422] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T16:46:59.258758] [INFO ] [REMOTE ] AMG: Full fetch complete (22461 records). [2025-09-14T16:46:59.258870] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-14T16:46:59.638293] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-14T16:46:59.638513] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-14T16:46:59.638987] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-14T16:46:59.639186] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-14T16:46:59.640254] [DEBUG] [LOCAL ] AMG: Trimmed 22461 records to 14731 (keeping 150 days of data) [2025-09-14T16:46:59.759345] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-14T16:46:59.768870] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T16:46:59.803659] [DEBUG] [LOCAL ] AMG: Primary data saved (14731 records). [2025-09-14T16:46:59.804063] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-14T16:46:59.804217] [INFO ] [MAIN ] Update Progress: 100/2370 symbols completed. AMG took 20.6s. Estimated remaining: 3h 42m 30s. Rate: 10.2 symbols/min [2025-09-14T16:47:00.004793] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:00.042201] [DEBUG] [LOCAL ] AMPX: Loaded 23933 existing records from primary storage. [2025-09-14T16:47:00.042476] [INFO ] [MAIN ] AMPX: Loaded 23933 existing records. [2025-09-14T16:47:00.322585] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:00.323079] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-14T16:47:00.323173] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-14T16:47:00.324155] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-14T16:47:00.324255] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-14T16:47:00.564238] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-14T16:47:00.853218] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:01.358865] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-14T16:47:01.472128] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T16:47:02.107027] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T16:47:02.158821] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-14T16:47:02.958843] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-14T16:47:03.055658] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T16:47:03.583452] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T16:47:03.758835] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-14T16:47:04.199164] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T16:47:04.558890] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-14T16:47:05.358848] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-14T16:47:05.407739] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T16:47:05.984312] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T16:47:06.158829] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-14T16:47:06.950458] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T16:47:06.959608] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-14T16:47:07.312415] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T16:47:07.758830] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-14T16:47:08.309712] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T16:47:08.558862] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-14T16:47:09.358864] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-14T16:47:09.507552] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T16:47:09.542936] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T16:47:10.158888] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-14T16:47:10.942550] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T16:47:10.958783] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-14T16:47:11.308016] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T16:47:11.578383] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:47:11.582873] [INFO ] [REMOTE ] AMN: Full fetch complete (46201 records). [2025-09-14T16:47:11.583016] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-14T16:47:11.758824] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-14T16:47:11.964719] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-14T16:47:11.964838] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-14T16:47:11.965416] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-14T16:47:11.965495] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-14T16:47:11.966598] [DEBUG] [LOCAL ] AMN: Trimmed 46201 records to 31538 (keeping 150 days of data) [2025-09-14T16:47:12.148996] [DEBUG] [LOCAL ] AMN: Primary data saved (31538 records). [2025-09-14T16:47:12.149180] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-14T16:47:12.149295] [INFO ] [MAIN ] Update Progress: 101/2370 symbols completed. AMN took 18.6s. Estimated remaining: 3h 44m 50s. Rate: 10.1 symbols/min [2025-09-14T16:47:12.321662] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:12.339374] [DEBUG] [LOCAL ] AMPY: Loaded 16195 existing records from primary storage. [2025-09-14T16:47:12.339543] [INFO ] [MAIN ] AMPY: Loaded 16195 existing records. [2025-09-14T16:47:12.519078] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:12.519412] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-14T16:47:12.519487] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-14T16:47:12.520027] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-14T16:47:12.520108] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-14T16:47:12.563949] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-14T16:47:12.883003] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:13.358808] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-14T16:47:13.729705] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T16:47:14.063736] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T16:47:14.158837] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-14T16:47:14.958877] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-14T16:47:15.208157] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T16:47:15.420582] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T16:47:15.424233] [INFO ] [REMOTE ] AMP: Full fetch complete (35689 records). [2025-09-14T16:47:15.424381] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-14T16:47:15.761248] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-14T16:47:15.800171] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-14T16:47:15.800337] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-14T16:47:15.800855] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-14T16:47:15.801007] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-14T16:47:15.802238] [DEBUG] [LOCAL ] AMP: Trimmed 35689 records to 23565 (keeping 150 days of data) [2025-09-14T16:47:15.926132] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T16:47:15.995711] [DEBUG] [LOCAL ] AMP: Primary data saved (23565 records). [2025-09-14T16:47:15.995904] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-14T16:47:15.996052] [INFO ] [MAIN ] Update Progress: 102/2370 symbols completed. AMP took 21.5s. Estimated remaining: 3h 43m 57s. Rate: 10.1 symbols/min [2025-09-14T16:47:16.168291] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:16.185168] [DEBUG] [LOCAL ] AMR: Loaded 13475 existing records from primary storage. [2025-09-14T16:47:16.185352] [INFO ] [MAIN ] AMR: Loaded 13475 existing records. [2025-09-14T16:47:16.363818] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:16.364085] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-14T16:47:16.364148] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-14T16:47:16.364671] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-14T16:47:16.364751] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-14T16:47:16.567861] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-14T16:47:16.731684] [INFO ] [REMOTE ] AMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:16.749114] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T16:47:17.358833] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-14T16:47:18.025336] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T16:47:18.031404] [INFO ] [REMOTE ] AMH: Full fetch complete (56136 records). [2025-09-14T16:47:18.031541] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-14T16:47:18.174793] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-14T16:47:18.416061] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-14T16:47:18.416171] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-14T16:47:18.416749] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-14T16:47:18.416812] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-14T16:47:18.418004] [DEBUG] [LOCAL ] AMH: Trimmed 56136 records to 38783 (keeping 150 days of data) [2025-09-14T16:47:18.663474] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T16:47:18.698320] [DEBUG] [LOCAL ] AMH: Primary data saved (38783 records). [2025-09-14T16:47:18.698545] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-14T16:47:18.698696] [INFO ] [MAIN ] Update Progress: 103/2370 symbols completed. AMH took 27.2s. Estimated remaining: 3h 42m 40s. Rate: 10.2 symbols/min [2025-09-14T16:47:18.884326] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:18.901275] [DEBUG] [LOCAL ] AMRC: Loaded 17065 existing records from primary storage. [2025-09-14T16:47:18.901442] [INFO ] [MAIN ] AMRC: Loaded 17065 existing records. [2025-09-14T16:47:18.963953] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-14T16:47:19.078553] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:19.078835] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-14T16:47:19.078898] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-14T16:47:19.079364] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-14T16:47:19.079423] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-14T16:47:19.443801] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:19.460020] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T16:47:19.758847] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-14T16:47:20.145759] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T16:47:20.558831] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-14T16:47:20.818491] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T16:47:21.358834] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-14T16:47:21.437633] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T16:47:22.158839] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-14T16:47:22.958882] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-14T16:47:23.142576] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T16:47:23.758870] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-14T16:47:23.840485] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T16:47:24.515573] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T16:47:24.558786] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-14T16:47:25.138218] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T16:47:25.358921] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-14T16:47:26.084016] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T16:47:26.158812] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-14T16:47:26.467403] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:47:26.958885] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-14T16:47:27.758837] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-14T16:47:28.131331] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T16:47:28.166589] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T16:47:28.558876] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-14T16:47:28.970759] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T16:47:29.358832] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-14T16:47:29.932164] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T16:47:30.158826] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-14T16:47:30.860594] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T16:47:30.958791] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-14T16:47:31.317484] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T16:47:31.758853] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-14T16:47:32.053708] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T16:47:32.558852] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-14T16:47:33.358896] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-14T16:47:33.674347] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T16:47:33.818134] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T16:47:34.158877] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-14T16:47:34.605144] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:47:34.958876] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-14T16:47:35.058942] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T16:47:35.062840] [INFO ] [REMOTE ] AMPY: Full fetch complete (39644 records). [2025-09-14T16:47:35.063031] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-14T16:47:35.520269] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-14T16:47:35.520391] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-14T16:47:35.520912] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-14T16:47:35.520974] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-14T16:47:35.522109] [DEBUG] [LOCAL ] AMPY: Trimmed 39644 records to 28357 (keeping 150 days of data) [2025-09-14T16:47:35.686012] [DEBUG] [LOCAL ] AMPY: Primary data saved (28357 records). [2025-09-14T16:47:35.686194] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-14T16:47:35.686302] [INFO ] [MAIN ] Update Progress: 104/2370 symbols completed. AMPY took 23.5s. Estimated remaining: 3h 46m 36s. Rate: 10.0 symbols/min [2025-09-14T16:47:35.763997] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-14T16:47:35.874525] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:35.899600] [DEBUG] [LOCAL ] AMRZ: Loaded 21868 existing records from primary storage. [2025-09-14T16:47:35.899833] [INFO ] [MAIN ] AMRZ: Loaded 21868 existing records. [2025-09-14T16:47:36.078408] [WARN ] [MAIN ] AMRZ: Insufficient historical data. Have data from 2025-06-23, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:36.078701] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-14T16:47:36.078767] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-14T16:47:36.079584] [DEBUG] [LOCAL ] AMRZ: Deleted primary data file. [2025-09-14T16:47:36.079682] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-14T16:47:36.437849] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:36.527471] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T16:47:36.534546] [INFO ] [REMOTE ] AMPX: Full fetch complete (56230 records). [2025-09-14T16:47:36.534857] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-14T16:47:36.564016] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-14T16:47:36.963827] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-14T16:47:36.963973] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-14T16:47:36.964826] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-14T16:47:36.964899] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-14T16:47:36.966592] [DEBUG] [LOCAL ] AMPX: Trimmed 56230 records to 39319 (keeping 150 days of data) [2025-09-14T16:47:37.232167] [DEBUG] [LOCAL ] AMPX: Primary data saved (39319 records). [2025-09-14T16:47:37.232377] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-14T16:47:37.232563] [INFO ] [MAIN ] Update Progress: 105/2370 symbols completed. AMPX took 37.4s. Estimated remaining: 3h 44m 54s. Rate: 10.1 symbols/min [2025-09-14T16:47:37.384948] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-14T16:47:37.411389] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:37.435561] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T16:47:37.460247] [DEBUG] [LOCAL ] AMT: Loaded 23349 existing records from primary storage. [2025-09-14T16:47:37.460415] [INFO ] [MAIN ] AMT: Loaded 23349 existing records. [2025-09-14T16:47:37.636030] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:37.636324] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-14T16:47:37.636386] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-14T16:47:37.637040] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-14T16:47:37.637103] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-14T16:47:37.691796] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:47:37.728431] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-14T16:47:37.996813] [INFO ] [REMOTE ] AMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:38.166370] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-14T16:47:38.169206] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T16:47:38.425678] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:47:38.426041] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-14T16:47:38.958842] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-14T16:47:39.758876] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-14T16:47:40.417890] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T16:47:40.558834] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-14T16:47:40.823371] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T16:47:41.358859] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-14T16:47:41.622685] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:47:41.623035] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-14T16:47:41.657541] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T16:47:41.661981] [INFO ] [REMOTE ] AMRC: Full fetch complete (41221 records). [2025-09-14T16:47:41.662129] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-14T16:47:42.050635] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-14T16:47:42.050804] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-14T16:47:42.051389] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-14T16:47:42.051472] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-14T16:47:42.053035] [DEBUG] [LOCAL ] AMRC: Trimmed 41221 records to 28206 (keeping 150 days of data) [2025-09-14T16:47:42.161011] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-14T16:47:42.228157] [DEBUG] [LOCAL ] AMRC: Primary data saved (28206 records). [2025-09-14T16:47:42.228330] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-14T16:47:42.228432] [INFO ] [MAIN ] Update Progress: 106/2370 symbols completed. AMRC took 23.5s. Estimated remaining: 3h 44m 27s. Rate: 10.1 symbols/min [2025-09-14T16:47:42.411054] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:42.422475] [DEBUG] [LOCAL ] AMTB: Loaded 9387 existing records from primary storage. [2025-09-14T16:47:42.422621] [INFO ] [MAIN ] AMTB: Loaded 9387 existing records. [2025-09-14T16:47:42.602695] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:42.603019] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-14T16:47:42.603081] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-14T16:47:42.603537] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-14T16:47:42.603598] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-14T16:47:42.767219] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:47:42.851550] [INFO ] [REMOTE ] AMR: Full fetch complete (31705 records). [2025-09-14T16:47:42.878416] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-14T16:47:42.964072] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-14T16:47:43.047393] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:43.342928] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-14T16:47:43.343043] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-14T16:47:43.343629] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-14T16:47:43.343704] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-14T16:47:43.344595] [DEBUG] [LOCAL ] AMR: Trimmed 31705 records to 21672 (keeping 150 days of data) [2025-09-14T16:47:43.398790] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:47:43.408245] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-14T16:47:43.480100] [DEBUG] [LOCAL ] AMR: Primary data saved (21672 records). [2025-09-14T16:47:43.480273] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-14T16:47:43.480382] [INFO ] [MAIN ] Update Progress: 107/2370 symbols completed. AMR took 27.5s. Estimated remaining: 3h 42m 42s. Rate: 10.2 symbols/min [2025-09-14T16:47:43.655672] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:43.659792] [DEBUG] [LOCAL ] AMTD: Loaded 1777 existing records from primary storage. [2025-09-14T16:47:43.659890] [INFO ] [MAIN ] AMTD: Loaded 1777 existing records. [2025-09-14T16:47:43.763172] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-14T16:47:43.846950] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:43.847324] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-14T16:47:43.847395] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-14T16:47:43.847734] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-14T16:47:43.847803] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-14T16:47:44.228662] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:44.558834] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-14T16:47:45.177605] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T16:47:45.358880] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-14T16:47:45.599802] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T16:47:46.158890] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-14T16:47:46.315476] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T16:47:46.958893] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-14T16:47:47.758876] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-14T16:47:47.814831] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T16:47:48.272542] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T16:47:48.558873] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-14T16:47:48.892460] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T16:47:49.248252] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-14T16:47:49.358847] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-14T16:47:50.158886] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-14T16:47:50.649738] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T16:47:50.932095] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T16:47:50.958842] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-14T16:47:51.758866] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-14T16:47:52.166672] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-14T16:47:52.558883] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-14T16:47:52.882199] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T16:47:53.265145] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T16:47:53.358913] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-14T16:47:54.158852] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-14T16:47:54.840470] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T16:47:54.958795] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-14T16:47:55.056795] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T16:47:55.758823] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-14T16:47:56.199967] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T16:47:56.367422] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T16:47:56.558829] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-14T16:47:57.206485] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T16:47:57.358827] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-14T16:47:57.958334] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T16:47:57.959551] [INFO ] [REMOTE ] AMTD: Full fetch complete (3708 records). [2025-09-14T16:47:57.959665] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-14T16:47:58.168061] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-14T16:47:58.327656] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-14T16:47:58.327768] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-14T16:47:58.327904] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-14T16:47:58.327956] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-14T16:47:58.328469] [DEBUG] [LOCAL ] AMTD: Trimmed 3708 records to 2827 (keeping 150 days of data) [2025-09-14T16:47:58.344921] [DEBUG] [LOCAL ] AMTD: Primary data saved (2827 records). [2025-09-14T16:47:58.344998] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-14T16:47:58.345086] [INFO ] [MAIN ] Update Progress: 108/2370 symbols completed. AMTD took 14.9s. Estimated remaining: 3h 45m 44s. Rate: 10.0 symbols/min [2025-09-14T16:47:58.512822] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:58.534703] [DEBUG] [LOCAL ] AMTM: Loaded 22243 existing records from primary storage. [2025-09-14T16:47:58.534858] [INFO ] [MAIN ] AMTM: Loaded 22243 existing records. [2025-09-14T16:47:58.718155] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:58.718421] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-14T16:47:58.718485] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-14T16:47:58.719247] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-14T16:47:58.719313] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-14T16:47:58.967901] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-14T16:47:59.083384] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:59.758887] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-14T16:47:59.795390] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T16:47:59.800830] [INFO ] [REMOTE ] AMRZ: Full fetch complete (21868 records). [2025-09-14T16:47:59.800998] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-14T16:47:59.985587] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 58 unique days, need 150 days [2025-09-14T16:47:59.986097] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:47:59.986209] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:47:59.986311] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-14T16:47:59.991606] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-14T16:47:59.998049] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-14T16:47:59.999178] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T16:47:59.999257] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-14T16:48:00.004616] [INFO ] [MAIN ] Update Progress: 109/2370 symbols completed. AMRZ took 24.3s. Estimated remaining: 3h 44m 8s. Rate: 10.1 symbols/min [2025-09-14T16:48:00.198254] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:00.203883] [DEBUG] [LOCAL ] AMWL: Loaded 4016 existing records from primary storage. [2025-09-14T16:48:00.204014] [INFO ] [MAIN ] AMWL: Loaded 4016 existing records. [2025-09-14T16:48:00.379279] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:00.379534] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-14T16:48:00.379595] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-14T16:48:00.379844] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-14T16:48:00.379902] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-14T16:48:00.563945] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-14T16:48:00.742807] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:01.358824] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-14T16:48:01.502524] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T16:48:01.590783] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T16:48:01.991809] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T16:48:02.158828] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-14T16:48:02.725825] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T16:48:02.958837] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-14T16:48:03.534595] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-14T16:48:03.758831] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-14T16:48:04.558842] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-14T16:48:05.358823] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-14T16:48:05.532336] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T16:48:05.773108] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T16:48:06.158823] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-14T16:48:06.201613] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T16:48:06.958838] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-14T16:48:07.508726] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-14T16:48:07.758886] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-14T16:48:08.039269] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T16:48:08.558880] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-14T16:48:08.861570] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T16:48:09.069468] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T16:48:09.358841] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-14T16:48:10.158847] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-14T16:48:10.693930] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T16:48:10.958869] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-14T16:48:11.010468] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T16:48:11.012612] [INFO ] [REMOTE ] AMTB: Full fetch complete (22497 records). [2025-09-14T16:48:11.012746] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-14T16:48:11.378852] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-14T16:48:11.378966] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-14T16:48:11.379339] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-14T16:48:11.379397] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-14T16:48:11.380093] [DEBUG] [LOCAL ] AMTB: Trimmed 22497 records to 15567 (keeping 150 days of data) [2025-09-14T16:48:11.476752] [DEBUG] [LOCAL ] AMTB: Primary data saved (15567 records). [2025-09-14T16:48:11.476937] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-14T16:48:11.477040] [INFO ] [MAIN ] Update Progress: 110/2370 symbols completed. AMTB took 29.2s. Estimated remaining: 3h 45m 56s. Rate: 10.0 symbols/min [2025-09-14T16:48:11.658300] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:11.659049] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T16:48:11.682538] [DEBUG] [LOCAL ] AMX: Loaded 21502 existing records from primary storage. [2025-09-14T16:48:11.682777] [INFO ] [MAIN ] AMX: Loaded 21502 existing records. [2025-09-14T16:48:11.763929] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-14T16:48:11.869215] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:11.869497] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-14T16:48:11.869603] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-14T16:48:11.870258] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-14T16:48:11.870323] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-14T16:48:12.225784] [INFO ] [REMOTE ] AMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:12.535038] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T16:48:12.537163] [INFO ] [REMOTE ] AMWL: Full fetch complete (10140 records). [2025-09-14T16:48:12.537357] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-14T16:48:12.569271] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-14T16:48:12.900960] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-14T16:48:12.901073] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-14T16:48:12.901307] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-14T16:48:12.901365] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-14T16:48:12.901966] [DEBUG] [LOCAL ] AMWL: Trimmed 10140 records to 6581 (keeping 150 days of data) [2025-09-14T16:48:12.938896] [DEBUG] [LOCAL ] AMWL: Primary data saved (6581 records). [2025-09-14T16:48:12.939017] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-14T16:48:12.939107] [INFO ] [MAIN ] Update Progress: 111/2370 symbols completed. AMWL took 12.9s. Estimated remaining: 3h 44m 17s. Rate: 10.1 symbols/min [2025-09-14T16:48:13.107167] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:13.122008] [DEBUG] [LOCAL ] AN: Loaded 13415 existing records from primary storage. [2025-09-14T16:48:13.122187] [INFO ] [MAIN ] AN: Loaded 13415 existing records. [2025-09-14T16:48:13.312210] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:13.312533] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-14T16:48:13.312600] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-14T16:48:13.313119] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-14T16:48:13.313187] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-14T16:48:13.371046] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-14T16:48:13.680636] [INFO ] [REMOTE ] AN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:14.158849] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-14T16:48:14.415749] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T16:48:14.920710] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T16:48:14.958776] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-14T16:48:15.758845] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-14T16:48:15.938498] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T16:48:16.177993] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T16:48:16.558853] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-14T16:48:17.180966] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T16:48:17.358829] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-14T16:48:17.646134] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T16:48:17.651852] [INFO ] [REMOTE ] AMT: Full fetch complete (57020 records). [2025-09-14T16:48:17.651990] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-14T16:48:18.039313] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-14T16:48:18.039447] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-14T16:48:18.040202] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-14T16:48:18.040282] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-14T16:48:18.041629] [DEBUG] [LOCAL ] AMT: Trimmed 57020 records to 39337 (keeping 150 days of data) [2025-09-14T16:48:18.159063] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-14T16:48:18.294840] [DEBUG] [LOCAL ] AMT: Primary data saved (39337 records). [2025-09-14T16:48:18.295122] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-14T16:48:18.295355] [INFO ] [MAIN ] Update Progress: 112/2370 symbols completed. AMT took 41.1s. Estimated remaining: 3h 43m 59s. Rate: 10.1 symbols/min [2025-09-14T16:48:18.428678] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:48:18.509763] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:18.533239] [DEBUG] [LOCAL ] ANET: Loaded 24126 existing records from primary storage. [2025-09-14T16:48:18.533413] [INFO ] [MAIN ] ANET: Loaded 24126 existing records. [2025-09-14T16:48:18.713974] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:18.714292] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-14T16:48:18.714369] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-14T16:48:18.714990] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-14T16:48:18.715056] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-14T16:48:18.964409] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-14T16:48:19.086706] [INFO ] [REMOTE ] ANET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:19.758839] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-14T16:48:19.867630] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T16:48:20.493669] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T16:48:20.558802] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-14T16:48:21.358884] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-14T16:48:21.826123] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T16:48:21.900233] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-14T16:48:22.158888] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-14T16:48:22.958932] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-14T16:48:23.093578] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T16:48:23.677076] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T16:48:23.758833] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-14T16:48:24.526134] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T16:48:24.558825] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-14T16:48:25.211620] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T16:48:25.358774] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-14T16:48:25.456902] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T16:48:25.659235] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T16:48:25.664318] [INFO ] [REMOTE ] AMTM: Full fetch complete (55183 records). [2025-09-14T16:48:25.664445] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-14T16:48:26.042199] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-14T16:48:26.042356] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-14T16:48:26.042993] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-14T16:48:26.043071] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-14T16:48:26.044260] [DEBUG] [LOCAL ] AMTM: Trimmed 55183 records to 37905 (keeping 150 days of data) [2025-09-14T16:48:26.158965] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-14T16:48:26.289192] [DEBUG] [LOCAL ] AMTM: Primary data saved (37905 records). [2025-09-14T16:48:26.289445] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-14T16:48:26.289570] [INFO ] [MAIN ] Update Progress: 113/2370 symbols completed. AMTM took 27.9s. Estimated remaining: 3h 44m 34s. Rate: 10.1 symbols/min [2025-09-14T16:48:26.473517] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:26.499624] [DEBUG] [LOCAL ] ANF: Loaded 23198 existing records from primary storage. [2025-09-14T16:48:26.499889] [INFO ] [MAIN ] ANF: Loaded 23198 existing records. [2025-09-14T16:48:26.694246] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:26.694620] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-14T16:48:26.694724] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-14T16:48:26.695459] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-14T16:48:26.695539] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-14T16:48:26.964054] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-14T16:48:27.084705] [INFO ] [REMOTE ] ANF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:27.758835] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-14T16:48:28.558859] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-14T16:48:28.592701] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T16:48:28.631667] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-14T16:48:29.358920] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-14T16:48:29.524722] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:48:29.552718] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T16:48:30.158903] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-14T16:48:30.958898] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-14T16:48:31.537684] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T16:48:31.606595] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-14T16:48:31.758846] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-14T16:48:32.429018] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T16:48:32.558814] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-14T16:48:32.688527] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T16:48:33.358845] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-14T16:48:34.158841] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-14T16:48:34.519014] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T16:48:34.958851] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-14T16:48:35.058847] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-14T16:48:35.574745] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:48:35.578667] [INFO ] [REMOTE ] AN: Full fetch complete (36061 records). [2025-09-14T16:48:35.578772] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-14T16:48:35.761768] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-14T16:48:35.984508] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-14T16:48:35.984922] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-14T16:48:35.985618] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-14T16:48:36.014028] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-14T16:48:36.017198] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T16:48:36.029873] [DEBUG] [LOCAL ] AN: Trimmed 36061 records to 23541 (keeping 150 days of data) [2025-09-14T16:48:36.205496] [DEBUG] [LOCAL ] AN: Primary data saved (23541 records). [2025-09-14T16:48:36.205764] [INFO ] [MAIN ] AN: Full history saved. [2025-09-14T16:48:36.205966] [INFO ] [MAIN ] Update Progress: 114/2370 symbols completed. AN took 23.3s. Estimated remaining: 3h 45m 46s. Rate: 10.0 symbols/min [2025-09-14T16:48:36.385870] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:36.389082] [DEBUG] [LOCAL ] ANGX: Loaded 636 existing records from primary storage. [2025-09-14T16:48:36.389184] [INFO ] [MAIN ] ANGX: Loaded 636 existing records. [2025-09-14T16:48:36.568537] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-14T16:48:36.576390] [WARN ] [MAIN ] ANGX: Insufficient historical data. Have data from 2025-09-11, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:36.577834] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-14T16:48:36.577961] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-14T16:48:36.578575] [DEBUG] [LOCAL ] ANGX: Deleted primary data file. [2025-09-14T16:48:36.578768] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-14T16:48:36.960381] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:37.358893] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-14T16:48:37.465978] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T16:48:37.615518] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:37.615856] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-14T16:48:38.158881] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-14T16:48:38.964322] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-14T16:48:38.968169] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-14T16:48:39.758889] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-14T16:48:39.787885] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T16:48:40.142439] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T16:48:40.147407] [INFO ] [REMOTE ] AMX: Full fetch complete (53261 records). [2025-09-14T16:48:40.147536] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-14T16:48:40.521804] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-14T16:48:40.521906] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-14T16:48:40.522490] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-14T16:48:40.522547] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-14T16:48:40.523729] [DEBUG] [LOCAL ] AMX: Trimmed 53261 records to 36855 (keeping 150 days of data) [2025-09-14T16:48:40.581548] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-14T16:48:40.771213] [DEBUG] [LOCAL ] AMX: Primary data saved (36855 records). [2025-09-14T16:48:40.771470] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-14T16:48:40.771745] [INFO ] [MAIN ] Update Progress: 115/2370 symbols completed. AMX took 29.3s. Estimated remaining: 3h 45m 12s. Rate: 10.0 symbols/min [2025-09-14T16:48:40.894945] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:40.927499] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-14T16:48:40.952363] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:40.963901] [DEBUG] [LOCAL ] ANRO: Loaded 7432 existing records from primary storage. [2025-09-14T16:48:40.964075] [INFO ] [MAIN ] ANRO: Loaded 7432 existing records. [2025-09-14T16:48:41.141200] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:41.141483] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-14T16:48:41.141573] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-14T16:48:41.141979] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-14T16:48:41.142065] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-14T16:48:41.364179] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-14T16:48:41.538171] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:41.644726] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T16:48:42.158823] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-14T16:48:42.958844] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-14T16:48:43.331071] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T16:48:43.758834] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-14T16:48:44.005409] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T16:48:44.261468] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T16:48:44.558841] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-14T16:48:44.809762] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:44.810101] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-14T16:48:45.229803] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T16:48:45.358886] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-14T16:48:46.158978] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-14T16:48:46.830371] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T16:48:46.836726] [INFO ] [REMOTE ] ANET: Full fetch complete (58446 records). [2025-09-14T16:48:46.837191] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-14T16:48:46.964007] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-14T16:48:47.232062] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-14T16:48:47.232298] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-14T16:48:47.233185] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-14T16:48:47.233407] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-14T16:48:47.235039] [DEBUG] [LOCAL ] ANET: Trimmed 58446 records to 40506 (keeping 150 days of data) [2025-09-14T16:48:47.376784] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T16:48:47.549186] [DEBUG] [LOCAL ] ANET: Primary data saved (40506 records). [2025-09-14T16:48:47.549355] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-14T16:48:47.549484] [INFO ] [MAIN ] Update Progress: 116/2370 symbols completed. ANET took 29.3s. Estimated remaining: 3h 45m 21s. Rate: 10.0 symbols/min [2025-09-14T16:48:47.725737] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:47.737539] [DEBUG] [LOCAL ] ANVS: Loaded 9915 existing records from primary storage. [2025-09-14T16:48:47.737726] [INFO ] [MAIN ] ANVS: Loaded 9915 existing records. [2025-09-14T16:48:47.767878] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-14T16:48:47.918305] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:47.918580] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-14T16:48:47.918658] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-14T16:48:47.919029] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-14T16:48:47.919088] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-14T16:48:48.161187] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:48.192487] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-14T16:48:48.268033] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:48.369618] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T16:48:48.558835] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-14T16:48:49.358888] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-14T16:48:50.087673] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T16:48:50.158802] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-14T16:48:50.573011] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T16:48:50.958793] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-14T16:48:51.315046] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T16:48:51.403746] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T16:48:51.409075] [INFO ] [REMOTE ] ANF: Full fetch complete (56855 records). [2025-09-14T16:48:51.409254] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-14T16:48:51.758930] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-14T16:48:51.792009] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-14T16:48:51.792150] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-14T16:48:51.792867] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-14T16:48:51.792949] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-14T16:48:51.794769] [DEBUG] [LOCAL ] ANF: Trimmed 56855 records to 39151 (keeping 150 days of data) [2025-09-14T16:48:52.038334] [DEBUG] [LOCAL ] ANF: Primary data saved (39151 records). [2025-09-14T16:48:52.038575] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-14T16:48:52.038787] [INFO ] [MAIN ] Update Progress: 117/2370 symbols completed. ANF took 25.7s. Estimated remaining: 3h 44m 46s. Rate: 10.0 symbols/min [2025-09-14T16:48:52.098685] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:52.098949] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-14T16:48:52.558829] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-14T16:48:53.358824] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-14T16:48:53.635514] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T16:48:53.660312] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:53.660723] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-14T16:48:54.158829] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-14T16:48:54.911776] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T16:48:54.958817] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-14T16:48:55.758911] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-14T16:48:56.227011] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T16:48:56.558842] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-14T16:48:56.953904] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T16:48:57.358834] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-14T16:48:57.853978] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T16:48:58.158900] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-14T16:48:58.386007] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T16:48:58.958835] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-14T16:48:59.326840] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:59.327415] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-14T16:48:59.343088] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T16:48:59.758837] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-14T16:49:00.558846] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-14T16:49:00.846610] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T16:49:01.328811] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T16:49:01.358811] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-14T16:49:02.158879] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-14T16:49:02.189623] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T16:49:02.191415] [INFO ] [REMOTE ] ANRO: Full fetch complete (22698 records). [2025-09-14T16:49:02.191505] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-14T16:49:02.579782] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-14T16:49:02.579886] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-14T16:49:02.580220] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-14T16:49:02.580272] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-14T16:49:02.580914] [DEBUG] [LOCAL ] ANRO: Trimmed 22698 records to 13852 (keeping 150 days of data) [2025-09-14T16:49:02.663930] [DEBUG] [LOCAL ] ANRO: Primary data saved (13852 records). [2025-09-14T16:49:02.664106] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-14T16:49:02.664238] [INFO ] [MAIN ] Update Progress: 118/2370 symbols completed. ANRO took 21.9s. Estimated remaining: 3h 46m 9s. Rate: 10.0 symbols/min [2025-09-14T16:49:02.926932] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T16:49:02.930553] [INFO ] [REMOTE ] ANVS: Full fetch complete (26834 records). [2025-09-14T16:49:02.930720] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-14T16:49:02.963886] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-14T16:49:03.298715] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-14T16:49:03.298823] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-14T16:49:03.299203] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-14T16:49:03.299274] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-14T16:49:03.299992] [DEBUG] [LOCAL ] ANVS: Trimmed 26834 records to 17780 (keeping 150 days of data) [2025-09-14T16:49:03.413071] [DEBUG] [LOCAL ] ANVS: Primary data saved (17780 records). [2025-09-14T16:49:03.413267] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-14T16:49:03.413388] [INFO ] [MAIN ] Update Progress: 119/2370 symbols completed. ANVS took 15.9s. Estimated remaining: 3h 44m 23s. Rate: 10.0 symbols/min [2025-09-14T16:49:03.511793] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T16:49:03.513295] [INFO ] [REMOTE ] ANGX: Full fetch complete (636 records). [2025-09-14T16:49:03.513380] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-14T16:49:03.692832] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 2 unique days, need 150 days [2025-09-14T16:49:03.693042] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:49:03.693096] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:49:03.693143] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-14T16:49:03.693223] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-14T16:49:03.693281] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-14T16:49:03.693345] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-14T16:49:03.693480] [INFO ] [MAIN ] Update Progress: 120/2370 symbols completed. ANGX took 27.5s. Estimated remaining: 3h 42m 30s. Rate: 10.1 symbols/min [2025-09-14T16:49:04.345144] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:04.367077] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:04.392859] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:04.429925] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:04.438918] [DEBUG] [LOCAL ] AOMD: Loaded 1124 existing records from primary storage. [2025-09-14T16:49:04.439861] [INFO ] [MAIN ] AOMD: Loaded 1124 existing records. [2025-09-14T16:49:04.494396] [DEBUG] [LOCAL ] AOMR: Loaded 7561 existing records from primary storage. [2025-09-14T16:49:04.523793] [INFO ] [MAIN ] AOMR: Loaded 7561 existing records. [2025-09-14T16:49:04.631692] [DEBUG] [LOCAL ] AOD: Loaded 13926 existing records from primary storage. [2025-09-14T16:49:04.710763] [INFO ] [MAIN ] AOD: Loaded 13926 existing records. [2025-09-14T16:49:04.754887] [WARN ] [MAIN ] AOMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:04.747555] [DEBUG] [LOCAL ] AON: Loaded 19818 existing records from primary storage. [2025-09-14T16:49:04.799527] [INFO ] [MAIN ] AON: Loaded 19818 existing records. [2025-09-14T16:49:04.799379] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-14T16:49:04.854814] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-14T16:49:04.941914] [DEBUG] [LOCAL ] AOMD: Deleted primary data file. [2025-09-14T16:49:05.018206] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-14T16:49:05.012722] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:05.061782] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-14T16:49:05.088315] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-14T16:49:05.228563] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:05.202198] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-14T16:49:05.296535] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-14T16:49:05.296468] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:05.312361] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-14T16:49:05.323142] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-14T16:49:05.354981] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-14T16:49:05.398155] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-14T16:49:05.408566] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-14T16:49:05.528502] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-14T16:49:05.564571] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-14T16:49:05.553969] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-14T16:49:06.134352] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:06.303730] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-14T16:49:06.386601] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:06.435417] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-14T16:49:06.683261] [INFO ] [REMOTE ] AOD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:06.702606] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:49:06.704393] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-14T16:49:06.725805] [INFO ] [REMOTE ] AON: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:06.727423] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-14T16:49:06.727576] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-14T16:49:06.958831] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-14T16:49:07.289039] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:49:07.289505] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-14T16:49:07.554679] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T16:49:07.644768] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T16:49:07.758805] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-14T16:49:08.443534] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T16:49:08.510025] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T16:49:08.558849] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-14T16:49:09.358846] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-14T16:49:09.631004] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:49:09.631460] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-14T16:49:09.694226] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T16:49:10.158862] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-14T16:49:10.958873] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-14T16:49:11.566308] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T16:49:11.758851] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-14T16:49:12.072894] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-14T16:49:12.425192] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T16:49:12.558876] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-14T16:49:13.161908] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-14T16:49:13.358834] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-14T16:49:14.158889] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-14T16:49:14.772103] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T16:49:14.958887] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-14T16:49:15.270788] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:49:15.758839] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-14T16:49:16.115251] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T16:49:16.345187] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T16:49:16.558880] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-14T16:49:17.358805] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-14T16:49:17.801040] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T16:49:18.158883] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-14T16:49:18.254398] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T16:49:18.958867] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-14T16:49:19.758859] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-14T16:49:19.872106] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-14T16:49:19.875611] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-07 [2025-09-14T16:49:19.877298] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T16:49:19.927223] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T16:49:20.558901] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-14T16:49:21.358868] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-14T16:49:21.582752] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T16:49:22.158795] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-14T16:49:22.611595] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T16:49:22.958848] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-14T16:49:23.271223] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T16:49:23.275047] [INFO ] [REMOTE ] AOD: Full fetch complete (32870 records). [2025-09-14T16:49:23.275163] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-14T16:49:23.670763] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-14T16:49:23.670910] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-14T16:49:23.671436] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-14T16:49:23.671513] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-14T16:49:23.672825] [DEBUG] [LOCAL ] AOD: Trimmed 32870 records to 22575 (keeping 150 days of data) [2025-09-14T16:49:23.763671] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-14T16:49:23.814719] [DEBUG] [LOCAL ] AOD: Primary data saved (22575 records). [2025-09-14T16:49:23.814881] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-14T16:49:23.814979] [INFO ] [MAIN ] Update Progress: 121/2370 symbols completed. AOD took 20.1s. Estimated remaining: 3h 46m 48s. Rate: 9.9 symbols/min [2025-09-14T16:49:23.960067] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T16:49:23.991991] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:23.992082] [INFO ] [REMOTE ] AOMR: Full fetch complete (19016 records). [2025-09-14T16:49:23.992310] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-14T16:49:24.155563] [DEBUG] [LOCAL ] AORT: Loaded 13183 existing records from primary storage. [2025-09-14T16:49:24.176242] [INFO ] [MAIN ] AORT: Loaded 13183 existing records. [2025-09-14T16:49:24.535201] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:24.566027] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-14T16:49:24.567331] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-14T16:49:24.594408] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-14T16:49:24.594266] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-14T16:49:24.594672] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-14T16:49:24.595072] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-14T16:49:24.595125] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-14T16:49:24.595312] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-14T16:49:24.595624] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-14T16:49:24.617374] [DEBUG] [LOCAL ] AOMR: Trimmed 19016 records to 12788 (keeping 150 days of data) [2025-09-14T16:49:25.027201] [INFO ] [REMOTE ] AORT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:25.041113] [DEBUG] [LOCAL ] AOMR: Primary data saved (12788 records). [2025-09-14T16:49:25.041306] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-14T16:49:25.041416] [INFO ] [MAIN ] Update Progress: 122/2370 symbols completed. AOMR took 21.3s. Estimated remaining: 3h 45m 13s. Rate: 10.0 symbols/min [2025-09-14T16:49:25.143806] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T16:49:25.214115] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:25.237719] [DEBUG] [LOCAL ] AOS: Loaded 21715 existing records from primary storage. [2025-09-14T16:49:25.237885] [INFO ] [MAIN ] AOS: Loaded 21715 existing records. [2025-09-14T16:49:25.363949] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-14T16:49:25.428036] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:25.428335] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-14T16:49:25.428451] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-14T16:49:25.429926] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-14T16:49:25.429996] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-14T16:49:25.793914] [INFO ] [REMOTE ] AOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:25.822619] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T16:49:25.860664] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T16:49:25.861588] [INFO ] [REMOTE ] AOMD: Full fetch complete (1347 records). [2025-09-14T16:49:25.861709] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-14T16:49:26.035860] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 54 unique days, need 150 days [2025-09-14T16:49:26.036101] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:49:26.036170] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:49:26.036242] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-14T16:49:26.036371] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-14T16:49:26.036437] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-14T16:49:26.036527] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-14T16:49:26.036636] [INFO ] [MAIN ] Update Progress: 123/2370 symbols completed. AOMD took 22.3s. Estimated remaining: 3h 43m 35s. Rate: 10.0 symbols/min [2025-09-14T16:49:26.163922] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-14T16:49:26.207118] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:26.212097] [DEBUG] [LOCAL ] AP: Loaded 3325 existing records from primary storage. [2025-09-14T16:49:26.212221] [INFO ] [MAIN ] AP: Loaded 3325 existing records. [2025-09-14T16:49:26.392755] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:26.393044] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-14T16:49:26.393107] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-14T16:49:26.393368] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-14T16:49:26.393447] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-14T16:49:26.749944] [INFO ] [REMOTE ] AP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:26.958889] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-14T16:49:27.490411] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T16:49:27.582786] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T16:49:27.758829] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-14T16:49:28.203145] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T16:49:28.558867] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-14T16:49:29.358887] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-14T16:49:29.598385] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:49:29.787536] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T16:49:30.158845] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-14T16:49:30.958898] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-14T16:49:31.029780] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T16:49:31.758853] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-14T16:49:32.483819] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T16:49:32.558868] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-14T16:49:32.567895] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T16:49:33.358875] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-14T16:49:34.158856] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-14T16:49:34.399580] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T16:49:34.958876] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-14T16:49:35.101942] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T16:49:35.142160] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T16:49:35.758832] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-14T16:49:36.538864] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T16:49:36.558806] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-14T16:49:36.655930] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T16:49:36.998295] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T16:49:36.999490] [INFO ] [REMOTE ] AP: Full fetch complete (6997 records). [2025-09-14T16:49:36.999583] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-14T16:49:37.363785] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-14T16:49:37.370415] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-14T16:49:37.371423] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-14T16:49:37.371727] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-14T16:49:37.371787] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-14T16:49:37.372318] [DEBUG] [LOCAL ] AP: Trimmed 6997 records to 5808 (keeping 150 days of data) [2025-09-14T16:49:37.406776] [DEBUG] [LOCAL ] AP: Primary data saved (5808 records). [2025-09-14T16:49:37.406941] [INFO ] [MAIN ] AP: Full history saved. [2025-09-14T16:49:37.407074] [INFO ] [MAIN ] Update Progress: 124/2370 symbols completed. AP took 11.4s. Estimated remaining: 3h 45m 7s. Rate: 10.0 symbols/min [2025-09-14T16:49:37.578475] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:37.594841] [DEBUG] [LOCAL ] APAM: Loaded 16068 existing records from primary storage. [2025-09-14T16:49:37.595030] [INFO ] [MAIN ] APAM: Loaded 16068 existing records. [2025-09-14T16:49:37.791777] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:37.792042] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-14T16:49:37.792101] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-14T16:49:37.792740] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-14T16:49:37.792807] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-14T16:49:38.146636] [INFO ] [REMOTE ] APAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:38.158781] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-14T16:49:38.958866] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-14T16:49:39.079631] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T16:49:39.579159] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T16:49:39.606339] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:49:39.611792] [INFO ] [REMOTE ] AON: Full fetch complete (49434 records). [2025-09-14T16:49:39.611963] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-14T16:49:39.765413] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-14T16:49:40.046873] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-14T16:49:40.046998] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-14T16:49:40.047578] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-14T16:49:40.047657] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-14T16:49:40.048931] [DEBUG] [LOCAL ] AON: Trimmed 49434 records to 34078 (keeping 150 days of data) [2025-09-14T16:49:40.274093] [DEBUG] [LOCAL ] AON: Primary data saved (34078 records). [2025-09-14T16:49:40.274294] [INFO ] [MAIN ] AON: Full history saved. [2025-09-14T16:49:40.274402] [INFO ] [MAIN ] Update Progress: 125/2370 symbols completed. AON took 36.6s. Estimated remaining: 3h 44m 5s. Rate: 10.0 symbols/min [2025-09-14T16:49:40.455697] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:40.475210] [DEBUG] [LOCAL ] APD: Loaded 19504 existing records from primary storage. [2025-09-14T16:49:40.475402] [INFO ] [MAIN ] APD: Loaded 19504 existing records. [2025-09-14T16:49:40.564612] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-14T16:49:40.654552] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:40.654842] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-14T16:49:40.654907] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-14T16:49:40.655493] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-14T16:49:40.655557] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-14T16:49:41.028866] [INFO ] [REMOTE ] APD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:41.085924] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T16:49:41.358858] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-14T16:49:41.835155] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T16:49:42.158858] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-14T16:49:42.568416] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T16:49:42.958807] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-14T16:49:43.407301] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T16:49:43.758830] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-14T16:49:44.258155] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T16:49:44.558864] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-14T16:49:45.199732] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T16:49:45.358832] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-14T16:49:46.114690] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T16:49:46.158844] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-14T16:49:46.684341] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T16:49:46.958816] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-14T16:49:47.267135] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T16:49:47.758886] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-14T16:49:48.487705] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T16:49:48.558840] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-14T16:49:49.100689] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T16:49:49.358836] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-14T16:49:49.684865] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T16:49:50.158850] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-14T16:49:50.958833] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-14T16:49:51.209447] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T16:49:51.326107] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T16:49:51.758835] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-14T16:49:52.371193] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T16:49:52.558835] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-14T16:49:53.358864] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-14T16:49:53.431100] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T16:49:53.908339] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T16:49:53.911927] [INFO ] [REMOTE ] AORT: Full fetch complete (32566 records). [2025-09-14T16:49:53.912043] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-14T16:49:54.163916] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-14T16:49:54.286149] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-14T16:49:54.286398] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-14T16:49:54.287057] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-14T16:49:54.287222] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-14T16:49:54.288444] [DEBUG] [LOCAL ] AORT: Trimmed 32566 records to 21896 (keeping 150 days of data) [2025-09-14T16:49:54.417589] [DEBUG] [LOCAL ] AORT: Primary data saved (21896 records). [2025-09-14T16:49:54.417938] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-14T16:49:54.418170] [INFO ] [MAIN ] Update Progress: 126/2370 symbols completed. AORT took 30.6s. Estimated remaining: 3h 46m 24s. Rate: 9.9 symbols/min [2025-09-14T16:49:54.567353] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T16:49:54.648447] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:54.672497] [DEBUG] [LOCAL ] APG: Loaded 22857 existing records from primary storage. [2025-09-14T16:49:54.672709] [INFO ] [MAIN ] APG: Loaded 22857 existing records. [2025-09-14T16:49:54.849205] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:54.849490] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-14T16:49:54.849562] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-14T16:49:54.850208] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-14T16:49:54.850277] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-14T16:49:54.963922] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-14T16:49:55.221206] [INFO ] [REMOTE ] APG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:55.690443] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T16:49:55.694297] [INFO ] [REMOTE ] APAM: Full fetch complete (39959 records). [2025-09-14T16:49:55.694477] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-14T16:49:55.764053] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-14T16:49:55.831130] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T16:49:56.123450] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-14T16:49:56.123563] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-14T16:49:56.124093] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-14T16:49:56.124154] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-14T16:49:56.125098] [DEBUG] [LOCAL ] APAM: Trimmed 39959 records to 27241 (keeping 150 days of data) [2025-09-14T16:49:56.299084] [DEBUG] [LOCAL ] APAM: Primary data saved (27241 records). [2025-09-14T16:49:56.299440] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-14T16:49:56.299723] [INFO ] [MAIN ] Update Progress: 127/2370 symbols completed. APAM took 18.9s. Estimated remaining: 3h 45m 4s. Rate: 10.0 symbols/min [2025-09-14T16:49:56.470726] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:56.495008] [DEBUG] [LOCAL ] APH: Loaded 24102 existing records from primary storage. [2025-09-14T16:49:56.495171] [INFO ] [MAIN ] APH: Loaded 24102 existing records. [2025-09-14T16:49:56.563973] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-14T16:49:56.678285] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:56.678541] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-14T16:49:56.678604] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-14T16:49:56.679351] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-14T16:49:56.679417] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-14T16:49:57.033911] [INFO ] [REMOTE ] APH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:57.185040] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T16:49:57.358825] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-14T16:49:58.158883] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-14T16:49:58.494942] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T16:49:58.699468] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T16:49:58.958835] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-14T16:49:59.550592] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T16:49:59.758839] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-14T16:50:00.558847] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-14T16:50:00.594244] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T16:50:01.358828] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-14T16:50:01.589377] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T16:50:02.158846] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-14T16:50:02.558207] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T16:50:02.958876] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-14T16:50:03.077134] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T16:50:03.508588] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T16:50:03.758846] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-14T16:50:04.418374] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:50:04.423107] [INFO ] [REMOTE ] APD: Full fetch complete (49795 records). [2025-09-14T16:50:04.423298] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-14T16:50:04.576061] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-14T16:50:04.834384] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-14T16:50:04.834628] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-14T16:50:04.835318] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-14T16:50:04.835506] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-14T16:50:04.837447] [DEBUG] [LOCAL ] APD: Trimmed 49795 records to 33825 (keeping 150 days of data) [2025-09-14T16:50:05.061416] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T16:50:05.097928] [DEBUG] [LOCAL ] APD: Primary data saved (33825 records). [2025-09-14T16:50:05.098118] [INFO ] [MAIN ] APD: Full history saved. [2025-09-14T16:50:05.098225] [INFO ] [MAIN ] Update Progress: 128/2370 symbols completed. APD took 24.8s. Estimated remaining: 3h 45m 47s. Rate: 9.9 symbols/min [2025-09-14T16:50:05.275868] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:05.300852] [DEBUG] [LOCAL ] APLE: Loaded 23196 existing records from primary storage. [2025-09-14T16:50:05.301021] [INFO ] [MAIN ] APLE: Loaded 23196 existing records. [2025-09-14T16:50:05.363987] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-14T16:50:05.506118] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:05.506456] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-14T16:50:05.506539] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-14T16:50:05.507541] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-14T16:50:05.507608] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-14T16:50:05.867566] [INFO ] [REMOTE ] APLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:05.970379] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:50:06.158905] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-14T16:50:06.743684] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T16:50:06.748990] [INFO ] [REMOTE ] AOS: Full fetch complete (53730 records). [2025-09-14T16:50:06.749160] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-14T16:50:06.964207] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-14T16:50:07.151711] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-14T16:50:07.151892] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-14T16:50:07.152683] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-14T16:50:07.152755] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-14T16:50:07.154187] [DEBUG] [LOCAL ] AOS: Trimmed 53730 records to 37044 (keeping 150 days of data) [2025-09-14T16:50:07.289206] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-14T16:50:07.437290] [DEBUG] [LOCAL ] AOS: Primary data saved (37044 records). [2025-09-14T16:50:07.437516] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-14T16:50:07.437629] [INFO ] [MAIN ] Update Progress: 129/2370 symbols completed. AOS took 42.4s. Estimated remaining: 3h 44m 36s. Rate: 10.0 symbols/min [2025-09-14T16:50:07.616387] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:07.641932] [DEBUG] [LOCAL ] APO: Loaded 23855 existing records from primary storage. [2025-09-14T16:50:07.642156] [INFO ] [MAIN ] APO: Loaded 23855 existing records. [2025-09-14T16:50:07.763990] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-14T16:50:07.833007] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:07.833392] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-14T16:50:07.833460] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-14T16:50:07.834221] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-14T16:50:07.834287] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-14T16:50:08.187988] [INFO ] [REMOTE ] APO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:08.558921] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-14T16:50:08.822540] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T16:50:09.066972] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T16:50:09.358886] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-14T16:50:10.158852] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-14T16:50:10.217103] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T16:50:10.752916] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:50:10.958854] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-14T16:50:11.652075] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T16:50:11.758905] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-14T16:50:12.002838] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T16:50:12.008063] [INFO ] [REMOTE ] APG: Full fetch complete (54393 records). [2025-09-14T16:50:12.008181] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-14T16:50:12.391194] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-14T16:50:12.391317] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-14T16:50:12.391977] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-14T16:50:12.392041] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-14T16:50:12.393314] [DEBUG] [LOCAL ] APG: Trimmed 54393 records to 38148 (keeping 150 days of data) [2025-09-14T16:50:12.565417] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-14T16:50:12.630339] [DEBUG] [LOCAL ] APG: Primary data saved (38148 records). [2025-09-14T16:50:12.630531] [INFO ] [MAIN ] APG: Full history saved. [2025-09-14T16:50:12.630663] [INFO ] [MAIN ] Update Progress: 130/2370 symbols completed. APG took 18.2s. Estimated remaining: 3h 44m 16s. Rate: 10.0 symbols/min [2025-09-14T16:50:12.799489] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:12.804721] [DEBUG] [LOCAL ] APOS: Loaded 2996 existing records from primary storage. [2025-09-14T16:50:12.804838] [INFO ] [MAIN ] APOS: Loaded 2996 existing records. [2025-09-14T16:50:12.987709] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:12.988019] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-14T16:50:12.988088] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-14T16:50:12.988399] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-14T16:50:12.988465] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-14T16:50:13.346417] [INFO ] [REMOTE ] APOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:13.358780] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-14T16:50:13.597542] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T16:50:13.987623] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T16:50:14.158871] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-14T16:50:14.582721] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T16:50:14.958836] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-14T16:50:15.758884] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-14T16:50:16.110755] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T16:50:16.286007] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T16:50:16.558846] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-14T16:50:16.935728] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T16:50:17.358841] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-14T16:50:18.158877] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-14T16:50:18.751522] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T16:50:18.771072] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T16:50:18.958849] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-14T16:50:19.128940] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T16:50:19.433862] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T16:50:19.758872] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-14T16:50:20.558907] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-14T16:50:21.256662] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T16:50:21.358788] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-14T16:50:21.503678] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T16:50:22.158842] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-14T16:50:22.958877] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-14T16:50:23.412904] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T16:50:23.520973] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T16:50:23.758843] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-14T16:50:23.931345] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T16:50:24.558857] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-14T16:50:25.358810] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-14T16:50:25.418803] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T16:50:25.849003] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T16:50:26.158839] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-14T16:50:26.618203] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T16:50:26.958837] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-14T16:50:27.758892] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-14T16:50:27.996490] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T16:50:28.558837] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-14T16:50:28.620175] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T16:50:29.208121] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:50:29.209689] [INFO ] [REMOTE ] APOS: Full fetch complete (8085 records). [2025-09-14T16:50:29.209798] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-14T16:50:29.362871] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-14T16:50:29.571817] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-14T16:50:29.572033] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-14T16:50:29.572387] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-14T16:50:29.572464] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-14T16:50:29.573086] [DEBUG] [LOCAL ] APOS: Trimmed 8085 records to 5346 (keeping 150 days of data) [2025-09-14T16:50:29.635683] [DEBUG] [LOCAL ] APOS: Primary data saved (5346 records). [2025-09-14T16:50:29.636856] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T16:50:29.637046] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-14T16:50:29.648201] [INFO ] [MAIN ] Update Progress: 131/2370 symbols completed. APOS took 17.0s. Estimated remaining: 3h 47m 18s. Rate: 9.9 symbols/min [2025-09-14T16:50:29.820012] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:29.844181] [DEBUG] [LOCAL ] APTV: Loaded 23229 existing records from primary storage. [2025-09-14T16:50:29.844387] [INFO ] [MAIN ] APTV: Loaded 23229 existing records. [2025-09-14T16:50:30.048521] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:30.048847] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-14T16:50:30.048921] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-14T16:50:30.049675] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-14T16:50:30.049742] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-14T16:50:30.159027] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-14T16:50:30.426295] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-14T16:50:30.453031] [INFO ] [REMOTE ] APTV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:30.454478] [INFO ] [REMOTE ] APH: Full fetch complete (58371 records). [2025-09-14T16:50:30.454632] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-14T16:50:30.831882] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-14T16:50:30.832013] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-14T16:50:30.832738] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-14T16:50:30.832863] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-14T16:50:30.834270] [DEBUG] [LOCAL ] APH: Trimmed 58371 records to 40431 (keeping 150 days of data) [2025-09-14T16:50:30.958890] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-14T16:50:31.098736] [DEBUG] [LOCAL ] APH: Primary data saved (40431 records). [2025-09-14T16:50:31.098906] [INFO ] [MAIN ] APH: Full history saved. [2025-09-14T16:50:31.099033] [INFO ] [MAIN ] Update Progress: 132/2370 symbols completed. APH took 34.8s. Estimated remaining: 3h 45m 54s. Rate: 9.9 symbols/min [2025-09-14T16:50:31.287996] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:31.309992] [DEBUG] [LOCAL ] AQN: Loaded 22979 existing records from primary storage. [2025-09-14T16:50:31.310183] [INFO ] [MAIN ] AQN: Loaded 22979 existing records. [2025-09-14T16:50:31.488634] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:31.488943] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-14T16:50:31.489030] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-14T16:50:31.489631] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-14T16:50:31.489726] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-14T16:50:31.759265] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-14T16:50:31.859458] [INFO ] [REMOTE ] AQN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:31.874951] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T16:50:31.880556] [INFO ] [REMOTE ] APO: Full fetch complete (58023 records). [2025-09-14T16:50:31.880720] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-14T16:50:32.208066] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T16:50:32.309969] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-14T16:50:32.310080] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-14T16:50:32.310756] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-14T16:50:32.310828] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-14T16:50:32.312154] [DEBUG] [LOCAL ] APO: Trimmed 58023 records to 40146 (keeping 150 days of data) [2025-09-14T16:50:32.558871] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-14T16:50:32.572039] [DEBUG] [LOCAL ] APO: Primary data saved (40146 records). [2025-09-14T16:50:32.572164] [INFO ] [MAIN ] APO: Full history saved. [2025-09-14T16:50:32.572266] [INFO ] [MAIN ] Update Progress: 133/2370 symbols completed. APO took 25.1s. Estimated remaining: 3h 44m 30s. Rate: 10.0 symbols/min [2025-09-14T16:50:32.749878] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:32.753438] [DEBUG] [LOCAL ] AQNB: Loaded 1849 existing records from primary storage. [2025-09-14T16:50:32.753538] [INFO ] [MAIN ] AQNB: Loaded 1849 existing records. [2025-09-14T16:50:32.929324] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:32.929669] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-14T16:50:32.929748] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-14T16:50:32.930073] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-14T16:50:32.930137] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-14T16:50:33.283280] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:33.358816] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-14T16:50:33.530089] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:50:33.683510] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-14T16:50:33.857662] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T16:50:34.158847] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-14T16:50:34.958890] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-14T16:50:35.509991] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T16:50:35.758866] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-14T16:50:35.941623] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T16:50:36.558849] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-14T16:50:37.011243] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T16:50:37.260341] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T16:50:37.358880] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-14T16:50:37.999734] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T16:50:38.158835] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-14T16:50:38.958840] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-14T16:50:39.600449] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:50:39.606338] [INFO ] [REMOTE ] APLE: Full fetch complete (56315 records). [2025-09-14T16:50:39.606483] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-14T16:50:39.781286] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-14T16:50:39.994365] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-14T16:50:39.994503] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-14T16:50:39.995354] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-14T16:50:39.995442] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-14T16:50:39.997011] [DEBUG] [LOCAL ] APLE: Trimmed 56315 records to 39120 (keeping 150 days of data) [2025-09-14T16:50:40.123594] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T16:50:40.292553] [DEBUG] [LOCAL ] APLE: Primary data saved (39120 records). [2025-09-14T16:50:40.292751] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-14T16:50:40.292857] [INFO ] [MAIN ] Update Progress: 134/2370 symbols completed. APLE took 35.2s. Estimated remaining: 3h 44m 53s. Rate: 9.9 symbols/min [2025-09-14T16:50:40.404548] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T16:50:40.471554] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:40.494446] [DEBUG] [LOCAL ] AR: Loaded 24041 existing records from primary storage. [2025-09-14T16:50:40.494604] [INFO ] [MAIN ] AR: Loaded 24041 existing records. [2025-09-14T16:50:40.564025] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-14T16:50:40.673555] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:40.673816] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-14T16:50:40.673876] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-14T16:50:40.674504] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-14T16:50:40.674571] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-14T16:50:41.026442] [INFO ] [REMOTE ] AR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:41.358883] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-14T16:50:42.158842] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-14T16:50:42.457619] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T16:50:42.720574] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T16:50:42.764072] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T16:50:42.958838] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-14T16:50:43.530493] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T16:50:43.758876] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-14T16:50:44.558847] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-14T16:50:45.358875] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-14T16:50:45.610999] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T16:50:45.925857] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T16:50:46.158861] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-14T16:50:46.823103] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T16:50:46.958840] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-14T16:50:47.758851] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-14T16:50:48.014056] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T16:50:48.280107] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T16:50:48.558874] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-14T16:50:49.077171] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:50:49.078151] [INFO ] [REMOTE ] AQNB: Full fetch complete (4382 records). [2025-09-14T16:50:49.078237] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-14T16:50:49.361592] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-14T16:50:49.484311] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-14T16:50:49.487675] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:50:49.487951] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-14T16:50:49.498775] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-14T16:50:49.499197] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-14T16:50:49.499827] [DEBUG] [LOCAL ] AQNB: Trimmed 4382 records to 2963 (keeping 150 days of data) [2025-09-14T16:50:49.519177] [DEBUG] [LOCAL ] AQNB: Primary data saved (2963 records). [2025-09-14T16:50:49.519320] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-14T16:50:49.519429] [INFO ] [MAIN ] Update Progress: 135/2370 symbols completed. AQNB took 16.9s. Estimated remaining: 3h 45m 40s. Rate: 9.9 symbols/min [2025-09-14T16:50:49.701531] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:49.723660] [DEBUG] [LOCAL ] ARCO: Loaded 19776 existing records from primary storage. [2025-09-14T16:50:49.723831] [INFO ] [MAIN ] ARCO: Loaded 19776 existing records. [2025-09-14T16:50:49.907389] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:49.907709] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-14T16:50:49.907777] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-14T16:50:49.908411] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-14T16:50:49.908486] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-14T16:50:50.165828] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-14T16:50:50.430670] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:50.958956] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-14T16:50:51.176694] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T16:50:51.758878] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-14T16:50:52.006667] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T16:50:52.268632] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T16:50:52.558847] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-14T16:50:53.309426] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T16:50:53.358786] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-14T16:50:54.166217] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-14T16:50:54.195131] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T16:50:54.733431] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T16:50:54.958842] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-14T16:50:55.758847] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-14T16:50:55.831360] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T16:50:56.558829] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-14T16:50:56.832845] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T16:50:57.358821] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-14T16:50:57.411519] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:50:58.071485] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T16:50:58.077699] [INFO ] [REMOTE ] AQN: Full fetch complete (56594 records). [2025-09-14T16:50:58.077830] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-14T16:50:58.166719] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-14T16:50:58.456583] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-14T16:50:58.456763] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-14T16:50:58.457591] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-14T16:50:58.457726] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-14T16:50:58.459551] [DEBUG] [LOCAL ] AQN: Trimmed 56594 records to 38906 (keeping 150 days of data) [2025-09-14T16:50:58.719380] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T16:50:58.755538] [DEBUG] [LOCAL ] AQN: Primary data saved (38906 records). [2025-09-14T16:50:58.755736] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-14T16:50:58.755886] [INFO ] [MAIN ] Update Progress: 136/2370 symbols completed. AQN took 27.7s. Estimated remaining: 3h 46m 26s. Rate: 9.9 symbols/min [2025-09-14T16:50:58.927699] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:58.937250] [DEBUG] [LOCAL ] ARDC: Loaded 6834 existing records from primary storage. [2025-09-14T16:50:58.937399] [INFO ] [MAIN ] ARDC: Loaded 6834 existing records. [2025-09-14T16:50:58.967625] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-14T16:50:59.119090] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:59.119334] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-14T16:50:59.119414] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-14T16:50:59.119780] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-14T16:50:59.119845] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-14T16:50:59.481174] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:59.758785] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-14T16:50:59.811163] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T16:51:00.117607] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T16:51:00.123278] [INFO ] [REMOTE ] APTV: Full fetch complete (56907 records). [2025-09-14T16:51:00.123502] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-14T16:51:00.528174] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-14T16:51:00.528386] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-14T16:51:00.529143] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-14T16:51:00.537791] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-14T16:51:00.554677] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T16:51:00.564860] [DEBUG] [LOCAL ] APTV: Trimmed 56907 records to 39109 (keeping 150 days of data) [2025-09-14T16:51:00.564055] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-14T16:51:00.804071] [DEBUG] [LOCAL ] APTV: Primary data saved (39109 records). [2025-09-14T16:51:00.804257] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-14T16:51:00.804367] [INFO ] [MAIN ] Update Progress: 137/2370 symbols completed. APTV took 31.2s. Estimated remaining: 3h 45m 14s. Rate: 9.9 symbols/min [2025-09-14T16:51:00.975778] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:00.990243] [DEBUG] [LOCAL ] ARDT: Loaded 12876 existing records from primary storage. [2025-09-14T16:51:00.990391] [INFO ] [MAIN ] ARDT: Loaded 12876 existing records. [2025-09-14T16:51:01.176272] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:01.176532] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-14T16:51:01.176592] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-14T16:51:01.177092] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-14T16:51:01.177169] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-14T16:51:01.359980] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-14T16:51:01.562018] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:01.570551] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T16:51:02.158837] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-14T16:51:02.850973] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T16:51:02.958823] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-14T16:51:03.213378] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T16:51:03.759056] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-14T16:51:03.758972] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T16:51:04.413935] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:51:04.419679] [INFO ] [REMOTE ] AR: Full fetch complete (58261 records). [2025-09-14T16:51:04.419896] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-14T16:51:04.568142] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-14T16:51:04.820065] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-14T16:51:04.820200] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-14T16:51:04.820897] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-14T16:51:04.820971] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-14T16:51:04.822458] [DEBUG] [LOCAL ] AR: Trimmed 58261 records to 40342 (keeping 150 days of data) [2025-09-14T16:51:05.071148] [DEBUG] [LOCAL ] AR: Primary data saved (40342 records). [2025-09-14T16:51:05.071326] [INFO ] [MAIN ] AR: Full history saved. [2025-09-14T16:51:05.071451] [INFO ] [MAIN ] Update Progress: 138/2370 symbols completed. AR took 24.8s. Estimated remaining: 3h 44m 39s. Rate: 9.9 symbols/min [2025-09-14T16:51:05.248416] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:05.275998] [DEBUG] [LOCAL ] ARE: Loaded 22587 existing records from primary storage. [2025-09-14T16:51:05.276325] [INFO ] [MAIN ] ARE: Loaded 22587 existing records. [2025-09-14T16:51:05.363971] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-14T16:51:05.467589] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:05.467919] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-14T16:51:05.467983] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-14T16:51:05.468599] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-14T16:51:05.468710] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-14T16:51:05.841161] [INFO ] [REMOTE ] ARE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:06.158824] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-14T16:51:06.184449] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T16:51:06.230562] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T16:51:06.958887] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-14T16:51:07.352400] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T16:51:07.758841] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-14T16:51:08.145906] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T16:51:08.558882] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-14T16:51:08.653303] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T16:51:09.358843] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-14T16:51:09.944553] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T16:51:10.158843] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-14T16:51:10.958859] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-14T16:51:11.036336] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T16:51:11.127753] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T16:51:11.758892] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-14T16:51:11.940794] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T16:51:12.558821] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-14T16:51:12.870886] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:51:13.358923] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-14T16:51:13.771568] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T16:51:14.158874] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-14T16:51:14.966689] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-14T16:51:14.969683] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T16:51:15.061486] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T16:51:15.758850] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-14T16:51:16.558824] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-14T16:51:16.905401] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T16:51:16.958355] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T16:51:17.183781] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:51:17.185818] [INFO ] [REMOTE ] ARDC: Full fetch complete (15956 records). [2025-09-14T16:51:17.185908] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-14T16:51:17.363951] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-14T16:51:17.567994] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-14T16:51:17.568118] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-14T16:51:17.568480] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-14T16:51:17.568537] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-14T16:51:17.569251] [DEBUG] [LOCAL ] ARDC: Trimmed 15956 records to 10479 (keeping 150 days of data) [2025-09-14T16:51:17.642618] [DEBUG] [LOCAL ] ARDC: Primary data saved (10479 records). [2025-09-14T16:51:17.642842] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-14T16:51:17.642950] [INFO ] [MAIN ] Update Progress: 139/2370 symbols completed. ARDC took 18.9s. Estimated remaining: 3h 46m 18s. Rate: 9.9 symbols/min [2025-09-14T16:51:17.812443] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:17.834356] [DEBUG] [LOCAL ] ARES: Loaded 21664 existing records from primary storage. [2025-09-14T16:51:17.834540] [INFO ] [MAIN ] ARES: Loaded 21664 existing records. [2025-09-14T16:51:18.009571] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:18.009849] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-14T16:51:18.009912] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-14T16:51:18.010512] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-14T16:51:18.010577] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-14T16:51:18.165974] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-14T16:51:18.376138] [INFO ] [REMOTE ] ARES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:18.958817] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-14T16:51:19.277005] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T16:51:19.494846] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T16:51:19.499520] [INFO ] [REMOTE ] ARCO: Full fetch complete (48596 records). [2025-09-14T16:51:19.499680] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-14T16:51:19.763905] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-14T16:51:19.876549] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-14T16:51:19.876695] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-14T16:51:19.877304] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-14T16:51:19.877401] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-14T16:51:19.878954] [DEBUG] [LOCAL ] ARCO: Trimmed 48596 records to 33598 (keeping 150 days of data) [2025-09-14T16:51:20.082886] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T16:51:20.112591] [DEBUG] [LOCAL ] ARCO: Primary data saved (33598 records). [2025-09-14T16:51:20.112805] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-14T16:51:20.112926] [INFO ] [MAIN ] Update Progress: 140/2370 symbols completed. ARCO took 30.6s. Estimated remaining: 3h 45m 14s. Rate: 9.9 symbols/min [2025-09-14T16:51:20.283584] [INFO ] [MAIN ] ARGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:20.286853] [DEBUG] [LOCAL ] ARGD: Loaded 1416 existing records from primary storage. [2025-09-14T16:51:20.286945] [INFO ] [MAIN ] ARGD: Loaded 1416 existing records. [2025-09-14T16:51:20.463213] [WARN ] [MAIN ] ARGD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:20.463506] [INFO ] [MAIN ] ARGD: Wiping existing primary data before full refresh. [2025-09-14T16:51:20.463571] [INFO ] [LOCAL ] ARGD: Starting deletion of primary data. [2025-09-14T16:51:20.463816] [DEBUG] [LOCAL ] ARGD: Deleted primary data file. [2025-09-14T16:51:20.463904] [INFO ] [MAIN ] ARGD: Starting full primary refresh. [2025-09-14T16:51:20.567803] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-14T16:51:20.869100] [INFO ] [REMOTE ] ARGD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:21.358887] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-02. [2025-09-14T16:51:21.699685] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T16:51:21.841692] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T16:51:22.158933] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-14T16:51:22.298296] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T16:51:22.958837] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-14T16:51:23.720212] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T16:51:23.758809] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-14T16:51:24.558865] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-14T16:51:24.780525] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T16:51:25.358861] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-14T16:51:25.526708] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T16:51:25.574022] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T16:51:26.158828] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-03. [2025-09-14T16:51:26.600062] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T16:51:26.814457] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T16:51:26.958875] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-14T16:51:27.758880] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-14T16:51:27.900318] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T16:51:27.904662] [INFO ] [REMOTE ] ARDT: Full fetch complete (31342 records). [2025-09-14T16:51:27.904935] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-14T16:51:28.287137] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-14T16:51:28.287277] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-14T16:51:28.287895] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-14T16:51:28.287967] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-14T16:51:28.289108] [DEBUG] [LOCAL ] ARDT: Trimmed 31342 records to 20242 (keeping 150 days of data) [2025-09-14T16:51:28.422788] [DEBUG] [LOCAL ] ARDT: Primary data saved (20242 records). [2025-09-14T16:51:28.439012] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-14T16:51:28.439974] [INFO ] [MAIN ] Update Progress: 141/2370 symbols completed. ARDT took 27.6s. Estimated remaining: 3h 45m 44s. Rate: 9.9 symbols/min [2025-09-14T16:51:28.441035] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T16:51:28.531125] [INFO ] [REMOTE ] ARE: Full fetch complete (54822 records). [2025-09-14T16:51:28.556931] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-14T16:51:28.563588] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-14T16:51:28.759513] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:29.003817] [DEBUG] [LOCAL ] ARI: Loaded 18692 existing records from primary storage. [2025-09-14T16:51:29.030183] [INFO ] [MAIN ] ARI: Loaded 18692 existing records. [2025-09-14T16:51:29.168563] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-14T16:51:29.194871] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-14T16:51:29.215521] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-14T16:51:29.222414] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-14T16:51:29.313686] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:29.313947] [DEBUG] [LOCAL ] ARE: Trimmed 54822 records to 38314 (keeping 150 days of data) [2025-09-14T16:51:29.314406] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-14T16:51:29.315009] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-14T16:51:29.315713] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-14T16:51:29.315796] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-14T16:51:29.410188] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-04. [2025-09-14T16:51:29.799603] [INFO ] [REMOTE ] ARI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:29.921781] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T16:51:29.959378] [DEBUG] [LOCAL ] ARE: Primary data saved (38314 records). [2025-09-14T16:51:29.959662] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-14T16:51:29.959802] [INFO ] [MAIN ] Update Progress: 142/2370 symbols completed. ARE took 24.9s. Estimated remaining: 3h 44m 26s. Rate: 9.9 symbols/min [2025-09-14T16:51:30.142713] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:30.163873] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-05. [2025-09-14T16:51:30.165850] [DEBUG] [LOCAL ] ARIS: Loaded 18640 existing records from primary storage. [2025-09-14T16:51:30.166055] [INFO ] [MAIN ] ARIS: Loaded 18640 existing records. [2025-09-14T16:51:30.362070] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:30.362468] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-14T16:51:30.362630] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-14T16:51:30.363482] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-14T16:51:30.363558] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-14T16:51:30.764723] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:30.764950] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T16:51:30.769539] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-14T16:51:30.958872] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-14T16:51:31.758927] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-06. [2025-09-14T16:51:32.117899] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-14T16:51:32.370229] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:51:32.558894] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-07. [2025-09-14T16:51:32.976071] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-14T16:51:33.358877] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-14T16:51:34.158850] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-08. [2025-09-14T16:51:34.766832] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T16:51:34.847010] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T16:51:34.958809] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-14T16:51:35.758849] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-14T16:51:36.518181] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T16:51:36.558888] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-14T16:51:37.281312] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T16:51:37.358834] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-14T16:51:38.158843] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-14T16:51:38.194958] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T16:51:38.906053] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T16:51:38.958838] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-14T16:51:39.560751] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T16:51:39.758822] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-14T16:51:40.558824] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-09. [2025-09-14T16:51:40.691301] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T16:51:41.087060] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T16:51:41.088069] [INFO ] [REMOTE ] ARGD: Full fetch complete (2549 records). [2025-09-14T16:51:41.088153] [DEBUG] [VALIDATOR ] ARGD: Validating primary data. [2025-09-14T16:51:41.363951] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-14T16:51:41.448487] [DEBUG] [VALIDATOR ] ARGD: All expected trading days are present. [2025-09-14T16:51:41.448790] [DEBUG] [VALIDATOR ] ARGD: Primary data validation passed. [2025-09-14T16:51:41.448929] [INFO ] [MAIN ] ARGD: Fetched primary data is valid. [2025-09-14T16:51:41.449028] [DEBUG] [LOCAL ] ARGD: Saving primary data. [2025-09-14T16:51:41.449687] [DEBUG] [LOCAL ] ARGD: Trimmed 2549 records to 1963 (keeping 150 days of data) [2025-09-14T16:51:41.462509] [DEBUG] [LOCAL ] ARGD: Primary data saved (1963 records). [2025-09-14T16:51:41.462625] [INFO ] [MAIN ] ARGD: Full history saved. [2025-09-14T16:51:41.462793] [INFO ] [MAIN ] Update Progress: 143/2370 symbols completed. ARGD took 21.3s. Estimated remaining: 3h 45m 45s. Rate: 9.9 symbols/min [2025-09-14T16:51:41.584541] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T16:51:41.672581] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:41.694359] [DEBUG] [LOCAL ] ARLO: Loaded 20471 existing records from primary storage. [2025-09-14T16:51:41.694521] [INFO ] [MAIN ] ARLO: Loaded 20471 existing records. [2025-09-14T16:51:41.896515] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:41.896943] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-14T16:51:41.897017] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-14T16:51:41.897777] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-14T16:51:41.897846] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-14T16:51:42.166559] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-14T16:51:42.249976] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:42.959037] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-14T16:51:43.018754] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:51:43.758828] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-14T16:51:43.829686] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T16:51:44.234557] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T16:51:44.558874] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-14T16:51:45.258266] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T16:51:45.358833] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-14T16:51:45.813099] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:51:46.158834] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-14T16:51:46.738703] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T16:51:46.958841] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-14T16:51:47.440529] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T16:51:47.758835] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-14T16:51:48.558843] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-14T16:51:48.810770] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T16:51:49.358832] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-14T16:51:49.451553] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T16:51:50.168955] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-14T16:51:50.172251] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T16:51:50.423242] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T16:51:50.427753] [INFO ] [REMOTE ] ARI: Full fetch complete (46885 records). [2025-09-14T16:51:50.427924] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-14T16:51:50.804155] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-14T16:51:50.804265] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-14T16:51:50.804811] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-14T16:51:50.804871] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-14T16:51:50.805987] [DEBUG] [LOCAL ] ARI: Trimmed 46885 records to 32487 (keeping 150 days of data) [2025-09-14T16:51:50.966371] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-14T16:51:50.997590] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T16:51:51.010781] [INFO ] [REMOTE ] ARES: Full fetch complete (53933 records). [2025-09-14T16:51:51.012177] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-14T16:51:51.292352] [DEBUG] [LOCAL ] ARI: Primary data saved (32487 records). [2025-09-14T16:51:51.318768] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-14T16:51:51.318932] [INFO ] [MAIN ] Update Progress: 144/2370 symbols completed. ARI took 22.9s. Estimated remaining: 3h 46m 38s. Rate: 9.8 symbols/min [2025-09-14T16:51:51.515183] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-14T16:51:51.518498] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-14T16:51:51.519388] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-14T16:51:51.529963] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-14T16:51:51.596064] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:51.596456] [DEBUG] [LOCAL ] ARES: Trimmed 53933 records to 36960 (keeping 150 days of data) [2025-09-14T16:51:51.718491] [DEBUG] [LOCAL ] ARMK: Loaded 22387 existing records from primary storage. [2025-09-14T16:51:51.720543] [INFO ] [MAIN ] ARMK: Loaded 22387 existing records. [2025-09-14T16:51:51.767727] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-14T16:51:51.922829] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:51.925631] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-14T16:51:51.927858] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-14T16:51:51.929860] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-14T16:51:51.930201] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-14T16:51:52.381296] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:52.406001] [DEBUG] [LOCAL ] ARES: Primary data saved (36960 records). [2025-09-14T16:51:52.406181] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-14T16:51:52.406322] [INFO ] [MAIN ] Update Progress: 145/2370 symbols completed. ARES took 34.8s. Estimated remaining: 3h 45m 14s. Rate: 9.9 symbols/min [2025-09-14T16:51:52.578176] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:52.575713] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-14T16:51:52.604885] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T16:51:52.627925] [DEBUG] [LOCAL ] AROC: Loaded 21959 existing records from primary storage. [2025-09-14T16:51:52.628072] [INFO ] [MAIN ] AROC: Loaded 21959 existing records. [2025-09-14T16:51:52.817569] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:52.817910] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-14T16:51:52.817987] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-14T16:51:52.824559] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-14T16:51:52.834825] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-14T16:51:52.867010] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T16:51:52.941071] [INFO ] [REMOTE ] ARIS: Full fetch complete (45552 records). [2025-09-14T16:51:52.943460] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-14T16:51:53.367753] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-14T16:51:53.442243] [INFO ] [REMOTE ] AROC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:53.577021] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-14T16:51:53.577123] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-14T16:51:53.577629] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-14T16:51:53.577702] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-14T16:51:53.578821] [DEBUG] [LOCAL ] ARIS: Trimmed 45552 records to 31143 (keeping 150 days of data) [2025-09-14T16:51:53.777832] [DEBUG] [LOCAL ] ARIS: Primary data saved (31143 records). [2025-09-14T16:51:53.778026] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-14T16:51:53.778156] [INFO ] [MAIN ] Update Progress: 146/2370 symbols completed. ARIS took 23.8s. Estimated remaining: 3h 43m 57s. Rate: 9.9 symbols/min [2025-09-14T16:51:53.953831] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:53.994864] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T16:51:54.026120] [DEBUG] [LOCAL ] ARR: Loaded 23340 existing records from primary storage. [2025-09-14T16:51:54.026331] [INFO ] [MAIN ] ARR: Loaded 23340 existing records. [2025-09-14T16:51:54.164018] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-14T16:51:54.202269] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:54.202554] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-14T16:51:54.202639] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-14T16:51:54.203271] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-14T16:51:54.203339] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-14T16:51:54.558119] [INFO ] [REMOTE ] ARR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:54.619486] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T16:51:54.958825] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-14T16:51:55.758810] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-14T16:51:55.918234] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T16:51:56.558810] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-14T16:51:56.641577] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T16:51:57.346997] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T16:51:57.358776] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-14T16:51:58.158825] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-14T16:51:58.424596] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:51:58.958845] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-14T16:51:59.073169] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T16:51:59.767943] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-14T16:51:59.786145] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T16:52:00.558839] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-14T16:52:00.857432] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T16:52:01.358847] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-14T16:52:01.638901] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:52:02.158846] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-14T16:52:02.662952] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T16:52:02.958834] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-14T16:52:03.098471] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T16:52:03.526124] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T16:52:03.758843] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-14T16:52:04.558809] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-14T16:52:04.892044] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T16:52:05.364013] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-14T16:52:05.369306] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T16:52:06.158835] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-14T16:52:06.273449] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T16:52:06.790840] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T16:52:06.958869] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-14T16:52:07.758907] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-14T16:52:07.940818] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T16:52:08.550947] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T16:52:08.561613] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-14T16:52:08.926498] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T16:52:09.358849] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-14T16:52:09.686727] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T16:52:09.691896] [INFO ] [REMOTE ] ARLO: Full fetch complete (47521 records). [2025-09-14T16:52:09.692066] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-14T16:52:10.098943] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-14T16:52:10.099094] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-14T16:52:10.099684] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-14T16:52:10.099771] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-14T16:52:10.100951] [DEBUG] [LOCAL ] ARLO: Trimmed 47521 records to 32823 (keeping 150 days of data) [2025-09-14T16:52:10.161094] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-14T16:52:10.311800] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T16:52:10.336693] [DEBUG] [LOCAL ] ARLO: Primary data saved (32823 records). [2025-09-14T16:52:10.336847] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-14T16:52:10.336940] [INFO ] [MAIN ] Update Progress: 147/2370 symbols completed. ARLO took 28.9s. Estimated remaining: 3h 46m 30s. Rate: 9.8 symbols/min [2025-09-14T16:52:10.536557] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:10.552960] [DEBUG] [LOCAL ] ARW: Loaded 13792 existing records from primary storage. [2025-09-14T16:52:10.553101] [INFO ] [MAIN ] ARW: Loaded 13792 existing records. [2025-09-14T16:52:10.733519] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:10.733896] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-14T16:52:10.733970] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-14T16:52:10.734436] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-14T16:52:10.734506] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-14T16:52:10.967416] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-14T16:52:11.092688] [INFO ] [REMOTE ] ARW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:11.623844] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T16:52:11.758881] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-14T16:52:12.558858] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-14T16:52:12.736564] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T16:52:13.270163] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T16:52:13.297844] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T16:52:13.305807] [INFO ] [REMOTE ] AROC: Full fetch complete (53184 records). [2025-09-14T16:52:13.306038] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-14T16:52:13.368002] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-14T16:52:13.710529] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-14T16:52:13.710661] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-14T16:52:13.711260] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-14T16:52:13.711326] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-14T16:52:13.712623] [DEBUG] [LOCAL ] AROC: Trimmed 53184 records to 36498 (keeping 150 days of data) [2025-09-14T16:52:13.950627] [DEBUG] [LOCAL ] AROC: Primary data saved (36498 records). [2025-09-14T16:52:13.950838] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-14T16:52:13.950962] [INFO ] [MAIN ] Update Progress: 148/2370 symbols completed. AROC took 21.5s. Estimated remaining: 3h 45m 46s. Rate: 9.8 symbols/min [2025-09-14T16:52:14.120676] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:14.133245] [DEBUG] [LOCAL ] ARX: Loaded 11341 existing records from primary storage. [2025-09-14T16:52:14.133388] [INFO ] [MAIN ] ARX: Loaded 11341 existing records. [2025-09-14T16:52:14.164196] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-14T16:52:14.312241] [WARN ] [MAIN ] ARX: Insufficient historical data. Have data from 2025-07-24, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:14.312490] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-14T16:52:14.312569] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-14T16:52:14.312985] [DEBUG] [LOCAL ] ARX: Deleted primary data file. [2025-09-14T16:52:14.313065] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-14T16:52:14.674382] [INFO ] [REMOTE ] ARX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:14.688510] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:52:14.693901] [INFO ] [REMOTE ] ARMK: Full fetch complete (54686 records). [2025-09-14T16:52:14.694011] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-14T16:52:14.963885] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-14T16:52:15.080364] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-14T16:52:15.080467] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-14T16:52:15.081096] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-14T16:52:15.081162] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-14T16:52:15.082383] [DEBUG] [LOCAL ] ARMK: Trimmed 54686 records to 37720 (keeping 150 days of data) [2025-09-14T16:52:15.317334] [DEBUG] [LOCAL ] ARMK: Primary data saved (37720 records). [2025-09-14T16:52:15.317532] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-14T16:52:15.317696] [INFO ] [MAIN ] Update Progress: 149/2370 symbols completed. ARMK took 24.0s. Estimated remaining: 3h 44m 30s. Rate: 9.9 symbols/min [2025-09-14T16:52:15.490016] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:15.522977] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-14T16:52:15.552011] [DEBUG] [LOCAL ] AS: Loaded 23795 existing records from primary storage. [2025-09-14T16:52:15.552179] [INFO ] [MAIN ] AS: Loaded 23795 existing records. [2025-09-14T16:52:15.726846] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:15.727110] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-14T16:52:15.727183] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-14T16:52:15.727772] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-14T16:52:15.727842] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-14T16:52:15.764014] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-14T16:52:16.086287] [INFO ] [REMOTE ] AS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:16.088961] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:16.089217] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-14T16:52:16.563887] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-14T16:52:16.578220] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T16:52:16.829219] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:16.829599] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-14T16:52:17.358841] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-14T16:52:18.158899] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-14T16:52:18.958838] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-14T16:52:19.214274] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:19.214679] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-14T16:52:19.351031] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T16:52:19.760265] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-14T16:52:19.763128] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T16:52:20.558830] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-14T16:52:21.358883] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-14T16:52:21.410892] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T16:52:21.565475] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T16:52:21.988267] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:52:21.993603] [INFO ] [REMOTE ] ARR: Full fetch complete (56582 records). [2025-09-14T16:52:21.993746] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-14T16:52:22.170483] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-14T16:52:22.384677] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-14T16:52:22.384789] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-14T16:52:22.385466] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-14T16:52:22.385537] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-14T16:52:22.386879] [DEBUG] [LOCAL ] ARR: Trimmed 56582 records to 39076 (keeping 150 days of data) [2025-09-14T16:52:22.528932] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:22.529426] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-14T16:52:22.654854] [DEBUG] [LOCAL ] ARR: Primary data saved (39076 records). [2025-09-14T16:52:22.655058] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-14T16:52:22.655173] [INFO ] [MAIN ] Update Progress: 150/2370 symbols completed. ARR took 28.9s. Estimated remaining: 3h 44m 42s. Rate: 9.9 symbols/min [2025-09-14T16:52:22.832805] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:22.841621] [DEBUG] [LOCAL ] ASA: Loaded 6464 existing records from primary storage. [2025-09-14T16:52:22.841795] [INFO ] [MAIN ] ASA: Loaded 6464 existing records. [2025-09-14T16:52:22.963899] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-14T16:52:23.025173] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:23.025434] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-14T16:52:23.025495] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-14T16:52:23.025803] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-14T16:52:23.025869] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-14T16:52:23.310431] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:23.316326] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-14T16:52:23.393427] [INFO ] [REMOTE ] ASA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:23.758865] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-14T16:52:24.558843] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-14T16:52:25.209600] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T16:52:25.358837] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-14T16:52:25.545847] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T16:52:26.158843] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-14T16:52:26.861444] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T16:52:26.958822] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-14T16:52:27.223290] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T16:52:27.590199] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T16:52:27.758847] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-14T16:52:28.558879] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-14T16:52:28.651337] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T16:52:29.358844] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-14T16:52:30.120893] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T16:52:30.158791] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-14T16:52:30.433968] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T16:52:30.958845] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-14T16:52:31.758835] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-14T16:52:31.909550] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T16:52:31.943163] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T16:52:32.558870] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-14T16:52:33.094214] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T16:52:33.358826] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-14T16:52:33.383194] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T16:52:34.158849] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-14T16:52:34.698251] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T16:52:34.702927] [INFO ] [REMOTE ] ARX: Full fetch complete (11316 records). [2025-09-14T16:52:34.703020] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-14T16:52:34.889244] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 36 unique days, need 150 days [2025-09-14T16:52:34.889581] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:52:34.889655] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:52:34.889716] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-14T16:52:34.889810] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-14T16:52:34.889913] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-14T16:52:34.890006] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-14T16:52:34.890139] [INFO ] [MAIN ] Update Progress: 151/2370 symbols completed. ARX took 20.9s. Estimated remaining: 3h 46m 7s. Rate: 9.8 symbols/min [2025-09-14T16:52:34.964327] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-14T16:52:35.098160] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:35.133082] [DEBUG] [LOCAL ] ASAN: Loaded 23750 existing records from primary storage. [2025-09-14T16:52:35.133340] [INFO ] [MAIN ] ASAN: Loaded 23750 existing records. [2025-09-14T16:52:35.368708] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:35.369076] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-14T16:52:35.369175] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-14T16:52:35.370093] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-14T16:52:35.370194] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-14T16:52:35.728768] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T16:52:35.768575] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-14T16:52:36.016154] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:36.570853] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-14T16:52:36.605394] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T16:52:36.606421] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T16:52:36.841418] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T16:52:36.846158] [INFO ] [REMOTE ] ARW: Full fetch complete (36172 records). [2025-09-14T16:52:36.846387] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-14T16:52:37.240586] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-14T16:52:37.240754] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-14T16:52:37.241353] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-14T16:52:37.241415] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-14T16:52:37.242808] [DEBUG] [LOCAL ] ARW: Trimmed 36172 records to 24276 (keeping 150 days of data) [2025-09-14T16:52:37.359359] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-14T16:52:37.409354] [DEBUG] [LOCAL ] ARW: Primary data saved (24276 records). [2025-09-14T16:52:37.409546] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-14T16:52:37.409699] [INFO ] [MAIN ] Update Progress: 152/2370 symbols completed. ARW took 27.1s. Estimated remaining: 3h 45m 8s. Rate: 9.9 symbols/min [2025-09-14T16:52:37.585971] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:37.607735] [DEBUG] [LOCAL ] ASB: Loaded 22101 existing records from primary storage. [2025-09-14T16:52:37.607912] [INFO ] [MAIN ] ASB: Loaded 22101 existing records. [2025-09-14T16:52:37.783378] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:37.783700] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-14T16:52:37.783766] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-14T16:52:37.784365] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-14T16:52:37.784439] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-14T16:52:38.151370] [INFO ] [REMOTE ] ASB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:38.158799] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-14T16:52:38.399519] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T16:52:38.958844] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-14T16:52:39.759006] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-14T16:52:39.807200] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T16:52:39.832543] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T16:52:39.835922] [INFO ] [REMOTE ] ASA: Full fetch complete (14199 records). [2025-09-14T16:52:39.836033] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-14T16:52:40.220094] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-14T16:52:40.220239] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-14T16:52:40.220696] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-14T16:52:40.220769] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-14T16:52:40.221688] [DEBUG] [LOCAL ] ASA: Trimmed 14199 records to 10448 (keeping 150 days of data) [2025-09-14T16:52:40.289000] [DEBUG] [LOCAL ] ASA: Primary data saved (10448 records). [2025-09-14T16:52:40.289173] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-14T16:52:40.289303] [INFO ] [MAIN ] Update Progress: 153/2370 symbols completed. ASA took 17.6s. Estimated remaining: 3h 44m 16s. Rate: 9.9 symbols/min [2025-09-14T16:52:40.456958] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:40.460675] [DEBUG] [LOCAL ] ASBA: Loaded 1676 existing records from primary storage. [2025-09-14T16:52:40.460773] [INFO ] [MAIN ] ASBA: Loaded 1676 existing records. [2025-09-14T16:52:40.559036] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-14T16:52:40.637864] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:40.638139] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-14T16:52:40.638200] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-14T16:52:40.638449] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-14T16:52:40.638510] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-14T16:52:40.992550] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:41.358857] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-14T16:52:41.471555] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T16:52:41.953588] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T16:52:42.158858] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-14T16:52:42.371964] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T16:52:42.751208] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T16:52:42.958831] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-14T16:52:43.758861] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-14T16:52:44.164893] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-14T16:52:44.558809] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-14T16:52:44.674446] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T16:52:45.358837] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-14T16:52:45.952480] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T16:52:46.158819] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-14T16:52:46.232782] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T16:52:46.958893] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-14T16:52:47.669708] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T16:52:47.675403] [INFO ] [REMOTE ] AS: Full fetch complete (57682 records). [2025-09-14T16:52:47.675624] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-14T16:52:47.767244] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-14T16:52:48.064915] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-14T16:52:48.065065] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-14T16:52:48.065694] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-14T16:52:48.065754] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-14T16:52:48.067306] [DEBUG] [LOCAL ] AS: Trimmed 57682 records to 39972 (keeping 150 days of data) [2025-09-14T16:52:48.280194] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T16:52:48.317851] [DEBUG] [LOCAL ] AS: Primary data saved (39972 records). [2025-09-14T16:52:48.318035] [INFO ] [MAIN ] AS: Full history saved. [2025-09-14T16:52:48.318153] [INFO ] [MAIN ] Update Progress: 154/2370 symbols completed. AS took 33.0s. Estimated remaining: 3h 44m 38s. Rate: 9.9 symbols/min [2025-09-14T16:52:48.490677] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:48.508786] [DEBUG] [LOCAL ] ASC: Loaded 16590 existing records from primary storage. [2025-09-14T16:52:48.508946] [INFO ] [MAIN ] ASC: Loaded 16590 existing records. [2025-09-14T16:52:48.564081] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-14T16:52:48.694347] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:48.694706] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-14T16:52:48.694772] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-14T16:52:48.695778] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-14T16:52:48.695853] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-14T16:52:49.053217] [INFO ] [REMOTE ] ASC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:49.083178] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T16:52:49.358812] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-14T16:52:49.980466] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T16:52:50.158846] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-14T16:52:50.911912] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T16:52:50.958803] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-14T16:52:51.489483] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T16:52:51.758854] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-14T16:52:52.401452] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T16:52:52.431868] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T16:52:52.558802] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-14T16:52:53.358887] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-14T16:52:54.113156] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T16:52:54.158798] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-14T16:52:54.754932] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T16:52:54.880763] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T16:52:54.958841] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-14T16:52:55.758836] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-14T16:52:56.430773] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:52:56.558827] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-14T16:52:57.103512] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T16:52:57.358876] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-14T16:52:57.634254] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:52:58.158854] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-14T16:52:58.656111] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T16:52:58.657130] [INFO ] [REMOTE ] ASBA: Full fetch complete (3760 records). [2025-09-14T16:52:58.657227] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-14T16:52:58.969621] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-14T16:52:59.009869] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-14T16:52:59.010115] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-14T16:52:59.010339] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-14T16:52:59.010416] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-14T16:52:59.011117] [DEBUG] [LOCAL ] ASBA: Trimmed 3760 records to 2556 (keeping 150 days of data) [2025-09-14T16:52:59.028763] [DEBUG] [LOCAL ] ASBA: Primary data saved (2556 records). [2025-09-14T16:52:59.028874] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-14T16:52:59.029005] [INFO ] [MAIN ] Update Progress: 155/2370 symbols completed. ASBA took 18.7s. Estimated remaining: 3h 45m 38s. Rate: 9.8 symbols/min [2025-09-14T16:52:59.199319] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:59.232903] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:52:59.247981] [DEBUG] [LOCAL ] ASG: Loaded 8690 existing records from primary storage. [2025-09-14T16:52:59.248432] [INFO ] [MAIN ] ASG: Loaded 8690 existing records. [2025-09-14T16:52:59.423182] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:59.423434] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-14T16:52:59.423508] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-14T16:52:59.423927] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-14T16:52:59.423994] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-14T16:52:59.771794] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-14T16:52:59.776250] [INFO ] [REMOTE ] ASG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:00.308847] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T16:53:00.558831] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-14T16:53:01.276710] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T16:53:01.358826] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-14T16:53:01.820263] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T16:53:02.015377] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:53:02.020808] [INFO ] [REMOTE ] ASB: Full fetch complete (53952 records). [2025-09-14T16:53:02.020999] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-14T16:53:02.165526] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-14T16:53:02.417198] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-14T16:53:02.417320] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-14T16:53:02.417927] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-14T16:53:02.417987] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-14T16:53:02.419153] [DEBUG] [LOCAL ] ASB: Trimmed 53952 records to 36945 (keeping 150 days of data) [2025-09-14T16:53:02.655150] [DEBUG] [LOCAL ] ASB: Primary data saved (36945 records). [2025-09-14T16:53:02.655368] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-14T16:53:02.655478] [INFO ] [MAIN ] Update Progress: 156/2370 symbols completed. ASB took 25.2s. Estimated remaining: 3h 44m 56s. Rate: 9.8 symbols/min [2025-09-14T16:53:02.827865] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:02.839939] [DEBUG] [LOCAL ] ASGI: Loaded 10421 existing records from primary storage. [2025-09-14T16:53:02.840072] [INFO ] [MAIN ] ASGI: Loaded 10421 existing records. [2025-09-14T16:53:02.963993] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-14T16:53:03.031719] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:03.032099] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-14T16:53:03.032229] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-14T16:53:03.032731] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-14T16:53:03.032801] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-14T16:53:03.473266] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:03.758866] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-14T16:53:03.997766] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T16:53:04.329335] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T16:53:04.558826] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-14T16:53:04.866182] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T16:53:05.358877] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-14T16:53:06.058239] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T16:53:06.158826] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-14T16:53:06.369474] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T16:53:06.958839] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-14T16:53:07.758852] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-14T16:53:08.059225] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T16:53:08.170682] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T16:53:08.558804] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-14T16:53:08.868998] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:53:09.358834] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-14T16:53:10.012910] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T16:53:10.022271] [INFO ] [REMOTE ] ASAN: Full fetch complete (57362 records). [2025-09-14T16:53:10.022518] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-14T16:53:10.163999] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-14T16:53:10.427600] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-14T16:53:10.427838] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-14T16:53:10.428758] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-14T16:53:10.428827] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-14T16:53:10.430587] [DEBUG] [LOCAL ] ASAN: Trimmed 57362 records to 39578 (keeping 150 days of data) [2025-09-14T16:53:10.690839] [DEBUG] [LOCAL ] ASAN: Primary data saved (39578 records). [2025-09-14T16:53:10.691071] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-14T16:53:10.691195] [INFO ] [MAIN ] Update Progress: 157/2370 symbols completed. ASAN took 35.8s. Estimated remaining: 3h 45m 18s. Rate: 9.8 symbols/min [2025-09-14T16:53:10.897821] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T16:53:10.958782] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-14T16:53:11.274727] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T16:53:11.758834] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-14T16:53:12.075765] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T16:53:12.558944] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-14T16:53:12.832450] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T16:53:13.358869] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-14T16:53:13.540070] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T16:53:13.544150] [INFO ] [REMOTE ] ASC: Full fetch complete (42004 records). [2025-09-14T16:53:13.544298] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-14T16:53:13.960094] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-14T16:53:13.960267] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-14T16:53:13.961175] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-14T16:53:13.961255] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-14T16:53:13.963036] [DEBUG] [LOCAL ] ASC: Trimmed 42004 records to 28033 (keeping 150 days of data) [2025-09-14T16:53:14.092295] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T16:53:14.159154] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-14T16:53:14.171363] [DEBUG] [LOCAL ] ASC: Primary data saved (28033 records). [2025-09-14T16:53:14.171517] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-14T16:53:14.171680] [INFO ] [MAIN ] Update Progress: 158/2370 symbols completed. ASC took 25.9s. Estimated remaining: 3h 44m 35s. Rate: 9.8 symbols/min [2025-09-14T16:53:14.958839] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-14T16:53:15.391347] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T16:53:15.758857] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-14T16:53:15.967039] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T16:53:15.969450] [INFO ] [REMOTE ] ASG: Full fetch complete (23126 records). [2025-09-14T16:53:15.969553] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-14T16:53:16.333963] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-14T16:53:16.334070] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-14T16:53:16.334467] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-14T16:53:16.334554] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-14T16:53:16.335343] [DEBUG] [LOCAL ] ASG: Trimmed 23126 records to 14539 (keeping 150 days of data) [2025-09-14T16:53:16.421619] [DEBUG] [LOCAL ] ASG: Primary data saved (14539 records). [2025-09-14T16:53:16.421849] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-14T16:53:16.421994] [INFO ] [MAIN ] Update Progress: 159/2370 symbols completed. ASG took 17.4s. Estimated remaining: 3h 43m 35s. Rate: 9.9 symbols/min [2025-09-14T16:53:16.634321] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T16:53:16.642080] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-14T16:53:17.716635] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T16:53:17.721830] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-14T16:53:18.940585] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T16:53:18.946493] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-14T16:53:19.818111] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T16:53:19.823758] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-14T16:53:20.824678] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T16:53:20.828104] [INFO ] [REMOTE ] ASGI: Full fetch complete (23917 records). [2025-09-14T16:53:20.828260] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-14T16:53:21.250463] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-14T16:53:21.250721] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-14T16:53:21.251204] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-14T16:53:21.251265] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-14T16:53:21.252313] [DEBUG] [LOCAL ] ASGI: Trimmed 23917 records to 16822 (keeping 150 days of data) [2025-09-14T16:53:21.365571] [DEBUG] [LOCAL ] ASGI: Primary data saved (16822 records). [2025-09-14T16:53:21.365855] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-14T16:53:21.365983] [INFO ] [MAIN ] Update Progress: 160/2370 symbols completed. ASGI took 18.7s. Estimated remaining: 3h 43m 14s. Rate: 9.9 symbols/min [2025-09-14T16:53:21.879580] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:22.060907] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:22.083572] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:22.103137] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:22.116459] [DEBUG] [LOCAL ] ASH: Loaded 15965 existing records from primary storage. [2025-09-14T16:53:22.116834] [INFO ] [MAIN ] ASH: Loaded 15965 existing records. [2025-09-14T16:53:22.218988] [DEBUG] [LOCAL ] ASIX: Loaded 10488 existing records from primary storage. [2025-09-14T16:53:22.248345] [INFO ] [MAIN ] ASIX: Loaded 10488 existing records. [2025-09-14T16:53:22.322987] [DEBUG] [LOCAL ] ASPN: Loaded 22143 existing records from primary storage. [2025-09-14T16:53:22.390746] [INFO ] [MAIN ] ASPN: Loaded 22143 existing records. [2025-09-14T16:53:22.442134] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:22.396636] [DEBUG] [LOCAL ] ASGN: Loaded 16516 existing records from primary storage. [2025-09-14T16:53:22.489467] [INFO ] [MAIN ] ASGN: Loaded 16516 existing records. [2025-09-14T16:53:22.525545] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-14T16:53:22.546350] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-14T16:53:22.659267] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-14T16:53:22.783287] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:22.743735] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-14T16:53:22.809565] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-14T16:53:22.892281] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-14T16:53:22.932854] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:22.953713] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-14T16:53:22.988355] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-14T16:53:22.988575] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:22.988757] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-14T16:53:23.035313] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-14T16:53:23.080961] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-14T16:53:23.117368] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-14T16:53:23.152416] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-14T16:53:23.171992] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-14T16:53:23.259050] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-14T16:53:23.373173] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-14T16:53:24.189232] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:24.250575] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-14T16:53:24.352188] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:24.399708] [INFO ] [REMOTE ] ASH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:24.400121] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-14T16:53:24.449611] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:24.449926] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-14T16:53:24.450993] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-14T16:53:25.462709] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T16:53:25.466550] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-14T16:53:25.788998] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T16:53:25.799083] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-14T16:53:25.882014] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T16:53:25.889955] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-14T16:53:26.050121] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T16:53:26.058298] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-14T16:53:26.376008] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T16:53:26.380599] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-14T16:53:27.252900] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:53:27.262268] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-14T16:53:27.467912] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T16:53:27.652869] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T16:53:27.710725] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T16:53:27.758860] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-14T16:53:28.558931] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-14T16:53:28.614111] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T16:53:29.208464] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T16:53:29.358840] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-14T16:53:30.158815] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-14T16:53:30.400844] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T16:53:30.815631] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T16:53:30.937194] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T16:53:30.958798] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-14T16:53:31.758904] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-14T16:53:32.101251] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T16:53:32.558838] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-14T16:53:32.792724] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T16:53:33.358854] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-14T16:53:33.775044] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T16:53:34.158897] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-14T16:53:34.381223] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T16:53:34.958854] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-14T16:53:35.659174] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T16:53:35.758845] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-14T16:53:36.144100] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T16:53:36.381284] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:53:36.385012] [INFO ] [REMOTE ] ASH: Full fetch complete (41568 records). [2025-09-14T16:53:36.385111] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-14T16:53:36.561889] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-14T16:53:36.759721] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-14T16:53:36.759824] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-14T16:53:36.760299] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-14T16:53:36.760353] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-14T16:53:36.761299] [DEBUG] [LOCAL ] ASH: Trimmed 41568 records to 27620 (keeping 150 days of data) [2025-09-14T16:53:36.931574] [DEBUG] [LOCAL ] ASH: Primary data saved (27620 records). [2025-09-14T16:53:36.931754] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-14T16:53:36.931863] [INFO ] [MAIN ] Update Progress: 161/2370 symbols completed. ASH took 15.6s. Estimated remaining: 3h 45m 18s. Rate: 9.8 symbols/min [2025-09-14T16:53:37.085868] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:53:37.117892] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:37.118711] [INFO ] [REMOTE ] ASIX: Full fetch complete (23797 records). [2025-09-14T16:53:37.118814] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-14T16:53:37.225032] [DEBUG] [LOCAL ] ASR: Loaded 4369 existing records from primary storage. [2025-09-14T16:53:37.225224] [INFO ] [MAIN ] ASR: Loaded 4369 existing records. [2025-09-14T16:53:37.364587] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-14T16:53:37.580401] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:37.616060] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-14T16:53:37.616277] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-14T16:53:37.638102] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-14T16:53:37.667160] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-14T16:53:37.804252] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-14T16:53:37.815199] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-14T16:53:37.836907] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-14T16:53:37.866092] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-14T16:53:37.964170] [DEBUG] [LOCAL ] ASIX: Trimmed 23797 records to 17222 (keeping 150 days of data) [2025-09-14T16:53:38.160518] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-14T16:53:38.166758] [INFO ] [REMOTE ] ASR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:38.206859] [DEBUG] [LOCAL ] ASIX: Primary data saved (17222 records). [2025-09-14T16:53:38.207210] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-14T16:53:38.207356] [INFO ] [MAIN ] Update Progress: 162/2370 symbols completed. ASIX took 16.8s. Estimated remaining: 3h 44m 6s. Rate: 9.9 symbols/min [2025-09-14T16:53:38.413971] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:38.439499] [DEBUG] [LOCAL ] ASX: Loaded 23560 existing records from primary storage. [2025-09-14T16:53:38.439720] [INFO ] [MAIN ] ASX: Loaded 23560 existing records. [2025-09-14T16:53:38.625438] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:38.625777] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-14T16:53:38.625844] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-14T16:53:38.626503] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-14T16:53:38.626567] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-14T16:53:38.960442] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-14T16:53:39.004831] [INFO ] [REMOTE ] ASX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:39.026434] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T16:53:39.527806] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T16:53:39.758864] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-14T16:53:39.928452] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T16:53:40.558855] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-14T16:53:41.358874] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-14T16:53:41.452846] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:53:42.131335] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T16:53:42.146976] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T16:53:42.158783] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-14T16:53:42.819797] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T16:53:42.958847] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-14T16:53:43.758919] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-14T16:53:44.036774] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:53:44.558883] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-14T16:53:45.358850] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-14T16:53:45.496048] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T16:53:45.691116] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T16:53:46.158848] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-14T16:53:46.179829] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T16:53:46.958884] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-14T16:53:47.418586] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T16:53:47.758910] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-14T16:53:47.782512] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T16:53:48.558849] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-14T16:53:49.358917] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-14T16:53:49.498052] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T16:53:49.978787] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:53:49.982545] [INFO ] [REMOTE ] ASGN: Full fetch complete (39813 records). [2025-09-14T16:53:49.982662] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-14T16:53:50.159141] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-14T16:53:50.360841] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-14T16:53:50.361003] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-14T16:53:50.361587] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-14T16:53:50.361716] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-14T16:53:50.362786] [DEBUG] [LOCAL ] ASGN: Trimmed 39813 records to 26592 (keeping 150 days of data) [2025-09-14T16:53:50.480089] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T16:53:50.560289] [DEBUG] [LOCAL ] ASGN: Primary data saved (26592 records). [2025-09-14T16:53:50.560457] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-14T16:53:50.560569] [INFO ] [MAIN ] Update Progress: 163/2370 symbols completed. ASGN took 29.2s. Estimated remaining: 3h 45m 25s. Rate: 9.8 symbols/min [2025-09-14T16:53:50.726917] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:50.744489] [DEBUG] [LOCAL ] ATEN: Loaded 17300 existing records from primary storage. [2025-09-14T16:53:50.744661] [INFO ] [MAIN ] ATEN: Loaded 17300 existing records. [2025-09-14T16:53:50.964062] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-14T16:53:50.964708] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:50.965006] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T16:53:50.968835] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-14T16:53:50.969616] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-14T16:53:50.970442] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-14T16:53:50.970505] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-14T16:53:51.334022] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:51.758871] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-14T16:53:52.558838] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-14T16:53:52.705430] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T16:53:52.736930] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T16:53:53.358845] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-14T16:53:54.158817] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-14T16:53:54.268470] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T16:53:54.290403] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T16:53:54.292108] [INFO ] [REMOTE ] ASR: Full fetch complete (9602 records). [2025-09-14T16:53:54.292197] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-14T16:53:54.654781] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-14T16:53:54.654888] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-14T16:53:54.655186] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-14T16:53:54.655240] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-14T16:53:54.655748] [DEBUG] [LOCAL ] ASR: Trimmed 9602 records to 7112 (keeping 150 days of data) [2025-09-14T16:53:54.699891] [DEBUG] [LOCAL ] ASR: Primary data saved (7112 records). [2025-09-14T16:53:54.700030] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-14T16:53:54.700149] [INFO ] [MAIN ] Update Progress: 164/2370 symbols completed. ASR took 17.8s. Estimated remaining: 3h 44m 52s. Rate: 9.8 symbols/min [2025-09-14T16:53:54.869283] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:54.888098] [DEBUG] [LOCAL ] ATGE: Loaded 12884 existing records from primary storage. [2025-09-14T16:53:54.888336] [INFO ] [MAIN ] ATGE: Loaded 12884 existing records. [2025-09-14T16:53:54.963907] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-14T16:53:55.068694] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:55.068996] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-14T16:53:55.069068] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-14T16:53:55.069551] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-14T16:53:55.069633] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-14T16:53:55.417538] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:55.576263] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T16:53:55.758803] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-14T16:53:56.455297] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T16:53:56.460313] [INFO ] [REMOTE ] ASPN: Full fetch complete (54319 records). [2025-09-14T16:53:56.460432] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-14T16:53:56.560664] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-14T16:53:56.856036] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-14T16:53:56.856163] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-14T16:53:56.856866] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-14T16:53:56.856951] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-14T16:53:56.858112] [DEBUG] [LOCAL ] ASPN: Trimmed 54319 records to 37369 (keeping 150 days of data) [2025-09-14T16:53:57.083203] [DEBUG] [LOCAL ] ASPN: Primary data saved (37369 records). [2025-09-14T16:53:57.083390] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-14T16:53:57.083496] [INFO ] [MAIN ] Update Progress: 165/2370 symbols completed. ASPN took 35.7s. Estimated remaining: 3h 43m 56s. Rate: 9.8 symbols/min [2025-09-14T16:53:57.256235] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:57.269413] [DEBUG] [LOCAL ] ATHM: Loaded 12106 existing records from primary storage. [2025-09-14T16:53:57.269580] [INFO ] [MAIN ] ATHM: Loaded 12106 existing records. [2025-09-14T16:53:57.366557] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-14T16:53:57.454828] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:57.455321] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-14T16:53:57.455424] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-14T16:53:57.455987] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-14T16:53:57.456057] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-14T16:53:57.787274] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T16:53:57.878727] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:57.901004] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T16:53:58.158871] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-14T16:53:58.775954] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:53:58.958854] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-14T16:53:59.758808] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-14T16:53:59.796871] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T16:54:00.558838] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-14T16:54:00.660135] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T16:54:01.358811] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-14T16:54:01.438103] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T16:54:02.096004] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T16:54:02.101771] [INFO ] [REMOTE ] ASX: Full fetch complete (57538 records). [2025-09-14T16:54:02.101964] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-14T16:54:02.166274] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-14T16:54:02.493318] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-14T16:54:02.493516] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-14T16:54:02.494182] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-14T16:54:02.494265] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-14T16:54:02.495765] [DEBUG] [LOCAL ] ASX: Trimmed 57538 records to 39787 (keeping 150 days of data) [2025-09-14T16:54:02.614041] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T16:54:02.779839] [DEBUG] [LOCAL ] ASX: Primary data saved (39787 records). [2025-09-14T16:54:02.780043] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-14T16:54:02.780153] [INFO ] [MAIN ] Update Progress: 166/2370 symbols completed. ASX took 24.6s. Estimated remaining: 3h 43m 44s. Rate: 9.9 symbols/min [2025-09-14T16:54:02.956068] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:02.960927] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-14T16:54:02.960788] [DEBUG] [LOCAL ] ATHS: Loaded 3127 existing records from primary storage. [2025-09-14T16:54:02.961246] [INFO ] [MAIN ] ATHS: Loaded 3127 existing records. [2025-09-14T16:54:03.147881] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:03.148147] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-14T16:54:03.148221] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-14T16:54:03.148528] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-14T16:54:03.148589] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-14T16:54:03.500676] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:03.651681] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T16:54:03.758845] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-14T16:54:04.293969] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T16:54:04.558827] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-14T16:54:05.296747] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T16:54:05.358823] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-14T16:54:06.128088] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T16:54:06.158781] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-14T16:54:06.646431] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T16:54:06.958823] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-14T16:54:07.459153] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T16:54:07.758837] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-14T16:54:08.497631] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T16:54:08.558837] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-14T16:54:09.208487] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T16:54:09.247445] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T16:54:09.358811] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-14T16:54:10.158868] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-14T16:54:10.934907] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T16:54:10.958806] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-14T16:54:11.280945] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T16:54:11.758898] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-14T16:54:12.208947] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T16:54:12.294038] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T16:54:12.558872] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-14T16:54:13.321669] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T16:54:13.358800] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-14T16:54:14.014052] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T16:54:14.158841] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-14T16:54:14.552409] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T16:54:14.556475] [INFO ] [REMOTE ] ATEN: Full fetch complete (43645 records). [2025-09-14T16:54:14.556605] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-14T16:54:14.929299] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-14T16:54:14.929402] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-14T16:54:14.929914] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-14T16:54:14.929975] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-14T16:54:14.930955] [DEBUG] [LOCAL ] ATEN: Trimmed 43645 records to 29040 (keeping 150 days of data) [2025-09-14T16:54:14.986886] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-14T16:54:15.114798] [DEBUG] [LOCAL ] ATEN: Primary data saved (29040 records). [2025-09-14T16:54:15.114982] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-14T16:54:15.115097] [INFO ] [MAIN ] Update Progress: 167/2370 symbols completed. ATEN took 24.6s. Estimated remaining: 3h 45m 1s. Rate: 9.8 symbols/min [2025-09-14T16:54:15.288047] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:15.312035] [DEBUG] [LOCAL ] ATI: Loaded 22882 existing records from primary storage. [2025-09-14T16:54:15.312249] [INFO ] [MAIN ] ATI: Loaded 22882 existing records. [2025-09-14T16:54:15.497771] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:15.498083] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-14T16:54:15.498146] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-14T16:54:15.498796] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-14T16:54:15.498859] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-14T16:54:15.763978] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-14T16:54:15.868479] [INFO ] [REMOTE ] ATI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:16.224918] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T16:54:16.558841] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-14T16:54:16.855343] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T16:54:17.358863] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-14T16:54:17.739683] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T16:54:18.158792] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-14T16:54:18.572928] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T16:54:18.958895] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-14T16:54:19.563780] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T16:54:19.758834] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-14T16:54:20.236158] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T16:54:20.558855] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-14T16:54:21.070354] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T16:54:21.358867] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-14T16:54:21.872410] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T16:54:21.875537] [INFO ] [REMOTE ] ATGE: Full fetch complete (35349 records). [2025-09-14T16:54:21.875634] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-14T16:54:22.163877] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-14T16:54:22.253344] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-14T16:54:22.253528] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-14T16:54:22.254083] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-14T16:54:22.254256] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-14T16:54:22.255441] [DEBUG] [LOCAL ] ATGE: Trimmed 35349 records to 23587 (keeping 150 days of data) [2025-09-14T16:54:22.373454] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T16:54:22.440257] [DEBUG] [LOCAL ] ATGE: Primary data saved (23587 records). [2025-09-14T16:54:22.440416] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-14T16:54:22.440522] [INFO ] [MAIN ] Update Progress: 168/2370 symbols completed. ATGE took 27.7s. Estimated remaining: 3h 45m 10s. Rate: 9.8 symbols/min [2025-09-14T16:54:22.609001] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:22.626961] [DEBUG] [LOCAL ] ATKR: Loaded 15949 existing records from primary storage. [2025-09-14T16:54:22.627126] [INFO ] [MAIN ] ATKR: Loaded 15949 existing records. [2025-09-14T16:54:22.806261] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:22.806542] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-14T16:54:22.806601] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-14T16:54:22.807169] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-14T16:54:22.807253] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-14T16:54:22.962568] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-14T16:54:23.093336] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T16:54:23.122199] [INFO ] [REMOTE ] ATHM: Full fetch complete (37237 records). [2025-09-14T16:54:23.168242] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-14T16:54:23.172424] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:23.546284] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-14T16:54:23.546402] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-14T16:54:23.546867] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-14T16:54:23.546923] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-14T16:54:23.547898] [DEBUG] [LOCAL ] ATHM: Trimmed 37237 records to 23577 (keeping 150 days of data) [2025-09-14T16:54:23.691968] [DEBUG] [LOCAL ] ATHM: Primary data saved (23577 records). [2025-09-14T16:54:23.692173] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-14T16:54:23.692354] [INFO ] [MAIN ] Update Progress: 169/2370 symbols completed. ATHM took 26.6s. Estimated remaining: 3h 44m 0s. Rate: 9.8 symbols/min [2025-09-14T16:54:23.763916] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-14T16:54:23.866503] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:23.886968] [DEBUG] [LOCAL ] ATMU: Loaded 18144 existing records from primary storage. [2025-09-14T16:54:23.887138] [INFO ] [MAIN ] ATMU: Loaded 18144 existing records. [2025-09-14T16:54:24.064265] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:24.064538] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-14T16:54:24.064599] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-14T16:54:24.065173] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-14T16:54:24.065244] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-14T16:54:24.427967] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:24.435729] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T16:54:24.558824] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-14T16:54:24.870573] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T16:54:25.358824] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-14T16:54:25.971423] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:54:26.158883] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-14T16:54:26.951355] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T16:54:26.961609] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-14T16:54:26.976308] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T16:54:27.758844] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-14T16:54:28.446734] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T16:54:28.467144] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T16:54:28.558842] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-14T16:54:29.102829] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T16:54:29.104270] [INFO ] [REMOTE ] ATHS: Full fetch complete (7700 records). [2025-09-14T16:54:29.104382] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-14T16:54:29.363946] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-14T16:54:29.481843] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-14T16:54:29.481960] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-14T16:54:29.482228] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-14T16:54:29.482287] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-14T16:54:29.482781] [DEBUG] [LOCAL ] ATHS: Trimmed 7700 records to 5007 (keeping 150 days of data) [2025-09-14T16:54:29.516009] [DEBUG] [LOCAL ] ATHS: Primary data saved (5007 records). [2025-09-14T16:54:29.516153] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-14T16:54:29.516313] [INFO ] [MAIN ] Update Progress: 170/2370 symbols completed. ATHS took 26.7s. Estimated remaining: 3h 43m 51s. Rate: 9.8 symbols/min [2025-09-14T16:54:29.684627] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:29.707629] [DEBUG] [LOCAL ] ATO: Loaded 17504 existing records from primary storage. [2025-09-14T16:54:29.707802] [INFO ] [MAIN ] ATO: Loaded 17504 existing records. [2025-09-14T16:54:29.885919] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:29.886207] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-14T16:54:29.886286] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-14T16:54:29.886950] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-14T16:54:29.887025] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-14T16:54:30.163982] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-14T16:54:30.256499] [INFO ] [REMOTE ] ATO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:30.615905] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T16:54:30.958835] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-14T16:54:31.427550] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T16:54:31.758869] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-14T16:54:32.387840] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T16:54:32.558827] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-14T16:54:32.858290] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T16:54:33.358833] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-14T16:54:33.654687] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T16:54:34.158837] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-14T16:54:34.875889] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T16:54:34.958792] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-14T16:54:35.214904] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T16:54:35.758829] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-14T16:54:36.409481] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T16:54:36.558851] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-14T16:54:37.358833] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-14T16:54:37.456817] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T16:54:37.504447] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T16:54:38.158852] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-14T16:54:38.958796] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-14T16:54:39.061423] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T16:54:39.758893] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-14T16:54:40.124863] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T16:54:40.536947] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T16:54:40.558917] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-14T16:54:41.358896] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-14T16:54:41.394496] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T16:54:41.951708] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:54:42.158860] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-14T16:54:42.429338] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T16:54:42.437373] [INFO ] [REMOTE ] ATI: Full fetch complete (56290 records). [2025-09-14T16:54:42.437762] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-14T16:54:42.891796] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-14T16:54:42.892035] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-14T16:54:42.892903] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-14T16:54:42.893112] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-14T16:54:42.911252] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T16:54:42.919086] [DEBUG] [LOCAL ] ATI: Trimmed 56290 records to 39009 (keeping 150 days of data) [2025-09-14T16:54:42.991325] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-14T16:54:43.181216] [DEBUG] [LOCAL ] ATI: Primary data saved (39009 records). [2025-09-14T16:54:43.181423] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-14T16:54:43.181571] [INFO ] [MAIN ] Update Progress: 171/2370 symbols completed. ATI took 28.1s. Estimated remaining: 3h 45m 22s. Rate: 9.8 symbols/min [2025-09-14T16:54:43.353363] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:43.369533] [DEBUG] [LOCAL ] ATR: Loaded 13805 existing records from primary storage. [2025-09-14T16:54:43.369721] [INFO ] [MAIN ] ATR: Loaded 13805 existing records. [2025-09-14T16:54:43.547780] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:43.548052] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-14T16:54:43.548115] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-14T16:54:43.548675] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-14T16:54:43.548740] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-14T16:54:43.766129] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-14T16:54:43.922141] [INFO ] [REMOTE ] ATR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:44.482014] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T16:54:44.558803] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-14T16:54:45.244065] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T16:54:45.248922] [INFO ] [REMOTE ] ATMU: Full fetch complete (43279 records). [2025-09-14T16:54:45.249023] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-14T16:54:45.364255] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-14T16:54:45.626133] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-14T16:54:45.626275] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-14T16:54:45.626806] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-14T16:54:45.626865] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-14T16:54:45.627982] [DEBUG] [LOCAL ] ATMU: Trimmed 43279 records to 28868 (keeping 150 days of data) [2025-09-14T16:54:45.810209] [DEBUG] [LOCAL ] ATMU: Primary data saved (28868 records). [2025-09-14T16:54:45.810369] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-14T16:54:45.810466] [INFO ] [MAIN ] Update Progress: 172/2370 symbols completed. ATMU took 22.1s. Estimated remaining: 3h 44m 31s. Rate: 9.8 symbols/min [2025-09-14T16:54:45.976527] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:45.985714] [DEBUG] [LOCAL ] ATS: Loaded 7803 existing records from primary storage. [2025-09-14T16:54:45.985857] [INFO ] [MAIN ] ATS: Loaded 7803 existing records. [2025-09-14T16:54:46.160353] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-14T16:54:46.163624] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:46.164821] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-14T16:54:46.164970] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-14T16:54:46.165480] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-14T16:54:46.165602] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-14T16:54:46.444776] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T16:54:46.557218] [INFO ] [REMOTE ] ATS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:46.847915] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T16:54:46.958814] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-14T16:54:47.638117] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T16:54:47.758844] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-14T16:54:48.090581] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T16:54:48.558829] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-14T16:54:49.016752] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T16:54:49.358879] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-14T16:54:49.850223] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T16:54:50.158842] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-14T16:54:50.345223] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T16:54:50.958835] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-14T16:54:51.501949] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T16:54:51.506146] [INFO ] [REMOTE ] ATKR: Full fetch complete (39984 records). [2025-09-14T16:54:51.506319] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-14T16:54:51.764065] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-14T16:54:51.900100] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-14T16:54:51.900252] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-14T16:54:51.900960] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-14T16:54:51.901027] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-14T16:54:51.902476] [DEBUG] [LOCAL ] ATKR: Trimmed 39984 records to 25920 (keeping 150 days of data) [2025-09-14T16:54:52.073098] [DEBUG] [LOCAL ] ATKR: Primary data saved (25920 records). [2025-09-14T16:54:52.073307] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-14T16:54:52.073491] [INFO ] [MAIN ] Update Progress: 173/2370 symbols completed. ATKR took 29.6s. Estimated remaining: 3h 44m 26s. Rate: 9.8 symbols/min [2025-09-14T16:54:52.286336] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:52.308128] [DEBUG] [LOCAL ] ATUS: Loaded 22455 existing records from primary storage. [2025-09-14T16:54:52.308350] [INFO ] [MAIN ] ATUS: Loaded 22455 existing records. [2025-09-14T16:54:52.486890] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:52.487274] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-14T16:54:52.487415] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-14T16:54:52.488201] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-14T16:54:52.488286] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-14T16:54:52.567455] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-14T16:54:52.653221] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T16:54:52.907910] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:52.921552] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T16:54:53.358829] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-14T16:54:54.163942] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-14T16:54:54.176583] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T16:54:54.420035] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T16:54:54.958864] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-14T16:54:55.586475] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:54:55.592123] [INFO ] [REMOTE ] ATO: Full fetch complete (45733 records). [2025-09-14T16:54:55.592336] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-14T16:54:55.771851] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-14T16:54:56.020048] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-14T16:54:56.021282] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-14T16:54:56.021132] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T16:54:56.022059] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-14T16:54:56.022222] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-14T16:54:56.033494] [DEBUG] [LOCAL ] ATO: Trimmed 45733 records to 31430 (keeping 150 days of data) [2025-09-14T16:54:56.242009] [DEBUG] [LOCAL ] ATO: Primary data saved (31430 records). [2025-09-14T16:54:56.242184] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-14T16:54:56.242282] [INFO ] [MAIN ] Update Progress: 174/2370 symbols completed. ATO took 26.7s. Estimated remaining: 3h 43m 55s. Rate: 9.8 symbols/min [2025-09-14T16:54:56.412878] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:56.434565] [DEBUG] [LOCAL ] AU: Loaded 23633 existing records from primary storage. [2025-09-14T16:54:56.434745] [INFO ] [MAIN ] AU: Loaded 23633 existing records. [2025-09-14T16:54:56.563922] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-14T16:54:56.614456] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:56.614781] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-14T16:54:56.614886] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-14T16:54:56.615639] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-14T16:54:56.615735] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-14T16:54:56.874680] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T16:54:56.993154] [INFO ] [REMOTE ] AU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:57.358914] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-14T16:54:58.032964] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T16:54:58.049047] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T16:54:58.158822] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-14T16:54:58.958831] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-14T16:54:59.510103] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T16:54:59.758829] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-14T16:55:00.501751] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T16:55:00.558778] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-14T16:55:00.873794] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:55:01.358817] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-14T16:55:02.158833] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-14T16:55:02.228525] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T16:55:02.635533] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T16:55:02.958816] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-14T16:55:03.194597] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T16:55:03.758823] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-14T16:55:04.370364] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:55:04.374391] [INFO ] [REMOTE ] ATR: Full fetch complete (33538 records). [2025-09-14T16:55:04.374762] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-14T16:55:04.519105] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T16:55:04.574303] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-14T16:55:04.811594] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-14T16:55:04.811733] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-14T16:55:04.812267] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-14T16:55:04.812346] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-14T16:55:04.813236] [DEBUG] [LOCAL ] ATR: Trimmed 33538 records to 23237 (keeping 150 days of data) [2025-09-14T16:55:04.958973] [DEBUG] [LOCAL ] ATR: Primary data saved (23237 records). [2025-09-14T16:55:04.959163] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-14T16:55:04.959290] [INFO ] [MAIN ] Update Progress: 175/2370 symbols completed. ATR took 21.8s. Estimated remaining: 3h 44m 22s. Rate: 9.8 symbols/min [2025-09-14T16:55:05.131114] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:05.150883] [DEBUG] [LOCAL ] AUB: Loaded 20131 existing records from primary storage. [2025-09-14T16:55:05.151066] [INFO ] [MAIN ] AUB: Loaded 20131 existing records. [2025-09-14T16:55:05.335776] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:05.336105] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-14T16:55:05.336433] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-14T16:55:05.337117] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-14T16:55:05.337190] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-14T16:55:05.370589] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-14T16:55:05.704145] [INFO ] [REMOTE ] AUB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:06.107264] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T16:55:06.109763] [INFO ] [REMOTE ] ATS: Full fetch complete (19626 records). [2025-09-14T16:55:06.109879] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-14T16:55:06.165110] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-14T16:55:06.493557] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T16:55:06.552003] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-14T16:55:06.552279] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-14T16:55:06.552736] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-14T16:55:06.552809] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-14T16:55:06.554123] [DEBUG] [LOCAL ] ATS: Trimmed 19626 records to 13232 (keeping 150 days of data) [2025-09-14T16:55:06.638996] [DEBUG] [LOCAL ] ATS: Primary data saved (13232 records). [2025-09-14T16:55:06.639255] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-14T16:55:06.639381] [INFO ] [MAIN ] Update Progress: 176/2370 symbols completed. ATS took 20.8s. Estimated remaining: 3h 43m 20s. Rate: 9.8 symbols/min [2025-09-14T16:55:06.823828] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:06.828382] [DEBUG] [LOCAL ] AUNA: Loaded 2339 existing records from primary storage. [2025-09-14T16:55:06.828488] [INFO ] [MAIN ] AUNA: Loaded 2339 existing records. [2025-09-14T16:55:06.964039] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-14T16:55:07.024786] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:07.025127] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-14T16:55:07.025221] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-14T16:55:07.025573] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-14T16:55:07.025667] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-14T16:55:07.399626] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:07.556298] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T16:55:07.758840] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-14T16:55:08.375251] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T16:55:08.558852] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-14T16:55:08.704997] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T16:55:08.958231] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T16:55:09.358833] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-14T16:55:10.158841] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-14T16:55:10.838799] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T16:55:10.958852] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-14T16:55:11.742409] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T16:55:11.758779] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-14T16:55:12.527132] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T16:55:12.558787] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-14T16:55:13.358821] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-14T16:55:13.485956] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T16:55:13.993824] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T16:55:14.158830] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-14T16:55:14.196731] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T16:55:14.958860] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-14T16:55:15.376000] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T16:55:15.404781] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T16:55:15.758884] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-14T16:55:16.558887] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-14T16:55:16.934005] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T16:55:16.939427] [INFO ] [REMOTE ] ATUS: Full fetch complete (53523 records). [2025-09-14T16:55:16.939628] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-14T16:55:17.327695] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-14T16:55:17.327881] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-14T16:55:17.328514] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-14T16:55:17.328582] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-14T16:55:17.329955] [DEBUG] [LOCAL ] ATUS: Trimmed 53523 records to 37778 (keeping 150 days of data) [2025-09-14T16:55:17.378072] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-14T16:55:17.550088] [DEBUG] [LOCAL ] ATUS: Primary data saved (37778 records). [2025-09-14T16:55:17.550289] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-14T16:55:17.550394] [INFO ] [MAIN ] Update Progress: 177/2370 symbols completed. ATUS took 25.5s. Estimated remaining: 3h 44m 14s. Rate: 9.8 symbols/min [2025-09-14T16:55:17.720865] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:17.739012] [DEBUG] [LOCAL ] AVA: Loaded 17440 existing records from primary storage. [2025-09-14T16:55:17.739195] [INFO ] [MAIN ] AVA: Loaded 17440 existing records. [2025-09-14T16:55:17.934848] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:17.935495] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-14T16:55:17.935699] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-14T16:55:17.936410] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-14T16:55:17.936478] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-14T16:55:18.165833] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-14T16:55:18.206970] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:55:18.286784] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T16:55:18.365338] [INFO ] [REMOTE ] AVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:18.958821] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-14T16:55:19.645596] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T16:55:19.758831] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-14T16:55:20.497608] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T16:55:20.499815] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T16:55:20.558876] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-14T16:55:21.358870] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-14T16:55:21.594709] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T16:55:22.158842] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-14T16:55:22.958801] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-14T16:55:23.034825] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T16:55:23.758825] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-14T16:55:24.134533] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T16:55:24.459998] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T16:55:24.558810] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-14T16:55:24.948275] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T16:55:25.358888] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-14T16:55:26.091582] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T16:55:26.158839] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-14T16:55:26.552977] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T16:55:26.557752] [INFO ] [REMOTE ] AUB: Full fetch complete (50171 records). [2025-09-14T16:55:26.557920] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-14T16:55:26.936367] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-14T16:55:26.936489] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-14T16:55:26.937105] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-14T16:55:26.937170] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-14T16:55:26.938473] [DEBUG] [LOCAL ] AUB: Trimmed 50171 records to 34357 (keeping 150 days of data) [2025-09-14T16:55:26.995782] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-14T16:55:27.171106] [DEBUG] [LOCAL ] AUB: Primary data saved (34357 records). [2025-09-14T16:55:27.171296] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-14T16:55:27.171416] [INFO ] [MAIN ] Update Progress: 178/2370 symbols completed. AUB took 22.2s. Estimated remaining: 3h 44m 50s. Rate: 9.7 symbols/min [2025-09-14T16:55:27.350789] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:27.356833] [DEBUG] [LOCAL ] AVAL: Loaded 3607 existing records from primary storage. [2025-09-14T16:55:27.356939] [INFO ] [MAIN ] AVAL: Loaded 3607 existing records. [2025-09-14T16:55:27.535744] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T16:55:27.557535] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:27.560002] [INFO ] [REMOTE ] AUNA: Full fetch complete (5184 records). [2025-09-14T16:55:27.560382] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-14T16:55:27.560858] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-14T16:55:27.597611] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-14T16:55:27.632569] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-14T16:55:27.656066] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-14T16:55:27.785519] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-14T16:55:27.884126] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-14T16:55:28.310207] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-14T16:55:28.325802] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-14T16:55:28.351206] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-14T16:55:28.377065] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-14T16:55:28.383227] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:28.384539] [DEBUG] [LOCAL ] AUNA: Trimmed 5184 records to 3632 (keeping 150 days of data) [2025-09-14T16:55:28.405811] [DEBUG] [LOCAL ] AUNA: Primary data saved (3632 records). [2025-09-14T16:55:28.405924] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-14T16:55:28.406049] [INFO ] [MAIN ] Update Progress: 179/2370 symbols completed. AUNA took 21.8s. Estimated remaining: 3h 43m 44s. Rate: 9.8 symbols/min [2025-09-14T16:55:28.571707] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-14T16:55:28.574500] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:28.596690] [DEBUG] [LOCAL ] AVB: Loaded 18835 existing records from primary storage. [2025-09-14T16:55:28.596901] [INFO ] [MAIN ] AVB: Loaded 18835 existing records. [2025-09-14T16:55:28.776824] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:28.777098] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-14T16:55:28.777162] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-14T16:55:28.777855] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-14T16:55:28.777919] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-14T16:55:29.139298] [INFO ] [REMOTE ] AVB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:29.164082] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T16:55:29.358830] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-14T16:55:30.158870] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-14T16:55:30.249203] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T16:55:30.781283] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T16:55:30.958834] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-14T16:55:31.617897] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T16:55:31.758892] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-14T16:55:32.453052] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T16:55:32.558955] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-14T16:55:32.782242] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T16:55:33.358920] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-14T16:55:34.158870] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-14T16:55:34.662611] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T16:55:34.958843] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-14T16:55:35.054261] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T16:55:35.169886] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T16:55:35.758827] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-14T16:55:36.452536] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T16:55:36.458513] [INFO ] [REMOTE ] AU: Full fetch complete (57426 records). [2025-09-14T16:55:36.458780] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-14T16:55:36.566265] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-14T16:55:36.888567] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-14T16:55:36.888770] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-14T16:55:36.889618] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-14T16:55:36.889707] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-14T16:55:36.891669] [DEBUG] [LOCAL ] AU: Trimmed 57426 records to 39866 (keeping 150 days of data) [2025-09-14T16:55:37.163494] [DEBUG] [LOCAL ] AU: Primary data saved (39866 records). [2025-09-14T16:55:37.163752] [INFO ] [MAIN ] AU: Full history saved. [2025-09-14T16:55:37.163891] [INFO ] [MAIN ] Update Progress: 180/2370 symbols completed. AU took 40.9s. Estimated remaining: 3h 44m 10s. Rate: 9.8 symbols/min [2025-09-14T16:55:37.352202] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:37.365703] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-14T16:55:37.368997] [DEBUG] [LOCAL ] AVBC: Loaded 3893 existing records from primary storage. [2025-09-14T16:55:37.384687] [INFO ] [MAIN ] AVBC: Loaded 3893 existing records. [2025-09-14T16:55:37.386597] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T16:55:37.584099] [WARN ] [MAIN ] AVBC: Insufficient historical data. Have data from 2025-08-01, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:37.584450] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-14T16:55:37.584539] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-14T16:55:37.584890] [DEBUG] [LOCAL ] AVBC: Deleted primary data file. [2025-09-14T16:55:37.584971] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-14T16:55:37.964852] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:37.992715] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T16:55:38.158838] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-14T16:55:38.402293] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:55:38.768582] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:55:38.772672] [INFO ] [REMOTE ] AVA: Full fetch complete (42826 records). [2025-09-14T16:55:38.772776] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-14T16:55:38.963960] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-14T16:55:39.163505] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-14T16:55:39.163618] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-14T16:55:39.164222] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-14T16:55:39.164283] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-14T16:55:39.165529] [DEBUG] [LOCAL ] AVA: Trimmed 42826 records to 29173 (keeping 150 days of data) [2025-09-14T16:55:39.347317] [DEBUG] [LOCAL ] AVA: Primary data saved (29173 records). [2025-09-14T16:55:39.347493] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-14T16:55:39.347595] [INFO ] [MAIN ] Update Progress: 181/2370 symbols completed. AVA took 21.8s. Estimated remaining: 3h 43m 16s. Rate: 9.8 symbols/min [2025-09-14T16:55:39.515246] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:39.526021] [DEBUG] [LOCAL ] AVD: Loaded 10298 existing records from primary storage. [2025-09-14T16:55:39.526165] [INFO ] [MAIN ] AVD: Loaded 10298 existing records. [2025-09-14T16:55:39.705252] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:39.705658] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-14T16:55:39.705726] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-14T16:55:39.706079] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-14T16:55:39.706138] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-14T16:55:39.767320] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-14T16:55:40.078081] [INFO ] [REMOTE ] AVD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:40.080336] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T16:55:40.110905] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:40.111342] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-14T16:55:40.558849] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-14T16:55:41.358856] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-14T16:55:41.490170] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T16:55:42.158834] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-14T16:55:42.431169] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:42.433922] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-14T16:55:42.433837] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T16:55:42.958831] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-14T16:55:43.758861] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-14T16:55:44.287224] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T16:55:44.528010] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T16:55:44.558801] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-14T16:55:45.156320] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T16:55:45.358840] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-14T16:55:45.615808] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:45.616183] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-14T16:55:46.158902] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-14T16:55:46.958865] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-14T16:55:47.710237] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T16:55:47.758820] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-14T16:55:47.876233] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T16:55:48.366864] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:55:48.368098] [INFO ] [REMOTE ] AVAL: Full fetch complete (11046 records). [2025-09-14T16:55:48.368183] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-14T16:55:48.586021] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-14T16:55:48.771765] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-14T16:55:48.771871] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-14T16:55:48.772119] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-14T16:55:48.772178] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-14T16:55:48.772672] [DEBUG] [LOCAL ] AVAL: Trimmed 11046 records to 6001 (keeping 150 days of data) [2025-09-14T16:55:48.813102] [DEBUG] [LOCAL ] AVAL: Primary data saved (6001 records). [2025-09-14T16:55:48.813413] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-14T16:55:48.813560] [INFO ] [MAIN ] Update Progress: 182/2370 symbols completed. AVAL took 21.6s. Estimated remaining: 3h 43m 50s. Rate: 9.8 symbols/min [2025-09-14T16:55:48.988105] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:48.991802] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:48.992407] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-14T16:55:49.005952] [DEBUG] [LOCAL ] AVK: Loaded 8724 existing records from primary storage. [2025-09-14T16:55:49.006170] [INFO ] [MAIN ] AVK: Loaded 8724 existing records. [2025-09-14T16:55:49.201245] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:49.201613] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-14T16:55:49.201702] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-14T16:55:49.202171] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-14T16:55:49.202239] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-14T16:55:49.369370] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-14T16:55:49.583979] [INFO ] [REMOTE ] AVK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:50.158838] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-14T16:55:50.432538] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:50.432916] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-14T16:55:50.651242] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T16:55:50.958832] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-14T16:55:51.227175] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:51.227504] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-14T16:55:51.758895] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-14T16:55:52.558830] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-14T16:55:52.826110] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T16:55:53.358912] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-14T16:55:53.828621] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T16:55:54.033389] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T16:55:54.158835] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-14T16:55:54.958863] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-14T16:55:55.288257] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T16:55:55.758869] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-14T16:55:56.558842] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-14T16:55:56.589631] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T16:55:56.841145] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:55:57.358829] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-14T16:55:57.373415] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T16:55:57.375203] [INFO ] [REMOTE ] AVBC: Full fetch complete (3893 records). [2025-09-14T16:55:57.375310] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-14T16:55:57.555122] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 30 unique days, need 150 days [2025-09-14T16:55:57.555348] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:55:57.555404] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:55:57.555463] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-14T16:55:57.555545] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-14T16:55:57.555625] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-14T16:55:57.555726] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-14T16:55:57.555842] [INFO ] [MAIN ] Update Progress: 183/2370 symbols completed. AVBC took 20.4s. Estimated remaining: 3h 44m 15s. Rate: 9.8 symbols/min [2025-09-14T16:55:57.726370] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:57.742830] [DEBUG] [LOCAL ] AVNS: Loaded 15455 existing records from primary storage. [2025-09-14T16:55:57.742991] [INFO ] [MAIN ] AVNS: Loaded 15455 existing records. [2025-09-14T16:55:57.920937] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:57.921401] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-14T16:55:57.926624] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-14T16:55:57.932404] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T16:55:57.936319] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-14T16:55:57.936769] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-14T16:55:57.979520] [INFO ] [REMOTE ] AVB: Full fetch complete (44630 records). [2025-09-14T16:55:58.011445] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-14T16:55:58.178072] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-14T16:55:58.584531] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:58.670839] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-14T16:55:58.670941] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-14T16:55:58.671432] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-14T16:55:58.671493] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-14T16:55:58.672493] [DEBUG] [LOCAL ] AVB: Trimmed 44630 records to 31412 (keeping 150 days of data) [2025-09-14T16:55:58.871119] [DEBUG] [LOCAL ] AVB: Primary data saved (31412 records). [2025-09-14T16:55:58.871316] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-14T16:55:58.871425] [INFO ] [MAIN ] Update Progress: 184/2370 symbols completed. AVB took 30.5s. Estimated remaining: 3h 43m 11s. Rate: 9.8 symbols/min [2025-09-14T16:55:58.968147] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-14T16:55:59.046144] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:59.066407] [DEBUG] [LOCAL ] AVNT: Loaded 17850 existing records from primary storage. [2025-09-14T16:55:59.066587] [INFO ] [MAIN ] AVNT: Loaded 17850 existing records. [2025-09-14T16:55:59.239176] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:59.239432] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-14T16:55:59.239574] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-14T16:55:59.240098] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-14T16:55:59.240160] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-14T16:55:59.555900] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T16:55:59.633946] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:59.758851] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-14T16:56:00.210349] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T16:56:00.558840] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-14T16:56:01.186530] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T16:56:01.360168] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-14T16:56:01.361667] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T16:56:02.158837] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-14T16:56:02.665163] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T16:56:02.865889] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T16:56:02.869673] [INFO ] [REMOTE ] AVD: Full fetch complete (24780 records). [2025-09-14T16:56:02.869834] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-14T16:56:02.964049] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-14T16:56:03.269730] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-14T16:56:03.269847] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-14T16:56:03.270259] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-14T16:56:03.270315] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-14T16:56:03.271044] [DEBUG] [LOCAL ] AVD: Trimmed 24780 records to 16581 (keeping 150 days of data) [2025-09-14T16:56:03.364091] [DEBUG] [LOCAL ] AVD: Primary data saved (16581 records). [2025-09-14T16:56:03.364264] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-14T16:56:03.364371] [INFO ] [MAIN ] Update Progress: 185/2370 symbols completed. AVD took 24.0s. Estimated remaining: 3h 42m 46s. Rate: 9.8 symbols/min [2025-09-14T16:56:03.530829] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:03.554329] [DEBUG] [LOCAL ] AVTR: Loaded 23979 existing records from primary storage. [2025-09-14T16:56:03.554486] [INFO ] [MAIN ] AVTR: Loaded 23979 existing records. [2025-09-14T16:56:03.727128] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:03.727363] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-14T16:56:03.727420] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-14T16:56:03.728180] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-14T16:56:03.728244] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-14T16:56:03.763995] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-14T16:56:04.077564] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:04.323460] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:56:04.558881] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-14T16:56:05.364597] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-14T16:56:05.369030] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T16:56:06.158852] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-14T16:56:06.301729] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T16:56:06.465243] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T16:56:06.958887] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-14T16:56:07.738204] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T16:56:07.758796] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-14T16:56:08.068060] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:56:08.558858] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-14T16:56:09.068615] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T16:56:09.358823] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-14T16:56:10.158886] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-14T16:56:10.395121] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T16:56:10.433279] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T16:56:10.958843] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-14T16:56:11.231300] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T16:56:11.758830] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-14T16:56:11.980613] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T16:56:12.558843] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-14T16:56:13.358790] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-14T16:56:13.522206] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T16:56:13.633249] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T16:56:14.158872] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-14T16:56:14.435240] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T16:56:14.869194] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T16:56:14.958826] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-14T16:56:15.758825] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-14T16:56:15.943203] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T16:56:15.945773] [INFO ] [REMOTE ] AVK: Full fetch complete (19674 records). [2025-09-14T16:56:15.945889] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-14T16:56:16.354877] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-14T16:56:16.355005] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-14T16:56:16.355366] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-14T16:56:16.355437] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-14T16:56:16.356134] [DEBUG] [LOCAL ] AVK: Trimmed 19674 records to 13507 (keeping 150 days of data) [2025-09-14T16:56:16.450738] [DEBUG] [LOCAL ] AVK: Primary data saved (13507 records). [2025-09-14T16:56:16.450955] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-14T16:56:16.451074] [INFO ] [MAIN ] Update Progress: 186/2370 symbols completed. AVK took 27.6s. Estimated remaining: 3h 44m 2s. Rate: 9.7 symbols/min [2025-09-14T16:56:16.563996] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-14T16:56:16.628576] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:16.647513] [DEBUG] [LOCAL ] AVY: Loaded 15831 existing records from primary storage. [2025-09-14T16:56:16.647704] [INFO ] [MAIN ] AVY: Loaded 15831 existing records. [2025-09-14T16:56:16.831615] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:16.831998] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-14T16:56:16.832063] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-14T16:56:16.832544] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-14T16:56:16.832618] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-14T16:56:17.204425] [INFO ] [REMOTE ] AVY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:17.228205] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:56:17.358867] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-14T16:56:18.158853] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-14T16:56:18.380437] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T16:56:18.831553] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T16:56:18.958854] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-14T16:56:19.646173] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T16:56:19.758839] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-14T16:56:20.363984] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:56:20.367787] [INFO ] [REMOTE ] AVNS: Full fetch complete (36259 records). [2025-09-14T16:56:20.367894] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-14T16:56:20.569669] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-14T16:56:20.765871] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-14T16:56:20.766066] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-14T16:56:20.766718] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-14T16:56:20.766898] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-14T16:56:20.789757] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T16:56:20.789946] [DEBUG] [LOCAL ] AVNS: Trimmed 36259 records to 25223 (keeping 150 days of data) [2025-09-14T16:56:20.951042] [DEBUG] [LOCAL ] AVNS: Primary data saved (25223 records). [2025-09-14T16:56:20.951238] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-14T16:56:20.951356] [INFO ] [MAIN ] Update Progress: 187/2370 symbols completed. AVNS took 23.4s. Estimated remaining: 3h 43m 36s. Rate: 9.8 symbols/min [2025-09-14T16:56:21.140357] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:21.154404] [DEBUG] [LOCAL ] AWF: Loaded 10476 existing records from primary storage. [2025-09-14T16:56:21.154582] [INFO ] [MAIN ] AWF: Loaded 10476 existing records. [2025-09-14T16:56:21.362767] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-14T16:56:21.367073] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:21.368191] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-14T16:56:21.368251] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-14T16:56:21.368625] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-14T16:56:21.368710] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-14T16:56:21.725590] [INFO ] [REMOTE ] AWF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:22.158847] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-14T16:56:22.280266] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T16:56:22.958874] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-14T16:56:23.157299] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T16:56:23.207043] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T16:56:23.758845] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-14T16:56:24.558868] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-14T16:56:24.591087] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T16:56:24.873701] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T16:56:25.358901] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-14T16:56:25.693898] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T16:56:25.702304] [INFO ] [REMOTE ] AVNT: Full fetch complete (43041 records). [2025-09-14T16:56:25.702590] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-14T16:56:26.163969] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-14T16:56:26.244876] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-14T16:56:26.245007] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-14T16:56:26.246024] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-14T16:56:26.246089] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-14T16:56:26.247271] [DEBUG] [LOCAL ] AVNT: Trimmed 43041 records to 29154 (keeping 150 days of data) [2025-09-14T16:56:26.459845] [DEBUG] [LOCAL ] AVNT: Primary data saved (29154 records). [2025-09-14T16:56:26.461471] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T16:56:26.461694] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-14T16:56:26.471343] [INFO ] [MAIN ] Update Progress: 188/2370 symbols completed. AVNT took 27.6s. Estimated remaining: 3h 43m 23s. Rate: 9.8 symbols/min [2025-09-14T16:56:26.675130] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:26.689700] [DEBUG] [LOCAL ] AWI: Loaded 12079 existing records from primary storage. [2025-09-14T16:56:26.689886] [INFO ] [MAIN ] AWI: Loaded 12079 existing records. [2025-09-14T16:56:26.875660] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:26.875950] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-14T16:56:26.876013] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-14T16:56:26.876517] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-14T16:56:26.876617] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-14T16:56:26.964137] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-14T16:56:27.244239] [INFO ] [REMOTE ] AWI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:27.436864] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T16:56:27.758856] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-14T16:56:28.508101] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T16:56:28.558802] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-14T16:56:28.789140] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T16:56:29.358848] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-14T16:56:30.158840] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-14T16:56:30.349985] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T16:56:30.373795] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T16:56:30.958845] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-14T16:56:31.391042] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T16:56:31.758873] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-14T16:56:32.558828] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-14T16:56:32.829979] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T16:56:32.872541] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T16:56:33.358841] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-14T16:56:33.566794] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T16:56:34.158844] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-14T16:56:34.306612] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T16:56:34.958840] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-14T16:56:35.086126] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T16:56:35.758837] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-14T16:56:36.321300] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T16:56:36.558832] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-14T16:56:37.260777] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T16:56:37.358826] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-14T16:56:38.158845] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-14T16:56:38.399368] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T16:56:38.412207] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T16:56:38.415579] [INFO ] [REMOTE ] AWF: Full fetch complete (26601 records). [2025-09-14T16:56:38.416082] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-14T16:56:38.786608] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-14T16:56:38.786742] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-14T16:56:38.787149] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-14T16:56:38.787219] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-14T16:56:38.788006] [DEBUG] [LOCAL ] AWF: Trimmed 26601 records to 17314 (keeping 150 days of data) [2025-09-14T16:56:38.899464] [DEBUG] [LOCAL ] AWF: Primary data saved (17314 records). [2025-09-14T16:56:38.899667] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-14T16:56:38.899797] [INFO ] [MAIN ] Update Progress: 189/2370 symbols completed. AWF took 17.9s. Estimated remaining: 3h 44m 29s. Rate: 9.7 symbols/min [2025-09-14T16:56:38.963298] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-14T16:56:39.077222] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:39.097103] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T16:56:39.131496] [DEBUG] [LOCAL ] AWK: Loaded 21679 existing records from primary storage. [2025-09-14T16:56:39.131806] [INFO ] [MAIN ] AWK: Loaded 21679 existing records. [2025-09-14T16:56:39.306165] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:39.306499] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-14T16:56:39.306587] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-14T16:56:39.307841] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-14T16:56:39.307905] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-14T16:56:39.658873] [INFO ] [REMOTE ] AWK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:39.758800] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-14T16:56:40.194919] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T16:56:40.558864] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-14T16:56:41.185083] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:56:41.188983] [INFO ] [REMOTE ] AVY: Full fetch complete (41208 records). [2025-09-14T16:56:41.189121] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-14T16:56:41.364873] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-14T16:56:41.580171] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-14T16:56:41.580356] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-14T16:56:41.580896] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-14T16:56:41.581091] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-14T16:56:41.582786] [DEBUG] [LOCAL ] AVY: Trimmed 41208 records to 27556 (keeping 150 days of data) [2025-09-14T16:56:41.682136] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T16:56:41.823157] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T16:56:41.830894] [INFO ] [REMOTE ] AVTR: Full fetch complete (58235 records). [2025-09-14T16:56:41.832147] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-14T16:56:42.001622] [DEBUG] [LOCAL ] AVY: Primary data saved (27556 records). [2025-09-14T16:56:42.041277] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-14T16:56:42.083297] [INFO ] [MAIN ] Update Progress: 190/2370 symbols completed. AVY took 25.6s. Estimated remaining: 3h 43m 49s. Rate: 9.7 symbols/min [2025-09-14T16:56:42.162798] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-14T16:56:42.399589] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:42.399766] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-14T16:56:42.399932] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-14T16:56:42.400817] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-14T16:56:42.401036] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-14T16:56:42.402926] [DEBUG] [LOCAL ] AVTR: Trimmed 58235 records to 40334 (keeping 150 days of data) [2025-09-14T16:56:42.465177] [DEBUG] [LOCAL ] AWP: Loaded 11198 existing records from primary storage. [2025-09-14T16:56:42.465426] [INFO ] [MAIN ] AWP: Loaded 11198 existing records. [2025-09-14T16:56:42.698804] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:42.700581] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-14T16:56:42.701168] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-14T16:56:42.702550] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-14T16:56:42.703205] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-14T16:56:42.959136] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-14T16:56:43.070387] [INFO ] [REMOTE ] AWP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:43.207223] [DEBUG] [LOCAL ] AVTR: Primary data saved (40334 records). [2025-09-14T16:56:43.207419] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-14T16:56:43.207555] [INFO ] [MAIN ] Update Progress: 191/2370 symbols completed. AVTR took 39.8s. Estimated remaining: 3h 42m 45s. Rate: 9.8 symbols/min [2025-09-14T16:56:43.374871] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:43.386038] [DEBUG] [LOCAL ] AWR: Loaded 10174 existing records from primary storage. [2025-09-14T16:56:43.386203] [INFO ] [MAIN ] AWR: Loaded 10174 existing records. [2025-09-14T16:56:43.571250] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:43.571593] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-14T16:56:43.571679] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-14T16:56:43.572429] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-14T16:56:43.572745] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-14T16:56:43.782412] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-14T16:56:43.931735] [INFO ] [REMOTE ] AWR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:44.101350] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T16:56:44.217068] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T16:56:44.558840] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-14T16:56:44.898310] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T16:56:45.358880] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-14T16:56:46.158825] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-14T16:56:46.249532] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T16:56:46.321481] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T16:56:46.958854] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-14T16:56:47.504003] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T16:56:47.758805] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-14T16:56:48.068141] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T16:56:48.558851] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-14T16:56:48.981003] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T16:56:49.358796] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-14T16:56:49.627122] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T16:56:50.158828] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-14T16:56:50.958801] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-14T16:56:51.243276] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T16:56:51.491701] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T16:56:51.758872] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-14T16:56:51.772214] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T16:56:52.558822] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-14T16:56:52.878222] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T16:56:53.358817] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-14T16:56:53.618435] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T16:56:54.158835] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-14T16:56:54.542500] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T16:56:54.691770] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T16:56:54.694781] [INFO ] [REMOTE ] AWI: Full fetch complete (28505 records). [2025-09-14T16:56:54.694873] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-14T16:56:54.964030] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-14T16:56:55.070712] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-14T16:56:55.070857] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-14T16:56:55.071617] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-14T16:56:55.071701] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-14T16:56:55.072733] [DEBUG] [LOCAL ] AWI: Trimmed 28505 records to 19432 (keeping 150 days of data) [2025-09-14T16:56:55.208327] [DEBUG] [LOCAL ] AWI: Primary data saved (19432 records). [2025-09-14T16:56:55.208607] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-14T16:56:55.208793] [INFO ] [MAIN ] Update Progress: 192/2370 symbols completed. AWI took 28.7s. Estimated remaining: 3h 43m 46s. Rate: 9.7 symbols/min [2025-09-14T16:56:55.383897] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:55.399014] [DEBUG] [LOCAL ] AX: Loaded 12263 existing records from primary storage. [2025-09-14T16:56:55.399252] [INFO ] [MAIN ] AX: Loaded 12263 existing records. [2025-09-14T16:56:55.586493] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:55.586893] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-14T16:56:55.586997] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-14T16:56:55.587921] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-14T16:56:55.587996] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-14T16:56:55.766807] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-14T16:56:55.957789] [INFO ] [REMOTE ] AX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:56.558877] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-14T16:56:56.782697] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T16:56:56.895776] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T16:56:57.358813] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-14T16:56:57.455555] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T16:56:58.158831] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-14T16:56:58.428751] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T16:56:58.958834] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-14T16:56:59.623478] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T16:56:59.758816] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-14T16:57:00.010257] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T16:57:00.558827] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-14T16:57:01.358849] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-14T16:57:01.800621] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T16:57:01.830949] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T16:57:02.007074] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:57:02.011175] [INFO ] [REMOTE ] AWP: Full fetch complete (23837 records). [2025-09-14T16:57:02.011462] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-14T16:57:02.164008] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-14T16:57:02.415813] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-14T16:57:02.415977] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-14T16:57:02.416485] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-14T16:57:02.416549] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-14T16:57:02.417820] [DEBUG] [LOCAL ] AWP: Trimmed 23837 records to 16752 (keeping 150 days of data) [2025-09-14T16:57:02.523885] [DEBUG] [LOCAL ] AWP: Primary data saved (16752 records). [2025-09-14T16:57:02.524201] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-14T16:57:02.524373] [INFO ] [MAIN ] Update Progress: 193/2370 symbols completed. AWP took 20.4s. Estimated remaining: 3h 43m 52s. Rate: 9.7 symbols/min [2025-09-14T16:57:02.700612] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:02.723695] [DEBUG] [LOCAL ] AXL: Loaded 22482 existing records from primary storage. [2025-09-14T16:57:02.723908] [INFO ] [MAIN ] AXL: Loaded 22482 existing records. [2025-09-14T16:57:02.900241] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:02.900494] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-14T16:57:02.900555] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-14T16:57:02.901171] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-14T16:57:02.901236] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-14T16:57:02.963914] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-14T16:57:03.259187] [INFO ] [REMOTE ] AXL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:03.316338] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T16:57:03.630818] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T16:57:03.635870] [INFO ] [REMOTE ] AWK: Full fetch complete (53215 records). [2025-09-14T16:57:03.636000] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-14T16:57:03.763917] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-14T16:57:04.015660] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-14T16:57:04.015771] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-14T16:57:04.016369] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-14T16:57:04.016425] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-14T16:57:04.017605] [DEBUG] [LOCAL ] AWK: Trimmed 53215 records to 36312 (keeping 150 days of data) [2025-09-14T16:57:04.240094] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T16:57:04.246013] [INFO ] [REMOTE ] AWR: Full fetch complete (24158 records). [2025-09-14T16:57:04.248725] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-14T16:57:04.563973] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-14T16:57:04.635263] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-14T16:57:04.638273] [DEBUG] [LOCAL ] AWK: Primary data saved (36312 records). [2025-09-14T16:57:04.638315] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-14T16:57:04.639076] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-14T16:57:04.639509] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-14T16:57:04.639606] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-14T16:57:04.639723] [INFO ] [MAIN ] Update Progress: 194/2370 symbols completed. AWK took 25.7s. Estimated remaining: 3h 43m 1s. Rate: 9.8 symbols/min [2025-09-14T16:57:04.737883] [DEBUG] [LOCAL ] AWR: Trimmed 24158 records to 16385 (keeping 150 days of data) [2025-09-14T16:57:04.886927] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:04.916320] [DEBUG] [LOCAL ] AXP: Loaded 23889 existing records from primary storage. [2025-09-14T16:57:04.917538] [INFO ] [MAIN ] AXP: Loaded 23889 existing records. [2025-09-14T16:57:05.108477] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:05.109946] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-14T16:57:05.110659] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-14T16:57:05.112720] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-14T16:57:05.113277] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-14T16:57:05.214223] [DEBUG] [LOCAL ] AWR: Primary data saved (16385 records). [2025-09-14T16:57:05.216485] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-14T16:57:05.237866] [INFO ] [MAIN ] Update Progress: 195/2370 symbols completed. AWR took 22.0s. Estimated remaining: 3h 41m 53s. Rate: 9.8 symbols/min [2025-09-14T16:57:05.360803] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-14T16:57:05.620832] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:05.654881] [INFO ] [REMOTE ] AXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:05.658559] [DEBUG] [LOCAL ] AXR: Loaded 1389 existing records from primary storage. [2025-09-14T16:57:05.658669] [INFO ] [MAIN ] AXR: Loaded 1389 existing records. [2025-09-14T16:57:05.859003] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:05.859292] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-14T16:57:05.859358] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-14T16:57:05.859605] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-14T16:57:05.859692] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-14T16:57:06.164042] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-14T16:57:06.259685] [INFO ] [REMOTE ] AXR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:06.290842] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T16:57:06.871039] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T16:57:06.958871] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-14T16:57:07.758801] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-14T16:57:08.194259] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T16:57:08.231328] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T16:57:08.326225] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T16:57:08.558859] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-14T16:57:08.975939] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T16:57:09.358886] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-14T16:57:09.989674] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T16:57:10.158897] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-14T16:57:10.958863] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-14T16:57:11.758840] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-14T16:57:12.136408] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-14T16:57:12.228076] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T16:57:12.299424] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T16:57:12.558828] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-14T16:57:13.282456] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T16:57:13.358924] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-14T16:57:14.158896] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-14T16:57:14.958950] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-14T16:57:15.138371] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T16:57:15.758849] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-14T16:57:15.879913] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T16:57:16.541463] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-14T16:57:16.560006] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-14T16:57:16.560094] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-14T16:57:17.110324] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-14T16:57:17.358916] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-14T16:57:18.158914] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-14T16:57:18.678581] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T16:57:18.958951] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-14T16:57:19.758895] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-14T16:57:20.239414] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T16:57:20.354007] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T16:57:20.558830] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-14T16:57:20.897330] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T16:57:21.358815] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-14T16:57:22.158827] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-14T16:57:22.553218] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T16:57:22.554891] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T16:57:22.566374] [INFO ] [REMOTE ] AXR: Full fetch complete (3328 records). [2025-09-14T16:57:22.566729] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-14T16:57:22.955894] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T16:57:22.956135] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-14T16:57:22.962037] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-14T16:57:22.962170] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-14T16:57:22.963959] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-14T16:57:22.964561] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-14T16:57:22.965146] [DEBUG] [LOCAL ] AXR: Trimmed 3328 records to 2176 (keeping 150 days of data) [2025-09-14T16:57:22.978615] [DEBUG] [LOCAL ] AXR: Primary data saved (2176 records). [2025-09-14T16:57:22.978722] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-14T16:57:22.978835] [INFO ] [MAIN ] Update Progress: 196/2370 symbols completed. AXR took 17.7s. Estimated remaining: 3h 43m 55s. Rate: 9.7 symbols/min [2025-09-14T16:57:23.150349] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:23.167794] [DEBUG] [LOCAL ] AXS: Loaded 17155 existing records from primary storage. [2025-09-14T16:57:23.167957] [INFO ] [MAIN ] AXS: Loaded 17155 existing records. [2025-09-14T16:57:23.343355] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:23.343783] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-14T16:57:23.344052] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-14T16:57:23.344682] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-14T16:57:23.344748] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-14T16:57:23.698933] [INFO ] [REMOTE ] AXS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:23.758824] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-14T16:57:24.493134] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T16:57:24.558830] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-14T16:57:25.358868] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-14T16:57:26.003089] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-14T16:57:26.158815] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-14T16:57:26.385927] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T16:57:26.843860] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T16:57:26.958822] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-14T16:57:27.758840] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-14T16:57:28.277930] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-14T16:57:28.449970] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T16:57:28.558849] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-14T16:57:29.081000] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T16:57:29.358814] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-14T16:57:30.002419] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:57:30.008043] [INFO ] [REMOTE ] AXP: Full fetch complete (57853 records). [2025-09-14T16:57:30.008174] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-14T16:57:30.165241] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-14T16:57:30.393541] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-14T16:57:30.393784] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-14T16:57:30.394425] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-14T16:57:30.394516] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-14T16:57:30.422345] [DEBUG] [LOCAL ] AXP: Trimmed 57853 records to 40062 (keeping 150 days of data) [2025-09-14T16:57:30.424419] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:57:30.685581] [DEBUG] [LOCAL ] AXP: Primary data saved (40062 records). [2025-09-14T16:57:30.685779] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-14T16:57:30.685885] [INFO ] [MAIN ] Update Progress: 197/2370 symbols completed. AXP took 26.0s. Estimated remaining: 3h 44m 6s. Rate: 9.7 symbols/min [2025-09-14T16:57:30.760089] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T16:57:30.763298] [INFO ] [REMOTE ] AX: Full fetch complete (31189 records). [2025-09-14T16:57:30.763412] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-14T16:57:30.968606] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-14T16:57:31.134141] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-14T16:57:31.134285] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-14T16:57:31.134736] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-14T16:57:31.134813] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-14T16:57:31.135828] [DEBUG] [LOCAL ] AX: Trimmed 31189 records to 20596 (keeping 150 days of data) [2025-09-14T16:57:31.260993] [DEBUG] [LOCAL ] AX: Primary data saved (20596 records). [2025-09-14T16:57:31.261175] [INFO ] [MAIN ] AX: Full history saved. [2025-09-14T16:57:31.261290] [INFO ] [MAIN ] Update Progress: 198/2370 symbols completed. AX took 36.1s. Estimated remaining: 3h 42m 58s. Rate: 9.7 symbols/min [2025-09-14T16:57:31.299710] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T16:57:31.304990] [INFO ] [REMOTE ] AXL: Full fetch complete (55021 records). [2025-09-14T16:57:31.305170] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-14T16:57:31.695771] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-14T16:57:31.696008] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-14T16:57:31.696633] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-14T16:57:31.696717] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-14T16:57:31.698042] [DEBUG] [LOCAL ] AXL: Trimmed 55021 records to 37892 (keeping 150 days of data) [2025-09-14T16:57:31.783321] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-14T16:57:31.926441] [DEBUG] [LOCAL ] AXL: Primary data saved (37892 records). [2025-09-14T16:57:31.926663] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-14T16:57:31.926765] [INFO ] [MAIN ] Update Progress: 199/2370 symbols completed. AXL took 29.4s. Estimated remaining: 3h 41m 52s. Rate: 9.8 symbols/min [2025-09-14T16:57:33.376424] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T16:57:33.384525] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-14T16:57:34.639037] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:57:34.648163] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-14T16:57:36.143446] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T16:57:36.152457] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-14T16:57:37.545294] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:57:37.554017] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-14T16:57:38.475016] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T16:57:38.479076] [INFO ] [REMOTE ] AXS: Full fetch complete (41482 records). [2025-09-14T16:57:38.479204] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-14T16:57:38.855812] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-14T16:57:38.855926] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-14T16:57:38.856481] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-14T16:57:38.856549] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-14T16:57:38.857567] [DEBUG] [LOCAL ] AXS: Trimmed 41482 records to 28568 (keeping 150 days of data) [2025-09-14T16:57:39.042492] [DEBUG] [LOCAL ] AXS: Primary data saved (28568 records). [2025-09-14T16:57:39.042700] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-14T16:57:39.042846] [INFO ] [MAIN ] Update Progress: 200/2370 symbols completed. AXS took 16.1s. Estimated remaining: 3h 41m 57s. Rate: 9.8 symbols/min [2025-09-14T16:57:39.648453] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:39.692965] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:39.752830] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:39.755243] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:39.776093] [DEBUG] [LOCAL ] AZZ: Loaded 10278 existing records from primary storage. [2025-09-14T16:57:39.775743] [DEBUG] [LOCAL ] AZO: Loaded 4712 existing records from primary storage. [2025-09-14T16:57:39.776408] [INFO ] [MAIN ] AZO: Loaded 4712 existing records. [2025-09-14T16:57:39.776458] [INFO ] [MAIN ] AZZ: Loaded 10278 existing records. [2025-09-14T16:57:39.780554] [DEBUG] [LOCAL ] AYI: Loaded 10549 existing records from primary storage. [2025-09-14T16:57:39.801754] [INFO ] [MAIN ] AYI: Loaded 10549 existing records. [2025-09-14T16:57:40.051016] [DEBUG] [LOCAL ] AXTA: Loaded 23295 existing records from primary storage. [2025-09-14T16:57:40.098912] [INFO ] [MAIN ] AXTA: Loaded 23295 existing records. [2025-09-14T16:57:40.242709] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:40.344776] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:40.420398] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-14T16:57:40.433715] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:40.420470] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-14T16:57:40.441319] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-14T16:57:40.444710] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-14T16:57:40.444767] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-14T16:57:40.445133] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-14T16:57:40.455486] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-14T16:57:40.455524] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-14T16:57:40.466118] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-14T16:57:40.466050] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-14T16:57:40.460683] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-14T16:57:40.599561] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-14T16:57:40.608122] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:40.739431] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-14T16:57:40.790987] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-14T16:57:40.831208] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-14T16:57:40.912523] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-14T16:57:41.561461] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:41.633025] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-14T16:57:41.760191] [INFO ] [REMOTE ] AYI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:41.832004] [INFO ] [REMOTE ] AZO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:41.882696] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-14T16:57:41.856599] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-14T16:57:41.983124] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:41.983470] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-14T16:57:42.743186] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T16:57:42.746145] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-14T16:57:42.892395] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T16:57:42.897583] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-14T16:57:42.948839] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T16:57:42.953749] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-14T16:57:43.358632] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T16:57:43.368784] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-14T16:57:43.535841] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T16:57:43.540370] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-14T16:57:43.716170] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T16:57:43.722078] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-14T16:57:44.196755] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T16:57:44.203883] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-14T16:57:44.580931] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T16:57:44.591975] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-14T16:57:44.612803] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T16:57:44.704916] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T16:57:45.358930] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-14T16:57:45.746087] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T16:57:46.046405] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T16:57:46.110806] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T16:57:46.158816] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-14T16:57:46.841039] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T16:57:46.958840] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-14T16:57:47.758828] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-14T16:57:47.866700] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T16:57:48.558797] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-14T16:57:48.911200] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T16:57:49.358857] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-14T16:57:50.154748] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T16:57:50.158917] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-14T16:57:50.432801] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T16:57:50.760423] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T16:57:50.958824] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-14T16:57:51.175045] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T16:57:51.176507] [INFO ] [REMOTE ] AZO: Full fetch complete (12142 records). [2025-09-14T16:57:51.176606] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-14T16:57:51.546186] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-14T16:57:51.546308] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-14T16:57:51.546610] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-14T16:57:51.546683] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-14T16:57:51.547184] [DEBUG] [LOCAL ] AZO: Trimmed 12142 records to 7902 (keeping 150 days of data) [2025-09-14T16:57:51.597807] [DEBUG] [LOCAL ] AZO: Primary data saved (7902 records). [2025-09-14T16:57:51.597976] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-14T16:57:51.598098] [INFO ] [MAIN ] Update Progress: 201/2370 symbols completed. AZO took 12.6s. Estimated remaining: 3h 42m 60s. Rate: 9.7 symbols/min [2025-09-14T16:57:51.766627] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-14T16:57:51.770549] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:51.796322] [DEBUG] [LOCAL ] B: Loaded 24154 existing records from primary storage. [2025-09-14T16:57:51.796531] [INFO ] [MAIN ] B: Loaded 24154 existing records. [2025-09-14T16:57:51.974005] [WARN ] [MAIN ] B: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:51.974255] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-14T16:57:51.974326] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-14T16:57:51.975018] [DEBUG] [LOCAL ] B: Deleted primary data file. [2025-09-14T16:57:51.975083] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-14T16:57:52.329803] [INFO ] [REMOTE ] B: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:52.558826] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-14T16:57:52.800127] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:57:52.800418] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-14T16:57:53.037574] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T16:57:53.358872] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-14T16:57:54.158882] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-14T16:57:54.958860] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-14T16:57:55.073834] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T16:57:55.097374] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T16:57:55.758846] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-14T16:57:56.102185] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T16:57:56.558840] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-14T16:57:57.363901] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-14T16:57:57.383022] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T16:57:57.881670] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T16:57:58.158848] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-14T16:57:58.280921] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T16:57:58.403392] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:57:58.403737] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-14T16:57:58.958842] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-14T16:57:59.207215] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:57:59.207578] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-14T16:57:59.758827] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-14T16:58:00.293673] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T16:58:00.296236] [INFO ] [REMOTE ] AYI: Full fetch complete (27639 records). [2025-09-14T16:58:00.296374] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-14T16:58:00.564016] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-14T16:58:00.684820] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-14T16:58:00.684929] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-14T16:58:00.685381] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-14T16:58:00.685463] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-14T16:58:00.686231] [DEBUG] [LOCAL ] AYI: Trimmed 27639 records to 17957 (keeping 150 days of data) [2025-09-14T16:58:00.797991] [DEBUG] [LOCAL ] AYI: Primary data saved (17957 records). [2025-09-14T16:58:00.798186] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-14T16:58:00.798328] [INFO ] [MAIN ] Update Progress: 202/2370 symbols completed. AYI took 21.8s. Estimated remaining: 3h 43m 26s. Rate: 9.7 symbols/min [2025-09-14T16:58:00.970513] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:00.994657] [DEBUG] [LOCAL ] BA: Loaded 24153 existing records from primary storage. [2025-09-14T16:58:00.994840] [INFO ] [MAIN ] BA: Loaded 24153 existing records. [2025-09-14T16:58:01.176511] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:01.176898] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-14T16:58:01.176972] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-14T16:58:01.177677] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-14T16:58:01.177755] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-14T16:58:01.365193] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-14T16:58:01.531709] [INFO ] [REMOTE ] BA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:02.158819] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-14T16:58:02.364675] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T16:58:02.545103] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T16:58:02.958869] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-14T16:58:03.688739] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T16:58:03.758843] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-14T16:58:04.392296] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:58:04.397967] [INFO ] [REMOTE ] AXTA: Full fetch complete (56579 records). [2025-09-14T16:58:04.398155] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-14T16:58:04.562250] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-14T16:58:04.788878] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-14T16:58:04.788990] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-14T16:58:04.789633] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-14T16:58:04.789720] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-14T16:58:04.791016] [DEBUG] [LOCAL ] AXTA: Trimmed 56579 records to 39189 (keeping 150 days of data) [2025-09-14T16:58:05.040722] [DEBUG] [LOCAL ] AXTA: Primary data saved (39189 records). [2025-09-14T16:58:05.040927] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-14T16:58:05.041112] [INFO ] [MAIN ] Update Progress: 203/2370 symbols completed. AXTA took 26.0s. Estimated remaining: 3h 42m 59s. Rate: 9.7 symbols/min [2025-09-14T16:58:05.178953] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:58:05.226226] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:05.230710] [INFO ] [REMOTE ] AZZ: Full fetch complete (24071 records). [2025-09-14T16:58:05.231108] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-14T16:58:05.339300] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-14T16:58:05.362207] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-14T16:58:05.560373] [DEBUG] [LOCAL ] BABA: Loaded 24180 existing records from primary storage. [2025-09-14T16:58:05.581881] [INFO ] [MAIN ] BABA: Loaded 24180 existing records. [2025-09-14T16:58:05.791486] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-14T16:58:05.815810] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-14T16:58:05.852329] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-14T16:58:05.852451] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:05.852558] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-14T16:58:05.852793] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-14T16:58:05.852973] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-14T16:58:05.853532] [DEBUG] [LOCAL ] AZZ: Trimmed 24071 records to 16871 (keeping 150 days of data) [2025-09-14T16:58:05.853953] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-14T16:58:05.854025] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-14T16:58:06.166980] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-14T16:58:06.298430] [INFO ] [REMOTE ] BABA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:06.313471] [DEBUG] [LOCAL ] AZZ: Primary data saved (16871 records). [2025-09-14T16:58:06.313591] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-14T16:58:06.313696] [INFO ] [MAIN ] Update Progress: 204/2370 symbols completed. AZZ took 27.3s. Estimated remaining: 3h 42m 1s. Rate: 9.8 symbols/min [2025-09-14T16:58:06.481113] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:06.505305] [DEBUG] [LOCAL ] BAC: Loaded 24168 existing records from primary storage. [2025-09-14T16:58:06.505470] [INFO ] [MAIN ] BAC: Loaded 24168 existing records. [2025-09-14T16:58:06.678679] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:06.678927] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-14T16:58:06.678985] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-14T16:58:06.679762] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-14T16:58:06.679825] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-14T16:58:06.963879] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-14T16:58:07.032420] [INFO ] [REMOTE ] BAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:07.766011] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-14T16:58:07.768841] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-14T16:58:08.120597] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T16:58:08.558830] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-14T16:58:09.358829] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-14T16:58:09.622470] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-14T16:58:10.070622] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T16:58:10.158851] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-14T16:58:10.958817] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-14T16:58:11.136147] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-14T16:58:11.423269] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T16:58:11.758892] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-14T16:58:12.416366] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:58:12.421824] [INFO ] [REMOTE ] B: Full fetch complete (33850 records). [2025-09-14T16:58:12.421934] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-14T16:58:12.564045] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-14T16:58:12.611215] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 87 unique days, need 150 days [2025-09-14T16:58:12.611723] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:58:12.611794] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:58:12.612023] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-14T16:58:12.612307] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-14T16:58:12.612477] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-14T16:58:12.612587] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-14T16:58:12.612849] [INFO ] [MAIN ] Update Progress: 205/2370 symbols completed. B took 21.0s. Estimated remaining: 3h 41m 57s. Rate: 9.8 symbols/min [2025-09-14T16:58:12.788569] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:12.823329] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-14T16:58:12.850977] [DEBUG] [LOCAL ] BAH: Loaded 23012 existing records from primary storage. [2025-09-14T16:58:12.851139] [INFO ] [MAIN ] BAH: Loaded 23012 existing records. [2025-09-14T16:58:13.030701] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:13.031015] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-14T16:58:13.031077] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-14T16:58:13.031729] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-14T16:58:13.031793] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-14T16:58:13.365396] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-14T16:58:13.395350] [INFO ] [REMOTE ] BAH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:13.834582] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-09-14T16:58:14.158857] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-14T16:58:14.958876] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-14T16:58:15.232955] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-14T16:58:15.609999] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T16:58:15.758825] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-14T16:58:16.182217] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-14T16:58:16.558833] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-14T16:58:17.358830] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-14T16:58:17.668003] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T16:58:17.780760] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-14T16:58:18.158827] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-14T16:58:18.958871] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-14T16:58:19.072009] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-14T16:58:19.279723] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T16:58:19.711734] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T16:58:19.758777] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-14T16:58:20.558910] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-14T16:58:21.358875] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-14T16:58:21.474456] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-14T16:58:21.888617] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-14T16:58:22.158853] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-14T16:58:22.935301] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-14T16:58:22.958775] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-14T16:58:23.758887] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-14T16:58:24.359142] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-09-14T16:58:24.558881] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-14T16:58:25.277061] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-14T16:58:25.358814] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-14T16:58:25.461088] [DEBUG] [REMOTE ] BA: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-14T16:58:25.461448] [WARN ] [REMOTE ] BA: No data returned for month 2025-08 [2025-09-14T16:58:25.495464] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T16:58:25.598285] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (3.44 seconds). [2025-09-14T16:58:26.158836] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-14T16:58:26.958830] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-14T16:58:27.136784] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-14T16:58:27.758901] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-14T16:58:28.007870] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T16:58:28.558932] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-14T16:58:29.219023] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:58:29.224572] [INFO ] [REMOTE ] BA: Full fetch complete (50281 records). [2025-09-14T16:58:29.224716] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-14T16:58:29.378345] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-14T16:58:29.424057] [WARN ] [VALIDATOR ] BA: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T16:58:29.425242] [FATAL] [MAIN ] BA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:58:29.425369] [WARN ] [MAIN ] BA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:58:29.425535] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-14T16:58:29.425762] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-09-14T16:58:29.425878] [INFO ] [LOCAL ] BA: Starting deletion of derivative data. [2025-09-14T16:58:29.425996] [DEBUG] [LOCAL ] BA: No derivative data file found to delete. [2025-09-14T16:58:29.426278] [INFO ] [MAIN ] Update Progress: 206/2370 symbols completed. BA took 28.6s. Estimated remaining: 3h 43m 42s. Rate: 9.7 symbols/min [2025-09-14T16:58:29.624322] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:29.657121] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-14T16:58:29.680109] [DEBUG] [LOCAL ] BAK: Loaded 17696 existing records from primary storage. [2025-09-14T16:58:29.680274] [INFO ] [MAIN ] BAK: Loaded 17696 existing records. [2025-09-14T16:58:29.859982] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:29.860256] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-14T16:58:29.860320] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-14T16:58:29.860875] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-14T16:58:29.860939] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-14T16:58:30.167180] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-14T16:58:30.218533] [INFO ] [REMOTE ] BAK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:30.283949] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-14T16:58:30.787624] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T16:58:30.958884] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-14T16:58:31.758885] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-14T16:58:32.002299] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T16:58:32.396274] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:58:32.401819] [INFO ] [REMOTE ] BAC: Full fetch complete (58488 records). [2025-09-14T16:58:32.401959] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-14T16:58:32.574401] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-14T16:58:32.788242] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-14T16:58:32.788452] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-14T16:58:32.789226] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-14T16:58:32.789324] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-14T16:58:32.790931] [DEBUG] [LOCAL ] BAC: Trimmed 58488 records to 40548 (keeping 150 days of data) [2025-09-14T16:58:32.918076] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-14T16:58:33.093734] [DEBUG] [LOCAL ] BAC: Primary data saved (40548 records). [2025-09-14T16:58:33.093904] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-14T16:58:33.094053] [INFO ] [MAIN ] Update Progress: 207/2370 symbols completed. BAC took 26.8s. Estimated remaining: 3h 43m 10s. Rate: 9.7 symbols/min [2025-09-14T16:58:33.271359] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:33.293961] [DEBUG] [LOCAL ] BALL: Loaded 22987 existing records from primary storage. [2025-09-14T16:58:33.294148] [INFO ] [MAIN ] BALL: Loaded 22987 existing records. [2025-09-14T16:58:33.363911] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-14T16:58:33.509791] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:33.510084] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-14T16:58:33.510148] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-14T16:58:33.510938] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-14T16:58:33.511018] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-14T16:58:33.863217] [INFO ] [REMOTE ] BALL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:34.066879] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T16:58:34.158818] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-14T16:58:34.958832] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-14T16:58:35.162324] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-14T16:58:35.167909] [INFO ] [REMOTE ] BAH: Full fetch complete (56406 records). [2025-09-14T16:58:35.168053] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-14T16:58:35.555188] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-14T16:58:35.555315] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-14T16:58:35.556005] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-14T16:58:35.556084] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-14T16:58:35.557595] [DEBUG] [LOCAL ] BAH: Trimmed 56406 records to 38796 (keeping 150 days of data) [2025-09-14T16:58:35.765358] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-14T16:58:35.837122] [DEBUG] [LOCAL ] BAH: Primary data saved (38796 records). [2025-09-14T16:58:35.837307] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-14T16:58:35.837483] [INFO ] [MAIN ] Update Progress: 208/2370 symbols completed. BAH took 23.2s. Estimated remaining: 3h 42m 28s. Rate: 9.7 symbols/min [2025-09-14T16:58:36.012942] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:36.019344] [DEBUG] [LOCAL ] BALY: Loaded 3829 existing records from primary storage. [2025-09-14T16:58:36.019448] [INFO ] [MAIN ] BALY: Loaded 3829 existing records. [2025-09-14T16:58:36.195591] [WARN ] [MAIN ] BALY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:36.195900] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-14T16:58:36.195966] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-14T16:58:36.196241] [DEBUG] [LOCAL ] BALY: Deleted primary data file. [2025-09-14T16:58:36.196310] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-14T16:58:36.563740] [INFO ] [REMOTE ] BALY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:36.564599] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-14T16:58:36.591458] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T16:58:36.630064] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-14T16:58:37.276202] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T16:58:37.358793] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-14T16:58:38.014253] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T16:58:38.158845] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-14T16:58:38.179481] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-14T16:58:38.188352] [INFO ] [REMOTE ] BABA: Full fetch complete (58500 records). [2025-09-14T16:58:38.188529] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-14T16:58:38.568773] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-14T16:58:38.568904] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-14T16:58:38.569549] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-14T16:58:38.569609] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-14T16:58:38.571296] [DEBUG] [LOCAL ] BABA: Trimmed 58500 records to 40560 (keeping 150 days of data) [2025-09-14T16:58:38.844610] [DEBUG] [LOCAL ] BABA: Primary data saved (40560 records). [2025-09-14T16:58:38.844884] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-14T16:58:38.845076] [INFO ] [MAIN ] Update Progress: 209/2370 symbols completed. BABA took 33.8s. Estimated remaining: 3h 41m 49s. Rate: 9.7 symbols/min [2025-09-14T16:58:38.964003] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-14T16:58:39.016834] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:39.040799] [DEBUG] [LOCAL ] BAM: Loaded 23159 existing records from primary storage. [2025-09-14T16:58:39.040958] [INFO ] [MAIN ] BAM: Loaded 23159 existing records. [2025-09-14T16:58:39.216598] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:39.216898] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-14T16:58:39.216971] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-14T16:58:39.217608] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-14T16:58:39.217696] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-14T16:58:39.580064] [INFO ] [REMOTE ] BAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:39.759144] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-14T16:58:39.759415] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T16:58:39.932194] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T16:58:40.558878] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-14T16:58:40.928816] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T16:58:41.358850] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-14T16:58:42.158887] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-14T16:58:42.455996] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T16:58:42.473673] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:58:42.958882] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-14T16:58:43.342868] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T16:58:43.758873] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-14T16:58:44.558908] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-14T16:58:44.681966] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T16:58:44.867138] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T16:58:45.358912] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-14T16:58:46.158855] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-14T16:58:46.251575] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T16:58:46.958880] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-14T16:58:47.189729] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T16:58:47.627333] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T16:58:47.758824] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-14T16:58:48.025718] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T16:58:48.558871] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-14T16:58:49.358818] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-14T16:58:49.419403] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T16:58:49.546694] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T16:58:50.158863] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-14T16:58:50.852509] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T16:58:50.958845] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-14T16:58:51.102316] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T16:58:51.758882] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-14T16:58:52.038045] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T16:58:52.042279] [INFO ] [REMOTE ] BAK: Full fetch complete (42270 records). [2025-09-14T16:58:52.042458] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-14T16:58:52.446043] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-14T16:58:52.446187] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-14T16:58:52.447060] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-14T16:58:52.447143] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-14T16:58:52.448510] [DEBUG] [LOCAL ] BAK: Trimmed 42270 records to 29310 (keeping 150 days of data) [2025-09-14T16:58:52.559630] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-14T16:58:52.655164] [DEBUG] [LOCAL ] BAK: Primary data saved (29310 records). [2025-09-14T16:58:52.655417] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-14T16:58:52.655564] [INFO ] [MAIN ] Update Progress: 210/2370 symbols completed. BAK took 23.2s. Estimated remaining: 3h 43m 1s. Rate: 9.7 symbols/min [2025-09-14T16:58:52.837116] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:52.863986] [DEBUG] [LOCAL ] BANC: Loaded 22950 existing records from primary storage. [2025-09-14T16:58:52.864265] [INFO ] [MAIN ] BANC: Loaded 22950 existing records. [2025-09-14T16:58:53.049911] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:53.050244] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-14T16:58:53.050306] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-14T16:58:53.050987] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-14T16:58:53.051055] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-14T16:58:53.364439] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-14T16:58:53.422516] [INFO ] [REMOTE ] BANC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:53.585321] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T16:58:54.027854] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T16:58:54.064819] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T16:58:54.066077] [INFO ] [REMOTE ] BALY: Full fetch complete (9022 records). [2025-09-14T16:58:54.066163] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-14T16:58:54.163915] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-14T16:58:54.256311] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T16:58:54.256687] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:58:54.256766] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:58:54.256822] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-14T16:58:54.256901] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-14T16:58:54.256952] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-14T16:58:54.257025] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-14T16:58:54.257137] [INFO ] [MAIN ] Update Progress: 211/2370 symbols completed. BALY took 18.4s. Estimated remaining: 3h 42m 8s. Rate: 9.7 symbols/min [2025-09-14T16:58:54.433729] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:54.449984] [DEBUG] [LOCAL ] BAP: Loaded 11635 existing records from primary storage. [2025-09-14T16:58:54.450189] [INFO ] [MAIN ] BAP: Loaded 11635 existing records. [2025-09-14T16:58:54.633237] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:54.647879] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-14T16:58:54.648058] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-14T16:58:54.649326] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T16:58:54.654398] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-14T16:58:54.654968] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-14T16:58:54.660575] [INFO ] [REMOTE ] BALL: Full fetch complete (56487 records). [2025-09-14T16:58:54.724216] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-14T16:58:54.961017] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-14T16:58:55.432794] [INFO ] [REMOTE ] BAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:55.453529] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-14T16:58:55.453684] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-14T16:58:55.454586] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-14T16:58:55.454704] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-14T16:58:55.456582] [DEBUG] [LOCAL ] BALL: Trimmed 56487 records to 38898 (keeping 150 days of data) [2025-09-14T16:58:55.700083] [DEBUG] [LOCAL ] BALL: Primary data saved (38898 records). [2025-09-14T16:58:55.700269] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-14T16:58:55.700396] [INFO ] [MAIN ] Update Progress: 212/2370 symbols completed. BALL took 22.6s. Estimated remaining: 3h 41m 14s. Rate: 9.8 symbols/min [2025-09-14T16:58:55.763990] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-14T16:58:55.874168] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:55.892309] [DEBUG] [LOCAL ] BARK: Loaded 17022 existing records from primary storage. [2025-09-14T16:58:55.892478] [INFO ] [MAIN ] BARK: Loaded 17022 existing records. [2025-09-14T16:58:56.066543] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:56.066870] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-14T16:58:56.066933] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-14T16:58:56.067474] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-14T16:58:56.067538] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-14T16:58:56.442331] [INFO ] [REMOTE ] BARK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:56.558886] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-14T16:58:56.972517] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T16:58:57.358854] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-14T16:58:57.447461] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T16:58:57.499880] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T16:58:58.158859] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-14T16:58:58.532074] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T16:58:58.958854] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-14T16:58:59.349251] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T16:58:59.758824] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-14T16:59:00.558861] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-14T16:59:00.933242] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T16:59:01.358887] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-14T16:59:01.411744] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T16:59:02.156704] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T16:59:02.164197] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-14T16:59:02.794749] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T16:59:02.958839] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-14T16:59:03.358389] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T16:59:03.758826] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-14T16:59:04.558909] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-14T16:59:04.646150] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-14T16:59:04.651867] [INFO ] [REMOTE ] BAM: Full fetch complete (56527 records). [2025-09-14T16:59:04.652070] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-14T16:59:05.051535] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-14T16:59:05.057280] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-14T16:59:05.067622] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-14T16:59:05.068911] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T16:59:05.068981] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-14T16:59:05.076486] [DEBUG] [LOCAL ] BAM: Trimmed 56527 records to 38990 (keeping 150 days of data) [2025-09-14T16:59:05.320814] [DEBUG] [LOCAL ] BAM: Primary data saved (38990 records). [2025-09-14T16:59:05.321008] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-14T16:59:05.321114] [INFO ] [MAIN ] Update Progress: 213/2370 symbols completed. BAM took 26.5s. Estimated remaining: 3h 41m 43s. Rate: 9.7 symbols/min [2025-09-14T16:59:05.364514] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-14T16:59:05.501371] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:05.529402] [DEBUG] [LOCAL ] BAX: Loaded 23984 existing records from primary storage. [2025-09-14T16:59:05.529628] [INFO ] [MAIN ] BAX: Loaded 23984 existing records. [2025-09-14T16:59:05.713228] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:05.713503] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-14T16:59:05.713564] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-14T16:59:05.714239] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-14T16:59:05.714304] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-14T16:59:06.066563] [INFO ] [REMOTE ] BAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:06.108739] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T16:59:06.158827] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-14T16:59:06.327018] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T16:59:06.958881] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-14T16:59:07.758895] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-14T16:59:07.957623] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T16:59:08.514902] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T16:59:08.558779] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-14T16:59:09.358822] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-14T16:59:09.559959] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T16:59:09.951519] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T16:59:10.158875] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-14T16:59:10.958863] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-14T16:59:11.267816] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T16:59:11.758881] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-14T16:59:11.920061] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T16:59:12.167794] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T16:59:12.558849] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-14T16:59:13.358819] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-14T16:59:13.583501] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T16:59:13.647516] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T16:59:14.158882] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-14T16:59:14.958804] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-14T16:59:15.348114] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-14T16:59:15.368192] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T16:59:15.371986] [INFO ] [REMOTE ] BAP: Full fetch complete (28661 records). [2025-09-14T16:59:15.372130] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-14T16:59:15.740910] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-14T16:59:15.741012] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-14T16:59:15.741380] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-14T16:59:15.741433] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-14T16:59:15.742148] [DEBUG] [LOCAL ] BAP: Trimmed 28661 records to 19263 (keeping 150 days of data) [2025-09-14T16:59:15.796395] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-14T16:59:15.863200] [DEBUG] [LOCAL ] BAP: Primary data saved (19263 records). [2025-09-14T16:59:15.863350] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-14T16:59:15.863459] [INFO ] [MAIN ] Update Progress: 214/2370 symbols completed. BAP took 21.6s. Estimated remaining: 3h 42m 21s. Rate: 9.7 symbols/min [2025-09-14T16:59:16.030531] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:16.056364] [DEBUG] [LOCAL ] BB: Loaded 23724 existing records from primary storage. [2025-09-14T16:59:16.056584] [INFO ] [MAIN ] BB: Loaded 23724 existing records. [2025-09-14T16:59:16.266394] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:16.266715] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-14T16:59:16.266798] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-14T16:59:16.267557] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-14T16:59:16.267623] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-14T16:59:16.564069] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-14T16:59:16.619615] [INFO ] [REMOTE ] BB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:16.723183] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T16:59:17.184008] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T16:59:17.358811] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-14T16:59:18.158884] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-14T16:59:18.495964] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T16:59:18.958866] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-14T16:59:19.019566] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T16:59:19.257070] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T16:59:19.758884] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-14T16:59:20.558940] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-14T16:59:21.198561] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-14T16:59:21.358860] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-14T16:59:21.555318] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T16:59:22.036455] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T16:59:22.158848] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-14T16:59:22.958900] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-14T16:59:23.428877] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T16:59:23.598665] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:59:23.605691] [INFO ] [REMOTE ] BANC: Full fetch complete (55601 records). [2025-09-14T16:59:23.605983] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-14T16:59:23.764711] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-14T16:59:24.230720] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-14T16:59:24.259394] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-14T16:59:24.261569] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-14T16:59:24.267859] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-14T16:59:24.267691] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T16:59:24.289428] [DEBUG] [LOCAL ] BANC: Trimmed 55601 records to 38316 (keeping 150 days of data) [2025-09-14T16:59:24.559608] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-14T16:59:24.606567] [DEBUG] [LOCAL ] BANC: Primary data saved (38316 records). [2025-09-14T16:59:24.607111] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-14T16:59:24.607328] [INFO ] [MAIN ] Update Progress: 215/2370 symbols completed. BANC took 32.0s. Estimated remaining: 3h 42m 40s. Rate: 9.7 symbols/min [2025-09-14T16:59:24.833658] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:24.860577] [DEBUG] [LOCAL ] BBAI: Loaded 24180 existing records from primary storage. [2025-09-14T16:59:24.860840] [INFO ] [MAIN ] BBAI: Loaded 24180 existing records. [2025-09-14T16:59:25.040058] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:25.040361] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-14T16:59:25.040428] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-14T16:59:25.041217] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-14T16:59:25.041289] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-14T16:59:25.366893] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-14T16:59:25.395792] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:25.788708] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T16:59:25.792808] [INFO ] [REMOTE ] BARK: Full fetch complete (42174 records). [2025-09-14T16:59:25.792960] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-14T16:59:26.160578] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-14T16:59:26.195748] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-14T16:59:26.195938] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-14T16:59:26.196751] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-14T16:59:26.196871] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-14T16:59:26.211860] [DEBUG] [LOCAL ] BARK: Trimmed 42174 records to 28961 (keeping 150 days of data) [2025-09-14T16:59:26.241694] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-14T16:59:26.434085] [DEBUG] [LOCAL ] BARK: Primary data saved (28961 records). [2025-09-14T16:59:26.434320] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-14T16:59:26.434497] [INFO ] [MAIN ] Update Progress: 216/2370 symbols completed. BARK took 30.7s. Estimated remaining: 3h 41m 50s. Rate: 9.7 symbols/min [2025-09-14T16:59:26.619688] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:26.641967] [DEBUG] [LOCAL ] BBAR: Loaded 18473 existing records from primary storage. [2025-09-14T16:59:26.642223] [INFO ] [MAIN ] BBAR: Loaded 18473 existing records. [2025-09-14T16:59:26.833411] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:26.833746] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-14T16:59:26.833811] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-14T16:59:26.834458] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-14T16:59:26.834523] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-14T16:59:26.963889] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-14T16:59:27.214154] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:27.254482] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T16:59:27.758885] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-14T16:59:28.338129] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T16:59:28.390386] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:59:28.396530] [INFO ] [REMOTE ] BAX: Full fetch complete (58155 records). [2025-09-14T16:59:28.396751] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-14T16:59:28.563956] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-14T16:59:28.828436] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-14T16:59:28.828606] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-14T16:59:28.829548] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-14T16:59:28.829634] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-14T16:59:28.831534] [DEBUG] [LOCAL ] BAX: Trimmed 58155 records to 40292 (keeping 150 days of data) [2025-09-14T16:59:29.153682] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-14T16:59:29.206311] [DEBUG] [LOCAL ] BAX: Primary data saved (40292 records). [2025-09-14T16:59:29.206495] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-14T16:59:29.206601] [INFO ] [MAIN ] Update Progress: 217/2370 symbols completed. BAX took 23.9s. Estimated remaining: 3h 41m 10s. Rate: 9.7 symbols/min [2025-09-14T16:59:29.361092] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-14T16:59:29.385411] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:29.410679] [DEBUG] [LOCAL ] BBD: Loaded 23923 existing records from primary storage. [2025-09-14T16:59:29.410867] [INFO ] [MAIN ] BBD: Loaded 23923 existing records. [2025-09-14T16:59:29.586555] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:29.586878] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-14T16:59:29.586945] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-14T16:59:29.587754] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-14T16:59:29.587820] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-14T16:59:29.936155] [INFO ] [REMOTE ] BBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:30.158846] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-14T16:59:30.271128] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T16:59:30.958824] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-14T16:59:31.758889] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-14T16:59:31.816804] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-14T16:59:31.857373] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T16:59:32.558794] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-14T16:59:32.619854] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T16:59:33.080080] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T16:59:33.358815] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-14T16:59:34.158840] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-14T16:59:34.958899] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-14T16:59:35.044594] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T16:59:35.290766] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-14T16:59:35.758797] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-14T16:59:35.933377] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T16:59:36.113809] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T16:59:36.558889] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-14T16:59:37.358813] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-14T16:59:38.158819] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-14T16:59:38.191467] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-14T16:59:38.260628] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T16:59:38.972994] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-14T16:59:39.007059] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T16:59:39.758846] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-14T16:59:39.851502] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T16:59:40.137150] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T16:59:40.558852] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-14T16:59:41.358820] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-14T16:59:41.649761] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T16:59:42.158821] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-14T16:59:42.568089] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-14T16:59:42.731340] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T16:59:42.958863] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-14T16:59:43.579851] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T16:59:43.585365] [INFO ] [REMOTE ] BB: Full fetch complete (57617 records). [2025-09-14T16:59:43.585518] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-14T16:59:43.760721] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-14T16:59:43.973003] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-14T16:59:43.973127] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-14T16:59:43.973896] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-14T16:59:43.973960] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-14T16:59:43.975232] [DEBUG] [LOCAL ] BB: Trimmed 57617 records to 39734 (keeping 150 days of data) [2025-09-14T16:59:44.212924] [DEBUG] [LOCAL ] BB: Primary data saved (39734 records). [2025-09-14T16:59:44.213112] [INFO ] [MAIN ] BB: Full history saved. [2025-09-14T16:59:44.213220] [INFO ] [MAIN ] Update Progress: 218/2370 symbols completed. BB took 28.3s. Estimated remaining: 3h 42m 32s. Rate: 9.7 symbols/min [2025-09-14T16:59:44.382688] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:44.398562] [DEBUG] [LOCAL ] BBDC: Loaded 13500 existing records from primary storage. [2025-09-14T16:59:44.398758] [INFO ] [MAIN ] BBDC: Loaded 13500 existing records. [2025-09-14T16:59:44.562241] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-14T16:59:44.582226] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:44.584135] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-14T16:59:44.584217] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-14T16:59:44.584702] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-14T16:59:44.584772] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-14T16:59:44.951826] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:44.978714] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T16:59:45.358852] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-14T16:59:45.479893] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T16:59:46.158875] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-14T16:59:46.249187] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T16:59:46.958852] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-14T16:59:47.712603] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-14T16:59:47.739082] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T16:59:47.744283] [INFO ] [REMOTE ] BBAR: Full fetch complete (44690 records). [2025-09-14T16:59:47.744464] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-14T16:59:47.766283] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-14T16:59:48.125588] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-14T16:59:48.125742] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-14T16:59:48.126354] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-14T16:59:48.126417] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-14T16:59:48.127633] [DEBUG] [LOCAL ] BBAR: Trimmed 44690 records to 31093 (keeping 150 days of data) [2025-09-14T16:59:48.326518] [DEBUG] [LOCAL ] BBAR: Primary data saved (31093 records). [2025-09-14T16:59:48.326815] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-14T16:59:48.326969] [INFO ] [MAIN ] Update Progress: 219/2370 symbols completed. BBAR took 21.9s. Estimated remaining: 3h 42m 5s. Rate: 9.7 symbols/min [2025-09-14T16:59:48.499857] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:48.503420] [DEBUG] [LOCAL ] BBDO: Loaded 1647 existing records from primary storage. [2025-09-14T16:59:48.503554] [INFO ] [MAIN ] BBDO: Loaded 1647 existing records. [2025-09-14T16:59:48.566314] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-14T16:59:48.687720] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:48.688135] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-14T16:59:48.688236] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-14T16:59:48.688536] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-14T16:59:48.688634] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-14T16:59:48.820172] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T16:59:49.088329] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:49.358831] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-14T16:59:49.684100] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T16:59:50.158903] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-14T16:59:50.936989] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T16:59:50.958789] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-14T16:59:51.353593] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-09-14T16:59:51.404496] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T16:59:51.758851] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-14T16:59:52.018215] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T16:59:52.440414] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-14T16:59:52.558825] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-14T16:59:52.996930] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T16:59:53.358829] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-14T16:59:54.158850] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-14T16:59:54.871783] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T16:59:54.958860] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-14T16:59:55.745544] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T16:59:55.758792] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-14T16:59:56.019101] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-14T16:59:56.024633] [INFO ] [REMOTE ] BBAI: Full fetch complete (58500 records). [2025-09-14T16:59:56.024775] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-14T16:59:56.409320] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-14T16:59:56.409452] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-14T16:59:56.410190] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-14T16:59:56.410253] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-14T16:59:56.411542] [DEBUG] [LOCAL ] BBAI: Trimmed 58500 records to 40560 (keeping 150 days of data) [2025-09-14T16:59:56.579590] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-14T16:59:56.655698] [DEBUG] [LOCAL ] BBAI: Primary data saved (40560 records). [2025-09-14T16:59:56.655866] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-14T16:59:56.655970] [INFO ] [MAIN ] Update Progress: 220/2370 symbols completed. BBAI took 32.0s. Estimated remaining: 3h 42m 19s. Rate: 9.7 symbols/min [2025-09-14T16:59:56.830326] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:56.841187] [DEBUG] [LOCAL ] BBN: Loaded 8529 existing records from primary storage. [2025-09-14T16:59:56.841367] [INFO ] [MAIN ] BBN: Loaded 8529 existing records. [2025-09-14T16:59:57.026832] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:57.027991] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-14T16:59:57.028052] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-14T16:59:57.028475] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-14T16:59:57.028536] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-14T16:59:57.322733] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-14T16:59:57.363431] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-14T16:59:57.397608] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T16:59:57.416916] [INFO ] [REMOTE ] BBN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:57.423491] [INFO ] [REMOTE ] BBD: Full fetch complete (57836 records). [2025-09-14T16:59:57.423699] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-14T16:59:57.799820] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-14T16:59:57.799931] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-14T16:59:57.800686] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-14T16:59:57.800755] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-14T16:59:57.801948] [DEBUG] [LOCAL ] BBD: Trimmed 57836 records to 40069 (keeping 150 days of data) [2025-09-14T16:59:57.907486] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T16:59:58.072800] [DEBUG] [LOCAL ] BBD: Primary data saved (40069 records). [2025-09-14T16:59:58.073029] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-14T16:59:58.073169] [INFO ] [MAIN ] Update Progress: 221/2370 symbols completed. BBD took 28.9s. Estimated remaining: 3h 41m 27s. Rate: 9.7 symbols/min [2025-09-14T16:59:58.164016] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-14T16:59:58.252558] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:58.257864] [DEBUG] [LOCAL ] BBT: Loaded 2749 existing records from primary storage. [2025-09-14T16:59:58.258037] [INFO ] [MAIN ] BBT: Loaded 2749 existing records. [2025-09-14T16:59:58.441041] [WARN ] [MAIN ] BBT: Insufficient historical data. Have data from 2025-09-02, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:58.441354] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-14T16:59:58.441460] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-14T16:59:58.441829] [DEBUG] [LOCAL ] BBT: Deleted primary data file. [2025-09-14T16:59:58.441895] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-14T16:59:58.734892] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T16:59:58.816076] [INFO ] [REMOTE ] BBT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:58.958882] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-14T16:59:59.208123] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:59:59.208615] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-14T16:59:59.758885] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-14T17:00:00.558825] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-14T17:00:00.720938] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T17:00:01.358867] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-14T17:00:02.043466] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T17:00:02.071068] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T17:00:02.158943] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-14T17:00:02.958951] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-14T17:00:03.759000] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-14T17:00:04.027534] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:04.028278] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-14T17:00:04.558940] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-14T17:00:05.358956] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-14T17:00:05.498113] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:05.498491] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-14T17:00:06.009788] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:00:06.011265] [INFO ] [REMOTE ] BBDO: Full fetch complete (5516 records). [2025-09-14T17:00:06.011542] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-14T17:00:06.125600] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-14T17:00:06.167036] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-14T17:00:06.435836] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (3.48 seconds). [2025-09-14T17:00:06.458672] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-14T17:00:06.469495] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-14T17:00:06.470189] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-14T17:00:06.470324] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-14T17:00:06.472091] [DEBUG] [LOCAL ] BBDO: Trimmed 5516 records to 3603 (keeping 150 days of data) [2025-09-14T17:00:06.495238] [DEBUG] [LOCAL ] BBDO: Primary data saved (3603 records). [2025-09-14T17:00:06.495461] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-14T17:00:06.495594] [INFO ] [MAIN ] Update Progress: 222/2370 symbols completed. BBDO took 18.2s. Estimated remaining: 3h 41m 42s. Rate: 9.7 symbols/min [2025-09-14T17:00:06.573047] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:06.602045] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-14T17:00:06.683866] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:06.688562] [DEBUG] [LOCAL ] BBU: Loaded 2518 existing records from primary storage. [2025-09-14T17:00:06.688702] [INFO ] [MAIN ] BBU: Loaded 2518 existing records. [2025-09-14T17:00:06.868766] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:06.869067] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-14T17:00:06.869142] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-14T17:00:06.869439] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-14T17:00:06.869501] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-14T17:00:06.963993] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-14T17:00:07.242720] [INFO ] [REMOTE ] BBU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:07.325549] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:07.325914] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-14T17:00:07.758875] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-14T17:00:08.053289] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:08.053636] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-14T17:00:08.558838] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-14T17:00:09.358870] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-14T17:00:09.608859] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:09.609214] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-14T17:00:09.775350] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T17:00:10.158853] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-14T17:00:10.958852] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-14T17:00:11.005724] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:00:11.009745] [INFO ] [REMOTE ] BBDC: Full fetch complete (36816 records). [2025-09-14T17:00:11.009865] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-14T17:00:11.413586] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-14T17:00:11.413732] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-14T17:00:11.414206] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-14T17:00:11.414260] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-14T17:00:11.415310] [DEBUG] [LOCAL ] BBDC: Trimmed 36816 records to 23732 (keeping 150 days of data) [2025-09-14T17:00:11.559362] [DEBUG] [LOCAL ] BBDC: Primary data saved (23732 records). [2025-09-14T17:00:11.559527] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-14T17:00:11.559623] [INFO ] [MAIN ] Update Progress: 223/2370 symbols completed. BBDC took 27.3s. Estimated remaining: 3h 41m 25s. Rate: 9.7 symbols/min [2025-09-14T17:00:11.733204] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:11.739750] [DEBUG] [LOCAL ] BBUC: Loaded 5443 existing records from primary storage. [2025-09-14T17:00:11.739865] [INFO ] [MAIN ] BBUC: Loaded 5443 existing records. [2025-09-14T17:00:11.769867] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-14T17:00:11.925098] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:11.925374] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-14T17:00:11.925437] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-14T17:00:11.925757] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-14T17:00:11.925818] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-14T17:00:12.213200] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T17:00:12.243345] [INFO ] [REMOTE ] BBT: Full fetch complete (2749 records). [2025-09-14T17:00:12.290662] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-14T17:00:12.295001] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:12.479540] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 9 unique days, need 150 days [2025-09-14T17:00:12.479806] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:00:12.479865] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:00:12.479909] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-14T17:00:12.479986] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-14T17:00:12.480043] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-14T17:00:12.480101] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-14T17:00:12.480187] [INFO ] [MAIN ] Update Progress: 224/2370 symbols completed. BBT took 14.4s. Estimated remaining: 3h 40m 28s. Rate: 9.7 symbols/min [2025-09-14T17:00:12.563935] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-14T17:00:12.655755] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:12.678756] [DEBUG] [LOCAL ] BBVA: Loaded 21936 existing records from primary storage. [2025-09-14T17:00:12.678927] [INFO ] [MAIN ] BBVA: Loaded 21936 existing records. [2025-09-14T17:00:12.856851] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:12.857136] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-14T17:00:12.857197] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-14T17:00:12.857769] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-14T17:00:12.857830] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-14T17:00:13.221294] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:13.255979] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T17:00:13.358833] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-14T17:00:14.054708] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:00:14.158848] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-14T17:00:14.602183] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-14T17:00:14.958881] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-14T17:00:14.997388] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:00:15.758868] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-14T17:00:16.568825] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-14T17:00:16.616982] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:00:16.934415] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T17:00:17.195615] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T17:00:17.358891] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-14T17:00:17.851535] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T17:00:18.158922] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-14T17:00:18.958864] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-14T17:00:19.279022] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T17:00:19.486999] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T17:00:19.758861] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-14T17:00:20.232083] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-14T17:00:20.558809] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-14T17:00:21.358820] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-14T17:00:21.584713] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T17:00:21.587301] [INFO ] [REMOTE ] BBN: Full fetch complete (19424 records). [2025-09-14T17:00:21.587422] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-14T17:00:21.976273] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-14T17:00:21.976383] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-14T17:00:21.976802] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-14T17:00:21.976878] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-14T17:00:21.977981] [DEBUG] [LOCAL ] BBN: Trimmed 19424 records to 13604 (keeping 150 days of data) [2025-09-14T17:00:22.067149] [DEBUG] [LOCAL ] BBN: Primary data saved (13604 records). [2025-09-14T17:00:22.067338] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-14T17:00:22.067464] [INFO ] [MAIN ] Update Progress: 225/2370 symbols completed. BBN took 25.4s. Estimated remaining: 3h 40m 55s. Rate: 9.7 symbols/min [2025-09-14T17:00:22.169149] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-14T17:00:22.247829] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:22.263870] [DEBUG] [LOCAL ] BBW: Loaded 11155 existing records from primary storage. [2025-09-14T17:00:22.264090] [INFO ] [MAIN ] BBW: Loaded 11155 existing records. [2025-09-14T17:00:22.459544] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:22.470330] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-14T17:00:22.471026] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-14T17:00:22.471352] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T17:00:22.474865] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-14T17:00:22.475662] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-14T17:00:22.851565] [INFO ] [REMOTE ] BBW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:22.958816] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-14T17:00:23.758887] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-14T17:00:23.931842] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T17:00:24.558890] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-14T17:00:24.692809] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:00:24.701241] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-14T17:00:25.358804] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-14T17:00:25.805806] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T17:00:26.050198] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T17:00:26.158896] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-14T17:00:26.947800] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T17:00:26.958791] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-14T17:00:27.758858] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-14T17:00:28.013561] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T17:00:28.558850] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-14T17:00:29.326651] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:00:29.358805] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-14T17:00:30.048929] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T17:00:30.158905] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-14T17:00:30.958824] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-14T17:00:31.139470] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T17:00:31.472749] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:00:31.473564] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T17:00:31.480385] [INFO ] [REMOTE ] BBU: Full fetch complete (4401 records). [2025-09-14T17:00:31.480849] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-14T17:00:31.760355] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-14T17:00:31.843053] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-14T17:00:31.843156] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-14T17:00:31.843345] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-14T17:00:31.843412] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-14T17:00:31.843840] [DEBUG] [LOCAL ] BBU: Trimmed 4401 records to 3202 (keeping 150 days of data) [2025-09-14T17:00:31.864114] [DEBUG] [LOCAL ] BBU: Primary data saved (3202 records). [2025-09-14T17:00:31.864250] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-14T17:00:31.864405] [INFO ] [MAIN ] Update Progress: 226/2370 symbols completed. BBU took 25.4s. Estimated remaining: 3h 41m 23s. Rate: 9.7 symbols/min [2025-09-14T17:00:32.036551] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:32.064992] [DEBUG] [LOCAL ] BBWI: Loaded 24036 existing records from primary storage. [2025-09-14T17:00:32.065180] [INFO ] [MAIN ] BBWI: Loaded 24036 existing records. [2025-09-14T17:00:32.245967] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:32.246306] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-14T17:00:32.246383] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-14T17:00:32.247183] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-14T17:00:32.247258] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-14T17:00:32.563929] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-14T17:00:32.621523] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:32.983588] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T17:00:33.358823] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-14T17:00:34.158833] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-14T17:00:34.452346] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T17:00:34.493604] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T17:00:34.712574] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-14T17:00:34.958837] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-14T17:00:35.758806] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-14T17:00:36.127456] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T17:00:36.558838] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-14T17:00:36.766559] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T17:00:37.358870] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-14T17:00:37.652195] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:00:37.656044] [INFO ] [REMOTE ] BBW: Full fetch complete (28438 records). [2025-09-14T17:00:37.656178] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-14T17:00:38.020869] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-14T17:00:38.020979] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-14T17:00:38.021411] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-14T17:00:38.021463] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-14T17:00:38.022210] [DEBUG] [LOCAL ] BBW: Trimmed 28438 records to 19034 (keeping 150 days of data) [2025-09-14T17:00:38.135323] [DEBUG] [LOCAL ] BBW: Primary data saved (19034 records). [2025-09-14T17:00:38.135489] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-14T17:00:38.135583] [INFO ] [MAIN ] Update Progress: 227/2370 symbols completed. BBW took 16.1s. Estimated remaining: 3h 41m 18s. Rate: 9.7 symbols/min [2025-09-14T17:00:38.166458] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-14T17:00:38.312639] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:38.337683] [DEBUG] [LOCAL ] BBY: Loaded 23942 existing records from primary storage. [2025-09-14T17:00:38.337845] [INFO ] [MAIN ] BBY: Loaded 23942 existing records. [2025-09-14T17:00:38.512779] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:38.513068] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-14T17:00:38.513130] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-14T17:00:38.513749] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-14T17:00:38.513812] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-14T17:00:38.861326] [INFO ] [REMOTE ] BBY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:38.958815] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-14T17:00:39.245972] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T17:00:39.267214] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T17:00:39.758841] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-14T17:00:40.558831] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-14T17:00:40.608581] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T17:00:40.634751] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:00:40.636616] [INFO ] [REMOTE ] BBUC: Full fetch complete (14102 records). [2025-09-14T17:00:40.636727] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-14T17:00:40.996727] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-14T17:00:40.996908] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-14T17:00:40.997193] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-14T17:00:40.997274] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-14T17:00:40.997811] [DEBUG] [LOCAL ] BBUC: Trimmed 14102 records to 9469 (keeping 150 days of data) [2025-09-14T17:00:41.060679] [DEBUG] [LOCAL ] BBUC: Primary data saved (9469 records). [2025-09-14T17:00:41.060839] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-14T17:00:41.060933] [INFO ] [MAIN ] Update Progress: 228/2370 symbols completed. BBUC took 29.5s. Estimated remaining: 3h 40m 41s. Rate: 9.7 symbols/min [2025-09-14T17:00:41.230692] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:41.250132] [DEBUG] [LOCAL ] BC: Loaded 18992 existing records from primary storage. [2025-09-14T17:00:41.250290] [INFO ] [MAIN ] BC: Loaded 18992 existing records. [2025-09-14T17:00:41.364008] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-14T17:00:41.428910] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:41.429189] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-14T17:00:41.429252] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-14T17:00:41.429926] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-14T17:00:41.429993] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-14T17:00:41.782051] [INFO ] [REMOTE ] BC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:42.158831] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-14T17:00:42.372617] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T17:00:42.958796] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-14T17:00:43.426496] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T17:00:43.758859] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-14T17:00:44.032980] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:00:44.558840] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-14T17:00:44.953626] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:00:45.027895] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:00:45.358902] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-14T17:00:46.158877] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-14T17:00:46.216172] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:00:46.960776] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-14T17:00:46.966731] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T17:00:47.758835] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-14T17:00:48.076793] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:00:48.558796] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-14T17:00:48.607590] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T17:00:49.366382] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-14T17:00:49.385957] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:00:50.078561] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T17:00:50.085608] [INFO ] [REMOTE ] BBVA: Full fetch complete (53883 records). [2025-09-14T17:00:50.085853] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-14T17:00:50.164767] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-14T17:00:50.477227] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-14T17:00:50.477341] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-14T17:00:50.477956] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-14T17:00:50.478016] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-14T17:00:50.479635] [DEBUG] [LOCAL ] BBVA: Trimmed 53883 records to 36749 (keeping 150 days of data) [2025-09-14T17:00:50.712890] [DEBUG] [LOCAL ] BBVA: Primary data saved (36749 records). [2025-09-14T17:00:50.713081] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-14T17:00:50.713186] [INFO ] [MAIN ] Update Progress: 229/2370 symbols completed. BBVA took 38.2s. Estimated remaining: 3h 41m 7s. Rate: 9.7 symbols/min [2025-09-14T17:00:50.883819] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:50.900634] [DEBUG] [LOCAL ] BCAT: Loaded 15256 existing records from primary storage. [2025-09-14T17:00:50.900806] [INFO ] [MAIN ] BCAT: Loaded 15256 existing records. [2025-09-14T17:00:50.968787] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-14T17:00:51.087703] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:51.087948] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-14T17:00:51.088011] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-14T17:00:51.088533] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-14T17:00:51.088594] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-14T17:00:51.450991] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:51.499273] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-14T17:00:51.694443] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T17:00:51.758796] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-14T17:00:52.484176] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T17:00:52.558807] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-14T17:00:53.026127] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:00:53.358861] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-14T17:00:54.158852] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-14T17:00:54.359286] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:00:54.382382] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T17:00:54.958828] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-14T17:00:55.607576] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T17:00:55.758793] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-14T17:00:56.113134] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T17:00:56.558823] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-14T17:00:57.358831] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-14T17:00:57.665153] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T17:00:57.871215] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T17:00:58.158908] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-14T17:00:58.788888] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:00:58.793777] [INFO ] [REMOTE ] BC: Full fetch complete (48563 records). [2025-09-14T17:00:58.793926] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-14T17:00:58.967446] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-14T17:00:59.183601] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-14T17:00:59.183762] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-14T17:00:59.184482] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-14T17:00:59.184621] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-14T17:00:59.186040] [DEBUG] [LOCAL ] BC: Trimmed 48563 records to 33445 (keeping 150 days of data) [2025-09-14T17:00:59.317795] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:00:59.445383] [DEBUG] [LOCAL ] BC: Primary data saved (33445 records). [2025-09-14T17:00:59.445552] [INFO ] [MAIN ] BC: Full history saved. [2025-09-14T17:00:59.445665] [INFO ] [MAIN ] Update Progress: 230/2370 symbols completed. BC took 18.4s. Estimated remaining: 3h 41m 24s. Rate: 9.7 symbols/min [2025-09-14T17:00:59.614218] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:59.627183] [DEBUG] [LOCAL ] BCC: Loaded 12802 existing records from primary storage. [2025-09-14T17:00:59.627338] [INFO ] [MAIN ] BCC: Loaded 12802 existing records. [2025-09-14T17:00:59.767830] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-14T17:00:59.804619] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:59.804873] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-14T17:00:59.804930] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-14T17:00:59.805489] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-14T17:00:59.805552] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-14T17:01:00.175708] [INFO ] [REMOTE ] BCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:00.558824] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-14T17:01:00.978351] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T17:01:01.271970] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-14T17:01:01.358831] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-14T17:01:01.581961] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T17:01:02.023992] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:01:02.029516] [INFO ] [REMOTE ] BBY: Full fetch complete (58083 records). [2025-09-14T17:01:02.029700] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-14T17:01:02.174764] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-14T17:01:02.451762] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-14T17:01:02.451977] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-14T17:01:02.452845] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-14T17:01:02.452906] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-14T17:01:02.454344] [DEBUG] [LOCAL ] BBY: Trimmed 58083 records to 40251 (keeping 150 days of data) [2025-09-14T17:01:02.705171] [DEBUG] [LOCAL ] BBY: Primary data saved (40251 records). [2025-09-14T17:01:02.705352] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-14T17:01:02.705462] [INFO ] [MAIN ] Update Progress: 231/2370 symbols completed. BBY took 24.6s. Estimated remaining: 3h 40m 51s. Rate: 9.7 symbols/min [2025-09-14T17:01:02.871926] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:02.894997] [DEBUG] [LOCAL ] BCE: Loaded 23359 existing records from primary storage. [2025-09-14T17:01:02.895224] [INFO ] [MAIN ] BCE: Loaded 23359 existing records. [2025-09-14T17:01:02.967758] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-14T17:01:03.070739] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:03.071014] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-14T17:01:03.071072] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-14T17:01:03.071719] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-14T17:01:03.071782] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-14T17:01:03.436209] [INFO ] [REMOTE ] BCE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:03.598991] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T17:01:03.758883] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-14T17:01:04.507161] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:01:04.558815] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-14T17:01:05.121263] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T17:01:05.358919] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-14T17:01:06.146824] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:01:06.158836] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-14T17:01:06.515970] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:01:06.958835] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-14T17:01:07.758859] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-14T17:01:07.977386] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T17:01:08.336498] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T17:01:08.558905] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-14T17:01:09.323886] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T17:01:09.358897] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-14T17:01:09.902488] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T17:01:09.907717] [INFO ] [REMOTE ] BCAT: Full fetch complete (37537 records). [2025-09-14T17:01:09.907874] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-14T17:01:10.167450] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-14T17:01:10.328889] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-14T17:01:10.328991] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-14T17:01:10.329455] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-14T17:01:10.329509] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-14T17:01:10.330351] [DEBUG] [LOCAL ] BCAT: Trimmed 37537 records to 25422 (keeping 150 days of data) [2025-09-14T17:01:10.482588] [DEBUG] [LOCAL ] BCAT: Primary data saved (25422 records). [2025-09-14T17:01:10.482766] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-14T17:01:10.482866] [INFO ] [MAIN ] Update Progress: 232/2370 symbols completed. BCAT took 19.8s. Estimated remaining: 3h 40m 59s. Rate: 9.7 symbols/min [2025-09-14T17:01:10.651964] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:10.665672] [DEBUG] [LOCAL ] BCH: Loaded 13126 existing records from primary storage. [2025-09-14T17:01:10.665814] [INFO ] [MAIN ] BCH: Loaded 13126 existing records. [2025-09-14T17:01:10.838199] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T17:01:10.862687] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:10.863631] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-14T17:01:10.863716] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-14T17:01:10.864118] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-14T17:01:10.864176] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-14T17:01:10.961784] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-14T17:01:11.211282] [INFO ] [REMOTE ] BCH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:11.758834] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-14T17:01:12.146238] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T17:01:12.208942] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T17:01:12.451041] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T17:01:12.456715] [INFO ] [REMOTE ] BBWI: Full fetch complete (58228 records). [2025-09-14T17:01:12.456855] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-14T17:01:12.558805] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-14T17:01:12.844985] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-14T17:01:12.845093] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-14T17:01:12.846390] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-14T17:01:12.846461] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-14T17:01:12.847724] [DEBUG] [LOCAL ] BBWI: Trimmed 58228 records to 40331 (keeping 150 days of data) [2025-09-14T17:01:13.115091] [DEBUG] [LOCAL ] BBWI: Primary data saved (40331 records). [2025-09-14T17:01:13.115429] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-14T17:01:13.115531] [INFO ] [MAIN ] Update Progress: 233/2370 symbols completed. BBWI took 41.3s. Estimated remaining: 3h 40m 20s. Rate: 9.7 symbols/min [2025-09-14T17:01:13.285813] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:13.297675] [DEBUG] [LOCAL ] BCO: Loaded 11066 existing records from primary storage. [2025-09-14T17:01:13.297819] [INFO ] [MAIN ] BCO: Loaded 11066 existing records. [2025-09-14T17:01:13.364007] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-14T17:01:13.475175] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:13.475408] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-14T17:01:13.475478] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-14T17:01:13.476258] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-14T17:01:13.476326] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-14T17:01:13.820293] [INFO ] [REMOTE ] BCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:14.011495] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T17:01:14.158842] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-14T17:01:14.703407] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T17:01:14.958863] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-14T17:01:15.547259] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T17:01:15.758852] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-14T17:01:16.312288] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:01:16.316783] [INFO ] [REMOTE ] BCC: Full fetch complete (30971 records). [2025-09-14T17:01:16.316943] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-14T17:01:16.563961] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-14T17:01:16.755002] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-14T17:01:16.755237] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-14T17:01:16.755901] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-14T17:01:16.756032] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-14T17:01:16.757230] [DEBUG] [LOCAL ] BCC: Trimmed 30971 records to 20555 (keeping 150 days of data) [2025-09-14T17:01:16.899175] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T17:01:16.930188] [DEBUG] [LOCAL ] BCC: Primary data saved (20555 records). [2025-09-14T17:01:16.930348] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-14T17:01:16.930446] [INFO ] [MAIN ] Update Progress: 234/2370 symbols completed. BCC took 17.5s. Estimated remaining: 3h 39m 52s. Rate: 9.7 symbols/min [2025-09-14T17:01:17.102709] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:17.125753] [DEBUG] [LOCAL ] BCS: Loaded 23935 existing records from primary storage. [2025-09-14T17:01:17.125895] [INFO ] [MAIN ] BCS: Loaded 23935 existing records. [2025-09-14T17:01:17.304814] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:17.305071] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-14T17:01:17.305130] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-14T17:01:17.305930] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-14T17:01:17.305998] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-14T17:01:17.369448] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-14T17:01:17.664950] [INFO ] [REMOTE ] BCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:17.903466] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T17:01:18.158883] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-14T17:01:18.778159] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T17:01:18.958823] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-14T17:01:19.407906] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T17:01:19.758824] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-14T17:01:20.191202] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:01:20.558828] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-14T17:01:21.283735] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:01:21.358798] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-14T17:01:22.158849] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-14T17:01:22.319657] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:01:22.380803] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:01:22.958842] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-14T17:01:23.391757] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:01:23.758822] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-14T17:01:24.558851] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-14T17:01:24.618059] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:01:24.675812] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:01:25.358826] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-14T17:01:25.718295] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T17:01:26.158831] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-14T17:01:26.958910] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-14T17:01:27.104545] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:01:27.567453] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:01:27.758909] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-14T17:01:28.555355] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T17:01:28.564788] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-14T17:01:29.358866] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-14T17:01:29.438960] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T17:01:29.587431] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:01:30.158912] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-14T17:01:30.958837] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-14T17:01:31.234887] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T17:01:31.605141] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T17:01:31.610573] [INFO ] [REMOTE ] BCE: Full fetch complete (57019 records). [2025-09-14T17:01:31.610743] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-14T17:01:31.763913] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-14T17:01:32.007480] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-14T17:01:32.007678] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-14T17:01:32.008503] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-14T17:01:32.008590] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-14T17:01:32.026863] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T17:01:32.033245] [DEBUG] [LOCAL ] BCE: Trimmed 57019 records to 39338 (keeping 150 days of data) [2025-09-14T17:01:32.277949] [DEBUG] [LOCAL ] BCE: Primary data saved (39338 records). [2025-09-14T17:01:32.278140] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-14T17:01:32.278246] [INFO ] [MAIN ] Update Progress: 235/2370 symbols completed. BCE took 29.6s. Estimated remaining: 3h 41m 10s. Rate: 9.7 symbols/min [2025-09-14T17:01:32.449692] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:32.462790] [DEBUG] [LOCAL ] BCSF: Loaded 11633 existing records from primary storage. [2025-09-14T17:01:32.462952] [INFO ] [MAIN ] BCSF: Loaded 11633 existing records. [2025-09-14T17:01:32.561065] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-14T17:01:32.641984] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:32.642230] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-14T17:01:32.642306] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-14T17:01:32.642854] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-14T17:01:32.642916] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-14T17:01:33.010898] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:33.358846] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-14T17:01:33.888657] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T17:01:33.911780] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:01:33.915072] [INFO ] [REMOTE ] BCO: Full fetch complete (28737 records). [2025-09-14T17:01:33.923854] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-14T17:01:33.967756] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:01:34.163930] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-14T17:01:34.326834] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-14T17:01:34.326957] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-14T17:01:34.327440] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-14T17:01:34.327500] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-14T17:01:34.328441] [DEBUG] [LOCAL ] BCO: Trimmed 28737 records to 19472 (keeping 150 days of data) [2025-09-14T17:01:34.448147] [DEBUG] [LOCAL ] BCO: Primary data saved (19472 records). [2025-09-14T17:01:34.448335] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-14T17:01:34.448455] [INFO ] [MAIN ] Update Progress: 236/2370 symbols completed. BCO took 21.3s. Estimated remaining: 3h 40m 27s. Rate: 9.7 symbols/min [2025-09-14T17:01:34.618951] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:34.629606] [DEBUG] [LOCAL ] BCX: Loaded 9193 existing records from primary storage. [2025-09-14T17:01:34.629792] [INFO ] [MAIN ] BCX: Loaded 9193 existing records. [2025-09-14T17:01:34.806445] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:34.806753] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-14T17:01:34.806824] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-14T17:01:34.807232] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-14T17:01:34.807311] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-14T17:01:34.967479] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-14T17:01:35.178552] [INFO ] [REMOTE ] BCX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:35.341791] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:01:35.758834] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-14T17:01:36.558821] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-14T17:01:36.824571] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:01:37.011771] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T17:01:37.358820] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-14T17:01:37.661383] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T17:01:38.158838] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-14T17:01:38.524807] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:01:38.958841] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-14T17:01:39.091545] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T17:01:39.095999] [INFO ] [REMOTE ] BCH: Full fetch complete (31815 records). [2025-09-14T17:01:39.096188] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-14T17:01:39.489220] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-14T17:01:39.489358] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-14T17:01:39.489888] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-14T17:01:39.489981] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-14T17:01:39.491301] [DEBUG] [LOCAL ] BCH: Trimmed 31815 records to 21766 (keeping 150 days of data) [2025-09-14T17:01:39.621768] [DEBUG] [LOCAL ] BCH: Primary data saved (21766 records). [2025-09-14T17:01:39.621961] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-14T17:01:39.622121] [INFO ] [MAIN ] Update Progress: 237/2370 symbols completed. BCH took 29.1s. Estimated remaining: 3h 40m 11s. Rate: 9.7 symbols/min [2025-09-14T17:01:39.758836] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-14T17:01:40.558863] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-14T17:01:40.957754] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T17:01:41.176864] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T17:01:41.358856] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-14T17:01:41.447108] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T17:01:42.158847] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-14T17:01:42.403940] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T17:01:42.958825] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-14T17:01:43.758901] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-14T17:01:43.868342] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:01:43.989427] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T17:01:44.558866] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-14T17:01:44.843902] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T17:01:45.358840] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-14T17:01:46.158851] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-14T17:01:46.479699] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T17:01:46.518974] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T17:01:46.958839] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-14T17:01:47.436377] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T17:01:47.758845] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-14T17:01:48.226812] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T17:01:48.232318] [INFO ] [REMOTE ] BCS: Full fetch complete (58127 records). [2025-09-14T17:01:48.232458] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-14T17:01:48.564019] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-14T17:01:48.649481] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-14T17:01:48.649797] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-14T17:01:48.650718] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-14T17:01:48.650963] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-14T17:01:48.670325] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T17:01:48.677357] [DEBUG] [LOCAL ] BCS: Trimmed 58127 records to 40235 (keeping 150 days of data) [2025-09-14T17:01:48.959740] [DEBUG] [LOCAL ] BCS: Primary data saved (40235 records). [2025-09-14T17:01:48.959965] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-14T17:01:48.960123] [INFO ] [MAIN ] Update Progress: 238/2370 symbols completed. BCS took 32.0s. Estimated remaining: 3h 40m 33s. Rate: 9.7 symbols/min [2025-09-14T17:01:49.358835] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-14T17:01:49.828630] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:01:50.065992] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:01:50.069117] [INFO ] [REMOTE ] BCSF: Full fetch complete (29482 records). [2025-09-14T17:01:50.069257] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-14T17:01:50.164911] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-14T17:01:50.456605] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-14T17:01:50.456733] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-14T17:01:50.457192] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-14T17:01:50.457249] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-14T17:01:50.458021] [DEBUG] [LOCAL ] BCSF: Trimmed 29482 records to 19447 (keeping 150 days of data) [2025-09-14T17:01:50.575315] [DEBUG] [LOCAL ] BCSF: Primary data saved (19447 records). [2025-09-14T17:01:50.575493] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-14T17:01:50.575604] [INFO ] [MAIN ] Update Progress: 239/2370 symbols completed. BCSF took 18.3s. Estimated remaining: 3h 39m 46s. Rate: 9.7 symbols/min [2025-09-14T17:01:50.928608] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T17:01:50.958816] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-14T17:01:51.634501] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:01:51.636881] [INFO ] [REMOTE ] BCX: Full fetch complete (24186 records). [2025-09-14T17:01:51.636975] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-14T17:01:52.016991] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-14T17:01:52.017103] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-14T17:01:52.017457] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-14T17:01:52.017507] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-14T17:01:52.018195] [DEBUG] [LOCAL ] BCX: Trimmed 24186 records to 15656 (keeping 150 days of data) [2025-09-14T17:01:52.114484] [DEBUG] [LOCAL ] BCX: Primary data saved (15656 records). [2025-09-14T17:01:52.114700] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-14T17:01:52.114808] [INFO ] [MAIN ] Update Progress: 240/2370 symbols completed. BCX took 17.7s. Estimated remaining: 3h 38m 59s. Rate: 9.7 symbols/min [2025-09-14T17:01:52.736731] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:52.781698] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:52.818790] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:52.837703] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:52.871615] [DEBUG] [LOCAL ] BDC: Loaded 10970 existing records from primary storage. [2025-09-14T17:01:52.872102] [DEBUG] [LOCAL ] BDJ: Loaded 13207 existing records from primary storage. [2025-09-14T17:01:52.872541] [INFO ] [MAIN ] BDJ: Loaded 13207 existing records. [2025-09-14T17:01:52.872635] [INFO ] [MAIN ] BDC: Loaded 10970 existing records. [2025-09-14T17:01:53.133953] [DEBUG] [LOCAL ] BDX: Loaded 23585 existing records from primary storage. [2025-09-14T17:01:53.100793] [DEBUG] [LOCAL ] BDN: Loaded 21311 existing records from primary storage. [2025-09-14T17:01:53.162891] [INFO ] [MAIN ] BDN: Loaded 21311 existing records. [2025-09-14T17:01:53.187590] [INFO ] [MAIN ] BDX: Loaded 23585 existing records. [2025-09-14T17:01:53.216394] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:53.258097] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-14T17:01:53.435176] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:53.416047] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-14T17:01:53.470273] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-14T17:01:53.465140] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-14T17:01:53.528438] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-14T17:01:53.527128] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-14T17:01:53.549602] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-14T17:01:53.631137] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-14T17:01:53.745344] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:53.867936] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-14T17:01:53.846923] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:53.888804] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-14T17:01:53.909851] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-14T17:01:53.925884] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-14T17:01:54.015854] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-14T17:01:53.983952] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-14T17:01:54.171188] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-14T17:01:54.319733] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-14T17:01:54.745125] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:54.759753] [INFO ] [REMOTE ] BDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:54.803620] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-14T17:01:54.835977] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-14T17:01:55.130145] [INFO ] [REMOTE ] BDN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:55.173273] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-14T17:01:55.194930] [INFO ] [REMOTE ] BDX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:55.195304] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-14T17:01:56.258057] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T17:01:56.264572] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-14T17:01:56.325921] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:01:56.331560] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-14T17:01:56.412251] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:01:56.558826] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-14T17:01:56.908766] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T17:01:57.358810] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-14T17:01:57.572076] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T17:01:57.697563] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:01:58.136818] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T17:01:58.158783] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-14T17:01:58.731788] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T17:01:58.958866] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-14T17:01:59.548853] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T17:01:59.758841] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-14T17:02:00.558833] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-14T17:02:00.939606] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:02:01.049117] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:02:01.358869] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-14T17:02:02.127858] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:02:02.158784] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-14T17:02:02.316390] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T17:02:02.958855] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-14T17:02:03.547413] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:02:03.758850] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-14T17:02:04.558832] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-14T17:02:05.082775] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-14T17:02:05.330232] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T17:02:05.358776] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-14T17:02:05.416162] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:02:06.158842] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-14T17:02:06.796059] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:02:06.958851] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-14T17:02:07.577459] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T17:02:07.758802] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-14T17:02:08.187230] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:02:08.558851] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-14T17:02:09.358833] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-14T17:02:09.433145] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T17:02:09.919216] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T17:02:10.158877] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-14T17:02:10.683868] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:02:10.687269] [INFO ] [REMOTE ] BDC: Full fetch complete (27418 records). [2025-09-14T17:02:10.687463] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-14T17:02:10.962581] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-14T17:02:11.052108] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:02:11.119476] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-14T17:02:11.120109] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-14T17:02:11.120995] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-14T17:02:11.121092] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-14T17:02:11.122129] [DEBUG] [LOCAL ] BDC: Trimmed 27418 records to 17994 (keeping 150 days of data) [2025-09-14T17:02:11.246035] [DEBUG] [LOCAL ] BDC: Primary data saved (17994 records). [2025-09-14T17:02:11.246255] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-14T17:02:11.246387] [INFO ] [MAIN ] Update Progress: 241/2370 symbols completed. BDC took 19.1s. Estimated remaining: 3h 40m 47s. Rate: 9.6 symbols/min [2025-09-14T17:02:11.443793] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:11.469341] [DEBUG] [LOCAL ] BE: Loaded 24049 existing records from primary storage. [2025-09-14T17:02:11.469552] [INFO ] [MAIN ] BE: Loaded 24049 existing records. [2025-09-14T17:02:11.660542] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:11.660911] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-14T17:02:11.661008] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-14T17:02:11.661896] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-14T17:02:11.661992] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-14T17:02:11.765603] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-14T17:02:12.043808] [INFO ] [REMOTE ] BE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:12.558833] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-14T17:02:12.696200] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:02:12.738313] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T17:02:12.741451] [INFO ] [REMOTE ] BDJ: Full fetch complete (31880 records). [2025-09-14T17:02:12.741551] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-14T17:02:13.118982] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-14T17:02:13.119136] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-14T17:02:13.119611] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-14T17:02:13.119686] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-14T17:02:13.120574] [DEBUG] [LOCAL ] BDJ: Trimmed 31880 records to 21798 (keeping 150 days of data) [2025-09-14T17:02:13.252412] [DEBUG] [LOCAL ] BDJ: Primary data saved (21798 records). [2025-09-14T17:02:13.252571] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-14T17:02:13.252697] [INFO ] [MAIN ] Update Progress: 242/2370 symbols completed. BDJ took 21.1s. Estimated remaining: 3h 40m 4s. Rate: 9.7 symbols/min [2025-09-14T17:02:13.363961] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-14T17:02:13.432134] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:13.434311] [DEBUG] [LOCAL ] BEDU: Loaded 178 existing records from primary storage. [2025-09-14T17:02:13.434397] [INFO ] [MAIN ] BEDU: Loaded 178 existing records. [2025-09-14T17:02:13.615606] [WARN ] [MAIN ] BEDU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:13.615889] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-14T17:02:13.615949] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-14T17:02:13.616154] [DEBUG] [LOCAL ] BEDU: Deleted primary data file. [2025-09-14T17:02:13.616211] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-14T17:02:13.998999] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:14.069808] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T17:02:14.158861] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-14T17:02:14.533227] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-14T17:02:14.958865] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-14T17:02:15.176548] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:02:15.758861] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-14T17:02:16.305776] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:02:16.427138] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:02:16.432888] [INFO ] [REMOTE ] BDX: Full fetch complete (56927 records). [2025-09-14T17:02:16.433033] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-14T17:02:16.564022] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-14T17:02:16.836074] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-14T17:02:16.836250] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-14T17:02:16.836980] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-14T17:02:16.837048] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-14T17:02:16.839756] [DEBUG] [LOCAL ] BDX: Trimmed 56927 records to 39715 (keeping 150 days of data) [2025-09-14T17:02:17.110749] [DEBUG] [LOCAL ] BDX: Primary data saved (39715 records). [2025-09-14T17:02:17.110941] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-14T17:02:17.111085] [INFO ] [MAIN ] Update Progress: 243/2370 symbols completed. BDX took 25.0s. Estimated remaining: 3h 39m 37s. Rate: 9.7 symbols/min [2025-09-14T17:02:17.207669] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T17:02:17.290069] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:17.315247] [DEBUG] [LOCAL ] BEKE: Loaded 23755 existing records from primary storage. [2025-09-14T17:02:17.315456] [INFO ] [MAIN ] BEKE: Loaded 23755 existing records. [2025-09-14T17:02:17.368482] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-14T17:02:17.504185] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:17.504541] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-14T17:02:17.504613] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-14T17:02:17.505347] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-14T17:02:17.505438] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-14T17:02:17.879730] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:17.893011] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T17:02:18.158855] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-14T17:02:18.958825] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-14T17:02:19.356909] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T17:02:19.758866] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-14T17:02:19.992729] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T17:02:20.558918] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-14T17:02:21.358889] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-14T17:02:21.783868] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T17:02:21.853664] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:02:22.158867] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-14T17:02:22.958823] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-14T17:02:23.343676] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T17:02:23.758894] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-14T17:02:24.017679] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:02:24.052961] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-14T17:02:24.160702] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T17:02:24.558838] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-14T17:02:24.894126] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:02:24.899310] [INFO ] [REMOTE ] BDN: Full fetch complete (51753 records). [2025-09-14T17:02:24.899458] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-14T17:02:25.298673] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-14T17:02:25.298789] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-14T17:02:25.299408] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-14T17:02:25.299477] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-14T17:02:25.300664] [DEBUG] [LOCAL ] BDN: Trimmed 51753 records to 35556 (keeping 150 days of data) [2025-09-14T17:02:25.364512] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-14T17:02:25.519950] [DEBUG] [LOCAL ] BDN: Primary data saved (35556 records). [2025-09-14T17:02:25.520135] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-14T17:02:25.520271] [INFO ] [MAIN ] Update Progress: 244/2370 symbols completed. BDN took 33.4s. Estimated remaining: 3h 39m 50s. Rate: 9.7 symbols/min [2025-09-14T17:02:25.697517] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:25.722303] [DEBUG] [LOCAL ] BEN: Loaded 23709 existing records from primary storage. [2025-09-14T17:02:25.722499] [INFO ] [MAIN ] BEN: Loaded 23709 existing records. [2025-09-14T17:02:25.905357] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:25.905639] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-14T17:02:25.905716] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-14T17:02:25.906483] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-14T17:02:25.906558] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-14T17:02:26.163998] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-14T17:02:26.268709] [INFO ] [REMOTE ] BEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:26.531350] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T17:02:26.958873] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-14T17:02:27.299597] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T17:02:27.758880] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-14T17:02:28.024203] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-14T17:02:28.558863] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-14T17:02:28.633786] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:02:29.358860] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-14T17:02:29.671284] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:02:29.672062] [INFO ] [REMOTE ] BEDU: Full fetch complete (911 records). [2025-09-14T17:02:29.672155] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-14T17:02:29.848285] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 122 unique days, need 150 days [2025-09-14T17:02:29.848462] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:02:29.848513] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:02:29.848583] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-14T17:02:29.848689] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-14T17:02:29.848746] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-14T17:02:29.848816] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-14T17:02:29.848904] [INFO ] [MAIN ] Update Progress: 245/2370 symbols completed. BEDU took 16.6s. Estimated remaining: 3h 39m 28s. Rate: 9.7 symbols/min [2025-09-14T17:02:30.017245] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:30.037263] [DEBUG] [LOCAL ] BEP: Loaded 16629 existing records from primary storage. [2025-09-14T17:02:30.037416] [INFO ] [MAIN ] BEP: Loaded 16629 existing records. [2025-09-14T17:02:30.163977] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-14T17:02:30.224062] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:30.224410] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-14T17:02:30.224480] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-14T17:02:30.225102] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-14T17:02:30.225173] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-14T17:02:30.620491] [INFO ] [REMOTE ] BEP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:30.657125] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-14T17:02:30.958831] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-14T17:02:31.758889] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-14T17:02:32.042975] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T17:02:32.248275] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:02:32.558839] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-14T17:02:33.144452] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:02:33.358836] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-14T17:02:34.158832] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-14T17:02:34.341317] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:02:34.878188] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T17:02:34.958863] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-14T17:02:35.758905] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-14T17:02:36.075997] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:02:36.558893] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-14T17:02:36.612527] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T17:02:37.358827] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-14T17:02:37.715614] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:02:38.158823] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-14T17:02:38.503876] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T17:02:38.920115] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:02:38.958786] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-14T17:02:39.625504] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T17:02:39.758830] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-14T17:02:40.224093] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T17:02:40.558832] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-14T17:02:41.358838] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-14T17:02:42.158853] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-14T17:02:42.234580] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-14T17:02:42.363215] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T17:02:42.405706] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T17:02:42.958837] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-14T17:02:43.758841] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-14T17:02:44.002240] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:02:44.108714] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T17:02:44.558839] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-14T17:02:45.358902] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-14T17:02:45.514860] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:02:46.158863] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-14T17:02:46.368713] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:02:46.619754] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:02:46.793947] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:02:46.799598] [INFO ] [REMOTE ] BEN: Full fetch complete (57721 records). [2025-09-14T17:02:46.799807] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-14T17:02:46.972172] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-14T17:02:47.187087] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-14T17:02:47.187197] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-14T17:02:47.187889] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-14T17:02:47.187950] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-14T17:02:47.189169] [DEBUG] [LOCAL ] BEN: Trimmed 57721 records to 39969 (keeping 150 days of data) [2025-09-14T17:02:47.432448] [DEBUG] [LOCAL ] BEN: Primary data saved (39969 records). [2025-09-14T17:02:47.432619] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-14T17:02:47.432740] [INFO ] [MAIN ] Update Progress: 246/2370 symbols completed. BEN took 21.9s. Estimated remaining: 3h 40m 60s. Rate: 9.6 symbols/min [2025-09-14T17:02:47.601575] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:47.621504] [DEBUG] [LOCAL ] BEPC: Loaded 20434 existing records from primary storage. [2025-09-14T17:02:47.621678] [INFO ] [MAIN ] BEPC: Loaded 20434 existing records. [2025-09-14T17:02:47.763901] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-14T17:02:47.799046] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:47.799276] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-14T17:02:47.799335] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-14T17:02:47.800049] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-14T17:02:47.800114] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-14T17:02:48.152871] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:48.170312] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:02:48.174222] [INFO ] [REMOTE ] BEP: Full fetch complete (42848 records). [2025-09-14T17:02:48.174334] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-14T17:02:48.540809] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-14T17:02:48.540912] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-14T17:02:48.541447] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-14T17:02:48.541529] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-14T17:02:48.542477] [DEBUG] [LOCAL ] BEP: Trimmed 42848 records to 28134 (keeping 150 days of data) [2025-09-14T17:02:48.602462] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-14T17:02:48.722825] [DEBUG] [LOCAL ] BEP: Primary data saved (28134 records). [2025-09-14T17:02:48.722984] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-14T17:02:48.723082] [INFO ] [MAIN ] Update Progress: 247/2370 symbols completed. BEP took 18.9s. Estimated remaining: 3h 40m 11s. Rate: 9.6 symbols/min [2025-09-14T17:02:48.895682] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:48.899721] [DEBUG] [LOCAL ] BEPH: Loaded 2172 existing records from primary storage. [2025-09-14T17:02:48.899828] [INFO ] [MAIN ] BEPH: Loaded 2172 existing records. [2025-09-14T17:02:49.081209] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:49.081491] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-14T17:02:49.081554] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-14T17:02:49.081778] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-14T17:02:49.081837] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-14T17:02:49.358943] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-14T17:02:49.437220] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:49.569317] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-14T17:02:49.574858] [INFO ] [REMOTE ] BEKE: Full fetch complete (57952 records). [2025-09-14T17:02:49.574994] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-14T17:02:49.961437] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-14T17:02:49.961597] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-14T17:02:49.962713] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-14T17:02:49.962801] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-14T17:02:49.964853] [DEBUG] [LOCAL ] BEKE: Trimmed 57952 records to 40023 (keeping 150 days of data) [2025-09-14T17:02:50.171433] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-14T17:02:50.214629] [DEBUG] [LOCAL ] BEKE: Primary data saved (40023 records). [2025-09-14T17:02:50.215056] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-14T17:02:50.215190] [INFO ] [MAIN ] Update Progress: 248/2370 symbols completed. BEKE took 33.1s. Estimated remaining: 3h 39m 24s. Rate: 9.7 symbols/min [2025-09-14T17:02:50.390191] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:50.416373] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T17:02:50.418247] [DEBUG] [LOCAL ] BEPI: Loaded 1359 existing records from primary storage. [2025-09-14T17:02:50.427683] [INFO ] [MAIN ] BEPI: Loaded 1359 existing records. [2025-09-14T17:02:50.600449] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:50.600787] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-14T17:02:50.600888] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-14T17:02:50.601134] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-14T17:02:50.601201] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-14T17:02:50.709044] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T17:02:50.957528] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:50.963874] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-14T17:02:50.972681] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T17:02:50.978795] [INFO ] [REMOTE ] BE: Full fetch complete (58322 records). [2025-09-14T17:02:50.978914] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-14T17:02:51.364887] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-14T17:02:51.365006] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-14T17:02:51.365686] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-14T17:02:51.365748] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-14T17:02:51.368242] [DEBUG] [LOCAL ] BE: Trimmed 58322 records to 40401 (keeping 150 days of data) [2025-09-14T17:02:51.554823] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T17:02:51.618230] [DEBUG] [LOCAL ] BE: Primary data saved (40401 records). [2025-09-14T17:02:51.618381] [INFO ] [MAIN ] BE: Full history saved. [2025-09-14T17:02:51.618474] [INFO ] [MAIN ] Update Progress: 249/2370 symbols completed. BE took 40.4s. Estimated remaining: 3h 38m 37s. Rate: 9.7 symbols/min [2025-09-14T17:02:51.763948] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-14T17:02:51.788049] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:51.792768] [DEBUG] [LOCAL ] BEPJ: Loaded 1797 existing records from primary storage. [2025-09-14T17:02:51.792873] [INFO ] [MAIN ] BEPJ: Loaded 1797 existing records. [2025-09-14T17:02:51.969886] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:51.970183] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-14T17:02:51.970262] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-14T17:02:51.970596] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-14T17:02:51.970694] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-14T17:02:52.328320] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:52.334808] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T17:02:52.558872] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-14T17:02:53.358840] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-14T17:02:53.805097] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T17:02:54.158839] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-14T17:02:54.394628] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:02:54.838207] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T17:02:54.958826] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-14T17:02:55.619767] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T17:02:55.758845] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-14T17:02:56.558856] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-14T17:02:57.032816] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T17:02:57.358829] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-14T17:02:57.441846] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:02:57.870968] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T17:02:58.158855] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-14T17:02:58.600221] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T17:02:58.958804] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-14T17:02:59.544592] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T17:02:59.758857] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-14T17:03:00.265061] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T17:03:00.558811] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-14T17:03:01.136822] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-14T17:03:01.358853] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-14T17:03:02.158869] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-14T17:03:02.958888] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-14T17:03:03.412281] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-14T17:03:03.413185] [INFO ] [REMOTE ] BEPI: Full fetch complete (3684 records). [2025-09-14T17:03:03.413269] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-14T17:03:03.765456] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-14T17:03:03.771206] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-14T17:03:03.772081] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-14T17:03:03.772259] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-14T17:03:03.772332] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-14T17:03:03.773105] [DEBUG] [LOCAL ] BEPI: Trimmed 3684 records to 2735 (keeping 150 days of data) [2025-09-14T17:03:03.791842] [DEBUG] [LOCAL ] BEPI: Primary data saved (2735 records). [2025-09-14T17:03:03.791962] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-14T17:03:03.792104] [INFO ] [MAIN ] Update Progress: 250/2370 symbols completed. BEPI took 13.6s. Estimated remaining: 3h 39m 22s. Rate: 9.7 symbols/min [2025-09-14T17:03:03.968248] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:03.976458] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T17:03:03.995417] [DEBUG] [LOCAL ] BFAM: Loaded 15271 existing records from primary storage. [2025-09-14T17:03:03.995600] [INFO ] [MAIN ] BFAM: Loaded 15271 existing records. [2025-09-14T17:03:04.179014] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:04.179374] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-14T17:03:04.179454] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-14T17:03:04.180153] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-14T17:03:04.180237] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-14T17:03:04.465794] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:03:04.542661] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:04.558766] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-14T17:03:05.358841] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-14T17:03:05.906709] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-14T17:03:05.972695] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T17:03:06.038528] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T17:03:06.158827] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-14T17:03:06.958881] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-14T17:03:07.431054] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:03:07.632143] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T17:03:07.758825] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-14T17:03:08.204974] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T17:03:08.558856] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-14T17:03:08.920161] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-14T17:03:09.358840] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-14T17:03:09.703983] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:03:09.704862] [INFO ] [REMOTE ] BEPJ: Full fetch complete (3520 records). [2025-09-14T17:03:09.704949] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-14T17:03:10.071930] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-14T17:03:10.072042] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-14T17:03:10.072178] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-14T17:03:10.072230] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-14T17:03:10.072682] [DEBUG] [LOCAL ] BEPJ: Trimmed 3520 records to 2618 (keeping 150 days of data) [2025-09-14T17:03:10.089333] [DEBUG] [LOCAL ] BEPJ: Primary data saved (2618 records). [2025-09-14T17:03:10.089441] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-14T17:03:10.089531] [INFO ] [MAIN ] Update Progress: 251/2370 symbols completed. BEPJ took 18.5s. Estimated remaining: 3h 39m 16s. Rate: 9.7 symbols/min [2025-09-14T17:03:10.163909] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-14T17:03:10.263794] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:10.282004] [DEBUG] [LOCAL ] BFH: Loaded 17286 existing records from primary storage. [2025-09-14T17:03:10.282221] [INFO ] [MAIN ] BFH: Loaded 17286 existing records. [2025-09-14T17:03:10.471268] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:10.471588] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-14T17:03:10.471666] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-14T17:03:10.472259] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-14T17:03:10.472329] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-14T17:03:10.829715] [INFO ] [REMOTE ] BFH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:10.874753] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T17:03:10.958898] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-14T17:03:11.758844] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-14T17:03:12.439409] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T17:03:12.558832] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-14T17:03:13.358921] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-14T17:03:13.406532] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T17:03:14.158919] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-14T17:03:14.528682] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T17:03:14.958868] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-14T17:03:15.014533] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-14T17:03:15.758961] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-14T17:03:15.791456] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:03:16.043301] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:03:16.558871] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-14T17:03:17.358858] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-14T17:03:17.424630] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T17:03:18.158932] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-14T17:03:18.263891] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T17:03:18.701742] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:03:18.958839] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-14T17:03:19.610184] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T17:03:19.758923] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-14T17:03:20.391633] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T17:03:20.406744] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:03:20.558849] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-14T17:03:21.117140] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:03:21.118222] [INFO ] [REMOTE ] BEPH: Full fetch complete (5748 records). [2025-09-14T17:03:21.118321] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-14T17:03:21.363915] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-14T17:03:21.473157] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-14T17:03:21.473255] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-14T17:03:21.473445] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-14T17:03:21.473516] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-14T17:03:21.473960] [DEBUG] [LOCAL ] BEPH: Trimmed 5748 records to 3539 (keeping 150 days of data) [2025-09-14T17:03:21.495826] [DEBUG] [LOCAL ] BEPH: Primary data saved (3539 records). [2025-09-14T17:03:21.495918] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-14T17:03:21.496004] [INFO ] [MAIN ] Update Progress: 252/2370 symbols completed. BEPH took 32.8s. Estimated remaining: 3h 39m 54s. Rate: 9.6 symbols/min [2025-09-14T17:03:21.668482] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:21.675490] [DEBUG] [LOCAL ] BFK: Loaded 5499 existing records from primary storage. [2025-09-14T17:03:21.675626] [INFO ] [MAIN ] BFK: Loaded 5499 existing records. [2025-09-14T17:03:21.865359] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:21.865803] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-14T17:03:21.865875] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-14T17:03:21.866204] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-14T17:03:21.866263] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-14T17:03:22.163927] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-14T17:03:22.228902] [INFO ] [REMOTE ] BFK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:22.565120] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:03:22.570080] [INFO ] [REMOTE ] BEPC: Full fetch complete (51011 records). [2025-09-14T17:03:22.570235] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-14T17:03:22.959491] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-14T17:03:22.960844] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-14T17:03:22.960973] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-14T17:03:22.961571] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-14T17:03:22.961728] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-14T17:03:22.962965] [DEBUG] [LOCAL ] BEPC: Trimmed 51011 records to 34353 (keeping 150 days of data) [2025-09-14T17:03:23.177925] [DEBUG] [LOCAL ] BEPC: Primary data saved (34353 records). [2025-09-14T17:03:23.178100] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-14T17:03:23.178201] [INFO ] [MAIN ] Update Progress: 253/2370 symbols completed. BEPC took 35.7s. Estimated remaining: 3h 39m 10s. Rate: 9.7 symbols/min [2025-09-14T17:03:23.346001] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:23.368972] [DEBUG] [LOCAL ] BFLY: Loaded 23140 existing records from primary storage. [2025-09-14T17:03:23.369129] [INFO ] [MAIN ] BFLY: Loaded 23140 existing records. [2025-09-14T17:03:23.560328] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:23.560629] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-14T17:03:23.560710] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-14T17:03:23.561426] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-14T17:03:23.561495] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-14T17:03:23.759973] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-14T17:03:23.948934] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:23.976591] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T17:03:24.372324] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:03:24.558828] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-14T17:03:24.601789] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T17:03:25.358828] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-14T17:03:26.121440] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T17:03:26.152440] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T17:03:26.158777] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-14T17:03:26.958874] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-14T17:03:27.265016] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:03:27.758862] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-14T17:03:28.558824] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-14T17:03:28.602141] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T17:03:28.656052] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:03:29.358834] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-14T17:03:30.110528] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T17:03:30.157405] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T17:03:30.160577] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-14T17:03:30.958854] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-14T17:03:31.486139] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T17:03:31.490192] [INFO ] [REMOTE ] BFAM: Full fetch complete (35521 records). [2025-09-14T17:03:31.490359] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-14T17:03:31.768806] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-14T17:03:31.912328] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T17:03:31.912463] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-14T17:03:31.916049] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-14T17:03:31.917358] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-14T17:03:31.917440] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-14T17:03:31.919068] [DEBUG] [LOCAL ] BFAM: Trimmed 35521 records to 24802 (keeping 150 days of data) [2025-09-14T17:03:32.079987] [DEBUG] [LOCAL ] BFAM: Primary data saved (24802 records). [2025-09-14T17:03:32.080209] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-14T17:03:32.080331] [INFO ] [MAIN ] Update Progress: 254/2370 symbols completed. BFAM took 28.3s. Estimated remaining: 3h 39m 26s. Rate: 9.6 symbols/min [2025-09-14T17:03:32.255035] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:32.262947] [DEBUG] [LOCAL ] BFS: Loaded 4384 existing records from primary storage. [2025-09-14T17:03:32.263151] [INFO ] [MAIN ] BFS: Loaded 4384 existing records. [2025-09-14T17:03:32.448624] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:32.448901] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-14T17:03:32.448962] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-14T17:03:32.449350] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-14T17:03:32.449410] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-14T17:03:32.563999] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-14T17:03:32.804233] [INFO ] [REMOTE ] BFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:33.095999] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:03:33.358899] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-14T17:03:34.100400] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T17:03:34.158862] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-14T17:03:34.776251] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:03:34.780762] [INFO ] [REMOTE ] BFH: Full fetch complete (45399 records). [2025-09-14T17:03:34.780883] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-14T17:03:34.967781] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-14T17:03:35.184038] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-14T17:03:35.184245] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-14T17:03:35.184977] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-14T17:03:35.185133] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-14T17:03:35.187121] [DEBUG] [LOCAL ] BFH: Trimmed 45399 records to 30776 (keeping 150 days of data) [2025-09-14T17:03:35.224130] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:03:35.435769] [DEBUG] [LOCAL ] BFH: Primary data saved (30776 records). [2025-09-14T17:03:35.436022] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-14T17:03:35.436175] [INFO ] [MAIN ] Update Progress: 255/2370 symbols completed. BFH took 25.3s. Estimated remaining: 3h 38m 56s. Rate: 9.7 symbols/min [2025-09-14T17:03:35.615528] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:35.623754] [DEBUG] [LOCAL ] BFZ: Loaded 5111 existing records from primary storage. [2025-09-14T17:03:35.623992] [INFO ] [MAIN ] BFZ: Loaded 5111 existing records. [2025-09-14T17:03:35.773800] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-14T17:03:35.817832] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:35.818233] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-14T17:03:35.818311] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-14T17:03:35.818699] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-14T17:03:35.818767] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-14T17:03:35.943229] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T17:03:36.205851] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:36.558863] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-14T17:03:37.358839] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-14T17:03:37.440917] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:03:37.661112] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T17:03:38.158895] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-14T17:03:38.371898] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T17:03:38.958884] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-14T17:03:39.074688] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T17:03:39.751518] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:03:39.758759] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-14T17:03:40.558827] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-14T17:03:40.590046] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T17:03:40.592906] [INFO ] [REMOTE ] BFK: Full fetch complete (14521 records). [2025-09-14T17:03:40.593022] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-14T17:03:40.969352] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-14T17:03:40.969512] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-14T17:03:40.970090] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-14T17:03:40.970161] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-14T17:03:40.970832] [DEBUG] [LOCAL ] BFK: Trimmed 14521 records to 10011 (keeping 150 days of data) [2025-09-14T17:03:41.040372] [DEBUG] [LOCAL ] BFK: Primary data saved (10011 records). [2025-09-14T17:03:41.040626] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-14T17:03:41.040789] [INFO ] [MAIN ] Update Progress: 256/2370 symbols completed. BFK took 19.5s. Estimated remaining: 3h 38m 45s. Rate: 9.7 symbols/min [2025-09-14T17:03:41.228084] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:41.251967] [DEBUG] [LOCAL ] BG: Loaded 22942 existing records from primary storage. [2025-09-14T17:03:41.252213] [INFO ] [MAIN ] BG: Loaded 22942 existing records. [2025-09-14T17:03:41.363263] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-14T17:03:41.447850] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:41.448815] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-14T17:03:41.449779] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-14T17:03:41.449264] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:03:41.453400] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-14T17:03:41.453918] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-14T17:03:41.834961] [INFO ] [REMOTE ] BG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:42.158845] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-14T17:03:42.958837] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-14T17:03:42.981182] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:03:43.284542] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:03:43.495697] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T17:03:43.758823] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-14T17:03:44.522788] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T17:03:44.558835] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-14T17:03:45.358831] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-14T17:03:46.158814] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-14T17:03:46.188447] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:03:46.231412] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:03:46.960738] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-14T17:03:46.963583] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T17:03:47.758842] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-14T17:03:48.558823] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-14T17:03:48.724836] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:03:48.745073] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:03:49.119713] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T17:03:49.358851] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-14T17:03:50.058249] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:03:50.158881] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-14T17:03:50.371380] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-14T17:03:50.373088] [INFO ] [REMOTE ] BFS: Full fetch complete (9609 records). [2025-09-14T17:03:50.373173] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-14T17:03:50.726488] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-14T17:03:50.726593] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-14T17:03:50.726855] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-14T17:03:50.726910] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-14T17:03:50.727345] [DEBUG] [LOCAL ] BFS: Trimmed 9609 records to 6805 (keeping 150 days of data) [2025-09-14T17:03:50.769967] [DEBUG] [LOCAL ] BFS: Primary data saved (6805 records). [2025-09-14T17:03:50.770122] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-14T17:03:50.770221] [INFO ] [MAIN ] Update Progress: 257/2370 symbols completed. BFS took 18.7s. Estimated remaining: 3h 39m 7s. Rate: 9.6 symbols/min [2025-09-14T17:03:50.942507] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:50.951429] [DEBUG] [LOCAL ] BGB: Loaded 7128 existing records from primary storage. [2025-09-14T17:03:50.951573] [INFO ] [MAIN ] BGB: Loaded 7128 existing records. [2025-09-14T17:03:50.963957] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-14T17:03:51.130151] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:51.130444] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-14T17:03:51.130505] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-14T17:03:51.130867] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-14T17:03:51.130930] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-14T17:03:51.482206] [INFO ] [REMOTE ] BGB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:51.758826] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-14T17:03:52.558850] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-14T17:03:52.902403] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T17:03:53.067113] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:03:53.358844] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-14T17:03:54.060574] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T17:03:54.158832] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-14T17:03:54.958867] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-14T17:03:55.311714] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:03:55.333449] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:03:55.758836] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-14T17:03:56.558852] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-14T17:03:56.740006] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T17:03:56.798470] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T17:03:57.358923] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-14T17:03:58.028972] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T17:03:58.045795] [INFO ] [REMOTE ] BFLY: Full fetch complete (56476 records). [2025-09-14T17:03:58.046827] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:03:58.046967] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-14T17:03:58.163890] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-14T17:03:58.436276] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-14T17:03:58.436420] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-14T17:03:58.437253] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-14T17:03:58.437331] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-14T17:03:58.438735] [DEBUG] [LOCAL ] BFLY: Trimmed 56476 records to 38899 (keeping 150 days of data) [2025-09-14T17:03:58.662626] [DEBUG] [LOCAL ] BFLY: Primary data saved (38899 records). [2025-09-14T17:03:58.662821] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-14T17:03:58.662933] [INFO ] [MAIN ] Update Progress: 258/2370 symbols completed. BFLY took 35.5s. Estimated remaining: 3h 39m 15s. Rate: 9.6 symbols/min [2025-09-14T17:03:58.849879] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:58.860027] [DEBUG] [LOCAL ] BGH: Loaded 7452 existing records from primary storage. [2025-09-14T17:03:58.860210] [INFO ] [MAIN ] BGH: Loaded 7452 existing records. [2025-09-14T17:03:58.960511] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-14T17:03:59.040471] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:59.040785] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-14T17:03:59.040844] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-14T17:03:59.041141] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-14T17:03:59.041199] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-14T17:03:59.378681] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T17:03:59.416603] [INFO ] [REMOTE ] BGH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:59.758872] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-14T17:04:00.539319] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T17:04:00.541211] [INFO ] [REMOTE ] BFZ: Full fetch complete (12560 records). [2025-09-14T17:04:00.541295] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-14T17:04:00.563972] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-14T17:04:00.919678] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-14T17:04:00.919852] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-14T17:04:00.920316] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-14T17:04:00.920442] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-14T17:04:00.921333] [DEBUG] [LOCAL ] BFZ: Trimmed 12560 records to 8286 (keeping 150 days of data) [2025-09-14T17:04:00.997958] [DEBUG] [LOCAL ] BFZ: Primary data saved (8286 records). [2025-09-14T17:04:01.001025] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-14T17:04:01.001158] [INFO ] [MAIN ] Update Progress: 259/2370 symbols completed. BFZ took 25.6s. Estimated remaining: 3h 38m 37s. Rate: 9.7 symbols/min [2025-09-14T17:04:01.070259] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-14T17:04:01.193192] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:01.200671] [DEBUG] [LOCAL ] BGR: Loaded 5526 existing records from primary storage. [2025-09-14T17:04:01.200821] [INFO ] [MAIN ] BGR: Loaded 5526 existing records. [2025-09-14T17:04:01.363003] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-14T17:04:01.384581] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:01.385049] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-14T17:04:01.385133] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-14T17:04:01.385433] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-14T17:04:01.385495] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-14T17:04:01.579143] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T17:04:01.762076] [INFO ] [REMOTE ] BGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:02.158832] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-14T17:04:02.958891] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-14T17:04:03.237631] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:04:03.587502] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-14T17:04:03.758841] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-14T17:04:04.078688] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:04:04.558837] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-14T17:04:05.358925] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-14T17:04:05.544118] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:04:05.568461] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T17:04:06.158918] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-14T17:04:06.235997] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:04:06.517374] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T17:04:06.524185] [INFO ] [REMOTE ] BG: Full fetch complete (54786 records). [2025-09-14T17:04:06.524485] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-14T17:04:06.917611] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-14T17:04:06.917763] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-14T17:04:06.918399] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-14T17:04:06.918459] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-14T17:04:06.919812] [DEBUG] [LOCAL ] BG: Trimmed 54786 records to 37983 (keeping 150 days of data) [2025-09-14T17:04:06.978236] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-14T17:04:07.170507] [DEBUG] [LOCAL ] BG: Primary data saved (37983 records). [2025-09-14T17:04:07.170711] [INFO ] [MAIN ] BG: Full history saved. [2025-09-14T17:04:07.170815] [INFO ] [MAIN ] Update Progress: 260/2370 symbols completed. BG took 26.1s. Estimated remaining: 3h 38m 30s. Rate: 9.7 symbols/min [2025-09-14T17:04:07.339720] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:07.361998] [DEBUG] [LOCAL ] BGS: Loaded 22630 existing records from primary storage. [2025-09-14T17:04:07.362183] [INFO ] [MAIN ] BGS: Loaded 22630 existing records. [2025-09-14T17:04:07.542082] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:07.542434] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-14T17:04:07.542517] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-14T17:04:07.543273] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-14T17:04:07.543363] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-14T17:04:07.763975] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-14T17:04:07.907401] [INFO ] [REMOTE ] BGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:08.044145] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:04:08.558841] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-14T17:04:08.767358] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T17:04:08.769512] [INFO ] [REMOTE ] BGB: Full fetch complete (19747 records). [2025-09-14T17:04:08.769610] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-14T17:04:09.143144] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-14T17:04:09.143280] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-14T17:04:09.143699] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-14T17:04:09.143792] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-14T17:04:09.144846] [DEBUG] [LOCAL ] BGB: Trimmed 19747 records to 12790 (keeping 150 days of data) [2025-09-14T17:04:09.226450] [DEBUG] [LOCAL ] BGB: Primary data saved (12790 records). [2025-09-14T17:04:09.226664] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-14T17:04:09.226800] [INFO ] [MAIN ] Update Progress: 261/2370 symbols completed. BGB took 18.5s. Estimated remaining: 3h 37m 50s. Rate: 9.7 symbols/min [2025-09-14T17:04:09.363904] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-14T17:04:09.410023] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:09.415539] [DEBUG] [LOCAL ] BGSF: Loaded 3583 existing records from primary storage. [2025-09-14T17:04:09.415678] [INFO ] [MAIN ] BGSF: Loaded 3583 existing records. [2025-09-14T17:04:09.590835] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:09.591093] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-14T17:04:09.591171] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-14T17:04:09.591426] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-14T17:04:09.591491] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-14T17:04:09.958068] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:10.158800] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-14T17:04:10.159983] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T17:04:10.559898] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T17:04:10.642333] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:04:10.958943] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-14T17:04:11.439949] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-14T17:04:11.758894] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-14T17:04:12.558910] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-14T17:04:13.089305] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T17:04:13.358850] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-14T17:04:13.527402] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:04:13.877430] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T17:04:14.158833] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-14T17:04:14.958836] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-14T17:04:14.979180] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:04:15.758865] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-14T17:04:16.008276] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:04:16.558854] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-14T17:04:16.591734] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T17:04:17.355284] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T17:04:17.359043] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-14T17:04:18.158843] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-14T17:04:18.547978] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:04:18.826632] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T17:04:18.958841] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-14T17:04:19.659502] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T17:04:19.661082] [INFO ] [REMOTE ] BGSF: Full fetch complete (5427 records). [2025-09-14T17:04:19.661190] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-14T17:04:19.766390] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-14T17:04:20.029628] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-14T17:04:20.029775] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-14T17:04:20.029988] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-14T17:04:20.030066] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-14T17:04:20.030490] [DEBUG] [LOCAL ] BGSF: Trimmed 5427 records to 4332 (keeping 150 days of data) [2025-09-14T17:04:20.058371] [DEBUG] [LOCAL ] BGSF: Primary data saved (4332 records). [2025-09-14T17:04:20.058599] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-14T17:04:20.058760] [INFO ] [MAIN ] Update Progress: 262/2370 symbols completed. BGSF took 10.8s. Estimated remaining: 3h 38m 22s. Rate: 9.7 symbols/min [2025-09-14T17:04:20.234363] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:20.250284] [DEBUG] [LOCAL ] BGT: Loaded 7998 existing records from primary storage. [2025-09-14T17:04:20.250509] [INFO ] [MAIN ] BGT: Loaded 7998 existing records. [2025-09-14T17:04:20.433720] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:20.434086] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-14T17:04:20.434155] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-14T17:04:20.434672] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-14T17:04:20.434745] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-14T17:04:20.564063] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-14T17:04:20.808777] [INFO ] [REMOTE ] BGT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:21.358844] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-14T17:04:21.531708] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T17:04:21.651545] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:04:22.158889] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-14T17:04:22.425224] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T17:04:22.958840] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-14T17:04:23.620836] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T17:04:23.758888] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-14T17:04:24.060544] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:04:24.558874] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-14T17:04:24.655557] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T17:04:25.206605] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T17:04:25.358906] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-14T17:04:26.158841] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-14T17:04:26.350089] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:04:26.958841] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-14T17:04:27.283156] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:04:27.672362] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T17:04:27.758790] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-14T17:04:28.421517] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T17:04:28.558823] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-14T17:04:29.358853] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-14T17:04:30.154775] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T17:04:30.156760] [INFO ] [REMOTE ] BGR: Full fetch complete (14914 records). [2025-09-14T17:04:30.156875] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-14T17:04:30.168661] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-14T17:04:30.536450] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-14T17:04:30.536834] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-14T17:04:30.537409] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-14T17:04:30.537607] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-14T17:04:30.538693] [DEBUG] [LOCAL ] BGR: Trimmed 14914 records to 9858 (keeping 150 days of data) [2025-09-14T17:04:30.620342] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T17:04:30.645575] [DEBUG] [LOCAL ] BGR: Primary data saved (9858 records). [2025-09-14T17:04:30.645754] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-14T17:04:30.645863] [INFO ] [MAIN ] Update Progress: 263/2370 symbols completed. BGR took 29.6s. Estimated remaining: 3h 38m 50s. Rate: 9.6 symbols/min [2025-09-14T17:04:30.816706] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:30.824165] [DEBUG] [LOCAL ] BGX: Loaded 4984 existing records from primary storage. [2025-09-14T17:04:30.824332] [INFO ] [MAIN ] BGX: Loaded 4984 existing records. [2025-09-14T17:04:30.964026] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-14T17:04:31.007006] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:31.007438] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-14T17:04:31.007506] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-14T17:04:31.007814] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-14T17:04:31.007884] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-14T17:04:31.311237] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T17:04:31.391976] [INFO ] [REMOTE ] BGX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:31.758807] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-14T17:04:32.021792] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T17:04:32.525175] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T17:04:32.558785] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-14T17:04:33.358850] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-14T17:04:33.410068] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T17:04:34.158875] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-14T17:04:34.958916] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-14T17:04:35.319041] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:04:35.331186] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T17:04:35.334990] [INFO ] [REMOTE ] BGH: Full fetch complete (17353 records). [2025-09-14T17:04:35.335146] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-14T17:04:35.731623] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-14T17:04:35.731813] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-14T17:04:35.732318] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-14T17:04:35.732377] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-14T17:04:35.733141] [DEBUG] [LOCAL ] BGH: Trimmed 17353 records to 12346 (keeping 150 days of data) [2025-09-14T17:04:35.770360] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-14T17:04:35.830673] [DEBUG] [LOCAL ] BGH: Primary data saved (12346 records). [2025-09-14T17:04:35.831587] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T17:04:35.831786] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-14T17:04:35.834771] [INFO ] [MAIN ] Update Progress: 264/2370 symbols completed. BGH took 37.2s. Estimated remaining: 3h 38m 36s. Rate: 9.6 symbols/min [2025-09-14T17:04:36.011245] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:36.022670] [DEBUG] [LOCAL ] BGY: Loaded 10023 existing records from primary storage. [2025-09-14T17:04:36.022842] [INFO ] [MAIN ] BGY: Loaded 10023 existing records. [2025-09-14T17:04:36.200589] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:36.200903] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-14T17:04:36.200971] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-14T17:04:36.201409] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-14T17:04:36.201476] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-14T17:04:36.550115] [INFO ] [REMOTE ] BGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:36.558782] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-14T17:04:37.358907] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-14T17:04:37.563024] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:04:37.725212] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T17:04:38.083420] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T17:04:38.158806] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-14T17:04:38.958845] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-14T17:04:39.112536] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T17:04:39.758843] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-14T17:04:40.387693] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:04:40.558820] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-14T17:04:40.784618] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:04:41.358833] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-14T17:04:41.941731] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T17:04:42.121999] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:04:42.124167] [INFO ] [REMOTE ] BGT: Full fetch complete (17951 records). [2025-09-14T17:04:42.124278] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-14T17:04:42.163943] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-14T17:04:42.511502] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-14T17:04:42.511622] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-14T17:04:42.512078] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-14T17:04:42.512163] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-14T17:04:42.512942] [DEBUG] [LOCAL ] BGT: Trimmed 17951 records to 12374 (keeping 150 days of data) [2025-09-14T17:04:42.592735] [DEBUG] [LOCAL ] BGT: Primary data saved (12374 records). [2025-09-14T17:04:42.592962] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-14T17:04:42.593140] [INFO ] [MAIN ] Update Progress: 265/2370 symbols completed. BGT took 22.5s. Estimated remaining: 3h 38m 34s. Rate: 9.6 symbols/min [2025-09-14T17:04:42.770960] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:42.782282] [DEBUG] [LOCAL ] BH: Loaded 9282 existing records from primary storage. [2025-09-14T17:04:42.782442] [INFO ] [MAIN ] BH: Loaded 9282 existing records. [2025-09-14T17:04:42.966227] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-14T17:04:42.972114] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:42.973877] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-14T17:04:42.973964] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-14T17:04:42.974428] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-14T17:04:42.985604] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-14T17:04:43.036063] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:04:43.120955] [INFO ] [REMOTE ] BGS: Full fetch complete (54810 records). [2025-09-14T17:04:43.165329] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-14T17:04:43.630775] [INFO ] [REMOTE ] BH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:43.767024] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-14T17:04:43.863774] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-14T17:04:43.863904] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-14T17:04:43.864637] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-14T17:04:43.864783] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-14T17:04:43.878900] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T17:04:43.883692] [DEBUG] [LOCAL ] BGS: Trimmed 54810 records to 37999 (keeping 150 days of data) [2025-09-14T17:04:44.115844] [DEBUG] [LOCAL ] BGS: Primary data saved (37999 records). [2025-09-14T17:04:44.116017] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-14T17:04:44.116119] [INFO ] [MAIN ] Update Progress: 266/2370 symbols completed. BGS took 36.9s. Estimated remaining: 3h 37m 50s. Rate: 9.7 symbols/min [2025-09-14T17:04:44.295472] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:44.316554] [DEBUG] [LOCAL ] BHC: Loaded 21105 existing records from primary storage. [2025-09-14T17:04:44.316738] [INFO ] [MAIN ] BHC: Loaded 21105 existing records. [2025-09-14T17:04:44.483462] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:04:44.515813] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:44.516596] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-14T17:04:44.516680] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-14T17:04:44.517235] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-14T17:04:44.517298] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-14T17:04:44.563921] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-14T17:04:44.891899] [INFO ] [REMOTE ] BHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:45.358828] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-14T17:04:45.465204] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T17:04:46.158835] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-14T17:04:46.923806] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T17:04:46.958813] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-14T17:04:46.977108] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:04:47.758824] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-14T17:04:48.511019] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T17:04:48.558792] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-14T17:04:49.105790] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T17:04:49.358848] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-14T17:04:49.642896] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:04:50.018702] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T17:04:50.158885] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-14T17:04:50.958798] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-14T17:04:51.362133] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T17:04:51.758819] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-14T17:04:51.762262] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T17:04:52.558847] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-14T17:04:53.103047] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:04:53.308461] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:04:53.358815] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-14T17:04:54.158860] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-14T17:04:54.589021] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T17:04:54.958875] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-14T17:04:55.148420] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:04:55.690287] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:04:55.692811] [INFO ] [REMOTE ] BGY: Full fetch complete (25398 records). [2025-09-14T17:04:55.692919] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-14T17:04:55.764105] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-14T17:04:56.088140] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-14T17:04:56.088289] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-14T17:04:56.088734] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-14T17:04:56.088800] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-14T17:04:56.089744] [DEBUG] [LOCAL ] BGY: Trimmed 25398 records to 16485 (keeping 150 days of data) [2025-09-14T17:04:56.195792] [DEBUG] [LOCAL ] BGY: Primary data saved (16485 records). [2025-09-14T17:04:56.196005] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-14T17:04:56.196117] [INFO ] [MAIN ] Update Progress: 267/2370 symbols completed. BGY took 20.4s. Estimated remaining: 3h 38m 30s. Rate: 9.6 symbols/min [2025-09-14T17:04:56.384558] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:56.396767] [DEBUG] [LOCAL ] BHE: Loaded 10306 existing records from primary storage. [2025-09-14T17:04:56.396957] [INFO ] [MAIN ] BHE: Loaded 10306 existing records. [2025-09-14T17:04:56.575428] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-14T17:04:56.581431] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:56.582849] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-14T17:04:56.582950] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-14T17:04:56.583468] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-14T17:04:56.583571] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-14T17:04:56.946605] [INFO ] [REMOTE ] BHE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:57.358863] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-14T17:04:57.426977] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:04:57.456559] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:04:57.458921] [INFO ] [REMOTE ] BGX: Full fetch complete (12004 records). [2025-09-14T17:04:57.459043] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-14T17:04:57.826845] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-14T17:04:57.826987] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-14T17:04:57.827383] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-14T17:04:57.827464] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-14T17:04:57.828125] [DEBUG] [LOCAL ] BGX: Trimmed 12004 records to 7740 (keeping 150 days of data) [2025-09-14T17:04:57.881211] [DEBUG] [LOCAL ] BGX: Primary data saved (7740 records). [2025-09-14T17:04:57.881414] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-14T17:04:57.881560] [INFO ] [MAIN ] Update Progress: 268/2370 symbols completed. BGX took 27.2s. Estimated remaining: 3h 37m 48s. Rate: 9.7 symbols/min [2025-09-14T17:04:58.087446] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:58.108216] [DEBUG] [LOCAL ] BHK: Loaded 12388 existing records from primary storage. [2025-09-14T17:04:58.108519] [INFO ] [MAIN ] BHK: Loaded 12388 existing records. [2025-09-14T17:04:58.164092] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-14T17:04:58.430975] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:58.431633] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-14T17:04:58.431894] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-14T17:04:58.432691] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-14T17:04:58.432786] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-14T17:04:58.618612] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T17:04:58.964017] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-14T17:04:59.028233] [INFO ] [REMOTE ] BHK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:59.758853] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-14T17:04:59.837769] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T17:05:00.467885] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T17:05:00.558886] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-14T17:05:00.839327] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:05:01.358851] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-14T17:05:01.902285] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:05:02.158870] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-14T17:05:02.432817] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T17:05:02.958882] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-14T17:05:03.246403] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:05:03.758818] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-14T17:05:03.787148] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:05:04.558846] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-14T17:05:04.934557] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T17:05:05.358881] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-14T17:05:05.419544] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:05:06.158882] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-14T17:05:06.958791] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-14T17:05:07.148892] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:05:07.315515] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:05:07.553051] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T17:05:07.758845] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-14T17:05:08.558806] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-14T17:05:08.724684] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T17:05:08.727222] [INFO ] [REMOTE ] BH: Full fetch complete (15478 records). [2025-09-14T17:05:08.727313] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-14T17:05:09.091808] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-14T17:05:09.091915] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-14T17:05:09.092222] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-14T17:05:09.092276] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-14T17:05:09.092859] [DEBUG] [LOCAL ] BH: Trimmed 15478 records to 13143 (keeping 150 days of data) [2025-09-14T17:05:09.172686] [DEBUG] [LOCAL ] BH: Primary data saved (13143 records). [2025-09-14T17:05:09.172863] [INFO ] [MAIN ] BH: Full history saved. [2025-09-14T17:05:09.172962] [INFO ] [MAIN ] Update Progress: 269/2370 symbols completed. BH took 26.6s. Estimated remaining: 3h 38m 22s. Rate: 9.6 symbols/min [2025-09-14T17:05:09.347812] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:09.361929] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-14T17:05:09.373333] [DEBUG] [LOCAL ] BHP: Loaded 23912 existing records from primary storage. [2025-09-14T17:05:09.373502] [INFO ] [MAIN ] BHP: Loaded 23912 existing records. [2025-09-14T17:05:09.549008] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:09.549276] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-14T17:05:09.549339] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-14T17:05:09.550020] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-14T17:05:09.550088] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-14T17:05:09.907727] [INFO ] [REMOTE ] BHP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:09.951398] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T17:05:09.956787] [INFO ] [REMOTE ] BHC: Full fetch complete (50950 records). [2025-09-14T17:05:09.956996] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-14T17:05:10.165336] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-14T17:05:10.349188] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-14T17:05:10.349309] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-14T17:05:10.349930] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-14T17:05:10.349992] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-14T17:05:10.351304] [DEBUG] [LOCAL ] BHC: Trimmed 50950 records to 34955 (keeping 150 days of data) [2025-09-14T17:05:10.555401] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:05:10.580679] [DEBUG] [LOCAL ] BHC: Primary data saved (34955 records). [2025-09-14T17:05:10.580880] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-14T17:05:10.580989] [INFO ] [MAIN ] Update Progress: 270/2370 symbols completed. BHC took 26.5s. Estimated remaining: 3h 37m 38s. Rate: 9.6 symbols/min [2025-09-14T17:05:10.753395] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:10.763900] [DEBUG] [LOCAL ] BHR: Loaded 9096 existing records from primary storage. [2025-09-14T17:05:10.764083] [INFO ] [MAIN ] BHR: Loaded 9096 existing records. [2025-09-14T17:05:10.945111] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:10.945435] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-14T17:05:10.945502] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-14T17:05:10.945903] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-14T17:05:10.945969] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-14T17:05:10.967150] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-14T17:05:11.313025] [INFO ] [REMOTE ] BHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:11.758794] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-14T17:05:12.015154] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T17:05:12.074969] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T17:05:12.558881] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-14T17:05:13.001942] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T17:05:13.358857] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-14T17:05:13.640441] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:05:14.158868] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-14T17:05:14.685556] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:05:14.688233] [INFO ] [REMOTE ] BHE: Full fetch complete (27966 records). [2025-09-14T17:05:14.688344] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-14T17:05:14.963952] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-14T17:05:15.073271] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-14T17:05:15.073385] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-14T17:05:15.073896] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-14T17:05:15.073959] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-14T17:05:15.074765] [DEBUG] [LOCAL ] BHE: Trimmed 27966 records to 17884 (keeping 150 days of data) [2025-09-14T17:05:15.217222] [DEBUG] [LOCAL ] BHE: Primary data saved (17884 records). [2025-09-14T17:05:15.217463] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-14T17:05:15.217586] [INFO ] [MAIN ] Update Progress: 271/2370 symbols completed. BHE took 19.0s. Estimated remaining: 3h 37m 20s. Rate: 9.7 symbols/min [2025-09-14T17:05:15.220430] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T17:05:15.405915] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:15.408290] [DEBUG] [LOCAL ] BHV: Loaded 485 existing records from primary storage. [2025-09-14T17:05:15.408383] [INFO ] [MAIN ] BHV: Loaded 485 existing records. [2025-09-14T17:05:15.584529] [WARN ] [MAIN ] BHV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:15.584914] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-14T17:05:15.584980] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-14T17:05:15.585170] [DEBUG] [LOCAL ] BHV: Deleted primary data file. [2025-09-14T17:05:15.585230] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-14T17:05:15.769974] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-14T17:05:15.936675] [INFO ] [REMOTE ] BHV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:16.169668] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T17:05:16.558849] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-14T17:05:16.937112] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T17:05:17.104227] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:05:17.358877] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-14T17:05:17.778402] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T17:05:18.158879] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-14T17:05:18.958805] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-14T17:05:19.415238] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T17:05:19.758793] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-14T17:05:19.830767] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T17:05:20.088957] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-14T17:05:20.558832] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-14T17:05:21.358857] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-14T17:05:21.739263] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T17:05:22.158848] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-14T17:05:22.837206] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T17:05:22.898726] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T17:05:22.958837] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-14T17:05:23.758843] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-14T17:05:24.259259] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T17:05:24.558836] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-14T17:05:25.358802] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-14T17:05:25.673823] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:05:25.809895] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T17:05:25.839948] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:05:26.158872] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-14T17:05:26.958843] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-14T17:05:27.758800] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-14T17:05:27.904184] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T17:05:27.923191] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T17:05:27.927075] [INFO ] [REMOTE ] BHK: Full fetch complete (23611 records). [2025-09-14T17:05:27.927177] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-14T17:05:28.289853] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-14T17:05:28.289985] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-14T17:05:28.290458] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-14T17:05:28.290520] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-14T17:05:28.291291] [DEBUG] [LOCAL ] BHK: Trimmed 23611 records to 18380 (keeping 150 days of data) [2025-09-14T17:05:28.412704] [DEBUG] [LOCAL ] BHK: Primary data saved (18380 records). [2025-09-14T17:05:28.412897] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-14T17:05:28.413008] [INFO ] [MAIN ] Update Progress: 272/2370 symbols completed. BHK took 30.5s. Estimated remaining: 3h 38m 7s. Rate: 9.6 symbols/min [2025-09-14T17:05:28.560617] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-14T17:05:28.594004] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:28.617104] [DEBUG] [LOCAL ] BHVN: Loaded 22469 existing records from primary storage. [2025-09-14T17:05:28.617306] [INFO ] [MAIN ] BHVN: Loaded 22469 existing records. [2025-09-14T17:05:28.797494] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:28.797915] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-14T17:05:28.798017] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-14T17:05:28.803911] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-14T17:05:28.804008] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-14T17:05:28.883073] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:05:29.188586] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:29.358817] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-14T17:05:30.158822] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-14T17:05:30.295597] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T17:05:30.585534] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T17:05:30.958869] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-14T17:05:31.211876] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T17:05:31.700056] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:05:31.703390] [INFO ] [REMOTE ] BHR: Full fetch complete (22520 records). [2025-09-14T17:05:31.703480] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-14T17:05:31.764773] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-14T17:05:32.086535] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-14T17:05:32.086700] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-14T17:05:32.087230] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-14T17:05:32.087288] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-14T17:05:32.088116] [DEBUG] [LOCAL ] BHR: Trimmed 22520 records to 15557 (keeping 150 days of data) [2025-09-14T17:05:32.189190] [DEBUG] [LOCAL ] BHR: Primary data saved (15557 records). [2025-09-14T17:05:32.189567] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-14T17:05:32.189698] [INFO ] [MAIN ] Update Progress: 273/2370 symbols completed. BHR took 21.6s. Estimated remaining: 3h 37m 42s. Rate: 9.6 symbols/min [2025-09-14T17:05:32.365357] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:32.388999] [DEBUG] [LOCAL ] BILL: Loaded 23669 existing records from primary storage. [2025-09-14T17:05:32.389231] [INFO ] [MAIN ] BILL: Loaded 23669 existing records. [2025-09-14T17:05:32.567223] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-14T17:05:32.571800] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:32.573018] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-14T17:05:32.573081] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-14T17:05:32.573912] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-14T17:05:32.573982] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-14T17:05:32.931493] [INFO ] [REMOTE ] BILL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:33.358842] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-14T17:05:33.711196] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:05:34.015665] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T17:05:34.158836] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-14T17:05:34.849984] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:05:34.958858] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-14T17:05:35.339884] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T17:05:35.569920] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T17:05:35.575704] [INFO ] [REMOTE ] BHP: Full fetch complete (58045 records). [2025-09-14T17:05:35.575880] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-14T17:05:35.771000] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-14T17:05:35.983869] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-14T17:05:35.984006] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-14T17:05:35.984769] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-14T17:05:35.984834] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-14T17:05:35.986220] [DEBUG] [LOCAL ] BHP: Trimmed 58045 records to 40153 (keeping 150 days of data) [2025-09-14T17:05:36.245861] [DEBUG] [LOCAL ] BHP: Primary data saved (40153 records). [2025-09-14T17:05:36.246022] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-14T17:05:36.246138] [INFO ] [MAIN ] Update Progress: 274/2370 symbols completed. BHP took 27.1s. Estimated remaining: 3h 37m 19s. Rate: 9.6 symbols/min [2025-09-14T17:05:36.342760] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T17:05:36.423942] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:36.436368] [DEBUG] [LOCAL ] BIO: Loaded 10800 existing records from primary storage. [2025-09-14T17:05:36.436523] [INFO ] [MAIN ] BIO: Loaded 10800 existing records. [2025-09-14T17:05:36.563902] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-14T17:05:36.615550] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:36.615796] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-14T17:05:36.615865] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-14T17:05:36.616279] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-14T17:05:36.616339] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-14T17:05:36.972482] [INFO ] [REMOTE ] BIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:37.358837] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-14T17:05:37.930665] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T17:05:38.158849] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-14T17:05:38.354896] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:05:38.958848] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-14T17:05:39.288297] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:05:39.289239] [INFO ] [REMOTE ] BHV: Full fetch complete (1056 records). [2025-09-14T17:05:39.289335] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-14T17:05:39.472631] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T17:05:39.473005] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:05:39.473076] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:05:39.473185] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-14T17:05:39.473268] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-14T17:05:39.473421] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-14T17:05:39.473501] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-14T17:05:39.473696] [INFO ] [MAIN ] Update Progress: 275/2370 symbols completed. BHV took 24.3s. Estimated remaining: 3h 36m 50s. Rate: 9.7 symbols/min [2025-09-14T17:05:39.487845] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:05:39.663781] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:39.683011] [DEBUG] [LOCAL ] BIP: Loaded 17501 existing records from primary storage. [2025-09-14T17:05:39.683183] [INFO ] [MAIN ] BIP: Loaded 17501 existing records. [2025-09-14T17:05:39.764068] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-14T17:05:39.867425] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:39.868049] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-14T17:05:39.868115] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-14T17:05:39.868993] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-14T17:05:39.869058] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-14T17:05:40.217361] [INFO ] [REMOTE ] BIP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:40.558837] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-14T17:05:41.090877] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:05:41.358883] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-14T17:05:42.070355] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:05:42.158816] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-14T17:05:42.618550] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:05:42.958879] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-14T17:05:43.754066] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T17:05:43.764014] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-14T17:05:44.397430] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:05:44.558949] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-14T17:05:45.358891] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-14T17:05:45.505515] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T17:05:45.982756] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T17:05:46.158836] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-14T17:05:46.910291] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:05:46.958824] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-14T17:05:47.758835] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-14T17:05:48.083067] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:05:48.324321] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:05:48.558881] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-14T17:05:49.127401] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:05:49.358817] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-14T17:05:49.717539] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T17:05:50.158826] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-14T17:05:50.958839] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-14T17:05:51.004379] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T17:05:51.635598] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:05:51.758841] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-14T17:05:52.558857] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-14T17:05:52.854125] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:05:53.106446] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T17:05:53.358869] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-14T17:05:53.418157] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:05:54.158835] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-14T17:05:54.879362] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:05:54.958861] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-14T17:05:55.464215] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:05:55.758844] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-14T17:05:55.952238] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T17:05:55.956559] [INFO ] [REMOTE ] BIP: Full fetch complete (43416 records). [2025-09-14T17:05:55.956730] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-14T17:05:56.332124] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-14T17:05:56.332234] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-14T17:05:56.333139] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-14T17:05:56.333499] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-14T17:05:56.335267] [DEBUG] [LOCAL ] BIP: Trimmed 43416 records to 28380 (keeping 150 days of data) [2025-09-14T17:05:56.544424] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:05:56.553102] [DEBUG] [LOCAL ] BIP: Primary data saved (28380 records). [2025-09-14T17:05:56.554149] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-14T17:05:56.554304] [INFO ] [MAIN ] Update Progress: 276/2370 symbols completed. BIP took 17.1s. Estimated remaining: 3h 38m 6s. Rate: 9.6 symbols/min [2025-09-14T17:05:56.566423] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-14T17:05:56.728075] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:56.745890] [DEBUG] [LOCAL ] BIPC: Loaded 17774 existing records from primary storage. [2025-09-14T17:05:56.746081] [INFO ] [MAIN ] BIPC: Loaded 17774 existing records. [2025-09-14T17:05:56.920524] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:56.920824] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-14T17:05:56.920885] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-14T17:05:56.921607] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-14T17:05:56.921692] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-14T17:05:57.270184] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:57.358795] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-14T17:05:58.158843] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-14T17:05:58.186078] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T17:05:58.191426] [INFO ] [REMOTE ] BHVN: Full fetch complete (53176 records). [2025-09-14T17:05:58.191539] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-14T17:05:58.570273] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-14T17:05:58.570389] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-14T17:05:58.571006] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-14T17:05:58.571064] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-14T17:05:58.572402] [DEBUG] [LOCAL ] BHVN: Trimmed 53176 records to 37833 (keeping 150 days of data) [2025-09-14T17:05:58.685959] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:05:58.698952] [INFO ] [REMOTE ] BIO: Full fetch complete (28335 records). [2025-09-14T17:05:58.703788] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-14T17:05:58.977824] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-14T17:05:59.117692] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:05:59.184669] [DEBUG] [LOCAL ] BHVN: Primary data saved (37833 records). [2025-09-14T17:05:59.218540] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-14T17:05:59.220272] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-14T17:05:59.220498] [INFO ] [MAIN ] Update Progress: 277/2370 symbols completed. BHVN took 30.8s. Estimated remaining: 3h 37m 33s. Rate: 9.6 symbols/min [2025-09-14T17:05:59.220778] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-14T17:05:59.221404] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-14T17:05:59.221467] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-14T17:05:59.222279] [DEBUG] [LOCAL ] BIO: Trimmed 28335 records to 18672 (keeping 150 days of data) [2025-09-14T17:05:59.347578] [DEBUG] [LOCAL ] BIO: Primary data saved (18672 records). [2025-09-14T17:05:59.347809] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-14T17:05:59.347917] [INFO ] [MAIN ] Update Progress: 278/2370 symbols completed. BIO took 23.1s. Estimated remaining: 3h 36m 41s. Rate: 9.7 symbols/min [2025-09-14T17:05:59.758925] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-14T17:06:00.690361] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T17:06:00.701511] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-14T17:06:01.288026] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T17:06:01.358827] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-14T17:06:02.844281] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-14T17:06:02.856216] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-14T17:06:04.040522] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-14T17:06:04.051087] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-14T17:06:05.505096] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:06:05.516338] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-14T17:06:05.839311] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-14T17:06:05.853244] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-14T17:06:06.530127] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:06:06.536003] [INFO ] [REMOTE ] BILL: Full fetch complete (56990 records). [2025-09-14T17:06:06.536176] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-14T17:06:06.954028] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-14T17:06:06.954184] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-14T17:06:06.955044] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-14T17:06:06.955221] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-14T17:06:06.957263] [DEBUG] [LOCAL ] BILL: Trimmed 56990 records to 39323 (keeping 150 days of data) [2025-09-14T17:06:07.073893] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T17:06:07.106439] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-14T17:06:07.246437] [DEBUG] [LOCAL ] BILL: Primary data saved (39323 records). [2025-09-14T17:06:07.246721] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-14T17:06:07.246896] [INFO ] [MAIN ] Update Progress: 279/2370 symbols completed. BILL took 35.1s. Estimated remaining: 3h 36m 47s. Rate: 9.6 symbols/min [2025-09-14T17:06:08.531987] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T17:06:08.545149] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-14T17:06:10.031352] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T17:06:10.047088] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-14T17:06:11.281353] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T17:06:11.285900] [INFO ] [REMOTE ] BIPC: Full fetch complete (45552 records). [2025-09-14T17:06:11.286032] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-14T17:06:11.696330] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-14T17:06:11.696493] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-14T17:06:11.697255] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-14T17:06:11.697317] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-14T17:06:11.698687] [DEBUG] [LOCAL ] BIPC: Trimmed 45552 records to 30547 (keeping 150 days of data) [2025-09-14T17:06:11.902745] [DEBUG] [LOCAL ] BIPC: Primary data saved (30547 records). [2025-09-14T17:06:11.903001] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-14T17:06:11.903127] [INFO ] [MAIN ] Update Progress: 280/2370 symbols completed. BIPC took 15.3s. Estimated remaining: 3h 36m 29s. Rate: 9.7 symbols/min [2025-09-14T17:06:12.674086] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:12.685276] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:12.683975] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:12.719911] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:12.725216] [DEBUG] [LOCAL ] BIPH: Loaded 1011 existing records from primary storage. [2025-09-14T17:06:12.726769] [INFO ] [MAIN ] BIPH: Loaded 1011 existing records. [2025-09-14T17:06:12.764024] [DEBUG] [LOCAL ] BIPJ: Loaded 1309 existing records from primary storage. [2025-09-14T17:06:12.764886] [INFO ] [MAIN ] BIPJ: Loaded 1309 existing records. [2025-09-14T17:06:12.789399] [DEBUG] [LOCAL ] BIPI: Loaded 1435 existing records from primary storage. [2025-09-14T17:06:12.873367] [INFO ] [MAIN ] BIPI: Loaded 1435 existing records. [2025-09-14T17:06:13.025273] [DEBUG] [LOCAL ] BIRK: Loaded 22767 existing records from primary storage. [2025-09-14T17:06:13.160339] [INFO ] [MAIN ] BIRK: Loaded 22767 existing records. [2025-09-14T17:06:13.262993] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:13.353395] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:13.378264] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-14T17:06:13.432531] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-14T17:06:13.481458] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:13.481590] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-14T17:06:13.482121] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-14T17:06:13.482306] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-14T17:06:13.487941] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-14T17:06:13.498735] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-14T17:06:13.509141] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-14T17:06:13.524655] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-14T17:06:13.562450] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-14T17:06:13.562389] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:13.584698] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-14T17:06:13.584794] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-14T17:06:13.639124] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-14T17:06:13.716538] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-14T17:06:13.716691] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-14T17:06:13.748742] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-14T17:06:14.789484] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:14.828437] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-14T17:06:14.910686] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:14.930093] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-14T17:06:15.014235] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:15.011080] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:15.014973] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-14T17:06:15.015238] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-14T17:06:15.281908] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-14T17:06:15.283198] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-14T17:06:15.404325] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T17:06:15.405451] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-14T17:06:15.520828] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T17:06:15.522109] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-14T17:06:15.787961] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T17:06:15.789256] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-14T17:06:15.938698] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T17:06:15.940151] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-14T17:06:15.980249] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:06:15.982214] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-14T17:06:16.332606] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:06:16.334246] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-14T17:06:16.500769] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T17:06:16.558938] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-14T17:06:16.725629] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T17:06:16.899368] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:06:17.015853] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T17:06:17.358835] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-14T17:06:17.570061] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:06:18.158909] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-14T17:06:18.748941] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T17:06:18.958877] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-14T17:06:19.387797] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T17:06:19.438511] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T17:06:19.758836] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-14T17:06:20.102194] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-14T17:06:20.558837] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-14T17:06:21.050746] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T17:06:21.358831] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-14T17:06:21.849562] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-14T17:06:22.158834] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-14T17:06:22.726304] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T17:06:22.958835] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-14T17:06:23.439011] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-14T17:06:23.758859] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-14T17:06:24.166338] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:06:24.167630] [INFO ] [REMOTE ] BIPH: Full fetch complete (2789 records). [2025-09-14T17:06:24.167762] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-14T17:06:24.543673] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-14T17:06:24.543779] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-14T17:06:24.543919] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-14T17:06:24.543985] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-14T17:06:24.544357] [DEBUG] [LOCAL ] BIPH: Trimmed 2789 records to 1599 (keeping 150 days of data) [2025-09-14T17:06:24.554723] [DEBUG] [LOCAL ] BIPH: Primary data saved (1599 records). [2025-09-14T17:06:24.554848] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-14T17:06:24.554955] [INFO ] [MAIN ] Update Progress: 281/2370 symbols completed. BIPH took 12.7s. Estimated remaining: 3h 37m 11s. Rate: 9.6 symbols/min [2025-09-14T17:06:24.566086] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-14T17:06:24.732934] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:24.746109] [DEBUG] [LOCAL ] BIT: Loaded 11860 existing records from primary storage. [2025-09-14T17:06:24.746251] [INFO ] [MAIN ] BIT: Loaded 11860 existing records. [2025-09-14T17:06:24.919391] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:24.919664] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-14T17:06:24.919734] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-14T17:06:24.920167] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-14T17:06:24.920229] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-14T17:06:25.274817] [INFO ] [REMOTE ] BIT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:25.358834] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-14T17:06:26.158804] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-14T17:06:26.332871] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T17:06:26.356690] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:06:26.590749] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T17:06:26.958870] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-14T17:06:27.545360] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:06:27.546712] [INFO ] [REMOTE ] BIPI: Full fetch complete (3610 records). [2025-09-14T17:06:27.546819] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-14T17:06:27.764066] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-14T17:06:27.937116] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-14T17:06:27.937226] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-14T17:06:27.937381] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-14T17:06:27.937435] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-14T17:06:27.937832] [DEBUG] [LOCAL ] BIPI: Trimmed 3610 records to 2075 (keeping 150 days of data) [2025-09-14T17:06:27.950751] [DEBUG] [LOCAL ] BIPI: Primary data saved (2075 records). [2025-09-14T17:06:27.950829] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-14T17:06:27.950935] [INFO ] [MAIN ] Update Progress: 282/2370 symbols completed. BIPI took 16.0s. Estimated remaining: 3h 36m 44s. Rate: 9.6 symbols/min [2025-09-14T17:06:28.118092] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:28.141782] [DEBUG] [LOCAL ] BJ: Loaded 23005 existing records from primary storage. [2025-09-14T17:06:28.141961] [INFO ] [MAIN ] BJ: Loaded 23005 existing records. [2025-09-14T17:06:28.318953] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:28.319226] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-14T17:06:28.319287] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-14T17:06:28.319999] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-14T17:06:28.320064] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-14T17:06:28.564029] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-14T17:06:28.674208] [INFO ] [REMOTE ] BJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:29.358801] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-14T17:06:29.526551] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:06:29.700023] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:06:29.719771] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-14T17:06:30.158858] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-14T17:06:30.499631] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-14T17:06:30.958836] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-14T17:06:31.483291] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:06:31.484257] [INFO ] [REMOTE ] BIPJ: Full fetch complete (3034 records). [2025-09-14T17:06:31.484342] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-14T17:06:31.764109] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-14T17:06:31.879879] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-14T17:06:31.880013] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-14T17:06:31.880195] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-14T17:06:31.880265] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-14T17:06:31.880697] [DEBUG] [LOCAL ] BIPJ: Trimmed 3034 records to 2122 (keeping 150 days of data) [2025-09-14T17:06:31.893807] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2122 records). [2025-09-14T17:06:31.893891] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-14T17:06:31.893997] [INFO ] [MAIN ] Update Progress: 283/2370 symbols completed. BIPJ took 20.0s. Estimated remaining: 3h 36m 21s. Rate: 9.6 symbols/min [2025-09-14T17:06:32.104427] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:32.133504] [DEBUG] [LOCAL ] BK: Loaded 23984 existing records from primary storage. [2025-09-14T17:06:32.133740] [INFO ] [MAIN ] BK: Loaded 23984 existing records. [2025-09-14T17:06:32.309704] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:32.310001] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-14T17:06:32.310063] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-14T17:06:32.310730] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-14T17:06:32.310801] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-14T17:06:32.563945] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-14T17:06:32.679659] [INFO ] [REMOTE ] BK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:33.356320] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:06:33.366534] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-14T17:06:33.665599] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:06:34.158859] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-14T17:06:34.964003] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-14T17:06:34.987094] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:06:35.486999] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T17:06:35.744732] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T17:06:35.758837] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-14T17:06:36.558849] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-14T17:06:37.358868] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-14T17:06:37.436571] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T17:06:38.054824] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T17:06:38.158841] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-14T17:06:38.958891] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-14T17:06:39.115085] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:06:39.758831] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-14T17:06:40.558830] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-14T17:06:40.581188] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T17:06:40.586553] [INFO ] [REMOTE ] BIRK: Full fetch complete (55217 records). [2025-09-14T17:06:40.586702] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-14T17:06:40.970994] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-14T17:06:40.971199] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-14T17:06:40.971933] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-14T17:06:40.972053] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-14T17:06:41.000014] [DEBUG] [LOCAL ] BIRK: Trimmed 55217 records to 38281 (keeping 150 days of data) [2025-09-14T17:06:41.002885] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-14T17:06:41.245905] [DEBUG] [LOCAL ] BIRK: Primary data saved (38281 records). [2025-09-14T17:06:41.246203] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-14T17:06:41.246443] [INFO ] [MAIN ] Update Progress: 284/2370 symbols completed. BIRK took 29.3s. Estimated remaining: 3h 36m 38s. Rate: 9.6 symbols/min [2025-09-14T17:06:41.358802] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-14T17:06:41.422288] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:41.455734] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:06:41.488832] [DEBUG] [LOCAL ] BKD: Loaded 22535 existing records from primary storage. [2025-09-14T17:06:41.489099] [INFO ] [MAIN ] BKD: Loaded 22535 existing records. [2025-09-14T17:06:41.649966] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:06:41.695716] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:41.696751] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-14T17:06:41.696838] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-14T17:06:41.697424] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-14T17:06:41.697490] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-14T17:06:42.052908] [INFO ] [REMOTE ] BKD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:42.158832] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-14T17:06:42.958843] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-14T17:06:43.228100] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:06:43.301703] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T17:06:43.758854] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-14T17:06:44.028225] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T17:06:44.558908] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-14T17:06:45.366484] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-14T17:06:45.371663] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:06:46.158841] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-14T17:06:46.436812] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T17:06:46.471377] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T17:06:46.958841] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-14T17:06:47.642454] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:06:47.758826] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-14T17:06:48.261327] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T17:06:48.558833] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-14T17:06:49.358915] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-14T17:06:49.455362] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:06:50.158870] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-14T17:06:50.342052] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:06:50.577523] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T17:06:50.581715] [INFO ] [REMOTE ] BIT: Full fetch complete (23333 records). [2025-09-14T17:06:50.581849] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-14T17:06:50.959516] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-14T17:06:50.979794] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T17:06:50.977789] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-14T17:06:50.986134] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-14T17:06:50.987577] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-14T17:06:50.987868] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-14T17:06:50.988285] [INFO ] [REMOTE ] BJ: Full fetch complete (55894 records). [2025-09-14T17:06:50.989085] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-14T17:06:50.989797] [DEBUG] [LOCAL ] BIT: Trimmed 23333 records to 16547 (keeping 150 days of data) [2025-09-14T17:06:51.507599] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-14T17:06:51.509012] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-14T17:06:51.512714] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-14T17:06:51.513542] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-14T17:06:51.519979] [DEBUG] [LOCAL ] BIT: Primary data saved (16547 records). [2025-09-14T17:06:51.520458] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-14T17:06:51.520609] [INFO ] [MAIN ] Update Progress: 285/2370 symbols completed. BIT took 27.0s. Estimated remaining: 3h 37m 1s. Rate: 9.6 symbols/min [2025-09-14T17:06:51.521204] [DEBUG] [LOCAL ] BJ: Trimmed 55894 records to 38619 (keeping 150 days of data) [2025-09-14T17:06:51.771702] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-14T17:06:51.809865] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:51.913238] [DEBUG] [LOCAL ] BKE: Loaded 14987 existing records from primary storage. [2025-09-14T17:06:51.923290] [INFO ] [MAIN ] BKE: Loaded 14987 existing records. [2025-09-14T17:06:52.156161] [DEBUG] [LOCAL ] BJ: Primary data saved (38619 records). [2025-09-14T17:06:52.175920] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-14T17:06:52.175798] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:52.176551] [INFO ] [MAIN ] Update Progress: 286/2370 symbols completed. BJ took 24.2s. Estimated remaining: 3h 36m 14s. Rate: 9.6 symbols/min [2025-09-14T17:06:52.177402] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-14T17:06:52.177732] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-14T17:06:52.259252] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-14T17:06:52.291215] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-14T17:06:52.488975] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:52.713342] [DEBUG] [LOCAL ] BKH: Loaded 17885 existing records from primary storage. [2025-09-14T17:06:52.741042] [INFO ] [MAIN ] BKH: Loaded 17885 existing records. [2025-09-14T17:06:52.782834] [INFO ] [REMOTE ] BKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:52.816334] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-14T17:06:52.978353] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:52.979305] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-14T17:06:52.979491] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-14T17:06:52.980176] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-14T17:06:52.980253] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-14T17:06:53.118108] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-14T17:06:53.363939] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-14T17:06:53.425080] [INFO ] [REMOTE ] BKH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:53.467003] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T17:06:54.158854] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-14T17:06:54.202208] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:06:54.958904] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-14T17:06:55.300011] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T17:06:55.553776] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:06:55.758901] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-14T17:06:56.384572] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:06:56.558878] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-14T17:06:57.358911] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-14T17:06:57.443218] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T17:06:58.078254] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:06:58.158803] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-14T17:06:58.631095] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:06:58.958889] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-14T17:06:59.562198] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T17:06:59.758864] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-14T17:07:00.242340] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T17:07:00.558880] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-14T17:07:00.962233] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T17:07:01.358870] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-14T17:07:01.744795] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T17:07:02.158834] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-14T17:07:02.958884] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-14T17:07:03.058202] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T17:07:03.758877] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-14T17:07:04.016118] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:07:04.243560] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T17:07:04.558878] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-14T17:07:05.209563] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:07:05.358865] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-14T17:07:05.632785] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T17:07:06.158936] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-14T17:07:06.688162] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T17:07:06.785861] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:07:06.790455] [INFO ] [REMOTE ] BKE: Full fetch complete (38007 records). [2025-09-14T17:07:06.790735] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-14T17:07:06.967162] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-14T17:07:07.234241] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-14T17:07:07.234509] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-14T17:07:07.235375] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-14T17:07:07.235456] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-14T17:07:07.238176] [DEBUG] [LOCAL ] BKE: Trimmed 38007 records to 25219 (keeping 150 days of data) [2025-09-14T17:07:07.405981] [DEBUG] [LOCAL ] BKE: Primary data saved (25219 records). [2025-09-14T17:07:07.406210] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-14T17:07:07.406363] [INFO ] [MAIN ] Update Progress: 287/2370 symbols completed. BKE took 15.9s. Estimated remaining: 3h 37m 13s. Rate: 9.6 symbols/min [2025-09-14T17:07:07.586819] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:07.608912] [DEBUG] [LOCAL ] BKKT: Loaded 18164 existing records from primary storage. [2025-09-14T17:07:07.609143] [INFO ] [MAIN ] BKKT: Loaded 18164 existing records. [2025-09-14T17:07:07.763843] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-14T17:07:07.801992] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:07.802374] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-14T17:07:07.802440] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-14T17:07:07.803065] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-14T17:07:07.803137] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-14T17:07:08.193139] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:08.563980] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-14T17:07:08.572952] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:07:08.580255] [INFO ] [REMOTE ] BK: Full fetch complete (58246 records). [2025-09-14T17:07:08.580475] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-14T17:07:08.981231] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-14T17:07:08.981398] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-14T17:07:08.982258] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-14T17:07:08.982344] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-14T17:07:09.011444] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T17:07:09.009810] [DEBUG] [LOCAL ] BK: Trimmed 58246 records to 40340 (keeping 150 days of data) [2025-09-14T17:07:09.280511] [DEBUG] [LOCAL ] BK: Primary data saved (40340 records). [2025-09-14T17:07:09.280713] [INFO ] [MAIN ] BK: Full history saved. [2025-09-14T17:07:09.280842] [INFO ] [MAIN ] Update Progress: 288/2370 symbols completed. BK took 37.4s. Estimated remaining: 3h 36m 35s. Rate: 9.6 symbols/min [2025-09-14T17:07:09.363976] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-14T17:07:09.458209] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:09.463213] [DEBUG] [LOCAL ] BKN: Loaded 2969 existing records from primary storage. [2025-09-14T17:07:09.463340] [INFO ] [MAIN ] BKN: Loaded 2969 existing records. [2025-09-14T17:07:09.654996] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:09.655285] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-14T17:07:09.655595] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-14T17:07:09.656067] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-14T17:07:09.656133] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-14T17:07:10.022955] [INFO ] [REMOTE ] BKN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:10.158848] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-14T17:07:10.357486] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T17:07:10.580845] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T17:07:10.587279] [INFO ] [REMOTE ] BKD: Full fetch complete (54343 records). [2025-09-14T17:07:10.587476] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-14T17:07:10.896108] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T17:07:10.961500] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-14T17:07:10.987476] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-14T17:07:10.987603] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-14T17:07:10.988284] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-14T17:07:10.988355] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-14T17:07:10.989625] [DEBUG] [LOCAL ] BKD: Trimmed 54343 records to 37868 (keeping 150 days of data) [2025-09-14T17:07:11.214703] [DEBUG] [LOCAL ] BKD: Primary data saved (37868 records). [2025-09-14T17:07:11.214878] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-14T17:07:11.214979] [INFO ] [MAIN ] Update Progress: 289/2370 symbols completed. BKD took 30.0s. Estimated remaining: 3h 35m 58s. Rate: 9.6 symbols/min [2025-09-14T17:07:11.383364] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:11.406741] [DEBUG] [LOCAL ] BKSY: Loaded 22942 existing records from primary storage. [2025-09-14T17:07:11.406913] [INFO ] [MAIN ] BKSY: Loaded 22942 existing records. [2025-09-14T17:07:11.595006] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:11.595460] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-14T17:07:11.595529] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-14T17:07:11.596245] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-14T17:07:11.596354] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-14T17:07:11.779183] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-14T17:07:11.974735] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:11.999444] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T17:07:12.558877] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-14T17:07:13.358852] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-14T17:07:13.536445] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:07:14.158852] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-14T17:07:14.328246] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:07:14.958815] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-14T17:07:15.033831] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T17:07:15.105583] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:07:15.350512] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:07:15.354509] [INFO ] [REMOTE ] BKH: Full fetch complete (39500 records). [2025-09-14T17:07:15.354622] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-14T17:07:15.724890] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-14T17:07:15.725005] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-14T17:07:15.725771] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-14T17:07:15.726074] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-14T17:07:15.727510] [DEBUG] [LOCAL ] BKH: Trimmed 39500 records to 27760 (keeping 150 days of data) [2025-09-14T17:07:15.787231] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-14T17:07:15.921680] [DEBUG] [LOCAL ] BKH: Primary data saved (27760 records). [2025-09-14T17:07:15.921871] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-14T17:07:15.922039] [INFO ] [MAIN ] Update Progress: 290/2370 symbols completed. BKH took 23.7s. Estimated remaining: 3h 35m 41s. Rate: 9.6 symbols/min [2025-09-14T17:07:16.094819] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:16.101878] [DEBUG] [LOCAL ] BKT: Loaded 4693 existing records from primary storage. [2025-09-14T17:07:16.102062] [INFO ] [MAIN ] BKT: Loaded 4693 existing records. [2025-09-14T17:07:16.281378] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:16.281661] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-14T17:07:16.281723] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-14T17:07:16.282122] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-14T17:07:16.282201] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-14T17:07:16.445715] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T17:07:16.564023] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-14T17:07:16.653291] [INFO ] [REMOTE ] BKT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:17.358866] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-14T17:07:17.790111] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:07:18.158828] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-14T17:07:18.958853] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-14T17:07:18.986548] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:07:19.120007] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:07:19.457399] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T17:07:19.758834] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-14T17:07:20.518631] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:07:20.558783] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-14T17:07:21.358838] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-14T17:07:21.423436] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T17:07:22.158886] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-14T17:07:22.816096] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T17:07:22.958834] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-14T17:07:23.473914] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T17:07:23.758821] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-14T17:07:24.558812] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-14T17:07:24.804122] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T17:07:24.847841] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T17:07:25.358835] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-14T17:07:25.383360] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:07:26.158842] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-14T17:07:26.178705] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T17:07:26.958855] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-14T17:07:26.982668] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:07:27.758873] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-14T17:07:28.294964] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T17:07:28.558775] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-14T17:07:28.608754] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T17:07:29.358864] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-14T17:07:29.434100] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T17:07:30.158840] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-14T17:07:30.828317] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T17:07:30.958839] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-14T17:07:31.094450] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:07:31.758890] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-14T17:07:32.558936] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-14T17:07:32.598965] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:07:33.131092] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:07:33.132511] [INFO ] [REMOTE ] BKN: Full fetch complete (8127 records). [2025-09-14T17:07:33.132595] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-14T17:07:33.369101] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-14T17:07:33.491803] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-14T17:07:33.491960] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-14T17:07:33.492318] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-14T17:07:33.492530] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-14T17:07:33.493307] [DEBUG] [LOCAL ] BKN: Trimmed 8127 records to 5520 (keeping 150 days of data) [2025-09-14T17:07:33.528841] [DEBUG] [LOCAL ] BKN: Primary data saved (5520 records). [2025-09-14T17:07:33.529113] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-14T17:07:33.529308] [INFO ] [MAIN ] Update Progress: 291/2370 symbols completed. BKN took 24.2s. Estimated remaining: 3h 36m 56s. Rate: 9.6 symbols/min [2025-09-14T17:07:33.706253] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:33.739619] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T17:07:33.764260] [DEBUG] [LOCAL ] BKU: Loaded 18418 existing records from primary storage. [2025-09-14T17:07:33.764403] [INFO ] [MAIN ] BKU: Loaded 18418 existing records. [2025-09-14T17:07:33.950421] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:33.950794] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-14T17:07:33.950863] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-14T17:07:33.951595] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-14T17:07:33.951690] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-14T17:07:34.164153] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-14T17:07:34.317100] [INFO ] [REMOTE ] BKU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:34.958830] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-14T17:07:34.981253] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T17:07:34.986291] [INFO ] [REMOTE ] BKKT: Full fetch complete (35952 records). [2025-09-14T17:07:34.986472] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-14T17:07:35.150814] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:07:35.396360] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-14T17:07:35.396509] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-14T17:07:35.397470] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-14T17:07:35.397549] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-14T17:07:35.398916] [DEBUG] [LOCAL ] BKKT: Trimmed 35952 records to 25840 (keeping 150 days of data) [2025-09-14T17:07:35.556781] [DEBUG] [LOCAL ] BKKT: Primary data saved (25840 records). [2025-09-14T17:07:35.556956] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-14T17:07:35.557061] [INFO ] [MAIN ] Update Progress: 292/2370 symbols completed. BKKT took 28.2s. Estimated remaining: 3h 36m 19s. Rate: 9.6 symbols/min [2025-09-14T17:07:35.732800] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:35.747538] [DEBUG] [LOCAL ] BKV: Loaded 12386 existing records from primary storage. [2025-09-14T17:07:35.747776] [INFO ] [MAIN ] BKV: Loaded 12386 existing records. [2025-09-14T17:07:35.769431] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-14T17:07:35.935625] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:35.936026] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-14T17:07:35.936133] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-14T17:07:35.936823] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-14T17:07:35.936907] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-14T17:07:36.306553] [INFO ] [REMOTE ] BKV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:36.558846] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-14T17:07:36.749140] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:07:36.751113] [INFO ] [REMOTE ] BKT: Full fetch complete (10667 records). [2025-09-14T17:07:36.751202] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-14T17:07:37.124993] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-14T17:07:37.125145] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-14T17:07:37.125716] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-14T17:07:37.125819] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-14T17:07:37.126819] [DEBUG] [LOCAL ] BKT: Trimmed 10667 records to 7512 (keeping 150 days of data) [2025-09-14T17:07:37.196679] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-14T17:07:37.219751] [DEBUG] [LOCAL ] BKT: Primary data saved (7512 records). [2025-09-14T17:07:37.220007] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-14T17:07:37.220179] [INFO ] [MAIN ] Update Progress: 293/2370 symbols completed. BKT took 21.3s. Estimated remaining: 3h 35m 41s. Rate: 9.6 symbols/min [2025-09-14T17:07:37.373504] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-14T17:07:37.412785] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:37.431140] [DEBUG] [LOCAL ] BLCO: Loaded 15563 existing records from primary storage. [2025-09-14T17:07:37.431366] [INFO ] [MAIN ] BLCO: Loaded 15563 existing records. [2025-09-14T17:07:37.610827] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:37.611085] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-14T17:07:37.611147] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-14T17:07:37.611701] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-14T17:07:37.611765] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-14T17:07:37.981242] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:38.005437] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T17:07:38.158859] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-14T17:07:38.888273] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T17:07:38.895619] [INFO ] [REMOTE ] BKSY: Full fetch complete (52696 records). [2025-09-14T17:07:38.895872] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-14T17:07:38.964029] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-14T17:07:39.293858] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-14T17:07:39.294004] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-14T17:07:39.294764] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-14T17:07:39.294830] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-14T17:07:39.296530] [DEBUG] [LOCAL ] BKSY: Trimmed 52696 records to 36355 (keeping 150 days of data) [2025-09-14T17:07:39.533274] [DEBUG] [LOCAL ] BKSY: Primary data saved (36355 records). [2025-09-14T17:07:39.533592] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-14T17:07:39.533756] [INFO ] [MAIN ] Update Progress: 294/2370 symbols completed. BKSY took 28.3s. Estimated remaining: 3h 35m 7s. Rate: 9.7 symbols/min [2025-09-14T17:07:39.722085] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:39.751053] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:07:39.765342] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-14T17:07:39.774050] [DEBUG] [LOCAL ] BLD: Loaded 13101 existing records from primary storage. [2025-09-14T17:07:39.774271] [INFO ] [MAIN ] BLD: Loaded 13101 existing records. [2025-09-14T17:07:39.962099] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:39.962435] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-14T17:07:39.962500] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-14T17:07:39.963084] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-14T17:07:39.963152] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-14T17:07:40.341122] [INFO ] [REMOTE ] BLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:40.365717] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T17:07:40.558843] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-14T17:07:41.150074] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:07:41.358887] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-14T17:07:42.169493] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-14T17:07:42.176667] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T17:07:42.921321] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:07:42.958924] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-14T17:07:43.054736] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:07:43.758893] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-14T17:07:44.479705] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:07:44.558861] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-14T17:07:45.157514] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T17:07:45.358849] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-14T17:07:45.900180] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T17:07:46.158876] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-14T17:07:46.814037] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T17:07:46.958868] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-14T17:07:47.541717] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T17:07:47.758847] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-14T17:07:48.509696] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:07:48.558883] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-14T17:07:49.051446] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T17:07:49.358937] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-14T17:07:50.163248] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-14T17:07:50.170428] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:07:50.564157] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T17:07:50.958943] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-14T17:07:51.443774] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:07:51.758925] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-14T17:07:52.558898] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-14T17:07:52.656867] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T17:07:53.049091] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:07:53.358896] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-14T17:07:53.504259] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T17:07:54.158901] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-14T17:07:54.609928] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T17:07:54.958890] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-14T17:07:55.168333] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T17:07:55.758876] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-14T17:07:56.349422] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T17:07:56.558954] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-14T17:07:56.809076] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T17:07:57.346700] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:07:57.358925] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-14T17:07:58.158873] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-14T17:07:58.224893] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:07:58.228013] [INFO ] [REMOTE ] BKV: Full fetch complete (33426 records). [2025-09-14T17:07:58.228115] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-14T17:07:58.621703] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-14T17:07:58.621853] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-14T17:07:58.622476] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-14T17:07:58.622540] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-14T17:07:58.623934] [DEBUG] [LOCAL ] BKV: Trimmed 33426 records to 21330 (keeping 150 days of data) [2025-09-14T17:07:58.750561] [DEBUG] [LOCAL ] BKV: Primary data saved (21330 records). [2025-09-14T17:07:58.750744] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-14T17:07:58.750870] [INFO ] [MAIN ] Update Progress: 295/2370 symbols completed. BKV took 23.2s. Estimated remaining: 3h 36m 32s. Rate: 9.6 symbols/min [2025-09-14T17:07:58.921948] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:58.944848] [DEBUG] [LOCAL ] BLDR: Loaded 23341 existing records from primary storage. [2025-09-14T17:07:58.945035] [INFO ] [MAIN ] BLDR: Loaded 23341 existing records. [2025-09-14T17:07:58.965687] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-14T17:07:59.124833] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:59.125111] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-14T17:07:59.125193] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-14T17:07:59.126071] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-14T17:07:59.126139] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-14T17:07:59.488382] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:59.581180] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T17:07:59.649198] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:07:59.653758] [INFO ] [REMOTE ] BKU: Full fetch complete (45197 records). [2025-09-14T17:07:59.653943] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-14T17:07:59.764319] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-14T17:08:00.050272] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-14T17:08:00.050381] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-14T17:08:00.050945] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-14T17:08:00.051004] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-14T17:08:00.051990] [DEBUG] [LOCAL ] BKU: Trimmed 45197 records to 31235 (keeping 150 days of data) [2025-09-14T17:08:00.266494] [DEBUG] [LOCAL ] BKU: Primary data saved (31235 records). [2025-09-14T17:08:00.266720] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-14T17:08:00.266842] [INFO ] [MAIN ] Update Progress: 296/2370 symbols completed. BKU took 26.7s. Estimated remaining: 3h 35m 53s. Rate: 9.6 symbols/min [2025-09-14T17:08:00.446386] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:00.454151] [DEBUG] [LOCAL ] BLE: Loaded 5632 existing records from primary storage. [2025-09-14T17:08:00.454297] [INFO ] [MAIN ] BLE: Loaded 5632 existing records. [2025-09-14T17:08:00.564023] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-14T17:08:00.640109] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:00.640390] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-14T17:08:00.640457] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-14T17:08:00.640834] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-14T17:08:00.640899] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-14T17:08:00.995100] [INFO ] [REMOTE ] BLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:01.273441] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T17:08:01.358859] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-14T17:08:02.158866] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-14T17:08:02.511503] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T17:08:02.545953] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:08:02.549379] [INFO ] [REMOTE ] BLCO: Full fetch complete (40300 records). [2025-09-14T17:08:02.549487] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-14T17:08:02.868236] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T17:08:02.954982] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-14T17:08:02.955135] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-14T17:08:02.956042] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-14T17:08:02.956117] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-14T17:08:02.957613] [DEBUG] [LOCAL ] BLCO: Trimmed 40300 records to 26908 (keeping 150 days of data) [2025-09-14T17:08:02.958854] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-14T17:08:03.127030] [DEBUG] [LOCAL ] BLCO: Primary data saved (26908 records). [2025-09-14T17:08:03.127245] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-14T17:08:03.127372] [INFO ] [MAIN ] Update Progress: 297/2370 symbols completed. BLCO took 25.9s. Estimated remaining: 3h 35m 23s. Rate: 9.6 symbols/min [2025-09-14T17:08:03.305177] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:03.323910] [DEBUG] [LOCAL ] BLK: Loaded 14357 existing records from primary storage. [2025-09-14T17:08:03.324183] [INFO ] [MAIN ] BLK: Loaded 14357 existing records. [2025-09-14T17:08:03.515865] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:03.516257] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-14T17:08:03.516322] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-14T17:08:03.517105] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-14T17:08:03.517175] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-14T17:08:03.764170] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-14T17:08:03.901481] [INFO ] [REMOTE ] BLK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:04.558929] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-14T17:08:04.883395] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:08:05.177529] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:08:05.358841] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-14T17:08:06.158842] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-14T17:08:06.513062] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T17:08:06.706729] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:08:06.709827] [INFO ] [REMOTE ] BLD: Full fetch complete (30856 records). [2025-09-14T17:08:06.709940] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-14T17:08:06.963567] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-14T17:08:07.085633] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-14T17:08:07.085893] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-14T17:08:07.086563] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-14T17:08:07.086658] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-14T17:08:07.087751] [DEBUG] [LOCAL ] BLD: Trimmed 30856 records to 20705 (keeping 150 days of data) [2025-09-14T17:08:07.222435] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:08:07.258937] [DEBUG] [LOCAL ] BLD: Primary data saved (20705 records). [2025-09-14T17:08:07.259111] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-14T17:08:07.259286] [INFO ] [MAIN ] Update Progress: 298/2370 symbols completed. BLD took 27.7s. Estimated remaining: 3h 35m 2s. Rate: 9.6 symbols/min [2025-09-14T17:08:07.457316] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:07.478033] [DEBUG] [LOCAL ] BLND: Loaded 21744 existing records from primary storage. [2025-09-14T17:08:07.478210] [INFO ] [MAIN ] BLND: Loaded 21744 existing records. [2025-09-14T17:08:07.653942] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:07.654197] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-14T17:08:07.654258] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-14T17:08:07.654916] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-14T17:08:07.654980] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-14T17:08:07.763954] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-14T17:08:08.034464] [INFO ] [REMOTE ] BLND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:08.091439] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T17:08:08.558855] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-14T17:08:09.358841] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-14T17:08:09.565923] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T17:08:09.848186] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:08:10.158880] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-14T17:08:10.732061] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T17:08:10.958863] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-14T17:08:11.552477] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T17:08:11.758857] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-14T17:08:11.983278] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:08:12.558839] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-14T17:08:13.358903] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-14T17:08:13.805269] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T17:08:14.158852] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-14T17:08:14.430996] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:08:14.487888] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:08:14.958858] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-14T17:08:15.758862] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-14T17:08:16.155780] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T17:08:16.558831] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-14T17:08:16.614787] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T17:08:16.935790] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:08:17.358840] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-14T17:08:18.129220] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T17:08:18.158027] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:08:18.161002] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-14T17:08:18.492666] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:08:18.498256] [INFO ] [REMOTE ] BLDR: Full fetch complete (56096 records). [2025-09-14T17:08:18.498445] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-14T17:08:18.888431] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-14T17:08:18.888593] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-14T17:08:18.889348] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-14T17:08:18.889421] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-14T17:08:18.890859] [DEBUG] [LOCAL ] BLDR: Trimmed 56096 records to 39059 (keeping 150 days of data) [2025-09-14T17:08:18.982832] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-14T17:08:19.137047] [DEBUG] [LOCAL ] BLDR: Primary data saved (39059 records). [2025-09-14T17:08:19.137224] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-14T17:08:19.137331] [INFO ] [MAIN ] Update Progress: 299/2370 symbols completed. BLDR took 20.4s. Estimated remaining: 3h 35m 35s. Rate: 9.6 symbols/min [2025-09-14T17:08:19.312054] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:19.322149] [DEBUG] [LOCAL ] BLSH: Loaded 8340 existing records from primary storage. [2025-09-14T17:08:19.322297] [INFO ] [MAIN ] BLSH: Loaded 8340 existing records. [2025-09-14T17:08:19.502479] [WARN ] [MAIN ] BLSH: Insufficient historical data. Have data from 2025-08-13, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:19.502756] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-14T17:08:19.502875] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-14T17:08:19.503252] [DEBUG] [LOCAL ] BLSH: Deleted primary data file. [2025-09-14T17:08:19.503313] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-14T17:08:19.764037] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-14T17:08:19.867468] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:20.558821] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-14T17:08:20.813370] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:20.813730] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-14T17:08:20.943077] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T17:08:21.049465] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:08:21.358815] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-14T17:08:22.158834] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-14T17:08:22.414624] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:22.415009] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-14T17:08:22.743308] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T17:08:22.958853] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-14T17:08:23.758870] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-14T17:08:23.794771] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T17:08:23.797373] [INFO ] [REMOTE ] BLE: Full fetch complete (15570 records). [2025-09-14T17:08:23.797494] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-14T17:08:24.033608] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:24.093512] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-14T17:08:24.173851] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-14T17:08:24.173960] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-14T17:08:24.174302] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-14T17:08:24.174364] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-14T17:08:24.174964] [DEBUG] [LOCAL ] BLE: Trimmed 15570 records to 10534 (keeping 150 days of data) [2025-09-14T17:08:24.239114] [DEBUG] [LOCAL ] BLE: Primary data saved (10534 records). [2025-09-14T17:08:24.239295] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-14T17:08:24.239394] [INFO ] [MAIN ] Update Progress: 300/2370 symbols completed. BLE took 24.0s. Estimated remaining: 3h 35m 21s. Rate: 9.6 symbols/min [2025-09-14T17:08:24.415890] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:24.424246] [DEBUG] [LOCAL ] BLW: Loaded 5455 existing records from primary storage. [2025-09-14T17:08:24.424422] [INFO ] [MAIN ] BLW: Loaded 5455 existing records. [2025-09-14T17:08:24.568546] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-14T17:08:24.612621] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:24.612929] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-14T17:08:24.612999] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-14T17:08:24.613336] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-14T17:08:24.613398] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-14T17:08:24.888460] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:24.889091] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-14T17:08:24.965629] [INFO ] [REMOTE ] BLW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:25.358870] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-14T17:08:26.158911] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-14T17:08:26.408455] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:26.408819] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-14T17:08:26.958859] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-14T17:08:27.225051] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T17:08:27.758871] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-14T17:08:28.542912] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T17:08:28.558773] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-14T17:08:29.226420] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T17:08:29.358863] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-14T17:08:29.625482] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T17:08:29.629325] [INFO ] [REMOTE ] BLK: Full fetch complete (39253 records). [2025-09-14T17:08:29.629440] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-14T17:08:30.018848] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-14T17:08:30.019074] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-14T17:08:30.019715] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-14T17:08:30.019986] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-14T17:08:30.021458] [DEBUG] [LOCAL ] BLK: Trimmed 39253 records to 24978 (keeping 150 days of data) [2025-09-14T17:08:30.159513] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T17:08:30.159663] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-14T17:08:30.242231] [DEBUG] [LOCAL ] BLK: Primary data saved (24978 records). [2025-09-14T17:08:30.242435] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-14T17:08:30.242544] [INFO ] [MAIN ] Update Progress: 301/2370 symbols completed. BLK took 27.1s. Estimated remaining: 3h 35m 13s. Rate: 9.6 symbols/min [2025-09-14T17:08:30.415897] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:30.424688] [DEBUG] [LOCAL ] BLX: Loaded 6732 existing records from primary storage. [2025-09-14T17:08:30.424837] [INFO ] [MAIN ] BLX: Loaded 6732 existing records. [2025-09-14T17:08:30.469227] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:30.518409] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-14T17:08:30.612941] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:30.613227] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-14T17:08:30.613295] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-14T17:08:30.613725] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-14T17:08:30.613788] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-14T17:08:30.968400] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-14T17:08:30.995814] [INFO ] [REMOTE ] BLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:31.758881] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-14T17:08:32.390895] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T17:08:32.558812] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-14T17:08:32.628292] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T17:08:33.358844] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-14T17:08:34.166826] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-14T17:08:34.172883] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:08:34.243905] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:08:34.958888] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-14T17:08:35.758865] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-14T17:08:36.037543] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T17:08:36.258256] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-14T17:08:36.263669] [INFO ] [REMOTE ] BLSH: Full fetch complete (8329 records). [2025-09-14T17:08:36.263756] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-14T17:08:36.448901] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 22 unique days, need 150 days [2025-09-14T17:08:36.449322] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:08:36.449502] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:08:36.454794] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-14T17:08:36.460111] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-14T17:08:36.460862] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-14T17:08:36.461587] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T17:08:36.461775] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-14T17:08:36.462014] [INFO ] [MAIN ] Update Progress: 302/2370 symbols completed. BLSH took 17.3s. Estimated remaining: 3h 35m 6s. Rate: 9.6 symbols/min [2025-09-14T17:08:36.563963] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-14T17:08:36.641961] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:36.658624] [DEBUG] [LOCAL ] BMA: Loaded 15502 existing records from primary storage. [2025-09-14T17:08:36.658822] [INFO ] [MAIN ] BMA: Loaded 15502 existing records. [2025-09-14T17:08:36.841861] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:36.842219] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-14T17:08:36.842288] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-14T17:08:36.843078] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-14T17:08:36.843151] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-14T17:08:37.248872] [INFO ] [REMOTE ] BMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:37.358865] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-14T17:08:38.158787] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-14T17:08:38.189159] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T17:08:38.466300] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:08:38.958842] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-14T17:08:39.529334] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T17:08:39.758862] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-14T17:08:39.980401] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:08:40.558831] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-14T17:08:40.899287] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:08:41.147318] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T17:08:41.358828] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-14T17:08:42.158851] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-14T17:08:42.863123] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T17:08:42.869298] [INFO ] [REMOTE ] BLND: Full fetch complete (53899 records). [2025-09-14T17:08:42.869485] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-14T17:08:42.966531] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-14T17:08:43.217930] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T17:08:43.296160] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-14T17:08:43.296282] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-14T17:08:43.296992] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-14T17:08:43.297051] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-14T17:08:43.298220] [DEBUG] [LOCAL ] BLND: Trimmed 53899 records to 36755 (keeping 150 days of data) [2025-09-14T17:08:43.511700] [DEBUG] [LOCAL ] BLND: Primary data saved (36755 records). [2025-09-14T17:08:43.511912] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-14T17:08:43.512036] [INFO ] [MAIN ] Update Progress: 303/2370 symbols completed. BLND took 36.3s. Estimated remaining: 3h 35m 6s. Rate: 9.6 symbols/min [2025-09-14T17:08:43.690353] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:43.697469] [DEBUG] [LOCAL ] BME: Loaded 5202 existing records from primary storage. [2025-09-14T17:08:43.697612] [INFO ] [MAIN ] BME: Loaded 5202 existing records. [2025-09-14T17:08:43.764050] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-14T17:08:43.876325] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:43.876613] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-14T17:08:43.876714] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-14T17:08:43.877013] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-14T17:08:43.877071] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-14T17:08:44.241828] [INFO ] [REMOTE ] BME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:44.407542] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T17:08:44.558839] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-14T17:08:44.668739] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:08:45.358832] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-14T17:08:45.985569] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T17:08:46.158790] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-14T17:08:46.347899] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:08:46.661791] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T17:08:46.958868] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-14T17:08:47.758866] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-14T17:08:47.825418] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T17:08:48.333545] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T17:08:48.558859] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-14T17:08:49.358913] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-14T17:08:49.997927] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T17:08:50.053409] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:08:50.158986] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-14T17:08:50.732047] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T17:08:50.958883] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-14T17:08:51.758905] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-14T17:08:51.964573] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T17:08:52.558827] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-14T17:08:52.663482] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T17:08:53.241143] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:08:53.243367] [INFO ] [REMOTE ] BLW: Full fetch complete (14018 records). [2025-09-14T17:08:53.243462] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-14T17:08:53.364061] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-14T17:08:53.638821] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-14T17:08:53.638941] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-14T17:08:53.639364] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-14T17:08:53.639428] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-14T17:08:53.640228] [DEBUG] [LOCAL ] BLW: Trimmed 14018 records to 9026 (keeping 150 days of data) [2025-09-14T17:08:53.700294] [DEBUG] [LOCAL ] BLW: Primary data saved (9026 records). [2025-09-14T17:08:53.700511] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-14T17:08:53.700703] [INFO ] [MAIN ] Update Progress: 304/2370 symbols completed. BLW took 29.5s. Estimated remaining: 3h 35m 26s. Rate: 9.6 symbols/min [2025-09-14T17:08:53.876314] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:53.892052] [DEBUG] [LOCAL ] BMEZ: Loaded 11083 existing records from primary storage. [2025-09-14T17:08:53.892224] [INFO ] [MAIN ] BMEZ: Loaded 11083 existing records. [2025-09-14T17:08:54.070816] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:54.071102] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-14T17:08:54.071165] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-14T17:08:54.071629] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-14T17:08:54.071733] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-14T17:08:54.163217] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-14T17:08:54.235697] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:08:54.263296] [INFO ] [REMOTE ] BLX: Full fetch complete (17094 records). [2025-09-14T17:08:54.301101] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-14T17:08:54.585534] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:54.851584] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-14T17:08:54.851749] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-14T17:08:54.852292] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-14T17:08:54.852353] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-14T17:08:54.853579] [DEBUG] [LOCAL ] BLX: Trimmed 17094 records to 11179 (keeping 150 days of data) [2025-09-14T17:08:54.931274] [DEBUG] [LOCAL ] BLX: Primary data saved (11179 records). [2025-09-14T17:08:54.931552] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-14T17:08:54.931780] [INFO ] [MAIN ] Update Progress: 305/2370 symbols completed. BLX took 24.7s. Estimated remaining: 3h 34m 46s. Rate: 9.6 symbols/min [2025-09-14T17:08:54.965904] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-14T17:08:55.113149] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:55.127261] [DEBUG] [LOCAL ] BMI: Loaded 10899 existing records from primary storage. [2025-09-14T17:08:55.127434] [INFO ] [MAIN ] BMI: Loaded 10899 existing records. [2025-09-14T17:08:55.312236] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:55.312555] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-14T17:08:55.312620] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-14T17:08:55.313250] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-14T17:08:55.313319] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-14T17:08:55.682292] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:08:55.706769] [INFO ] [REMOTE ] BMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:55.737988] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T17:08:55.758780] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-14T17:08:56.558924] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-14T17:08:56.812257] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T17:08:57.358934] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-14T17:08:57.740406] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:08:58.158904] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-14T17:08:58.499468] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T17:08:58.958846] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-14T17:08:59.052507] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:08:59.758954] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-14T17:08:59.837524] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:09:00.558848] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-14T17:09:01.111068] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T17:09:01.115978] [INFO ] [REMOTE ] BMA: Full fetch complete (37642 records). [2025-09-14T17:09:01.116125] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-14T17:09:01.364291] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-14T17:09:01.547010] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-14T17:09:01.547120] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-14T17:09:01.547773] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-14T17:09:01.547840] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-14T17:09:01.548980] [DEBUG] [LOCAL ] BMA: Trimmed 37642 records to 25819 (keeping 150 days of data) [2025-09-14T17:09:01.718325] [DEBUG] [LOCAL ] BMA: Primary data saved (25819 records). [2025-09-14T17:09:01.718521] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-14T17:09:01.718670] [INFO ] [MAIN ] Update Progress: 306/2370 symbols completed. BMA took 25.3s. Estimated remaining: 3h 34m 43s. Rate: 9.6 symbols/min [2025-09-14T17:09:01.911618] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:01.934978] [DEBUG] [LOCAL ] BMN: Loaded 1221 existing records from primary storage. [2025-09-14T17:09:01.937305] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T17:09:01.937453] [INFO ] [MAIN ] BMN: Loaded 1221 existing records. [2025-09-14T17:09:02.120203] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:02.120470] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-14T17:09:02.120532] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-14T17:09:02.120769] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-14T17:09:02.120830] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-14T17:09:02.164016] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-14T17:09:02.490755] [INFO ] [REMOTE ] BMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:02.958877] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-14T17:09:03.409931] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-14T17:09:03.758851] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-14T17:09:04.558854] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-14T17:09:04.611546] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-14T17:09:04.724077] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T17:09:05.032688] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T17:09:05.358821] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-14T17:09:05.456435] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T17:09:06.158881] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-14T17:09:06.677073] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T17:09:06.958859] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-14T17:09:07.010481] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T17:09:07.758855] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-14T17:09:08.010457] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T17:09:08.558837] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-14T17:09:08.828286] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:09:09.358801] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-14T17:09:09.814391] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:09:10.158896] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-14T17:09:10.795747] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T17:09:10.816405] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:09:10.958873] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-14T17:09:11.491413] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T17:09:11.758903] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-14T17:09:12.558906] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-14T17:09:12.627336] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T17:09:13.358856] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-14T17:09:14.076672] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T17:09:14.158838] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-14T17:09:14.388799] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:09:14.494800] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-14T17:09:14.958848] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-14T17:09:15.538166] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:09:15.541587] [INFO ] [REMOTE ] BMI: Full fetch complete (25136 records). [2025-09-14T17:09:15.541723] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-14T17:09:15.761868] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-14T17:09:15.960517] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-14T17:09:15.960628] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-14T17:09:15.961070] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-14T17:09:15.961126] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-14T17:09:15.961907] [DEBUG] [LOCAL ] BMI: Trimmed 25136 records to 17696 (keeping 150 days of data) [2025-09-14T17:09:16.084377] [DEBUG] [LOCAL ] BMI: Primary data saved (17696 records). [2025-09-14T17:09:16.084606] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-14T17:09:16.084748] [INFO ] [MAIN ] Update Progress: 307/2370 symbols completed. BMI took 21.2s. Estimated remaining: 3h 35m 32s. Rate: 9.6 symbols/min [2025-09-14T17:09:16.265315] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:16.286429] [DEBUG] [LOCAL ] BMO: Loaded 18430 existing records from primary storage. [2025-09-14T17:09:16.286605] [INFO ] [MAIN ] BMO: Loaded 18430 existing records. [2025-09-14T17:09:16.395725] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T17:09:16.479771] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:16.480050] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-14T17:09:16.480114] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-14T17:09:16.480827] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-14T17:09:16.480892] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-14T17:09:16.564004] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-14T17:09:16.840147] [INFO ] [REMOTE ] BMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:17.358877] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-14T17:09:17.822470] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:09:18.158881] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-14T17:09:18.575794] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:09:18.654680] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:09:18.655736] [INFO ] [REMOTE ] BMN: Full fetch complete (2760 records). [2025-09-14T17:09:18.655852] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-14T17:09:18.964025] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-14T17:09:19.022238] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-14T17:09:19.022353] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-14T17:09:19.022487] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-14T17:09:19.022539] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-14T17:09:19.022931] [DEBUG] [LOCAL ] BMN: Trimmed 2760 records to 1921 (keeping 150 days of data) [2025-09-14T17:09:19.035930] [DEBUG] [LOCAL ] BMN: Primary data saved (1921 records). [2025-09-14T17:09:19.036015] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-14T17:09:19.036105] [INFO ] [MAIN ] Update Progress: 308/2370 symbols completed. BMN took 17.3s. Estimated remaining: 3h 35m 3s. Rate: 9.6 symbols/min [2025-09-14T17:09:19.202983] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:19.226927] [DEBUG] [LOCAL ] BMY: Loaded 24117 existing records from primary storage. [2025-09-14T17:09:19.227109] [INFO ] [MAIN ] BMY: Loaded 24117 existing records. [2025-09-14T17:09:19.399790] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:19.400038] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-14T17:09:19.400099] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-14T17:09:19.400805] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-14T17:09:19.400869] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-14T17:09:19.764045] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-14T17:09:19.803710] [INFO ] [REMOTE ] BMY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:19.811545] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:09:19.815860] [INFO ] [REMOTE ] BME: Full fetch complete (11374 records). [2025-09-14T17:09:19.816060] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-14T17:09:20.188934] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-14T17:09:20.189051] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-14T17:09:20.189366] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-14T17:09:20.189419] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-14T17:09:20.189926] [DEBUG] [LOCAL ] BME: Trimmed 11374 records to 8191 (keeping 150 days of data) [2025-09-14T17:09:20.242630] [DEBUG] [LOCAL ] BME: Primary data saved (8191 records). [2025-09-14T17:09:20.242836] [INFO ] [MAIN ] BME: Full history saved. [2025-09-14T17:09:20.242935] [INFO ] [MAIN ] Update Progress: 309/2370 symbols completed. BME took 36.7s. Estimated remaining: 3h 34m 23s. Rate: 9.6 symbols/min [2025-09-14T17:09:20.413707] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:20.440380] [DEBUG] [LOCAL ] BN: Loaded 23725 existing records from primary storage. [2025-09-14T17:09:20.440567] [INFO ] [MAIN ] BN: Loaded 23725 existing records. [2025-09-14T17:09:20.564006] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-14T17:09:20.618000] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:20.618217] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-14T17:09:20.618279] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-14T17:09:20.618914] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-14T17:09:20.618979] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-14T17:09:20.767301] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T17:09:20.873683] [INFO ] [REMOTE ] BMEZ: Full fetch complete (28434 records). [2025-09-14T17:09:20.905284] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-14T17:09:21.080769] [INFO ] [REMOTE ] BN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:21.360968] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-14T17:09:21.368673] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-14T17:09:21.369532] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-14T17:09:21.370119] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-14T17:09:21.370226] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-14T17:09:21.371207] [DEBUG] [LOCAL ] BMEZ: Trimmed 28434 records to 18009 (keeping 150 days of data) [2025-09-14T17:09:21.486512] [DEBUG] [LOCAL ] BMEZ: Primary data saved (18009 records). [2025-09-14T17:09:21.486746] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-14T17:09:21.486927] [INFO ] [MAIN ] Update Progress: 310/2370 symbols completed. BMEZ took 27.8s. Estimated remaining: 3h 33m 44s. Rate: 9.6 symbols/min [2025-09-14T17:09:21.661787] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:21.675895] [DEBUG] [LOCAL ] BNED: Loaded 13524 existing records from primary storage. [2025-09-14T17:09:21.676052] [INFO ] [MAIN ] BNED: Loaded 13524 existing records. [2025-09-14T17:09:21.850548] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:21.850869] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-14T17:09:21.850948] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-14T17:09:21.851411] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-14T17:09:21.851472] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-14T17:09:22.174743] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-14T17:09:22.213264] [INFO ] [REMOTE ] BNED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:22.605853] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T17:09:22.958853] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-14T17:09:23.133865] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:09:23.758853] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-14T17:09:23.845587] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:09:23.890361] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T17:09:24.558897] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-14T17:09:25.358840] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-14T17:09:25.931125] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-14T17:09:25.939921] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T17:09:26.158852] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-14T17:09:26.958861] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-14T17:09:27.434733] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-14T17:09:27.758925] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-14T17:09:28.135919] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:09:28.216851] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:09:28.558840] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-14T17:09:29.358893] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-14T17:09:29.821746] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:09:29.998497] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T17:09:30.158861] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-14T17:09:30.958918] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-14T17:09:31.255571] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:09:31.291763] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T17:09:31.758898] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-14T17:09:32.458007] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T17:09:32.558791] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-14T17:09:32.651702] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T17:09:33.358827] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-14T17:09:33.847698] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:09:34.158842] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-14T17:09:34.958813] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-14T17:09:35.213211] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:09:35.739157] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T17:09:35.758782] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-14T17:09:36.558830] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-14T17:09:37.018322] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T17:09:37.166037] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T17:09:37.170943] [INFO ] [REMOTE ] BMO: Full fetch complete (44899 records). [2025-09-14T17:09:37.171095] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-14T17:09:37.363927] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-14T17:09:37.555934] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-14T17:09:37.556100] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-14T17:09:37.556754] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-14T17:09:37.556824] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-14T17:09:37.572717] [DEBUG] [LOCAL ] BMO: Trimmed 44899 records to 30336 (keeping 150 days of data) [2025-09-14T17:09:37.573287] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T17:09:37.766493] [DEBUG] [LOCAL ] BMO: Primary data saved (30336 records). [2025-09-14T17:09:37.766695] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-14T17:09:37.766830] [INFO ] [MAIN ] Update Progress: 311/2370 symbols completed. BMO took 21.7s. Estimated remaining: 3h 34m 44s. Rate: 9.6 symbols/min [2025-09-14T17:09:37.939981] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:37.943509] [DEBUG] [LOCAL ] BNH: Loaded 1790 existing records from primary storage. [2025-09-14T17:09:37.943601] [INFO ] [MAIN ] BNH: Loaded 1790 existing records. [2025-09-14T17:09:38.119767] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:38.120052] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-14T17:09:38.120132] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-14T17:09:38.120397] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-14T17:09:38.120494] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-14T17:09:38.163984] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-14T17:09:38.475733] [INFO ] [REMOTE ] BNH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:38.958844] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-14T17:09:39.711142] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T17:09:39.750038] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:09:39.759047] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-14T17:09:40.558831] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-14T17:09:40.883419] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:09:40.920165] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:09:41.151600] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T17:09:41.358824] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-14T17:09:42.158843] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-14T17:09:42.958790] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-14T17:09:43.245874] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:09:43.248907] [INFO ] [REMOTE ] BNED: Full fetch complete (32413 records). [2025-09-14T17:09:43.249003] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-14T17:09:43.415146] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:09:43.659079] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-14T17:09:43.659446] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-14T17:09:43.660213] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-14T17:09:43.661960] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-14T17:09:43.662120] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-14T17:09:43.674574] [DEBUG] [LOCAL ] BNED: Trimmed 32413 records to 22113 (keeping 150 days of data) [2025-09-14T17:09:43.760232] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-14T17:09:43.807253] [DEBUG] [LOCAL ] BNED: Primary data saved (22113 records). [2025-09-14T17:09:43.807402] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-14T17:09:43.807498] [INFO ] [MAIN ] Update Progress: 312/2370 symbols completed. BNED took 22.3s. Estimated remaining: 3h 34m 36s. Rate: 9.6 symbols/min [2025-09-14T17:09:43.975664] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:43.978370] [DEBUG] [LOCAL ] BNJ: Loaded 1058 existing records from primary storage. [2025-09-14T17:09:43.978458] [INFO ] [MAIN ] BNJ: Loaded 1058 existing records. [2025-09-14T17:09:44.154988] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:44.155210] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-14T17:09:44.155268] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-14T17:09:44.155569] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-14T17:09:44.155660] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-14T17:09:44.502488] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:44.558773] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-14T17:09:45.052850] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T17:09:45.358856] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-14T17:09:45.691348] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T17:09:46.158873] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-14T17:09:46.810020] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:09:46.958921] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-14T17:09:47.524877] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-14T17:09:47.749261] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T17:09:47.758767] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-14T17:09:48.448229] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:09:48.558880] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-14T17:09:49.358903] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-14T17:09:49.863717] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T17:09:49.871805] [INFO ] [REMOTE ] BN: Full fetch complete (57637 records). [2025-09-14T17:09:49.872059] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-14T17:09:49.977871] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T17:09:50.164764] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-14T17:09:50.258988] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-14T17:09:50.259090] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-14T17:09:50.259792] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-14T17:09:50.259855] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-14T17:09:50.261114] [DEBUG] [LOCAL ] BN: Trimmed 57637 records to 39788 (keeping 150 days of data) [2025-09-14T17:09:50.516438] [DEBUG] [LOCAL ] BN: Primary data saved (39788 records). [2025-09-14T17:09:50.516717] [INFO ] [MAIN ] BN: Full history saved. [2025-09-14T17:09:50.516812] [INFO ] [MAIN ] Update Progress: 313/2370 symbols completed. BN took 30.3s. Estimated remaining: 3h 34m 33s. Rate: 9.6 symbols/min [2025-09-14T17:09:50.686192] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:50.705948] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:09:50.711924] [INFO ] [REMOTE ] BMY: Full fetch complete (58437 records). [2025-09-14T17:09:50.712112] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-14T17:09:50.839839] [DEBUG] [LOCAL ] BNL: Loaded 21001 existing records from primary storage. [2025-09-14T17:09:50.869227] [INFO ] [MAIN ] BNL: Loaded 21001 existing records. [2025-09-14T17:09:50.960989] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-14T17:09:51.271296] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:51.294102] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-14T17:09:51.309790] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-14T17:09:51.309671] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-14T17:09:51.310094] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-14T17:09:51.311050] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-14T17:09:51.311001] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-14T17:09:51.311218] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-14T17:09:51.316468] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-14T17:09:51.438445] [DEBUG] [LOCAL ] BMY: Trimmed 58437 records to 40497 (keeping 150 days of data) [2025-09-14T17:09:51.779058] [INFO ] [REMOTE ] BNL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:51.774723] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-14T17:09:51.787109] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T17:09:51.964562] [DEBUG] [LOCAL ] BMY: Primary data saved (40497 records). [2025-09-14T17:09:51.964810] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-14T17:09:51.964929] [INFO ] [MAIN ] Update Progress: 314/2370 symbols completed. BMY took 32.9s. Estimated remaining: 3h 33m 55s. Rate: 9.6 symbols/min [2025-09-14T17:09:52.144102] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:52.168917] [DEBUG] [LOCAL ] BNS: Loaded 22904 existing records from primary storage. [2025-09-14T17:09:52.169138] [INFO ] [MAIN ] BNS: Loaded 22904 existing records. [2025-09-14T17:09:52.350607] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:52.350933] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-14T17:09:52.351026] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-14T17:09:52.351932] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-14T17:09:52.352002] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-14T17:09:52.491965] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T17:09:52.564039] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-14T17:09:52.736432] [INFO ] [REMOTE ] BNS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:53.358860] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-14T17:09:53.945017] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T17:09:54.135132] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T17:09:54.158784] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-14T17:09:54.958831] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-14T17:09:55.701382] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:09:55.758833] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-14T17:09:56.409281] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:09:56.558897] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-14T17:09:56.735433] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T17:09:56.948129] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:09:56.949446] [INFO ] [REMOTE ] BNH: Full fetch complete (5147 records). [2025-09-14T17:09:56.949550] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-14T17:09:57.332808] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-14T17:09:57.332945] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-14T17:09:57.333173] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-14T17:09:57.333229] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-14T17:09:57.333728] [DEBUG] [LOCAL ] BNH: Trimmed 5147 records to 3202 (keeping 150 days of data) [2025-09-14T17:09:57.354784] [DEBUG] [LOCAL ] BNH: Primary data saved (3202 records). [2025-09-14T17:09:57.354937] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-14T17:09:57.355067] [INFO ] [MAIN ] Update Progress: 315/2370 symbols completed. BNH took 19.6s. Estimated remaining: 3h 33m 44s. Rate: 9.6 symbols/min [2025-09-14T17:09:57.366695] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-14T17:09:57.537778] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:57.541999] [DEBUG] [LOCAL ] BNT: Loaded 1305 existing records from primary storage. [2025-09-14T17:09:57.542156] [INFO ] [MAIN ] BNT: Loaded 1305 existing records. [2025-09-14T17:09:57.725293] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:57.725691] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-14T17:09:57.725787] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-14T17:09:57.726109] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-14T17:09:57.726174] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-14T17:09:58.104573] [INFO ] [REMOTE ] BNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:58.158874] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-14T17:09:58.726868] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-14T17:09:58.958861] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-14T17:09:59.317476] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T17:09:59.443400] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T17:09:59.758855] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-14T17:10:00.089928] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-14T17:10:00.558839] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-14T17:10:00.965383] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:10:00.966419] [INFO ] [REMOTE ] BNJ: Full fetch complete (2885 records). [2025-09-14T17:10:00.966504] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-14T17:10:01.358336] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-14T17:10:01.358552] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-14T17:10:01.358934] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-14T17:10:01.359187] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-14T17:10:01.361004] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-14T17:10:01.363638] [DEBUG] [LOCAL ] BNJ: Trimmed 2885 records to 1751 (keeping 150 days of data) [2025-09-14T17:10:01.387422] [DEBUG] [LOCAL ] BNJ: Primary data saved (1751 records). [2025-09-14T17:10:01.387731] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-14T17:10:01.387953] [INFO ] [MAIN ] Update Progress: 316/2370 symbols completed. BNJ took 17.6s. Estimated remaining: 3h 33m 23s. Rate: 9.6 symbols/min [2025-09-14T17:10:01.640162] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:01.646951] [DEBUG] [LOCAL ] BNY: Loaded 3376 existing records from primary storage. [2025-09-14T17:10:01.647161] [INFO ] [MAIN ] BNY: Loaded 3376 existing records. [2025-09-14T17:10:01.938120] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:01.938721] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-14T17:10:01.938811] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-14T17:10:01.939308] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-14T17:10:01.939385] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-14T17:10:02.111818] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T17:10:02.164112] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-14T17:10:02.554070] [INFO ] [REMOTE ] BNY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:02.958896] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-14T17:10:03.758848] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-14T17:10:04.066798] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T17:10:04.408072] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:10:04.547496] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:10:04.558874] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-14T17:10:05.267515] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T17:10:05.358830] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-14T17:10:06.158870] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-14T17:10:06.958898] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-14T17:10:06.981820] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T17:10:07.206700] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:10:07.747632] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T17:10:07.758772] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-14T17:10:08.260021] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-14T17:10:08.558889] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-14T17:10:09.358889] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-14T17:10:10.067050] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T17:10:10.158847] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-14T17:10:10.316737] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:10:10.507540] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-14T17:10:10.958886] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-14T17:10:11.758907] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-14T17:10:12.551440] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T17:10:12.558770] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-14T17:10:12.591914] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:10:13.358873] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-14T17:10:13.372398] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T17:10:14.158873] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-14T17:10:14.652027] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T17:10:14.958895] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-14T17:10:15.001146] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T17:10:15.758844] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-14T17:10:16.210230] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T17:10:16.211808] [INFO ] [REMOTE ] BNT: Full fetch complete (3475 records). [2025-09-14T17:10:16.211915] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-14T17:10:16.558948] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-14T17:10:16.579236] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-14T17:10:16.580128] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-14T17:10:16.580288] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-14T17:10:16.580501] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-14T17:10:16.581195] [DEBUG] [LOCAL ] BNT: Trimmed 3475 records to 2113 (keeping 150 days of data) [2025-09-14T17:10:16.594633] [DEBUG] [LOCAL ] BNT: Primary data saved (2113 records). [2025-09-14T17:10:16.594745] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-14T17:10:16.594901] [INFO ] [MAIN ] Update Progress: 317/2370 symbols completed. BNT took 19.2s. Estimated remaining: 3h 34m 15s. Rate: 9.6 symbols/min [2025-09-14T17:10:16.660596] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T17:10:17.358942] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-14T17:10:18.158796] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-14T17:10:18.234158] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T17:10:18.958892] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-14T17:10:18.984738] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:10:19.299473] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T17:10:19.758916] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-14T17:10:20.458199] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T17:10:20.463236] [INFO ] [REMOTE ] BNL: Full fetch complete (50748 records). [2025-09-14T17:10:20.463398] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-14T17:10:20.564820] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-14T17:10:20.857513] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-14T17:10:20.857674] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-14T17:10:20.858380] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-14T17:10:20.858445] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-14T17:10:20.859778] [DEBUG] [LOCAL ] BNL: Trimmed 50748 records to 35098 (keeping 150 days of data) [2025-09-14T17:10:21.082170] [DEBUG] [LOCAL ] BNL: Primary data saved (35098 records). [2025-09-14T17:10:21.082338] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-14T17:10:21.082440] [INFO ] [MAIN ] Update Progress: 318/2370 symbols completed. BNL took 30.6s. Estimated remaining: 3h 33m 57s. Rate: 9.6 symbols/min [2025-09-14T17:10:21.141604] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T17:10:21.358828] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-14T17:10:21.622200] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:10:22.158866] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-14T17:10:22.180882] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:10:22.958888] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-14T17:10:23.617309] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:10:23.618844] [INFO ] [REMOTE ] BNY: Full fetch complete (7738 records). [2025-09-14T17:10:23.618952] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-14T17:10:24.000400] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-14T17:10:24.028814] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-14T17:10:24.035491] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-14T17:10:24.036223] [INFO ] [REMOTE ] BNS: Full fetch complete (55920 records). [2025-09-14T17:10:24.036095] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-14T17:10:24.036385] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-14T17:10:24.036464] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-14T17:10:24.051559] [DEBUG] [LOCAL ] BNY: Trimmed 7738 records to 5302 (keeping 150 days of data) [2025-09-14T17:10:24.202401] [DEBUG] [LOCAL ] BNY: Primary data saved (5302 records). [2025-09-14T17:10:24.229080] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-14T17:10:24.278599] [INFO ] [MAIN ] Update Progress: 319/2370 symbols completed. BNY took 22.9s. Estimated remaining: 3h 33m 31s. Rate: 9.6 symbols/min [2025-09-14T17:10:24.530435] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-14T17:10:24.530585] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-14T17:10:24.531409] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-14T17:10:24.531475] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-14T17:10:24.533307] [DEBUG] [LOCAL ] BNS: Trimmed 55920 records to 38577 (keeping 150 days of data) [2025-09-14T17:10:24.785522] [DEBUG] [LOCAL ] BNS: Primary data saved (38577 records). [2025-09-14T17:10:24.785804] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-14T17:10:24.785971] [INFO ] [MAIN ] Update Progress: 320/2370 symbols completed. BNS took 32.8s. Estimated remaining: 3h 32m 48s. Rate: 9.6 symbols/min [2025-09-14T17:10:25.437132] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:25.512865] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:25.564921] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:25.545004] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:25.581589] [DEBUG] [LOCAL ] BOC: Loaded 8543 existing records from primary storage. [2025-09-14T17:10:25.581988] [INFO ] [MAIN ] BOC: Loaded 8543 existing records. [2025-09-14T17:10:25.672031] [DEBUG] [LOCAL ] BOE: Loaded 7069 existing records from primary storage. [2025-09-14T17:10:25.678159] [DEBUG] [LOCAL ] BOH: Loaded 13627 existing records from primary storage. [2025-09-14T17:10:25.693930] [INFO ] [MAIN ] BOE: Loaded 7069 existing records. [2025-09-14T17:10:25.705628] [DEBUG] [LOCAL ] BOND: Loaded 14395 existing records from primary storage. [2025-09-14T17:10:25.709181] [INFO ] [MAIN ] BOH: Loaded 13627 existing records. [2025-09-14T17:10:25.720044] [INFO ] [MAIN ] BOND: Loaded 14395 existing records. [2025-09-14T17:10:26.057795] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:26.142189] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-14T17:10:26.223974] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:26.362140] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:26.362345] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-14T17:10:26.377882] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-14T17:10:26.378106] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:26.379082] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-14T17:10:26.379462] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-14T17:10:26.379364] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-14T17:10:26.380013] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-14T17:10:26.379893] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-14T17:10:26.379132] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-14T17:10:26.380201] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-14T17:10:26.380365] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-14T17:10:26.380518] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-14T17:10:26.380681] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-14T17:10:26.391238] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-14T17:10:26.421385] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-14T17:10:26.442973] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-14T17:10:27.866408] [INFO ] [REMOTE ] BOH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:27.883854] [INFO ] [REMOTE ] BOE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:27.926258] [INFO ] [REMOTE ] BOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:27.937807] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-14T17:10:27.983978] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-14T17:10:27.943515] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-14T17:10:28.008451] [INFO ] [REMOTE ] BOND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:28.009764] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-14T17:10:28.921735] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T17:10:28.925234] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-14T17:10:29.127906] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:10:29.132090] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-14T17:10:29.296754] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T17:10:29.306211] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-14T17:10:29.337838] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:10:29.358813] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-14T17:10:29.956842] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T17:10:29.973627] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:10:30.158906] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-14T17:10:30.404037] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:10:30.818036] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:10:30.958785] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-14T17:10:31.345321] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:10:31.758876] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-14T17:10:32.558806] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-14T17:10:32.610403] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:10:32.698925] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T17:10:33.358854] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-14T17:10:34.001823] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T17:10:34.158841] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-14T17:10:34.362477] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:10:34.958829] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-14T17:10:35.177199] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:10:35.758798] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-14T17:10:36.146167] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T17:10:36.558838] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-14T17:10:36.806754] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T17:10:37.358840] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-14T17:10:38.013881] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:10:38.158846] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-14T17:10:38.289121] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:10:38.958829] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-14T17:10:39.517178] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T17:10:39.758861] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-14T17:10:39.851176] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T17:10:40.558834] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-14T17:10:41.018452] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:10:41.163618] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:10:41.358826] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-14T17:10:42.158833] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-14T17:10:42.477330] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T17:10:42.958827] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-14T17:10:43.199368] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T17:10:43.507033] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:10:43.510457] [INFO ] [REMOTE ] BOH: Full fetch complete (33769 records). [2025-09-14T17:10:43.510586] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-14T17:10:43.763929] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-14T17:10:43.892580] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-14T17:10:43.892706] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-14T17:10:43.893258] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-14T17:10:43.893323] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-14T17:10:43.894264] [DEBUG] [LOCAL ] BOH: Trimmed 33769 records to 22443 (keeping 150 days of data) [2025-09-14T17:10:44.034427] [DEBUG] [LOCAL ] BOH: Primary data saved (22443 records). [2025-09-14T17:10:44.034593] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-14T17:10:44.034710] [INFO ] [MAIN ] Update Progress: 321/2370 symbols completed. BOH took 19.2s. Estimated remaining: 3h 34m 5s. Rate: 9.6 symbols/min [2025-09-14T17:10:44.201764] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:44.219314] [DEBUG] [LOCAL ] BOOT: Loaded 16710 existing records from primary storage. [2025-09-14T17:10:44.219487] [INFO ] [MAIN ] BOOT: Loaded 16710 existing records. [2025-09-14T17:10:44.397702] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:44.398021] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-14T17:10:44.398091] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-14T17:10:44.398612] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-14T17:10:44.398700] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-14T17:10:44.568936] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-14T17:10:44.752969] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:44.956344] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:10:45.358802] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-14T17:10:45.581273] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:10:45.583912] [INFO ] [REMOTE ] BOE: Full fetch complete (19000 records). [2025-09-14T17:10:45.584003] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-14T17:10:45.941421] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-14T17:10:45.941529] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-14T17:10:45.941927] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-14T17:10:45.941997] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-14T17:10:45.942675] [DEBUG] [LOCAL ] BOE: Trimmed 19000 records to 12245 (keeping 150 days of data) [2025-09-14T17:10:46.020456] [DEBUG] [LOCAL ] BOE: Primary data saved (12245 records). [2025-09-14T17:10:46.020670] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-14T17:10:46.020797] [INFO ] [MAIN ] Update Progress: 322/2370 symbols completed. BOE took 21.2s. Estimated remaining: 3h 33m 32s. Rate: 9.6 symbols/min [2025-09-14T17:10:46.167813] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-14T17:10:46.192406] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:46.215140] [DEBUG] [LOCAL ] BORR: Loaded 22857 existing records from primary storage. [2025-09-14T17:10:46.215311] [INFO ] [MAIN ] BORR: Loaded 22857 existing records. [2025-09-14T17:10:46.390969] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:46.391251] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-14T17:10:46.391317] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-14T17:10:46.392021] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-14T17:10:46.392098] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-14T17:10:46.742133] [INFO ] [REMOTE ] BORR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:46.774847] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T17:10:46.958902] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-14T17:10:47.758809] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-14T17:10:47.840348] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:10:48.312508] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T17:10:48.558855] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-14T17:10:49.015478] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:10:49.358788] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-14T17:10:49.749390] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:10:49.754062] [INFO ] [REMOTE ] BOND: Full fetch complete (34693 records). [2025-09-14T17:10:49.754206] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-14T17:10:50.148375] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-14T17:10:50.148512] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-14T17:10:50.149157] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-14T17:10:50.149219] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-14T17:10:50.150468] [DEBUG] [LOCAL ] BOND: Trimmed 34693 records to 23942 (keeping 150 days of data) [2025-09-14T17:10:50.207390] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-14T17:10:50.323320] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T17:10:50.327544] [INFO ] [REMOTE ] BOC: Full fetch complete (19652 records). [2025-09-14T17:10:50.328491] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-14T17:10:50.361715] [DEBUG] [LOCAL ] BOND: Primary data saved (23942 records). [2025-09-14T17:10:50.426755] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-14T17:10:50.454608] [INFO ] [MAIN ] Update Progress: 323/2370 symbols completed. BOND took 25.7s. Estimated remaining: 3h 33m 14s. Rate: 9.6 symbols/min [2025-09-14T17:10:50.834785] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:50.903782] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-14T17:10:50.903891] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-14T17:10:50.904329] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-14T17:10:50.904397] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-14T17:10:50.905903] [DEBUG] [LOCAL ] BOC: Trimmed 19652 records to 13587 (keeping 150 days of data) [2025-09-14T17:10:50.968270] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-14T17:10:50.983702] [DEBUG] [LOCAL ] BOW: Loaded 9565 existing records from primary storage. [2025-09-14T17:10:50.989245] [INFO ] [MAIN ] BOW: Loaded 9565 existing records. [2025-09-14T17:10:51.022002] [DEBUG] [LOCAL ] BOC: Primary data saved (13587 records). [2025-09-14T17:10:51.045006] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-14T17:10:51.074773] [INFO ] [MAIN ] Update Progress: 324/2370 symbols completed. BOC took 26.3s. Estimated remaining: 3h 32m 32s. Rate: 9.6 symbols/min [2025-09-14T17:10:51.310092] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:51.351881] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-14T17:10:51.369835] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:51.369969] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-14T17:10:51.370794] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-14T17:10:51.370895] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-14T17:10:51.644743] [DEBUG] [LOCAL ] BOX: Loaded 22525 existing records from primary storage. [2025-09-14T17:10:51.661348] [INFO ] [MAIN ] BOX: Loaded 22525 existing records. [2025-09-14T17:10:51.899518] [INFO ] [REMOTE ] BOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:51.915667] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-14T17:10:51.974351] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:51.974800] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-14T17:10:51.974876] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-14T17:10:51.976152] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-14T17:10:51.977109] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-14T17:10:52.214402] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T17:10:52.488090] [INFO ] [REMOTE ] BOX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:52.558831] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-14T17:10:52.647058] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T17:10:52.808524] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:10:53.358838] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-14T17:10:54.158941] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-14T17:10:54.235830] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:10:54.760809] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T17:10:54.958927] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-14T17:10:55.758880] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-14T17:10:55.954238] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T17:10:56.558910] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-14T17:10:56.758021] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T17:10:57.275710] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T17:10:57.358839] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-14T17:10:58.158844] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-14T17:10:58.425577] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:10:58.958864] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-14T17:10:59.272918] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T17:10:59.758855] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-14T17:10:59.887866] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:11:00.320154] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:11:00.558874] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-14T17:11:01.358850] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-14T17:11:01.621361] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:11:02.158847] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-14T17:11:02.214241] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:11:02.958858] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-14T17:11:03.208580] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:11:03.758847] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-14T17:11:03.874554] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:11:04.350055] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T17:11:04.558875] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-14T17:11:04.678620] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:11:05.358921] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-14T17:11:05.845066] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:11:06.158848] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-14T17:11:06.958861] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-14T17:11:07.023361] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:11:07.758877] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-14T17:11:08.062678] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:11:08.086821] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:11:08.558858] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-14T17:11:09.247310] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T17:11:09.358812] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-14T17:11:09.677422] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:11:09.867019] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:11:09.872544] [INFO ] [REMOTE ] BOX: Full fetch complete (54457 records). [2025-09-14T17:11:09.872733] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-14T17:11:10.161845] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-14T17:11:10.255183] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-14T17:11:10.255303] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-14T17:11:10.256172] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-14T17:11:10.256252] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-14T17:11:10.257758] [DEBUG] [LOCAL ] BOX: Trimmed 54457 records to 37722 (keeping 150 days of data) [2025-09-14T17:11:10.483962] [DEBUG] [LOCAL ] BOX: Primary data saved (37722 records). [2025-09-14T17:11:10.484165] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-14T17:11:10.484320] [INFO ] [MAIN ] Update Progress: 325/2370 symbols completed. BOX took 19.4s. Estimated remaining: 3h 33m 49s. Rate: 9.6 symbols/min [2025-09-14T17:11:10.653838] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:10.677491] [DEBUG] [LOCAL ] BP: Loaded 24080 existing records from primary storage. [2025-09-14T17:11:10.677701] [INFO ] [MAIN ] BP: Loaded 24080 existing records. [2025-09-14T17:11:10.853336] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:10.853696] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-14T17:11:10.853769] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-14T17:11:10.854562] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-14T17:11:10.854637] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-14T17:11:10.964228] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-14T17:11:11.219075] [INFO ] [REMOTE ] BP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:11.758799] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-14T17:11:12.251235] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T17:11:12.281480] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T17:11:12.558914] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-14T17:11:13.225812] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:11:13.230551] [INFO ] [REMOTE ] BOOT: Full fetch complete (45585 records). [2025-09-14T17:11:13.230676] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-14T17:11:13.371830] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-14T17:11:13.610042] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-14T17:11:13.610153] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-14T17:11:13.610782] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-14T17:11:13.610853] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-14T17:11:13.611879] [DEBUG] [LOCAL ] BOOT: Trimmed 45585 records to 30125 (keeping 150 days of data) [2025-09-14T17:11:13.799251] [DEBUG] [LOCAL ] BOOT: Primary data saved (30125 records). [2025-09-14T17:11:13.799462] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-14T17:11:13.799597] [INFO ] [MAIN ] Update Progress: 326/2370 symbols completed. BOOT took 29.8s. Estimated remaining: 3h 33m 24s. Rate: 9.6 symbols/min [2025-09-14T17:11:13.974830] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:14.005855] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-14T17:11:14.026293] [DEBUG] [LOCAL ] BR: Loaded 15362 existing records from primary storage. [2025-09-14T17:11:14.026419] [INFO ] [MAIN ] BR: Loaded 15362 existing records. [2025-09-14T17:11:14.166246] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-14T17:11:14.206101] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:14.206628] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-14T17:11:14.206812] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-14T17:11:14.214137] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T17:11:14.214200] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-14T17:11:14.217315] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-14T17:11:14.217418] [INFO ] [REMOTE ] BOW: Full fetch complete (24908 records). [2025-09-14T17:11:14.299842] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-14T17:11:14.868534] [INFO ] [REMOTE ] BR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:14.947877] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-14T17:11:14.948006] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-14T17:11:14.948709] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-14T17:11:14.948769] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-14T17:11:14.949596] [DEBUG] [LOCAL ] BOW: Trimmed 24908 records to 16592 (keeping 150 days of data) [2025-09-14T17:11:14.959395] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-14T17:11:15.065752] [DEBUG] [LOCAL ] BOW: Primary data saved (16592 records). [2025-09-14T17:11:15.066000] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-14T17:11:15.066188] [INFO ] [MAIN ] Update Progress: 327/2370 symbols completed. BOW took 24.6s. Estimated remaining: 3h 32m 46s. Rate: 9.6 symbols/min [2025-09-14T17:11:15.240395] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:15.266567] [DEBUG] [LOCAL ] BRBR: Loaded 23602 existing records from primary storage. [2025-09-14T17:11:15.266846] [INFO ] [MAIN ] BRBR: Loaded 23602 existing records. [2025-09-14T17:11:15.452404] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:15.452767] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-14T17:11:15.452837] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-14T17:11:15.453596] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-14T17:11:15.453707] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-14T17:11:15.764181] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-14T17:11:15.845872] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:15.911070] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T17:11:16.453003] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:11:16.558881] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-14T17:11:17.358933] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-14T17:11:17.786249] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T17:11:18.158899] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-14T17:11:18.257305] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:11:18.661336] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T17:11:18.667481] [INFO ] [REMOTE ] BORR: Full fetch complete (55807 records). [2025-09-14T17:11:18.667616] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-14T17:11:18.963973] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-14T17:11:19.044488] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-14T17:11:19.044586] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-14T17:11:19.045237] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-14T17:11:19.045296] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-14T17:11:19.046513] [DEBUG] [LOCAL ] BORR: Trimmed 55807 records to 38458 (keeping 150 days of data) [2025-09-14T17:11:19.270320] [DEBUG] [LOCAL ] BORR: Primary data saved (38458 records). [2025-09-14T17:11:19.270489] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-14T17:11:19.270596] [INFO ] [MAIN ] Update Progress: 328/2370 symbols completed. BORR took 33.2s. Estimated remaining: 3h 32m 27s. Rate: 9.6 symbols/min [2025-09-14T17:11:19.438777] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:19.447608] [DEBUG] [LOCAL ] BRC: Loaded 7748 existing records from primary storage. [2025-09-14T17:11:19.447768] [INFO ] [MAIN ] BRC: Loaded 7748 existing records. [2025-09-14T17:11:19.623539] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:19.623863] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-14T17:11:19.624012] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-14T17:11:19.624482] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-14T17:11:19.624546] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-14T17:11:19.772940] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-14T17:11:19.925930] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:11:20.003849] [INFO ] [REMOTE ] BRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:20.558919] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-14T17:11:20.835218] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:11:21.358788] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-14T17:11:21.744029] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:11:21.919291] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T17:11:22.158843] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-14T17:11:22.963889] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-14T17:11:22.984620] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:11:23.758839] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-14T17:11:24.461747] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-14T17:11:24.558835] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-14T17:11:24.739575] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:11:25.209062] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:11:25.358864] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-14T17:11:25.816612] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T17:11:26.158855] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-14T17:11:26.577220] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T17:11:26.958840] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-14T17:11:27.758857] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-14T17:11:27.975381] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T17:11:28.558852] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-14T17:11:28.587541] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T17:11:28.729759] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T17:11:29.358826] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-14T17:11:30.158855] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-14T17:11:30.225689] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T17:11:30.349192] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:11:30.958872] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-14T17:11:31.758812] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-14T17:11:32.072833] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T17:11:32.377682] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-14T17:11:32.558809] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-14T17:11:32.976534] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T17:11:33.358850] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-14T17:11:34.158886] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-14T17:11:34.407387] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T17:11:34.632830] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T17:11:34.958867] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-14T17:11:35.567124] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T17:11:35.571015] [INFO ] [REMOTE ] BR: Full fetch complete (37179 records). [2025-09-14T17:11:35.571125] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-14T17:11:35.765195] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-14T17:11:35.954680] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-14T17:11:35.954828] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-14T17:11:35.955522] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-14T17:11:35.955694] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-14T17:11:35.968369] [DEBUG] [LOCAL ] BR: Trimmed 37179 records to 25468 (keeping 150 days of data) [2025-09-14T17:11:35.990228] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T17:11:36.164025] [DEBUG] [LOCAL ] BR: Primary data saved (25468 records). [2025-09-14T17:11:36.164202] [INFO ] [MAIN ] BR: Full history saved. [2025-09-14T17:11:36.164304] [INFO ] [MAIN ] Update Progress: 329/2370 symbols completed. BR took 22.4s. Estimated remaining: 3h 33m 27s. Rate: 9.6 symbols/min [2025-09-14T17:11:36.336557] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:36.356292] [DEBUG] [LOCAL ] BRCC: Loaded 19201 existing records from primary storage. [2025-09-14T17:11:36.356480] [INFO ] [MAIN ] BRCC: Loaded 19201 existing records. [2025-09-14T17:11:36.538764] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:36.539031] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-14T17:11:36.539088] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-14T17:11:36.539800] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-14T17:11:36.539864] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-14T17:11:36.571341] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-14T17:11:36.904074] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:37.358846] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-14T17:11:37.450672] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:11:38.071056] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-14T17:11:38.158774] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-14T17:11:38.740697] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:11:38.958851] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-14T17:11:39.758834] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-14T17:11:39.916003] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-14T17:11:39.921609] [INFO ] [REMOTE ] BP: Full fetch complete (58390 records). [2025-09-14T17:11:39.921774] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-14T17:11:40.320111] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-14T17:11:40.320288] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-14T17:11:40.321150] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-14T17:11:40.321245] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-14T17:11:40.327691] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:11:40.330412] [INFO ] [REMOTE ] BRC: Full fetch complete (21883 records). [2025-09-14T17:11:40.330618] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-14T17:11:40.330854] [DEBUG] [LOCAL ] BP: Trimmed 58390 records to 40451 (keeping 150 days of data) [2025-09-14T17:11:40.568752] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-14T17:11:40.831985] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-14T17:11:40.833071] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-14T17:11:40.834170] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-14T17:11:40.834825] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-14T17:11:40.838978] [DEBUG] [LOCAL ] BRC: Trimmed 21883 records to 13569 (keeping 150 days of data) [2025-09-14T17:11:40.935604] [DEBUG] [LOCAL ] BRC: Primary data saved (13569 records). [2025-09-14T17:11:40.941155] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-14T17:11:40.941345] [INFO ] [MAIN ] Update Progress: 330/2370 symbols completed. BRC took 21.7s. Estimated remaining: 3h 33m 12s. Rate: 9.6 symbols/min [2025-09-14T17:11:41.192194] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-14T17:11:41.281761] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:41.308951] [DEBUG] [LOCAL ] BRFS: Loaded 16945 existing records from primary storage. [2025-09-14T17:11:41.311735] [INFO ] [MAIN ] BRFS: Loaded 16945 existing records. [2025-09-14T17:11:41.367881] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-14T17:11:41.501917] [WARN ] [MAIN ] BRFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:41.505283] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-14T17:11:41.506557] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-14T17:11:41.508338] [DEBUG] [LOCAL ] BRFS: Deleted primary data file. [2025-09-14T17:11:41.509340] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-14T17:11:41.664058] [DEBUG] [LOCAL ] BP: Primary data saved (40451 records). [2025-09-14T17:11:41.698090] [INFO ] [MAIN ] BP: Full history saved. [2025-09-14T17:11:41.732035] [INFO ] [MAIN ] Update Progress: 331/2370 symbols completed. BP took 31.2s. Estimated remaining: 3h 32m 32s. Rate: 9.6 symbols/min [2025-09-14T17:11:42.004923] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:42.047968] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:42.071838] [DEBUG] [LOCAL ] BRO: Loaded 23751 existing records from primary storage. [2025-09-14T17:11:42.072012] [INFO ] [MAIN ] BRO: Loaded 23751 existing records. [2025-09-14T17:11:42.169298] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-14T17:11:42.251696] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:42.252117] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-14T17:11:42.252248] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-14T17:11:42.257869] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-14T17:11:42.267039] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T17:11:42.265798] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-14T17:11:42.303494] [INFO ] [REMOTE ] BRBR: Full fetch complete (54996 records). [2025-09-14T17:11:42.335743] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-14T17:11:42.785943] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-14T17:11:42.966590] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-14T17:11:42.971292] [INFO ] [REMOTE ] BRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:43.085750] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-14T17:11:43.085867] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-14T17:11:43.086586] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-14T17:11:43.086688] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-14T17:11:43.087988] [DEBUG] [LOCAL ] BRBR: Trimmed 54996 records to 39015 (keeping 150 days of data) [2025-09-14T17:11:43.318953] [DEBUG] [LOCAL ] BRBR: Primary data saved (39015 records). [2025-09-14T17:11:43.319170] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-14T17:11:43.319304] [INFO ] [MAIN ] Update Progress: 332/2370 symbols completed. BRBR took 28.3s. Estimated remaining: 3h 31m 57s. Rate: 9.6 symbols/min [2025-09-14T17:11:43.490495] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:43.513018] [DEBUG] [LOCAL ] BROS: Loaded 23922 existing records from primary storage. [2025-09-14T17:11:43.513176] [INFO ] [MAIN ] BROS: Loaded 23922 existing records. [2025-09-14T17:11:43.689271] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:43.689543] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-14T17:11:43.689603] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-14T17:11:43.690298] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-14T17:11:43.690361] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-14T17:11:43.764378] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-14T17:11:44.050194] [INFO ] [REMOTE ] BROS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:44.074859] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T17:11:44.110559] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T17:11:44.558828] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-14T17:11:45.208594] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:11:45.358842] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-14T17:11:46.158789] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-14T17:11:46.595505] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T17:11:46.680805] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T17:11:46.958945] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-14T17:11:47.709411] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:11:47.758869] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-14T17:11:48.558872] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-14T17:11:48.950701] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T17:11:49.306385] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T17:11:49.358794] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-14T17:11:50.158854] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-14T17:11:50.677667] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T17:11:50.911459] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T17:11:50.958818] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-14T17:11:51.737599] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:11:51.758871] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-14T17:11:52.516151] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:11:52.558785] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-14T17:11:53.358832] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-14T17:11:53.610921] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:11:53.679424] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T17:11:53.684797] [INFO ] [REMOTE ] BRCC: Full fetch complete (43364 records). [2025-09-14T17:11:53.685011] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-14T17:11:54.105542] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-14T17:11:54.105775] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-14T17:11:54.106582] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-14T17:11:54.106664] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-14T17:11:54.108099] [DEBUG] [LOCAL ] BRCC: Trimmed 43364 records to 30415 (keeping 150 days of data) [2025-09-14T17:11:54.164141] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-14T17:11:54.291673] [DEBUG] [LOCAL ] BRCC: Primary data saved (30415 records). [2025-09-14T17:11:54.291902] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-14T17:11:54.292018] [INFO ] [MAIN ] Update Progress: 333/2370 symbols completed. BRCC took 18.1s. Estimated remaining: 3h 32m 20s. Rate: 9.6 symbols/min [2025-09-14T17:11:54.480842] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:54.503477] [DEBUG] [LOCAL ] BRSL: Loaded 18687 existing records from primary storage. [2025-09-14T17:11:54.503698] [INFO ] [MAIN ] BRSL: Loaded 18687 existing records. [2025-09-14T17:11:54.678804] [WARN ] [MAIN ] BRSL: Insufficient historical data. Have data from 2025-07-02, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:54.679117] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-14T17:11:54.679261] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-14T17:11:54.679930] [DEBUG] [LOCAL ] BRSL: Deleted primary data file. [2025-09-14T17:11:54.679996] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-14T17:11:54.924400] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:11:54.979664] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-14T17:11:55.087270] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:55.758812] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-14T17:11:56.020766] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:11:56.021141] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-14T17:11:56.085081] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T17:11:56.558877] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-14T17:11:57.108197] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T17:11:57.358829] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-14T17:11:57.605881] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:11:57.606235] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-14T17:11:57.825269] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:11:58.158841] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-14T17:11:58.421307] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:11:58.421715] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-14T17:11:58.958945] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-14T17:11:59.758874] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-14T17:12:00.006761] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:12:00.007151] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-14T17:12:00.558858] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-14T17:12:01.203580] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-14T17:12:01.358867] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-14T17:12:02.158922] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-14T17:12:02.436609] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:12:02.436987] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-14T17:12:02.760943] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-14T17:12:02.958780] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-14T17:12:03.368079] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T17:12:03.758927] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-14T17:12:04.558902] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-14T17:12:04.718689] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:12:05.345269] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:12:05.358780] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-14T17:12:06.158849] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-14T17:12:06.655160] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:12:06.921178] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:12:06.958790] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-14T17:12:07.758987] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-14T17:12:08.469568] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-14T17:12:08.490383] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T17:12:08.494566] [INFO ] [REMOTE ] BRFS: Full fetch complete (44998 records). [2025-09-14T17:12:08.494721] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-14T17:12:08.565954] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-14T17:12:08.915764] [DEBUG] [VALIDATOR ] BRFS: All expected trading days are present. [2025-09-14T17:12:08.915883] [DEBUG] [VALIDATOR ] BRFS: Primary data validation passed. [2025-09-14T17:12:08.916580] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-14T17:12:08.916656] [DEBUG] [LOCAL ] BRFS: Saving primary data. [2025-09-14T17:12:08.917769] [DEBUG] [LOCAL ] BRFS: Trimmed 44998 records to 30661 (keeping 150 days of data) [2025-09-14T17:12:09.093080] [DEBUG] [LOCAL ] BRFS: Primary data saved (30661 records). [2025-09-14T17:12:09.093274] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-14T17:12:09.093399] [INFO ] [MAIN ] Update Progress: 334/2370 symbols completed. BRFS took 28.2s. Estimated remaining: 3h 33m 5s. Rate: 9.6 symbols/min [2025-09-14T17:12:09.266745] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:09.284521] [DEBUG] [LOCAL ] BRSP: Loaded 16625 existing records from primary storage. [2025-09-14T17:12:09.284745] [INFO ] [MAIN ] BRSP: Loaded 16625 existing records. [2025-09-14T17:12:09.364085] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-14T17:12:09.473019] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:09.473345] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-14T17:12:09.473425] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-14T17:12:09.474004] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-14T17:12:09.474073] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-14T17:12:09.857453] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:09.895469] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-14T17:12:10.158877] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-14T17:12:10.359473] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:12:10.958854] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-14T17:12:11.253222] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:12:11.602260] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:12:11.608231] [INFO ] [REMOTE ] BRO: Full fetch complete (56230 records). [2025-09-14T17:12:11.635400] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-14T17:12:11.723163] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-14T17:12:11.761670] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-14T17:12:12.056106] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-14T17:12:12.056277] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-14T17:12:12.056958] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-14T17:12:12.057023] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-14T17:12:12.058369] [DEBUG] [LOCAL ] BRO: Trimmed 56230 records to 39113 (keeping 150 days of data) [2025-09-14T17:12:12.331349] [DEBUG] [LOCAL ] BRO: Primary data saved (39113 records). [2025-09-14T17:12:12.331873] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-14T17:12:12.332009] [INFO ] [MAIN ] Update Progress: 335/2370 symbols completed. BRO took 30.6s. Estimated remaining: 3h 32m 41s. Rate: 9.6 symbols/min [2025-09-14T17:12:12.503962] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:12.508616] [DEBUG] [LOCAL ] BRT: Loaded 2279 existing records from primary storage. [2025-09-14T17:12:12.508837] [INFO ] [MAIN ] BRT: Loaded 2279 existing records. [2025-09-14T17:12:12.571190] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-14T17:12:12.690687] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:12.690960] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-14T17:12:12.691020] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-14T17:12:12.691449] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-14T17:12:12.691509] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-14T17:12:13.044347] [INFO ] [REMOTE ] BRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:13.308715] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:12:13.358791] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-14T17:12:14.158925] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-14T17:12:14.445845] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-14T17:12:14.451443] [INFO ] [REMOTE ] BROS: Full fetch complete (57954 records). [2025-09-14T17:12:14.451594] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-14T17:12:14.847491] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-14T17:12:14.847630] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-14T17:12:14.848349] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-14T17:12:14.848404] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-14T17:12:14.849778] [DEBUG] [LOCAL ] BROS: Trimmed 57954 records to 40080 (keeping 150 days of data) [2025-09-14T17:12:14.960109] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-14T17:12:15.104264] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T17:12:15.127372] [DEBUG] [LOCAL ] BROS: Primary data saved (40080 records). [2025-09-14T17:12:15.127553] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-14T17:12:15.127692] [INFO ] [MAIN ] Update Progress: 336/2370 symbols completed. BROS took 31.8s. Estimated remaining: 3h 32m 13s. Rate: 9.6 symbols/min [2025-09-14T17:12:15.295632] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:15.307112] [DEBUG] [LOCAL ] BRW: Loaded 9686 existing records from primary storage. [2025-09-14T17:12:15.307271] [INFO ] [MAIN ] BRW: Loaded 9686 existing records. [2025-09-14T17:12:15.488373] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:15.488875] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-14T17:12:15.492091] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T17:12:15.493539] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-14T17:12:15.499221] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-14T17:12:15.507052] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-14T17:12:15.587569] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T17:12:15.618267] [INFO ] [REMOTE ] BRSL: Full fetch complete (18687 records). [2025-09-14T17:12:15.633688] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-14T17:12:15.762279] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-14T17:12:16.045791] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 51 unique days, need 150 days [2025-09-14T17:12:16.066328] [INFO ] [REMOTE ] BRW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:16.062927] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:12:16.066679] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:12:16.066745] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-14T17:12:16.066815] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-14T17:12:16.066864] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-14T17:12:16.066975] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-14T17:12:16.067077] [INFO ] [MAIN ] Update Progress: 337/2370 symbols completed. BRSL took 21.8s. Estimated remaining: 3h 31m 35s. Rate: 9.6 symbols/min [2025-09-14T17:12:16.234733] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:16.258401] [DEBUG] [LOCAL ] BRX: Loaded 23276 existing records from primary storage. [2025-09-14T17:12:16.258611] [INFO ] [MAIN ] BRX: Loaded 23276 existing records. [2025-09-14T17:12:16.431007] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:16.431202] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-14T17:12:16.431261] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-14T17:12:16.432120] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-14T17:12:16.432185] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-14T17:12:16.569336] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-14T17:12:16.777462] [INFO ] [REMOTE ] BRX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:17.276421] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:12:17.358793] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-14T17:12:17.750040] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:12:18.158887] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-14T17:12:18.958885] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-14T17:12:19.108021] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:12:19.148633] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:12:19.617146] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T17:12:19.758870] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-14T17:12:20.558901] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-14T17:12:21.295506] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T17:12:21.358893] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-14T17:12:21.577723] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T17:12:22.014763] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T17:12:22.158831] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-14T17:12:22.958908] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-14T17:12:23.700732] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T17:12:23.747693] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:12:23.758770] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-14T17:12:24.558834] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-14T17:12:25.013146] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T17:12:25.046132] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:12:25.358845] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-14T17:12:26.158839] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-14T17:12:26.958872] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-14T17:12:27.084760] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:12:27.106987] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T17:12:27.382190] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T17:12:27.758843] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-14T17:12:28.472962] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T17:12:28.558880] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-14T17:12:29.290292] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T17:12:29.358797] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-14T17:12:30.158852] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-14T17:12:30.577558] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T17:12:30.581578] [INFO ] [REMOTE ] BRSP: Full fetch complete (40659 records). [2025-09-14T17:12:30.581717] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-14T17:12:30.965102] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-14T17:12:30.966913] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-14T17:12:30.967043] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-14T17:12:30.967700] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-14T17:12:30.967884] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-14T17:12:30.969188] [DEBUG] [LOCAL ] BRSP: Trimmed 40659 records to 26840 (keeping 150 days of data) [2025-09-14T17:12:31.128161] [DEBUG] [LOCAL ] BRSP: Primary data saved (26840 records). [2025-09-14T17:12:31.128336] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-14T17:12:31.128441] [INFO ] [MAIN ] Update Progress: 338/2370 symbols completed. BRSP took 22.0s. Estimated remaining: 3h 32m 22s. Rate: 9.6 symbols/min [2025-09-14T17:12:31.299244] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:31.315251] [DEBUG] [LOCAL ] BSAC: Loaded 14315 existing records from primary storage. [2025-09-14T17:12:31.315453] [INFO ] [MAIN ] BSAC: Loaded 14315 existing records. [2025-09-14T17:12:31.493739] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:31.494028] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-14T17:12:31.494179] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-14T17:12:31.494722] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-14T17:12:31.494786] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-14T17:12:31.769847] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-14T17:12:31.864352] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:31.988971] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T17:12:32.022194] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T17:12:32.351784] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:12:32.353220] [INFO ] [REMOTE ] BRT: Full fetch complete (4977 records). [2025-09-14T17:12:32.353317] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-14T17:12:32.583997] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-14T17:12:32.778045] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-14T17:12:32.778187] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-14T17:12:32.778402] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-14T17:12:32.778468] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-14T17:12:32.778959] [DEBUG] [LOCAL ] BRT: Trimmed 4977 records to 3527 (keeping 150 days of data) [2025-09-14T17:12:32.802108] [DEBUG] [LOCAL ] BRT: Primary data saved (3527 records). [2025-09-14T17:12:32.802326] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-14T17:12:32.802457] [INFO ] [MAIN ] Update Progress: 339/2370 symbols completed. BRT took 20.5s. Estimated remaining: 3h 31m 48s. Rate: 9.6 symbols/min [2025-09-14T17:12:32.979127] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:32.999757] [DEBUG] [LOCAL ] BSBR: Loaded 16730 existing records from primary storage. [2025-09-14T17:12:33.000022] [INFO ] [MAIN ] BSBR: Loaded 16730 existing records. [2025-09-14T17:12:33.192022] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:33.192500] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-14T17:12:33.192586] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-14T17:12:33.193284] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-14T17:12:33.193359] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-14T17:12:33.359070] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-14T17:12:33.575041] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:34.158916] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-14T17:12:34.482695] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T17:12:34.789377] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T17:12:34.958845] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-14T17:12:35.614032] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:12:35.725394] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T17:12:35.758777] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-14T17:12:36.558842] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-14T17:12:36.712504] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T17:12:36.715059] [INFO ] [REMOTE ] BRW: Full fetch complete (20131 records). [2025-09-14T17:12:36.715152] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-14T17:12:37.083542] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-14T17:12:37.083746] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-14T17:12:37.084148] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-14T17:12:37.084203] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-14T17:12:37.084864] [DEBUG] [LOCAL ] BRW: Trimmed 20131 records to 14128 (keeping 150 days of data) [2025-09-14T17:12:37.170220] [DEBUG] [LOCAL ] BRW: Primary data saved (14128 records). [2025-09-14T17:12:37.170412] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-14T17:12:37.170517] [INFO ] [MAIN ] Update Progress: 340/2370 symbols completed. BRW took 22.0s. Estimated remaining: 3h 31m 30s. Rate: 9.6 symbols/min [2025-09-14T17:12:37.340038] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:37.344956] [DEBUG] [LOCAL ] BSL: Loaded 2958 existing records from primary storage. [2025-09-14T17:12:37.345061] [INFO ] [MAIN ] BSL: Loaded 2958 existing records. [2025-09-14T17:12:37.365300] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-14T17:12:37.526476] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:37.526791] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-14T17:12:37.526856] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-14T17:12:37.527164] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-14T17:12:37.527224] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-14T17:12:37.886369] [INFO ] [REMOTE ] BSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:38.158892] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-14T17:12:38.436530] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:12:38.470060] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T17:12:38.958850] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-14T17:12:39.202286] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T17:12:39.758875] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-14T17:12:39.835232] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:12:40.558938] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-14T17:12:41.140734] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T17:12:41.143867] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T17:12:41.358837] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-14T17:12:41.967680] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T17:12:42.158837] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-14T17:12:42.958843] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-14T17:12:43.391074] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:12:43.758868] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-14T17:12:43.793043] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:12:44.558831] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-14T17:12:45.350038] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T17:12:45.358809] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-14T17:12:45.552759] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:12:45.894227] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T17:12:46.158826] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-14T17:12:46.815418] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T17:12:46.958852] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-14T17:12:47.248028] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T17:12:47.254680] [INFO ] [REMOTE ] BRX: Full fetch complete (56452 records). [2025-09-14T17:12:47.254919] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-14T17:12:47.654320] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-14T17:12:47.654450] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-14T17:12:47.655187] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-14T17:12:47.655250] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-14T17:12:47.656466] [DEBUG] [LOCAL ] BRX: Trimmed 56452 records to 39074 (keeping 150 days of data) [2025-09-14T17:12:47.758820] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-14T17:12:47.907683] [DEBUG] [LOCAL ] BRX: Primary data saved (39074 records). [2025-09-14T17:12:47.907874] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-14T17:12:47.907991] [INFO ] [MAIN ] Update Progress: 341/2370 symbols completed. BRX took 31.8s. Estimated remaining: 3h 31m 51s. Rate: 9.6 symbols/min [2025-09-14T17:12:48.078593] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:48.097424] [DEBUG] [LOCAL ] BSM: Loaded 16021 existing records from primary storage. [2025-09-14T17:12:48.097633] [INFO ] [MAIN ] BSM: Loaded 16021 existing records. [2025-09-14T17:12:48.278124] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:48.278398] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-14T17:12:48.278463] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-14T17:12:48.279006] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-14T17:12:48.279076] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-14T17:12:48.465409] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:12:48.514759] [INFO ] [REMOTE ] BSL: Full fetch complete (9389 records). [2025-09-14T17:12:48.547635] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-14T17:12:48.563930] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-14T17:12:48.754404] [INFO ] [REMOTE ] BSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:49.015592] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-14T17:12:49.015714] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-14T17:12:49.015964] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-14T17:12:49.016027] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-14T17:12:49.016500] [DEBUG] [LOCAL ] BSL: Trimmed 9389 records to 5222 (keeping 150 days of data) [2025-09-14T17:12:49.050018] [DEBUG] [LOCAL ] BSL: Primary data saved (5222 records). [2025-09-14T17:12:49.050154] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-14T17:12:49.050281] [INFO ] [MAIN ] Update Progress: 342/2370 symbols completed. BSL took 11.9s. Estimated remaining: 3h 31m 14s. Rate: 9.6 symbols/min [2025-09-14T17:12:49.228432] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:49.240039] [DEBUG] [LOCAL ] BST: Loaded 8207 existing records from primary storage. [2025-09-14T17:12:49.240270] [INFO ] [MAIN ] BST: Loaded 8207 existing records. [2025-09-14T17:12:49.363903] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-14T17:12:49.426744] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:49.427071] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-14T17:12:49.427151] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-14T17:12:49.427545] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-14T17:12:49.427623] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-14T17:12:49.794116] [INFO ] [REMOTE ] BST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:49.813410] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:12:50.158825] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-14T17:12:50.911927] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:12:50.958828] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-14T17:12:51.597582] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:12:51.758780] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-14T17:12:52.080294] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T17:12:52.558836] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-14T17:12:52.825744] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:12:53.358827] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-14T17:12:54.054239] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T17:12:54.158877] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-14T17:12:54.399999] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T17:12:54.958839] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-14T17:12:55.510366] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:12:55.758834] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-14T17:12:55.962099] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T17:12:56.558824] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-14T17:12:57.345619] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:12:57.358769] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-14T17:12:57.822742] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:12:58.158890] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-14T17:12:58.758723] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T17:12:58.958883] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-14T17:12:59.571044] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T17:12:59.758937] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-14T17:13:00.321320] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T17:13:00.326316] [INFO ] [REMOTE ] BSBR: Full fetch complete (38213 records). [2025-09-14T17:13:00.326466] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-14T17:13:00.566274] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-14T17:13:00.710201] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-14T17:13:00.710337] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-14T17:13:00.711014] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-14T17:13:00.711079] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-14T17:13:00.712326] [DEBUG] [LOCAL ] BSBR: Trimmed 38213 records to 26870 (keeping 150 days of data) [2025-09-14T17:13:00.872687] [DEBUG] [LOCAL ] BSBR: Primary data saved (26870 records). [2025-09-14T17:13:00.872866] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-14T17:13:00.873000] [INFO ] [MAIN ] Update Progress: 343/2370 symbols completed. BSBR took 28.1s. Estimated remaining: 3h 31m 41s. Rate: 9.6 symbols/min [2025-09-14T17:13:01.044758] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:01.059292] [DEBUG] [LOCAL ] BSTZ: Loaded 11116 existing records from primary storage. [2025-09-14T17:13:01.059479] [INFO ] [MAIN ] BSTZ: Loaded 11116 existing records. [2025-09-14T17:13:01.250171] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:01.250686] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-14T17:13:01.250834] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-14T17:13:01.251369] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-14T17:13:01.251451] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-14T17:13:01.367454] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:13:01.365368] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-14T17:13:01.651742] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:01.938213] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T17:13:02.158904] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-14T17:13:02.627380] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T17:13:02.958868] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-14T17:13:03.508356] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T17:13:03.758882] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-14T17:13:04.057475] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T17:13:04.558855] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-14T17:13:04.619714] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T17:13:04.623628] [INFO ] [REMOTE ] BSAC: Full fetch complete (35554 records). [2025-09-14T17:13:04.623788] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-14T17:13:05.002183] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-14T17:13:05.002313] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-14T17:13:05.003261] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-14T17:13:05.003358] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-14T17:13:05.004788] [DEBUG] [LOCAL ] BSAC: Trimmed 35554 records to 24764 (keeping 150 days of data) [2025-09-14T17:13:05.158062] [DEBUG] [LOCAL ] BSAC: Primary data saved (24764 records). [2025-09-14T17:13:05.158250] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-14T17:13:05.158417] [INFO ] [MAIN ] Update Progress: 344/2370 symbols completed. BSAC took 34.0s. Estimated remaining: 3h 31m 23s. Rate: 9.6 symbols/min [2025-09-14T17:13:05.350909] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:05.365548] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-14T17:13:05.384857] [DEBUG] [LOCAL ] BSX: Loaded 24051 existing records from primary storage. [2025-09-14T17:13:05.385059] [INFO ] [MAIN ] BSX: Loaded 24051 existing records. [2025-09-14T17:13:05.565626] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:05.566031] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-14T17:13:05.566294] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-14T17:13:05.572147] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-14T17:13:05.580419] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-14T17:13:05.625410] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:13:05.941407] [INFO ] [REMOTE ] BSX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:06.158847] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-14T17:13:06.576836] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T17:13:06.958899] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-14T17:13:07.758846] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-14T17:13:08.075463] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T17:13:08.329806] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T17:13:08.558838] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-14T17:13:08.885075] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T17:13:09.358846] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-14T17:13:10.144190] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:13:10.158804] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-14T17:13:10.815319] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T17:13:10.958792] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-14T17:13:11.256279] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T17:13:11.258957] [INFO ] [REMOTE ] BST: Full fetch complete (21329 records). [2025-09-14T17:13:11.259132] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-14T17:13:11.651298] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-14T17:13:11.651411] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-14T17:13:11.651897] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-14T17:13:11.651966] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-14T17:13:11.652670] [DEBUG] [LOCAL ] BST: Trimmed 21329 records to 13627 (keeping 150 days of data) [2025-09-14T17:13:11.744666] [DEBUG] [LOCAL ] BST: Primary data saved (13627 records). [2025-09-14T17:13:11.744854] [INFO ] [MAIN ] BST: Full history saved. [2025-09-14T17:13:11.744976] [INFO ] [MAIN ] Update Progress: 345/2370 symbols completed. BST took 22.7s. Estimated remaining: 3h 31m 19s. Rate: 9.6 symbols/min [2025-09-14T17:13:11.766616] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-14T17:13:11.928095] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:11.933329] [DEBUG] [LOCAL ] BTA: Loaded 2373 existing records from primary storage. [2025-09-14T17:13:11.933458] [INFO ] [MAIN ] BTA: Loaded 2373 existing records. [2025-09-14T17:13:12.116010] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:12.116347] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-14T17:13:12.116413] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-14T17:13:12.116748] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-14T17:13:12.116815] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-14T17:13:12.466000] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T17:13:12.514275] [INFO ] [REMOTE ] BTA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:12.558815] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-14T17:13:13.358889] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-14T17:13:13.787396] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:13:13.978599] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-14T17:13:14.158899] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-14T17:13:14.251221] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:13:14.958867] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-14T17:13:15.236929] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:13:15.611211] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:13:15.758877] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-14T17:13:16.558966] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-14T17:13:17.104444] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T17:13:17.358901] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-14T17:13:18.114323] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T17:13:18.158898] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-14T17:13:18.306745] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T17:13:18.841631] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T17:13:18.958900] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-14T17:13:19.758867] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-14T17:13:19.835174] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:13:19.838495] [INFO ] [REMOTE ] BSTZ: Full fetch complete (27036 records). [2025-09-14T17:13:19.838673] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-14T17:13:20.244110] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-14T17:13:20.244271] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-14T17:13:20.244953] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-14T17:13:20.245027] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-14T17:13:20.246506] [DEBUG] [LOCAL ] BSTZ: Trimmed 27036 records to 18235 (keeping 150 days of data) [2025-09-14T17:13:20.353568] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T17:13:20.390181] [DEBUG] [LOCAL ] BSTZ: Primary data saved (18235 records). [2025-09-14T17:13:20.390451] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-14T17:13:20.390621] [INFO ] [MAIN ] Update Progress: 346/2370 symbols completed. BSTZ took 19.5s. Estimated remaining: 3h 31m 26s. Rate: 9.6 symbols/min [2025-09-14T17:13:20.585049] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-14T17:13:20.642951] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:20.657949] [DEBUG] [LOCAL ] BTCM: Loaded 10681 existing records from primary storage. [2025-09-14T17:13:20.658144] [INFO ] [MAIN ] BTCM: Loaded 10681 existing records. [2025-09-14T17:13:20.851384] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:20.851825] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-14T17:13:20.851893] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-14T17:13:20.852285] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-14T17:13:20.852347] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-14T17:13:21.215099] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:21.358857] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-14T17:13:22.158856] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-14T17:13:22.603386] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T17:13:22.824103] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T17:13:22.953222] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T17:13:22.961687] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-14T17:13:23.689268] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T17:13:23.758845] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-14T17:13:24.558875] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-14T17:13:25.257035] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T17:13:25.358848] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-14T17:13:25.631458] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T17:13:25.981545] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T17:13:26.158902] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-14T17:13:26.709304] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:13:26.710861] [INFO ] [REMOTE ] BTA: Full fetch complete (6067 records). [2025-09-14T17:13:26.710980] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-14T17:13:26.964009] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-14T17:13:27.090529] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-14T17:13:27.090685] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-14T17:13:27.090992] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-14T17:13:27.091048] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-14T17:13:27.091511] [DEBUG] [LOCAL ] BTA: Trimmed 6067 records to 4083 (keeping 150 days of data) [2025-09-14T17:13:27.118480] [DEBUG] [LOCAL ] BTA: Primary data saved (4083 records). [2025-09-14T17:13:27.118709] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-14T17:13:27.118880] [INFO ] [MAIN ] Update Progress: 347/2370 symbols completed. BTA took 15.4s. Estimated remaining: 3h 31m 23s. Rate: 9.6 symbols/min [2025-09-14T17:13:27.299336] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:27.329210] [DEBUG] [LOCAL ] BTE: Loaded 23635 existing records from primary storage. [2025-09-14T17:13:27.329449] [INFO ] [MAIN ] BTE: Loaded 23635 existing records. [2025-09-14T17:13:27.519243] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:27.519547] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-14T17:13:27.519613] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-14T17:13:27.520314] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-14T17:13:27.520387] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-14T17:13:27.771715] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-14T17:13:27.893425] [INFO ] [REMOTE ] BTE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:28.558798] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-14T17:13:29.127128] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T17:13:29.174153] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T17:13:29.178470] [INFO ] [REMOTE ] BSM: Full fetch complete (35930 records). [2025-09-14T17:13:29.178594] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-14T17:13:29.363878] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-14T17:13:29.550617] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-14T17:13:29.550738] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-14T17:13:29.551235] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-14T17:13:29.551289] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-14T17:13:29.552145] [DEBUG] [LOCAL ] BSM: Trimmed 35930 records to 24437 (keeping 150 days of data) [2025-09-14T17:13:29.709126] [DEBUG] [LOCAL ] BSM: Primary data saved (24437 records). [2025-09-14T17:13:29.709302] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-14T17:13:29.709410] [INFO ] [MAIN ] Update Progress: 348/2370 symbols completed. BSM took 41.8s. Estimated remaining: 3h 30m 55s. Rate: 9.6 symbols/min [2025-09-14T17:13:29.881710] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:29.905942] [DEBUG] [LOCAL ] BTI: Loaded 24046 existing records from primary storage. [2025-09-14T17:13:29.906116] [INFO ] [MAIN ] BTI: Loaded 24046 existing records. [2025-09-14T17:13:30.084894] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:30.085152] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-14T17:13:30.085212] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-14T17:13:30.086028] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-14T17:13:30.086095] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-14T17:13:30.163982] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-14T17:13:30.447912] [INFO ] [REMOTE ] BTI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:30.474948] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T17:13:30.877053] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T17:13:30.958842] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-14T17:13:31.226702] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:13:31.457173] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T17:13:31.758868] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-14T17:13:32.451345] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:13:32.558864] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-14T17:13:33.358932] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-14T17:13:33.991844] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:13:33.998004] [INFO ] [REMOTE ] BSX: Full fetch complete (58365 records). [2025-09-14T17:13:33.998245] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-14T17:13:34.165951] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-14T17:13:34.405597] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-14T17:13:34.405756] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-14T17:13:34.406447] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-14T17:13:34.406505] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-14T17:13:34.408791] [DEBUG] [LOCAL ] BSX: Trimmed 58365 records to 40428 (keeping 150 days of data) [2025-09-14T17:13:34.697662] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-14T17:13:34.728430] [DEBUG] [LOCAL ] BSX: Primary data saved (40428 records). [2025-09-14T17:13:34.728675] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-14T17:13:34.728829] [INFO ] [MAIN ] Update Progress: 349/2370 symbols completed. BSX took 29.6s. Estimated remaining: 3h 30m 42s. Rate: 9.6 symbols/min [2025-09-14T17:13:34.866202] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T17:13:34.924778] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:34.931193] [DEBUG] [LOCAL ] BTO: Loaded 3759 existing records from primary storage. [2025-09-14T17:13:34.931349] [INFO ] [MAIN ] BTO: Loaded 3759 existing records. [2025-09-14T17:13:34.963976] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-14T17:13:35.123807] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:35.124194] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-14T17:13:35.124264] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-14T17:13:35.124612] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-14T17:13:35.124709] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-14T17:13:35.495457] [INFO ] [REMOTE ] BTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:35.758879] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-14T17:13:36.558894] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-14T17:13:37.082968] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T17:13:37.358845] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-14T17:13:37.564902] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:13:38.092117] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:13:38.158792] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-14T17:13:38.958871] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-14T17:13:38.974514] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T17:13:39.546044] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T17:13:39.758860] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-14T17:13:40.007318] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T17:13:40.358470] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T17:13:40.558895] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-14T17:13:41.358840] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-14T17:13:41.758800] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:13:41.761369] [INFO ] [REMOTE ] BTCM: Full fetch complete (14378 records). [2025-09-14T17:13:41.761458] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-14T17:13:42.128279] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-14T17:13:42.128392] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-14T17:13:42.128754] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-14T17:13:42.128811] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-14T17:13:42.129395] [DEBUG] [LOCAL ] BTCM: Trimmed 14378 records to 12647 (keeping 150 days of data) [2025-09-14T17:13:42.159217] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-14T17:13:42.205385] [DEBUG] [LOCAL ] BTCM: Primary data saved (12647 records). [2025-09-14T17:13:42.205593] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-14T17:13:42.205773] [INFO ] [MAIN ] Update Progress: 350/2370 symbols completed. BTCM took 21.8s. Estimated remaining: 3h 30m 42s. Rate: 9.6 symbols/min [2025-09-14T17:13:42.386778] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:42.395403] [DEBUG] [LOCAL ] BTT: Loaded 6892 existing records from primary storage. [2025-09-14T17:13:42.395554] [INFO ] [MAIN ] BTT: Loaded 6892 existing records. [2025-09-14T17:13:42.591277] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:42.591663] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-14T17:13:42.591765] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-14T17:13:42.592170] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-14T17:13:42.592247] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-14T17:13:42.961595] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-14T17:13:42.980932] [INFO ] [REMOTE ] BTT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:43.134193] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T17:13:43.286297] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T17:13:43.758889] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-14T17:13:44.558922] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-14T17:13:44.693518] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T17:13:44.996568] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-14T17:13:45.152973] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T17:13:45.358846] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-14T17:13:46.159391] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-14T17:13:46.163474] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T17:13:46.958817] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-14T17:13:47.711568] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T17:13:47.758776] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-14T17:13:48.069066] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:13:48.555920] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:13:48.558843] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-14T17:13:49.358872] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-14T17:13:49.566547] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T17:13:50.158914] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-14T17:13:50.674970] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:13:50.676939] [INFO ] [REMOTE ] BTO: Full fetch complete (9774 records). [2025-09-14T17:13:50.677064] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-14T17:13:50.968665] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-14T17:13:51.060583] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-14T17:13:51.060754] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-14T17:13:51.061072] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-14T17:13:51.061143] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-14T17:13:51.061664] [DEBUG] [LOCAL ] BTO: Trimmed 9774 records to 6230 (keeping 150 days of data) [2025-09-14T17:13:51.100333] [DEBUG] [LOCAL ] BTO: Primary data saved (6230 records). [2025-09-14T17:13:51.100500] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-14T17:13:51.100657] [INFO ] [MAIN ] Update Progress: 351/2370 symbols completed. BTO took 16.4s. Estimated remaining: 3h 30m 51s. Rate: 9.6 symbols/min [2025-09-14T17:13:51.267716] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:51.292505] [DEBUG] [LOCAL ] BTU: Loaded 23839 existing records from primary storage. [2025-09-14T17:13:51.292756] [INFO ] [MAIN ] BTU: Loaded 23839 existing records. [2025-09-14T17:13:51.484332] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:51.485088] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-14T17:13:51.485224] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-14T17:13:51.486478] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-14T17:13:51.486577] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-14T17:13:51.609665] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-14T17:13:51.764578] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-14T17:13:51.998908] [INFO ] [REMOTE ] BTU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:52.003146] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T17:13:52.558967] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-14T17:13:53.358933] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-14T17:13:53.611345] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T17:13:54.158858] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-14T17:13:54.375822] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:13:54.442668] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:13:54.958872] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-14T17:13:55.758887] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-14T17:13:56.169696] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T17:13:56.461530] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:13:56.558877] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-14T17:13:57.200303] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T17:13:57.358868] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-14T17:13:57.824744] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T17:13:57.983550] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T17:13:58.158911] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-14T17:13:58.958921] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-14T17:13:59.758815] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-14T17:13:59.814522] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:14:00.558939] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-14T17:14:00.736911] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T17:14:01.096424] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-14T17:14:01.358918] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-14T17:14:02.158898] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-14T17:14:02.697873] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-14T17:14:02.958891] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-14T17:14:03.069957] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T17:14:03.074113] [INFO ] [REMOTE ] BTT: Full fetch complete (17306 records). [2025-09-14T17:14:03.074406] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-14T17:14:03.483064] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-14T17:14:03.483196] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-14T17:14:03.483801] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-14T17:14:03.483884] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-14T17:14:03.484748] [DEBUG] [LOCAL ] BTT: Trimmed 17306 records to 11736 (keeping 150 days of data) [2025-09-14T17:14:03.562547] [DEBUG] [LOCAL ] BTT: Primary data saved (11736 records). [2025-09-14T17:14:03.562810] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-14T17:14:03.562966] [INFO ] [MAIN ] Update Progress: 352/2370 symbols completed. BTT took 21.4s. Estimated remaining: 3h 31m 21s. Rate: 9.5 symbols/min [2025-09-14T17:14:03.774622] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-14T17:14:03.782707] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:03.834868] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-14T17:14:03.856502] [DEBUG] [LOCAL ] BTX: Loaded 14517 existing records from primary storage. [2025-09-14T17:14:03.857250] [INFO ] [MAIN ] BTX: Loaded 14517 existing records. [2025-09-14T17:14:04.139500] [WARN ] [MAIN ] BTX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:04.139926] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-14T17:14:04.140078] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-14T17:14:04.140868] [DEBUG] [LOCAL ] BTX: Deleted primary data file. [2025-09-14T17:14:04.140957] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-14T17:14:04.559794] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-14T17:14:04.559633] [INFO ] [REMOTE ] BTX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:04.579841] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T17:14:04.586294] [INFO ] [REMOTE ] BTE: Full fetch complete (57284 records). [2025-09-14T17:14:04.586429] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-14T17:14:05.003902] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-14T17:14:05.004041] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-14T17:14:05.004929] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-14T17:14:05.004999] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-14T17:14:05.006582] [DEBUG] [LOCAL ] BTE: Trimmed 57284 records to 39642 (keeping 150 days of data) [2025-09-14T17:14:05.248768] [DEBUG] [LOCAL ] BTE: Primary data saved (39642 records). [2025-09-14T17:14:05.248983] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-14T17:14:05.249094] [INFO ] [MAIN ] Update Progress: 353/2370 symbols completed. BTE took 38.1s. Estimated remaining: 3h 30m 48s. Rate: 9.6 symbols/min [2025-09-14T17:14:05.364052] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-14T17:14:05.430794] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:05.452427] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T17:14:05.462404] [INFO ] [REMOTE ] BTI: Full fetch complete (58219 records). [2025-09-14T17:14:05.467347] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-14T17:14:05.467739] [DEBUG] [LOCAL ] BTZ: Loaded 9789 existing records from primary storage. [2025-09-14T17:14:05.468275] [INFO ] [MAIN ] BTZ: Loaded 9789 existing records. [2025-09-14T17:14:05.891681] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:05.983752] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-14T17:14:06.006483] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-14T17:14:06.023238] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-14T17:14:06.059408] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-14T17:14:06.182425] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-14T17:14:06.214103] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-14T17:14:06.219681] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-14T17:14:06.235547] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-14T17:14:06.358097] [DEBUG] [LOCAL ] BTI: Trimmed 58219 records to 40349 (keeping 150 days of data) [2025-09-14T17:14:06.599917] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:06.601980] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-14T17:14:06.603000] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T17:14:06.654464] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-14T17:14:06.821670] [DEBUG] [LOCAL ] BTI: Primary data saved (40349 records). [2025-09-14T17:14:06.821895] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-14T17:14:06.822026] [INFO ] [MAIN ] Update Progress: 354/2370 symbols completed. BTI took 37.1s. Estimated remaining: 3h 30m 15s. Rate: 9.6 symbols/min [2025-09-14T17:14:06.964040] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-14T17:14:07.017208] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:07.045474] [DEBUG] [LOCAL ] BUD: Loaded 23583 existing records from primary storage. [2025-09-14T17:14:07.045724] [INFO ] [MAIN ] BUD: Loaded 23583 existing records. [2025-09-14T17:14:07.229027] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:07.229373] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-14T17:14:07.229441] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-14T17:14:07.230198] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-14T17:14:07.230281] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-14T17:14:07.601809] [INFO ] [REMOTE ] BUD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:07.728356] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T17:14:07.758833] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-14T17:14:08.558891] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-14T17:14:08.645785] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T17:14:08.985721] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T17:14:09.358883] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-14T17:14:10.158883] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-14T17:14:10.277115] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:14:10.895069] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T17:14:10.958873] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-14T17:14:11.474420] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T17:14:11.758978] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-14T17:14:12.117767] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T17:14:12.558893] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-14T17:14:13.358792] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-14T17:14:13.498107] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:14:13.785059] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:14:14.158885] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-14T17:14:14.958886] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-14T17:14:15.058156] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:14:15.697615] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T17:14:15.758807] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-14T17:14:16.135979] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:14:16.558800] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-14T17:14:16.916352] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T17:14:16.921808] [INFO ] [REMOTE ] BTU: Full fetch complete (57934 records). [2025-09-14T17:14:16.921967] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-14T17:14:17.236941] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:14:17.331869] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-14T17:14:17.331985] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-14T17:14:17.332680] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-14T17:14:17.332743] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-14T17:14:17.334010] [DEBUG] [LOCAL ] BTU: Trimmed 57934 records to 40092 (keeping 150 days of data) [2025-09-14T17:14:17.392286] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-14T17:14:17.589613] [DEBUG] [LOCAL ] BTU: Primary data saved (40092 records). [2025-09-14T17:14:17.589806] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-14T17:14:17.589911] [INFO ] [MAIN ] Update Progress: 355/2370 symbols completed. BTU took 26.5s. Estimated remaining: 3h 30m 34s. Rate: 9.6 symbols/min [2025-09-14T17:14:17.759659] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:17.767682] [DEBUG] [LOCAL ] BUI: Loaded 5460 existing records from primary storage. [2025-09-14T17:14:17.767846] [INFO ] [MAIN ] BUI: Loaded 5460 existing records. [2025-09-14T17:14:17.947104] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:17.947439] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-14T17:14:17.947512] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-14T17:14:17.947846] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-14T17:14:17.947909] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-14T17:14:18.164017] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-14T17:14:18.297544] [INFO ] [REMOTE ] BUI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:18.958868] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-14T17:14:19.452761] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:14:19.642990] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:14:19.736438] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T17:14:19.758829] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-14T17:14:20.558826] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-14T17:14:21.358854] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-14T17:14:21.469739] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T17:14:21.472910] [INFO ] [REMOTE ] BTZ: Full fetch complete (24998 records). [2025-09-14T17:14:21.473007] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-14T17:14:21.843894] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-14T17:14:21.844051] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-14T17:14:21.844561] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-14T17:14:21.844634] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-14T17:14:21.845483] [DEBUG] [LOCAL ] BTZ: Trimmed 24998 records to 16645 (keeping 150 days of data) [2025-09-14T17:14:21.950722] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-14T17:14:21.988999] [DEBUG] [LOCAL ] BTZ: Primary data saved (16645 records). [2025-09-14T17:14:21.989161] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-14T17:14:21.989268] [INFO ] [MAIN ] Update Progress: 356/2370 symbols completed. BTZ took 16.7s. Estimated remaining: 3h 30m 17s. Rate: 9.6 symbols/min [2025-09-14T17:14:22.161931] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-14T17:14:22.161847] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:22.184615] [DEBUG] [LOCAL ] BUR: Loaded 21306 existing records from primary storage. [2025-09-14T17:14:22.184805] [INFO ] [MAIN ] BUR: Loaded 21306 existing records. [2025-09-14T17:14:22.363070] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:22.363397] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-14T17:14:22.363466] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-14T17:14:22.364001] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-14T17:14:22.364062] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-14T17:14:22.763300] [INFO ] [REMOTE ] BUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:22.784692] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T17:14:22.958849] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-14T17:14:23.060877] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T17:14:23.758864] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-14T17:14:24.303194] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T17:14:24.558863] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-14T17:14:24.576012] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T17:14:25.358856] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-14T17:14:26.158929] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-14T17:14:26.434973] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:14:26.846302] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:14:26.958874] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-14T17:14:27.065898] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T17:14:27.758839] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-14T17:14:28.455852] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:14:28.558815] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-14T17:14:28.850508] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:14:28.854235] [INFO ] [REMOTE ] BTX: Full fetch complete (33980 records). [2025-09-14T17:14:28.854371] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-14T17:14:29.038811] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 142 unique days, need 150 days [2025-09-14T17:14:29.039300] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:14:29.039357] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:14:29.039407] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-14T17:14:29.039483] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-14T17:14:29.039529] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-14T17:14:29.039615] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-14T17:14:29.039815] [INFO ] [MAIN ] Update Progress: 357/2370 symbols completed. BTX took 25.5s. Estimated remaining: 3h 30m 16s. Rate: 9.6 symbols/min [2025-09-14T17:14:29.358850] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-14T17:14:29.416342] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T17:14:30.158845] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-14T17:14:30.823930] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T17:14:30.861020] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T17:14:30.958833] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-14T17:14:31.758914] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-14T17:14:32.558925] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-14T17:14:32.583961] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T17:14:32.593228] [INFO ] [REMOTE ] BUD: Full fetch complete (57364 records). [2025-09-14T17:14:32.593569] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-14T17:14:33.010610] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-14T17:14:33.010866] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-14T17:14:33.011841] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-14T17:14:33.011928] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-14T17:14:33.013864] [DEBUG] [LOCAL ] BUD: Trimmed 57364 records to 39588 (keeping 150 days of data) [2025-09-14T17:14:33.269012] [DEBUG] [LOCAL ] BUD: Primary data saved (39588 records). [2025-09-14T17:14:33.269285] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-14T17:14:33.269424] [INFO ] [MAIN ] Update Progress: 358/2370 symbols completed. BUD took 26.4s. Estimated remaining: 3h 29m 58s. Rate: 9.6 symbols/min [2025-09-14T17:14:33.325932] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T17:14:33.358891] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-14T17:14:33.392133] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:14:34.158887] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-14T17:14:34.247553] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T17:14:34.958885] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-14T17:14:35.711326] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:14:35.713341] [INFO ] [REMOTE ] BUI: Full fetch complete (12289 records). [2025-09-14T17:14:35.713428] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-14T17:14:36.077653] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-14T17:14:36.077835] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-14T17:14:36.078221] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-14T17:14:36.078295] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-14T17:14:36.102230] [DEBUG] [LOCAL ] BUI: Trimmed 12289 records to 8643 (keeping 150 days of data) [2025-09-14T17:14:36.104167] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T17:14:36.152832] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-14T17:14:36.169206] [DEBUG] [LOCAL ] BUI: Primary data saved (8643 records). [2025-09-14T17:14:36.169321] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-14T17:14:36.169452] [INFO ] [MAIN ] Update Progress: 359/2370 symbols completed. BUI took 18.6s. Estimated remaining: 3h 29m 33s. Rate: 9.6 symbols/min [2025-09-14T17:14:37.723964] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:14:37.733322] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-14T17:14:39.397128] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:14:39.413210] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-14T17:14:40.638412] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:14:40.649572] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-14T17:14:42.364040] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:14:42.375218] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-14T17:14:43.881493] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T17:14:43.886519] [INFO ] [REMOTE ] BUR: Full fetch complete (48573 records). [2025-09-14T17:14:43.886665] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-14T17:14:44.268268] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-14T17:14:44.268435] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-14T17:14:44.269180] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-14T17:14:44.269250] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-14T17:14:44.270621] [DEBUG] [LOCAL ] BUR: Trimmed 48573 records to 34135 (keeping 150 days of data) [2025-09-14T17:14:44.486448] [DEBUG] [LOCAL ] BUR: Primary data saved (34135 records). [2025-09-14T17:14:44.486709] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-14T17:14:44.487038] [INFO ] [MAIN ] Update Progress: 360/2370 symbols completed. BUR took 22.5s. Estimated remaining: 3h 29m 38s. Rate: 9.6 symbols/min [2025-09-14T17:14:45.334221] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:45.495244] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:45.426414] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:45.560371] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:45.568321] [DEBUG] [LOCAL ] BUXX: Loaded 6237 existing records from primary storage. [2025-09-14T17:14:45.576362] [INFO ] [MAIN ] BUXX: Loaded 6237 existing records. [2025-09-14T17:14:45.589018] [DEBUG] [LOCAL ] BVN: Loaded 19198 existing records from primary storage. [2025-09-14T17:14:45.594932] [INFO ] [MAIN ] BVN: Loaded 19198 existing records. [2025-09-14T17:14:45.724332] [DEBUG] [LOCAL ] BURL: Loaded 20050 existing records from primary storage. [2025-09-14T17:14:45.786802] [DEBUG] [LOCAL ] BV: Loaded 17155 existing records from primary storage. [2025-09-14T17:14:45.785823] [INFO ] [MAIN ] BURL: Loaded 20050 existing records. [2025-09-14T17:14:45.853608] [INFO ] [MAIN ] BV: Loaded 17155 existing records. [2025-09-14T17:14:46.247084] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:46.288246] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:46.298986] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-14T17:14:46.325621] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-14T17:14:46.352242] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-14T17:14:46.395837] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:46.395561] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-14T17:14:46.412583] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-14T17:14:46.422333] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-14T17:14:46.456161] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:46.449711] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-14T17:14:46.422511] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-14T17:14:46.457139] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-14T17:14:46.457334] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-14T17:14:46.456018] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-14T17:14:46.457532] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-14T17:14:46.478699] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-14T17:14:46.516661] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-14T17:14:46.537362] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-14T17:14:46.582616] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-14T17:14:47.809754] [INFO ] [REMOTE ] BVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:47.891457] [INFO ] [REMOTE ] BV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:47.921616] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-14T17:14:47.932483] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-14T17:14:47.932130] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:47.966117] [INFO ] [REMOTE ] BURL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:47.966478] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-14T17:14:47.969132] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-14T17:14:48.765659] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T17:14:48.768526] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-14T17:14:49.104491] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:14:49.113354] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-14T17:14:49.186433] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:14:49.195211] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-14T17:14:49.400291] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T17:14:49.408322] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-14T17:14:49.621947] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T17:14:49.625482] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-14T17:14:50.375638] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T17:14:50.388140] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-14T17:14:50.658248] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T17:14:50.668962] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-14T17:14:50.722954] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:14:50.729225] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-14T17:14:50.882578] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:14:50.891808] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-14T17:14:51.541438] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T17:14:51.547167] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-14T17:14:51.739290] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T17:14:51.749224] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-14T17:14:51.914059] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:14:51.922918] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-14T17:14:52.202821] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T17:14:52.289460] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T17:14:52.558838] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-14T17:14:53.206271] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:14:53.358890] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-14T17:14:53.386739] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:14:54.158831] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-14T17:14:54.200228] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T17:14:54.848174] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T17:14:54.958791] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-14T17:14:55.490734] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T17:14:55.758881] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-14T17:14:56.370379] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:14:56.558840] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-14T17:14:57.135117] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T17:14:57.358838] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-14T17:14:57.998235] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T17:14:58.158800] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-14T17:14:58.958869] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-14T17:14:59.047694] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T17:14:59.574355] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T17:14:59.579316] [INFO ] [REMOTE ] BVN: Full fetch complete (46983 records). [2025-09-14T17:14:59.579452] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-14T17:14:59.766893] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-14T17:14:59.958718] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-14T17:14:59.958838] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-14T17:14:59.959774] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-14T17:14:59.959841] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-14T17:14:59.961010] [DEBUG] [LOCAL ] BVN: Trimmed 46983 records to 32333 (keeping 150 days of data) [2025-09-14T17:15:00.095484] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T17:15:00.193211] [DEBUG] [LOCAL ] BVN: Primary data saved (32333 records). [2025-09-14T17:15:00.193395] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-14T17:15:00.193497] [INFO ] [MAIN ] Update Progress: 361/2370 symbols completed. BVN took 15.7s. Estimated remaining: 3h 30m 24s. Rate: 9.5 symbols/min [2025-09-14T17:15:00.369080] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:00.390768] [DEBUG] [LOCAL ] BW: Loaded 17055 existing records from primary storage. [2025-09-14T17:15:00.390924] [INFO ] [MAIN ] BW: Loaded 17055 existing records. [2025-09-14T17:15:00.564002] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-14T17:15:00.567952] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:00.569000] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-14T17:15:00.569076] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-14T17:15:00.569547] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-14T17:15:00.569624] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-14T17:15:00.931867] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:15:00.938315] [INFO ] [REMOTE ] BW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:01.358908] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-14T17:15:02.158869] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-14T17:15:02.451468] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T17:15:02.958835] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-14T17:15:03.705580] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-14T17:15:03.758849] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-14T17:15:04.437637] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-14T17:15:04.558878] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-14T17:15:04.710683] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-14T17:15:04.715441] [INFO ] [REMOTE ] BURL: Full fetch complete (50461 records). [2025-09-14T17:15:04.715552] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-14T17:15:05.091878] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-14T17:15:05.092031] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-14T17:15:05.092681] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-14T17:15:05.092740] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-14T17:15:05.094140] [DEBUG] [LOCAL ] BURL: Trimmed 50461 records to 34400 (keeping 150 days of data) [2025-09-14T17:15:05.308417] [DEBUG] [LOCAL ] BURL: Primary data saved (34400 records). [2025-09-14T17:15:05.308621] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-14T17:15:05.308785] [INFO ] [MAIN ] Update Progress: 362/2370 symbols completed. BURL took 20.8s. Estimated remaining: 3h 30m 12s. Rate: 9.6 symbols/min [2025-09-14T17:15:05.372063] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-14T17:15:05.482874] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:05.506197] [DEBUG] [LOCAL ] BWA: Loaded 23382 existing records from primary storage. [2025-09-14T17:15:05.506455] [INFO ] [MAIN ] BWA: Loaded 23382 existing records. [2025-09-14T17:15:05.685198] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:05.685577] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-14T17:15:05.685638] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-14T17:15:05.686288] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-14T17:15:05.686348] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-14T17:15:05.981579] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-14T17:15:06.057214] [INFO ] [REMOTE ] BV: Full fetch complete (42123 records). [2025-09-14T17:15:06.061915] [INFO ] [REMOTE ] BWA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:06.062109] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-14T17:15:06.161078] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-14T17:15:06.415080] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T17:15:06.503332] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-14T17:15:06.503501] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-14T17:15:06.504447] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-14T17:15:06.504529] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-14T17:15:06.506253] [DEBUG] [LOCAL ] BV: Trimmed 42123 records to 28695 (keeping 150 days of data) [2025-09-14T17:15:06.702256] [DEBUG] [LOCAL ] BV: Primary data saved (28695 records). [2025-09-14T17:15:06.702507] [INFO ] [MAIN ] BV: Full history saved. [2025-09-14T17:15:06.702689] [INFO ] [MAIN ] Update Progress: 363/2370 symbols completed. BV took 22.2s. Estimated remaining: 3h 29m 38s. Rate: 9.6 symbols/min [2025-09-14T17:15:06.883830] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:06.890612] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T17:15:06.893199] [INFO ] [REMOTE ] BUXX: Full fetch complete (16127 records). [2025-09-14T17:15:06.893338] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-14T17:15:06.959007] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-14T17:15:07.003635] [DEBUG] [LOCAL ] BWG: Loaded 6216 existing records from primary storage. [2025-09-14T17:15:07.046545] [INFO ] [MAIN ] BWG: Loaded 6216 existing records. [2025-09-14T17:15:07.443099] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:07.478433] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-14T17:15:07.478721] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-14T17:15:07.478848] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-14T17:15:07.479121] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-14T17:15:07.480271] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-14T17:15:07.480323] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-14T17:15:07.480447] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-14T17:15:07.480567] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-14T17:15:07.558300] [DEBUG] [LOCAL ] BUXX: Trimmed 16127 records to 11633 (keeping 150 days of data) [2025-09-14T17:15:07.904837] [INFO ] [REMOTE ] BWG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:07.905722] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-14T17:15:07.925763] [DEBUG] [LOCAL ] BUXX: Primary data saved (11633 records). [2025-09-14T17:15:07.926371] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-14T17:15:07.926536] [INFO ] [MAIN ] Update Progress: 364/2370 symbols completed. BUXX took 23.4s. Estimated remaining: 3h 29m 4s. Rate: 9.6 symbols/min [2025-09-14T17:15:08.157231] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:08.197478] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T17:15:08.215514] [DEBUG] [LOCAL ] BWLP: Loaded 14175 existing records from primary storage. [2025-09-14T17:15:08.215751] [INFO ] [MAIN ] BWLP: Loaded 14175 existing records. [2025-09-14T17:15:08.412915] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:08.413327] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-14T17:15:08.413396] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-14T17:15:08.413871] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-14T17:15:08.413936] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-14T17:15:08.569906] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-14T17:15:08.783764] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:15:08.830720] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:08.833133] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:15:09.358891] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-14T17:15:10.158880] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-14T17:15:10.697392] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T17:15:10.738862] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-14T17:15:10.755351] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T17:15:10.958833] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-14T17:15:11.758866] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-14T17:15:12.558840] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-14T17:15:12.723567] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T17:15:13.216151] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:15:13.230333] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T17:15:13.358824] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-14T17:15:14.158869] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-14T17:15:14.958931] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-14T17:15:15.374133] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T17:15:15.758855] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-14T17:15:16.335341] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T17:15:16.558798] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-14T17:15:16.655992] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T17:15:17.148005] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T17:15:17.358841] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-14T17:15:17.604839] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:15:18.125728] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T17:15:18.158767] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-14T17:15:18.812826] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T17:15:18.958892] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-14T17:15:19.758843] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-14T17:15:20.528759] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T17:15:20.558871] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-14T17:15:21.358804] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-14T17:15:21.414610] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:15:21.665186] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T17:15:22.158841] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-14T17:15:22.468857] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:15:22.958873] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-14T17:15:23.599890] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T17:15:23.605507] [INFO ] [REMOTE ] BW: Full fetch complete (42797 records). [2025-09-14T17:15:23.605722] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-14T17:15:23.764489] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-14T17:15:24.008344] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-14T17:15:24.008547] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-14T17:15:24.009210] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-14T17:15:24.009274] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-14T17:15:24.010588] [DEBUG] [LOCAL ] BW: Trimmed 42797 records to 28564 (keeping 150 days of data) [2025-09-14T17:15:24.119633] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T17:15:24.210345] [DEBUG] [LOCAL ] BW: Primary data saved (28564 records). [2025-09-14T17:15:24.210534] [INFO ] [MAIN ] BW: Full history saved. [2025-09-14T17:15:24.210658] [INFO ] [MAIN ] Update Progress: 365/2370 symbols completed. BW took 24.0s. Estimated remaining: 3h 29m 53s. Rate: 9.6 symbols/min [2025-09-14T17:15:24.391525] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:24.397971] [DEBUG] [LOCAL ] BWMX: Loaded 4154 existing records from primary storage. [2025-09-14T17:15:24.398124] [INFO ] [MAIN ] BWMX: Loaded 4154 existing records. [2025-09-14T17:15:24.565458] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-14T17:15:24.584760] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:15:24.589685] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:24.594470] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-14T17:15:24.594983] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-14T17:15:24.595737] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-14T17:15:24.595809] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-14T17:15:24.944512] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:25.358835] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-14T17:15:26.158849] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-14T17:15:26.290953] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T17:15:26.293054] [INFO ] [REMOTE ] BWG: Full fetch complete (13066 records). [2025-09-14T17:15:26.293154] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-14T17:15:26.658674] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-14T17:15:26.658812] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-14T17:15:26.659173] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-14T17:15:26.659227] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-14T17:15:26.659776] [DEBUG] [LOCAL ] BWG: Trimmed 13066 records to 9612 (keeping 150 days of data) [2025-09-14T17:15:26.721166] [DEBUG] [LOCAL ] BWG: Primary data saved (9612 records). [2025-09-14T17:15:26.721359] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-14T17:15:26.721479] [INFO ] [MAIN ] Update Progress: 366/2370 symbols completed. BWG took 20.0s. Estimated remaining: 3h 29m 26s. Rate: 9.6 symbols/min [2025-09-14T17:15:26.909043] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:26.941944] [DEBUG] [LOCAL ] BWNB: Loaded 1420 existing records from primary storage. [2025-09-14T17:15:26.942120] [INFO ] [MAIN ] BWNB: Loaded 1420 existing records. [2025-09-14T17:15:26.963905] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-14T17:15:27.008585] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-14T17:15:27.134955] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:27.135214] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-14T17:15:27.135275] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-14T17:15:27.135563] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-14T17:15:27.135638] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-14T17:15:27.510270] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:27.529403] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:15:27.679355] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T17:15:27.758832] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-14T17:15:28.368629] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T17:15:28.558836] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-14T17:15:29.358847] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-14T17:15:29.944388] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T17:15:30.158801] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-14T17:15:30.264696] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:15:30.576985] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T17:15:30.958849] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-14T17:15:31.612279] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T17:15:31.758854] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-14T17:15:32.360862] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-14T17:15:32.558842] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-14T17:15:32.865158] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:15:32.873438] [INFO ] [REMOTE ] BWA: Full fetch complete (56858 records). [2025-09-14T17:15:32.873709] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-14T17:15:33.277114] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-14T17:15:33.277240] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-14T17:15:33.277944] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-14T17:15:33.278045] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-14T17:15:33.279346] [DEBUG] [LOCAL ] BWA: Trimmed 56858 records to 39146 (keeping 150 days of data) [2025-09-14T17:15:33.377314] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-14T17:15:33.541124] [DEBUG] [LOCAL ] BWA: Primary data saved (39146 records). [2025-09-14T17:15:33.541316] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-14T17:15:33.541422] [INFO ] [MAIN ] Update Progress: 367/2370 symbols completed. BWA took 28.2s. Estimated remaining: 3h 29m 23s. Rate: 9.6 symbols/min [2025-09-14T17:15:33.723777] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:33.727557] [DEBUG] [LOCAL ] BWSN: Loaded 1842 existing records from primary storage. [2025-09-14T17:15:33.727685] [INFO ] [MAIN ] BWSN: Loaded 1842 existing records. [2025-09-14T17:15:33.913541] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:33.913844] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-14T17:15:33.913910] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-14T17:15:33.914185] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-14T17:15:33.914265] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-14T17:15:34.162313] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-14T17:15:34.263071] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T17:15:34.283877] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:34.958890] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-14T17:15:35.681036] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T17:15:35.717230] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T17:15:35.758774] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-14T17:15:36.558832] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-14T17:15:36.654771] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:15:37.065614] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T17:15:37.358955] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-14T17:15:38.158868] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-14T17:15:38.170224] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T17:15:38.958837] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-14T17:15:39.394836] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-14T17:15:39.526611] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T17:15:39.758840] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-14T17:15:40.329348] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T17:15:40.558845] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-14T17:15:41.014435] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T17:15:41.358825] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-14T17:15:42.156562] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T17:15:42.159127] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-14T17:15:42.879556] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T17:15:42.958856] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-14T17:15:43.416875] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T17:15:43.418331] [INFO ] [REMOTE ] BWMX: Full fetch complete (7855 records). [2025-09-14T17:15:43.418447] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-14T17:15:43.766006] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-14T17:15:43.789903] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-14T17:15:43.790014] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-14T17:15:43.790235] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-14T17:15:43.790284] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-14T17:15:43.790770] [DEBUG] [LOCAL ] BWMX: Trimmed 7855 records to 6394 (keeping 150 days of data) [2025-09-14T17:15:43.830169] [DEBUG] [LOCAL ] BWMX: Primary data saved (6394 records). [2025-09-14T17:15:43.830306] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-14T17:15:43.830403] [INFO ] [MAIN ] Update Progress: 368/2370 symbols completed. BWMX took 19.6s. Estimated remaining: 3h 29m 39s. Rate: 9.5 symbols/min [2025-09-14T17:15:43.999385] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:44.021694] [DEBUG] [LOCAL ] BWXT: Loaded 21361 existing records from primary storage. [2025-09-14T17:15:44.021868] [INFO ] [MAIN ] BWXT: Loaded 21361 existing records. [2025-09-14T17:15:44.197158] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:44.197430] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-14T17:15:44.197494] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-14T17:15:44.198289] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-14T17:15:44.198355] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-14T17:15:44.558168] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:44.562735] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-14T17:15:44.563679] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T17:15:45.030781] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-14T17:15:45.358887] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-14T17:15:46.158891] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-14T17:15:46.484415] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T17:15:46.488072] [INFO ] [REMOTE ] BWLP: Full fetch complete (35929 records). [2025-09-14T17:15:46.488183] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-14T17:15:46.860867] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-14T17:15:46.861041] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-14T17:15:46.861728] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-14T17:15:46.866385] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-14T17:15:46.866544] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T17:15:46.869541] [DEBUG] [LOCAL ] BWLP: Trimmed 35929 records to 24114 (keeping 150 days of data) [2025-09-14T17:15:46.964186] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-14T17:15:47.027436] [DEBUG] [LOCAL ] BWLP: Primary data saved (24114 records). [2025-09-14T17:15:47.027632] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-14T17:15:47.027758] [INFO ] [MAIN ] Update Progress: 369/2370 symbols completed. BWLP took 39.1s. Estimated remaining: 3h 29m 16s. Rate: 9.6 symbols/min [2025-09-14T17:15:47.197745] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:47.224153] [DEBUG] [LOCAL ] BX: Loaded 23941 existing records from primary storage. [2025-09-14T17:15:47.224396] [INFO ] [MAIN ] BX: Loaded 23941 existing records. [2025-09-14T17:15:47.418113] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:47.418615] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-14T17:15:47.418696] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-14T17:15:47.419563] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-14T17:15:47.419630] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-14T17:15:47.780154] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-14T17:15:47.787722] [INFO ] [REMOTE ] BX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:48.279075] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-14T17:15:48.558820] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-14T17:15:48.642707] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:15:49.358846] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-14T17:15:50.025048] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T17:15:50.158835] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-14T17:15:50.665629] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T17:15:50.958867] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-14T17:15:51.475164] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:15:51.476319] [INFO ] [REMOTE ] BWNB: Full fetch complete (4771 records). [2025-09-14T17:15:51.476415] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-14T17:15:51.761107] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-14T17:15:51.843880] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-14T17:15:51.843999] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-14T17:15:51.844217] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-14T17:15:51.844299] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-14T17:15:51.844771] [DEBUG] [LOCAL ] BWNB: Trimmed 4771 records to 3446 (keeping 150 days of data) [2025-09-14T17:15:51.865932] [DEBUG] [LOCAL ] BWNB: Primary data saved (3446 records). [2025-09-14T17:15:51.866063] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-14T17:15:51.866212] [INFO ] [MAIN ] Update Progress: 370/2370 symbols completed. BWNB took 25.1s. Estimated remaining: 3h 29m 1s. Rate: 9.6 symbols/min [2025-09-14T17:15:52.041483] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:52.074188] [DEBUG] [LOCAL ] BXC: Loaded 6262 existing records from primary storage. [2025-09-14T17:15:52.075697] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:15:52.085270] [INFO ] [MAIN ] BXC: Loaded 6262 existing records. [2025-09-14T17:15:52.273689] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:52.274006] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-14T17:15:52.274066] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-14T17:15:52.274444] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-14T17:15:52.274511] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-14T17:15:52.566226] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-14T17:15:52.658904] [INFO ] [REMOTE ] BXC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:53.186233] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:15:53.187481] [INFO ] [REMOTE ] BWSN: Full fetch complete (5345 records). [2025-09-14T17:15:53.187581] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-14T17:15:53.365093] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-14T17:15:53.552687] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-14T17:15:53.552804] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-14T17:15:53.552997] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-14T17:15:53.553048] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-14T17:15:53.553448] [DEBUG] [LOCAL ] BWSN: Trimmed 5345 records to 4133 (keeping 150 days of data) [2025-09-14T17:15:53.580270] [DEBUG] [LOCAL ] BWSN: Primary data saved (4133 records). [2025-09-14T17:15:53.580439] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-14T17:15:53.580567] [INFO ] [MAIN ] Update Progress: 371/2370 symbols completed. BWSN took 20.0s. Estimated remaining: 3h 28m 31s. Rate: 9.6 symbols/min [2025-09-14T17:15:53.761501] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:53.786581] [DEBUG] [LOCAL ] BXMT: Loaded 20689 existing records from primary storage. [2025-09-14T17:15:53.786803] [INFO ] [MAIN ] BXMT: Loaded 20689 existing records. [2025-09-14T17:15:53.997552] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-14T17:15:54.003301] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:54.015742] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-14T17:15:54.015830] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-14T17:15:54.016731] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-14T17:15:54.016797] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-14T17:15:54.168525] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-14T17:15:54.396435] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:54.959304] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-14T17:15:54.962161] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T17:15:55.081813] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T17:15:55.758875] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-14T17:15:56.558833] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-14T17:15:56.645753] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T17:15:57.358838] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-14T17:15:57.718283] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:15:58.158842] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-14T17:15:58.408986] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:15:58.958837] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-14T17:15:59.012022] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T17:15:59.543054] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T17:15:59.758866] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-14T17:16:00.558862] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-14T17:16:00.733037] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T17:16:01.276809] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-14T17:16:01.358796] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-14T17:16:02.158870] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-14T17:16:02.613358] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T17:16:02.918862] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T17:16:02.958813] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-14T17:16:03.219757] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:16:03.758830] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-14T17:16:03.876127] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:16:04.558829] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-14T17:16:05.358837] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-14T17:16:05.794292] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T17:16:06.158807] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-14T17:16:06.222124] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:16:06.290838] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:16:06.958837] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-14T17:16:07.758872] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-14T17:16:08.047607] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T17:16:08.558842] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-14T17:16:08.899430] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T17:16:09.358818] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-14T17:16:09.402339] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:16:09.697753] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:16:09.702976] [INFO ] [REMOTE ] BWXT: Full fetch complete (50734 records). [2025-09-14T17:16:09.703117] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-14T17:16:10.099279] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-14T17:16:10.099405] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-14T17:16:10.100173] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-14T17:16:10.100245] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-14T17:16:10.101537] [DEBUG] [LOCAL ] BWXT: Trimmed 50734 records to 35100 (keeping 150 days of data) [2025-09-14T17:16:10.163927] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-14T17:16:10.355514] [DEBUG] [LOCAL ] BWXT: Primary data saved (35100 records). [2025-09-14T17:16:10.355751] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-14T17:16:10.355867] [INFO ] [MAIN ] Update Progress: 372/2370 symbols completed. BWXT took 26.5s. Estimated remaining: 3h 29m 21s. Rate: 9.5 symbols/min [2025-09-14T17:16:10.529905] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:10.539848] [DEBUG] [LOCAL ] BXMX: Loaded 7543 existing records from primary storage. [2025-09-14T17:16:10.540003] [INFO ] [MAIN ] BXMX: Loaded 7543 existing records. [2025-09-14T17:16:10.718412] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:10.718830] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-14T17:16:10.718952] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-14T17:16:10.719358] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-14T17:16:10.719586] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-14T17:16:10.853850] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-14T17:16:10.966384] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-14T17:16:11.128940] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:11.139131] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T17:16:11.758879] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-14T17:16:12.558839] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-14T17:16:12.614874] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T17:16:12.636380] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:16:12.934939] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T17:16:12.940476] [INFO ] [REMOTE ] BX: Full fetch complete (58173 records). [2025-09-14T17:16:12.940611] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-14T17:16:13.337079] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-14T17:16:13.337201] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-14T17:16:13.337917] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-14T17:16:13.337976] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-14T17:16:13.339198] [DEBUG] [LOCAL ] BX: Trimmed 58173 records to 40257 (keeping 150 days of data) [2025-09-14T17:16:13.400350] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-14T17:16:13.599887] [DEBUG] [LOCAL ] BX: Primary data saved (40257 records). [2025-09-14T17:16:13.600047] [INFO ] [MAIN ] BX: Full history saved. [2025-09-14T17:16:13.600155] [INFO ] [MAIN ] Update Progress: 373/2370 symbols completed. BX took 26.6s. Estimated remaining: 3h 28m 58s. Rate: 9.6 symbols/min [2025-09-14T17:16:13.768863] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:13.789944] [DEBUG] [LOCAL ] BXP: Loaded 22191 existing records from primary storage. [2025-09-14T17:16:13.790141] [INFO ] [MAIN ] BXP: Loaded 22191 existing records. [2025-09-14T17:16:13.974024] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:13.974356] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-14T17:16:13.974420] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-14T17:16:13.975003] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-14T17:16:13.975085] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-14T17:16:14.167042] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-14T17:16:14.340956] [INFO ] [REMOTE ] BXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:14.958800] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-14T17:16:15.029478] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T17:16:15.031259] [INFO ] [REMOTE ] BXC: Full fetch complete (14530 records). [2025-09-14T17:16:15.031347] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-14T17:16:15.391122] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-14T17:16:15.391349] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-14T17:16:15.391882] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-14T17:16:15.392025] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-14T17:16:15.392728] [DEBUG] [LOCAL ] BXC: Trimmed 14530 records to 10237 (keeping 150 days of data) [2025-09-14T17:16:15.466351] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-14T17:16:15.489286] [DEBUG] [LOCAL ] BXC: Primary data saved (10237 records). [2025-09-14T17:16:15.489427] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-14T17:16:15.489524] [INFO ] [MAIN ] Update Progress: 374/2370 symbols completed. BXC took 23.6s. Estimated remaining: 3h 28m 29s. Rate: 9.6 symbols/min [2025-09-14T17:16:15.656235] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:15.678321] [DEBUG] [LOCAL ] BXSL: Loaded 21207 existing records from primary storage. [2025-09-14T17:16:15.678543] [INFO ] [MAIN ] BXSL: Loaded 21207 existing records. [2025-09-14T17:16:15.766602] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-14T17:16:15.853507] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:15.853779] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-14T17:16:15.853839] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-14T17:16:15.854590] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-14T17:16:15.854678] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-14T17:16:16.204482] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:16.434488] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:16:16.439407] [INFO ] [REMOTE ] BXMT: Full fetch complete (51807 records). [2025-09-14T17:16:16.439525] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-14T17:16:16.559364] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-14T17:16:16.815729] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T17:16:16.859519] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-14T17:16:16.859631] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-14T17:16:16.860434] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-14T17:16:16.860492] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-14T17:16:16.861664] [DEBUG] [LOCAL ] BXMT: Trimmed 51807 records to 34780 (keeping 150 days of data) [2025-09-14T17:16:17.074472] [DEBUG] [LOCAL ] BXMT: Primary data saved (34780 records). [2025-09-14T17:16:17.074671] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-14T17:16:17.074777] [INFO ] [MAIN ] Update Progress: 375/2370 symbols completed. BXMT took 23.5s. Estimated remaining: 3h 27m 57s. Rate: 9.6 symbols/min [2025-09-14T17:16:17.252450] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:17.263826] [DEBUG] [LOCAL ] BY: Loaded 9981 existing records from primary storage. [2025-09-14T17:16:17.263999] [INFO ] [MAIN ] BY: Loaded 9981 existing records. [2025-09-14T17:16:17.364953] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-14T17:16:17.450069] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:17.450370] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-14T17:16:17.450449] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-14T17:16:17.450942] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-14T17:16:17.451011] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-14T17:16:17.645042] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:16:17.846413] [INFO ] [REMOTE ] BY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:18.158882] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-14T17:16:18.937983] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T17:16:18.967223] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-14T17:16:18.970132] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T17:16:19.758907] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-14T17:16:20.558910] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-14T17:16:20.731591] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:16:21.358885] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-14T17:16:21.464247] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T17:16:21.662722] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:16:22.158831] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-14T17:16:22.964818] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-14T17:16:22.987520] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:16:23.561518] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T17:16:23.758924] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-14T17:16:23.887306] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:16:24.558895] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-14T17:16:24.962790] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T17:16:25.358849] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-14T17:16:25.544788] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T17:16:26.158842] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-14T17:16:26.826085] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T17:16:26.958903] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-14T17:16:27.759555] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-14T17:16:27.765073] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:16:28.057353] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T17:16:28.558844] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-14T17:16:29.116156] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:16:29.358857] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-14T17:16:29.876517] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T17:16:30.158823] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-14T17:16:30.487387] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:16:30.958949] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-14T17:16:31.758854] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-14T17:16:31.846589] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:16:32.533415] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T17:16:32.558839] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-14T17:16:32.751129] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:16:33.358929] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-14T17:16:33.762613] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:16:33.768431] [INFO ] [REMOTE ] BXSL: Full fetch complete (51437 records). [2025-09-14T17:16:33.768676] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-14T17:16:34.159205] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-14T17:16:34.159124] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-14T17:16:34.160479] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-14T17:16:34.161355] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-14T17:16:34.161870] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-14T17:16:34.163963] [DEBUG] [LOCAL ] BXSL: Trimmed 51437 records to 35067 (keeping 150 days of data) [2025-09-14T17:16:34.402188] [DEBUG] [LOCAL ] BXSL: Primary data saved (35067 records). [2025-09-14T17:16:34.402430] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-14T17:16:34.402564] [INFO ] [MAIN ] Update Progress: 376/2370 symbols completed. BXSL took 18.9s. Estimated remaining: 3h 28m 50s. Rate: 9.5 symbols/min [2025-09-14T17:16:34.597520] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T17:16:34.599697] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:34.628068] [DEBUG] [LOCAL ] BYD: Loaded 20494 existing records from primary storage. [2025-09-14T17:16:34.628285] [INFO ] [MAIN ] BYD: Loaded 20494 existing records. [2025-09-14T17:16:34.814199] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:34.814521] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-14T17:16:34.814585] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-14T17:16:34.815288] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-14T17:16:34.815353] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-14T17:16:34.964854] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-14T17:16:35.177250] [INFO ] [REMOTE ] BYD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:35.192228] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T17:16:35.758829] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-14T17:16:36.558786] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-14T17:16:36.801812] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:16:36.950761] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:16:37.358889] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-14T17:16:38.158848] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-14T17:16:38.195197] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T17:16:38.233664] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:16:38.958833] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-14T17:16:39.538068] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T17:16:39.758897] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-14T17:16:40.488908] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:16:40.491358] [INFO ] [REMOTE ] BY: Full fetch complete (22454 records). [2025-09-14T17:16:40.491449] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-14T17:16:40.564032] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-14T17:16:40.888111] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-14T17:16:40.888352] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-14T17:16:40.888921] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-14T17:16:40.889090] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-14T17:16:40.890282] [DEBUG] [LOCAL ] BY: Trimmed 22454 records to 16124 (keeping 150 days of data) [2025-09-14T17:16:41.001355] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T17:16:41.040600] [DEBUG] [LOCAL ] BY: Primary data saved (16124 records). [2025-09-14T17:16:41.040802] [INFO ] [MAIN ] BY: Full history saved. [2025-09-14T17:16:41.040913] [INFO ] [MAIN ] Update Progress: 377/2370 symbols completed. BY took 24.0s. Estimated remaining: 3h 28m 46s. Rate: 9.5 symbols/min [2025-09-14T17:16:41.212295] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:41.219322] [DEBUG] [LOCAL ] BYM: Loaded 4794 existing records from primary storage. [2025-09-14T17:16:41.219513] [INFO ] [MAIN ] BYM: Loaded 4794 existing records. [2025-09-14T17:16:41.364430] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-14T17:16:41.410189] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:41.410948] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-14T17:16:41.411012] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-14T17:16:41.411360] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-14T17:16:41.411424] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-14T17:16:41.765585] [INFO ] [REMOTE ] BYM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:41.786505] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T17:16:42.158863] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-14T17:16:42.903184] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:16:42.905320] [INFO ] [REMOTE ] BXMX: Full fetch complete (21312 records). [2025-09-14T17:16:42.905435] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-14T17:16:42.967932] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-14T17:16:43.273069] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-14T17:16:43.273202] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-14T17:16:43.273627] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-14T17:16:43.273732] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-14T17:16:43.274451] [DEBUG] [LOCAL ] BXMX: Trimmed 21312 records to 13751 (keeping 150 days of data) [2025-09-14T17:16:43.364359] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T17:16:43.404474] [DEBUG] [LOCAL ] BXMX: Primary data saved (13751 records). [2025-09-14T17:16:43.404690] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-14T17:16:43.404797] [INFO ] [MAIN ] Update Progress: 378/2370 symbols completed. BXMX took 33.0s. Estimated remaining: 3h 28m 19s. Rate: 9.6 symbols/min [2025-09-14T17:16:43.579995] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:43.595939] [DEBUG] [LOCAL ] BZH: Loaded 14369 existing records from primary storage. [2025-09-14T17:16:43.596103] [INFO ] [MAIN ] BZH: Loaded 14369 existing records. [2025-09-14T17:16:43.771177] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-14T17:16:43.776161] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:43.777354] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-14T17:16:43.777434] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-14T17:16:43.777969] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-14T17:16:43.778045] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-14T17:16:44.141530] [INFO ] [REMOTE ] BZH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:44.157233] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:16:44.162786] [INFO ] [REMOTE ] BXP: Full fetch complete (54124 records). [2025-09-14T17:16:44.162971] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-14T17:16:44.564545] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-14T17:16:44.566468] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-14T17:16:44.566542] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-14T17:16:44.567527] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-14T17:16:44.567741] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-14T17:16:44.571231] [DEBUG] [LOCAL ] BXP: Trimmed 54124 records to 37306 (keeping 150 days of data) [2025-09-14T17:16:44.695236] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:16:44.828089] [DEBUG] [LOCAL ] BXP: Primary data saved (37306 records). [2025-09-14T17:16:44.828302] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-14T17:16:44.828440] [INFO ] [MAIN ] Update Progress: 379/2370 symbols completed. BXP took 31.2s. Estimated remaining: 3h 27m 47s. Rate: 9.6 symbols/min [2025-09-14T17:16:45.000307] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:45.024679] [DEBUG] [LOCAL ] C: Loaded 24152 existing records from primary storage. [2025-09-14T17:16:45.024882] [INFO ] [MAIN ] C: Loaded 24152 existing records. [2025-09-14T17:16:45.204457] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:45.204781] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-14T17:16:45.204847] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-14T17:16:45.209480] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-14T17:16:45.210071] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-14T17:16:45.367566] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-14T17:16:45.633526] [INFO ] [REMOTE ] C: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:46.158851] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-14T17:16:46.626101] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T17:16:46.958900] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-14T17:16:47.736724] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-14T17:16:47.758773] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-14T17:16:47.871988] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T17:16:48.024299] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:16:48.558894] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-14T17:16:49.358822] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-14T17:16:49.555993] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T17:16:49.898983] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-14T17:16:50.158898] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-14T17:16:50.958838] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-14T17:16:51.063489] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T17:16:51.685663] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T17:16:51.758839] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-14T17:16:52.558881] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-14T17:16:52.705307] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:16:52.887333] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T17:16:53.174786] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T17:16:53.358889] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-14T17:16:54.158907] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-14T17:16:54.958925] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-14T17:16:55.001114] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:16:55.758980] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-14T17:16:56.017958] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T17:16:56.088307] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:16:56.093369] [INFO ] [REMOTE ] BYD: Full fetch complete (49284 records). [2025-09-14T17:16:56.093547] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-14T17:16:56.498894] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-14T17:16:56.499020] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-14T17:16:56.499795] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-14T17:16:56.499875] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-14T17:16:56.502772] [DEBUG] [LOCAL ] BYD: Trimmed 49284 records to 33858 (keeping 150 days of data) [2025-09-14T17:16:56.564216] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-14T17:16:56.737205] [DEBUG] [LOCAL ] BYD: Primary data saved (33858 records). [2025-09-14T17:16:56.737410] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-14T17:16:56.737612] [INFO ] [MAIN ] Update Progress: 380/2370 symbols completed. BYD took 22.3s. Estimated remaining: 3h 28m 10s. Rate: 9.6 symbols/min [2025-09-14T17:16:56.918773] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:56.928631] [DEBUG] [LOCAL ] CAAP: Loaded 7949 existing records from primary storage. [2025-09-14T17:16:56.928844] [INFO ] [MAIN ] CAAP: Loaded 7949 existing records. [2025-09-14T17:16:57.110528] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:57.110844] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-14T17:16:57.110929] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-14T17:16:57.111326] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-14T17:16:57.111388] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-14T17:16:57.361947] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-14T17:16:57.460860] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-14T17:16:57.531627] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:57.641257] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:16:58.158864] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-14T17:16:58.319470] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T17:16:58.958849] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-14T17:16:59.574617] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T17:16:59.758847] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-14T17:16:59.891120] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:17:00.558868] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-14T17:17:00.711126] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T17:17:01.358843] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-14T17:17:02.027527] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T17:17:02.158393] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:17:02.160720] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-14T17:17:02.958886] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-14T17:17:03.261882] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T17:17:03.758893] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-14T17:17:03.772206] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:17:03.774921] [INFO ] [REMOTE ] BYM: Full fetch complete (13097 records). [2025-09-14T17:17:03.775102] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-14T17:17:04.146100] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-14T17:17:04.146266] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-14T17:17:04.146680] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-14T17:17:04.146756] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-14T17:17:04.147336] [DEBUG] [LOCAL ] BYM: Trimmed 13097 records to 8535 (keeping 150 days of data) [2025-09-14T17:17:04.201971] [DEBUG] [LOCAL ] BYM: Primary data saved (8535 records). [2025-09-14T17:17:04.202148] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-14T17:17:04.202282] [INFO ] [MAIN ] Update Progress: 381/2370 symbols completed. BYM took 23.2s. Estimated remaining: 3h 28m 10s. Rate: 9.6 symbols/min [2025-09-14T17:17:04.374301] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:04.385759] [DEBUG] [LOCAL ] CABO: Loaded 8088 existing records from primary storage. [2025-09-14T17:17:04.385904] [INFO ] [MAIN ] CABO: Loaded 8088 existing records. [2025-09-14T17:17:04.561315] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-14T17:17:04.564598] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:04.565906] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-14T17:17:04.565969] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-14T17:17:04.566358] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-14T17:17:04.566410] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-14T17:17:04.945297] [INFO ] [REMOTE ] CABO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:04.960515] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T17:17:05.358881] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-14T17:17:06.158896] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-14T17:17:06.420418] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T17:17:06.622076] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T17:17:06.958827] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-14T17:17:07.434192] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:17:07.758867] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-14T17:17:08.558802] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-14T17:17:08.708800] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T17:17:09.040893] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-14T17:17:09.358848] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-14T17:17:09.425932] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:17:09.429793] [INFO ] [REMOTE ] BZH: Full fetch complete (36423 records). [2025-09-14T17:17:09.429894] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-14T17:17:09.798412] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-14T17:17:09.798535] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-14T17:17:09.799085] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-14T17:17:09.799143] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-14T17:17:09.800410] [DEBUG] [LOCAL ] BZH: Trimmed 36423 records to 24562 (keeping 150 days of data) [2025-09-14T17:17:09.963744] [DEBUG] [LOCAL ] BZH: Primary data saved (24562 records). [2025-09-14T17:17:09.963979] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-14T17:17:09.964105] [INFO ] [MAIN ] Update Progress: 382/2370 symbols completed. BZH took 26.6s. Estimated remaining: 3h 28m 1s. Rate: 9.6 symbols/min [2025-09-14T17:17:10.149669] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:10.161905] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-14T17:17:10.161747] [DEBUG] [LOCAL ] CACI: Loaded 9042 existing records from primary storage. [2025-09-14T17:17:10.163389] [INFO ] [MAIN ] CACI: Loaded 9042 existing records. [2025-09-14T17:17:10.348134] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:10.348453] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-14T17:17:10.348520] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-14T17:17:10.348967] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-14T17:17:10.349033] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-14T17:17:10.744212] [INFO ] [REMOTE ] CACI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:10.760059] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T17:17:10.958854] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-14T17:17:11.249863] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T17:17:11.758904] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-14T17:17:12.350915] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:17:12.558886] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-14T17:17:12.769787] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T17:17:13.358967] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-14T17:17:13.813335] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T17:17:14.158836] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-14T17:17:14.958815] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-14T17:17:15.065890] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T17:17:15.068824] [INFO ] [REMOTE ] CAAP: Full fetch complete (20148 records). [2025-09-14T17:17:15.068930] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-14T17:17:15.450987] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-14T17:17:15.451142] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-14T17:17:15.451755] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-14T17:17:15.451875] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-14T17:17:15.453108] [DEBUG] [LOCAL ] CAAP: Trimmed 20148 records to 13531 (keeping 150 days of data) [2025-09-14T17:17:15.556391] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-14T17:17:15.578703] [DEBUG] [LOCAL ] CAAP: Primary data saved (13531 records). [2025-09-14T17:17:15.578853] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-14T17:17:15.578990] [INFO ] [MAIN ] Update Progress: 383/2370 symbols completed. CAAP took 18.8s. Estimated remaining: 3h 27m 51s. Rate: 9.6 symbols/min [2025-09-14T17:17:15.751807] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:15.758817] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-14T17:17:15.777578] [DEBUG] [LOCAL ] CADE: Loaded 22503 existing records from primary storage. [2025-09-14T17:17:15.777758] [INFO ] [MAIN ] CADE: Loaded 22503 existing records. [2025-09-14T17:17:15.953486] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:15.953929] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-14T17:17:15.954003] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-14T17:17:15.962424] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-14T17:17:15.963519] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T17:17:15.963219] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-14T17:17:16.330978] [INFO ] [REMOTE ] CADE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:16.558841] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-14T17:17:17.358835] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-14T17:17:17.706769] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T17:17:17.785543] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-14T17:17:18.158845] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-14T17:17:18.495978] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:17:18.503188] [INFO ] [REMOTE ] C: Full fetch complete (58421 records). [2025-09-14T17:17:18.503522] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-14T17:17:18.926559] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-14T17:17:18.926724] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-14T17:17:18.927578] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-14T17:17:18.927700] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-14T17:17:18.929394] [DEBUG] [LOCAL ] C: Trimmed 58421 records to 40482 (keeping 150 days of data) [2025-09-14T17:17:18.951950] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:17:18.959916] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-14T17:17:19.221007] [DEBUG] [LOCAL ] C: Primary data saved (40482 records). [2025-09-14T17:17:19.221180] [INFO ] [MAIN ] C: Full history saved. [2025-09-14T17:17:19.221291] [INFO ] [MAIN ] Update Progress: 384/2370 symbols completed. C took 34.4s. Estimated remaining: 3h 27m 31s. Rate: 9.6 symbols/min [2025-09-14T17:17:19.415413] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:19.435733] [DEBUG] [LOCAL ] CAE: Loaded 17385 existing records from primary storage. [2025-09-14T17:17:19.435952] [INFO ] [MAIN ] CAE: Loaded 17385 existing records. [2025-09-14T17:17:19.626343] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:19.626764] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-14T17:17:19.626851] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-14T17:17:19.627488] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-14T17:17:19.627562] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-14T17:17:19.773524] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-14T17:17:19.999332] [INFO ] [REMOTE ] CAE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:20.558818] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-14T17:17:20.659939] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:17:20.863838] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:17:21.358810] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-14T17:17:21.421408] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T17:17:22.158845] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-14T17:17:22.614726] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:17:22.958850] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-14T17:17:23.243943] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:17:23.758874] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-14T17:17:23.942752] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T17:17:24.558852] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-14T17:17:25.358859] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-14T17:17:25.511625] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:17:25.625960] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:17:26.158833] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-14T17:17:26.375053] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T17:17:26.377095] [INFO ] [REMOTE ] CABO: Full fetch complete (19202 records). [2025-09-14T17:17:26.377214] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-14T17:17:26.744860] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-14T17:17:26.744986] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-14T17:17:26.745516] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-14T17:17:26.745670] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-14T17:17:26.758167] [DEBUG] [LOCAL ] CABO: Trimmed 19202 records to 13907 (keeping 150 days of data) [2025-09-14T17:17:26.759065] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:17:26.851496] [DEBUG] [LOCAL ] CABO: Primary data saved (13907 records). [2025-09-14T17:17:26.851721] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-14T17:17:26.851831] [INFO ] [MAIN ] Update Progress: 385/2370 symbols completed. CABO took 22.6s. Estimated remaining: 3h 27m 32s. Rate: 9.6 symbols/min [2025-09-14T17:17:26.959858] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-14T17:17:27.037297] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:27.040404] [DEBUG] [LOCAL ] CAF: Loaded 1229 existing records from primary storage. [2025-09-14T17:17:27.040498] [INFO ] [MAIN ] CAF: Loaded 1229 existing records. [2025-09-14T17:17:27.221956] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:27.222260] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-14T17:17:27.222373] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-14T17:17:27.222598] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-14T17:17:27.222695] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-14T17:17:27.588104] [INFO ] [REMOTE ] CAF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:27.758843] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-14T17:17:28.558849] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-14T17:17:28.788461] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T17:17:29.240280] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-14T17:17:29.358923] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-14T17:17:29.515980] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T17:17:29.965260] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T17:17:30.158911] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-14T17:17:30.958857] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-14T17:17:31.406834] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T17:17:31.663067] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T17:17:31.758863] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-14T17:17:32.408765] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T17:17:32.559033] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-14T17:17:33.358863] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-14T17:17:34.071850] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:17:34.158840] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-14T17:17:34.750820] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T17:17:34.958797] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-14T17:17:34.993816] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T17:17:35.758820] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-14T17:17:35.958634] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T17:17:36.558859] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-14T17:17:37.364014] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-14T17:17:37.380950] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T17:17:37.841930] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T17:17:37.901153] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:17:37.903828] [INFO ] [REMOTE ] CACI: Full fetch complete (29741 records). [2025-09-14T17:17:37.903931] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-14T17:17:38.158870] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-14T17:17:38.282076] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-14T17:17:38.282193] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-14T17:17:38.282684] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-14T17:17:38.282743] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-14T17:17:38.283511] [DEBUG] [LOCAL ] CACI: Trimmed 29741 records to 17208 (keeping 150 days of data) [2025-09-14T17:17:38.387771] [DEBUG] [LOCAL ] CACI: Primary data saved (17208 records). [2025-09-14T17:17:38.388003] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-14T17:17:38.388146] [INFO ] [MAIN ] Update Progress: 386/2370 symbols completed. CACI took 28.4s. Estimated remaining: 3h 27m 53s. Rate: 9.5 symbols/min [2025-09-14T17:17:38.578580] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:38.604678] [DEBUG] [LOCAL ] CAG: Loaded 24099 existing records from primary storage. [2025-09-14T17:17:38.604870] [INFO ] [MAIN ] CAG: Loaded 24099 existing records. [2025-09-14T17:17:38.788723] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:38.789026] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-14T17:17:38.789102] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-14T17:17:38.790084] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-14T17:17:38.790166] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-14T17:17:38.975813] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-14T17:17:39.175527] [INFO ] [REMOTE ] CAG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:39.758851] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-14T17:17:39.902822] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:17:40.558917] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-14T17:17:40.725200] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:17:41.207717] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T17:17:41.358842] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-14T17:17:42.164448] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-14T17:17:42.170408] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T17:17:42.754187] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T17:17:42.958874] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-14T17:17:43.582459] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T17:17:43.620489] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:17:43.628108] [INFO ] [REMOTE ] CADE: Full fetch complete (52631 records). [2025-09-14T17:17:43.628394] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-14T17:17:43.764130] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-14T17:17:44.171358] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-14T17:17:44.171552] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-14T17:17:44.173015] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-14T17:17:44.173132] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-14T17:17:44.175041] [DEBUG] [LOCAL ] CADE: Trimmed 52631 records to 37014 (keeping 150 days of data) [2025-09-14T17:17:44.499008] [DEBUG] [LOCAL ] CADE: Primary data saved (37014 records). [2025-09-14T17:17:44.499256] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-14T17:17:44.499400] [INFO ] [MAIN ] Update Progress: 387/2370 symbols completed. CADE took 28.9s. Estimated remaining: 3h 27m 46s. Rate: 9.5 symbols/min [2025-09-14T17:17:44.566569] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-14T17:17:44.718794] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:44.744946] [DEBUG] [LOCAL ] CAH: Loaded 23005 existing records from primary storage. [2025-09-14T17:17:44.745153] [INFO ] [MAIN ] CAH: Loaded 23005 existing records. [2025-09-14T17:17:44.929946] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:44.930347] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-14T17:17:44.930422] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-14T17:17:44.931266] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-14T17:17:44.931347] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-14T17:17:45.304594] [INFO ] [REMOTE ] CAH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:45.358824] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-14T17:17:45.646195] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T17:17:45.939819] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-14T17:17:45.943732] [INFO ] [REMOTE ] CAE: Full fetch complete (42466 records). [2025-09-14T17:17:45.943837] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-14T17:17:46.164143] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-14T17:17:46.326394] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-14T17:17:46.326542] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-14T17:17:46.327182] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-14T17:17:46.327246] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-14T17:17:46.328498] [DEBUG] [LOCAL ] CAE: Trimmed 42466 records to 28792 (keeping 150 days of data) [2025-09-14T17:17:46.501510] [DEBUG] [LOCAL ] CAE: Primary data saved (28792 records). [2025-09-14T17:17:46.501759] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-14T17:17:46.501889] [INFO ] [MAIN ] Update Progress: 388/2370 symbols completed. CAE took 27.3s. Estimated remaining: 3h 27m 18s. Rate: 9.6 symbols/min [2025-09-14T17:17:46.611164] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T17:17:46.689848] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:46.711711] [DEBUG] [LOCAL ] CAL: Loaded 18787 existing records from primary storage. [2025-09-14T17:17:46.712008] [INFO ] [MAIN ] CAL: Loaded 18787 existing records. [2025-09-14T17:17:46.909822] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:46.910380] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-14T17:17:46.910454] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-14T17:17:46.929217] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-14T17:17:46.939538] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-14T17:17:46.963995] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-14T17:17:46.975070] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:17:47.361263] [INFO ] [REMOTE ] CAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:47.574616] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T17:17:47.758873] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-14T17:17:48.558870] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-14T17:17:48.968621] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T17:17:49.358901] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-14T17:17:50.158895] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-14T17:17:50.526962] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T17:17:50.553476] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:17:50.554599] [INFO ] [REMOTE ] CAF: Full fetch complete (3957 records). [2025-09-14T17:17:50.554711] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-14T17:17:50.927483] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-14T17:17:50.927618] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-14T17:17:50.927839] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-14T17:17:50.927897] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-14T17:17:50.928348] [DEBUG] [LOCAL ] CAF: Trimmed 3957 records to 2328 (keeping 150 days of data) [2025-09-14T17:17:50.944584] [DEBUG] [LOCAL ] CAF: Primary data saved (2328 records). [2025-09-14T17:17:50.944834] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-14T17:17:50.944987] [INFO ] [MAIN ] Update Progress: 389/2370 symbols completed. CAF took 24.1s. Estimated remaining: 3h 27m 2s. Rate: 9.6 symbols/min [2025-09-14T17:17:50.967282] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-14T17:17:51.128167] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:51.148284] [DEBUG] [LOCAL ] CALX: Loaded 17044 existing records from primary storage. [2025-09-14T17:17:51.148521] [INFO ] [MAIN ] CALX: Loaded 17044 existing records. [2025-09-14T17:17:51.333602] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:51.334027] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-14T17:17:51.334114] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-14T17:17:51.399027] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-14T17:17:51.419444] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-14T17:17:51.501960] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-14T17:17:51.764060] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-14T17:17:51.839803] [INFO ] [REMOTE ] CALX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:52.287237] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T17:17:52.558894] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-14T17:17:53.358877] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-14T17:17:54.158854] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-14T17:17:54.228398] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-14T17:17:54.531709] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T17:17:54.958897] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-14T17:17:55.758860] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-14T17:17:56.425041] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-14T17:17:56.558873] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-14T17:17:56.912093] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:17:57.008722] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T17:17:57.317996] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (3.16 seconds). [2025-09-14T17:17:57.358834] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-14T17:17:58.158918] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-14T17:17:58.380729] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T17:17:58.958853] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-14T17:17:59.486624] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-14T17:17:59.647760] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T17:17:59.758882] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-14T17:18:00.569389] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-14T17:18:00.574813] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T17:18:01.042089] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:18:01.358896] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-14T17:18:02.158902] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-14T17:18:02.765188] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-14T17:18:02.965271] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-14T17:18:02.968221] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:18:03.758872] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-14T17:18:04.011064] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T17:18:04.178040] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T17:18:04.183792] [INFO ] [REMOTE ] CAG: Full fetch complete (58335 records). [2025-09-14T17:18:04.183947] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-14T17:18:04.566957] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-14T17:18:04.588928] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-14T17:18:04.589080] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-14T17:18:04.590142] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-14T17:18:04.590392] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-14T17:18:04.592882] [DEBUG] [LOCAL ] CAG: Trimmed 58335 records to 40406 (keeping 150 days of data) [2025-09-14T17:18:04.855040] [DEBUG] [LOCAL ] CAG: Primary data saved (40406 records). [2025-09-14T17:18:04.855238] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-14T17:18:04.855397] [INFO ] [MAIN ] Update Progress: 390/2370 symbols completed. CAG took 26.5s. Estimated remaining: 3h 27m 35s. Rate: 9.5 symbols/min [2025-09-14T17:18:05.025356] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:05.039254] [DEBUG] [LOCAL ] CANG: Loaded 13033 existing records from primary storage. [2025-09-14T17:18:05.039427] [INFO ] [MAIN ] CANG: Loaded 13033 existing records. [2025-09-14T17:18:05.217636] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:05.217912] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-14T17:18:05.217986] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-14T17:18:05.218470] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-14T17:18:05.218547] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-14T17:18:05.372793] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-14T17:18:05.602012] [INFO ] [REMOTE ] CANG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:06.158874] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-14T17:18:06.242280] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-14T17:18:06.793508] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T17:18:06.861064] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T17:18:06.958852] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-14T17:18:07.000029] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T17:18:07.758833] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-14T17:18:08.561174] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-14T17:18:08.564285] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:18:09.110082] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T17:18:09.200209] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:18:09.205074] [INFO ] [REMOTE ] CAL: Full fetch complete (46941 records). [2025-09-14T17:18:09.205185] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-14T17:18:09.363395] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-14T17:18:09.587955] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-14T17:18:09.588089] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-14T17:18:09.588771] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-14T17:18:09.588831] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-14T17:18:09.589968] [DEBUG] [LOCAL ] CAL: Trimmed 46941 records to 32070 (keeping 150 days of data) [2025-09-14T17:18:09.787840] [DEBUG] [LOCAL ] CAL: Primary data saved (32070 records). [2025-09-14T17:18:09.788031] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-14T17:18:09.788128] [INFO ] [MAIN ] Update Progress: 391/2370 symbols completed. CAL took 23.3s. Estimated remaining: 3h 27m 21s. Rate: 9.5 symbols/min [2025-09-14T17:18:09.959939] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:09.964594] [DEBUG] [LOCAL ] CAPL: Loaded 2347 existing records from primary storage. [2025-09-14T17:18:09.964753] [INFO ] [MAIN ] CAPL: Loaded 2347 existing records. [2025-09-14T17:18:10.143918] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:10.144247] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-14T17:18:10.144309] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-14T17:18:10.144639] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-14T17:18:10.144734] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-14T17:18:10.159426] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-14T17:18:10.515888] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:10.530906] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T17:18:10.958855] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-14T17:18:11.388406] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T17:18:11.758938] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-14T17:18:12.153182] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:18:12.558830] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-14T17:18:13.315818] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:18:13.358791] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-14T17:18:13.590519] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T17:18:13.791165] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:18:13.794939] [INFO ] [REMOTE ] CALX: Full fetch complete (41877 records). [2025-09-14T17:18:13.795043] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-14T17:18:14.165767] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-14T17:18:14.168274] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-14T17:18:14.169235] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-14T17:18:14.169925] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-14T17:18:14.169990] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-14T17:18:14.171117] [DEBUG] [LOCAL ] CALX: Trimmed 41877 records to 28955 (keeping 150 days of data) [2025-09-14T17:18:14.350254] [DEBUG] [LOCAL ] CALX: Primary data saved (28955 records). [2025-09-14T17:18:14.350441] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-14T17:18:14.350544] [INFO ] [MAIN ] Update Progress: 392/2370 symbols completed. CALX took 23.4s. Estimated remaining: 3h 27m 6s. Rate: 9.6 symbols/min [2025-09-14T17:18:14.519582] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:14.542248] [DEBUG] [LOCAL ] CARR: Loaded 23996 existing records from primary storage. [2025-09-14T17:18:14.542463] [INFO ] [MAIN ] CARR: Loaded 23996 existing records. [2025-09-14T17:18:14.716736] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:14.717029] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-14T17:18:14.717107] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-14T17:18:14.717865] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-14T17:18:14.717952] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-14T17:18:14.969913] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-14T17:18:15.042210] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:18:15.097166] [INFO ] [REMOTE ] CARR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:15.758815] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-14T17:18:15.798412] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T17:18:15.803776] [INFO ] [REMOTE ] CAH: Full fetch complete (56160 records). [2025-09-14T17:18:15.803893] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-14T17:18:16.180598] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-14T17:18:16.180741] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-14T17:18:16.181476] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-14T17:18:16.181534] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-14T17:18:16.182745] [DEBUG] [LOCAL ] CAH: Trimmed 56160 records to 38710 (keeping 150 days of data) [2025-09-14T17:18:16.295544] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:18:16.441017] [DEBUG] [LOCAL ] CAH: Primary data saved (38710 records). [2025-09-14T17:18:16.441202] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-14T17:18:16.441303] [INFO ] [MAIN ] Update Progress: 393/2370 symbols completed. CAH took 31.9s. Estimated remaining: 3h 26m 39s. Rate: 9.6 symbols/min [2025-09-14T17:18:16.563998] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-14T17:18:16.615272] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:16.634150] [DEBUG] [LOCAL ] CARS: Loaded 17231 existing records from primary storage. [2025-09-14T17:18:16.634326] [INFO ] [MAIN ] CARS: Loaded 17231 existing records. [2025-09-14T17:18:16.809211] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:16.809496] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-14T17:18:16.809556] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-14T17:18:16.810109] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-14T17:18:16.810200] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-14T17:18:17.153919] [INFO ] [REMOTE ] CARS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:17.358815] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-14T17:18:18.158894] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-14T17:18:18.402539] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:18:18.462173] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T17:18:18.958843] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-14T17:18:19.402303] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T17:18:19.758862] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-14T17:18:20.565911] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-14T17:18:20.589448] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:18:21.358892] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-14T17:18:21.613218] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T17:18:22.062558] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:18:22.158793] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-14T17:18:22.445448] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:18:22.958899] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-14T17:18:23.758861] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-14T17:18:23.983190] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T17:18:24.202458] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T17:18:24.558887] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-14T17:18:25.033100] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T17:18:25.060494] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-14T17:18:25.358859] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-14T17:18:26.158899] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-14T17:18:26.768447] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:18:26.958862] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-14T17:18:27.261227] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:18:27.730728] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T17:18:27.758775] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-14T17:18:28.558905] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-14T17:18:28.745996] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T17:18:28.749611] [INFO ] [REMOTE ] CANG: Full fetch complete (29040 records). [2025-09-14T17:18:28.749717] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-14T17:18:29.116107] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-14T17:18:29.116219] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-14T17:18:29.116844] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-14T17:18:29.116908] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-14T17:18:29.117706] [DEBUG] [LOCAL ] CANG: Trimmed 29040 records to 20289 (keeping 150 days of data) [2025-09-14T17:18:29.234474] [DEBUG] [LOCAL ] CANG: Primary data saved (20289 records). [2025-09-14T17:18:29.234670] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-14T17:18:29.234770] [INFO ] [MAIN ] Update Progress: 394/2370 symbols completed. CANG took 24.4s. Estimated remaining: 3h 27m 5s. Rate: 9.5 symbols/min [2025-09-14T17:18:29.364033] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-14T17:18:29.408046] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:29.432718] [DEBUG] [LOCAL ] CAT: Loaded 23753 existing records from primary storage. [2025-09-14T17:18:29.432898] [INFO ] [MAIN ] CAT: Loaded 23753 existing records. [2025-09-14T17:18:29.608213] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:29.608456] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-14T17:18:29.608515] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-14T17:18:29.609279] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-14T17:18:29.609352] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-14T17:18:29.973219] [INFO ] [REMOTE ] CAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:30.153477] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:18:30.161544] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-14T17:18:30.168990] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:18:30.958846] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-14T17:18:31.758851] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-14T17:18:31.982858] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:18:32.172887] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:18:32.174050] [INFO ] [REMOTE ] CAPL: Full fetch complete (6397 records). [2025-09-14T17:18:32.174147] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-14T17:18:32.533985] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-14T17:18:32.534091] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-14T17:18:32.534284] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-14T17:18:32.534336] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-14T17:18:32.534775] [DEBUG] [LOCAL ] CAPL: Trimmed 6397 records to 3919 (keeping 150 days of data) [2025-09-14T17:18:32.558988] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-14T17:18:32.563145] [DEBUG] [LOCAL ] CAPL: Primary data saved (3919 records). [2025-09-14T17:18:32.563271] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-14T17:18:32.563395] [INFO ] [MAIN ] Update Progress: 395/2370 symbols completed. CAPL took 22.8s. Estimated remaining: 3h 26m 44s. Rate: 9.6 symbols/min [2025-09-14T17:18:32.740245] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:32.746946] [DEBUG] [LOCAL ] CATO: Loaded 3374 existing records from primary storage. [2025-09-14T17:18:32.747063] [INFO ] [MAIN ] CATO: Loaded 3374 existing records. [2025-09-14T17:18:32.927003] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:32.927528] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-14T17:18:32.927593] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-14T17:18:32.927892] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-14T17:18:32.927951] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-14T17:18:33.061621] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T17:18:33.325685] [INFO ] [REMOTE ] CATO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:33.358798] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-14T17:18:34.158874] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-14T17:18:34.531574] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:18:34.723630] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T17:18:34.900496] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T17:18:34.958798] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-14T17:18:35.758817] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-14T17:18:36.558857] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-14T17:18:36.849020] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T17:18:37.361046] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-14T17:18:37.380682] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T17:18:37.451336] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:18:38.042021] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:18:38.050045] [INFO ] [REMOTE ] CARR: Full fetch complete (58279 records). [2025-09-14T17:18:38.050309] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-14T17:18:38.164007] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-14T17:18:38.437102] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-14T17:18:38.437226] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-14T17:18:38.438010] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-14T17:18:38.438083] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-14T17:18:38.439777] [DEBUG] [LOCAL ] CARR: Trimmed 58279 records to 40349 (keeping 150 days of data) [2025-09-14T17:18:38.702303] [DEBUG] [LOCAL ] CARR: Primary data saved (40349 records). [2025-09-14T17:18:38.702491] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-14T17:18:38.702753] [INFO ] [MAIN ] Update Progress: 396/2370 symbols completed. CARR took 24.4s. Estimated remaining: 3h 26m 37s. Rate: 9.6 symbols/min [2025-09-14T17:18:38.874702] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:38.898792] [DEBUG] [LOCAL ] CAVA: Loaded 24047 existing records from primary storage. [2025-09-14T17:18:38.898987] [INFO ] [MAIN ] CAVA: Loaded 24047 existing records. [2025-09-14T17:18:38.961762] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-14T17:18:39.024638] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T17:18:39.139420] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:39.139754] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-14T17:18:39.139846] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-14T17:18:39.140520] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-14T17:18:39.140585] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-14T17:18:39.513750] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:39.758899] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-14T17:18:40.151457] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T17:18:40.429725] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T17:18:40.558853] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-14T17:18:41.019109] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:18:41.358862] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-14T17:18:42.043060] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T17:18:42.158839] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-14T17:18:42.822285] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T17:18:42.958790] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-14T17:18:43.511611] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:18:43.515677] [INFO ] [REMOTE ] CARS: Full fetch complete (43455 records). [2025-09-14T17:18:43.515806] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-14T17:18:43.763952] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-14T17:18:43.898341] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-14T17:18:43.898463] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-14T17:18:43.899090] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-14T17:18:43.899148] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-14T17:18:43.900180] [DEBUG] [LOCAL ] CARS: Trimmed 43455 records to 29560 (keeping 150 days of data) [2025-09-14T17:18:44.081158] [DEBUG] [LOCAL ] CARS: Primary data saved (29560 records). [2025-09-14T17:18:44.081324] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-14T17:18:44.081431] [INFO ] [MAIN ] Update Progress: 397/2370 symbols completed. CARS took 27.6s. Estimated remaining: 3h 26m 27s. Rate: 9.6 symbols/min [2025-09-14T17:18:44.558880] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-14T17:18:44.573833] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:18:44.575576] [INFO ] [REMOTE ] CATO: Full fetch complete (8228 records). [2025-09-14T17:18:44.575685] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-14T17:18:44.931669] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-14T17:18:44.931801] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-14T17:18:44.932058] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-14T17:18:44.932114] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-14T17:18:44.932563] [DEBUG] [LOCAL ] CATO: Trimmed 8228 records to 5126 (keeping 150 days of data) [2025-09-14T17:18:44.962471] [DEBUG] [LOCAL ] CATO: Primary data saved (5126 records). [2025-09-14T17:18:44.962588] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-14T17:18:44.962698] [INFO ] [MAIN ] Update Progress: 398/2370 symbols completed. CATO took 12.4s. Estimated remaining: 3h 25m 54s. Rate: 9.6 symbols/min [2025-09-14T17:18:45.358849] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-14T17:18:46.726398] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T17:18:46.737997] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-14T17:18:47.531577] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-14T17:18:47.542059] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-14T17:18:49.014982] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T17:18:49.026531] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-14T17:18:49.385796] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:18:49.397286] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-14T17:18:51.140948] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-14T17:18:51.153314] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-14T17:18:51.211535] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T17:18:51.223717] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-14T17:18:53.175221] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:18:53.187671] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-14T17:18:53.256807] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:18:53.269046] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-14T17:18:55.255434] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:18:55.269103] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-14T17:18:55.325431] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-14T17:18:55.337088] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-14T17:18:55.951467] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:18:55.957312] [INFO ] [REMOTE ] CAT: Full fetch complete (57582 records). [2025-09-14T17:18:55.957490] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-14T17:18:56.365880] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-14T17:18:56.366034] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-14T17:18:56.367033] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-14T17:18:56.367103] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-14T17:18:56.369174] [DEBUG] [LOCAL ] CAT: Trimmed 57582 records to 39807 (keeping 150 days of data) [2025-09-14T17:18:56.638475] [DEBUG] [LOCAL ] CAT: Primary data saved (39807 records). [2025-09-14T17:18:56.638739] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-14T17:18:56.638867] [INFO ] [MAIN ] Update Progress: 399/2370 symbols completed. CAT took 27.4s. Estimated remaining: 3h 26m 14s. Rate: 9.6 symbols/min [2025-09-14T17:18:57.236658] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:18:57.249508] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-14T17:18:59.490627] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-14T17:18:59.502575] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-14T17:18:59.824211] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:18:59.829836] [INFO ] [REMOTE ] CAVA: Full fetch complete (58176 records). [2025-09-14T17:18:59.829976] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-14T17:19:00.237198] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-14T17:19:00.237319] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-14T17:19:00.238123] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-14T17:19:00.238186] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-14T17:19:00.239532] [DEBUG] [LOCAL ] CAVA: Trimmed 58176 records to 40321 (keeping 150 days of data) [2025-09-14T17:19:00.487591] [DEBUG] [LOCAL ] CAVA: Primary data saved (40321 records). [2025-09-14T17:19:00.487782] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-14T17:19:00.487882] [INFO ] [MAIN ] Update Progress: 400/2370 symbols completed. CAVA took 21.8s. Estimated remaining: 3h 25m 56s. Rate: 9.6 symbols/min [2025-09-14T17:19:01.127037] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:01.085827] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:01.129231] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:01.173561] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:01.182324] [DEBUG] [LOCAL ] CBNA: Loaded 1432 existing records from primary storage. [2025-09-14T17:19:01.184783] [DEBUG] [LOCAL ] CBAN: Loaded 4216 existing records from primary storage. [2025-09-14T17:19:01.185467] [INFO ] [MAIN ] CBAN: Loaded 4216 existing records. [2025-09-14T17:19:01.185339] [INFO ] [MAIN ] CBNA: Loaded 1432 existing records. [2025-09-14T17:19:01.216418] [DEBUG] [LOCAL ] CBL: Loaded 7540 existing records from primary storage. [2025-09-14T17:19:01.272062] [INFO ] [MAIN ] CBL: Loaded 7540 existing records. [2025-09-14T17:19:01.596104] [DEBUG] [LOCAL ] CB: Loaded 22320 existing records from primary storage. [2025-09-14T17:19:01.669597] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:01.687278] [INFO ] [MAIN ] CB: Loaded 22320 existing records. [2025-09-14T17:19:01.704512] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:01.705811] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-14T17:19:01.805147] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:01.705961] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-14T17:19:01.833515] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-14T17:19:01.817508] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-14T17:19:01.871279] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-14T17:19:01.881922] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-14T17:19:01.860340] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-14T17:19:01.887450] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-14T17:19:01.897931] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-14T17:19:01.917181] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-14T17:19:01.996574] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-14T17:19:02.094908] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-14T17:19:02.201059] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:02.350170] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-14T17:19:02.490798] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-14T17:19:02.552629] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-14T17:19:02.687612] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-14T17:19:03.050979] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:03.114689] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-14T17:19:03.195304] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:03.213688] [INFO ] [REMOTE ] CBL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:03.215153] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-14T17:19:03.214897] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-14T17:19:03.470296] [INFO ] [REMOTE ] CB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:03.470694] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-14T17:19:03.644767] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T17:19:03.646261] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-14T17:19:03.935575] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T17:19:03.938767] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-14T17:19:04.152715] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T17:19:04.154000] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-14T17:19:04.382455] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T17:19:04.387439] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-14T17:19:04.599813] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T17:19:04.603591] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-14T17:19:04.679427] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T17:19:04.680919] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-14T17:19:05.022189] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T17:19:05.031856] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-14T17:19:05.339466] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T17:19:05.341140] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-14T17:19:05.426538] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:19:05.430057] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-14T17:19:05.532987] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T17:19:05.732677] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-14T17:19:06.101210] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T17:19:06.158875] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-14T17:19:06.575813] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:19:06.958832] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-14T17:19:07.004367] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T17:19:07.758812] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-14T17:19:08.023264] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T17:19:08.094357] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-14T17:19:08.558823] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-14T17:19:09.358805] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-14T17:19:09.643971] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T17:19:09.792042] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T17:19:10.158886] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-14T17:19:10.664791] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:19:10.665857] [INFO ] [REMOTE ] CBNA: Full fetch complete (3235 records). [2025-09-14T17:19:10.665958] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-14T17:19:10.963928] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-14T17:19:11.029076] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-14T17:19:11.029178] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-14T17:19:11.029315] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-14T17:19:11.029365] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-14T17:19:11.029767] [DEBUG] [LOCAL ] CBNA: Trimmed 3235 records to 2374 (keeping 150 days of data) [2025-09-14T17:19:11.044199] [DEBUG] [LOCAL ] CBNA: Primary data saved (2374 records). [2025-09-14T17:19:11.044286] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-14T17:19:11.044381] [INFO ] [MAIN ] Update Progress: 401/2370 symbols completed. CBNA took 10.6s. Estimated remaining: 3h 26m 11s. Rate: 9.6 symbols/min [2025-09-14T17:19:11.212983] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:11.213237] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-14T17:19:11.213293] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-14T17:19:11.213410] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-14T17:19:11.213460] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-14T17:19:11.213510] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-14T17:19:11.213553] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-14T17:19:11.563060] [INFO ] [REMOTE ] CBO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:11.758832] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-14T17:19:12.558835] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-14T17:19:12.754929] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T17:19:12.794186] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:12.794535] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-14T17:19:13.296217] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T17:19:13.358826] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-14T17:19:14.158857] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-14T17:19:14.958856] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-14T17:19:15.005974] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T17:19:15.084531] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:19:15.715621] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T17:19:15.758788] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-14T17:19:16.558848] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-14T17:19:16.582796] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:19:17.358859] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-14T17:19:17.422810] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T17:19:17.572051] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-09-14T17:19:18.158831] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-14T17:19:18.697088] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:19:18.698452] [INFO ] [REMOTE ] CBAN: Full fetch complete (12355 records). [2025-09-14T17:19:18.698535] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-14T17:19:18.963894] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-14T17:19:19.065917] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-14T17:19:19.066103] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-14T17:19:19.066440] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-14T17:19:19.066492] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-14T17:19:19.067048] [DEBUG] [LOCAL ] CBAN: Trimmed 12355 records to 7543 (keeping 150 days of data) [2025-09-14T17:19:19.114076] [DEBUG] [LOCAL ] CBAN: Primary data saved (7543 records). [2025-09-14T17:19:19.114227] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-14T17:19:19.114340] [INFO ] [MAIN ] Update Progress: 402/2370 symbols completed. CBAN took 18.6s. Estimated remaining: 3h 26m 13s. Rate: 9.5 symbols/min [2025-09-14T17:19:19.282363] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:19.306507] [DEBUG] [LOCAL ] CBRE: Loaded 22180 existing records from primary storage. [2025-09-14T17:19:19.306708] [INFO ] [MAIN ] CBRE: Loaded 22180 existing records. [2025-09-14T17:19:19.480916] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:19.481190] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-14T17:19:19.481254] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-14T17:19:19.481927] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-14T17:19:19.481990] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-14T17:19:19.764019] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-14T17:19:19.837939] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:20.558841] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-14T17:19:20.601853] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:19:20.619215] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T17:19:20.621673] [INFO ] [REMOTE ] CBL: Full fetch complete (18616 records). [2025-09-14T17:19:20.621841] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-14T17:19:21.022814] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-14T17:19:21.022984] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-14T17:19:21.023392] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-14T17:19:21.023446] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-14T17:19:21.024031] [DEBUG] [LOCAL ] CBL: Trimmed 18616 records to 12055 (keeping 150 days of data) [2025-09-14T17:19:21.096665] [DEBUG] [LOCAL ] CBL: Primary data saved (12055 records). [2025-09-14T17:19:21.096830] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-14T17:19:21.096931] [INFO ] [MAIN ] Update Progress: 403/2370 symbols completed. CBL took 20.6s. Estimated remaining: 3h 25m 46s. Rate: 9.6 symbols/min [2025-09-14T17:19:21.272936] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:21.289583] [DEBUG] [LOCAL ] CBT: Loaded 13086 existing records from primary storage. [2025-09-14T17:19:21.289800] [INFO ] [MAIN ] CBT: Loaded 13086 existing records. [2025-09-14T17:19:21.364132] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-14T17:19:21.472549] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:21.472883] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-14T17:19:21.472950] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-14T17:19:21.473447] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-14T17:19:21.473507] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-14T17:19:21.730609] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-14T17:19:21.840938] [INFO ] [REMOTE ] CBT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:22.158820] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-14T17:19:22.217570] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:19:22.424871] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-14T17:19:22.958859] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-14T17:19:23.758861] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-14T17:19:23.974946] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-14T17:19:24.558831] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-14T17:19:24.683830] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:19:25.358827] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-14T17:19:25.870502] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:19:26.158827] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-14T17:19:26.370290] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-14T17:19:26.958831] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-14T17:19:27.425011] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T17:19:27.758839] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-14T17:19:28.558909] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-14T17:19:28.904400] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T17:19:29.236709] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T17:19:29.358909] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-14T17:19:29.665891] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:19:29.674519] [INFO ] [REMOTE ] CB: Full fetch complete (54330 records). [2025-09-14T17:19:29.674833] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-14T17:19:30.158312] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-14T17:19:30.158573] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-14T17:19:30.159689] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-14T17:19:30.160104] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-14T17:19:30.159807] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-14T17:19:30.162927] [DEBUG] [LOCAL ] CB: Trimmed 54330 records to 37384 (keeping 150 days of data) [2025-09-14T17:19:30.283138] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:19:30.442198] [DEBUG] [LOCAL ] CB: Primary data saved (37384 records). [2025-09-14T17:19:30.442422] [INFO ] [MAIN ] CB: Full history saved. [2025-09-14T17:19:30.442534] [INFO ] [MAIN ] Update Progress: 404/2370 symbols completed. CB took 30.0s. Estimated remaining: 3h 25m 54s. Rate: 9.5 symbols/min [2025-09-14T17:19:30.624066] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:30.636323] [DEBUG] [LOCAL ] CBU: Loaded 10583 existing records from primary storage. [2025-09-14T17:19:30.636496] [INFO ] [MAIN ] CBU: Loaded 10583 existing records. [2025-09-14T17:19:30.818742] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:30.819028] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-14T17:19:30.819089] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-14T17:19:30.819547] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-14T17:19:30.819608] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-14T17:19:30.963885] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-14T17:19:31.178284] [INFO ] [REMOTE ] CBU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:31.758891] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-14T17:19:31.981680] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:31.982063] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-14T17:19:32.107060] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:19:32.192157] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:19:32.558844] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-14T17:19:33.358849] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-14T17:19:34.158827] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-14T17:19:34.333480] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T17:19:34.389333] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:34.389852] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-14T17:19:34.389957] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-14T17:19:34.390057] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-14T17:19:34.391063] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:19:34.391140] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:19:34.391188] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:19:34.391239] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-14T17:19:34.391321] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-14T17:19:34.391378] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-14T17:19:34.391617] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-14T17:19:34.392090] [INFO ] [MAIN ] Update Progress: 405/2370 symbols completed. CBO took 23.3s. Estimated remaining: 3h 25m 37s. Rate: 9.6 symbols/min [2025-09-14T17:19:34.569040] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:34.569321] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-14T17:19:34.569397] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-14T17:19:34.569553] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-14T17:19:34.569626] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-14T17:19:34.569731] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-14T17:19:34.569800] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-14T17:19:34.941601] [INFO ] [REMOTE ] CBX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:34.963716] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-14T17:19:34.967834] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:19:35.758853] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-14T17:19:36.516045] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T17:19:36.558870] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-14T17:19:36.813180] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T17:19:37.358840] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-14T17:19:38.158855] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-14T17:19:38.393352] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:19:38.426886] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:19:38.958872] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-14T17:19:39.373467] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T17:19:39.758917] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-14T17:19:40.286593] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T17:19:40.558860] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-14T17:19:40.767830] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:40.768225] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-14T17:19:40.990588] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:19:41.358922] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-14T17:19:42.158880] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-14T17:19:42.780242] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T17:19:42.958837] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-14T17:19:43.190490] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:43.190910] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-14T17:19:43.391798] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:19:43.758840] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-14T17:19:44.558811] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-14T17:19:44.797136] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T17:19:45.057319] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:19:45.061089] [INFO ] [REMOTE ] CBT: Full fetch complete (34533 records). [2025-09-14T17:19:45.061233] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-14T17:19:45.363968] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-14T17:19:45.439962] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-14T17:19:45.440093] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-14T17:19:45.440764] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-14T17:19:45.440841] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-14T17:19:45.442481] [DEBUG] [LOCAL ] CBT: Trimmed 34533 records to 23085 (keeping 150 days of data) [2025-09-14T17:19:45.587132] [DEBUG] [LOCAL ] CBT: Primary data saved (23085 records). [2025-09-14T17:19:45.587316] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-14T17:19:45.587448] [INFO ] [MAIN ] Update Progress: 406/2370 symbols completed. CBT took 24.5s. Estimated remaining: 3h 25m 54s. Rate: 9.5 symbols/min [2025-09-14T17:19:45.667922] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:45.689326] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-14T17:19:45.759064] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:45.776868] [DEBUG] [LOCAL ] CBZ: Loaded 15564 existing records from primary storage. [2025-09-14T17:19:45.777047] [INFO ] [MAIN ] CBZ: Loaded 15564 existing records. [2025-09-14T17:19:45.959715] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:45.960061] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-14T17:19:45.960127] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-14T17:19:45.960713] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-14T17:19:45.960775] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-14T17:19:46.166441] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-14T17:19:46.336185] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:46.910627] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:19:46.915896] [INFO ] [REMOTE ] CBRE: Full fetch complete (55247 records). [2025-09-14T17:19:46.916035] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-14T17:19:46.963905] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-14T17:19:47.338752] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-14T17:19:47.338867] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-14T17:19:47.339540] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-14T17:19:47.339595] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-14T17:19:47.341078] [DEBUG] [LOCAL ] CBRE: Trimmed 55247 records to 37804 (keeping 150 days of data) [2025-09-14T17:19:47.575112] [DEBUG] [LOCAL ] CBRE: Primary data saved (37804 records). [2025-09-14T17:19:47.575297] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-14T17:19:47.575409] [INFO ] [MAIN ] Update Progress: 407/2370 symbols completed. CBRE took 28.5s. Estimated remaining: 3h 25m 27s. Rate: 9.6 symbols/min [2025-09-14T17:19:47.759824] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:47.758881] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-14T17:19:47.761425] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T17:19:47.789060] [DEBUG] [LOCAL ] CC: Loaded 23788 existing records from primary storage. [2025-09-14T17:19:47.789300] [INFO ] [MAIN ] CC: Loaded 23788 existing records. [2025-09-14T17:19:47.968626] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:47.968938] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-14T17:19:47.968999] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-14T17:19:47.969693] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-14T17:19:47.969757] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-14T17:19:48.326495] [INFO ] [REMOTE ] CC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:48.558854] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-14T17:19:48.770508] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-09-14T17:19:49.066097] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:19:49.358846] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-14T17:19:50.158857] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-14T17:19:50.882777] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:19:50.958885] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-14T17:19:51.375522] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T17:19:51.758874] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-14T17:19:51.981676] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-14T17:19:52.117067] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T17:19:52.558843] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-14T17:19:53.358838] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-14T17:19:54.158946] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-14T17:19:54.409800] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:54.410196] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-14T17:19:54.454828] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:19:54.719149] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T17:19:54.958901] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-14T17:19:55.204583] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:55.205036] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-14T17:19:55.205138] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-14T17:19:55.205224] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-14T17:19:55.206000] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:19:55.206082] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:19:55.206138] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:19:55.206196] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-14T17:19:55.206280] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-14T17:19:55.206337] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-14T17:19:55.206401] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-14T17:19:55.206489] [INFO ] [MAIN ] Update Progress: 408/2370 symbols completed. CBX took 20.8s. Estimated remaining: 3h 25m 28s. Rate: 9.5 symbols/min [2025-09-14T17:19:55.381069] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:55.404328] [DEBUG] [LOCAL ] CCI: Loaded 23854 existing records from primary storage. [2025-09-14T17:19:55.404510] [INFO ] [MAIN ] CCI: Loaded 23854 existing records. [2025-09-14T17:19:55.580509] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:55.580811] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-14T17:19:55.580876] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-14T17:19:55.581547] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-14T17:19:55.581610] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-14T17:19:55.766468] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-14T17:19:55.935628] [INFO ] [REMOTE ] CCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:56.558838] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-14T17:19:57.358885] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-14T17:19:57.686716] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:19:57.719994] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T17:19:57.722463] [INFO ] [REMOTE ] CBU: Full fetch complete (24325 records). [2025-09-14T17:19:57.722567] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-14T17:19:58.096828] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-14T17:19:58.097015] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-14T17:19:58.097573] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-14T17:19:58.097725] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-14T17:19:58.106130] [DEBUG] [LOCAL ] CBU: Trimmed 24325 records to 16496 (keeping 150 days of data) [2025-09-14T17:19:58.119887] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:19:58.173304] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-14T17:19:58.237692] [DEBUG] [LOCAL ] CBU: Primary data saved (16496 records). [2025-09-14T17:19:58.237906] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-14T17:19:58.238103] [INFO ] [MAIN ] Update Progress: 409/2370 symbols completed. CBU took 27.8s. Estimated remaining: 3h 25m 6s. Rate: 9.6 symbols/min [2025-09-14T17:19:58.406985] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:58.409425] [DEBUG] [LOCAL ] CCIA: Loaded 657 existing records from primary storage. [2025-09-14T17:19:58.409515] [INFO ] [MAIN ] CCIA: Loaded 657 existing records. [2025-09-14T17:19:58.583073] [WARN ] [MAIN ] CCIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:58.583345] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-14T17:19:58.583406] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-14T17:19:58.583630] [DEBUG] [LOCAL ] CCIA: Deleted primary data file. [2025-09-14T17:19:58.583712] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-14T17:19:58.932842] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:58.958855] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-14T17:19:59.276010] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-14T17:19:59.758839] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-14T17:19:59.922484] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T17:20:00.558861] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-14T17:20:00.721129] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T17:20:01.358931] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-14T17:20:02.131802] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T17:20:02.158885] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-14T17:20:02.351313] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T17:20:02.958889] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-14T17:20:03.507918] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:20:03.758920] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-14T17:20:04.558838] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-14T17:20:04.775991] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T17:20:04.961214] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-14T17:20:05.324834] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T17:20:05.358854] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-14T17:20:06.158876] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-14T17:20:06.958860] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-14T17:20:07.282354] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:20:07.693438] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:20:07.758802] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-14T17:20:08.558840] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-14T17:20:08.811873] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T17:20:08.844151] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:20:08.932034] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T17:20:09.358848] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-14T17:20:10.158879] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-14T17:20:10.572044] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T17:20:10.576398] [INFO ] [REMOTE ] CBZ: Full fetch complete (35281 records). [2025-09-14T17:20:10.576493] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-14T17:20:10.956331] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-14T17:20:10.956470] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-14T17:20:10.957063] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-14T17:20:10.957128] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-14T17:20:10.958337] [DEBUG] [LOCAL ] CBZ: Trimmed 35281 records to 25154 (keeping 150 days of data) [2025-09-14T17:20:10.958879] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-14T17:20:11.112211] [DEBUG] [LOCAL ] CBZ: Primary data saved (25154 records). [2025-09-14T17:20:11.112405] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-14T17:20:11.112517] [INFO ] [MAIN ] Update Progress: 410/2370 symbols completed. CBZ took 25.5s. Estimated remaining: 3h 25m 31s. Rate: 9.5 symbols/min [2025-09-14T17:20:11.280447] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:11.289132] [DEBUG] [LOCAL ] CCIF: Loaded 6974 existing records from primary storage. [2025-09-14T17:20:11.289279] [INFO ] [MAIN ] CCIF: Loaded 6974 existing records. [2025-09-14T17:20:11.450615] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T17:20:11.469594] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:11.470709] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-14T17:20:11.470783] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-14T17:20:11.471156] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-14T17:20:11.471216] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-14T17:20:11.763987] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-14T17:20:11.825934] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:12.033577] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:20:12.246665] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T17:20:12.558826] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-14T17:20:13.058780] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T17:20:13.358904] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-14T17:20:14.158882] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-14T17:20:14.958880] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-14T17:20:15.187899] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T17:20:15.232527] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:20:15.345704] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:20:15.346518] [INFO ] [REMOTE ] CCIA: Full fetch complete (1539 records). [2025-09-14T17:20:15.346602] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-14T17:20:15.521223] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T17:20:15.521454] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:20:15.521505] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:20:15.521545] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-14T17:20:15.521611] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-14T17:20:15.521677] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-14T17:20:15.521742] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-14T17:20:15.521835] [INFO ] [MAIN ] Update Progress: 411/2370 symbols completed. CCIA took 17.3s. Estimated remaining: 3h 25m 16s. Rate: 9.5 symbols/min [2025-09-14T17:20:15.701364] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:15.727220] [DEBUG] [LOCAL ] CCJ: Loaded 24128 existing records from primary storage. [2025-09-14T17:20:15.727445] [INFO ] [MAIN ] CCJ: Loaded 24128 existing records. [2025-09-14T17:20:15.764026] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-14T17:20:15.920499] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:15.920878] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-14T17:20:15.920972] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-14T17:20:15.921728] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-14T17:20:15.921807] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-14T17:20:16.293992] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:16.558864] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-14T17:20:16.899913] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:20:17.358860] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-14T17:20:17.994915] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:20:18.000548] [INFO ] [REMOTE ] CC: Full fetch complete (57481 records). [2025-09-14T17:20:18.000711] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-14T17:20:18.158928] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-14T17:20:18.386829] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-14T17:20:18.387001] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-14T17:20:18.387942] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-14T17:20:18.388037] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-14T17:20:18.389606] [DEBUG] [LOCAL ] CC: Trimmed 57481 records to 39907 (keeping 150 days of data) [2025-09-14T17:20:18.528451] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T17:20:18.687882] [DEBUG] [LOCAL ] CC: Primary data saved (39907 records). [2025-09-14T17:20:18.688089] [INFO ] [MAIN ] CC: Full history saved. [2025-09-14T17:20:18.688208] [INFO ] [MAIN ] Update Progress: 412/2370 symbols completed. CC took 31.1s. Estimated remaining: 3h 24m 55s. Rate: 9.6 symbols/min [2025-09-14T17:20:18.877425] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:18.900972] [DEBUG] [LOCAL ] CCK: Loaded 20570 existing records from primary storage. [2025-09-14T17:20:18.901207] [INFO ] [MAIN ] CCK: Loaded 20570 existing records. [2025-09-14T17:20:18.965242] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-14T17:20:19.085801] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:19.086122] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-14T17:20:19.086198] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-14T17:20:19.086834] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-14T17:20:19.086901] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-14T17:20:19.439998] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T17:20:19.459059] [INFO ] [REMOTE ] CCK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:19.758869] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-14T17:20:20.558804] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-14T17:20:20.708228] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:20:20.855694] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T17:20:21.358910] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-14T17:20:22.158904] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-14T17:20:22.277404] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T17:20:22.344415] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T17:20:22.958833] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-14T17:20:23.758908] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-14T17:20:23.978258] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T17:20:24.145948] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T17:20:24.558861] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-14T17:20:25.358890] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-14T17:20:25.475278] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:20:25.722814] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:20:26.158887] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-14T17:20:26.958819] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-14T17:20:27.025188] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:20:27.042307] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:20:27.044399] [INFO ] [REMOTE ] CCIF: Full fetch complete (16575 records). [2025-09-14T17:20:27.044486] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-14T17:20:27.407860] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-14T17:20:27.407985] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-14T17:20:27.408462] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-14T17:20:27.408526] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-14T17:20:27.409120] [DEBUG] [LOCAL ] CCIF: Trimmed 16575 records to 11453 (keeping 150 days of data) [2025-09-14T17:20:27.477891] [DEBUG] [LOCAL ] CCIF: Primary data saved (11453 records). [2025-09-14T17:20:27.478051] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-14T17:20:27.478166] [INFO ] [MAIN ] Update Progress: 413/2370 symbols completed. CCIF took 16.4s. Estimated remaining: 3h 25m 0s. Rate: 9.5 symbols/min [2025-09-14T17:20:27.646361] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:27.669913] [DEBUG] [LOCAL ] CCL: Loaded 24211 existing records from primary storage. [2025-09-14T17:20:27.670133] [INFO ] [MAIN ] CCL: Loaded 24211 existing records. [2025-09-14T17:20:27.766629] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-14T17:20:27.848290] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:27.848552] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-14T17:20:27.848613] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-14T17:20:27.849296] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-14T17:20:27.849363] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-14T17:20:28.207425] [INFO ] [REMOTE ] CCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:28.286300] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:20:28.292573] [INFO ] [REMOTE ] CCI: Full fetch complete (57789 records). [2025-09-14T17:20:28.292830] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-14T17:20:28.561196] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-14T17:20:28.673561] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-14T17:20:28.673733] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-14T17:20:28.674509] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-14T17:20:28.674605] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-14T17:20:28.678031] [DEBUG] [LOCAL ] CCI: Trimmed 57789 records to 39942 (keeping 150 days of data) [2025-09-14T17:20:28.797497] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:20:28.959528] [DEBUG] [LOCAL ] CCI: Primary data saved (39942 records). [2025-09-14T17:20:28.959761] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-14T17:20:28.959907] [INFO ] [MAIN ] Update Progress: 414/2370 symbols completed. CCI took 33.8s. Estimated remaining: 3h 24m 31s. Rate: 9.6 symbols/min [2025-09-14T17:20:29.127744] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:29.149519] [DEBUG] [LOCAL ] CCO: Loaded 21598 existing records from primary storage. [2025-09-14T17:20:29.149728] [INFO ] [MAIN ] CCO: Loaded 21598 existing records. [2025-09-14T17:20:29.330765] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:29.331279] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-14T17:20:29.331353] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-14T17:20:29.331985] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-14T17:20:29.332057] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-14T17:20:29.363896] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-14T17:20:29.697354] [INFO ] [REMOTE ] CCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:30.158833] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-14T17:20:30.949432] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-14T17:20:30.959346] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-14T17:20:31.534537] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T17:20:31.586760] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T17:20:31.758848] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-14T17:20:32.558882] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-14T17:20:32.775471] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T17:20:33.358844] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-14T17:20:33.889170] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:20:33.935884] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T17:20:34.158829] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-14T17:20:34.953913] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:20:34.964037] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-14T17:20:35.472132] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T17:20:35.758877] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-14T17:20:36.558849] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-14T17:20:37.172827] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T17:20:37.358807] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-14T17:20:38.086043] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-14T17:20:38.158790] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-14T17:20:38.231358] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T17:20:38.958847] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-14T17:20:39.693891] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T17:20:39.758808] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-14T17:20:40.291449] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-14T17:20:40.330596] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:20:40.558826] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-14T17:20:41.358898] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-14T17:20:42.159383] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-14T17:20:42.162442] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T17:20:42.258452] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-14T17:20:42.924505] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:20:42.958793] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-14T17:20:43.758853] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-14T17:20:44.173343] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:20:44.178959] [INFO ] [REMOTE ] CCK: Full fetch complete (50777 records). [2025-09-14T17:20:44.179116] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-14T17:20:44.564933] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-14T17:20:44.592946] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-14T17:20:44.593962] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-14T17:20:44.597925] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-14T17:20:44.598293] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-14T17:20:44.601010] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-14T17:20:44.637257] [DEBUG] [LOCAL ] CCK: Trimmed 50777 records to 34738 (keeping 150 days of data) [2025-09-14T17:20:44.643750] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T17:20:44.877031] [DEBUG] [LOCAL ] CCK: Primary data saved (34738 records). [2025-09-14T17:20:44.877220] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-14T17:20:44.877349] [INFO ] [MAIN ] Update Progress: 415/2370 symbols completed. CCK took 26.2s. Estimated remaining: 3h 25m 10s. Rate: 9.5 symbols/min [2025-09-14T17:20:45.049370] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:45.057213] [DEBUG] [LOCAL ] CCRD: Loaded 5568 existing records from primary storage. [2025-09-14T17:20:45.057338] [INFO ] [MAIN ] CCRD: Loaded 5568 existing records. [2025-09-14T17:20:45.232443] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:45.232742] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-14T17:20:45.232810] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-14T17:20:45.233127] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-14T17:20:45.233187] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-14T17:20:45.371748] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-14T17:20:45.596515] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:46.158910] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-14T17:20:46.959313] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-14T17:20:46.965205] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-14T17:20:47.153705] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T17:20:47.627731] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T17:20:47.758830] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-14T17:20:47.818372] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T17:20:47.824733] [INFO ] [REMOTE ] CCJ: Full fetch complete (58354 records). [2025-09-14T17:20:47.824866] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-14T17:20:48.201066] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-14T17:20:48.201228] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-14T17:20:48.201971] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-14T17:20:48.202034] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-14T17:20:48.203415] [DEBUG] [LOCAL ] CCJ: Trimmed 58354 records to 40437 (keeping 150 days of data) [2025-09-14T17:20:48.450256] [DEBUG] [LOCAL ] CCJ: Primary data saved (40437 records). [2025-09-14T17:20:48.450428] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-14T17:20:48.450538] [INFO ] [MAIN ] Update Progress: 416/2370 symbols completed. CCJ took 32.9s. Estimated remaining: 3h 24m 51s. Rate: 9.5 symbols/min [2025-09-14T17:20:48.558042] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T17:20:48.560766] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-14T17:20:48.639986] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:48.655511] [DEBUG] [LOCAL ] CCS: Loaded 13141 existing records from primary storage. [2025-09-14T17:20:48.655703] [INFO ] [MAIN ] CCS: Loaded 13141 existing records. [2025-09-14T17:20:48.830064] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:48.830374] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-14T17:20:48.830435] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-14T17:20:48.830932] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-14T17:20:48.830995] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-14T17:20:49.221055] [INFO ] [REMOTE ] CCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:49.358833] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-14T17:20:50.158889] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-14T17:20:50.748867] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:20:50.937313] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T17:20:50.958879] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-14T17:20:51.235227] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-14T17:20:51.758883] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-14T17:20:52.481590] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:20:52.558851] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-14T17:20:52.593840] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T17:20:53.358854] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-14T17:20:54.027043] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:20:54.158882] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-14T17:20:54.244175] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T17:20:54.958836] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-14T17:20:55.495567] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T17:20:55.500717] [INFO ] [REMOTE ] CCO: Full fetch complete (50930 records). [2025-09-14T17:20:55.500878] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-14T17:20:55.763959] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-14T17:20:55.879423] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-14T17:20:55.879540] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-14T17:20:55.880224] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-14T17:20:55.880282] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-14T17:20:55.881358] [DEBUG] [LOCAL ] CCO: Trimmed 50930 records to 36522 (keeping 150 days of data) [2025-09-14T17:20:56.089901] [DEBUG] [LOCAL ] CCO: Primary data saved (36522 records). [2025-09-14T17:20:56.090103] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-14T17:20:56.090204] [INFO ] [MAIN ] Update Progress: 417/2370 symbols completed. CCO took 27.1s. Estimated remaining: 3h 24m 51s. Rate: 9.5 symbols/min [2025-09-14T17:20:56.262076] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:56.273197] [DEBUG] [LOCAL ] CCU: Loaded 9467 existing records from primary storage. [2025-09-14T17:20:56.273399] [INFO ] [MAIN ] CCU: Loaded 9467 existing records. [2025-09-14T17:20:56.447628] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:56.447935] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-14T17:20:56.447997] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-14T17:20:56.448427] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-14T17:20:56.448489] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-14T17:20:56.563974] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-14T17:20:56.799418] [INFO ] [REMOTE ] CCU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:57.297341] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T17:20:57.366214] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-14T17:20:57.388636] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-14T17:20:57.651733] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T17:20:58.158845] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-14T17:20:58.508787] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T17:20:58.956033] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T17:20:58.960391] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-14T17:20:59.758889] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-14T17:21:00.060527] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T17:21:00.558829] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-14T17:21:00.938963] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T17:21:00.944669] [INFO ] [REMOTE ] CCL: Full fetch complete (58480 records). [2025-09-14T17:21:00.944844] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-14T17:21:01.325758] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-14T17:21:01.325966] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-14T17:21:01.326751] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-14T17:21:01.326888] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-14T17:21:01.344298] [DEBUG] [LOCAL ] CCL: Trimmed 58480 records to 40540 (keeping 150 days of data) [2025-09-14T17:21:01.344194] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:21:01.358789] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-14T17:21:01.607514] [DEBUG] [LOCAL ] CCL: Primary data saved (40540 records). [2025-09-14T17:21:01.607893] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-14T17:21:01.608028] [INFO ] [MAIN ] Update Progress: 418/2370 symbols completed. CCL took 34.1s. Estimated remaining: 3h 24m 41s. Rate: 9.5 symbols/min [2025-09-14T17:21:01.780112] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:01.780371] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-14T17:21:01.780436] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-14T17:21:01.780617] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-14T17:21:01.780903] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-14T17:21:01.780999] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-14T17:21:01.781077] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-14T17:21:02.140029] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:02.158801] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-14T17:21:02.958847] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-14T17:21:03.019357] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T17:21:03.758830] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-14T17:21:03.981487] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-14T17:21:04.187489] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:21:04.359872] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:21:04.558895] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-14T17:21:04.774519] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-14T17:21:05.358833] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-14T17:21:06.158877] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-14T17:21:06.468895] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:21:06.468281] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-14T17:21:06.958891] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-14T17:21:07.758861] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-14T17:21:07.825480] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:21:07.827237] [INFO ] [REMOTE ] CCRD: Full fetch complete (9236 records). [2025-09-14T17:21:07.827321] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-14T17:21:08.075418] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-14T17:21:08.214210] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-14T17:21:08.214331] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-14T17:21:08.214617] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-14T17:21:08.214687] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-14T17:21:08.215173] [DEBUG] [LOCAL ] CCRD: Trimmed 9236 records to 7757 (keeping 150 days of data) [2025-09-14T17:21:08.262518] [DEBUG] [LOCAL ] CCRD: Primary data saved (7757 records). [2025-09-14T17:21:08.262704] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-14T17:21:08.262796] [INFO ] [MAIN ] Update Progress: 419/2370 symbols completed. CCRD took 23.4s. Estimated remaining: 3h 24m 37s. Rate: 9.5 symbols/min [2025-09-14T17:21:08.433178] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:08.456332] [DEBUG] [LOCAL ] CDE: Loaded 24062 existing records from primary storage. [2025-09-14T17:21:08.456515] [INFO ] [MAIN ] CDE: Loaded 24062 existing records. [2025-09-14T17:21:08.563968] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-14T17:21:08.635015] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:08.635243] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-14T17:21:08.635301] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-14T17:21:08.636128] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-14T17:21:08.636194] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-14T17:21:09.001624] [INFO ] [REMOTE ] CDE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:09.358833] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-14T17:21:09.909152] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T17:21:10.158889] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-14T17:21:10.958792] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-14T17:21:11.028274] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T17:21:11.169600] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T17:21:11.192600] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:21:11.192984] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-14T17:21:11.758867] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-14T17:21:12.558880] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-14T17:21:12.992121] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:21:13.358839] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-14T17:21:14.158890] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-14T17:21:14.846347] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:21:14.958862] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-14T17:21:15.758860] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-14T17:21:15.862727] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:21:15.983027] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T17:21:15.990360] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-14T17:21:15.992669] [INFO ] [REMOTE ] CCS: Full fetch complete (33545 records). [2025-09-14T17:21:15.992893] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-14T17:21:16.426001] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (3.87 seconds). [2025-09-14T17:21:16.426536] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-14T17:21:16.437691] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-14T17:21:16.438987] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-14T17:21:16.439460] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-14T17:21:16.440741] [DEBUG] [LOCAL ] CCS: Trimmed 33545 records to 22771 (keeping 150 days of data) [2025-09-14T17:21:16.559205] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-14T17:21:16.586971] [DEBUG] [LOCAL ] CCS: Primary data saved (22771 records). [2025-09-14T17:21:16.587177] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-14T17:21:16.587299] [INFO ] [MAIN ] Update Progress: 420/2370 symbols completed. CCS took 28.1s. Estimated remaining: 3h 24m 40s. Rate: 9.5 symbols/min [2025-09-14T17:21:16.762329] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:16.768911] [DEBUG] [LOCAL ] CDLR: Loaded 4567 existing records from primary storage. [2025-09-14T17:21:16.769068] [INFO ] [MAIN ] CDLR: Loaded 4567 existing records. [2025-09-14T17:21:16.951919] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:16.952252] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-14T17:21:16.952322] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-14T17:21:16.952810] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-14T17:21:16.952885] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-14T17:21:17.327481] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:17.358860] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-14T17:21:17.382320] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T17:21:17.384837] [INFO ] [REMOTE ] CCU: Full fetch complete (26197 records). [2025-09-14T17:21:17.384956] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-14T17:21:17.760585] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-14T17:21:17.760781] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-14T17:21:17.761275] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-14T17:21:17.761332] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-14T17:21:17.762171] [DEBUG] [LOCAL ] CCU: Trimmed 26197 records to 16710 (keeping 150 days of data) [2025-09-14T17:21:17.864434] [DEBUG] [LOCAL ] CCU: Primary data saved (16710 records). [2025-09-14T17:21:17.864681] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-14T17:21:17.864835] [INFO ] [MAIN ] Update Progress: 421/2370 symbols completed. CCU took 21.8s. Estimated remaining: 3h 24m 10s. Rate: 9.5 symbols/min [2025-09-14T17:21:18.045097] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:18.066018] [DEBUG] [LOCAL ] CDP: Loaded 18781 existing records from primary storage. [2025-09-14T17:21:18.066246] [INFO ] [MAIN ] CDP: Loaded 18781 existing records. [2025-09-14T17:21:18.167305] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-14T17:21:18.252030] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:18.252350] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-14T17:21:18.252509] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-14T17:21:18.253234] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-14T17:21:18.253311] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-14T17:21:18.610417] [INFO ] [REMOTE ] CDP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:18.950134] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T17:21:18.958776] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-14T17:21:19.419323] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:21:19.758861] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-14T17:21:19.887157] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T17:21:20.558883] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-14T17:21:20.803494] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:21:20.803919] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-09 [2025-09-14T17:21:20.804012] [INFO ] [REMOTE ] CCZ: Full fetch complete (75 records). [2025-09-14T17:21:20.804103] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-14T17:21:20.804893] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-08-08) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:21:20.804973] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:21:20.805022] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:21:20.805071] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-14T17:21:20.805143] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-14T17:21:20.805194] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-14T17:21:20.805263] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-14T17:21:20.805355] [INFO ] [MAIN ] Update Progress: 422/2370 symbols completed. CCZ took 19.2s. Estimated remaining: 3h 23m 49s. Rate: 9.6 symbols/min [2025-09-14T17:21:20.985352] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:20.999219] [DEBUG] [LOCAL ] CDRE: Loaded 10636 existing records from primary storage. [2025-09-14T17:21:20.999438] [INFO ] [MAIN ] CDRE: Loaded 10636 existing records. [2025-09-14T17:21:21.176151] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:21.176423] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-14T17:21:21.176509] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-14T17:21:21.177003] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-14T17:21:21.177084] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-14T17:21:21.360867] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-14T17:21:21.549808] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:21.573199] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T17:21:22.158897] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-14T17:21:22.308971] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T17:21:22.958826] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-14T17:21:23.758809] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-14T17:21:23.831045] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T17:21:23.885432] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:21:24.558838] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-14T17:21:25.358865] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-14T17:21:25.495151] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T17:21:25.584786] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:21:26.158832] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-14T17:21:26.958841] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-14T17:21:27.230886] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T17:21:27.237913] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T17:21:27.758845] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-14T17:21:27.983840] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T17:21:28.558849] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-14T17:21:29.230549] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T17:21:29.358792] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-14T17:21:29.834993] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T17:21:30.158831] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-14T17:21:30.617126] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T17:21:30.958830] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-14T17:21:31.758802] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-14T17:21:32.105219] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T17:21:32.186658] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-14T17:21:32.558839] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-14T17:21:33.358852] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-14T17:21:33.496832] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T17:21:33.916821] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T17:21:34.158841] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-14T17:21:34.263965] [DEBUG] [REMOTE ] CDP: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-14T17:21:34.264407] [WARN ] [REMOTE ] CDP: No data returned for month 2025-05 [2025-09-14T17:21:34.958843] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-14T17:21:35.187012] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-14T17:21:35.193124] [INFO ] [REMOTE ] CDE: Full fetch complete (58320 records). [2025-09-14T17:21:35.193347] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-14T17:21:35.590130] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-14T17:21:35.590285] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-14T17:21:35.591106] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-14T17:21:35.591213] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-14T17:21:35.592663] [DEBUG] [LOCAL ] CDE: Trimmed 58320 records to 40384 (keeping 150 days of data) [2025-09-14T17:21:35.764041] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-14T17:21:35.842276] [DEBUG] [LOCAL ] CDE: Primary data saved (40384 records). [2025-09-14T17:21:35.842465] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-14T17:21:35.842568] [INFO ] [MAIN ] Update Progress: 423/2370 symbols completed. CDE took 27.6s. Estimated remaining: 3h 24m 23s. Rate: 9.5 symbols/min [2025-09-14T17:21:36.015967] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:36.037147] [DEBUG] [LOCAL ] CE: Loaded 22797 existing records from primary storage. [2025-09-14T17:21:36.037325] [INFO ] [MAIN ] CE: Loaded 22797 existing records. [2025-09-14T17:21:36.213067] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:36.213380] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-14T17:21:36.213445] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-14T17:21:36.214136] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-14T17:21:36.214200] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-14T17:21:36.575605] [INFO ] [REMOTE ] CE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:36.575696] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-14T17:21:36.605908] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T17:21:37.085736] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T17:21:37.323484] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:21:37.325097] [INFO ] [REMOTE ] CDLR: Full fetch complete (10682 records). [2025-09-14T17:21:37.325188] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-14T17:21:37.364040] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-14T17:21:37.702526] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-14T17:21:37.702713] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-14T17:21:37.703002] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-14T17:21:37.703055] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-14T17:21:37.703545] [DEBUG] [LOCAL ] CDLR: Trimmed 10682 records to 7036 (keeping 150 days of data) [2025-09-14T17:21:37.745421] [DEBUG] [LOCAL ] CDLR: Primary data saved (7036 records). [2025-09-14T17:21:37.745599] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-14T17:21:37.745742] [INFO ] [MAIN ] Update Progress: 424/2370 symbols completed. CDLR took 21.2s. Estimated remaining: 3h 23m 56s. Rate: 9.5 symbols/min [2025-09-14T17:21:37.917922] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:37.922755] [DEBUG] [LOCAL ] CEE: Loaded 2501 existing records from primary storage. [2025-09-14T17:21:37.922856] [INFO ] [MAIN ] CEE: Loaded 2501 existing records. [2025-09-14T17:21:38.116062] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:38.117349] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-14T17:21:38.117421] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-14T17:21:38.117968] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-14T17:21:38.118034] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-14T17:21:38.163953] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-14T17:21:38.494013] [INFO ] [REMOTE ] CEE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:38.511806] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T17:21:38.958844] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-14T17:21:39.770271] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-14T17:21:39.777312] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:21:40.117435] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:21:40.558890] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-14T17:21:40.685492] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:21:41.358843] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-14T17:21:42.158871] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-14T17:21:42.289336] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T17:21:42.408599] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:21:42.958881] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-14T17:21:43.588670] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T17:21:43.758963] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-14T17:21:43.788493] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T17:21:44.558872] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-14T17:21:45.117779] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:21:45.122568] [INFO ] [REMOTE ] CDP: Full fetch complete (40307 records). [2025-09-14T17:21:45.122764] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-14T17:21:45.323635] [WARN ] [VALIDATOR ] CDP: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T17:21:45.324748] [FATAL] [MAIN ] CDP: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:21:45.324815] [WARN ] [MAIN ] CDP: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:21:45.324884] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-14T17:21:45.324999] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-09-14T17:21:45.325054] [INFO ] [LOCAL ] CDP: Starting deletion of derivative data. [2025-09-14T17:21:45.325122] [DEBUG] [LOCAL ] CDP: No derivative data file found to delete. [2025-09-14T17:21:45.325225] [INFO ] [MAIN ] Update Progress: 425/2370 symbols completed. CDP took 27.5s. Estimated remaining: 3h 23m 56s. Rate: 9.5 symbols/min [2025-09-14T17:21:45.364016] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-14T17:21:45.507450] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:45.520496] [DEBUG] [LOCAL ] CEPU: Loaded 10879 existing records from primary storage. [2025-09-14T17:21:45.520706] [INFO ] [MAIN ] CEPU: Loaded 10879 existing records. [2025-09-14T17:21:45.701224] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:45.701620] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-14T17:21:45.701719] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-14T17:21:45.702615] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-14T17:21:45.702722] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-14T17:21:46.040003] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T17:21:46.077131] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T17:21:46.105201] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:46.158777] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-14T17:21:46.958916] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-14T17:21:47.768082] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-14T17:21:47.773867] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:21:47.838979] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:21:48.558833] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-14T17:21:48.952941] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:21:49.163173] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-14T17:21:49.358861] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-14T17:21:50.158824] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-14T17:21:50.476004] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:21:50.958853] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-14T17:21:51.748157] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:21:51.758977] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-14T17:21:51.781366] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T17:21:51.783992] [INFO ] [REMOTE ] CDRE: Full fetch complete (26460 records). [2025-09-14T17:21:51.784087] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-14T17:21:52.175041] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-14T17:21:52.175170] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-14T17:21:52.175742] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-14T17:21:52.175804] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-14T17:21:52.176809] [DEBUG] [LOCAL ] CDRE: Trimmed 26460 records to 18728 (keeping 150 days of data) [2025-09-14T17:21:52.294161] [DEBUG] [LOCAL ] CDRE: Primary data saved (18728 records). [2025-09-14T17:21:52.294348] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-14T17:21:52.294464] [INFO ] [MAIN ] Update Progress: 426/2370 symbols completed. CDRE took 31.5s. Estimated remaining: 3h 23m 53s. Rate: 9.5 symbols/min [2025-09-14T17:21:52.424886] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T17:21:52.484465] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:52.508277] [DEBUG] [LOCAL ] CF: Loaded 23447 existing records from primary storage. [2025-09-14T17:21:52.508476] [INFO ] [MAIN ] CF: Loaded 23447 existing records. [2025-09-14T17:21:52.563925] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-14T17:21:52.700351] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:52.700664] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-14T17:21:52.700736] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-14T17:21:52.701473] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-14T17:21:52.701540] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-14T17:21:53.066550] [INFO ] [REMOTE ] CF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:53.358844] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-14T17:21:54.158860] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-14T17:21:54.330412] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:21:54.958897] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-14T17:21:55.101385] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T17:21:55.328796] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T17:21:55.758831] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-14T17:21:56.558890] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-14T17:21:56.870475] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:21:57.358900] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-14T17:21:57.407958] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T17:21:57.654509] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:21:58.019421] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:21:58.024860] [INFO ] [REMOTE ] CE: Full fetch complete (56278 records). [2025-09-14T17:21:58.025029] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-14T17:21:58.171394] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-14T17:21:58.421948] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-14T17:21:58.422069] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-14T17:21:58.422790] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-14T17:21:58.422849] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-14T17:21:58.424085] [DEBUG] [LOCAL ] CE: Trimmed 56278 records to 38584 (keeping 150 days of data) [2025-09-14T17:21:58.667523] [DEBUG] [LOCAL ] CE: Primary data saved (38584 records). [2025-09-14T17:21:58.667744] [INFO ] [MAIN ] CE: Full history saved. [2025-09-14T17:21:58.667848] [INFO ] [MAIN ] Update Progress: 427/2370 symbols completed. CE took 22.8s. Estimated remaining: 3h 23m 47s. Rate: 9.5 symbols/min [2025-09-14T17:21:58.835268] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:58.859984] [DEBUG] [LOCAL ] CFG: Loaded 23999 existing records from primary storage. [2025-09-14T17:21:58.860159] [INFO ] [MAIN ] CFG: Loaded 23999 existing records. [2025-09-14T17:21:58.964088] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-14T17:21:59.035972] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:59.036167] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-14T17:21:59.036224] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-14T17:21:59.036988] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-14T17:21:59.037058] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-14T17:21:59.394134] [INFO ] [REMOTE ] CFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:59.561539] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:21:59.758824] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-14T17:22:00.558803] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-14T17:22:00.598671] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T17:22:00.648473] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:22:01.241203] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:22:01.242852] [INFO ] [REMOTE ] CEE: Full fetch complete (8744 records). [2025-09-14T17:22:01.243040] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-14T17:22:01.363921] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-14T17:22:01.631996] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-14T17:22:01.632138] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-14T17:22:01.632406] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-14T17:22:01.632457] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-14T17:22:01.633008] [DEBUG] [LOCAL ] CEE: Trimmed 8744 records to 4013 (keeping 150 days of data) [2025-09-14T17:22:01.656652] [DEBUG] [LOCAL ] CEE: Primary data saved (4013 records). [2025-09-14T17:22:01.656748] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-14T17:22:01.656838] [INFO ] [MAIN ] Update Progress: 428/2370 symbols completed. CEE took 23.9s. Estimated remaining: 3h 23m 25s. Rate: 9.5 symbols/min [2025-09-14T17:22:01.843114] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:01.847038] [DEBUG] [LOCAL ] CFND: Loaded 2189 existing records from primary storage. [2025-09-14T17:22:01.847133] [INFO ] [MAIN ] CFND: Loaded 2189 existing records. [2025-09-14T17:22:02.020823] [WARN ] [MAIN ] CFND: Insufficient historical data. Have data from 2025-08-07, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:02.021118] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-14T17:22:02.021176] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-14T17:22:02.021541] [DEBUG] [LOCAL ] CFND: Deleted primary data file. [2025-09-14T17:22:02.021605] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-14T17:22:02.163964] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-14T17:22:02.396333] [INFO ] [REMOTE ] CFND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:02.958834] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-14T17:22:03.229199] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:03.229577] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-14T17:22:03.288777] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T17:22:03.650253] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:22:03.758860] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-14T17:22:04.558782] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-14T17:22:04.794243] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T17:22:05.358896] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-14T17:22:05.636343] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:05.636776] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-14T17:22:06.158849] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-14T17:22:06.405171] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:06.405618] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-14T17:22:06.495106] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T17:22:06.958898] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-14T17:22:07.758858] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-14T17:22:08.057321] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:08.057747] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-14T17:22:08.391038] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T17:22:08.558860] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-14T17:22:09.358859] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-14T17:22:09.617353] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:09.617733] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-14T17:22:10.158836] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-14T17:22:10.352572] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T17:22:10.958883] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-14T17:22:11.265632] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:11.266024] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-14T17:22:11.758876] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-14T17:22:12.052857] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T17:22:12.558848] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-14T17:22:13.240262] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T17:22:13.358891] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-14T17:22:14.014732] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T17:22:14.158883] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-14T17:22:14.958864] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-14T17:22:15.172670] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T17:22:15.251161] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:22:15.254548] [INFO ] [REMOTE ] CEPU: Full fetch complete (27886 records). [2025-09-14T17:22:15.254664] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-14T17:22:15.611860] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:22:15.643929] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-14T17:22:15.644017] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-14T17:22:15.644533] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-14T17:22:15.644597] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-14T17:22:15.645332] [DEBUG] [LOCAL ] CEPU: Trimmed 27886 records to 18775 (keeping 150 days of data) [2025-09-14T17:22:15.757393] [DEBUG] [LOCAL ] CEPU: Primary data saved (18775 records). [2025-09-14T17:22:15.757583] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-14T17:22:15.757713] [INFO ] [MAIN ] Update Progress: 429/2370 symbols completed. CEPU took 30.4s. Estimated remaining: 3h 23m 54s. Rate: 9.5 symbols/min [2025-09-14T17:22:15.768982] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-14T17:22:15.938219] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:15.954875] [DEBUG] [LOCAL ] CFR: Loaded 15003 existing records from primary storage. [2025-09-14T17:22:15.955039] [INFO ] [MAIN ] CFR: Loaded 15003 existing records. [2025-09-14T17:22:16.139046] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:16.139362] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-14T17:22:16.139433] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-14T17:22:16.139970] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-14T17:22:16.140034] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-14T17:22:16.517198] [INFO ] [REMOTE ] CFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:16.530871] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:22:16.536443] [INFO ] [REMOTE ] CF: Full fetch complete (56911 records). [2025-09-14T17:22:16.536578] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-14T17:22:16.567086] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-14T17:22:16.921799] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-14T17:22:16.921913] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-14T17:22:16.922706] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-14T17:22:16.922782] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-14T17:22:16.924067] [DEBUG] [LOCAL ] CF: Trimmed 56911 records to 39355 (keeping 150 days of data) [2025-09-14T17:22:17.166461] [DEBUG] [LOCAL ] CF: Primary data saved (39355 records). [2025-09-14T17:22:17.166680] [INFO ] [MAIN ] CF: Full history saved. [2025-09-14T17:22:17.166822] [INFO ] [MAIN ] Update Progress: 430/2370 symbols completed. CF took 24.9s. Estimated remaining: 3h 23m 26s. Rate: 9.5 symbols/min [2025-09-14T17:22:17.350440] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:17.361625] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-14T17:22:17.372145] [DEBUG] [LOCAL ] CGAU: Loaded 19233 existing records from primary storage. [2025-09-14T17:22:17.372352] [INFO ] [MAIN ] CGAU: Loaded 19233 existing records. [2025-09-14T17:22:17.554876] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:17.555172] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-14T17:22:17.555233] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-14T17:22:17.555856] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-14T17:22:17.555926] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-14T17:22:17.904321] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:18.158799] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-14T17:22:18.418712] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T17:22:18.560120] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T17:22:18.958853] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-14T17:22:19.426106] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:22:19.427556] [INFO ] [REMOTE ] CFND: Full fetch complete (2189 records). [2025-09-14T17:22:19.427656] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-14T17:22:19.607509] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 26 unique days, need 150 days [2025-09-14T17:22:19.607790] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:22:19.607998] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:22:19.608162] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-14T17:22:19.608289] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-14T17:22:19.608493] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-14T17:22:19.608662] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-14T17:22:19.608828] [INFO ] [MAIN ] Update Progress: 431/2370 symbols completed. CFND took 18.0s. Estimated remaining: 3h 23m 2s. Rate: 9.5 symbols/min [2025-09-14T17:22:19.758855] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-14T17:22:19.782798] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:22:19.816737] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:19.827509] [DEBUG] [LOCAL ] CGV: Loaded 623 existing records from primary storage. [2025-09-14T17:22:19.827605] [INFO ] [MAIN ] CGV: Loaded 623 existing records. [2025-09-14T17:22:20.016251] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:20.016608] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-14T17:22:20.016706] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-14T17:22:20.016980] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-14T17:22:20.017054] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-14T17:22:20.367038] [INFO ] [REMOTE ] CGV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:20.558842] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-14T17:22:21.322379] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T17:22:21.358797] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-14T17:22:22.035185] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T17:22:22.158874] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-14T17:22:22.900353] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:22:22.958856] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-14T17:22:23.758904] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-14T17:22:24.031002] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T17:22:24.236891] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:22:24.549551] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:22:24.558765] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-14T17:22:25.358839] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-14T17:22:25.807608] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:22:26.027626] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:22:26.033877] [INFO ] [REMOTE ] CFG: Full fetch complete (58291 records). [2025-09-14T17:22:26.034119] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-14T17:22:26.165089] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-14T17:22:26.563104] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T17:22:26.588756] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-14T17:22:26.588939] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-14T17:22:26.591930] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-14T17:22:26.592215] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-14T17:22:26.596019] [DEBUG] [LOCAL ] CFG: Trimmed 58291 records to 40366 (keeping 150 days of data) [2025-09-14T17:22:26.951200] [DEBUG] [LOCAL ] CFG: Primary data saved (40366 records). [2025-09-14T17:22:26.951421] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-14T17:22:26.951590] [INFO ] [MAIN ] Update Progress: 432/2370 symbols completed. CFG took 28.3s. Estimated remaining: 3h 23m 1s. Rate: 9.5 symbols/min [2025-09-14T17:22:26.964059] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-14T17:22:27.188176] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:27.202983] [DEBUG] [LOCAL ] CHCT: Loaded 11224 existing records from primary storage. [2025-09-14T17:22:27.203202] [INFO ] [MAIN ] CHCT: Loaded 11224 existing records. [2025-09-14T17:22:27.394537] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:27.394828] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-14T17:22:27.394898] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-14T17:22:27.395339] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-14T17:22:27.395439] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-14T17:22:27.508015] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:22:27.766383] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:27.762814] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-14T17:22:28.558840] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-14T17:22:29.352776] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:22:29.361844] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-14T17:22:29.780037] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:22:29.840746] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T17:22:30.158819] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-14T17:22:30.958826] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-14T17:22:31.757167] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:22:31.765815] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-14T17:22:31.835836] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T17:22:32.241395] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-14T17:22:32.558882] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-14T17:22:33.358843] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-14T17:22:34.120207] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T17:22:34.147287] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:22:34.158771] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-14T17:22:34.958899] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-14T17:22:35.686997] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:22:35.758848] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-14T17:22:36.394873] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:22:36.558894] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-14T17:22:37.358895] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-14T17:22:37.487670] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T17:22:37.552950] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T17:22:38.158893] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-14T17:22:38.510561] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-14T17:22:38.841522] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T17:22:38.958844] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-14T17:22:39.758889] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-14T17:22:40.225468] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T17:22:40.230547] [INFO ] [REMOTE ] CGAU: Full fetch complete (45793 records). [2025-09-14T17:22:40.230694] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-14T17:22:40.561408] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-14T17:22:40.605701] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-14T17:22:40.605808] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-14T17:22:40.606497] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-14T17:22:40.606588] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-14T17:22:40.607821] [DEBUG] [LOCAL ] CGAU: Trimmed 45793 records to 31557 (keeping 150 days of data) [2025-09-14T17:22:40.798832] [DEBUG] [LOCAL ] CGAU: Primary data saved (31557 records). [2025-09-14T17:22:40.799035] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-14T17:22:40.799183] [INFO ] [MAIN ] Update Progress: 433/2370 symbols completed. CGAU took 23.6s. Estimated remaining: 3h 23m 29s. Rate: 9.5 symbols/min [2025-09-14T17:22:40.979320] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:40.992516] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:22:41.012027] [INFO ] [REMOTE ] CFR: Full fetch complete (36738 records). [2025-09-14T17:22:41.013150] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T17:22:41.013337] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-14T17:22:41.149923] [DEBUG] [LOCAL ] CHD: Loaded 23484 existing records from primary storage. [2025-09-14T17:22:41.196259] [INFO ] [MAIN ] CHD: Loaded 23484 existing records. [2025-09-14T17:22:41.360606] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-14T17:22:41.599253] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:41.599698] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-14T17:22:41.599619] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-14T17:22:41.599825] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-14T17:22:41.599876] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-14T17:22:41.600508] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-14T17:22:41.600653] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-14T17:22:41.601231] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-14T17:22:41.601386] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-14T17:22:41.645827] [DEBUG] [LOCAL ] CFR: Trimmed 36738 records to 24399 (keeping 150 days of data) [2025-09-14T17:22:41.914659] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:22:41.938863] [INFO ] [REMOTE ] CGV: Full fetch complete (1630 records). [2025-09-14T17:22:41.960659] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-14T17:22:42.160822] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-14T17:22:42.207572] [INFO ] [REMOTE ] CHD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:42.462943] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-14T17:22:42.464155] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-14T17:22:42.464765] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-14T17:22:42.465749] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-14T17:22:42.466918] [DEBUG] [LOCAL ] CGV: Trimmed 1630 records to 953 (keeping 150 days of data) [2025-09-14T17:22:42.480419] [DEBUG] [LOCAL ] CGV: Primary data saved (953 records). [2025-09-14T17:22:42.481385] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-14T17:22:42.481810] [INFO ] [MAIN ] Update Progress: 434/2370 symbols completed. CGV took 22.9s. Estimated remaining: 3h 23m 2s. Rate: 9.5 symbols/min [2025-09-14T17:22:42.681814] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:42.691168] [DEBUG] [LOCAL ] CFR: Primary data saved (24399 records). [2025-09-14T17:22:42.691350] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-14T17:22:42.691496] [INFO ] [MAIN ] Update Progress: 435/2370 symbols completed. CFR took 26.9s. Estimated remaining: 3h 22m 28s. Rate: 9.6 symbols/min [2025-09-14T17:22:42.800228] [DEBUG] [LOCAL ] CHE: Loaded 7372 existing records from primary storage. [2025-09-14T17:22:42.821056] [INFO ] [MAIN ] CHE: Loaded 7372 existing records. [2025-09-14T17:22:42.960004] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-14T17:22:42.954765] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:43.065823] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:43.071017] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-14T17:22:43.071102] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-14T17:22:43.071543] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-14T17:22:43.071624] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-14T17:22:43.190501] [DEBUG] [LOCAL ] CHGG: Loaded 21362 existing records from primary storage. [2025-09-14T17:22:43.201341] [INFO ] [MAIN ] CHGG: Loaded 21362 existing records. [2025-09-14T17:22:43.534781] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:43.562243] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-14T17:22:43.597097] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-14T17:22:43.632626] [INFO ] [REMOTE ] CHE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:43.633435] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-14T17:22:43.645933] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-14T17:22:43.713369] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:22:43.763867] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-14T17:22:44.007937] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:44.558798] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-14T17:22:44.640572] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:22:44.699240] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T17:22:45.149347] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T17:22:45.358869] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-14T17:22:46.158848] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-14T17:22:46.354171] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T17:22:46.958850] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-14T17:22:47.758826] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-14T17:22:47.992523] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:22:48.055352] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:22:48.558840] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-14T17:22:49.256444] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T17:22:49.358792] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-14T17:22:50.158801] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-14T17:22:50.208439] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:22:50.958826] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-14T17:22:51.156893] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T17:22:51.210117] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T17:22:51.758829] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-14T17:22:52.558842] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-14T17:22:52.691916] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:22:53.073223] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:22:53.348572] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T17:22:53.358769] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-14T17:22:54.158811] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-14T17:22:54.394515] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T17:22:54.958848] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-14T17:22:55.758881] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-14T17:22:55.836689] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:22:56.558924] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-14T17:22:56.779596] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:22:56.845920] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:22:57.358839] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-14T17:22:57.880673] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:22:57.883259] [INFO ] [REMOTE ] CHCT: Full fetch complete (26383 records). [2025-09-14T17:22:57.883384] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-14T17:22:58.163449] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-14T17:22:58.217803] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:22:58.312483] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-14T17:22:58.312600] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-14T17:22:58.313150] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-14T17:22:58.313210] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-14T17:22:58.313954] [DEBUG] [LOCAL ] CHCT: Trimmed 26383 records to 18123 (keeping 150 days of data) [2025-09-14T17:22:58.431560] [DEBUG] [LOCAL ] CHCT: Primary data saved (18123 records). [2025-09-14T17:22:58.431762] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-14T17:22:58.431881] [INFO ] [MAIN ] Update Progress: 436/2370 symbols completed. CHCT took 31.5s. Estimated remaining: 3h 23m 4s. Rate: 9.5 symbols/min [2025-09-14T17:22:58.600694] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:58.616302] [DEBUG] [LOCAL ] CHH: Loaded 13701 existing records from primary storage. [2025-09-14T17:22:58.616459] [INFO ] [MAIN ] CHH: Loaded 13701 existing records. [2025-09-14T17:22:58.807347] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:58.807671] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-14T17:22:58.807734] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-14T17:22:58.808175] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-14T17:22:58.808234] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-14T17:22:58.966462] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-14T17:22:59.196204] [INFO ] [REMOTE ] CHH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:59.758895] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-14T17:23:00.178062] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T17:23:00.558870] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-14T17:23:01.358875] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-14T17:23:04.443281] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (5.48 seconds). [2025-09-14T17:23:04.447055] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-14T17:23:05.002172] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (5.24 seconds). [2025-09-14T17:23:05.010586] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-14T17:23:05.020416] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:23:05.023108] [INFO ] [REMOTE ] CHE: Full fetch complete (15310 records). [2025-09-14T17:23:05.023224] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-14T17:23:05.396881] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-14T17:23:05.397078] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-14T17:23:05.397632] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-14T17:23:05.397904] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-14T17:23:05.399146] [DEBUG] [LOCAL ] CHE: Trimmed 15310 records to 11232 (keeping 150 days of data) [2025-09-14T17:23:05.491075] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (4.93 seconds). [2025-09-14T17:23:05.505629] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-14T17:23:05.522856] [DEBUG] [LOCAL ] CHE: Primary data saved (11232 records). [2025-09-14T17:23:05.523078] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-14T17:23:05.523192] [INFO ] [MAIN ] Update Progress: 437/2370 symbols completed. CHE took 23.0s. Estimated remaining: 3h 23m 1s. Rate: 9.5 symbols/min [2025-09-14T17:23:05.819955] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:23:05.825489] [INFO ] [REMOTE ] CHD: Full fetch complete (56330 records). [2025-09-14T17:23:05.825701] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-14T17:23:06.231069] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-14T17:23:06.231270] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-14T17:23:06.232281] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-14T17:23:06.232390] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-14T17:23:06.234468] [DEBUG] [LOCAL ] CHD: Trimmed 56330 records to 39567 (keeping 150 days of data) [2025-09-14T17:23:06.366774] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (5.01 seconds). [2025-09-14T17:23:06.379938] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-14T17:23:06.558119] [DEBUG] [LOCAL ] CHD: Primary data saved (39567 records). [2025-09-14T17:23:06.558351] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-14T17:23:06.558476] [INFO ] [MAIN ] Update Progress: 438/2370 symbols completed. CHD took 25.8s. Estimated remaining: 3h 22m 32s. Rate: 9.5 symbols/min [2025-09-14T17:23:07.111270] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T17:23:07.119943] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-14T17:23:08.342809] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:23:08.353895] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-14T17:23:08.667945] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:23:08.676195] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-14T17:23:10.140076] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:23:10.148331] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-14T17:23:10.238781] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T17:23:10.248964] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-14T17:23:11.538367] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T17:23:11.545192] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-14T17:23:11.817296] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T17:23:11.822555] [INFO ] [REMOTE ] CHGG: Full fetch complete (52226 records). [2025-09-14T17:23:11.822731] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-14T17:23:12.199991] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-14T17:23:12.200110] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-14T17:23:12.200793] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-14T17:23:12.200851] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-14T17:23:12.201994] [DEBUG] [LOCAL ] CHGG: Trimmed 52226 records to 35858 (keeping 150 days of data) [2025-09-14T17:23:12.412455] [DEBUG] [LOCAL ] CHGG: Primary data saved (35858 records). [2025-09-14T17:23:12.412631] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-14T17:23:12.412752] [INFO ] [MAIN ] Update Progress: 439/2370 symbols completed. CHGG took 29.7s. Estimated remaining: 3h 22m 23s. Rate: 9.5 symbols/min [2025-09-14T17:23:12.641991] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T17:23:12.649605] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-14T17:23:13.991558] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T17:23:13.998719] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-14T17:23:14.518420] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:23:14.521703] [INFO ] [REMOTE ] CHH: Full fetch complete (35496 records). [2025-09-14T17:23:14.521806] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-14T17:23:14.901941] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-14T17:23:14.902048] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-14T17:23:14.902585] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-14T17:23:14.902654] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-14T17:23:14.903479] [DEBUG] [LOCAL ] CHH: Trimmed 35496 records to 23681 (keeping 150 days of data) [2025-09-14T17:23:15.050658] [DEBUG] [LOCAL ] CHH: Primary data saved (23681 records). [2025-09-14T17:23:15.050842] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-14T17:23:15.050940] [INFO ] [MAIN ] Update Progress: 440/2370 symbols completed. CHH took 16.6s. Estimated remaining: 3h 22m 1s. Rate: 9.6 symbols/min [2025-09-14T17:23:15.653853] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:15.706108] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:15.722337] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:15.791438] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:15.799082] [DEBUG] [LOCAL ] CHN: Loaded 2331 existing records from primary storage. [2025-09-14T17:23:15.801435] [INFO ] [MAIN ] CHN: Loaded 2331 existing records. [2025-09-14T17:23:15.843448] [DEBUG] [LOCAL ] CHMI: Loaded 9203 existing records from primary storage. [2025-09-14T17:23:15.881376] [DEBUG] [LOCAL ] CHT: Loaded 8305 existing records from primary storage. [2025-09-14T17:23:15.886854] [INFO ] [MAIN ] CHMI: Loaded 9203 existing records. [2025-09-14T17:23:15.907929] [INFO ] [MAIN ] CHT: Loaded 8305 existing records. [2025-09-14T17:23:16.088629] [DEBUG] [LOCAL ] CHPT: Loaded 20838 existing records from primary storage. [2025-09-14T17:23:16.147571] [INFO ] [MAIN ] CHPT: Loaded 20838 existing records. [2025-09-14T17:23:16.207313] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:16.359061] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-14T17:23:16.428578] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:16.487918] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:16.492974] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-14T17:23:16.499343] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-14T17:23:16.499722] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-14T17:23:16.505360] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-14T17:23:16.500049] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-14T17:23:16.500143] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-14T17:23:16.545029] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-14T17:23:16.597291] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:16.597104] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-14T17:23:16.643775] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-14T17:23:16.675586] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-14T17:23:16.659335] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-14T17:23:16.675479] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-14T17:23:16.775751] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-14T17:23:16.956853] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-14T17:23:17.019851] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-14T17:23:17.560955] [INFO ] [REMOTE ] CHN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:17.670799] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-14T17:23:17.982228] [INFO ] [REMOTE ] CHT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:18.033555] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:18.044749] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-14T17:23:18.050288] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-14T17:23:18.126525] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:18.127364] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-14T17:23:18.534479] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T17:23:18.540288] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-14T17:23:19.114555] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:23:19.119430] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-14T17:23:19.182435] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T17:23:19.184398] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-14T17:23:19.226743] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:23:19.233817] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-14T17:23:19.847467] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T17:23:19.849450] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-14T17:23:20.224296] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T17:23:20.257743] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-14T17:23:20.259546] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-14T17:23:20.270806] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-14T17:23:20.303711] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:23:20.314099] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T17:23:20.558880] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-14T17:23:20.989902] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-14T17:23:21.103443] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T17:23:21.358831] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-14T17:23:22.030304] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T17:23:22.158825] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-14T17:23:22.334804] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T17:23:22.958807] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-14T17:23:23.236779] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T17:23:23.758830] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-14T17:23:24.317131] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:23:24.558866] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-14T17:23:24.664189] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:23:25.090527] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T17:23:25.358837] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-14T17:23:26.158839] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-14T17:23:26.958830] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-14T17:23:27.216996] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T17:23:27.403748] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T17:23:27.758827] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-14T17:23:28.116562] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T17:23:28.558844] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-14T17:23:29.358824] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-14T17:23:29.665569] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:23:30.037444] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T17:23:30.158831] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-14T17:23:30.557713] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T17:23:30.907317] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:23:30.909717] [INFO ] [REMOTE ] CHT: Full fetch complete (21469 records). [2025-09-14T17:23:30.909804] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-14T17:23:30.963952] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-14T17:23:31.291052] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-14T17:23:31.291170] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-14T17:23:31.291661] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-14T17:23:31.291737] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-14T17:23:31.292414] [DEBUG] [LOCAL ] CHT: Trimmed 21469 records to 14550 (keeping 150 days of data) [2025-09-14T17:23:31.378538] [DEBUG] [LOCAL ] CHT: Primary data saved (14550 records). [2025-09-14T17:23:31.378727] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-14T17:23:31.378831] [INFO ] [MAIN ] Update Progress: 441/2370 symbols completed. CHT took 16.3s. Estimated remaining: 3h 22m 39s. Rate: 9.5 symbols/min [2025-09-14T17:23:31.554996] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:31.578552] [DEBUG] [LOCAL ] CHWY: Loaded 24036 existing records from primary storage. [2025-09-14T17:23:31.578744] [INFO ] [MAIN ] CHWY: Loaded 24036 existing records. [2025-09-14T17:23:31.757803] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:31.758119] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-14T17:23:31.758180] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-14T17:23:31.758791] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-14T17:23:31.759613] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-14T17:23:31.759699] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-14T17:23:32.115808] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:32.201670] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T17:23:32.402044] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:23:32.403243] [INFO ] [REMOTE ] CHN: Full fetch complete (5471 records). [2025-09-14T17:23:32.403328] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-14T17:23:32.560667] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-14T17:23:32.758128] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-14T17:23:32.758248] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-14T17:23:32.758464] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-14T17:23:32.758519] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-14T17:23:32.758924] [DEBUG] [LOCAL ] CHN: Trimmed 5471 records to 3676 (keeping 150 days of data) [2025-09-14T17:23:32.780588] [DEBUG] [LOCAL ] CHN: Primary data saved (3676 records). [2025-09-14T17:23:32.780726] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-14T17:23:32.780827] [INFO ] [MAIN ] Update Progress: 442/2370 symbols completed. CHN took 17.7s. Estimated remaining: 3h 22m 11s. Rate: 9.5 symbols/min [2025-09-14T17:23:32.954726] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:32.977220] [DEBUG] [LOCAL ] CI: Loaded 22466 existing records from primary storage. [2025-09-14T17:23:32.977463] [INFO ] [MAIN ] CI: Loaded 22466 existing records. [2025-09-14T17:23:33.151823] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:33.152136] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-14T17:23:33.152198] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-14T17:23:33.152919] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-14T17:23:33.152991] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-14T17:23:33.364045] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-14T17:23:33.516479] [INFO ] [REMOTE ] CI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:34.158894] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-14T17:23:34.919923] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-14T17:23:34.944148] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:23:34.958774] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-14T17:23:35.347715] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-14T17:23:35.758826] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-14T17:23:35.984765] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T17:23:35.987499] [INFO ] [REMOTE ] CHMI: Full fetch complete (23601 records). [2025-09-14T17:23:35.987676] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-14T17:23:36.394977] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-14T17:23:36.395187] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-14T17:23:36.395818] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-14T17:23:36.395888] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-14T17:23:36.396873] [DEBUG] [LOCAL ] CHMI: Trimmed 23601 records to 15383 (keeping 150 days of data) [2025-09-14T17:23:36.491191] [DEBUG] [LOCAL ] CHMI: Primary data saved (15383 records). [2025-09-14T17:23:36.491402] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-14T17:23:36.491537] [INFO ] [MAIN ] Update Progress: 443/2370 symbols completed. CHMI took 21.4s. Estimated remaining: 3h 21m 54s. Rate: 9.5 symbols/min [2025-09-14T17:23:36.568135] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-14T17:23:36.673283] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:36.683756] [DEBUG] [LOCAL ] CIA: Loaded 8329 existing records from primary storage. [2025-09-14T17:23:36.683942] [INFO ] [MAIN ] CIA: Loaded 8329 existing records. [2025-09-14T17:23:36.863254] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:36.863544] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-14T17:23:36.863606] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-14T17:23:36.864040] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-14T17:23:36.864115] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-14T17:23:37.224499] [INFO ] [REMOTE ] CIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:37.358843] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-14T17:23:38.106150] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T17:23:38.158868] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-14T17:23:38.295917] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T17:23:38.654056] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T17:23:38.958885] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-14T17:23:39.448549] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:23:39.758858] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-14T17:23:40.558793] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-14T17:23:40.584995] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T17:23:40.738768] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T17:23:41.358869] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-14T17:23:41.799705] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-14T17:23:41.805616] [INFO ] [REMOTE ] CHPT: Full fetch complete (54878 records). [2025-09-14T17:23:41.805847] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-14T17:23:42.178549] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-14T17:23:42.197539] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-14T17:23:42.197909] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-14T17:23:42.199471] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-14T17:23:42.199546] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-14T17:23:42.200731] [DEBUG] [LOCAL ] CHPT: Trimmed 54878 records to 37016 (keeping 150 days of data) [2025-09-14T17:23:42.439995] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:23:42.467290] [DEBUG] [LOCAL ] CHPT: Primary data saved (37016 records). [2025-09-14T17:23:42.467473] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-14T17:23:42.467628] [INFO ] [MAIN ] Update Progress: 444/2370 symbols completed. CHPT took 27.4s. Estimated remaining: 3h 21m 46s. Rate: 9.5 symbols/min [2025-09-14T17:23:42.635210] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:42.649262] [DEBUG] [LOCAL ] CIB: Loaded 12900 existing records from primary storage. [2025-09-14T17:23:42.649422] [INFO ] [MAIN ] CIB: Loaded 12900 existing records. [2025-09-14T17:23:42.828022] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:42.828314] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-14T17:23:42.828388] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-14T17:23:42.829126] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-14T17:23:42.829204] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-14T17:23:42.967751] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-14T17:23:43.186863] [INFO ] [REMOTE ] CIB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:43.758832] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-14T17:23:43.891554] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:23:44.274131] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T17:23:44.558843] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-14T17:23:44.742630] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T17:23:45.358869] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-14T17:23:46.158845] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-14T17:23:46.498828] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:23:46.882049] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T17:23:46.947812] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T17:23:46.958781] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-14T17:23:47.712303] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T17:23:47.758778] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-14T17:23:48.558897] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-14T17:23:48.669299] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T17:23:49.358836] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-14T17:23:50.153552] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T17:23:50.155447] [INFO ] [REMOTE ] CIA: Full fetch complete (18268 records). [2025-09-14T17:23:50.155549] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-14T17:23:50.167072] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-14T17:23:50.523403] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-14T17:23:50.523575] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-14T17:23:50.524082] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-14T17:23:50.524206] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-14T17:23:50.524899] [DEBUG] [LOCAL ] CIA: Trimmed 18268 records to 12924 (keeping 150 days of data) [2025-09-14T17:23:50.615806] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T17:23:50.641812] [DEBUG] [LOCAL ] CIA: Primary data saved (12924 records). [2025-09-14T17:23:50.642011] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-14T17:23:50.642122] [INFO ] [MAIN ] Update Progress: 445/2370 symbols completed. CIA took 14.2s. Estimated remaining: 3h 21m 48s. Rate: 9.5 symbols/min [2025-09-14T17:23:50.815687] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:50.818234] [DEBUG] [LOCAL ] CICB: Loaded 562 existing records from primary storage. [2025-09-14T17:23:50.818341] [INFO ] [MAIN ] CICB: Loaded 562 existing records. [2025-09-14T17:23:50.967690] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-14T17:23:51.010246] [WARN ] [MAIN ] CICB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:51.010710] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-14T17:23:51.010804] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-14T17:23:51.011013] [DEBUG] [LOCAL ] CICB: Deleted primary data file. [2025-09-14T17:23:51.011070] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-14T17:23:51.361256] [INFO ] [REMOTE ] CICB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:51.758811] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-14T17:23:52.142932] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:23:52.160989] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-14T17:23:52.543545] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:23:52.558768] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-14T17:23:53.358842] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-14T17:23:53.552177] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:23:54.158858] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-14T17:23:54.562412] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T17:23:54.958871] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-14T17:23:55.294385] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T17:23:55.447914] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T17:23:55.758875] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-14T17:23:56.149768] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T17:23:56.558845] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-14T17:23:57.358826] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-14T17:23:58.158781] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-14T17:23:58.201563] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T17:23:58.343151] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T17:23:58.619411] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:23:58.958860] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-14T17:23:59.438053] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T17:23:59.758835] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-14T17:24:00.558888] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-14T17:24:01.358889] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-14T17:24:01.980350] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-14T17:24:02.018424] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:24:02.158882] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-14T17:24:02.958826] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-14T17:24:03.758859] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-14T17:24:04.183108] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T17:24:04.194228] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-14T17:24:04.445926] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-14T17:24:04.558824] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-14T17:24:04.796943] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-14T17:24:05.358837] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-14T17:24:05.681150] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T17:24:05.685201] [INFO ] [REMOTE ] CIB: Full fetch complete (34169 records). [2025-09-14T17:24:05.685332] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-14T17:24:06.058951] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-14T17:24:06.059140] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-14T17:24:06.059774] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-14T17:24:06.059839] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-14T17:24:06.060732] [DEBUG] [LOCAL ] CIB: Trimmed 34169 records to 22339 (keeping 150 days of data) [2025-09-14T17:24:06.161989] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-14T17:24:06.197630] [DEBUG] [LOCAL ] CIB: Primary data saved (22339 records). [2025-09-14T17:24:06.197805] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-14T17:24:06.197949] [INFO ] [MAIN ] Update Progress: 446/2370 symbols completed. CIB took 23.7s. Estimated remaining: 3h 22m 22s. Rate: 9.5 symbols/min [2025-09-14T17:24:06.366334] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:06.388685] [DEBUG] [LOCAL ] CIEN: Loaded 23257 existing records from primary storage. [2025-09-14T17:24:06.388880] [INFO ] [MAIN ] CIEN: Loaded 23257 existing records. [2025-09-14T17:24:06.580085] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:06.580402] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-14T17:24:06.580479] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-14T17:24:06.581258] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-14T17:24:06.581327] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-14T17:24:06.895261] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:24:06.944596] [INFO ] [REMOTE ] CI: Full fetch complete (54296 records). [2025-09-14T17:24:06.960423] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-14T17:24:06.964066] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:06.964358] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-14T17:24:07.343841] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-14T17:24:07.344083] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-14T17:24:07.344945] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-14T17:24:07.345021] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-14T17:24:07.346785] [DEBUG] [LOCAL ] CI: Trimmed 54296 records to 37661 (keeping 150 days of data) [2025-09-14T17:24:07.479491] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:24:07.480794] [INFO ] [REMOTE ] CICB: Full fetch complete (1456 records). [2025-09-14T17:24:07.482544] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-14T17:24:07.496847] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-14T17:24:07.682170] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-14T17:24:07.683932] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:24:07.685544] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:24:07.686115] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-14T17:24:07.686741] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-14T17:24:07.687045] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-14T17:24:07.688749] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-14T17:24:07.689320] [INFO ] [MAIN ] Update Progress: 447/2370 symbols completed. CICB took 17.0s. Estimated remaining: 3h 21m 54s. Rate: 9.5 symbols/min [2025-09-14T17:24:07.761208] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-14T17:24:07.872290] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:07.965507] [DEBUG] [LOCAL ] CIF: Loaded 1654 existing records from primary storage. [2025-09-14T17:24:07.969843] [INFO ] [MAIN ] CIF: Loaded 1654 existing records. [2025-09-14T17:24:08.159570] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:08.161186] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-14T17:24:08.162266] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-14T17:24:08.163588] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-14T17:24:08.164738] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-14T17:24:08.520884] [DEBUG] [LOCAL ] CI: Primary data saved (37661 records). [2025-09-14T17:24:08.539619] [INFO ] [REMOTE ] CIF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:08.539736] [INFO ] [MAIN ] CI: Full history saved. [2025-09-14T17:24:08.540264] [INFO ] [MAIN ] Update Progress: 448/2370 symbols completed. CI took 35.8s. Estimated remaining: 3h 21m 25s. Rate: 9.5 symbols/min [2025-09-14T17:24:08.563921] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-14T17:24:08.725669] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:08.746260] [DEBUG] [LOCAL ] CIG: Loaded 20147 existing records from primary storage. [2025-09-14T17:24:08.746440] [INFO ] [MAIN ] CIG: Loaded 20147 existing records. [2025-09-14T17:24:08.921356] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:08.921686] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-14T17:24:08.921748] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-14T17:24:08.922355] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-14T17:24:08.922416] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-14T17:24:09.281232] [INFO ] [REMOTE ] CIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:09.345903] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:24:09.358769] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-14T17:24:10.158834] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-14T17:24:10.750497] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-14T17:24:10.958859] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-14T17:24:11.141723] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:24:11.261693] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T17:24:11.271356] [INFO ] [REMOTE ] CHWY: Full fetch complete (58297 records). [2025-09-14T17:24:11.271634] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-14T17:24:11.767767] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-14T17:24:11.894136] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T17:24:11.962820] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-14T17:24:11.963049] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-14T17:24:11.964464] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-14T17:24:11.964581] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-14T17:24:11.966558] [DEBUG] [LOCAL ] CHWY: Trimmed 58297 records to 40401 (keeping 150 days of data) [2025-09-14T17:24:12.337121] [DEBUG] [LOCAL ] CHWY: Primary data saved (40401 records). [2025-09-14T17:24:12.337317] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-14T17:24:12.337473] [INFO ] [MAIN ] Update Progress: 449/2370 symbols completed. CHWY took 41.0s. Estimated remaining: 3h 21m 8s. Rate: 9.6 symbols/min [2025-09-14T17:24:12.513764] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:12.521817] [DEBUG] [LOCAL ] CII: Loaded 5976 existing records from primary storage. [2025-09-14T17:24:12.521981] [INFO ] [MAIN ] CII: Loaded 5976 existing records. [2025-09-14T17:24:12.565095] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-14T17:24:12.706405] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:12.706746] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-14T17:24:12.706822] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-14T17:24:12.707140] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-14T17:24:12.707225] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-14T17:24:12.812540] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T17:24:13.086043] [INFO ] [REMOTE ] CII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:13.358850] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-14T17:24:14.066236] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T17:24:14.158830] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-14T17:24:14.928282] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-14T17:24:14.958780] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-14T17:24:15.372683] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T17:24:15.758827] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-14T17:24:16.558804] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-14T17:24:16.850169] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T17:24:16.944132] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:24:17.020701] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:24:17.358847] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-14T17:24:18.158829] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-14T17:24:18.281364] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:24:18.958828] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-14T17:24:19.758827] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-14T17:24:19.817383] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:24:19.979180] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:24:20.558865] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-14T17:24:21.358796] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-14T17:24:21.416518] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T17:24:21.464393] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T17:24:21.888276] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T17:24:22.158841] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-14T17:24:22.958828] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-14T17:24:23.060461] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:24:23.529575] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T17:24:23.758842] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-14T17:24:24.558826] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-14T17:24:25.358819] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-14T17:24:25.790127] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T17:24:26.009607] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T17:24:26.116734] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:24:26.158802] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-14T17:24:26.664882] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T17:24:26.958856] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-14T17:24:27.586821] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T17:24:27.758828] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-14T17:24:28.287275] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:24:28.288335] [INFO ] [REMOTE ] CIF: Full fetch complete (5124 records). [2025-09-14T17:24:28.288423] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-14T17:24:28.563960] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-14T17:24:28.668014] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-14T17:24:28.668143] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-14T17:24:28.668393] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-14T17:24:28.668452] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-14T17:24:28.668899] [DEBUG] [LOCAL ] CIF: Trimmed 5124 records to 2998 (keeping 150 days of data) [2025-09-14T17:24:28.687350] [DEBUG] [LOCAL ] CIF: Primary data saved (2998 records). [2025-09-14T17:24:28.687478] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-14T17:24:28.687652] [INFO ] [MAIN ] Update Progress: 450/2370 symbols completed. CIF took 21.0s. Estimated remaining: 3h 21m 45s. Rate: 9.5 symbols/min [2025-09-14T17:24:28.859681] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:28.879964] [DEBUG] [LOCAL ] CIM: Loaded 15669 existing records from primary storage. [2025-09-14T17:24:28.880181] [INFO ] [MAIN ] CIM: Loaded 15669 existing records. [2025-09-14T17:24:29.060683] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:29.060958] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-14T17:24:29.061034] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-14T17:24:29.061583] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-14T17:24:29.061667] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-14T17:24:29.363917] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-14T17:24:29.419811] [INFO ] [REMOTE ] CIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:30.158841] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-14T17:24:30.286145] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T17:24:30.285963] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:24:30.300610] [INFO ] [REMOTE ] CII: Full fetch complete (16967 records). [2025-09-14T17:24:30.301278] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-14T17:24:30.676154] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-14T17:24:30.676286] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-14T17:24:30.676750] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-14T17:24:30.676816] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-14T17:24:30.677353] [DEBUG] [LOCAL ] CII: Trimmed 16967 records to 10502 (keeping 150 days of data) [2025-09-14T17:24:30.741295] [DEBUG] [LOCAL ] CII: Primary data saved (10502 records). [2025-09-14T17:24:30.741470] [INFO ] [MAIN ] CII: Full history saved. [2025-09-14T17:24:30.741589] [INFO ] [MAIN ] Update Progress: 451/2370 symbols completed. CII took 18.4s. Estimated remaining: 3h 21m 20s. Rate: 9.5 symbols/min [2025-09-14T17:24:30.919000] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:30.921888] [DEBUG] [LOCAL ] CIMN: Loaded 993 existing records from primary storage. [2025-09-14T17:24:30.922008] [INFO ] [MAIN ] CIMN: Loaded 993 existing records. [2025-09-14T17:24:30.965361] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-14T17:24:31.103309] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:31.103625] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-14T17:24:31.103710] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-14T17:24:31.103929] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-14T17:24:31.103995] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-14T17:24:31.523254] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:31.678614] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:24:31.684328] [INFO ] [REMOTE ] CIEN: Full fetch complete (56641 records). [2025-09-14T17:24:31.684479] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-14T17:24:31.760996] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-14T17:24:31.820600] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:24:32.113780] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-14T17:24:32.113909] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-14T17:24:32.114883] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-14T17:24:32.114968] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-14T17:24:32.116420] [DEBUG] [LOCAL ] CIEN: Trimmed 56641 records to 39027 (keeping 150 days of data) [2025-09-14T17:24:32.338343] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T17:24:32.371472] [DEBUG] [LOCAL ] CIEN: Primary data saved (39027 records). [2025-09-14T17:24:32.371681] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-14T17:24:32.371810] [INFO ] [MAIN ] Update Progress: 452/2370 symbols completed. CIEN took 26.2s. Estimated remaining: 3h 20m 54s. Rate: 9.5 symbols/min [2025-09-14T17:24:32.551574] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:32.555049] [DEBUG] [LOCAL ] CIMO: Loaded 1450 existing records from primary storage. [2025-09-14T17:24:32.555145] [INFO ] [MAIN ] CIMO: Loaded 1450 existing records. [2025-09-14T17:24:32.565897] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-14T17:24:32.734686] [WARN ] [MAIN ] CIMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:32.734953] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-14T17:24:32.735012] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-14T17:24:32.735239] [DEBUG] [LOCAL ] CIMO: Deleted primary data file. [2025-09-14T17:24:32.735298] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-14T17:24:33.089966] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:33.358850] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-14T17:24:33.844066] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T17:24:34.158884] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-14T17:24:34.397704] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T17:24:34.656041] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T17:24:34.958904] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-14T17:24:35.758880] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-14T17:24:36.444407] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T17:24:36.558837] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-14T17:24:36.885477] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-14T17:24:37.358894] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-14T17:24:37.739204] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T17:24:38.158851] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-14T17:24:38.627738] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T17:24:38.958829] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-14T17:24:39.144886] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (4.19 seconds). [2025-09-14T17:24:39.495866] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:24:39.758881] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-14T17:24:40.558869] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-14T17:24:41.323825] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T17:24:41.358832] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-14T17:24:41.842251] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T17:24:41.957007] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T17:24:42.158822] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-14T17:24:42.623632] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-14T17:24:42.958886] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-14T17:24:43.553717] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T17:24:43.758828] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-14T17:24:44.272457] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T17:24:44.558835] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-14T17:24:45.063454] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:24:45.064590] [INFO ] [REMOTE ] CIMO: Full fetch complete (3136 records). [2025-09-14T17:24:45.064708] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-14T17:24:45.363964] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-14T17:24:45.434828] [DEBUG] [VALIDATOR ] CIMO: All expected trading days are present. [2025-09-14T17:24:45.435046] [DEBUG] [VALIDATOR ] CIMO: Primary data validation passed. [2025-09-14T17:24:45.435222] [INFO ] [MAIN ] CIMO: Fetched primary data is valid. [2025-09-14T17:24:45.435301] [DEBUG] [LOCAL ] CIMO: Saving primary data. [2025-09-14T17:24:45.436079] [DEBUG] [LOCAL ] CIMO: Trimmed 3136 records to 2054 (keeping 150 days of data) [2025-09-14T17:24:45.450474] [DEBUG] [LOCAL ] CIMO: Primary data saved (2054 records). [2025-09-14T17:24:45.450662] [INFO ] [MAIN ] CIMO: Full history saved. [2025-09-14T17:24:45.450810] [INFO ] [MAIN ] Update Progress: 453/2370 symbols completed. CIMO took 13.1s. Estimated remaining: 3h 21m 17s. Rate: 9.5 symbols/min [2025-09-14T17:24:45.626618] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:45.637414] [DEBUG] [LOCAL ] CINT: Loaded 7896 existing records from primary storage. [2025-09-14T17:24:45.637600] [INFO ] [MAIN ] CINT: Loaded 7896 existing records. [2025-09-14T17:24:45.814237] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:45.814510] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-14T17:24:45.814568] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-14T17:24:45.814924] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-14T17:24:45.814994] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-14T17:24:46.162222] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-14T17:24:46.165463] [INFO ] [REMOTE ] CINT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:46.507915] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-14T17:24:46.958881] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-14T17:24:47.060184] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T17:24:47.758807] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-14T17:24:48.020328] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T17:24:48.558880] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-14T17:24:49.261320] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T17:24:49.358873] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-14T17:24:49.734068] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T17:24:50.158883] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-14T17:24:50.412851] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T17:24:50.417869] [INFO ] [REMOTE ] CIG: Full fetch complete (46762 records). [2025-09-14T17:24:50.417982] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-14T17:24:50.792312] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-14T17:24:50.792428] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-14T17:24:50.793102] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-14T17:24:50.793163] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-14T17:24:50.794321] [DEBUG] [LOCAL ] CIG: Trimmed 46762 records to 33103 (keeping 150 days of data) [2025-09-14T17:24:50.971296] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-14T17:24:51.007085] [DEBUG] [LOCAL ] CIG: Primary data saved (33103 records). [2025-09-14T17:24:51.007269] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-14T17:24:51.007450] [INFO ] [MAIN ] Update Progress: 454/2370 symbols completed. CIG took 42.5s. Estimated remaining: 3h 21m 7s. Rate: 9.5 symbols/min [2025-09-14T17:24:51.180306] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:51.191955] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T17:24:51.205426] [DEBUG] [LOCAL ] CIO: Loaded 10012 existing records from primary storage. [2025-09-14T17:24:51.205632] [INFO ] [MAIN ] CIO: Loaded 10012 existing records. [2025-09-14T17:24:51.412039] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:51.412529] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-14T17:24:51.412606] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-14T17:24:51.413229] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-14T17:24:51.413323] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-14T17:24:51.504895] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T17:24:51.767484] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-14T17:24:51.788912] [INFO ] [REMOTE ] CIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:52.558831] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-14T17:24:52.812794] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T17:24:53.358884] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-14T17:24:53.723808] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T17:24:53.732875] [INFO ] [REMOTE ] CIMN: Full fetch complete (2884 records). [2025-09-14T17:24:53.745047] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-14T17:24:53.746407] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T17:24:54.113325] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-14T17:24:54.113436] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-14T17:24:54.113554] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-14T17:24:54.113605] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-14T17:24:54.114023] [DEBUG] [LOCAL ] CIMN: Trimmed 2884 records to 2000 (keeping 150 days of data) [2025-09-14T17:24:54.127620] [DEBUG] [LOCAL ] CIMN: Primary data saved (2000 records). [2025-09-14T17:24:54.127744] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-14T17:24:54.127869] [INFO ] [MAIN ] Update Progress: 455/2370 symbols completed. CIMN took 23.4s. Estimated remaining: 3h 20m 47s. Rate: 9.5 symbols/min [2025-09-14T17:24:54.164073] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-14T17:24:54.303969] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:54.321130] [DEBUG] [LOCAL ] CION: Loaded 11783 existing records from primary storage. [2025-09-14T17:24:54.321339] [INFO ] [MAIN ] CION: Loaded 11783 existing records. [2025-09-14T17:24:54.494177] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:54.494463] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-14T17:24:54.494526] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-14T17:24:54.494953] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-14T17:24:54.495017] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-14T17:24:54.862429] [INFO ] [REMOTE ] CION: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:54.958818] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-14T17:24:55.677700] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T17:24:55.734187] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T17:24:55.758831] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-14T17:24:56.558905] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-14T17:24:57.027844] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T17:24:57.358852] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-14T17:24:57.562394] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:24:57.972877] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:24:58.158852] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-14T17:24:58.958866] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-14T17:24:59.039831] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T17:24:59.758793] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-14T17:24:59.901667] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T17:25:00.519527] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:25:00.558807] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-14T17:25:01.358831] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-14T17:25:01.844844] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T17:25:01.851002] [INFO ] [REMOTE ] CIM: Full fetch complete (40697 records). [2025-09-14T17:25:01.851287] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-14T17:25:02.167555] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-14T17:25:02.310068] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-14T17:25:02.310259] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-14T17:25:02.311374] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-14T17:25:02.311445] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-14T17:25:02.313272] [DEBUG] [LOCAL ] CIM: Trimmed 40697 records to 27047 (keeping 150 days of data) [2025-09-14T17:25:02.455027] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:25:02.527243] [DEBUG] [LOCAL ] CIM: Primary data saved (27047 records). [2025-09-14T17:25:02.527506] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-14T17:25:02.527782] [INFO ] [MAIN ] Update Progress: 456/2370 symbols completed. CIM took 33.8s. Estimated remaining: 3h 20m 50s. Rate: 9.5 symbols/min [2025-09-14T17:25:02.706138] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:02.732010] [DEBUG] [LOCAL ] CIVI: Loaded 23663 existing records from primary storage. [2025-09-14T17:25:02.732241] [INFO ] [MAIN ] CIVI: Loaded 23663 existing records. [2025-09-14T17:25:02.935205] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:02.935554] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-14T17:25:02.935623] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-14T17:25:02.936411] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-14T17:25:02.936482] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-14T17:25:02.967945] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-14T17:25:03.312862] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:03.328600] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:25:03.758847] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-14T17:25:04.214664] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:25:04.558940] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-14T17:25:04.937023] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T17:25:05.358874] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-14T17:25:06.100700] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T17:25:06.158848] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-14T17:25:06.169024] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:25:06.172408] [INFO ] [REMOTE ] CINT: Full fetch complete (19704 records). [2025-09-14T17:25:06.172617] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-14T17:25:06.549692] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-14T17:25:06.549806] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-14T17:25:06.550202] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-14T17:25:06.550256] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-14T17:25:06.550863] [DEBUG] [LOCAL ] CINT: Trimmed 19704 records to 13273 (keeping 150 days of data) [2025-09-14T17:25:06.627990] [DEBUG] [LOCAL ] CINT: Primary data saved (13273 records). [2025-09-14T17:25:06.628182] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-14T17:25:06.628298] [INFO ] [MAIN ] Update Progress: 457/2370 symbols completed. CINT took 21.2s. Estimated remaining: 3h 20m 34s. Rate: 9.5 symbols/min [2025-09-14T17:25:06.803250] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:06.829607] [DEBUG] [LOCAL ] CL: Loaded 24068 existing records from primary storage. [2025-09-14T17:25:06.829804] [INFO ] [MAIN ] CL: Loaded 24068 existing records. [2025-09-14T17:25:06.964058] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-14T17:25:07.021836] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:07.022186] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-14T17:25:07.022296] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-14T17:25:07.023349] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-14T17:25:07.023623] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-14T17:25:07.394589] [INFO ] [REMOTE ] CL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:07.739988] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:25:07.758778] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-14T17:25:08.558906] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-14T17:25:08.783329] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T17:25:08.907505] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T17:25:09.358843] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-14T17:25:09.550079] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:25:10.158825] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-14T17:25:10.958799] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-14T17:25:11.320139] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T17:25:11.422979] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T17:25:11.758838] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-14T17:25:12.558877] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-14T17:25:12.661920] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:25:12.689728] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:25:13.358832] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-14T17:25:14.158865] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-14T17:25:14.468205] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:25:14.958804] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-14T17:25:15.090447] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T17:25:15.415210] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:25:15.758783] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-14T17:25:16.211829] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T17:25:16.558799] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-14T17:25:16.914801] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:25:17.272996] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:25:17.275994] [INFO ] [REMOTE ] CION: Full fetch complete (31319 records). [2025-09-14T17:25:17.276099] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-14T17:25:17.364023] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-14T17:25:17.648469] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-14T17:25:17.648576] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-14T17:25:17.649139] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-14T17:25:17.649198] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-14T17:25:17.650006] [DEBUG] [LOCAL ] CION: Trimmed 31319 records to 20633 (keeping 150 days of data) [2025-09-14T17:25:17.779106] [DEBUG] [LOCAL ] CION: Primary data saved (20633 records). [2025-09-14T17:25:17.779275] [INFO ] [MAIN ] CION: Full history saved. [2025-09-14T17:25:17.779365] [INFO ] [MAIN ] Update Progress: 458/2370 symbols completed. CION took 23.7s. Estimated remaining: 3h 20m 48s. Rate: 9.5 symbols/min [2025-09-14T17:25:17.947757] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:17.965462] [DEBUG] [LOCAL ] CLB: Loaded 14776 existing records from primary storage. [2025-09-14T17:25:17.965661] [INFO ] [MAIN ] CLB: Loaded 14776 existing records. [2025-09-14T17:25:18.142675] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:18.149017] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T17:25:18.149152] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-14T17:25:18.151337] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-14T17:25:18.151935] [INFO ] [REMOTE ] CIO: Full fetch complete (21194 records). [2025-09-14T17:25:18.152027] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-14T17:25:18.163862] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-14T17:25:18.163909] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-14T17:25:18.229327] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-14T17:25:18.868225] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-14T17:25:18.883819] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-14T17:25:18.890050] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-14T17:25:18.889387] [INFO ] [REMOTE ] CLB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:18.890215] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-14T17:25:18.891354] [DEBUG] [LOCAL ] CIO: Trimmed 21194 records to 14685 (keeping 150 days of data) [2025-09-14T17:25:18.958811] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-14T17:25:18.979149] [DEBUG] [LOCAL ] CIO: Primary data saved (14685 records). [2025-09-14T17:25:18.979675] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-14T17:25:18.979794] [INFO ] [MAIN ] Update Progress: 459/2370 symbols completed. CIO took 28.0s. Estimated remaining: 3h 20m 21s. Rate: 9.5 symbols/min [2025-09-14T17:25:19.150531] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:19.156415] [DEBUG] [LOCAL ] CLCO: Loaded 4165 existing records from primary storage. [2025-09-14T17:25:19.156551] [INFO ] [MAIN ] CLCO: Loaded 4165 existing records. [2025-09-14T17:25:19.333664] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:19.333927] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-14T17:25:19.333988] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-14T17:25:19.334283] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-14T17:25:19.334341] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-14T17:25:19.724129] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:19.758787] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-14T17:25:19.817535] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:25:20.558806] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-14T17:25:20.701651] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:25:20.756312] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:25:21.358826] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-14T17:25:22.158833] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-14T17:25:22.522318] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:25:22.551032] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:25:22.958853] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-14T17:25:23.758866] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-14T17:25:24.056725] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:25:24.558840] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-14T17:25:24.804815] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T17:25:25.203774] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T17:25:25.358823] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-14T17:25:25.764818] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T17:25:26.158878] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-14T17:25:26.958794] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-14T17:25:27.406058] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T17:25:27.619887] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T17:25:27.758785] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-14T17:25:28.044813] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:25:28.394864] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:25:28.400384] [INFO ] [REMOTE ] CIVI: Full fetch complete (57099 records). [2025-09-14T17:25:28.400525] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-14T17:25:28.560899] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-14T17:25:28.787470] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-14T17:25:28.787581] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-14T17:25:28.788337] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-14T17:25:28.788399] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-14T17:25:28.789665] [DEBUG] [LOCAL ] CIVI: Trimmed 57099 records to 39579 (keeping 150 days of data) [2025-09-14T17:25:29.040829] [DEBUG] [LOCAL ] CIVI: Primary data saved (39579 records). [2025-09-14T17:25:29.041016] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-14T17:25:29.041119] [INFO ] [MAIN ] Update Progress: 460/2370 symbols completed. CIVI took 26.5s. Estimated remaining: 3h 20m 30s. Rate: 9.5 symbols/min [2025-09-14T17:25:29.209062] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:29.219864] [DEBUG] [LOCAL ] CLDT: Loaded 9785 existing records from primary storage. [2025-09-14T17:25:29.220018] [INFO ] [MAIN ] CLDT: Loaded 9785 existing records. [2025-09-14T17:25:29.364019] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-14T17:25:29.400124] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:29.400447] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-14T17:25:29.400512] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-14T17:25:29.400966] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-14T17:25:29.401029] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-14T17:25:29.765969] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:30.158880] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-14T17:25:30.371206] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:25:30.585779] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T17:25:30.958814] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-14T17:25:31.081007] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:25:31.582996] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T17:25:31.758828] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-14T17:25:32.350904] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T17:25:32.558864] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-14T17:25:33.358829] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-14T17:25:33.720088] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:25:34.158861] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-14T17:25:34.965000] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-14T17:25:34.976466] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T17:25:35.154017] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T17:25:35.554578] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:25:35.560308] [INFO ] [REMOTE ] CL: Full fetch complete (58319 records). [2025-09-14T17:25:35.560467] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-14T17:25:35.767579] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-14T17:25:35.952015] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-14T17:25:35.952168] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-14T17:25:35.952925] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-14T17:25:35.953009] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-14T17:25:35.954365] [DEBUG] [LOCAL ] CL: Trimmed 58319 records to 40389 (keeping 150 days of data) [2025-09-14T17:25:36.208613] [DEBUG] [LOCAL ] CL: Primary data saved (40389 records). [2025-09-14T17:25:36.208818] [INFO ] [MAIN ] CL: Full history saved. [2025-09-14T17:25:36.208975] [INFO ] [MAIN ] Update Progress: 461/2370 symbols completed. CL took 29.6s. Estimated remaining: 3h 20m 28s. Rate: 9.5 symbols/min [2025-09-14T17:25:36.378895] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:36.402134] [DEBUG] [LOCAL ] CLF: Loaded 24103 existing records from primary storage. [2025-09-14T17:25:36.402329] [INFO ] [MAIN ] CLF: Loaded 24103 existing records. [2025-09-14T17:25:36.567509] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-14T17:25:36.588455] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:36.589559] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-14T17:25:36.589661] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-14T17:25:36.590503] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-14T17:25:36.590621] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-14T17:25:36.941706] [INFO ] [REMOTE ] CLF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:37.118029] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T17:25:37.358810] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-14T17:25:37.491323] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T17:25:38.158893] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-14T17:25:38.453268] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T17:25:38.958845] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-14T17:25:39.758811] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-14T17:25:40.085239] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T17:25:40.267205] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T17:25:40.558803] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-14T17:25:40.840802] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:25:41.281978] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:25:41.283365] [INFO ] [REMOTE ] CLCO: Full fetch complete (15682 records). [2025-09-14T17:25:41.283457] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-14T17:25:41.363923] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-14T17:25:41.660203] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-14T17:25:41.660695] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-14T17:25:41.661152] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-14T17:25:41.661220] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-14T17:25:41.661777] [DEBUG] [LOCAL ] CLCO: Trimmed 15682 records to 8144 (keeping 150 days of data) [2025-09-14T17:25:41.707441] [DEBUG] [LOCAL ] CLCO: Primary data saved (8144 records). [2025-09-14T17:25:41.707607] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-14T17:25:41.707725] [INFO ] [MAIN ] Update Progress: 462/2370 symbols completed. CLCO took 22.7s. Estimated remaining: 3h 20m 18s. Rate: 9.5 symbols/min [2025-09-14T17:25:41.876030] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:41.888860] [DEBUG] [LOCAL ] CLH: Loaded 11741 existing records from primary storage. [2025-09-14T17:25:41.889006] [INFO ] [MAIN ] CLH: Loaded 11741 existing records. [2025-09-14T17:25:42.063065] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:42.063336] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-14T17:25:42.063400] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-14T17:25:42.064013] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-14T17:25:42.064077] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-14T17:25:42.161829] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-14T17:25:42.419889] [INFO ] [REMOTE ] CLH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:42.958808] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-14T17:25:43.302141] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T17:25:43.643276] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-14T17:25:43.758787] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-14T17:25:44.066629] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T17:25:44.558830] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-14T17:25:45.358801] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-14T17:25:45.544535] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:25:45.648034] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:25:46.158878] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-14T17:25:46.781451] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T17:25:46.958826] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-14T17:25:47.758848] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-14T17:25:47.920517] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T17:25:47.923571] [INFO ] [REMOTE ] CLDT: Full fetch complete (28559 records). [2025-09-14T17:25:47.923700] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-14T17:25:48.292117] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-14T17:25:48.292237] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-14T17:25:48.292823] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-14T17:25:48.292882] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-14T17:25:48.293633] [DEBUG] [LOCAL ] CLDT: Trimmed 28559 records to 18061 (keeping 150 days of data) [2025-09-14T17:25:48.397217] [DEBUG] [LOCAL ] CLDT: Primary data saved (18061 records). [2025-09-14T17:25:48.397538] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-14T17:25:48.397779] [INFO ] [MAIN ] Update Progress: 463/2370 symbols completed. CLDT took 19.4s. Estimated remaining: 3h 20m 13s. Rate: 9.5 symbols/min [2025-09-14T17:25:48.580138] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:48.580358] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-14T17:25:48.621265] [DEBUG] [LOCAL ] CLPR: Loaded 4720 existing records from primary storage. [2025-09-14T17:25:48.624006] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-14T17:25:48.624278] [INFO ] [MAIN ] CLPR: Loaded 4720 existing records. [2025-09-14T17:25:48.822783] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:48.823388] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-14T17:25:48.823535] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-14T17:25:48.824249] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-14T17:25:48.824328] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-14T17:25:48.975670] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T17:25:49.223634] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:49.358801] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-14T17:25:50.067991] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:25:50.132192] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T17:25:50.158860] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-14T17:25:50.958838] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-14T17:25:51.758831] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-14T17:25:51.911190] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T17:25:52.343574] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T17:25:52.558880] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-14T17:25:52.879818] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:25:52.883798] [INFO ] [REMOTE ] CLB: Full fetch complete (35798 records). [2025-09-14T17:25:52.883926] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-14T17:25:53.262285] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-14T17:25:53.268141] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-14T17:25:53.277724] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-14T17:25:53.277831] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-14T17:25:53.279039] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T17:25:53.286007] [DEBUG] [LOCAL ] CLB: Trimmed 35798 records to 24690 (keeping 150 days of data) [2025-09-14T17:25:53.377133] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-14T17:25:53.444284] [DEBUG] [LOCAL ] CLB: Primary data saved (24690 records). [2025-09-14T17:25:53.444466] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-14T17:25:53.444669] [INFO ] [MAIN ] Update Progress: 464/2370 symbols completed. CLB took 35.7s. Estimated remaining: 3h 20m 2s. Rate: 9.5 symbols/min [2025-09-14T17:25:53.618265] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:53.642879] [DEBUG] [LOCAL ] CLS: Loaded 24046 existing records from primary storage. [2025-09-14T17:25:53.643061] [INFO ] [MAIN ] CLS: Loaded 24046 existing records. [2025-09-14T17:25:53.822460] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:53.822773] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-14T17:25:53.822870] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-14T17:25:53.823532] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-14T17:25:53.823597] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-14T17:25:54.169322] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-14T17:25:54.187547] [INFO ] [REMOTE ] CLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:54.307473] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:25:54.958835] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-14T17:25:55.158537] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T17:25:55.758864] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-14T17:25:56.558863] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-14T17:25:57.123481] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T17:25:57.233766] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-14T17:25:57.358832] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-14T17:25:57.550203] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T17:25:58.158885] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-14T17:25:58.958858] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-14T17:25:59.600109] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T17:25:59.653797] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:25:59.758797] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-14T17:25:59.877993] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-14T17:26:00.240744] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T17:26:00.243630] [INFO ] [REMOTE ] CLH: Full fetch complete (31825 records). [2025-09-14T17:26:00.243742] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-14T17:26:00.563999] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-14T17:26:00.631882] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-14T17:26:00.632122] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-14T17:26:00.632885] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-14T17:26:00.632950] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-14T17:26:00.634267] [DEBUG] [LOCAL ] CLH: Trimmed 31825 records to 20164 (keeping 150 days of data) [2025-09-14T17:26:00.762834] [DEBUG] [LOCAL ] CLH: Primary data saved (20164 records). [2025-09-14T17:26:00.763008] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-14T17:26:00.763121] [INFO ] [MAIN ] Update Progress: 465/2370 symbols completed. CLH took 19.1s. Estimated remaining: 3h 19m 60s. Rate: 9.5 symbols/min [2025-09-14T17:26:00.933865] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:00.960132] [DEBUG] [LOCAL ] CLVT: Loaded 23363 existing records from primary storage. [2025-09-14T17:26:00.960359] [INFO ] [MAIN ] CLVT: Loaded 23363 existing records. [2025-09-14T17:26:01.140031] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:01.140335] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-14T17:26:01.140402] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-14T17:26:01.141074] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-14T17:26:01.141145] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-14T17:26:01.367984] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-14T17:26:01.494692] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:02.158868] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-14T17:26:02.229374] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:26:02.958890] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-14T17:26:03.054111] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T17:26:03.716813] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T17:26:03.756446] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T17:26:03.759465] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-14T17:26:04.558918] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-14T17:26:05.354188] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:26:05.364743] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-14T17:26:06.158900] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-14T17:26:06.212941] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T17:26:06.958810] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-14T17:26:07.028129] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-14T17:26:07.684900] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:26:07.686347] [INFO ] [REMOTE ] CLPR: Full fetch complete (12546 records). [2025-09-14T17:26:07.686443] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-14T17:26:07.763955] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-14T17:26:08.055679] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-14T17:26:08.055845] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-14T17:26:08.056244] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-14T17:26:08.056419] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-14T17:26:08.057140] [DEBUG] [LOCAL ] CLPR: Trimmed 12546 records to 7910 (keeping 150 days of data) [2025-09-14T17:26:08.133459] [DEBUG] [LOCAL ] CLPR: Primary data saved (7910 records). [2025-09-14T17:26:08.134879] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:26:08.146185] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-14T17:26:08.146728] [INFO ] [MAIN ] Update Progress: 466/2370 symbols completed. CLPR took 19.7s. Estimated remaining: 3h 19m 58s. Rate: 9.5 symbols/min [2025-09-14T17:26:08.314143] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:08.328347] [DEBUG] [LOCAL ] CLW: Loaded 9293 existing records from primary storage. [2025-09-14T17:26:08.328520] [INFO ] [MAIN ] CLW: Loaded 9293 existing records. [2025-09-14T17:26:08.503542] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:08.503863] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-14T17:26:08.503934] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-14T17:26:08.504257] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-14T17:26:08.504316] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-14T17:26:08.565710] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-14T17:26:08.888415] [INFO ] [REMOTE ] CLW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:09.358835] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-14T17:26:10.060032] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-14T17:26:10.086160] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:26:10.091717] [INFO ] [REMOTE ] CLF: Full fetch complete (58422 records). [2025-09-14T17:26:10.091868] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-14T17:26:10.165171] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-14T17:26:10.476331] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-14T17:26:10.476546] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-14T17:26:10.477411] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-14T17:26:10.477576] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-14T17:26:10.479264] [DEBUG] [LOCAL ] CLF: Trimmed 58422 records to 40482 (keeping 150 days of data) [2025-09-14T17:26:10.593367] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T17:26:10.759210] [DEBUG] [LOCAL ] CLF: Primary data saved (40482 records). [2025-09-14T17:26:10.759390] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-14T17:26:10.759504] [INFO ] [MAIN ] Update Progress: 467/2370 symbols completed. CLF took 34.6s. Estimated remaining: 3h 19m 37s. Rate: 9.5 symbols/min [2025-09-14T17:26:10.932716] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:10.955906] [DEBUG] [LOCAL ] CLX: Loaded 23523 existing records from primary storage. [2025-09-14T17:26:10.956064] [INFO ] [MAIN ] CLX: Loaded 23523 existing records. [2025-09-14T17:26:10.961703] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-14T17:26:11.133136] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:11.133406] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-14T17:26:11.133468] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-14T17:26:11.134347] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-14T17:26:11.134416] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-14T17:26:11.497331] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:26:11.516070] [INFO ] [REMOTE ] CLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:11.758824] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-14T17:26:12.558836] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-14T17:26:13.335019] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-14T17:26:13.358791] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-14T17:26:13.483909] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T17:26:14.158846] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-14T17:26:14.222988] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:26:14.958896] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-14T17:26:15.362777] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T17:26:15.390869] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T17:26:15.758959] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-14T17:26:16.558910] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-14T17:26:16.756765] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:26:17.358859] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-14T17:26:18.016601] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-14T17:26:18.063603] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T17:26:18.158783] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-14T17:26:18.958854] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-14T17:26:19.271809] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T17:26:19.758861] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-14T17:26:20.010255] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:26:20.558905] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-14T17:26:20.613150] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-14T17:26:20.618836] [INFO ] [REMOTE ] CLS: Full fetch complete (58325 records). [2025-09-14T17:26:20.619009] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-14T17:26:21.004859] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-14T17:26:21.004962] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-14T17:26:21.009008] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-14T17:26:21.009142] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-14T17:26:21.010540] [DEBUG] [LOCAL ] CLS: Trimmed 58325 records to 40398 (keeping 150 days of data) [2025-09-14T17:26:21.131382] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:26:21.293345] [DEBUG] [LOCAL ] CLS: Primary data saved (40398 records). [2025-09-14T17:26:21.293513] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-14T17:26:21.293614] [INFO ] [MAIN ] Update Progress: 468/2370 symbols completed. CLS took 27.8s. Estimated remaining: 3h 19m 47s. Rate: 9.5 symbols/min [2025-09-14T17:26:21.368132] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-14T17:26:21.464631] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:21.485577] [DEBUG] [LOCAL ] CM: Loaded 22350 existing records from primary storage. [2025-09-14T17:26:21.485852] [INFO ] [MAIN ] CM: Loaded 22350 existing records. [2025-09-14T17:26:21.659858] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:21.660140] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-14T17:26:21.660200] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-14T17:26:21.660844] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-14T17:26:21.660912] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-14T17:26:22.017891] [INFO ] [REMOTE ] CM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:22.158870] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-14T17:26:22.335244] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T17:26:22.493223] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T17:26:22.958841] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-14T17:26:23.758888] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-14T17:26:23.865840] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:26:24.022611] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:26:24.558832] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-14T17:26:25.138316] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:26:25.358845] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-14T17:26:26.136990] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T17:26:26.143102] [INFO ] [REMOTE ] CLVT: Full fetch complete (56682 records). [2025-09-14T17:26:26.143289] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-14T17:26:26.165517] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-14T17:26:26.546078] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-14T17:26:26.546312] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-14T17:26:26.547104] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-14T17:26:26.547250] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-14T17:26:26.561376] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T17:26:26.566244] [DEBUG] [LOCAL ] CLVT: Trimmed 56682 records to 39160 (keeping 150 days of data) [2025-09-14T17:26:26.807091] [DEBUG] [LOCAL ] CLVT: Primary data saved (39160 records). [2025-09-14T17:26:26.807303] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-14T17:26:26.807412] [INFO ] [MAIN ] Update Progress: 469/2370 symbols completed. CLVT took 26.0s. Estimated remaining: 3h 19m 38s. Rate: 9.5 symbols/min [2025-09-14T17:26:26.967377] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-14T17:26:27.008013] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:27.038953] [DEBUG] [LOCAL ] CMA: Loaded 22691 existing records from primary storage. [2025-09-14T17:26:27.039165] [INFO ] [MAIN ] CMA: Loaded 22691 existing records. [2025-09-14T17:26:27.233835] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:27.234293] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-14T17:26:27.234364] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-14T17:26:27.235076] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-14T17:26:27.235171] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-14T17:26:27.612181] [INFO ] [REMOTE ] CMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:27.758870] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-14T17:26:27.878583] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T17:26:28.252671] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:26:28.558838] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-14T17:26:29.102015] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:26:29.105857] [INFO ] [REMOTE ] CLW: Full fetch complete (24670 records). [2025-09-14T17:26:29.105960] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-14T17:26:29.364590] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-14T17:26:29.509231] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-14T17:26:29.510223] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-14T17:26:29.511018] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-14T17:26:29.511091] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-14T17:26:29.512470] [DEBUG] [LOCAL ] CLW: Trimmed 24670 records to 15967 (keeping 150 days of data) [2025-09-14T17:26:29.628316] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T17:26:29.663009] [DEBUG] [LOCAL ] CLW: Primary data saved (15967 records). [2025-09-14T17:26:29.663208] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-14T17:26:29.663376] [INFO ] [MAIN ] Update Progress: 470/2370 symbols completed. CLW took 21.5s. Estimated remaining: 3h 19m 18s. Rate: 9.5 symbols/min [2025-09-14T17:26:29.833742] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:29.846445] [DEBUG] [LOCAL ] CMBT: Loaded 11271 existing records from primary storage. [2025-09-14T17:26:29.846631] [INFO ] [MAIN ] CMBT: Loaded 11271 existing records. [2025-09-14T17:26:30.026225] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:30.026488] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-14T17:26:30.026546] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-14T17:26:30.026998] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-14T17:26:30.027060] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-14T17:26:30.173792] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-14T17:26:30.398427] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:30.958868] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-14T17:26:31.088036] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T17:26:31.548246] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:26:31.758912] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-14T17:26:31.835557] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:26:32.558913] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-14T17:26:33.358907] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-14T17:26:33.712771] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T17:26:34.086697] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T17:26:34.158792] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-14T17:26:34.262435] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:26:34.958915] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-14T17:26:35.242764] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:26:35.758874] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-14T17:26:36.558843] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-14T17:26:36.809552] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:26:37.358887] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-14T17:26:37.652132] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T17:26:37.676831] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T17:26:38.158838] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-14T17:26:38.588504] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:26:38.807923] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:26:38.814540] [INFO ] [REMOTE ] CLX: Full fetch complete (55656 records). [2025-09-14T17:26:38.814791] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-14T17:26:38.965390] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-14T17:26:39.193689] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-14T17:26:39.193797] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-14T17:26:39.194517] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-14T17:26:39.194584] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-14T17:26:39.195846] [DEBUG] [LOCAL ] CLX: Trimmed 55656 records to 39046 (keeping 150 days of data) [2025-09-14T17:26:39.452140] [DEBUG] [LOCAL ] CLX: Primary data saved (39046 records). [2025-09-14T17:26:39.452339] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-14T17:26:39.452461] [INFO ] [MAIN ] Update Progress: 471/2370 symbols completed. CLX took 28.7s. Estimated remaining: 3h 19m 26s. Rate: 9.5 symbols/min [2025-09-14T17:26:39.618246] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:39.638769] [DEBUG] [LOCAL ] CMC: Loaded 19969 existing records from primary storage. [2025-09-14T17:26:39.638939] [INFO ] [MAIN ] CMC: Loaded 19969 existing records. [2025-09-14T17:26:39.763882] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-14T17:26:39.812584] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:39.812791] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-14T17:26:39.812849] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-14T17:26:39.813534] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-14T17:26:39.813598] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-14T17:26:40.164314] [INFO ] [REMOTE ] CMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:40.558799] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-14T17:26:40.702894] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:26:41.338304] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:26:41.358772] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-14T17:26:41.484310] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T17:26:42.086662] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T17:26:42.158798] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-14T17:26:42.958831] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-14T17:26:43.653584] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T17:26:43.758789] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-14T17:26:44.536984] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T17:26:44.558779] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-14T17:26:44.950181] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:26:44.955354] [INFO ] [REMOTE ] CMBT: Full fetch complete (21467 records). [2025-09-14T17:26:44.955490] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-14T17:26:45.321933] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-14T17:26:45.322044] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-14T17:26:45.322469] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-14T17:26:45.322523] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-14T17:26:45.323187] [DEBUG] [LOCAL ] CMBT: Trimmed 21467 records to 16797 (keeping 150 days of data) [2025-09-14T17:26:45.364395] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-14T17:26:45.428676] [DEBUG] [LOCAL ] CMBT: Primary data saved (16797 records). [2025-09-14T17:26:45.428942] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-14T17:26:45.429060] [INFO ] [MAIN ] Update Progress: 472/2370 symbols completed. CMBT took 15.8s. Estimated remaining: 3h 19m 18s. Rate: 9.5 symbols/min [2025-09-14T17:26:45.601553] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:45.606357] [DEBUG] [LOCAL ] CMCM: Loaded 2696 existing records from primary storage. [2025-09-14T17:26:45.606539] [INFO ] [MAIN ] CMCM: Loaded 2696 existing records. [2025-09-14T17:26:45.789891] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:45.790211] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-14T17:26:45.790282] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-14T17:26:45.790562] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-14T17:26:45.790631] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-14T17:26:46.137833] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:46.158791] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-14T17:26:46.327303] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:26:46.806436] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T17:26:46.958839] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-14T17:26:47.100738] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:26:47.604972] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:26:47.758860] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-14T17:26:48.259707] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T17:26:48.558864] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-14T17:26:49.358874] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-14T17:26:50.158901] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-14T17:26:50.322374] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:26:50.462689] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T17:26:50.958833] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-14T17:26:51.360446] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T17:26:51.758885] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-14T17:26:52.558876] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-14T17:26:52.868499] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T17:26:53.199840] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:26:53.205054] [INFO ] [REMOTE ] CMA: Full fetch complete (54828 records). [2025-09-14T17:26:53.205188] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-14T17:26:53.360776] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-14T17:26:53.512841] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-14T17:26:53.538363] [INFO ] [REMOTE ] CM: Full fetch complete (52616 records). [2025-09-14T17:26:53.579398] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-14T17:26:53.630037] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-14T17:26:53.630288] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-14T17:26:53.631089] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-14T17:26:53.631167] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-14T17:26:53.715577] [DEBUG] [LOCAL ] CMA: Trimmed 54828 records to 37599 (keeping 150 days of data) [2025-09-14T17:26:54.154898] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-14T17:26:54.156395] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-14T17:26:54.157572] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-14T17:26:54.157952] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-14T17:26:54.159110] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-14T17:26:54.163442] [DEBUG] [LOCAL ] CM: Trimmed 52616 records to 36406 (keeping 150 days of data) [2025-09-14T17:26:54.474273] [DEBUG] [LOCAL ] CMA: Primary data saved (37599 records). [2025-09-14T17:26:54.495141] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-14T17:26:54.495700] [INFO ] [MAIN ] Update Progress: 473/2370 symbols completed. CMA took 27.7s. Estimated remaining: 3h 19m 23s. Rate: 9.5 symbols/min [2025-09-14T17:26:54.682036] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:54.692722] [DEBUG] [LOCAL ] CMDB: Loaded 6216 existing records from primary storage. [2025-09-14T17:26:54.694294] [INFO ] [MAIN ] CMDB: Loaded 6216 existing records. [2025-09-14T17:26:54.767246] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T17:26:54.887381] [WARN ] [MAIN ] CMDB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:54.889944] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-14T17:26:54.891604] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-14T17:26:54.893181] [DEBUG] [LOCAL ] CMDB: Deleted primary data file. [2025-09-14T17:26:54.893826] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-14T17:26:54.896236] [DEBUG] [LOCAL ] CM: Primary data saved (36406 records). [2025-09-14T17:26:54.960695] [INFO ] [MAIN ] CM: Full history saved. [2025-09-14T17:26:54.960765] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-14T17:26:54.988182] [INFO ] [MAIN ] Update Progress: 474/2370 symbols completed. CM took 33.7s. Estimated remaining: 3h 18m 53s. Rate: 9.5 symbols/min [2025-09-14T17:26:55.358131] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:55.438664] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:55.484036] [DEBUG] [LOCAL ] CMG: Loaded 24089 existing records from primary storage. [2025-09-14T17:26:55.484548] [INFO ] [MAIN ] CMG: Loaded 24089 existing records. [2025-09-14T17:26:55.486437] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T17:26:55.674737] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:55.675072] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-14T17:26:55.678339] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-14T17:26:55.678475] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T17:26:55.679849] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-14T17:26:55.680131] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-14T17:26:55.764013] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-14T17:26:56.035530] [INFO ] [REMOTE ] CMG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:56.558881] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-14T17:26:57.100968] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T17:26:57.151932] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:26:57.358820] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-14T17:26:57.791010] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T17:26:58.158871] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-14T17:26:58.958831] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-14T17:26:59.210787] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:26:59.211128] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-14T17:26:59.758817] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-14T17:27:00.117459] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T17:27:00.558869] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-14T17:27:01.351950] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:27:01.355916] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T17:27:01.364587] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-14T17:27:01.367149] [INFO ] [REMOTE ] CMCM: Full fetch complete (5262 records). [2025-09-14T17:27:01.368413] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-14T17:27:01.750088] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-14T17:27:01.750206] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-14T17:27:01.750431] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-14T17:27:01.750520] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-14T17:27:01.751000] [DEBUG] [LOCAL ] CMCM: Trimmed 5262 records to 3310 (keeping 150 days of data) [2025-09-14T17:27:01.771432] [DEBUG] [LOCAL ] CMCM: Primary data saved (3310 records). [2025-09-14T17:27:01.771614] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-14T17:27:01.771737] [INFO ] [MAIN ] Update Progress: 475/2370 symbols completed. CMCM took 16.3s. Estimated remaining: 3h 18m 49s. Rate: 9.5 symbols/min [2025-09-14T17:27:01.950850] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:01.972581] [DEBUG] [LOCAL ] CMI: Loaded 18264 existing records from primary storage. [2025-09-14T17:27:01.972780] [INFO ] [MAIN ] CMI: Loaded 18264 existing records. [2025-09-14T17:27:02.158627] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:02.158862] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-14T17:27:02.159437] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-14T17:27:02.160608] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-14T17:27:02.161364] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-14T17:27:02.161434] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-14T17:27:02.355603] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:27:02.440520] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-14T17:27:02.550531] [INFO ] [REMOTE ] CMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:02.958895] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-14T17:27:03.758928] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-14T17:27:04.558885] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-14T17:27:04.838560] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:27:04.839047] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-14T17:27:05.311331] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T17:27:05.370475] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-14T17:27:05.373370] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:27:06.156268] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (4.00 seconds). [2025-09-14T17:27:06.167149] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-14T17:27:06.958823] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-14T17:27:07.015201] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T17:27:07.066982] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:27:07.758934] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-14T17:27:08.373540] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T17:27:08.379304] [INFO ] [REMOTE ] CMC: Full fetch complete (49847 records). [2025-09-14T17:27:08.379508] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-14T17:27:08.561793] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-14T17:27:08.930829] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-14T17:27:08.931221] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-14T17:27:08.932713] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-14T17:27:08.932956] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-14T17:27:08.935221] [DEBUG] [LOCAL ] CMC: Trimmed 49847 records to 33573 (keeping 150 days of data) [2025-09-14T17:27:09.118376] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-14T17:27:09.313884] [DEBUG] [LOCAL ] CMC: Primary data saved (33573 records). [2025-09-14T17:27:09.314147] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-14T17:27:09.314309] [INFO ] [MAIN ] Update Progress: 476/2370 symbols completed. CMC took 29.9s. Estimated remaining: 3h 18m 48s. Rate: 9.5 symbols/min [2025-09-14T17:27:09.366141] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-14T17:27:09.532969] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:09.548105] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:27:09.566212] [DEBUG] [LOCAL ] CMP: Loaded 15689 existing records from primary storage. [2025-09-14T17:27:09.566415] [INFO ] [MAIN ] CMP: Loaded 15689 existing records. [2025-09-14T17:27:09.755568] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:09.755873] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-14T17:27:09.755941] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-14T17:27:09.756501] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-14T17:27:09.756571] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-14T17:27:10.127626] [INFO ] [REMOTE ] CMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:10.158808] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-14T17:27:10.958908] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-14T17:27:11.078764] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T17:27:11.674045] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:27:11.760350] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-14T17:27:11.761305] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T17:27:12.558844] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-14T17:27:13.358842] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-14T17:27:13.391296] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T17:27:13.633612] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:27:14.158845] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-14T17:27:14.958824] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-14T17:27:14.984808] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:27:15.758833] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-14T17:27:16.091386] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T17:27:16.093448] [INFO ] [REMOTE ] CMDB: Full fetch complete (10179 records). [2025-09-14T17:27:16.093534] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-14T17:27:16.271557] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 89 unique days, need 150 days [2025-09-14T17:27:16.271833] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:27:16.271885] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:27:16.271933] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-14T17:27:16.272002] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-14T17:27:16.272058] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-14T17:27:16.272125] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-14T17:27:16.272203] [INFO ] [MAIN ] Update Progress: 477/2370 symbols completed. CMDB took 21.8s. Estimated remaining: 3h 18m 44s. Rate: 9.5 symbols/min [2025-09-14T17:27:16.558916] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-14T17:27:16.696934] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-14T17:27:17.075835] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T17:27:17.358853] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-14T17:27:18.158857] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-14T17:27:18.450783] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T17:27:18.958863] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-14T17:27:19.115233] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:27:19.366076] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T17:27:19.758851] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-14T17:27:20.558837] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-14T17:27:21.009428] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T17:27:21.166510] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T17:27:21.358832] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-14T17:27:21.664708] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T17:27:22.158837] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-14T17:27:22.958843] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-14T17:27:23.475532] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-14T17:27:23.758886] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-14T17:27:23.839975] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T17:27:24.075534] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:27:24.082262] [INFO ] [REMOTE ] CMG: Full fetch complete (58398 records). [2025-09-14T17:27:24.082540] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-14T17:27:24.324882] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:27:24.566268] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-14T17:27:24.569627] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-14T17:27:24.570829] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-14T17:27:24.571769] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-14T17:27:24.571995] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-14T17:27:24.573615] [DEBUG] [LOCAL ] CMG: Trimmed 58398 records to 40465 (keeping 150 days of data) [2025-09-14T17:27:24.817011] [DEBUG] [LOCAL ] CMG: Primary data saved (40465 records). [2025-09-14T17:27:24.817176] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-14T17:27:24.817270] [INFO ] [MAIN ] Update Progress: 478/2370 symbols completed. CMG took 29.8s. Estimated remaining: 3h 18m 46s. Rate: 9.5 symbols/min [2025-09-14T17:27:25.358841] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-14T17:27:25.829581] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:27:26.158888] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-14T17:27:26.679363] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:27:26.682955] [INFO ] [REMOTE ] CMP: Full fetch complete (40468 records). [2025-09-14T17:27:26.683105] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-14T17:27:27.079777] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-14T17:27:27.079984] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-14T17:27:27.080683] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-14T17:27:27.080860] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-14T17:27:27.106836] [DEBUG] [LOCAL ] CMP: Trimmed 40468 records to 28011 (keeping 150 days of data) [2025-09-14T17:27:27.108782] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:27:27.178002] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-14T17:27:27.286163] [DEBUG] [LOCAL ] CMP: Primary data saved (28011 records). [2025-09-14T17:27:27.286358] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-14T17:27:27.286514] [INFO ] [MAIN ] Update Progress: 479/2370 symbols completed. CMP took 18.0s. Estimated remaining: 3h 18m 25s. Rate: 9.5 symbols/min [2025-09-14T17:27:27.829155] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:27:27.833606] [INFO ] [REMOTE ] CMI: Full fetch complete (45420 records). [2025-09-14T17:27:27.833773] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-14T17:27:28.212070] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-14T17:27:28.212253] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-14T17:27:28.212861] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-14T17:27:28.212919] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-14T17:27:28.213902] [DEBUG] [LOCAL ] CMI: Trimmed 45420 records to 30752 (keeping 150 days of data) [2025-09-14T17:27:28.412576] [DEBUG] [LOCAL ] CMI: Primary data saved (30752 records). [2025-09-14T17:27:28.412761] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-14T17:27:28.412863] [INFO ] [MAIN ] Update Progress: 480/2370 symbols completed. CMI took 26.6s. Estimated remaining: 3h 17m 58s. Rate: 9.5 symbols/min [2025-09-14T17:27:29.003470] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:29.072073] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:29.123674] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:29.144468] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:29.151300] [DEBUG] [LOCAL ] CMSC: Loaded 2148 existing records from primary storage. [2025-09-14T17:27:29.153296] [DEBUG] [LOCAL ] CMSA: Loaded 1368 existing records from primary storage. [2025-09-14T17:27:29.153614] [INFO ] [MAIN ] CMSC: Loaded 2148 existing records. [2025-09-14T17:27:29.166165] [INFO ] [MAIN ] CMSA: Loaded 1368 existing records. [2025-09-14T17:27:29.394441] [DEBUG] [LOCAL ] CMS: Loaded 23540 existing records from primary storage. [2025-09-14T17:27:29.393879] [DEBUG] [LOCAL ] CMRE: Loaded 15761 existing records from primary storage. [2025-09-14T17:27:29.410107] [INFO ] [MAIN ] CMS: Loaded 23540 existing records. [2025-09-14T17:27:29.429801] [INFO ] [MAIN ] CMRE: Loaded 15761 existing records. [2025-09-14T17:27:29.519074] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:29.666577] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-14T17:27:29.704155] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:29.729086] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-14T17:27:29.745516] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-14T17:27:29.755945] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-14T17:27:29.761630] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-14T17:27:29.777255] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-14T17:27:29.777430] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-14T17:27:29.772069] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-14T17:27:30.004034] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:30.056171] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:30.139814] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-14T17:27:30.149902] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-14T17:27:30.149995] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-14T17:27:30.186891] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-14T17:27:30.236116] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-14T17:27:30.271790] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-14T17:27:30.379568] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-14T17:27:30.496271] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-14T17:27:31.029526] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:31.025715] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:31.095041] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-14T17:27:31.105064] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-14T17:27:31.471053] [INFO ] [REMOTE ] CMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:31.475050] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:31.476180] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-14T17:27:31.476537] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-14T17:27:31.801103] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T17:27:31.802719] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-14T17:27:31.808172] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T17:27:31.810010] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-14T17:27:32.327033] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T17:27:32.407379] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T17:27:32.555613] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:27:32.562708] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-14T17:27:33.123516] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T17:27:33.284243] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-14T17:27:33.358831] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-14T17:27:33.763305] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T17:27:34.158935] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-14T17:27:34.780554] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T17:27:34.958845] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-14T17:27:35.758820] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-14T17:27:36.558863] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-14T17:27:36.815982] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T17:27:37.172968] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T17:27:37.265832] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:27:37.358787] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-14T17:27:38.158874] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-14T17:27:38.667758] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T17:27:38.935754] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:27:38.958809] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-14T17:27:39.536419] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T17:27:39.758869] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-14T17:27:40.334002] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T17:27:40.558831] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-14T17:27:41.165155] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:27:41.358840] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-14T17:27:42.051665] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:27:42.158852] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-14T17:27:42.646413] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T17:27:42.958887] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-14T17:27:43.758869] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-14T17:27:44.444846] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T17:27:44.558889] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-14T17:27:44.909314] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:27:44.910257] [INFO ] [REMOTE ] CMSA: Full fetch complete (3530 records). [2025-09-14T17:27:44.910344] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-14T17:27:45.287403] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-14T17:27:45.287678] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-14T17:27:45.287908] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-14T17:27:45.288118] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-14T17:27:45.288703] [DEBUG] [LOCAL ] CMSA: Trimmed 3530 records to 2560 (keeping 150 days of data) [2025-09-14T17:27:45.307407] [DEBUG] [LOCAL ] CMSA: Primary data saved (2560 records). [2025-09-14T17:27:45.307710] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-14T17:27:45.308003] [INFO ] [MAIN ] Update Progress: 481/2370 symbols completed. CMSA took 16.9s. Estimated remaining: 3h 18m 34s. Rate: 9.5 symbols/min [2025-09-14T17:27:45.378491] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-14T17:27:45.444880] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:27:45.542712] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:45.548328] [DEBUG] [LOCAL ] CMSD: Loaded 3309 existing records from primary storage. [2025-09-14T17:27:45.548452] [INFO ] [MAIN ] CMSD: Loaded 3309 existing records. [2025-09-14T17:27:45.728992] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:45.729273] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-14T17:27:45.729337] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-14T17:27:45.729711] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-14T17:27:45.729777] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-14T17:27:46.083315] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:46.158797] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-14T17:27:46.818632] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T17:27:46.932723] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T17:27:46.958854] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-14T17:27:47.758897] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-14T17:27:48.471739] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:27:48.558828] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-14T17:27:48.632513] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T17:27:49.027750] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:27:49.028811] [INFO ] [REMOTE ] CMSC: Full fetch complete (5332 records). [2025-09-14T17:27:49.028897] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-14T17:27:49.365987] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-14T17:27:49.389680] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-14T17:27:49.389809] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-14T17:27:49.390073] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-14T17:27:49.390139] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-14T17:27:49.390567] [DEBUG] [LOCAL ] CMSC: Trimmed 5332 records to 3570 (keeping 150 days of data) [2025-09-14T17:27:49.412412] [DEBUG] [LOCAL ] CMSC: Primary data saved (3570 records). [2025-09-14T17:27:49.412516] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-14T17:27:49.412659] [INFO ] [MAIN ] Update Progress: 482/2370 symbols completed. CMSC took 21.0s. Estimated remaining: 3h 18m 19s. Rate: 9.5 symbols/min [2025-09-14T17:27:49.580312] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:49.595553] [DEBUG] [LOCAL ] CMTG: Loaded 15108 existing records from primary storage. [2025-09-14T17:27:49.595738] [INFO ] [MAIN ] CMTG: Loaded 15108 existing records. [2025-09-14T17:27:49.770267] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:49.770534] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-14T17:27:49.770596] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-14T17:27:49.771088] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-14T17:27:49.771150] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-14T17:27:50.120335] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:50.158803] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-14T17:27:50.523374] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:27:50.958842] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-14T17:27:51.622262] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:27:51.763032] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-14T17:27:51.765574] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T17:27:52.558847] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-14T17:27:53.358845] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-14T17:27:53.588518] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T17:27:53.651376] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:27:54.124746] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T17:27:54.158797] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-14T17:27:54.958804] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-14T17:27:55.339489] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T17:27:55.343949] [INFO ] [REMOTE ] CMRE: Full fetch complete (38999 records). [2025-09-14T17:27:55.344126] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-14T17:27:55.486094] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-14T17:27:55.748929] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-14T17:27:55.749033] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-14T17:27:55.749589] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-14T17:27:55.749659] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-14T17:27:55.750544] [DEBUG] [LOCAL ] CMRE: Trimmed 38999 records to 26592 (keeping 150 days of data) [2025-09-14T17:27:55.804117] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-14T17:27:55.916578] [DEBUG] [LOCAL ] CMRE: Primary data saved (26592 records). [2025-09-14T17:27:55.916796] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-14T17:27:55.916929] [INFO ] [MAIN ] Update Progress: 483/2370 symbols completed. CMRE took 27.5s. Estimated remaining: 3h 18m 13s. Rate: 9.5 symbols/min [2025-09-14T17:27:56.090058] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:56.095137] [DEBUG] [LOCAL ] CMU: Loaded 3151 existing records from primary storage. [2025-09-14T17:27:56.095275] [INFO ] [MAIN ] CMU: Loaded 3151 existing records. [2025-09-14T17:27:56.282577] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:56.282895] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-14T17:27:56.282973] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-14T17:27:56.283237] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-14T17:27:56.283296] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-14T17:27:56.565399] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-14T17:27:56.660447] [INFO ] [REMOTE ] CMU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:56.667396] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T17:27:57.358839] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-14T17:27:58.017700] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T17:27:58.158851] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-14T17:27:58.534228] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:27:58.958852] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-14T17:27:59.424104] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:27:59.758946] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-14T17:27:59.785044] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T17:28:00.558839] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-14T17:28:01.373439] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-14T17:28:01.386674] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:28:02.017102] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T17:28:02.158881] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-14T17:28:02.385472] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:28:02.625723] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T17:28:02.958837] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-14T17:28:03.589220] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T17:28:03.758868] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-14T17:28:04.558858] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-14T17:28:04.902077] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T17:28:05.192711] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:28:05.198168] [INFO ] [REMOTE ] CMS: Full fetch complete (57303 records). [2025-09-14T17:28:05.198291] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-14T17:28:05.364713] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-14T17:28:05.596512] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-14T17:28:05.596719] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-14T17:28:05.597625] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-14T17:28:05.597726] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-14T17:28:05.599148] [DEBUG] [LOCAL ] CMS: Trimmed 57303 records to 39684 (keeping 150 days of data) [2025-09-14T17:28:05.855798] [DEBUG] [LOCAL ] CMS: Primary data saved (39684 records). [2025-09-14T17:28:05.856040] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-14T17:28:05.856168] [INFO ] [MAIN ] Update Progress: 484/2370 symbols completed. CMS took 37.4s. Estimated remaining: 3h 18m 21s. Rate: 9.5 symbols/min [2025-09-14T17:28:06.029378] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:06.046019] [DEBUG] [LOCAL ] CNA: Loaded 16480 existing records from primary storage. [2025-09-14T17:28:06.046202] [INFO ] [MAIN ] CNA: Loaded 16480 existing records. [2025-09-14T17:28:06.163684] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-14T17:28:06.170313] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T17:28:06.238543] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:06.238870] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-14T17:28:06.238959] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-14T17:28:06.239616] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-14T17:28:06.239718] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-14T17:28:06.593907] [INFO ] [REMOTE ] CNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:06.958842] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-14T17:28:07.424278] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:28:07.426350] [INFO ] [REMOTE ] CMSD: Full fetch complete (8706 records). [2025-09-14T17:28:07.426507] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-14T17:28:07.758954] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-14T17:28:07.815159] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-14T17:28:07.815382] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-14T17:28:07.815768] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-14T17:28:07.815956] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-14T17:28:07.824586] [DEBUG] [LOCAL ] CMSD: Trimmed 8706 records to 5819 (keeping 150 days of data) [2025-09-14T17:28:07.840944] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T17:28:07.887244] [DEBUG] [LOCAL ] CMSD: Primary data saved (5819 records). [2025-09-14T17:28:07.887402] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-14T17:28:07.887521] [INFO ] [MAIN ] Update Progress: 485/2370 symbols completed. CMSD took 22.6s. Estimated remaining: 3h 17m 58s. Rate: 9.5 symbols/min [2025-09-14T17:28:08.054739] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:08.078533] [DEBUG] [LOCAL ] CNC: Loaded 24221 existing records from primary storage. [2025-09-14T17:28:08.078726] [INFO ] [MAIN ] CNC: Loaded 24221 existing records. [2025-09-14T17:28:08.251859] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:08.252131] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-14T17:28:08.252192] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-14T17:28:08.252901] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-14T17:28:08.252968] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-14T17:28:08.563997] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-14T17:28:08.625952] [INFO ] [REMOTE ] CNC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:08.787974] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T17:28:09.358849] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-14T17:28:09.467728] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:28:10.158849] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-14T17:28:10.749362] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T17:28:10.958860] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-14T17:28:11.746096] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:28:11.758788] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-14T17:28:12.336406] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T17:28:12.383611] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T17:28:12.558822] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-14T17:28:13.358848] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-14T17:28:13.609754] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T17:28:14.158852] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-14T17:28:14.726393] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:28:14.727953] [INFO ] [REMOTE ] CMU: Full fetch complete (7611 records). [2025-09-14T17:28:14.728244] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-14T17:28:14.964064] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-14T17:28:15.154033] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T17:28:15.154312] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-14T17:28:15.154540] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-14T17:28:15.161880] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-14T17:28:15.162084] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-14T17:28:15.162986] [DEBUG] [LOCAL ] CMU: Trimmed 7611 records to 4747 (keeping 150 days of data) [2025-09-14T17:28:15.191713] [DEBUG] [LOCAL ] CMU: Primary data saved (4747 records). [2025-09-14T17:28:15.191810] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-14T17:28:15.191908] [INFO ] [MAIN ] Update Progress: 486/2370 symbols completed. CMU took 19.3s. Estimated remaining: 3h 17m 56s. Rate: 9.5 symbols/min [2025-09-14T17:28:15.368632] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:15.375991] [DEBUG] [LOCAL ] CNF: Loaded 5867 existing records from primary storage. [2025-09-14T17:28:15.376119] [INFO ] [MAIN ] CNF: Loaded 5867 existing records. [2025-09-14T17:28:15.556534] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:15.556853] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-14T17:28:15.556915] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-14T17:28:15.557240] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-14T17:28:15.557298] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-14T17:28:15.764027] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-14T17:28:15.912003] [INFO ] [REMOTE ] CNF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:16.429322] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:28:16.558833] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-14T17:28:16.848778] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T17:28:16.854080] [INFO ] [REMOTE ] CMTG: Full fetch complete (41540 records). [2025-09-14T17:28:16.854255] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-14T17:28:16.974215] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-14T17:28:17.256499] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-14T17:28:17.256599] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-14T17:28:17.257270] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-14T17:28:17.257325] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-14T17:28:17.258301] [DEBUG] [LOCAL ] CMTG: Trimmed 41540 records to 27084 (keeping 150 days of data) [2025-09-14T17:28:17.361262] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-14T17:28:17.415388] [DEBUG] [LOCAL ] CMTG: Primary data saved (27084 records). [2025-09-14T17:28:17.415610] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-14T17:28:17.415750] [INFO ] [MAIN ] Update Progress: 487/2370 symbols completed. CMTG took 28.0s. Estimated remaining: 3h 17m 34s. Rate: 9.5 symbols/min [2025-09-14T17:28:17.581787] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:17.610047] [DEBUG] [LOCAL ] CNH: Loaded 23957 existing records from primary storage. [2025-09-14T17:28:17.610255] [INFO ] [MAIN ] CNH: Loaded 23957 existing records. [2025-09-14T17:28:17.783707] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:17.783972] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-14T17:28:17.784032] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-14T17:28:17.784700] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-14T17:28:17.784767] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-14T17:28:18.119296] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:28:18.141050] [INFO ] [REMOTE ] CNH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:18.158788] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-14T17:28:18.958894] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-14T17:28:19.532773] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T17:28:19.758847] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-14T17:28:20.184027] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:28:20.234951] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T17:28:20.558857] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-14T17:28:21.358872] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-14T17:28:21.394980] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T17:28:22.158869] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-14T17:28:22.958858] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-14T17:28:23.157890] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T17:28:23.758852] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-14T17:28:24.102604] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:28:24.139459] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T17:28:24.558840] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-14T17:28:24.725700] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:28:25.358824] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-14T17:28:26.158827] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-14T17:28:26.293828] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:28:26.958815] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-14T17:28:26.980885] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:28:27.343080] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T17:28:27.758816] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-14T17:28:28.558848] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-14T17:28:28.736192] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T17:28:28.799909] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:28:29.358892] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-14T17:28:30.158881] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-14T17:28:30.495044] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T17:28:30.913081] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:28:30.916108] [INFO ] [REMOTE ] CNF: Full fetch complete (10819 records). [2025-09-14T17:28:30.916201] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-14T17:28:30.969738] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-14T17:28:31.277110] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-14T17:28:31.277364] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-14T17:28:31.277728] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-14T17:28:31.294129] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-14T17:28:31.306264] [DEBUG] [LOCAL ] CNF: Trimmed 10819 records to 8737 (keeping 150 days of data) [2025-09-14T17:28:31.307692] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T17:28:31.369402] [DEBUG] [LOCAL ] CNF: Primary data saved (8737 records). [2025-09-14T17:28:31.369597] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-14T17:28:31.369729] [INFO ] [MAIN ] Update Progress: 488/2370 symbols completed. CNF took 16.2s. Estimated remaining: 3h 17m 57s. Rate: 9.5 symbols/min [2025-09-14T17:28:31.548927] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:31.572636] [DEBUG] [LOCAL ] CNI: Loaded 23250 existing records from primary storage. [2025-09-14T17:28:31.572828] [INFO ] [MAIN ] CNI: Loaded 23250 existing records. [2025-09-14T17:28:31.748806] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:31.749057] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-14T17:28:31.749157] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-14T17:28:31.750104] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-14T17:28:31.750181] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-14T17:28:31.764043] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-14T17:28:32.104683] [INFO ] [REMOTE ] CNI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:32.558888] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-14T17:28:33.358843] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-14T17:28:33.805456] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T17:28:33.852525] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-14T17:28:33.896319] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:28:34.158819] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-14T17:28:34.958852] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-14T17:28:35.053733] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T17:28:35.758875] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-14T17:28:36.262599] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T17:28:36.400583] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T17:28:36.558841] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-14T17:28:36.844493] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T17:28:36.850254] [INFO ] [REMOTE ] CNC: Full fetch complete (58391 records). [2025-09-14T17:28:36.850446] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-14T17:28:37.229891] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-14T17:28:37.230004] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-14T17:28:37.230745] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-14T17:28:37.230802] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-14T17:28:37.232476] [DEBUG] [LOCAL ] CNC: Trimmed 58391 records to 40524 (keeping 150 days of data) [2025-09-14T17:28:37.407885] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-14T17:28:37.480694] [DEBUG] [LOCAL ] CNC: Primary data saved (40524 records). [2025-09-14T17:28:37.480857] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-14T17:28:37.480986] [INFO ] [MAIN ] Update Progress: 489/2370 symbols completed. CNC took 29.6s. Estimated remaining: 3h 17m 50s. Rate: 9.5 symbols/min [2025-09-14T17:28:37.669455] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:37.702013] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T17:28:37.732495] [DEBUG] [LOCAL ] CNK: Loaded 23871 existing records from primary storage. [2025-09-14T17:28:37.732707] [INFO ] [MAIN ] CNK: Loaded 23871 existing records. [2025-09-14T17:28:37.925210] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:37.925707] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-14T17:28:37.925779] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-14T17:28:37.926555] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-14T17:28:37.926621] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-14T17:28:38.164034] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-14T17:28:38.306187] [INFO ] [REMOTE ] CNK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:38.380910] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T17:28:38.384279] [INFO ] [REMOTE ] CNA: Full fetch complete (35929 records). [2025-09-14T17:28:38.384405] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-14T17:28:38.752469] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-14T17:28:38.752578] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-14T17:28:38.753166] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-14T17:28:38.753223] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-14T17:28:38.754105] [DEBUG] [LOCAL ] CNA: Trimmed 35929 records to 24776 (keeping 150 days of data) [2025-09-14T17:28:38.914220] [DEBUG] [LOCAL ] CNA: Primary data saved (24776 records). [2025-09-14T17:28:38.914391] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-14T17:28:38.914510] [INFO ] [MAIN ] Update Progress: 490/2370 symbols completed. CNA took 33.1s. Estimated remaining: 3h 17m 25s. Rate: 9.5 symbols/min [2025-09-14T17:28:38.969205] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-14T17:28:39.089516] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:39.112260] [DEBUG] [LOCAL ] CNM: Loaded 22599 existing records from primary storage. [2025-09-14T17:28:39.112449] [INFO ] [MAIN ] CNM: Loaded 22599 existing records. [2025-09-14T17:28:39.290230] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:39.290521] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-14T17:28:39.290607] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-14T17:28:39.291273] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-14T17:28:39.291335] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-14T17:28:39.654072] [INFO ] [REMOTE ] CNM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:39.688594] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:28:39.695168] [INFO ] [REMOTE ] CNH: Full fetch complete (58242 records). [2025-09-14T17:28:39.695344] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-14T17:28:39.764031] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-14T17:28:40.087751] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-14T17:28:40.087996] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-14T17:28:40.088912] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-14T17:28:40.088986] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-14T17:28:40.090475] [DEBUG] [LOCAL ] CNH: Trimmed 58242 records to 40307 (keeping 150 days of data) [2025-09-14T17:28:40.214126] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-14T17:28:40.389354] [DEBUG] [LOCAL ] CNH: Primary data saved (40307 records). [2025-09-14T17:28:40.389543] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-14T17:28:40.389757] [INFO ] [MAIN ] Update Progress: 491/2370 symbols completed. CNH took 23.0s. Estimated remaining: 3h 17m 0s. Rate: 9.5 symbols/min [2025-09-14T17:28:40.559685] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:40.559769] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-14T17:28:40.577125] [DEBUG] [LOCAL ] CNMD: Loaded 14538 existing records from primary storage. [2025-09-14T17:28:40.577368] [INFO ] [MAIN ] CNMD: Loaded 14538 existing records. [2025-09-14T17:28:40.750003] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:40.750274] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-14T17:28:40.750355] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-14T17:28:40.750802] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-14T17:28:40.750861] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-14T17:28:41.096599] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:41.215334] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T17:28:41.358810] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-14T17:28:42.161412] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-14T17:28:42.166990] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:28:42.796881] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:28:42.958840] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-14T17:28:43.598817] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T17:28:43.758815] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-14T17:28:44.223961] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:28:44.558846] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-14T17:28:45.358831] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-14T17:28:45.409204] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T17:28:46.158836] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-14T17:28:46.282836] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:28:46.965399] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-14T17:28:46.982520] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T17:28:47.693853] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T17:28:47.758781] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-14T17:28:48.558829] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-14T17:28:48.865369] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:28:49.358889] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-14T17:28:49.771157] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T17:28:50.158828] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-14T17:28:50.371096] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T17:28:50.476557] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T17:28:50.958834] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-14T17:28:51.758855] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-14T17:28:51.855909] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T17:28:52.504475] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:28:52.558820] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-14T17:28:52.685206] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:28:53.358862] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-14T17:28:54.158900] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-14T17:28:54.357736] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:28:54.868093] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T17:28:54.958788] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-14T17:28:55.670550] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T17:28:55.758848] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-14T17:28:56.509052] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T17:28:56.514584] [INFO ] [REMOTE ] CNI: Full fetch complete (56120 records). [2025-09-14T17:28:56.514730] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-14T17:28:56.570763] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-14T17:28:56.900024] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-14T17:28:56.900175] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-14T17:28:56.900925] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-14T17:28:56.900990] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-14T17:28:56.902734] [DEBUG] [LOCAL ] CNI: Trimmed 56120 records to 38895 (keeping 150 days of data) [2025-09-14T17:28:57.186544] [DEBUG] [LOCAL ] CNI: Primary data saved (38895 records). [2025-09-14T17:28:57.186892] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-14T17:28:57.187267] [INFO ] [MAIN ] Update Progress: 492/2370 symbols completed. CNI took 25.8s. Estimated remaining: 3h 17m 34s. Rate: 9.5 symbols/min [2025-09-14T17:28:57.367982] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-14T17:28:57.383274] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:57.407487] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T17:28:57.439973] [DEBUG] [LOCAL ] CNNE: Loaded 17059 existing records from primary storage. [2025-09-14T17:28:57.440215] [INFO ] [MAIN ] CNNE: Loaded 17059 existing records. [2025-09-14T17:28:57.628176] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:57.628526] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-14T17:28:57.628594] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-14T17:28:57.629174] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-14T17:28:57.629255] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-14T17:28:57.987484] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T17:28:58.006778] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:58.158785] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-14T17:28:58.554713] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T17:28:58.558095] [INFO ] [REMOTE ] CNMD: Full fetch complete (35930 records). [2025-09-14T17:28:58.558206] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-14T17:28:58.924721] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-14T17:28:58.924856] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-14T17:28:58.925523] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-14T17:28:58.925621] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-14T17:28:58.926824] [DEBUG] [LOCAL ] CNMD: Trimmed 35930 records to 23985 (keeping 150 days of data) [2025-09-14T17:28:58.980687] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-14T17:28:59.107947] [DEBUG] [LOCAL ] CNMD: Primary data saved (23985 records). [2025-09-14T17:28:59.109554] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:28:59.109747] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-14T17:28:59.120636] [INFO ] [MAIN ] Update Progress: 493/2370 symbols completed. CNMD took 18.7s. Estimated remaining: 3h 17m 11s. Rate: 9.5 symbols/min [2025-09-14T17:28:59.291033] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:59.310138] [DEBUG] [LOCAL ] CNO: Loaded 18423 existing records from primary storage. [2025-09-14T17:28:59.310327] [INFO ] [MAIN ] CNO: Loaded 18423 existing records. [2025-09-14T17:28:59.505375] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:59.513296] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-14T17:28:59.513411] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-14T17:28:59.514015] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-14T17:28:59.514081] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-14T17:28:59.763889] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-14T17:28:59.867293] [INFO ] [REMOTE ] CNO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:00.293267] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:29:00.558845] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-14T17:29:01.358862] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-14T17:29:01.707261] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T17:29:02.158804] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-14T17:29:02.224704] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T17:29:02.493499] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:29:02.499242] [INFO ] [REMOTE ] CNM: Full fetch complete (55063 records). [2025-09-14T17:29:02.499395] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-14T17:29:02.963956] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-14T17:29:02.967193] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-14T17:29:02.969012] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-14T17:29:02.970111] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-14T17:29:02.970316] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-14T17:29:02.972038] [DEBUG] [LOCAL ] CNM: Trimmed 55063 records to 38006 (keeping 150 days of data) [2025-09-14T17:29:03.092127] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T17:29:03.246786] [DEBUG] [LOCAL ] CNM: Primary data saved (38006 records). [2025-09-14T17:29:03.246994] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-14T17:29:03.247111] [INFO ] [MAIN ] Update Progress: 494/2370 symbols completed. CNM took 24.3s. Estimated remaining: 3h 16m 56s. Rate: 9.5 symbols/min [2025-09-14T17:29:03.420155] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:03.443417] [DEBUG] [LOCAL ] CNP: Loaded 23931 existing records from primary storage. [2025-09-14T17:29:03.443606] [INFO ] [MAIN ] CNP: Loaded 23931 existing records. [2025-09-14T17:29:03.618197] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:03.618492] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-14T17:29:03.618552] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-14T17:29:03.619353] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-14T17:29:03.619418] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-14T17:29:03.760829] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-14T17:29:03.967453] [INFO ] [REMOTE ] CNP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:04.539291] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T17:29:04.558788] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-14T17:29:05.019351] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:29:05.358859] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-14T17:29:06.036314] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:29:06.158846] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-14T17:29:06.909353] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:29:06.958856] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-14T17:29:07.760451] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-14T17:29:07.767144] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:29:08.534584] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:29:08.558793] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-14T17:29:09.018262] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T17:29:09.358828] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-14T17:29:09.874517] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T17:29:10.158826] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-14T17:29:10.751581] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T17:29:10.958819] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-14T17:29:11.643169] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:29:11.758855] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-14T17:29:12.327803] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T17:29:12.558836] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-14T17:29:12.913249] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T17:29:13.358898] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-14T17:29:14.158865] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-14T17:29:14.236480] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:29:14.793413] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T17:29:14.817144] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:29:14.822593] [INFO ] [REMOTE ] CNK: Full fetch complete (57418 records). [2025-09-14T17:29:14.822777] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-14T17:29:14.965337] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-14T17:29:15.214158] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-14T17:29:15.214271] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-14T17:29:15.215007] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-14T17:29:15.215067] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-14T17:29:15.216257] [DEBUG] [LOCAL ] CNK: Trimmed 57418 records to 39750 (keeping 150 days of data) [2025-09-14T17:29:15.461503] [DEBUG] [LOCAL ] CNK: Primary data saved (39750 records). [2025-09-14T17:29:15.461694] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-14T17:29:15.461805] [INFO ] [MAIN ] Update Progress: 495/2370 symbols completed. CNK took 38.0s. Estimated remaining: 3h 17m 12s. Rate: 9.5 symbols/min [2025-09-14T17:29:15.630987] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:15.653955] [DEBUG] [LOCAL ] CNQ: Loaded 23980 existing records from primary storage. [2025-09-14T17:29:15.654168] [INFO ] [MAIN ] CNQ: Loaded 23980 existing records. [2025-09-14T17:29:15.764005] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-14T17:29:15.833185] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:15.833434] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-14T17:29:15.833492] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-14T17:29:15.834189] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-14T17:29:15.834253] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-14T17:29:16.183809] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:16.325307] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:29:16.329847] [INFO ] [REMOTE ] CNO: Full fetch complete (45831 records). [2025-09-14T17:29:16.329969] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-14T17:29:16.564052] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-14T17:29:16.716731] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-14T17:29:16.716977] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-14T17:29:16.717792] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-14T17:29:16.717991] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-14T17:29:16.737516] [DEBUG] [LOCAL ] CNO: Trimmed 45831 records to 30210 (keeping 150 days of data) [2025-09-14T17:29:16.739027] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T17:29:16.934497] [DEBUG] [LOCAL ] CNO: Primary data saved (30210 records). [2025-09-14T17:29:16.934713] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-14T17:29:16.934835] [INFO ] [MAIN ] Update Progress: 496/2370 symbols completed. CNO took 17.8s. Estimated remaining: 3h 16m 48s. Rate: 9.5 symbols/min [2025-09-14T17:29:17.104827] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:17.123960] [DEBUG] [LOCAL ] CNR: Loaded 19452 existing records from primary storage. [2025-09-14T17:29:17.124132] [INFO ] [MAIN ] CNR: Loaded 19452 existing records. [2025-09-14T17:29:17.306331] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:17.306603] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-14T17:29:17.306701] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-14T17:29:17.307254] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-09-14T17:29:17.307318] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-14T17:29:17.370127] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-14T17:29:17.668895] [INFO ] [REMOTE ] CNR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:18.158897] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-14T17:29:18.281587] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:29:18.958862] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-14T17:29:19.172369] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T17:29:19.444992] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T17:29:19.758838] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-14T17:29:20.558829] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-14T17:29:20.863531] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:29:21.358826] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-14T17:29:21.481548] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:29:21.940224] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T17:29:22.158840] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-14T17:29:22.958890] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-14T17:29:23.342372] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:29:23.569633] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T17:29:23.573830] [INFO ] [REMOTE ] CNNE: Full fetch complete (39702 records). [2025-09-14T17:29:23.573929] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-14T17:29:23.769182] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-14T17:29:23.949178] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-14T17:29:23.949399] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-14T17:29:23.950338] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-14T17:29:23.950416] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-14T17:29:23.952092] [DEBUG] [LOCAL ] CNNE: Trimmed 39702 records to 26922 (keeping 150 days of data) [2025-09-14T17:29:24.127743] [DEBUG] [LOCAL ] CNNE: Primary data saved (26922 records). [2025-09-14T17:29:24.127982] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-14T17:29:24.128121] [INFO ] [MAIN ] Update Progress: 497/2370 symbols completed. CNNE took 26.9s. Estimated remaining: 3h 16m 45s. Rate: 9.5 symbols/min [2025-09-14T17:29:24.305497] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:24.318917] [DEBUG] [LOCAL ] CNS: Loaded 9132 existing records from primary storage. [2025-09-14T17:29:24.319108] [INFO ] [MAIN ] CNS: Loaded 9132 existing records. [2025-09-14T17:29:24.501694] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:24.501999] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-14T17:29:24.502062] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-14T17:29:24.502474] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-14T17:29:24.502535] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-14T17:29:24.566517] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-14T17:29:24.884887] [INFO ] [REMOTE ] CNS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:24.929186] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:29:25.021752] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T17:29:25.358833] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-14T17:29:26.158910] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-14T17:29:26.541392] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T17:29:26.654405] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T17:29:26.958843] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-14T17:29:26.999026] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T17:29:27.758813] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-14T17:29:28.353813] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T17:29:28.558816] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-14T17:29:28.811304] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:29:29.358868] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-14T17:29:29.988213] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T17:29:30.158864] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-14T17:29:30.958838] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-14T17:29:31.149676] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T17:29:31.758825] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-14T17:29:31.897843] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T17:29:31.951798] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:29:32.558845] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-14T17:29:33.358867] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-14T17:29:33.496117] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:29:33.518696] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T17:29:34.158872] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-14T17:29:34.698419] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T17:29:34.814668] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:29:34.820311] [INFO ] [REMOTE ] CNP: Full fetch complete (58105 records). [2025-09-14T17:29:34.820439] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-14T17:29:34.964001] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-14T17:29:35.214940] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-14T17:29:35.215120] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-14T17:29:35.215938] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-14T17:29:35.216003] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-14T17:29:35.217275] [DEBUG] [LOCAL ] CNP: Trimmed 58105 records to 40238 (keeping 150 days of data) [2025-09-14T17:29:35.476754] [DEBUG] [LOCAL ] CNP: Primary data saved (40238 records). [2025-09-14T17:29:35.476919] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-14T17:29:35.477044] [INFO ] [MAIN ] Update Progress: 498/2370 symbols completed. CNP took 32.2s. Estimated remaining: 3h 16m 58s. Rate: 9.5 symbols/min [2025-09-14T17:29:35.651914] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:35.674074] [DEBUG] [LOCAL ] CNX: Loaded 22844 existing records from primary storage. [2025-09-14T17:29:35.674237] [INFO ] [MAIN ] CNX: Loaded 22844 existing records. [2025-09-14T17:29:35.763955] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-14T17:29:35.858964] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:35.859237] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-14T17:29:35.859313] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-14T17:29:35.860119] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-14T17:29:35.860208] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-14T17:29:36.228680] [INFO ] [REMOTE ] CNX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:36.558801] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-14T17:29:36.606901] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:29:36.832204] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:29:37.358830] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-14T17:29:38.158807] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-14T17:29:38.242462] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:29:38.526246] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T17:29:38.531942] [INFO ] [REMOTE ] CNQ: Full fetch complete (58258 records). [2025-09-14T17:29:38.532090] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-14T17:29:38.935585] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-14T17:29:38.935717] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-14T17:29:38.936440] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-14T17:29:38.936497] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-14T17:29:38.937745] [DEBUG] [LOCAL ] CNQ: Trimmed 58258 records to 40333 (keeping 150 days of data) [2025-09-14T17:29:38.993033] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-14T17:29:39.189022] [DEBUG] [LOCAL ] CNQ: Primary data saved (40333 records). [2025-09-14T17:29:39.189411] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-14T17:29:39.189529] [INFO ] [MAIN ] Update Progress: 499/2370 symbols completed. CNQ took 23.7s. Estimated remaining: 3h 16m 42s. Rate: 9.5 symbols/min [2025-09-14T17:29:39.379126] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:39.399448] [DEBUG] [LOCAL ] CODI: Loaded 19001 existing records from primary storage. [2025-09-14T17:29:39.399685] [INFO ] [MAIN ] CODI: Loaded 19001 existing records. [2025-09-14T17:29:39.586198] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:39.586666] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-14T17:29:39.586842] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-14T17:29:39.596498] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-14T17:29:39.614145] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-14T17:29:39.687257] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:29:39.771353] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-14T17:29:39.992436] [INFO ] [REMOTE ] CODI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:40.558848] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-14T17:29:40.821129] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:29:41.358859] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-14T17:29:41.619562] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T17:29:42.154003] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T17:29:42.159381] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-14T17:29:42.958841] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-14T17:29:43.720397] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:29:43.743949] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:29:43.758811] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-14T17:29:44.272063] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:29:44.274783] [INFO ] [REMOTE ] CNS: Full fetch complete (22785 records). [2025-09-14T17:29:44.274874] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-14T17:29:44.564003] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-14T17:29:44.651558] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-14T17:29:44.651721] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-14T17:29:44.652195] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-14T17:29:44.652252] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-14T17:29:44.652942] [DEBUG] [LOCAL ] CNS: Trimmed 22785 records to 14962 (keeping 150 days of data) [2025-09-14T17:29:44.749259] [DEBUG] [LOCAL ] CNS: Primary data saved (14962 records). [2025-09-14T17:29:44.749459] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-14T17:29:44.749567] [INFO ] [MAIN ] Update Progress: 500/2370 symbols completed. CNS took 20.6s. Estimated remaining: 3h 16m 32s. Rate: 9.5 symbols/min [2025-09-14T17:29:44.924555] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:44.964581] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (5.19 seconds). [2025-09-14T17:29:44.993447] [DEBUG] [LOCAL ] COF: Loaded 24010 existing records from primary storage. [2025-09-14T17:29:44.993632] [INFO ] [MAIN ] COF: Loaded 24010 existing records. [2025-09-14T17:29:45.183395] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:45.183725] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-14T17:29:45.183790] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-14T17:29:45.184542] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-14T17:29:45.184606] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-14T17:29:45.361136] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-14T17:29:45.541073] [INFO ] [REMOTE ] COF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:45.885528] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T17:29:46.158848] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-14T17:29:46.804933] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:29:46.809608] [INFO ] [REMOTE ] CNR: Full fetch complete (48405 records). [2025-09-14T17:29:46.809773] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-14T17:29:46.964010] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-14T17:29:47.215454] [DEBUG] [VALIDATOR ] CNR: All expected trading days are present. [2025-09-14T17:29:47.215720] [DEBUG] [VALIDATOR ] CNR: Primary data validation passed. [2025-09-14T17:29:47.216677] [INFO ] [MAIN ] CNR: Fetched primary data is valid. [2025-09-14T17:29:47.216816] [DEBUG] [LOCAL ] CNR: Saving primary data. [2025-09-14T17:29:47.218553] [DEBUG] [LOCAL ] CNR: Trimmed 48405 records to 32616 (keeping 150 days of data) [2025-09-14T17:29:47.379423] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T17:29:47.487938] [DEBUG] [LOCAL ] CNR: Primary data saved (32616 records). [2025-09-14T17:29:47.488198] [INFO ] [MAIN ] CNR: Full history saved. [2025-09-14T17:29:47.488337] [INFO ] [MAIN ] Update Progress: 501/2370 symbols completed. CNR took 30.6s. Estimated remaining: 3h 16m 13s. Rate: 9.5 symbols/min [2025-09-14T17:29:47.661764] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:47.693078] [DEBUG] [LOCAL ] COHR: Loaded 23926 existing records from primary storage. [2025-09-14T17:29:47.693323] [INFO ] [MAIN ] COHR: Loaded 23926 existing records. [2025-09-14T17:29:47.764043] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-14T17:29:47.887004] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:47.887330] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-14T17:29:47.887460] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-14T17:29:47.888129] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-14T17:29:47.888193] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-14T17:29:48.251563] [INFO ] [REMOTE ] COHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:48.558909] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-14T17:29:48.971856] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T17:29:49.358896] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-14T17:29:49.609539] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:29:50.158847] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-14T17:29:50.646682] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T17:29:50.958871] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-14T17:29:51.289153] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:29:51.758818] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-14T17:29:51.817626] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:29:52.558924] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-14T17:29:53.042542] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-14T17:29:53.358853] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-14T17:29:53.936595] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-14T17:29:54.158864] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-14T17:29:54.351714] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T17:29:54.801724] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T17:29:54.958823] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-14T17:29:55.758877] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-14T17:29:56.290429] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T17:29:56.558947] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-14T17:29:56.700367] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:29:57.358846] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-14T17:29:57.729976] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T17:29:58.158843] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-14T17:29:58.191900] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T17:29:58.621905] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:29:58.958842] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-14T17:29:59.758799] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-14T17:30:00.119678] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T17:30:00.558889] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-14T17:30:00.853287] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T17:30:01.052967] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T17:30:01.058137] [INFO ] [REMOTE ] CNX: Full fetch complete (55980 records). [2025-09-14T17:30:01.058263] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-14T17:30:01.359173] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-14T17:30:01.452763] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-14T17:30:01.452965] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-14T17:30:01.453744] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-14T17:30:01.472783] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-14T17:30:01.481995] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:30:01.491120] [DEBUG] [LOCAL ] CNX: Trimmed 55980 records to 38562 (keeping 150 days of data) [2025-09-14T17:30:01.723983] [DEBUG] [LOCAL ] CNX: Primary data saved (38562 records). [2025-09-14T17:30:01.724204] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-14T17:30:01.724387] [INFO ] [MAIN ] Update Progress: 502/2370 symbols completed. CNX took 26.2s. Estimated remaining: 3h 16m 36s. Rate: 9.5 symbols/min [2025-09-14T17:30:01.911847] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:01.938378] [DEBUG] [LOCAL ] COLD: Loaded 23639 existing records from primary storage. [2025-09-14T17:30:01.938580] [INFO ] [MAIN ] COLD: Loaded 23639 existing records. [2025-09-14T17:30:02.124790] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:02.125107] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-14T17:30:02.125186] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-14T17:30:02.125845] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-14T17:30:02.125913] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-14T17:30:02.163921] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-14T17:30:02.520560] [INFO ] [REMOTE ] COLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:02.958839] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-14T17:30:03.758831] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-14T17:30:04.947128] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-14T17:30:04.950904] [INFO ] [REMOTE ] CODI: Full fetch complete (41301 records). [2025-09-14T17:30:04.951016] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-14T17:30:05.399987] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-14T17:30:05.400543] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-14T17:30:05.401902] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-14T17:30:05.402154] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-14T17:30:05.404151] [DEBUG] [LOCAL ] CODI: Trimmed 41301 records to 31566 (keeping 150 days of data) [2025-09-14T17:30:05.586434] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (4.23 seconds). [2025-09-14T17:30:05.632312] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-14T17:30:05.751712] [DEBUG] [LOCAL ] CODI: Primary data saved (31566 records). [2025-09-14T17:30:05.752043] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-14T17:30:05.752229] [INFO ] [MAIN ] Update Progress: 503/2370 symbols completed. CODI took 26.6s. Estimated remaining: 3h 16m 21s. Rate: 9.5 symbols/min [2025-09-14T17:30:06.037638] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:06.076038] [DEBUG] [LOCAL ] COMP: Loaded 23846 existing records from primary storage. [2025-09-14T17:30:06.076271] [INFO ] [MAIN ] COMP: Loaded 23846 existing records. [2025-09-14T17:30:06.309430] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:06.310057] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-14T17:30:06.310167] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-14T17:30:06.311251] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-14T17:30:06.311350] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-14T17:30:06.633125] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (2.87 seconds). [2025-09-14T17:30:06.707547] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-14T17:30:06.818919] [INFO ] [REMOTE ] COMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:06.820040] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-14T17:30:06.855729] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (4.69 seconds). [2025-09-14T17:30:06.958874] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-14T17:30:07.390773] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:30:07.758824] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-14T17:30:08.543033] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:30:08.565947] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-14T17:30:08.584721] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:30:08.691795] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T17:30:09.358830] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-14T17:30:10.074209] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-14T17:30:10.117040] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:30:10.158788] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-14T17:30:10.958880] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-14T17:30:11.289488] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:30:11.377246] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T17:30:11.382904] [INFO ] [REMOTE ] COF: Full fetch complete (58256 records). [2025-09-14T17:30:11.383042] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-14T17:30:11.767038] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-14T17:30:11.813897] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-14T17:30:11.814011] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-14T17:30:11.814909] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-14T17:30:11.815035] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-14T17:30:11.816759] [DEBUG] [LOCAL ] COF: Trimmed 58256 records to 40371 (keeping 150 days of data) [2025-09-14T17:30:11.963463] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T17:30:12.120275] [DEBUG] [LOCAL ] COF: Primary data saved (40371 records). [2025-09-14T17:30:12.120439] [INFO ] [MAIN ] COF: Full history saved. [2025-09-14T17:30:12.120537] [INFO ] [MAIN ] Update Progress: 504/2370 symbols completed. COF took 27.4s. Estimated remaining: 3h 16m 15s. Rate: 9.5 symbols/min [2025-09-14T17:30:12.291496] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:12.312261] [DEBUG] [LOCAL ] CON: Loaded 18370 existing records from primary storage. [2025-09-14T17:30:12.312459] [INFO ] [MAIN ] CON: Loaded 18370 existing records. [2025-09-14T17:30:12.488903] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:12.489188] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-14T17:30:12.489249] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-14T17:30:12.489798] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-14T17:30:12.489884] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-14T17:30:12.563914] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-14T17:30:12.848485] [INFO ] [REMOTE ] CON: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:13.358881] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-14T17:30:13.696158] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T17:30:14.158830] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-14T17:30:14.868552] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T17:30:14.874452] [INFO ] [REMOTE ] COHR: Full fetch complete (58035 records). [2025-09-14T17:30:14.874700] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-14T17:30:14.963954] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-14T17:30:15.278219] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-14T17:30:15.278361] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-14T17:30:15.279123] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-14T17:30:15.279197] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-14T17:30:15.280618] [DEBUG] [LOCAL ] COHR: Trimmed 58035 records to 40158 (keeping 150 days of data) [2025-09-14T17:30:15.399638] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-14T17:30:15.562278] [DEBUG] [LOCAL ] COHR: Primary data saved (40158 records). [2025-09-14T17:30:15.562419] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-14T17:30:15.562521] [INFO ] [MAIN ] Update Progress: 505/2370 symbols completed. COHR took 28.1s. Estimated remaining: 3h 15m 58s. Rate: 9.5 symbols/min [2025-09-14T17:30:15.733613] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:15.763925] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-14T17:30:15.773144] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:30:15.788942] [DEBUG] [LOCAL ] COOK: Loaded 10804 existing records from primary storage. [2025-09-14T17:30:15.789180] [INFO ] [MAIN ] COOK: Loaded 10804 existing records. [2025-09-14T17:30:15.971683] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:15.971947] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-14T17:30:15.972027] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-14T17:30:15.972383] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-14T17:30:15.972442] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-14T17:30:16.329589] [INFO ] [REMOTE ] COOK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:16.376189] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T17:30:16.558869] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-14T17:30:17.358845] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-14T17:30:17.470489] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T17:30:17.633626] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T17:30:18.158826] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-14T17:30:18.916265] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:30:18.958814] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-14T17:30:19.758828] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-14T17:30:19.883721] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:30:20.558815] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-14T17:30:20.608433] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T17:30:20.653423] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:30:21.358829] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-14T17:30:22.140315] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:30:22.158770] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-14T17:30:22.963895] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-14T17:30:22.973519] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T17:30:22.980272] [INFO ] [REMOTE ] COLD: Full fetch complete (56327 records). [2025-09-14T17:30:22.980441] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-14T17:30:23.368162] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-14T17:30:23.368290] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-14T17:30:23.369101] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-14T17:30:23.369186] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-14T17:30:23.370876] [DEBUG] [LOCAL ] COLD: Trimmed 56327 records to 39316 (keeping 150 days of data) [2025-09-14T17:30:23.638523] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T17:30:23.667380] [DEBUG] [LOCAL ] COLD: Primary data saved (39316 records). [2025-09-14T17:30:23.667617] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-14T17:30:23.667819] [INFO ] [MAIN ] Update Progress: 506/2370 symbols completed. COLD took 21.9s. Estimated remaining: 3h 15m 59s. Rate: 9.5 symbols/min [2025-09-14T17:30:23.764764] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-14T17:30:23.841873] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:23.868635] [DEBUG] [LOCAL ] COP: Loaded 24087 existing records from primary storage. [2025-09-14T17:30:23.868817] [INFO ] [MAIN ] COP: Loaded 24087 existing records. [2025-09-14T17:30:24.049750] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:24.061723] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-14T17:30:24.062237] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:30:24.062387] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-14T17:30:24.067963] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-14T17:30:24.068056] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-14T17:30:24.423611] [INFO ] [REMOTE ] COP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:24.558820] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-14T17:30:25.358805] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-14T17:30:25.822750] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T17:30:26.147106] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:30:26.158768] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-14T17:30:26.215771] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T17:30:26.958822] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-14T17:30:27.360447] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T17:30:27.758837] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-14T17:30:27.926879] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:30:28.558847] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-14T17:30:29.358886] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-14T17:30:29.678487] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T17:30:30.080790] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:30:30.158800] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-14T17:30:30.488483] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:30:30.494069] [INFO ] [REMOTE ] CON: Full fetch complete (42025 records). [2025-09-14T17:30:30.494229] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-14T17:30:30.870680] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-14T17:30:30.870808] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-14T17:30:30.871434] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-14T17:30:30.871493] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-14T17:30:30.872596] [DEBUG] [LOCAL ] CON: Trimmed 42025 records to 28932 (keeping 150 days of data) [2025-09-14T17:30:30.973606] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-14T17:30:31.066819] [DEBUG] [LOCAL ] CON: Primary data saved (28932 records). [2025-09-14T17:30:31.067031] [INFO ] [MAIN ] CON: Full history saved. [2025-09-14T17:30:31.067254] [INFO ] [MAIN ] Update Progress: 507/2370 symbols completed. CON took 18.9s. Estimated remaining: 3h 15m 56s. Rate: 9.5 symbols/min [2025-09-14T17:30:31.236759] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:31.258131] [DEBUG] [LOCAL ] COR: Loaded 20001 existing records from primary storage. [2025-09-14T17:30:31.258300] [INFO ] [MAIN ] COR: Loaded 20001 existing records. [2025-09-14T17:30:31.444519] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:31.445060] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-14T17:30:31.445139] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-14T17:30:31.456142] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-14T17:30:31.471458] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-14T17:30:31.581791] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-14T17:30:31.764101] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-14T17:30:31.850280] [INFO ] [REMOTE ] COR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:32.135511] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:30:32.558841] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-14T17:30:33.358862] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-14T17:30:33.737658] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T17:30:34.158895] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-14T17:30:34.357593] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T17:30:34.958809] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-14T17:30:34.989865] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T17:30:34.996005] [INFO ] [REMOTE ] COMP: Full fetch complete (58009 records). [2025-09-14T17:30:34.996168] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-14T17:30:35.366445] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T17:30:35.429057] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-14T17:30:35.429207] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-14T17:30:35.430392] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-14T17:30:35.430476] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-14T17:30:35.432857] [DEBUG] [LOCAL ] COMP: Trimmed 58009 records to 40161 (keeping 150 days of data) [2025-09-14T17:30:35.749006] [DEBUG] [LOCAL ] COMP: Primary data saved (40161 records). [2025-09-14T17:30:35.749251] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-14T17:30:35.749494] [INFO ] [MAIN ] Update Progress: 508/2370 symbols completed. COMP took 30.0s. Estimated remaining: 3h 15m 44s. Rate: 9.5 symbols/min [2025-09-14T17:30:35.764987] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-14T17:30:35.975142] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:35.999363] [DEBUG] [LOCAL ] COTY: Loaded 23971 existing records from primary storage. [2025-09-14T17:30:35.999524] [INFO ] [MAIN ] COTY: Loaded 23971 existing records. [2025-09-14T17:30:36.173383] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:36.173657] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-14T17:30:36.173719] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-14T17:30:36.174294] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-14T17:30:36.174361] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-14T17:30:36.533194] [INFO ] [REMOTE ] COTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:36.563853] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-14T17:30:36.569861] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T17:30:36.987448] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T17:30:36.992200] [INFO ] [REMOTE ] COOK: Full fetch complete (25105 records). [2025-09-14T17:30:36.992321] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-14T17:30:37.353558] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-14T17:30:37.353679] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-14T17:30:37.354138] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-14T17:30:37.354188] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-14T17:30:37.356921] [DEBUG] [LOCAL ] COOK: Trimmed 25105 records to 18711 (keeping 150 days of data) [2025-09-14T17:30:37.358784] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-14T17:30:37.466279] [DEBUG] [LOCAL ] COOK: Primary data saved (18711 records). [2025-09-14T17:30:37.466456] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-14T17:30:37.466581] [INFO ] [MAIN ] Update Progress: 509/2370 symbols completed. COOK took 21.9s. Estimated remaining: 3h 15m 21s. Rate: 9.5 symbols/min [2025-09-14T17:30:37.634697] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:37.656391] [DEBUG] [LOCAL ] COUR: Loaded 22243 existing records from primary storage. [2025-09-14T17:30:37.656561] [INFO ] [MAIN ] COUR: Loaded 22243 existing records. [2025-09-14T17:30:37.836239] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:37.836514] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-14T17:30:37.836573] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-14T17:30:37.837220] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-14T17:30:37.837300] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-14T17:30:38.184218] [INFO ] [REMOTE ] COUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:38.180029] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-14T17:30:38.793537] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-14T17:30:38.958848] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-14T17:30:39.242633] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:30:39.760618] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-14T17:30:39.763174] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:30:40.558852] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-14T17:30:40.865121] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:30:41.358875] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-14T17:30:41.415949] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:30:42.158850] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-14T17:30:42.409405] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:30:42.958854] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-14T17:30:43.491600] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-14T17:30:43.758881] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-14T17:30:43.805694] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T17:30:44.558942] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-14T17:30:44.893044] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:30:45.358843] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-14T17:30:45.858902] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:30:46.158849] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-14T17:30:46.338790] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:30:46.958813] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-14T17:30:47.152453] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:30:47.758789] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-14T17:30:47.786547] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:30:48.558832] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-14T17:30:48.678395] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T17:30:49.329533] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:30:49.358784] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-14T17:30:50.158892] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-14T17:30:50.654482] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T17:30:50.958910] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-14T17:30:51.216871] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T17:30:51.621065] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:30:51.758879] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-14T17:30:52.185369] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:30:52.191428] [INFO ] [REMOTE ] COP: Full fetch complete (58407 records). [2025-09-14T17:30:52.191656] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-14T17:30:52.560755] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-14T17:30:52.580814] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-14T17:30:52.580971] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-14T17:30:52.581947] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-14T17:30:52.602745] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-14T17:30:52.607602] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T17:30:52.618486] [DEBUG] [LOCAL ] COP: Trimmed 58407 records to 40467 (keeping 150 days of data) [2025-09-14T17:30:52.870756] [DEBUG] [LOCAL ] COP: Primary data saved (40467 records). [2025-09-14T17:30:52.870917] [INFO ] [MAIN ] COP: Full history saved. [2025-09-14T17:30:52.871015] [INFO ] [MAIN ] Update Progress: 510/2370 symbols completed. COP took 29.2s. Estimated remaining: 3h 15m 48s. Rate: 9.5 symbols/min [2025-09-14T17:30:53.042425] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:53.066897] [DEBUG] [LOCAL ] CP: Loaded 23804 existing records from primary storage. [2025-09-14T17:30:53.067072] [INFO ] [MAIN ] CP: Loaded 23804 existing records. [2025-09-14T17:30:53.241749] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:53.242044] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-14T17:30:53.242101] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-14T17:30:53.242684] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-14T17:30:53.242745] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-14T17:30:53.363915] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-14T17:30:53.626422] [INFO ] [REMOTE ] CP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:54.158861] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-14T17:30:54.288260] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T17:30:54.890387] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:30:54.958838] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-14T17:30:55.758846] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-14T17:30:56.059474] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:30:56.558790] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-14T17:30:56.602856] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:30:56.912027] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:30:56.917041] [INFO ] [REMOTE ] COR: Full fetch complete (51662 records). [2025-09-14T17:30:56.917197] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-14T17:30:57.299301] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-14T17:30:57.299435] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-14T17:30:57.300239] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-14T17:30:57.300382] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-14T17:30:57.301720] [DEBUG] [LOCAL ] COR: Trimmed 51662 records to 34959 (keeping 150 days of data) [2025-09-14T17:30:57.359978] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-14T17:30:57.448689] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T17:30:57.591319] [DEBUG] [LOCAL ] COR: Primary data saved (34959 records). [2025-09-14T17:30:57.591534] [INFO ] [MAIN ] COR: Full history saved. [2025-09-14T17:30:57.591676] [INFO ] [MAIN ] Update Progress: 511/2370 symbols completed. COR took 26.5s. Estimated remaining: 3h 15m 36s. Rate: 9.5 symbols/min [2025-09-14T17:30:57.859702] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:57.879759] [DEBUG] [LOCAL ] CPA: Loaded 12521 existing records from primary storage. [2025-09-14T17:30:57.880005] [INFO ] [MAIN ] CPA: Loaded 12521 existing records. [2025-09-14T17:30:58.167052] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-14T17:30:58.181226] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:58.181539] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-14T17:30:58.181625] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-14T17:30:58.182166] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-14T17:30:58.182266] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-14T17:30:58.700893] [INFO ] [REMOTE ] CPA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:58.899927] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T17:30:58.905296] [INFO ] [REMOTE ] COUR: Full fetch complete (53089 records). [2025-09-14T17:30:58.905442] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-14T17:30:58.968824] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-14T17:30:59.291473] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-14T17:30:59.291659] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-14T17:30:59.292679] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-14T17:30:59.292828] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-14T17:30:59.294329] [DEBUG] [LOCAL ] COUR: Trimmed 53089 records to 36989 (keeping 150 days of data) [2025-09-14T17:30:59.519010] [DEBUG] [LOCAL ] COUR: Primary data saved (36989 records). [2025-09-14T17:30:59.519204] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-14T17:30:59.519320] [INFO ] [MAIN ] Update Progress: 512/2370 symbols completed. COUR took 22.1s. Estimated remaining: 3h 15m 13s. Rate: 9.5 symbols/min [2025-09-14T17:30:59.692397] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:59.694842] [DEBUG] [LOCAL ] CPAC: Loaded 582 existing records from primary storage. [2025-09-14T17:30:59.694934] [INFO ] [MAIN ] CPAC: Loaded 582 existing records. [2025-09-14T17:30:59.769044] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-14T17:30:59.877186] [WARN ] [MAIN ] CPAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:59.877474] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-14T17:30:59.877683] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-14T17:30:59.877946] [DEBUG] [LOCAL ] CPAC: Deleted primary data file. [2025-09-14T17:30:59.878047] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-14T17:31:00.245821] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:00.275829] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T17:31:00.345232] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:31:00.558869] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-14T17:31:01.358842] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-14T17:31:01.741083] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T17:31:01.935269] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-14T17:31:02.158845] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-14T17:31:02.329195] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T17:31:02.819935] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:31:02.825495] [INFO ] [REMOTE ] COTY: Full fetch complete (57943 records). [2025-09-14T17:31:02.825624] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-14T17:31:02.970114] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-14T17:31:03.210619] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-14T17:31:03.210751] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-14T17:31:03.211485] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-14T17:31:03.211552] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-14T17:31:03.212820] [DEBUG] [LOCAL ] COTY: Trimmed 57943 records to 40116 (keeping 150 days of data) [2025-09-14T17:31:03.413534] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T17:31:03.448251] [DEBUG] [LOCAL ] COTY: Primary data saved (40116 records). [2025-09-14T17:31:03.448416] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-14T17:31:03.448522] [INFO ] [MAIN ] Update Progress: 513/2370 symbols completed. COTY took 27.7s. Estimated remaining: 3h 14m 59s. Rate: 9.5 symbols/min [2025-09-14T17:31:03.616814] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:03.631354] [DEBUG] [LOCAL ] CPAY: Loaded 13267 existing records from primary storage. [2025-09-14T17:31:03.631534] [INFO ] [MAIN ] CPAY: Loaded 13267 existing records. [2025-09-14T17:31:03.772925] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-14T17:31:03.809743] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:03.809922] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-14T17:31:03.809989] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-14T17:31:03.810556] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-14T17:31:03.810696] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-14T17:31:04.158735] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:04.558847] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-14T17:31:04.930966] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:31:05.025326] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-14T17:31:05.358886] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-14T17:31:06.158843] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-14T17:31:06.771033] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T17:31:06.958847] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-14T17:31:07.758832] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-14T17:31:08.041939] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:31:08.131949] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T17:31:08.558830] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-14T17:31:08.965984] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T17:31:08.983520] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-14T17:31:09.358884] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-14T17:31:09.801245] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T17:31:10.158881] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-14T17:31:10.662150] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-14T17:31:10.958797] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-14T17:31:11.387948] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T17:31:11.758829] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-14T17:31:12.558826] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-14T17:31:13.358837] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-14T17:31:13.418079] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T17:31:13.852789] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T17:31:13.853668] [INFO ] [REMOTE ] CPAC: Full fetch complete (1250 records). [2025-09-14T17:31:13.853754] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-14T17:31:14.042099] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T17:31:14.042424] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:31:14.042549] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:31:14.042676] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-14T17:31:14.042874] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-14T17:31:14.042958] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-14T17:31:14.043015] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-14T17:31:14.043193] [INFO ] [MAIN ] Update Progress: 514/2370 symbols completed. CPAC took 14.5s. Estimated remaining: 3h 15m 8s. Rate: 9.5 symbols/min [2025-09-14T17:31:14.163606] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-14T17:31:14.222927] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:14.256933] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T17:31:14.264255] [DEBUG] [LOCAL ] CPF: Loaded 6449 existing records from primary storage. [2025-09-14T17:31:14.271392] [INFO ] [MAIN ] CPF: Loaded 6449 existing records. [2025-09-14T17:31:14.456772] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:14.457046] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-14T17:31:14.457105] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-14T17:31:14.457441] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-14T17:31:14.457501] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-14T17:31:14.821995] [INFO ] [REMOTE ] CPF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:14.958798] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-14T17:31:15.426410] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T17:31:15.758791] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-14T17:31:16.130381] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T17:31:16.558834] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-14T17:31:17.181564] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T17:31:17.358852] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-14T17:31:17.720293] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:31:18.158821] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-14T17:31:18.650588] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:31:18.958857] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-14T17:31:19.293693] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T17:31:19.758839] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-14T17:31:20.558811] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-14T17:31:20.869362] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:31:20.916511] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:31:21.358922] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-14T17:31:21.928702] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T17:31:22.158822] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-14T17:31:22.337829] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T17:31:22.958832] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-14T17:31:23.758829] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-14T17:31:23.933957] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T17:31:24.030702] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:31:24.558861] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-14T17:31:25.175466] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T17:31:25.358843] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-14T17:31:25.469792] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T17:31:26.158845] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-14T17:31:26.579472] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:31:26.958822] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-14T17:31:27.331855] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T17:31:27.335368] [INFO ] [REMOTE ] CPA: Full fetch complete (31921 records). [2025-09-14T17:31:27.335524] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-14T17:31:27.732491] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-14T17:31:27.732609] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-14T17:31:27.733186] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-14T17:31:27.733256] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-14T17:31:27.734186] [DEBUG] [LOCAL ] CPA: Trimmed 31921 records to 21487 (keeping 150 days of data) [2025-09-14T17:31:27.791710] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-14T17:31:27.873538] [DEBUG] [LOCAL ] CPA: Primary data saved (21487 records). [2025-09-14T17:31:27.873828] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-14T17:31:27.873929] [INFO ] [MAIN ] Update Progress: 515/2370 symbols completed. CPA took 30.3s. Estimated remaining: 3h 15m 29s. Rate: 9.5 symbols/min [2025-09-14T17:31:28.041954] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:28.048998] [DEBUG] [LOCAL ] CPK: Loaded 5526 existing records from primary storage. [2025-09-14T17:31:28.049124] [INFO ] [MAIN ] CPK: Loaded 5526 existing records. [2025-09-14T17:31:28.224233] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:28.224482] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-14T17:31:28.224585] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-14T17:31:28.224956] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-14T17:31:28.225018] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-14T17:31:28.562964] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-14T17:31:28.583029] [INFO ] [REMOTE ] CPK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:28.598675] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T17:31:28.604208] [INFO ] [REMOTE ] CP: Full fetch complete (57910 records). [2025-09-14T17:31:28.604382] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-14T17:31:28.942269] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T17:31:28.997407] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-14T17:31:28.997502] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-14T17:31:28.998225] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-14T17:31:28.998284] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-14T17:31:28.999447] [DEBUG] [LOCAL ] CP: Trimmed 57910 records to 40048 (keeping 150 days of data) [2025-09-14T17:31:29.242960] [DEBUG] [LOCAL ] CP: Primary data saved (40048 records). [2025-09-14T17:31:29.243118] [INFO ] [MAIN ] CP: Full history saved. [2025-09-14T17:31:29.243213] [INFO ] [MAIN ] Update Progress: 516/2370 symbols completed. CP took 36.4s. Estimated remaining: 3h 15m 4s. Rate: 9.5 symbols/min [2025-09-14T17:31:29.363939] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-14T17:31:29.416373] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:29.441199] [DEBUG] [LOCAL ] CPNG: Loaded 24059 existing records from primary storage. [2025-09-14T17:31:29.441379] [INFO ] [MAIN ] CPNG: Loaded 24059 existing records. [2025-09-14T17:31:29.616301] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:29.616533] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-14T17:31:29.616590] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-14T17:31:29.617327] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-14T17:31:29.617395] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-14T17:31:29.892350] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:31:29.896790] [INFO ] [REMOTE ] CPF: Full fetch complete (16957 records). [2025-09-14T17:31:29.917862] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-14T17:31:29.985152] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:30.158822] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-14T17:31:30.379054] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T17:31:30.417857] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-14T17:31:30.418275] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-14T17:31:30.418800] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-14T17:31:30.419245] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-14T17:31:30.419960] [DEBUG] [LOCAL ] CPF: Trimmed 16957 records to 11023 (keeping 150 days of data) [2025-09-14T17:31:30.488165] [DEBUG] [LOCAL ] CPF: Primary data saved (11023 records). [2025-09-14T17:31:30.488350] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-14T17:31:30.488451] [INFO ] [MAIN ] Update Progress: 517/2370 symbols completed. CPF took 16.4s. Estimated remaining: 3h 14m 40s. Rate: 9.5 symbols/min [2025-09-14T17:31:30.958888] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-14T17:31:31.570842] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T17:31:31.574026] [INFO ] [REMOTE ] CPAY: Full fetch complete (34092 records). [2025-09-14T17:31:31.574144] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-14T17:31:31.763915] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-14T17:31:31.967822] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-14T17:31:31.967994] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-14T17:31:31.968705] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-14T17:31:31.968798] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-14T17:31:31.970179] [DEBUG] [LOCAL ] CPAY: Trimmed 34092 records to 22765 (keeping 150 days of data) [2025-09-14T17:31:32.108263] [DEBUG] [LOCAL ] CPAY: Primary data saved (22765 records). [2025-09-14T17:31:32.108430] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-14T17:31:32.108525] [INFO ] [MAIN ] Update Progress: 518/2370 symbols completed. CPAY took 28.7s. Estimated remaining: 3h 14m 17s. Rate: 9.5 symbols/min [2025-09-14T17:31:32.464127] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-14T17:31:32.558840] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-14T17:31:32.767370] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:31:33.358827] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-14T17:31:34.298938] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T17:31:34.304228] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-14T17:31:34.690951] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T17:31:34.958885] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-14T17:31:35.375324] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T17:31:35.758855] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-14T17:31:36.768968] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:31:36.774240] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-14T17:31:37.017019] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:31:37.358805] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-14T17:31:37.740360] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:31:38.158882] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-14T17:31:39.055077] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:31:39.059437] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-14T17:31:39.484075] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-14T17:31:39.758949] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-14T17:31:39.904471] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T17:31:40.558900] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-14T17:31:40.998518] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T17:31:41.000117] [INFO ] [REMOTE ] CPK: Full fetch complete (13946 records). [2025-09-14T17:31:41.000320] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-14T17:31:41.374038] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-14T17:31:41.374141] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-14T17:31:41.374491] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-14T17:31:41.374556] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-14T17:31:41.375077] [DEBUG] [LOCAL ] CPK: Trimmed 13946 records to 9467 (keeping 150 days of data) [2025-09-14T17:31:41.434064] [DEBUG] [LOCAL ] CPK: Primary data saved (9467 records). [2025-09-14T17:31:41.434220] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-14T17:31:41.434332] [INFO ] [MAIN ] Update Progress: 519/2370 symbols completed. CPK took 13.6s. Estimated remaining: 3h 14m 21s. Rate: 9.5 symbols/min [2025-09-14T17:31:41.954670] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-14T17:31:41.966149] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-14T17:31:44.355200] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-14T17:31:44.367806] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-14T17:31:46.732150] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-14T17:31:46.744123] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-14T17:31:48.831547] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-14T17:31:48.839992] [INFO ] [REMOTE ] CPNG: Full fetch complete (58346 records). [2025-09-14T17:31:48.840202] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-14T17:31:49.230076] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-14T17:31:49.230185] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-14T17:31:49.230990] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-14T17:31:49.231073] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-14T17:31:49.232324] [DEBUG] [LOCAL ] CPNG: Trimmed 58346 records to 40425 (keeping 150 days of data) [2025-09-14T17:31:49.487280] [DEBUG] [LOCAL ] CPNG: Primary data saved (40425 records). [2025-09-14T17:31:49.487717] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-14T17:31:49.487827] [INFO ] [MAIN ] Update Progress: 520/2370 symbols completed. CPNG took 20.2s. Estimated remaining: 3h 14m 21s. Rate: 9.5 symbols/min [2025-09-14T17:31:50.049572] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:50.174751] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:50.198718] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:50.197087] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:50.216059] [DEBUG] [LOCAL ] CQP: Loaded 8865 existing records from primary storage. [2025-09-14T17:31:50.216252] [INFO ] [MAIN ] CQP: Loaded 8865 existing records. [2025-09-14T17:31:50.286299] [DEBUG] [LOCAL ] CPS: Loaded 10105 existing records from primary storage. [2025-09-14T17:31:50.336153] [INFO ] [MAIN ] CPS: Loaded 10105 existing records. [2025-09-14T17:31:50.357659] [DEBUG] [LOCAL ] CPRI: Loaded 23466 existing records from primary storage. [2025-09-14T17:31:50.369328] [DEBUG] [LOCAL ] CPT: Loaded 19705 existing records from primary storage. [2025-09-14T17:31:50.379751] [INFO ] [MAIN ] CPT: Loaded 19705 existing records. [2025-09-14T17:31:50.363725] [INFO ] [MAIN ] CPRI: Loaded 23466 existing records. [2025-09-14T17:31:50.652068] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:50.758151] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-14T17:31:50.793275] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-14T17:31:50.908332] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-14T17:31:50.955639] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:50.971875] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-14T17:31:51.016539] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:51.022861] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:51.023277] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-14T17:31:51.029063] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-14T17:31:51.023674] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-14T17:31:51.062996] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-14T17:31:51.083224] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-14T17:31:51.068349] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-14T17:31:51.110456] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-14T17:31:51.110686] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-14T17:31:51.128211] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-14T17:31:51.164163] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-14T17:31:51.164523] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-14T17:31:51.220737] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-14T17:31:52.702132] [INFO ] [REMOTE ] CQP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:52.880560] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-14T17:31:52.999491] [INFO ] [REMOTE ] CPS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:53.011051] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:53.045421] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-14T17:31:53.064502] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-14T17:31:53.071562] [INFO ] [REMOTE ] CPT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:53.073250] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-14T17:31:54.012937] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T17:31:54.018472] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-14T17:31:54.338706] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:31:54.348229] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-14T17:31:54.406054] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:31:54.415372] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-14T17:31:54.514095] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T17:31:54.524374] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-14T17:31:54.969672] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T17:31:54.976432] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-14T17:31:55.247751] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T17:31:55.252790] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-14T17:31:55.839716] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T17:31:55.850199] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-14T17:31:56.030733] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T17:31:56.035616] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-14T17:31:56.195983] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T17:31:56.203550] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-14T17:31:56.414711] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T17:31:56.426436] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-14T17:31:56.800486] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T17:31:56.806121] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-14T17:31:57.457516] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:31:57.465153] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-14T17:31:57.535635] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:31:57.546426] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-14T17:31:57.779566] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:31:57.786406] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-14T17:31:58.196507] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T17:31:58.208676] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-14T17:31:58.257158] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T17:31:58.789162] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T17:31:58.859768] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T17:31:58.958797] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-14T17:31:59.611513] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T17:31:59.758810] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-14T17:32:00.119582] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:32:00.558868] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-14T17:32:01.358867] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-14T17:32:01.576294] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:32:02.005667] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T17:32:02.158813] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-14T17:32:02.460147] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T17:32:02.958828] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-14T17:32:03.700169] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:32:03.701925] [INFO ] [REMOTE ] CQP: Full fetch complete (22281 records). [2025-09-14T17:32:03.702015] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-14T17:32:03.765044] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-14T17:32:04.075739] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-14T17:32:04.076000] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-14T17:32:04.076862] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-14T17:32:04.077000] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-14T17:32:04.077958] [DEBUG] [LOCAL ] CQP: Trimmed 22281 records to 15095 (keeping 150 days of data) [2025-09-14T17:32:04.200632] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T17:32:04.215360] [DEBUG] [LOCAL ] CQP: Primary data saved (15095 records). [2025-09-14T17:32:04.220431] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-14T17:32:04.220692] [INFO ] [MAIN ] Update Progress: 521/2370 symbols completed. CQP took 14.7s. Estimated remaining: 3h 14m 45s. Rate: 9.5 symbols/min [2025-09-14T17:32:04.392336] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:04.404756] [DEBUG] [LOCAL ] CR: Loaded 10640 existing records from primary storage. [2025-09-14T17:32:04.404939] [INFO ] [MAIN ] CR: Loaded 10640 existing records. [2025-09-14T17:32:04.565196] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-14T17:32:04.587992] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:04.588227] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-14T17:32:04.588309] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-14T17:32:04.588798] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-14T17:32:04.588876] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-14T17:32:04.944009] [INFO ] [REMOTE ] CR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:05.061204] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T17:32:05.358833] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-14T17:32:06.158820] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-14T17:32:06.281629] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:32:06.309333] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T17:32:06.958847] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-14T17:32:07.736210] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T17:32:07.758786] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-14T17:32:07.972194] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:32:07.975062] [INFO ] [REMOTE ] CPS: Full fetch complete (28927 records). [2025-09-14T17:32:07.975191] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-14T17:32:08.363817] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-14T17:32:08.363940] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-14T17:32:08.364515] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-14T17:32:08.364592] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-14T17:32:08.365611] [DEBUG] [LOCAL ] CPS: Trimmed 28927 records to 18945 (keeping 150 days of data) [2025-09-14T17:32:08.484375] [DEBUG] [LOCAL ] CPS: Primary data saved (18945 records). [2025-09-14T17:32:08.484632] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-14T17:32:08.484796] [INFO ] [MAIN ] Update Progress: 522/2370 symbols completed. CPS took 19.0s. Estimated remaining: 3h 14m 31s. Rate: 9.5 symbols/min [2025-09-14T17:32:08.563998] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-14T17:32:08.668575] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:08.674987] [DEBUG] [LOCAL ] CRBD: Loaded 4264 existing records from primary storage. [2025-09-14T17:32:08.675158] [INFO ] [MAIN ] CRBD: Loaded 4264 existing records. [2025-09-14T17:32:08.862976] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:08.863234] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-14T17:32:08.863306] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-14T17:32:08.863581] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-14T17:32:08.863711] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-14T17:32:09.223239] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:09.283637] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:32:09.306374] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T17:32:09.304935] [INFO ] [REMOTE ] CPRI: Full fetch complete (57174 records). [2025-09-14T17:32:09.306683] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-14T17:32:09.363986] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-14T17:32:09.708817] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-14T17:32:09.708931] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-14T17:32:09.709725] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-14T17:32:09.709792] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-14T17:32:09.711070] [DEBUG] [LOCAL ] CPRI: Trimmed 57174 records to 39506 (keeping 150 days of data) [2025-09-14T17:32:09.946232] [DEBUG] [LOCAL ] CPRI: Primary data saved (39506 records). [2025-09-14T17:32:09.946418] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-14T17:32:09.946544] [INFO ] [MAIN ] Update Progress: 523/2370 symbols completed. CPRI took 20.5s. Estimated remaining: 3h 14m 8s. Rate: 9.5 symbols/min [2025-09-14T17:32:10.116734] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:10.139029] [DEBUG] [LOCAL ] CRBG: Loaded 23505 existing records from primary storage. [2025-09-14T17:32:10.139205] [INFO ] [MAIN ] CRBG: Loaded 23505 existing records. [2025-09-14T17:32:10.169209] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-14T17:32:10.315447] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:10.315738] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-14T17:32:10.315800] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-14T17:32:10.316389] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-14T17:32:10.316449] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-14T17:32:10.662193] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:10.696918] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:32:10.958850] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-14T17:32:11.056397] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:32:11.758848] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-14T17:32:12.558926] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-14T17:32:12.676863] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T17:32:12.730760] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T17:32:13.358843] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-14T17:32:13.687208] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T17:32:14.158835] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-14T17:32:14.199265] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T17:32:14.958848] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-14T17:32:15.758835] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-14T17:32:15.775522] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T17:32:16.158634] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T17:32:16.558835] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-14T17:32:16.982091] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T17:32:17.358829] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-14T17:32:18.158827] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-14T17:32:18.191006] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:32:18.354415] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T17:32:18.958857] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-14T17:32:19.300585] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T17:32:19.583866] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:32:19.588911] [INFO ] [REMOTE ] CPT: Full fetch complete (48307 records). [2025-09-14T17:32:19.589147] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-14T17:32:19.764742] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-14T17:32:20.004182] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-14T17:32:20.004333] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-14T17:32:20.005084] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-14T17:32:20.005160] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-14T17:32:20.006498] [DEBUG] [LOCAL ] CPT: Trimmed 48307 records to 33071 (keeping 150 days of data) [2025-09-14T17:32:20.217282] [DEBUG] [LOCAL ] CPT: Primary data saved (33071 records). [2025-09-14T17:32:20.217459] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-14T17:32:20.217573] [INFO ] [MAIN ] Update Progress: 524/2370 symbols completed. CPT took 30.7s. Estimated remaining: 3h 14m 16s. Rate: 9.5 symbols/min [2025-09-14T17:32:20.400172] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:20.423220] [DEBUG] [LOCAL ] CRC: Loaded 19599 existing records from primary storage. [2025-09-14T17:32:20.423409] [INFO ] [MAIN ] CRC: Loaded 19599 existing records. [2025-09-14T17:32:20.565091] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-14T17:32:20.608047] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:20.608328] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-14T17:32:20.608392] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-14T17:32:20.609005] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-14T17:32:20.609099] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-14T17:32:20.771603] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T17:32:20.994162] [INFO ] [REMOTE ] CRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:21.358829] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-14T17:32:22.139834] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:32:22.158775] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-14T17:32:22.181842] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:32:22.958856] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-14T17:32:23.660416] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T17:32:23.758825] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-14T17:32:24.093112] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T17:32:24.503933] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:32:24.505362] [INFO ] [REMOTE ] CRBD: Full fetch complete (9914 records). [2025-09-14T17:32:24.509222] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-14T17:32:24.565989] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-14T17:32:24.875020] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-14T17:32:24.875120] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-14T17:32:24.875383] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-14T17:32:24.875451] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-14T17:32:24.875958] [DEBUG] [LOCAL ] CRBD: Trimmed 9914 records to 6949 (keeping 150 days of data) [2025-09-14T17:32:24.918436] [DEBUG] [LOCAL ] CRBD: Primary data saved (6949 records). [2025-09-14T17:32:24.918579] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-14T17:32:24.918728] [INFO ] [MAIN ] Update Progress: 525/2370 symbols completed. CRBD took 16.4s. Estimated remaining: 3h 14m 4s. Rate: 9.5 symbols/min [2025-09-14T17:32:25.087020] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:25.113369] [DEBUG] [LOCAL ] CRCL: Loaded 24230 existing records from primary storage. [2025-09-14T17:32:25.113528] [INFO ] [MAIN ] CRCL: Loaded 24230 existing records. [2025-09-14T17:32:25.291460] [WARN ] [MAIN ] CRCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:25.291722] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-14T17:32:25.291788] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-14T17:32:25.292399] [DEBUG] [LOCAL ] CRCL: Deleted primary data file. [2025-09-14T17:32:25.292462] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-14T17:32:25.367665] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-14T17:32:25.650186] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:26.158817] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-14T17:32:26.396866] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T17:32:26.617083] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T17:32:26.958824] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-14T17:32:27.231451] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:32:27.231848] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-14T17:32:27.568382] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T17:32:27.758825] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-14T17:32:28.558844] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-14T17:32:29.106259] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:32:29.109800] [INFO ] [REMOTE ] CR: Full fetch complete (26535 records). [2025-09-14T17:32:29.109900] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-14T17:32:29.361959] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-14T17:32:29.479588] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-14T17:32:29.479788] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-14T17:32:29.480484] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-14T17:32:29.480576] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-14T17:32:29.494243] [DEBUG] [LOCAL ] CR: Trimmed 26535 records to 18070 (keeping 150 days of data) [2025-09-14T17:32:29.516046] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:32:29.646935] [DEBUG] [LOCAL ] CR: Primary data saved (18070 records). [2025-09-14T17:32:29.647197] [INFO ] [MAIN ] CR: Full history saved. [2025-09-14T17:32:29.647398] [INFO ] [MAIN ] Update Progress: 526/2370 symbols completed. CR took 25.4s. Estimated remaining: 3h 13m 52s. Rate: 9.5 symbols/min [2025-09-14T17:32:29.815258] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:29.838674] [DEBUG] [LOCAL ] CRGY: Loaded 23347 existing records from primary storage. [2025-09-14T17:32:29.838870] [INFO ] [MAIN ] CRGY: Loaded 23347 existing records. [2025-09-14T17:32:30.013477] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:30.013763] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-14T17:32:30.013823] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-14T17:32:30.014418] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-14T17:32:30.014479] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-14T17:32:30.163964] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-14T17:32:30.379895] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:30.958860] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-14T17:32:31.135445] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:32:31.758819] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-14T17:32:31.806668] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T17:32:31.812441] [INFO ] [REMOTE ] CRBG: Full fetch complete (56886 records). [2025-09-14T17:32:31.812589] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-14T17:32:32.207885] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-14T17:32:32.208000] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-14T17:32:32.208724] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-14T17:32:32.208791] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-14T17:32:32.210048] [DEBUG] [LOCAL ] CRBG: Trimmed 56886 records to 39482 (keeping 150 days of data) [2025-09-14T17:32:32.461693] [DEBUG] [LOCAL ] CRBG: Primary data saved (39482 records). [2025-09-14T17:32:32.461948] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-14T17:32:32.462125] [INFO ] [MAIN ] Update Progress: 527/2370 symbols completed. CRBG took 22.5s. Estimated remaining: 3h 13m 33s. Rate: 9.5 symbols/min [2025-09-14T17:32:32.567147] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-14T17:32:32.646146] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:32.675298] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:32:32.704550] [DEBUG] [LOCAL ] CRH: Loaded 23889 existing records from primary storage. [2025-09-14T17:32:32.704778] [INFO ] [MAIN ] CRH: Loaded 23889 existing records. [2025-09-14T17:32:32.878292] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:32.878576] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-14T17:32:32.878637] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-14T17:32:32.879260] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-14T17:32:32.879330] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-14T17:32:32.910819] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:32:32.949721] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-14T17:32:33.243573] [INFO ] [REMOTE ] CRH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:33.358832] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-14T17:32:33.421286] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:32:34.158900] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-14T17:32:34.425474] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:32:34.425853] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-14T17:32:34.958874] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-14T17:32:35.174448] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T17:32:35.215214] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:32:35.215620] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-14T17:32:35.758812] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-14T17:32:36.558835] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-14T17:32:37.358842] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-14T17:32:38.068783] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-14T17:32:38.141366] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T17:32:38.158771] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-14T17:32:38.958785] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-14T17:32:39.513530] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T17:32:39.700850] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T17:32:39.758780] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-14T17:32:40.495191] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:32:40.558811] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-14T17:32:41.050399] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:32:41.358896] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-14T17:32:42.158805] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-14T17:32:42.595028] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T17:32:42.958836] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-14T17:32:43.758860] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-14T17:32:43.995379] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T17:32:44.095251] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-14T17:32:44.134564] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T17:32:44.558868] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-14T17:32:45.358849] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-14T17:32:45.715218] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:32:46.158891] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-14T17:32:46.348505] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T17:32:46.478093] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:32:46.484402] [INFO ] [REMOTE ] CRC: Full fetch complete (47759 records). [2025-09-14T17:32:46.484606] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-14T17:32:46.857702] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-14T17:32:46.857805] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-14T17:32:46.858450] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-14T17:32:46.858506] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-14T17:32:46.859570] [DEBUG] [LOCAL ] CRC: Trimmed 47759 records to 32978 (keeping 150 days of data) [2025-09-14T17:32:46.961405] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-14T17:32:47.084307] [DEBUG] [LOCAL ] CRC: Primary data saved (32978 records). [2025-09-14T17:32:47.084493] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-14T17:32:47.084706] [INFO ] [MAIN ] Update Progress: 528/2370 symbols completed. CRC took 26.9s. Estimated remaining: 3h 13m 56s. Rate: 9.5 symbols/min [2025-09-14T17:32:47.253145] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:47.274424] [DEBUG] [LOCAL ] CRI: Loaded 22366 existing records from primary storage. [2025-09-14T17:32:47.274579] [INFO ] [MAIN ] CRI: Loaded 22366 existing records. [2025-09-14T17:32:47.449566] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:47.449839] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-14T17:32:47.449917] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-14T17:32:47.450455] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-14T17:32:47.450514] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-14T17:32:47.765704] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-14T17:32:47.801793] [INFO ] [REMOTE ] CRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:47.978052] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-14T17:32:48.520245] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T17:32:48.558787] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-14T17:32:49.358839] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-14T17:32:49.631626] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T17:32:50.158859] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-14T17:32:50.958846] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-14T17:32:51.127745] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-14T17:32:51.133126] [INFO ] [REMOTE ] CRCL: Full fetch complete (26709 records). [2025-09-14T17:32:51.133221] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-14T17:32:51.314926] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 69 unique days, need 150 days [2025-09-14T17:32:51.315401] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:32:51.315510] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:32:51.315759] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-14T17:32:51.315903] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-14T17:32:51.316012] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-14T17:32:51.316121] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-14T17:32:51.316305] [INFO ] [MAIN ] Update Progress: 529/2370 symbols completed. CRCL took 26.4s. Estimated remaining: 3h 13m 42s. Rate: 9.5 symbols/min [2025-09-14T17:32:51.497380] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:51.529056] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T17:32:51.556934] [DEBUG] [LOCAL ] CRK: Loaded 23345 existing records from primary storage. [2025-09-14T17:32:51.557088] [INFO ] [MAIN ] CRK: Loaded 23345 existing records. [2025-09-14T17:32:51.731988] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:51.732233] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-14T17:32:51.732290] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-14T17:32:51.732892] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-14T17:32:51.732954] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-14T17:32:51.763938] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-14T17:32:52.099733] [INFO ] [REMOTE ] CRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:52.129234] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:32:52.465060] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T17:32:52.558840] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-14T17:32:53.358922] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-14T17:32:53.512085] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:32:54.022703] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:32:54.158817] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-14T17:32:54.958875] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-14T17:32:55.121503] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:32:55.631042] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:32:55.758825] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-14T17:32:56.558835] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-14T17:32:56.683331] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:32:57.358807] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-14T17:32:57.437768] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:32:58.016242] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:32:58.023717] [INFO ] [REMOTE ] CRGY: Full fetch complete (57020 records). [2025-09-14T17:32:58.023886] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-14T17:32:58.166241] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-14T17:32:58.408849] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-14T17:32:58.431998] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-14T17:32:58.432227] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-14T17:32:58.433002] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-14T17:32:58.433069] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-14T17:32:58.433150] [INFO ] [REMOTE ] CRH: Full fetch complete (58174 records). [2025-09-14T17:32:58.433506] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-14T17:32:58.524022] [DEBUG] [LOCAL ] CRGY: Trimmed 57020 records to 39368 (keeping 150 days of data) [2025-09-14T17:32:58.942393] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-14T17:32:58.944392] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-14T17:32:58.945917] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-14T17:32:58.946485] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-14T17:32:58.950313] [DEBUG] [LOCAL ] CRH: Trimmed 58174 records to 40240 (keeping 150 days of data) [2025-09-14T17:32:59.010826] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-14T17:32:59.210657] [DEBUG] [LOCAL ] CRGY: Primary data saved (39368 records). [2025-09-14T17:32:59.212959] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-14T17:32:59.213140] [INFO ] [MAIN ] Update Progress: 530/2370 symbols completed. CRGY took 29.6s. Estimated remaining: 3h 13m 42s. Rate: 9.5 symbols/min [2025-09-14T17:32:59.491085] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:59.515396] [DEBUG] [LOCAL ] CRL: Loaded 17947 existing records from primary storage. [2025-09-14T17:32:59.516533] [INFO ] [MAIN ] CRL: Loaded 17947 existing records. [2025-09-14T17:32:59.700955] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:59.702930] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-14T17:32:59.703981] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-14T17:32:59.705102] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-14T17:32:59.705719] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-14T17:32:59.864012] [DEBUG] [LOCAL ] CRH: Primary data saved (40240 records). [2025-09-14T17:32:59.928496] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-14T17:32:59.957368] [INFO ] [MAIN ] Update Progress: 531/2370 symbols completed. CRH took 27.5s. Estimated remaining: 3h 13m 16s. Rate: 9.5 symbols/min [2025-09-14T17:33:00.189296] [INFO ] [REMOTE ] CRL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:00.243354] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:00.240772] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-14T17:33:00.276972] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-14T17:33:00.306275] [DEBUG] [LOCAL ] CRM: Loaded 24134 existing records from primary storage. [2025-09-14T17:33:00.306458] [INFO ] [MAIN ] CRM: Loaded 24134 existing records. [2025-09-14T17:33:00.479457] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:00.479733] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-14T17:33:00.479797] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-14T17:33:00.480510] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-14T17:33:00.480570] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-14T17:33:00.568807] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-14T17:33:00.831936] [INFO ] [REMOTE ] CRM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:01.020493] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T17:33:01.358862] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-14T17:33:02.201983] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-14T17:33:02.205075] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T17:33:02.467912] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T17:33:02.958902] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-14T17:33:03.758883] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-14T17:33:04.716469] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (3.36 seconds). [2025-09-14T17:33:04.727092] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-14T17:33:05.163929] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-09-14T17:33:05.358910] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-14T17:33:05.503654] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-14T17:33:05.547081] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T17:33:06.158842] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-14T17:33:06.958934] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-14T17:33:07.142285] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-14T17:33:07.185368] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T17:33:07.583778] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T17:33:07.758835] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-14T17:33:08.558846] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-14T17:33:08.768668] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T17:33:09.358953] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-14T17:33:10.025028] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T17:33:10.158846] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-14T17:33:10.416524] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T17:33:10.483673] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:33:10.488818] [INFO ] [REMOTE ] CRI: Full fetch complete (54157 records). [2025-09-14T17:33:10.488953] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-14T17:33:10.864457] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-14T17:33:10.864574] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-14T17:33:10.865292] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-14T17:33:10.865349] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-14T17:33:10.866543] [DEBUG] [LOCAL ] CRI: Trimmed 54157 records to 37683 (keeping 150 days of data) [2025-09-14T17:33:10.959022] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-14T17:33:11.111718] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T17:33:11.143882] [DEBUG] [LOCAL ] CRI: Primary data saved (37683 records). [2025-09-14T17:33:11.144074] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-14T17:33:11.144182] [INFO ] [MAIN ] Update Progress: 532/2370 symbols completed. CRI took 24.1s. Estimated remaining: 3h 13m 27s. Rate: 9.5 symbols/min [2025-09-14T17:33:11.313052] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:11.332076] [DEBUG] [LOCAL ] CRS: Loaded 18766 existing records from primary storage. [2025-09-14T17:33:11.332260] [INFO ] [MAIN ] CRS: Loaded 18766 existing records. [2025-09-14T17:33:11.509323] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:11.509581] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-14T17:33:11.509660] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-14T17:33:11.510221] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-14T17:33:11.510285] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-14T17:33:11.763894] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-14T17:33:11.866683] [INFO ] [REMOTE ] CRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:12.558826] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-14T17:33:13.358890] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-14T17:33:13.399590] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:33:13.440521] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-14T17:33:14.158790] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-14T17:33:14.305978] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:33:14.958852] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-14T17:33:15.388140] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T17:33:15.758871] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-14T17:33:16.558846] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-14T17:33:16.677991] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T17:33:16.683349] [INFO ] [REMOTE ] CRK: Full fetch complete (56619 records). [2025-09-14T17:33:16.683497] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-14T17:33:17.088391] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-14T17:33:17.088559] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-14T17:33:17.089773] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-14T17:33:17.089851] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-14T17:33:17.091832] [DEBUG] [LOCAL ] CRK: Trimmed 56619 records to 39134 (keeping 150 days of data) [2025-09-14T17:33:17.372726] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (3.21 seconds). [2025-09-14T17:33:17.408942] [DEBUG] [LOCAL ] CRK: Primary data saved (39134 records). [2025-09-14T17:33:17.409893] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-14T17:33:17.411068] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-14T17:33:17.410400] [INFO ] [MAIN ] Update Progress: 533/2370 symbols completed. CRK took 26.1s. Estimated remaining: 3h 13m 20s. Rate: 9.5 symbols/min [2025-09-14T17:33:17.584746] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:17.612444] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-14T17:33:17.612618] [DEBUG] [LOCAL ] CRT: Loaded 2143 existing records from primary storage. [2025-09-14T17:33:17.612863] [INFO ] [MAIN ] CRT: Loaded 2143 existing records. [2025-09-14T17:33:17.807322] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:17.807685] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-14T17:33:17.807767] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-14T17:33:17.808023] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-14T17:33:17.808098] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-14T17:33:18.168566] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-14T17:33:18.209878] [INFO ] [REMOTE ] CRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:18.241489] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T17:33:18.958836] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-14T17:33:19.738139] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T17:33:19.765400] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-14T17:33:19.771665] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T17:33:19.933858] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-14T17:33:20.558840] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-14T17:33:21.151712] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T17:33:21.358853] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-14T17:33:21.416543] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:33:21.666842] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:33:21.671166] [INFO ] [REMOTE ] CRL: Full fetch complete (48278 records). [2025-09-14T17:33:21.671289] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-14T17:33:22.059047] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-14T17:33:22.059168] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-14T17:33:22.059924] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-14T17:33:22.059987] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-14T17:33:22.061101] [DEBUG] [LOCAL ] CRL: Trimmed 48278 records to 31895 (keeping 150 days of data) [2025-09-14T17:33:22.161619] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-14T17:33:22.255687] [DEBUG] [LOCAL ] CRL: Primary data saved (31895 records). [2025-09-14T17:33:22.255867] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-14T17:33:22.255967] [INFO ] [MAIN ] Update Progress: 534/2370 symbols completed. CRL took 23.0s. Estimated remaining: 3h 13m 9s. Rate: 9.5 symbols/min [2025-09-14T17:33:22.426129] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:22.443885] [DEBUG] [LOCAL ] CSAN: Loaded 18803 existing records from primary storage. [2025-09-14T17:33:22.444042] [INFO ] [MAIN ] CSAN: Loaded 18803 existing records. [2025-09-14T17:33:22.625031] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:22.625278] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-14T17:33:22.625342] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-14T17:33:22.625837] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-14T17:33:22.625904] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-14T17:33:22.924212] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T17:33:22.964502] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-14T17:33:22.993346] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:23.758821] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-14T17:33:24.558881] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-14T17:33:24.808099] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:33:25.358837] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-14T17:33:26.158888] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-14T17:33:26.340974] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T17:33:26.660454] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-14T17:33:26.880204] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:33:26.958773] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-14T17:33:27.047203] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T17:33:27.644290] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T17:33:27.649873] [INFO ] [REMOTE ] CRM: Full fetch complete (58448 records). [2025-09-14T17:33:27.650018] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-14T17:33:27.763873] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-14T17:33:28.039888] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-14T17:33:28.040027] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-14T17:33:28.040859] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-14T17:33:28.040932] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-14T17:33:28.042242] [DEBUG] [LOCAL ] CRM: Trimmed 58448 records to 40510 (keeping 150 days of data) [2025-09-14T17:33:28.298696] [DEBUG] [LOCAL ] CRM: Primary data saved (40510 records). [2025-09-14T17:33:28.298858] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-14T17:33:28.298953] [INFO ] [MAIN ] Update Progress: 535/2370 symbols completed. CRM took 28.3s. Estimated remaining: 3h 13m 1s. Rate: 9.5 symbols/min [2025-09-14T17:33:28.465329] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:28.480781] [DEBUG] [LOCAL ] CSL: Loaded 13838 existing records from primary storage. [2025-09-14T17:33:28.480949] [INFO ] [MAIN ] CSL: Loaded 13838 existing records. [2025-09-14T17:33:28.563955] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-14T17:33:28.658420] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:28.658735] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-14T17:33:28.658799] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-14T17:33:28.659505] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-14T17:33:28.659569] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-14T17:33:29.010204] [INFO ] [REMOTE ] CSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:29.106268] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T17:33:29.358842] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-14T17:33:29.534580] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:33:30.012502] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T17:33:30.158901] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-14T17:33:30.761675] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:33:30.958875] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-14T17:33:31.758828] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-14T17:33:32.355232] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T17:33:32.356577] [INFO ] [REMOTE ] CRT: Full fetch complete (5367 records). [2025-09-14T17:33:32.356695] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-14T17:33:32.566771] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-14T17:33:32.763127] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-14T17:33:32.764777] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:33:32.764892] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-14T17:33:32.774339] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-14T17:33:32.774617] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-14T17:33:32.783785] [DEBUG] [LOCAL ] CRT: Trimmed 5367 records to 3442 (keeping 150 days of data) [2025-09-14T17:33:32.807081] [DEBUG] [LOCAL ] CRT: Primary data saved (3442 records). [2025-09-14T17:33:32.807217] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-14T17:33:32.807337] [INFO ] [MAIN ] Update Progress: 536/2370 symbols completed. CRT took 15.4s. Estimated remaining: 3h 12m 49s. Rate: 9.5 symbols/min [2025-09-14T17:33:32.976373] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:32.983836] [DEBUG] [LOCAL ] CSR: Loaded 5736 existing records from primary storage. [2025-09-14T17:33:32.983980] [INFO ] [MAIN ] CSR: Loaded 5736 existing records. [2025-09-14T17:33:33.156767] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:33.157067] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-14T17:33:33.157129] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-14T17:33:33.157473] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-14T17:33:33.157532] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-14T17:33:33.363972] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-14T17:33:33.510385] [INFO ] [REMOTE ] CSR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:33.866104] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:33:33.870704] [INFO ] [REMOTE ] CRS: Full fetch complete (47445 records). [2025-09-14T17:33:33.870810] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-14T17:33:34.167791] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-14T17:33:34.264409] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-14T17:33:34.264566] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-14T17:33:34.265571] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-14T17:33:34.265745] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-14T17:33:34.267134] [DEBUG] [LOCAL ] CRS: Trimmed 47445 records to 32697 (keeping 150 days of data) [2025-09-14T17:33:34.291505] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:33:34.510508] [DEBUG] [LOCAL ] CRS: Primary data saved (32697 records). [2025-09-14T17:33:34.510716] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-14T17:33:34.510828] [INFO ] [MAIN ] Update Progress: 537/2370 symbols completed. CRS took 23.4s. Estimated remaining: 3h 12m 27s. Rate: 9.5 symbols/min [2025-09-14T17:33:34.696572] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:34.718874] [DEBUG] [LOCAL ] CSTM: Loaded 20930 existing records from primary storage. [2025-09-14T17:33:34.719051] [INFO ] [MAIN ] CSTM: Loaded 20930 existing records. [2025-09-14T17:33:34.903430] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:34.903707] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-14T17:33:34.903767] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-14T17:33:34.904413] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-14T17:33:34.904472] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-14T17:33:34.971481] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-14T17:33:35.235804] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:33:35.296923] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:35.758857] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-14T17:33:36.366990] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T17:33:36.558812] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-14T17:33:36.663490] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T17:33:37.358875] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-14T17:33:38.068714] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:33:38.158794] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-14T17:33:38.536343] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T17:33:38.958830] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-14T17:33:39.605504] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T17:33:39.758827] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-14T17:33:40.279415] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T17:33:40.558855] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-14T17:33:41.214015] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:33:41.358866] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-14T17:33:42.163887] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-14T17:33:42.186370] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T17:33:42.648562] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T17:33:42.958843] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-14T17:33:43.758889] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-14T17:33:43.792778] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T17:33:44.304319] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T17:33:44.558914] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-14T17:33:45.097662] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:33:45.358799] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-14T17:33:45.588610] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T17:33:46.158836] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-14T17:33:46.968771] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-14T17:33:46.996372] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T17:33:47.682227] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T17:33:47.758947] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-14T17:33:47.887382] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T17:33:48.558913] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-14T17:33:48.996345] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T17:33:49.358844] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-14T17:33:49.448582] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T17:33:50.158834] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-14T17:33:50.958831] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-14T17:33:51.001618] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:33:51.151784] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:33:51.758828] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-14T17:33:52.301259] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T17:33:52.558830] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-14T17:33:53.179766] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T17:33:53.184497] [INFO ] [REMOTE ] CSAN: Full fetch complete (45465 records). [2025-09-14T17:33:53.184612] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-14T17:33:53.363717] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-14T17:33:53.575890] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-14T17:33:53.576314] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-14T17:33:53.577234] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-14T17:33:53.577408] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-14T17:33:53.587465] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:33:53.591729] [DEBUG] [LOCAL ] CSAN: Trimmed 45465 records to 31822 (keeping 150 days of data) [2025-09-14T17:33:53.792293] [DEBUG] [LOCAL ] CSAN: Primary data saved (31822 records). [2025-09-14T17:33:53.792487] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-14T17:33:53.792621] [INFO ] [MAIN ] Update Progress: 538/2370 symbols completed. CSAN took 31.5s. Estimated remaining: 3h 13m 5s. Rate: 9.5 symbols/min [2025-09-14T17:33:53.969367] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:53.978949] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:33:53.983985] [INFO ] [REMOTE ] CSL: Full fetch complete (34077 records). [2025-09-14T17:33:53.984136] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-14T17:33:54.029902] [DEBUG] [LOCAL ] CSV: Loaded 5241 existing records from primary storage. [2025-09-14T17:33:54.066800] [INFO ] [MAIN ] CSV: Loaded 5241 existing records. [2025-09-14T17:33:54.161350] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-14T17:33:54.417992] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:54.451461] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-14T17:33:54.451564] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-14T17:33:54.472891] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-14T17:33:54.506821] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-14T17:33:54.570011] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-14T17:33:54.602011] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-14T17:33:54.602543] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-14T17:33:54.608135] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-14T17:33:54.645445] [DEBUG] [LOCAL ] CSL: Trimmed 34077 records to 22559 (keeping 150 days of data) [2025-09-14T17:33:54.931834] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:33:54.937409] [INFO ] [REMOTE ] CSR: Full fetch complete (13213 records). [2025-09-14T17:33:54.938042] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-14T17:33:54.968136] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-14T17:33:55.121748] [INFO ] [REMOTE ] CSV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:55.572179] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-14T17:33:55.574248] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-14T17:33:55.576377] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-14T17:33:55.578590] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-14T17:33:55.578429] [DEBUG] [LOCAL ] CSL: Primary data saved (22559 records). [2025-09-14T17:33:55.579685] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-14T17:33:55.580319] [INFO ] [MAIN ] Update Progress: 539/2370 symbols completed. CSL took 27.3s. Estimated remaining: 3h 12m 43s. Rate: 9.5 symbols/min [2025-09-14T17:33:55.580129] [DEBUG] [LOCAL ] CSR: Trimmed 13213 records to 9762 (keeping 150 days of data) [2025-09-14T17:33:55.764013] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-14T17:33:55.952492] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:55.972141] [DEBUG] [LOCAL ] CSW: Loaded 6733 existing records from primary storage. [2025-09-14T17:33:55.972374] [INFO ] [MAIN ] CSW: Loaded 6733 existing records. [2025-09-14T17:33:56.053958] [DEBUG] [LOCAL ] CSR: Primary data saved (9762 records). [2025-09-14T17:33:56.113509] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-14T17:33:56.143784] [INFO ] [MAIN ] Update Progress: 540/2370 symbols completed. CSR took 23.3s. Estimated remaining: 3h 12m 17s. Rate: 9.5 symbols/min [2025-09-14T17:33:56.370624] [WARN ] [MAIN ] CSW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:56.408916] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-14T17:33:56.440270] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-14T17:33:56.440166] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:56.441004] [DEBUG] [LOCAL ] CSW: Deleted primary data file. [2025-09-14T17:33:56.441136] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-14T17:33:56.541294] [DEBUG] [LOCAL ] CTBB: Loaded 3052 existing records from primary storage. [2025-09-14T17:33:56.578005] [INFO ] [MAIN ] CTBB: Loaded 3052 existing records. [2025-09-14T17:33:56.913319] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T17:33:56.937419] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:56.976892] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-14T17:33:56.998132] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-14T17:33:57.061230] [INFO ] [REMOTE ] CSW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:57.061610] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-14T17:33:57.062376] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-14T17:33:57.062801] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T17:33:57.067089] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-14T17:33:57.363981] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-14T17:33:57.437935] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:57.694117] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:33:57.694563] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-14T17:33:58.158825] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-14T17:33:58.776712] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T17:33:58.795639] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-14T17:33:58.958876] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-14T17:33:59.758817] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-14T17:33:59.828146] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T17:34:00.019184] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:00.019527] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-14T17:34:00.558831] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-14T17:34:01.358854] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-14T17:34:02.158796] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-14T17:34:02.414924] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:02.415211] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-14T17:34:02.522755] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:34:02.550984] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:34:02.958893] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-14T17:34:03.758895] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-14T17:34:04.429617] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T17:34:04.435079] [INFO ] [REMOTE ] CSTM: Full fetch complete (52297 records). [2025-09-14T17:34:04.435263] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-14T17:34:04.563911] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-14T17:34:04.846210] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-14T17:34:04.846715] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:34:04.846844] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-14T17:34:04.851349] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-14T17:34:04.851822] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-14T17:34:04.853390] [DEBUG] [LOCAL ] CSTM: Trimmed 52297 records to 35715 (keeping 150 days of data) [2025-09-14T17:34:05.065706] [DEBUG] [LOCAL ] CSTM: Primary data saved (35715 records). [2025-09-14T17:34:05.065882] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-14T17:34:05.065989] [INFO ] [MAIN ] Update Progress: 541/2370 symbols completed. CSTM took 30.6s. Estimated remaining: 3h 12m 20s. Rate: 9.5 symbols/min [2025-09-14T17:34:05.234112] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:05.238688] [DEBUG] [LOCAL ] CTDD: Loaded 2446 existing records from primary storage. [2025-09-14T17:34:05.238797] [INFO ] [MAIN ] CTDD: Loaded 2446 existing records. [2025-09-14T17:34:05.363936] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-14T17:34:05.418093] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:05.418341] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-14T17:34:05.418404] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-14T17:34:05.418680] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-14T17:34:05.418747] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-14T17:34:05.588137] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:34:05.707823] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:05.710885] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-14T17:34:05.792098] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:06.158956] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-14T17:34:06.719134] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-14T17:34:06.958858] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-14T17:34:07.678466] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:34:07.758824] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-14T17:34:08.558841] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-14T17:34:08.574331] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:34:09.358828] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-14T17:34:09.396414] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:34:10.056096] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:34:10.158830] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-14T17:34:10.942561] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:34:10.958770] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-14T17:34:11.758856] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-14T17:34:12.085711] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T17:34:12.555833] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T17:34:12.558827] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-14T17:34:13.358834] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-14T17:34:13.394467] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T17:34:14.158854] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-14T17:34:14.510558] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T17:34:14.958859] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-14T17:34:15.067608] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T17:34:15.758823] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-14T17:34:16.039441] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T17:34:16.558874] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-14T17:34:16.851335] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:34:17.184126] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T17:34:17.358838] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-14T17:34:17.802409] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T17:34:18.158828] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-14T17:34:18.924019] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:34:18.926108] [INFO ] [REMOTE ] CSV: Full fetch complete (14438 records). [2025-09-14T17:34:18.926200] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-14T17:34:18.963896] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-14T17:34:19.287424] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-14T17:34:19.287525] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-14T17:34:19.287883] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-14T17:34:19.287948] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-14T17:34:19.288466] [DEBUG] [LOCAL ] CSV: Trimmed 14438 records to 9150 (keeping 150 days of data) [2025-09-14T17:34:19.343091] [DEBUG] [LOCAL ] CSV: Primary data saved (9150 records). [2025-09-14T17:34:19.343237] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-14T17:34:19.343333] [INFO ] [MAIN ] Update Progress: 542/2370 symbols completed. CSV took 25.6s. Estimated remaining: 3h 12m 40s. Rate: 9.5 symbols/min [2025-09-14T17:34:19.511615] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:19.511873] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-14T17:34:19.511924] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-14T17:34:19.512143] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-14T17:34:19.512197] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-14T17:34:19.512278] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-14T17:34:19.512327] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-14T17:34:19.759480] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-14T17:34:19.802713] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T17:34:19.831178] [INFO ] [REMOTE ] CSW: Full fetch complete (7075 records). [2025-09-14T17:34:19.866491] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-14T17:34:19.955598] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:20.064277] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 67 unique days, need 150 days [2025-09-14T17:34:20.064538] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:34:20.064592] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:34:20.064667] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-14T17:34:20.064744] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-14T17:34:20.064794] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-14T17:34:20.064855] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-14T17:34:20.064963] [INFO ] [MAIN ] Update Progress: 543/2370 symbols completed. CSW took 24.5s. Estimated remaining: 3h 12m 15s. Rate: 9.5 symbols/min [2025-09-14T17:34:20.245236] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:20.253677] [DEBUG] [LOCAL ] CTEV: Loaded 6401 existing records from primary storage. [2025-09-14T17:34:20.253810] [INFO ] [MAIN ] CTEV: Loaded 6401 existing records. [2025-09-14T17:34:20.427108] [WARN ] [MAIN ] CTEV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:20.427363] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-14T17:34:20.427424] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-14T17:34:20.427781] [DEBUG] [LOCAL ] CTEV: Deleted primary data file. [2025-09-14T17:34:20.427843] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-14T17:34:20.580581] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-14T17:34:20.581561] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:34:20.792633] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:20.891230] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:20.891568] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-14T17:34:21.358849] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-14T17:34:22.041715] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:34:22.043109] [INFO ] [REMOTE ] CTBB: Full fetch complete (7938 records). [2025-09-14T17:34:22.043198] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-14T17:34:22.163989] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-14T17:34:22.407513] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-14T17:34:22.407617] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-14T17:34:22.407958] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-14T17:34:22.408034] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-14T17:34:22.408487] [DEBUG] [LOCAL ] CTBB: Trimmed 7938 records to 4859 (keeping 150 days of data) [2025-09-14T17:34:22.439103] [DEBUG] [LOCAL ] CTBB: Primary data saved (4859 records). [2025-09-14T17:34:22.439256] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-14T17:34:22.439373] [INFO ] [MAIN ] Update Progress: 544/2370 symbols completed. CTBB took 26.3s. Estimated remaining: 3h 11m 56s. Rate: 9.5 symbols/min [2025-09-14T17:34:22.503466] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:22.541751] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-14T17:34:22.612212] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:22.627016] [DEBUG] [LOCAL ] CTO: Loaded 12493 existing records from primary storage. [2025-09-14T17:34:22.627189] [INFO ] [MAIN ] CTO: Loaded 12493 existing records. [2025-09-14T17:34:22.808085] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:22.808331] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-14T17:34:22.808391] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-14T17:34:22.808950] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-14T17:34:22.809017] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-14T17:34:22.963944] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-14T17:34:23.188598] [INFO ] [REMOTE ] CTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:23.333313] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:23.333669] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-14T17:34:23.758836] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-14T17:34:24.100213] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-14T17:34:24.558875] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-14T17:34:25.358839] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-14T17:34:25.511431] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T17:34:26.158828] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-14T17:34:26.586301] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T17:34:26.908532] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T17:34:26.958841] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-14T17:34:27.758829] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-14T17:34:28.239631] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T17:34:28.473502] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:34:28.558824] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-14T17:34:28.799571] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-14T17:34:29.358925] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-14T17:34:30.029433] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T17:34:30.158847] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-14T17:34:30.398258] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-14T17:34:30.958828] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-14T17:34:31.178818] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:31.179188] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-14T17:34:31.758894] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-14T17:34:32.558813] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-14T17:34:32.750192] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:34:33.358859] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-14T17:34:33.808113] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T17:34:34.102452] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T17:34:34.158834] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-14T17:34:34.740869] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:34:34.742283] [INFO ] [REMOTE ] CTDD: Full fetch complete (6227 records). [2025-09-14T17:34:34.742702] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-14T17:34:34.964017] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-14T17:34:35.103062] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-14T17:34:35.103169] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-14T17:34:35.103347] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-14T17:34:35.103406] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-14T17:34:35.103858] [DEBUG] [LOCAL ] CTDD: Trimmed 6227 records to 3852 (keeping 150 days of data) [2025-09-14T17:34:35.128194] [DEBUG] [LOCAL ] CTDD: Primary data saved (3852 records). [2025-09-14T17:34:35.128288] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-14T17:34:35.128392] [INFO ] [MAIN ] Update Progress: 545/2370 symbols completed. CTDD took 30.1s. Estimated remaining: 3h 12m 11s. Rate: 9.5 symbols/min [2025-09-14T17:34:35.301934] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:35.317815] [DEBUG] [LOCAL ] CTOS: Loaded 15798 existing records from primary storage. [2025-09-14T17:34:35.317993] [INFO ] [MAIN ] CTOS: Loaded 15798 existing records. [2025-09-14T17:34:35.491524] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:35.491824] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-14T17:34:35.491897] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-14T17:34:35.492458] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-14T17:34:35.492550] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-14T17:34:35.764074] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-14T17:34:35.851706] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:36.039132] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:36.039483] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-14T17:34:36.039571] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-14T17:34:36.039665] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-14T17:34:36.040305] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:34:36.040459] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:34:36.040516] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:34:36.040564] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-14T17:34:36.040632] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-14T17:34:36.040702] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-14T17:34:36.040839] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-14T17:34:36.040925] [INFO ] [MAIN ] Update Progress: 546/2370 symbols completed. CTEST took 16.7s. Estimated remaining: 3h 11m 46s. Rate: 9.5 symbols/min [2025-09-14T17:34:36.239441] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:36.255872] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:34:36.283471] [DEBUG] [LOCAL ] CTRA: Loaded 24015 existing records from primary storage. [2025-09-14T17:34:36.283830] [INFO ] [MAIN ] CTRA: Loaded 24015 existing records. [2025-09-14T17:34:36.474126] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:36.474479] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-14T17:34:36.474574] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-14T17:34:36.475407] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-14T17:34:36.475492] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-14T17:34:36.564067] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-14T17:34:36.843775] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:37.358860] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-14T17:34:37.563578] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T17:34:38.158858] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-14T17:34:38.437336] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:34:38.958928] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-14T17:34:39.453864] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T17:34:39.758885] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-14T17:34:40.078271] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:34:40.369195] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T17:34:40.558898] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-14T17:34:41.358872] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-14T17:34:41.457035] [DEBUG] [REMOTE ] CTO: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-14T17:34:41.457404] [WARN ] [REMOTE ] CTO: No data returned for month 2025-07 [2025-09-14T17:34:42.158847] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-14T17:34:42.528628] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T17:34:42.958839] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-14T17:34:43.061015] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:34:43.758852] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-14T17:34:44.558874] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-14T17:34:45.014368] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T17:34:45.358841] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-14T17:34:45.406275] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:34:45.599727] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T17:34:46.158815] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-14T17:34:46.338225] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:34:46.341346] [INFO ] [REMOTE ] CTO: Full fetch complete (26678 records). [2025-09-14T17:34:46.341477] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-14T17:34:46.537738] [WARN ] [VALIDATOR ] CTO: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-14T17:34:46.538183] [FATAL] [MAIN ] CTO: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:34:46.538243] [WARN ] [MAIN ] CTO: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:34:46.538310] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-14T17:34:46.538391] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-09-14T17:34:46.538443] [INFO ] [LOCAL ] CTO: Starting deletion of derivative data. [2025-09-14T17:34:46.538497] [DEBUG] [LOCAL ] CTO: No derivative data file found to delete. [2025-09-14T17:34:46.538597] [INFO ] [MAIN ] Update Progress: 547/2370 symbols completed. CTO took 24.1s. Estimated remaining: 3h 11m 54s. Rate: 9.5 symbols/min [2025-09-14T17:34:46.716131] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:46.739811] [DEBUG] [LOCAL ] CTRE: Loaded 22554 existing records from primary storage. [2025-09-14T17:34:46.739981] [INFO ] [MAIN ] CTRE: Loaded 22554 existing records. [2025-09-14T17:34:46.868354] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:34:46.908853] [INFO ] [REMOTE ] CTEV: Full fetch complete (12880 records). [2025-09-14T17:34:46.925344] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-14T17:34:46.928920] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:46.962056] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-14T17:34:47.000139] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-14T17:34:47.034496] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-14T17:34:47.035460] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-14T17:34:47.056369] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-14T17:34:47.196292] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-14T17:34:47.220873] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:34:47.221539] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:34:47.221605] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-14T17:34:47.222146] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-14T17:34:47.232911] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-14T17:34:47.243253] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-14T17:34:47.270187] [INFO ] [MAIN ] Update Progress: 548/2370 symbols completed. CTEV took 27.2s. Estimated remaining: 3h 11m 29s. Rate: 9.5 symbols/min [2025-09-14T17:34:47.657116] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:47.674831] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:47.697305] [DEBUG] [LOCAL ] CTRI: Loaded 19235 existing records from primary storage. [2025-09-14T17:34:47.697511] [INFO ] [MAIN ] CTRI: Loaded 19235 existing records. [2025-09-14T17:34:47.764060] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-14T17:34:47.886857] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:47.887184] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-14T17:34:47.887272] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-14T17:34:47.887949] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-14T17:34:47.888034] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-14T17:34:48.239016] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:48.508429] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:34:48.559103] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-14T17:34:49.358983] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-14T17:34:49.509533] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:34:49.863241] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T17:34:50.158877] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-14T17:34:50.807225] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T17:34:50.958942] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-14T17:34:51.296799] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:34:51.758906] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-14T17:34:52.558845] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-14T17:34:52.720521] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:34:53.358813] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-14T17:34:53.755040] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T17:34:53.792398] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:34:54.158837] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-14T17:34:54.318389] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T17:34:54.958858] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-14T17:34:55.758894] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-14T17:34:56.166950] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T17:34:56.468850] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:34:56.558907] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-14T17:34:57.327580] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:34:57.358776] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-14T17:34:58.158869] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-14T17:34:58.403826] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T17:34:58.760517] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T17:34:58.958822] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-14T17:34:59.644136] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T17:34:59.758807] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-14T17:35:00.558832] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-14T17:35:01.194995] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-14T17:35:01.358833] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-14T17:35:01.418723] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T17:35:02.158836] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-14T17:35:02.331851] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T17:35:02.958820] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-14T17:35:03.250099] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T17:35:03.758880] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-14T17:35:03.878262] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:35:04.416183] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:35:04.441036] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:35:04.448138] [INFO ] [REMOTE ] CTRA: Full fetch complete (58330 records). [2025-09-14T17:35:04.448265] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-14T17:35:04.563915] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-14T17:35:04.839794] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-14T17:35:04.839907] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-14T17:35:04.840760] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-14T17:35:04.840842] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-14T17:35:04.842146] [DEBUG] [LOCAL ] CTRA: Trimmed 58330 records to 40394 (keeping 150 days of data) [2025-09-14T17:35:05.118064] [DEBUG] [LOCAL ] CTRA: Primary data saved (40394 records). [2025-09-14T17:35:05.118300] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-14T17:35:05.118462] [INFO ] [MAIN ] Update Progress: 549/2370 symbols completed. CTRA took 29.1s. Estimated remaining: 3h 12m 1s. Rate: 9.5 symbols/min [2025-09-14T17:35:05.296367] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:05.308786] [DEBUG] [LOCAL ] CTS: Loaded 8549 existing records from primary storage. [2025-09-14T17:35:05.309019] [INFO ] [MAIN ] CTS: Loaded 8549 existing records. [2025-09-14T17:35:05.364082] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-14T17:35:05.518953] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:05.519284] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-14T17:35:05.519350] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-14T17:35:05.519758] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-14T17:35:05.519827] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-14T17:35:05.895348] [INFO ] [REMOTE ] CTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:06.051449] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T17:35:06.056901] [INFO ] [REMOTE ] CTRI: Full fetch complete (39507 records). [2025-09-14T17:35:06.057035] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-14T17:35:06.164003] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-14T17:35:06.427393] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-14T17:35:06.427502] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-14T17:35:06.428146] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-14T17:35:06.428216] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-14T17:35:06.429241] [DEBUG] [LOCAL ] CTRI: Trimmed 39507 records to 29300 (keeping 150 days of data) [2025-09-14T17:35:06.602867] [DEBUG] [LOCAL ] CTRI: Primary data saved (29300 records). [2025-09-14T17:35:06.603032] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-14T17:35:06.603145] [INFO ] [MAIN ] Update Progress: 550/2370 symbols completed. CTRI took 19.3s. Estimated remaining: 3h 11m 39s. Rate: 9.5 symbols/min [2025-09-14T17:35:06.771169] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:06.798700] [DEBUG] [LOCAL ] CTVA: Loaded 23886 existing records from primary storage. [2025-09-14T17:35:06.798877] [INFO ] [MAIN ] CTVA: Loaded 23886 existing records. [2025-09-14T17:35:06.971143] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-14T17:35:06.975531] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:06.976755] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-14T17:35:06.976828] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-14T17:35:06.977600] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-14T17:35:06.977686] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-14T17:35:07.276844] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:35:07.429977] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:07.452452] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:35:07.758849] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-14T17:35:08.062360] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:35:08.558835] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-14T17:35:09.034242] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T17:35:09.039215] [INFO ] [REMOTE ] CTOS: Full fetch complete (39869 records). [2025-09-14T17:35:09.039346] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-14T17:35:09.369177] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-14T17:35:09.415894] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-14T17:35:09.415997] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-14T17:35:09.416791] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-14T17:35:09.416850] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-14T17:35:09.417849] [DEBUG] [LOCAL ] CTOS: Trimmed 39869 records to 27448 (keeping 150 days of data) [2025-09-14T17:35:09.578086] [DEBUG] [LOCAL ] CTOS: Primary data saved (27448 records). [2025-09-14T17:35:09.578255] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-14T17:35:09.578379] [INFO ] [MAIN ] Update Progress: 551/2370 symbols completed. CTOS took 34.4s. Estimated remaining: 3h 11m 21s. Rate: 9.5 symbols/min [2025-09-14T17:35:09.747719] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:09.747970] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-14T17:35:09.748136] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-14T17:35:09.748366] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-14T17:35:09.758478] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-14T17:35:09.759100] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-14T17:35:09.759519] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T17:35:09.759660] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-14T17:35:10.084791] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:35:10.139703] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:10.141495] [INFO ] [REMOTE ] CTRE: Full fetch complete (53491 records). [2025-09-14T17:35:10.141591] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-14T17:35:10.164013] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-14T17:35:10.518632] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-14T17:35:10.518752] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-14T17:35:10.519467] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-14T17:35:10.519523] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-14T17:35:10.520911] [DEBUG] [LOCAL ] CTRE: Trimmed 53491 records to 36929 (keeping 150 days of data) [2025-09-14T17:35:10.593761] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T17:35:10.754372] [DEBUG] [LOCAL ] CTRE: Primary data saved (36929 records). [2025-09-14T17:35:10.754544] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-14T17:35:10.754670] [INFO ] [MAIN ] Update Progress: 552/2370 symbols completed. CTRE took 24.2s. Estimated remaining: 3h 10m 58s. Rate: 9.5 symbols/min [2025-09-14T17:35:10.924378] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:10.945953] [DEBUG] [LOCAL ] CUBE: Loaded 22608 existing records from primary storage. [2025-09-14T17:35:10.946104] [INFO ] [MAIN ] CUBE: Loaded 22608 existing records. [2025-09-14T17:35:10.966286] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-14T17:35:11.123294] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:11.123587] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-14T17:35:11.123672] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-14T17:35:11.124393] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-14T17:35:11.124464] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-14T17:35:11.398445] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-14T17:35:11.478199] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:11.758891] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-14T17:35:12.558865] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-14T17:35:12.976816] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T17:35:13.358876] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-14T17:35:14.158829] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-14T17:35:14.314734] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:35:14.423739] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-14T17:35:14.892619] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T17:35:14.958853] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-14T17:35:15.758820] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-14T17:35:15.976134] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:35:16.558831] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-14T17:35:17.358827] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-14T17:35:17.607011] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T17:35:17.646213] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:35:17.663295] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-14T17:35:18.158840] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-14T17:35:18.958840] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-14T17:35:19.078936] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T17:35:19.758825] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-14T17:35:20.558786] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-14T17:35:20.599858] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T17:35:20.780239] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-14T17:35:21.358826] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-14T17:35:21.655560] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-14T17:35:21.699530] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T17:35:22.158836] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-14T17:35:22.958791] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-14T17:35:23.260581] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-14T17:35:23.289533] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T17:35:23.758830] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-14T17:35:23.985698] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-14T17:35:23.986568] [INFO ] [REMOTE ] CUBB: Full fetch complete (728 records). [2025-09-14T17:35:23.986677] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-14T17:35:23.987081] [FATAL] [VALIDATOR ] CUBB: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:35:23.987175] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:35:23.987254] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:35:23.987306] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-14T17:35:23.987376] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-14T17:35:23.987432] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-14T17:35:23.987552] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-14T17:35:23.987628] [INFO ] [MAIN ] Update Progress: 553/2370 symbols completed. CUBB took 14.4s. Estimated remaining: 3h 11m 15s. Rate: 9.5 symbols/min [2025-09-14T17:35:24.168466] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:24.184204] [DEBUG] [LOCAL ] CUBI: Loaded 12858 existing records from primary storage. [2025-09-14T17:35:24.184383] [INFO ] [MAIN ] CUBI: Loaded 12858 existing records. [2025-09-14T17:35:24.374023] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:24.374284] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-14T17:35:24.374343] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-14T17:35:24.374903] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-14T17:35:24.374976] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-14T17:35:24.560432] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-14T17:35:24.751402] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:25.358827] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-14T17:35:26.158831] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-14T17:35:26.476500] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T17:35:26.733496] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:35:26.736019] [INFO ] [REMOTE ] CTS: Full fetch complete (20639 records). [2025-09-14T17:35:26.736138] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-14T17:35:26.963909] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-14T17:35:27.141422] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-14T17:35:27.141556] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-14T17:35:27.142025] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-14T17:35:27.142083] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-14T17:35:27.142963] [DEBUG] [LOCAL ] CTS: Trimmed 20639 records to 14207 (keeping 150 days of data) [2025-09-14T17:35:27.249358] [DEBUG] [LOCAL ] CTS: Primary data saved (14207 records). [2025-09-14T17:35:27.249585] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-14T17:35:27.249841] [INFO ] [MAIN ] Update Progress: 554/2370 symbols completed. CTS took 22.1s. Estimated remaining: 3h 10m 58s. Rate: 9.5 symbols/min [2025-09-14T17:35:27.435925] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:27.471450] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T17:35:27.500308] [DEBUG] [LOCAL ] CUK: Loaded 22875 existing records from primary storage. [2025-09-14T17:35:27.500531] [INFO ] [MAIN ] CUK: Loaded 22875 existing records. [2025-09-14T17:35:27.683221] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:27.683502] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-14T17:35:27.683583] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-14T17:35:27.684245] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-14T17:35:27.684314] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-14T17:35:27.763902] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-14T17:35:28.043523] [INFO ] [REMOTE ] CUK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:28.190602] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T17:35:28.558830] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-14T17:35:29.358869] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-14T17:35:29.573229] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T17:35:30.158857] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-14T17:35:30.402820] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:35:30.528463] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:35:30.958885] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-14T17:35:31.758876] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-14T17:35:32.039127] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:35:32.320862] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:35:32.558851] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-14T17:35:33.338144] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T17:35:33.358798] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-14T17:35:33.700745] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T17:35:34.158833] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-14T17:35:34.958838] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-14T17:35:35.017704] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:35:35.758814] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-14T17:35:35.857450] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:35:35.982469] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T17:35:36.558861] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-14T17:35:37.358890] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-14T17:35:37.675535] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:35:37.868708] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:35:38.041812] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:35:38.047236] [INFO ] [REMOTE ] CUBE: Full fetch complete (54906 records). [2025-09-14T17:35:38.047423] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-14T17:35:38.163948] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-14T17:35:38.434010] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-14T17:35:38.434116] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-14T17:35:38.434845] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-14T17:35:38.434905] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-14T17:35:38.436079] [DEBUG] [LOCAL ] CUBE: Trimmed 54906 records to 38219 (keeping 150 days of data) [2025-09-14T17:35:38.666848] [DEBUG] [LOCAL ] CUBE: Primary data saved (38219 records). [2025-09-14T17:35:38.667019] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-14T17:35:38.667119] [INFO ] [MAIN ] Update Progress: 555/2370 symbols completed. CUBE took 27.9s. Estimated remaining: 3h 11m 9s. Rate: 9.5 symbols/min [2025-09-14T17:35:38.838516] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:38.841406] [DEBUG] [LOCAL ] CULP: Loaded 1208 existing records from primary storage. [2025-09-14T17:35:38.841497] [INFO ] [MAIN ] CULP: Loaded 1208 existing records. [2025-09-14T17:35:38.964080] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-14T17:35:39.018804] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:39.019140] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-14T17:35:39.019211] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-14T17:35:39.019442] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-14T17:35:39.019498] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-14T17:35:39.365835] [INFO ] [REMOTE ] CULP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:39.758853] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-14T17:35:40.052118] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T17:35:40.303605] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T17:35:40.319621] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T17:35:40.558904] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-14T17:35:41.180008] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:35:41.185018] [INFO ] [REMOTE ] CUBI: Full fetch complete (29035 records). [2025-09-14T17:35:41.185326] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-14T17:35:41.364199] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-14T17:35:41.724155] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-14T17:35:41.724294] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-14T17:35:41.724962] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-14T17:35:41.725034] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-14T17:35:41.726297] [DEBUG] [LOCAL ] CUBI: Trimmed 29035 records to 20046 (keeping 150 days of data) [2025-09-14T17:35:41.888191] [DEBUG] [LOCAL ] CUBI: Primary data saved (20046 records). [2025-09-14T17:35:41.888370] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-14T17:35:41.888473] [INFO ] [MAIN ] Update Progress: 556/2370 symbols completed. CUBI took 17.9s. Estimated remaining: 3h 10m 52s. Rate: 9.5 symbols/min [2025-09-14T17:35:42.062535] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:42.079356] [DEBUG] [LOCAL ] CURB: Loaded 14812 existing records from primary storage. [2025-09-14T17:35:42.079548] [INFO ] [MAIN ] CURB: Loaded 14812 existing records. [2025-09-14T17:35:42.168383] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-14T17:35:42.259038] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:42.259298] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-14T17:35:42.259360] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-14T17:35:42.259879] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-14T17:35:42.259945] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-14T17:35:42.614855] [INFO ] [REMOTE ] CURB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:42.630274] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:35:42.958854] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-14T17:35:43.245123] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:35:43.592904] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T17:35:43.758832] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-14T17:35:44.292462] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T17:35:44.558842] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-14T17:35:45.095212] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T17:35:45.358885] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-14T17:35:45.922575] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T17:35:46.158887] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-14T17:35:46.958857] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-14T17:35:47.758830] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-14T17:35:47.997976] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:35:48.120700] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-14T17:35:48.417582] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T17:35:48.558873] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-14T17:35:49.358848] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-14T17:35:49.620059] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T17:35:49.899912] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:35:49.901463] [INFO ] [REMOTE ] CULP: Full fetch complete (3329 records). [2025-09-14T17:35:49.901562] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-14T17:35:50.163964] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-14T17:35:50.298542] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-14T17:35:50.298693] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-14T17:35:50.298864] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-14T17:35:50.298921] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-14T17:35:50.299374] [DEBUG] [LOCAL ] CULP: Trimmed 3329 records to 2034 (keeping 150 days of data) [2025-09-14T17:35:50.311530] [DEBUG] [LOCAL ] CULP: Primary data saved (2034 records). [2025-09-14T17:35:50.311624] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-14T17:35:50.311743] [INFO ] [MAIN ] Update Progress: 557/2370 symbols completed. CULP took 11.6s. Estimated remaining: 3h 10m 53s. Rate: 9.5 symbols/min [2025-09-14T17:35:50.958913] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-14T17:35:51.730621] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:35:51.737043] [INFO ] [REMOTE ] CTVA: Full fetch complete (57835 records). [2025-09-14T17:35:51.737233] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-14T17:35:51.763971] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-14T17:35:52.121616] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T17:35:52.228780] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-14T17:35:52.228930] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-14T17:35:52.229900] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-14T17:35:52.229968] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-14T17:35:52.231666] [DEBUG] [LOCAL ] CTVA: Trimmed 57835 records to 40082 (keeping 150 days of data) [2025-09-14T17:35:52.489933] [DEBUG] [LOCAL ] CTVA: Primary data saved (40082 records). [2025-09-14T17:35:52.490107] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-14T17:35:52.490207] [INFO ] [MAIN ] Update Progress: 558/2370 symbols completed. CTVA took 45.9s. Estimated remaining: 3h 10m 33s. Rate: 9.5 symbols/min [2025-09-14T17:35:52.558877] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-14T17:35:53.314687] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:35:53.358793] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-14T17:35:54.436788] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:35:54.448404] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-14T17:35:54.832074] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T17:35:54.958828] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-14T17:35:56.203355] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T17:35:56.209674] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-14T17:35:56.348026] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:35:56.558929] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-14T17:35:57.340960] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:35:57.358783] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-14T17:35:58.225937] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-14T17:35:58.231752] [INFO ] [REMOTE ] CUK: Full fetch complete (55535 records). [2025-09-14T17:35:58.231891] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-14T17:35:58.628049] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-14T17:35:58.628157] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-14T17:35:58.628900] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-14T17:35:58.628958] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-14T17:35:58.630141] [DEBUG] [LOCAL ] CUK: Trimmed 55535 records to 38115 (keeping 150 days of data) [2025-09-14T17:35:58.860137] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:35:58.872096] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-14T17:35:58.910554] [DEBUG] [LOCAL ] CUK: Primary data saved (38115 records). [2025-09-14T17:35:58.910750] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-14T17:35:58.910867] [INFO ] [MAIN ] Update Progress: 559/2370 symbols completed. CUK took 31.7s. Estimated remaining: 3h 10m 27s. Rate: 9.5 symbols/min [2025-09-14T17:36:00.340308] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T17:36:00.348294] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-14T17:36:00.700552] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:36:00.704361] [INFO ] [REMOTE ] CURB: Full fetch complete (35602 records). [2025-09-14T17:36:00.704493] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-14T17:36:01.099036] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-14T17:36:01.099153] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-14T17:36:01.099786] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-14T17:36:01.099846] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-14T17:36:01.100859] [DEBUG] [LOCAL ] CURB: Trimmed 35602 records to 23951 (keeping 150 days of data) [2025-09-14T17:36:01.254412] [DEBUG] [LOCAL ] CURB: Primary data saved (23951 records). [2025-09-14T17:36:01.254880] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-14T17:36:01.255076] [INFO ] [MAIN ] Update Progress: 560/2370 symbols completed. CURB took 19.4s. Estimated remaining: 3h 10m 8s. Rate: 9.5 symbols/min [2025-09-14T17:36:01.977935] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:02.019983] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:02.057593] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:02.061268] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:02.078964] [DEBUG] [LOCAL ] CVEO: Loaded 6456 existing records from primary storage. [2025-09-14T17:36:02.079286] [INFO ] [MAIN ] CVEO: Loaded 6456 existing records. [2025-09-14T17:36:02.182616] [DEBUG] [LOCAL ] CURV: Loaded 14399 existing records from primary storage. [2025-09-14T17:36:02.229475] [INFO ] [MAIN ] CURV: Loaded 14399 existing records. [2025-09-14T17:36:02.229961] [DEBUG] [LOCAL ] CUZ: Loaded 22311 existing records from primary storage. [2025-09-14T17:36:02.230209] [INFO ] [MAIN ] CUZ: Loaded 22311 existing records. [2025-09-14T17:36:02.230621] [DEBUG] [LOCAL ] CVE: Loaded 23970 existing records from primary storage. [2025-09-14T17:36:02.373289] [INFO ] [MAIN ] CVE: Loaded 23970 existing records. [2025-09-14T17:36:02.469769] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:02.557862] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-14T17:36:02.618425] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-14T17:36:02.727411] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-14T17:36:02.743172] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:02.773292] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-14T17:36:02.849143] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-14T17:36:02.824890] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:02.891415] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-14T17:36:02.926045] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:02.920748] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-14T17:36:02.949165] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-14T17:36:02.934965] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-14T17:36:02.954438] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-14T17:36:02.984761] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-14T17:36:02.981395] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-14T17:36:02.984973] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-14T17:36:03.029337] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-14T17:36:03.046309] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-14T17:36:02.990134] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-14T17:36:04.117159] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:04.187472] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-14T17:36:04.262852] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:04.327230] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-14T17:36:04.316386] [INFO ] [REMOTE ] CURV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:04.359786] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-14T17:36:04.381033] [INFO ] [REMOTE ] CVE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:04.382855] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-14T17:36:05.440340] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T17:36:05.443486] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-14T17:36:05.580960] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:36:05.586405] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-14T17:36:06.029022] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:36:06.039566] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-14T17:36:06.233334] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T17:36:06.244424] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-14T17:36:06.488889] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:36:06.492917] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-14T17:36:06.868470] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T17:36:06.958827] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-14T17:36:07.206276] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T17:36:07.544435] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T17:36:07.758873] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-14T17:36:08.041879] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:36:08.082679] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:36:08.558833] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-14T17:36:09.358812] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-14T17:36:09.457602] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T17:36:10.158862] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-14T17:36:10.292537] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:36:10.386736] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T17:36:10.958882] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-14T17:36:11.170022] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:36:11.758853] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-14T17:36:12.558896] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-14T17:36:12.927419] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T17:36:12.968965] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T17:36:13.358887] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-14T17:36:13.775670] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T17:36:14.158859] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-14T17:36:14.234179] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T17:36:14.958829] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-14T17:36:15.682765] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T17:36:15.758833] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-14T17:36:15.993474] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:36:16.558894] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-14T17:36:17.358845] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-14T17:36:18.163925] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-14T17:36:18.179719] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-14T17:36:18.680306] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T17:36:18.682416] [INFO ] [REMOTE ] CVEO: Full fetch complete (16837 records). [2025-09-14T17:36:18.682507] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-14T17:36:18.966720] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-14T17:36:19.060069] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-14T17:36:19.060181] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-14T17:36:19.060690] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-14T17:36:19.060751] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-14T17:36:19.061326] [DEBUG] [LOCAL ] CVEO: Trimmed 16837 records to 11781 (keeping 150 days of data) [2025-09-14T17:36:19.130244] [DEBUG] [LOCAL ] CVEO: Primary data saved (11781 records). [2025-09-14T17:36:19.130417] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-14T17:36:19.130536] [INFO ] [MAIN ] Update Progress: 561/2370 symbols completed. CVEO took 17.9s. Estimated remaining: 3h 10m 39s. Rate: 9.5 symbols/min [2025-09-14T17:36:19.298247] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:19.319597] [DEBUG] [LOCAL ] CVI: Loaded 20957 existing records from primary storage. [2025-09-14T17:36:19.319921] [INFO ] [MAIN ] CVI: Loaded 20957 existing records. [2025-09-14T17:36:19.495309] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:19.518779] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-14T17:36:19.521849] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-14T17:36:19.523697] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-09-14T17:36:19.540997] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-14T17:36:19.551533] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-14T17:36:19.552159] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T17:36:19.767100] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-14T17:36:19.934597] [INFO ] [REMOTE ] CVI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:20.558885] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-14T17:36:20.691061] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:36:21.358848] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-14T17:36:21.820970] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T17:36:21.881902] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T17:36:21.886410] [INFO ] [REMOTE ] CURV: Full fetch complete (28457 records). [2025-09-14T17:36:21.886526] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-14T17:36:22.158798] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-14T17:36:22.261540] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-14T17:36:22.261684] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-14T17:36:22.262228] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-14T17:36:22.262286] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-14T17:36:22.263322] [DEBUG] [LOCAL ] CURV: Trimmed 28457 records to 19974 (keeping 150 days of data) [2025-09-14T17:36:22.379744] [DEBUG] [LOCAL ] CURV: Primary data saved (19974 records). [2025-09-14T17:36:22.379927] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-14T17:36:22.380041] [INFO ] [MAIN ] Update Progress: 562/2370 symbols completed. CURV took 21.1s. Estimated remaining: 3h 10m 23s. Rate: 9.5 symbols/min [2025-09-14T17:36:22.549603] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:22.557455] [DEBUG] [LOCAL ] CVLG: Loaded 6050 existing records from primary storage. [2025-09-14T17:36:22.557608] [INFO ] [MAIN ] CVLG: Loaded 6050 existing records. [2025-09-14T17:36:22.737590] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:22.737916] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-14T17:36:22.737991] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-14T17:36:22.738388] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-14T17:36:22.738457] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-14T17:36:22.978276] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-14T17:36:23.098570] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:23.127612] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:36:23.398759] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T17:36:23.758825] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-14T17:36:24.558832] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-14T17:36:24.903566] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T17:36:25.358822] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-14T17:36:25.512908] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:36:26.158835] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-14T17:36:26.254588] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:36:26.880562] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T17:36:26.886484] [INFO ] [REMOTE ] CVE: Full fetch complete (58231 records). [2025-09-14T17:36:26.886680] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-14T17:36:26.963970] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-14T17:36:27.280138] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-14T17:36:27.280303] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-14T17:36:27.281245] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-14T17:36:27.281333] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-14T17:36:27.282675] [DEBUG] [LOCAL ] CVE: Trimmed 58231 records to 40314 (keeping 150 days of data) [2025-09-14T17:36:27.534659] [DEBUG] [LOCAL ] CVE: Primary data saved (40314 records). [2025-09-14T17:36:27.534843] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-14T17:36:27.534980] [INFO ] [MAIN ] Update Progress: 563/2370 symbols completed. CVE took 26.3s. Estimated remaining: 3h 10m 13s. Rate: 9.5 symbols/min [2025-09-14T17:36:27.706755] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:27.754219] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T17:36:27.764412] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-14T17:36:27.776057] [DEBUG] [LOCAL ] CVNA: Loaded 23692 existing records from primary storage. [2025-09-14T17:36:27.776212] [INFO ] [MAIN ] CVNA: Loaded 23692 existing records. [2025-09-14T17:36:27.954418] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T17:36:27.957806] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:27.960569] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-14T17:36:27.960656] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-14T17:36:27.961346] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-14T17:36:27.961421] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-14T17:36:28.317171] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:28.330207] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:36:28.335549] [INFO ] [REMOTE ] CUZ: Full fetch complete (53438 records). [2025-09-14T17:36:28.335698] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-14T17:36:28.563894] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-14T17:36:28.715538] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-14T17:36:28.715720] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-14T17:36:28.716567] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-14T17:36:28.716681] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-14T17:36:28.718068] [DEBUG] [LOCAL ] CUZ: Trimmed 53438 records to 37222 (keeping 150 days of data) [2025-09-14T17:36:28.955396] [DEBUG] [LOCAL ] CUZ: Primary data saved (37222 records). [2025-09-14T17:36:28.955663] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-14T17:36:28.955912] [INFO ] [MAIN ] Update Progress: 564/2370 symbols completed. CUZ took 27.7s. Estimated remaining: 3h 9m 51s. Rate: 9.5 symbols/min [2025-09-14T17:36:29.136190] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:29.160913] [DEBUG] [LOCAL ] CVS: Loaded 24111 existing records from primary storage. [2025-09-14T17:36:29.161135] [INFO ] [MAIN ] CVS: Loaded 24111 existing records. [2025-09-14T17:36:29.342029] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:29.342316] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-14T17:36:29.342410] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-14T17:36:29.343074] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-14T17:36:29.343139] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-14T17:36:29.363912] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-14T17:36:29.722657] [INFO ] [REMOTE ] CVS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:30.158794] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-14T17:36:30.378015] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T17:36:30.639043] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:36:30.958915] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-14T17:36:31.758927] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-14T17:36:32.290918] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-14T17:36:32.558822] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-14T17:36:32.900324] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T17:36:32.971597] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T17:36:33.358849] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-14T17:36:34.110277] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T17:36:34.158900] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-14T17:36:34.909717] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-14T17:36:34.958887] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-14T17:36:35.759067] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-14T17:36:36.200073] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T17:36:36.558865] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-14T17:36:36.650593] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T17:36:37.358873] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-14T17:36:37.626156] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:36:38.166301] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-14T17:36:38.203179] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-14T17:36:38.960667] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-14T17:36:38.968671] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:36:39.235864] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T17:36:39.758920] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-14T17:36:40.558926] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-14T17:36:41.014555] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-14T17:36:41.358902] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-14T17:36:42.014669] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T17:36:42.161268] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-14T17:36:42.170216] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-14T17:36:42.234281] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T17:36:42.782888] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:36:42.784872] [INFO ] [REMOTE ] CVLG: Full fetch complete (16237 records). [2025-09-14T17:36:42.784970] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-14T17:36:42.963688] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-14T17:36:43.171433] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-14T17:36:43.171575] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-14T17:36:43.172192] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-14T17:36:43.172254] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-14T17:36:43.172986] [DEBUG] [LOCAL ] CVLG: Trimmed 16237 records to 11706 (keeping 150 days of data) [2025-09-14T17:36:43.255967] [DEBUG] [LOCAL ] CVLG: Primary data saved (11706 records). [2025-09-14T17:36:43.256299] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-14T17:36:43.256478] [INFO ] [MAIN ] Update Progress: 565/2370 symbols completed. CVLG took 20.9s. Estimated remaining: 3h 10m 10s. Rate: 9.5 symbols/min [2025-09-14T17:36:43.443989] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:43.471704] [DEBUG] [LOCAL ] CVX: Loaded 24170 existing records from primary storage. [2025-09-14T17:36:43.471943] [INFO ] [MAIN ] CVX: Loaded 24170 existing records. [2025-09-14T17:36:43.672927] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:43.673418] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-14T17:36:43.679375] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-14T17:36:43.689462] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-14T17:36:43.689385] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:36:43.689678] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-14T17:36:43.760594] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-14T17:36:43.760918] [INFO ] [REMOTE ] CVI: Full fetch complete (50234 records). [2025-09-14T17:36:43.803287] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-14T17:36:44.484562] [INFO ] [REMOTE ] CVX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:44.564666] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-14T17:36:44.568789] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-14T17:36:44.568952] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-14T17:36:44.569965] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-14T17:36:44.570045] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-14T17:36:44.571884] [DEBUG] [LOCAL ] CVI: Trimmed 50234 records to 34598 (keeping 150 days of data) [2025-09-14T17:36:44.781660] [DEBUG] [LOCAL ] CVI: Primary data saved (34598 records). [2025-09-14T17:36:44.781846] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-14T17:36:44.781971] [INFO ] [MAIN ] Update Progress: 566/2370 symbols completed. CVI took 25.7s. Estimated remaining: 3h 9m 48s. Rate: 9.5 symbols/min [2025-09-14T17:36:44.949970] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:44.961489] [DEBUG] [LOCAL ] CW: Loaded 9743 existing records from primary storage. [2025-09-14T17:36:44.961669] [INFO ] [MAIN ] CW: Loaded 9743 existing records. [2025-09-14T17:36:45.140765] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:45.141094] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-14T17:36:45.141159] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-14T17:36:45.141548] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-14T17:36:45.141622] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-14T17:36:45.377189] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-14T17:36:45.494383] [INFO ] [REMOTE ] CW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:45.956214] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T17:36:46.158843] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-14T17:36:46.774529] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-14T17:36:46.958869] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-14T17:36:47.332625] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T17:36:47.758872] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-14T17:36:47.838372] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-14T17:36:48.558865] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-14T17:36:49.215882] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T17:36:49.358803] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-14T17:36:49.554580] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:36:49.845234] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T17:36:50.158852] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-14T17:36:50.958953] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-14T17:36:51.678334] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T17:36:51.758868] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-14T17:36:52.233412] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T17:36:52.320087] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T17:36:52.558906] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-14T17:36:53.358883] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-14T17:36:54.006182] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:36:54.158894] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-14T17:36:54.459777] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-14T17:36:54.958922] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-14T17:36:55.616859] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T17:36:55.758813] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-14T17:36:56.161582] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T17:36:56.558844] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-14T17:36:57.083238] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:36:57.091465] [INFO ] [REMOTE ] CVS: Full fetch complete (58378 records). [2025-09-14T17:36:57.091709] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-14T17:36:57.359260] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-14T17:36:57.504919] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-14T17:36:57.521792] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-14T17:36:57.522731] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-14T17:36:57.522804] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-14T17:36:57.524792] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-14T17:36:57.536188] [DEBUG] [LOCAL ] CVS: Trimmed 58378 records to 40438 (keeping 150 days of data) [2025-09-14T17:36:57.784608] [DEBUG] [LOCAL ] CVS: Primary data saved (40438 records). [2025-09-14T17:36:57.784784] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-14T17:36:57.784889] [INFO ] [MAIN ] Update Progress: 567/2370 symbols completed. CVS took 28.8s. Estimated remaining: 3h 10m 3s. Rate: 9.5 symbols/min [2025-09-14T17:36:57.951122] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:57.975672] [DEBUG] [LOCAL ] CWAN: Loaded 23673 existing records from primary storage. [2025-09-14T17:36:57.975851] [INFO ] [MAIN ] CWAN: Loaded 23673 existing records. [2025-09-14T17:36:58.149942] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:58.150292] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-14T17:36:58.150360] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-14T17:36:58.165505] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-14T17:36:58.180390] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-14T17:36:58.180570] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-14T17:36:58.228435] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-14T17:36:58.552999] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:58.599426] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T17:36:58.958894] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-14T17:36:59.758887] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-14T17:37:00.558842] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-14T17:37:00.682335] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-14T17:37:00.720555] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:37:01.358890] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-14T17:37:01.538364] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-14T17:37:01.557268] [INFO ] [REMOTE ] CVNA: Full fetch complete (57717 records). [2025-09-14T17:37:01.557552] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-14T17:37:01.558592] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T17:37:01.954592] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-14T17:37:01.954747] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-14T17:37:01.955516] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-14T17:37:01.955579] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-14T17:37:01.957232] [DEBUG] [LOCAL ] CVNA: Trimmed 57717 records to 39897 (keeping 150 days of data) [2025-09-14T17:37:02.181573] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-14T17:37:02.220727] [DEBUG] [LOCAL ] CVNA: Primary data saved (39897 records). [2025-09-14T17:37:02.220964] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-14T17:37:02.221155] [INFO ] [MAIN ] Update Progress: 568/2370 symbols completed. CVNA took 34.7s. Estimated remaining: 3h 9m 51s. Rate: 9.5 symbols/min [2025-09-14T17:37:02.435104] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:02.457191] [DEBUG] [LOCAL ] CWEN: Loaded 20311 existing records from primary storage. [2025-09-14T17:37:02.457388] [INFO ] [MAIN ] CWEN: Loaded 20311 existing records. [2025-09-14T17:37:02.632726] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:02.633026] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-14T17:37:02.633102] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-14T17:37:02.633771] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-14T17:37:02.633847] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-14T17:37:02.964135] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-14T17:37:02.994623] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:03.519364] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T17:37:03.758882] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-14T17:37:04.174001] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T17:37:04.524004] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-14T17:37:04.558858] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-14T17:37:04.936395] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:37:05.148750] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:37:05.154382] [INFO ] [REMOTE ] CVX: Full fetch complete (58440 records). [2025-09-14T17:37:05.154555] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-14T17:37:05.364055] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-14T17:37:05.544530] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-14T17:37:05.544666] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-14T17:37:05.545528] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-14T17:37:05.545604] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-14T17:37:05.546901] [DEBUG] [LOCAL ] CVX: Trimmed 58440 records to 40500 (keeping 150 days of data) [2025-09-14T17:37:05.828815] [DEBUG] [LOCAL ] CVX: Primary data saved (40500 records). [2025-09-14T17:37:05.828984] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-14T17:37:05.829224] [INFO ] [MAIN ] Update Progress: 569/2370 symbols completed. CVX took 22.6s. Estimated remaining: 3h 9m 36s. Rate: 9.5 symbols/min [2025-09-14T17:37:06.006247] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:06.028816] [DEBUG] [LOCAL ] CWH: Loaded 22892 existing records from primary storage. [2025-09-14T17:37:06.028985] [INFO ] [MAIN ] CWH: Loaded 22892 existing records. [2025-09-14T17:37:06.172291] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-14T17:37:06.212193] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:06.212387] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-14T17:37:06.212478] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-14T17:37:06.213102] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-14T17:37:06.213169] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-14T17:37:06.573809] [INFO ] [REMOTE ] CWH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:06.748231] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:37:06.750869] [INFO ] [REMOTE ] CW: Full fetch complete (25593 records). [2025-09-14T17:37:06.750989] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-14T17:37:06.964048] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-14T17:37:07.129291] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-14T17:37:07.129615] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-14T17:37:07.130198] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-14T17:37:07.130414] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-14T17:37:07.132490] [DEBUG] [LOCAL ] CW: Trimmed 25593 records to 16960 (keeping 150 days of data) [2025-09-14T17:37:07.251906] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T17:37:07.288728] [DEBUG] [LOCAL ] CW: Primary data saved (16960 records). [2025-09-14T17:37:07.288932] [INFO ] [MAIN ] CW: Full history saved. [2025-09-14T17:37:07.289096] [INFO ] [MAIN ] Update Progress: 570/2370 symbols completed. CW took 22.5s. Estimated remaining: 3h 9m 15s. Rate: 9.5 symbols/min [2025-09-14T17:37:07.461911] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:07.486462] [DEBUG] [LOCAL ] CWK: Loaded 22344 existing records from primary storage. [2025-09-14T17:37:07.486689] [INFO ] [MAIN ] CWK: Loaded 22344 existing records. [2025-09-14T17:37:07.677754] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:07.678036] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-14T17:37:07.678097] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-14T17:37:07.678772] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-14T17:37:07.678838] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-14T17:37:07.763975] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-14T17:37:08.055525] [INFO ] [REMOTE ] CWK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:08.558833] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-14T17:37:08.747901] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T17:37:09.358899] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-14T17:37:09.467484] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:37:10.118904] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T17:37:10.158850] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-14T17:37:10.967106] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-14T17:37:10.972460] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T17:37:11.758828] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-14T17:37:11.945635] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:37:12.558870] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-14T17:37:12.792696] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:37:13.358840] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-14T17:37:13.679843] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:37:13.867421] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T17:37:14.158886] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-14T17:37:14.958837] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-14T17:37:15.099058] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T17:37:15.758855] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-14T17:37:16.023273] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:37:16.307232] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:37:16.558905] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-14T17:37:17.358824] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-14T17:37:17.739928] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T17:37:18.162012] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-14T17:37:18.167848] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:37:18.796897] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:37:18.958880] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-14T17:37:19.758830] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-14T17:37:19.897517] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:37:20.405384] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T17:37:20.558827] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-14T17:37:21.358864] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-14T17:37:21.511693] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:37:22.078862] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T17:37:22.158836] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-14T17:37:22.958849] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-14T17:37:23.065004] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T17:37:23.758884] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-14T17:37:23.875165] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:37:24.258331] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:37:24.263883] [INFO ] [REMOTE ] CWEN: Full fetch complete (49004 records). [2025-09-14T17:37:24.264039] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-14T17:37:24.560737] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-14T17:37:24.653706] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-14T17:37:24.654006] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-14T17:37:24.654812] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-14T17:37:24.654886] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-14T17:37:24.656619] [DEBUG] [LOCAL ] CWEN: Trimmed 49004 records to 33419 (keeping 150 days of data) [2025-09-14T17:37:24.783508] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T17:37:24.906133] [DEBUG] [LOCAL ] CWEN: Primary data saved (33419 records). [2025-09-14T17:37:24.906320] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-14T17:37:24.906448] [INFO ] [MAIN ] Update Progress: 571/2370 symbols completed. CWEN took 22.7s. Estimated remaining: 3h 9m 44s. Rate: 9.5 symbols/min [2025-09-14T17:37:25.082415] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:25.096669] [DEBUG] [LOCAL ] CWT: Loaded 11772 existing records from primary storage. [2025-09-14T17:37:25.096927] [INFO ] [MAIN ] CWT: Loaded 11772 existing records. [2025-09-14T17:37:25.280960] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:25.281382] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-14T17:37:25.281452] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-14T17:37:25.281956] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-14T17:37:25.282022] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-14T17:37:25.364014] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-14T17:37:25.661003] [INFO ] [REMOTE ] CWT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:26.146943] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:37:26.158775] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-14T17:37:26.958843] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-14T17:37:27.060048] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T17:37:27.066318] [INFO ] [REMOTE ] CWAN: Full fetch complete (56786 records). [2025-09-14T17:37:27.066512] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-14T17:37:27.438308] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-14T17:37:27.438473] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-14T17:37:27.439383] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-14T17:37:27.439532] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-14T17:37:27.440960] [DEBUG] [LOCAL ] CWAN: Trimmed 56786 records to 39593 (keeping 150 days of data) [2025-09-14T17:37:27.561241] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T17:37:27.717073] [DEBUG] [LOCAL ] CWAN: Primary data saved (39593 records). [2025-09-14T17:37:27.717262] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-14T17:37:27.717387] [INFO ] [MAIN ] Update Progress: 572/2370 symbols completed. CWAN took 29.9s. Estimated remaining: 3h 9m 26s. Rate: 9.5 symbols/min [2025-09-14T17:37:27.763916] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-14T17:37:27.895930] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:27.914813] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T17:37:27.938677] [DEBUG] [LOCAL ] CX: Loaded 23640 existing records from primary storage. [2025-09-14T17:37:27.938873] [INFO ] [MAIN ] CX: Loaded 23640 existing records. [2025-09-14T17:37:28.112548] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:28.112861] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-14T17:37:28.112925] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-14T17:37:28.113671] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-14T17:37:28.113732] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-14T17:37:28.464094] [INFO ] [REMOTE ] CX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:28.558782] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-14T17:37:29.285955] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T17:37:29.291113] [INFO ] [REMOTE ] CWH: Full fetch complete (55381 records). [2025-09-14T17:37:29.291242] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-14T17:37:29.365771] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-14T17:37:29.674764] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-14T17:37:29.674881] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-14T17:37:29.675668] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-14T17:37:29.675794] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-14T17:37:29.677039] [DEBUG] [LOCAL ] CWH: Trimmed 55381 records to 38864 (keeping 150 days of data) [2025-09-14T17:37:29.918684] [DEBUG] [LOCAL ] CWH: Primary data saved (38864 records). [2025-09-14T17:37:29.918886] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-14T17:37:29.918990] [INFO ] [MAIN ] Update Progress: 573/2370 symbols completed. CWH took 24.1s. Estimated remaining: 3h 9m 7s. Rate: 9.5 symbols/min [2025-09-14T17:37:30.091330] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:30.095693] [DEBUG] [LOCAL ] CXE: Loaded 2696 existing records from primary storage. [2025-09-14T17:37:30.095802] [INFO ] [MAIN ] CXE: Loaded 2696 existing records. [2025-09-14T17:37:30.164825] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-14T17:37:30.277233] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:30.277625] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-14T17:37:30.277809] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-14T17:37:30.278170] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-14T17:37:30.278323] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-14T17:37:30.575581] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-14T17:37:30.695276] [INFO ] [REMOTE ] CXE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:30.749219] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T17:37:30.958838] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-14T17:37:31.632069] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T17:37:31.758835] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-14T17:37:32.317660] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:37:32.406621] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:37:32.411894] [INFO ] [REMOTE ] CWK: Full fetch complete (53595 records). [2025-09-14T17:37:32.412021] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-14T17:37:32.564246] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-14T17:37:32.800355] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-14T17:37:32.800462] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-14T17:37:32.801178] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-14T17:37:32.801239] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-14T17:37:32.802359] [DEBUG] [LOCAL ] CWK: Trimmed 53595 records to 37114 (keeping 150 days of data) [2025-09-14T17:37:33.020185] [DEBUG] [LOCAL ] CWK: Primary data saved (37114 records). [2025-09-14T17:37:33.020368] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-14T17:37:33.020468] [INFO ] [MAIN ] Update Progress: 574/2370 symbols completed. CWK took 25.7s. Estimated remaining: 3h 8m 51s. Rate: 9.5 symbols/min [2025-09-14T17:37:33.189399] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:33.193539] [DEBUG] [LOCAL ] CXH: Loaded 2736 existing records from primary storage. [2025-09-14T17:37:33.193655] [INFO ] [MAIN ] CXH: Loaded 2736 existing records. [2025-09-14T17:37:33.364288] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-14T17:37:33.368583] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:33.369748] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-14T17:37:33.369908] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-14T17:37:33.370199] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-14T17:37:33.370260] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-14T17:37:33.489939] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T17:37:33.726191] [INFO ] [REMOTE ] CXH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:34.158878] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-14T17:37:34.958900] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-14T17:37:35.069152] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T17:37:35.141239] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:37:35.318578] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-14T17:37:35.758870] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-14T17:37:36.558894] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-14T17:37:37.151542] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:37:37.358854] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-14T17:37:38.049446] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T17:37:38.158800] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-14T17:37:38.653689] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T17:37:38.653555] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T17:37:38.958827] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-14T17:37:39.391313] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T17:37:39.758893] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-14T17:37:40.558856] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-14T17:37:41.212815] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T17:37:41.358874] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-14T17:37:41.485508] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:37:42.029844] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T17:37:42.158884] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-14T17:37:42.958890] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-14T17:37:43.557975] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:37:43.758863] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-14T17:37:44.271836] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:37:44.558858] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-14T17:37:45.179459] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T17:37:45.358829] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-14T17:37:45.505297] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:37:46.158846] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-14T17:37:46.643573] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T17:37:46.958959] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-14T17:37:47.501568] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:37:47.505783] [INFO ] [REMOTE ] CWT: Full fetch complete (30651 records). [2025-09-14T17:37:47.505953] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-14T17:37:47.763936] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-14T17:37:47.922904] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-14T17:37:47.923129] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-14T17:37:47.923743] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-14T17:37:47.923921] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-14T17:37:47.925197] [DEBUG] [LOCAL ] CWT: Trimmed 30651 records to 20471 (keeping 150 days of data) [2025-09-14T17:37:48.059083] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:37:48.089919] [DEBUG] [LOCAL ] CWT: Primary data saved (20471 records). [2025-09-14T17:37:48.090086] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-14T17:37:48.090188] [INFO ] [MAIN ] Update Progress: 575/2370 symbols completed. CWT took 23.2s. Estimated remaining: 3h 9m 12s. Rate: 9.5 symbols/min [2025-09-14T17:37:48.286544] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:48.292306] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-14T17:37:48.312327] [DEBUG] [LOCAL ] CXM: Loaded 21454 existing records from primary storage. [2025-09-14T17:37:48.312490] [INFO ] [MAIN ] CXM: Loaded 21454 existing records. [2025-09-14T17:37:48.496964] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:48.497340] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-14T17:37:48.497410] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-14T17:37:48.498104] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-14T17:37:48.498179] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-14T17:37:48.564093] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-14T17:37:48.857914] [INFO ] [REMOTE ] CXM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:49.358878] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-14T17:37:50.058415] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:37:50.158836] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-14T17:37:50.241299] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T17:37:50.246929] [INFO ] [REMOTE ] CX: Full fetch complete (57447 records). [2025-09-14T17:37:50.247073] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-14T17:37:50.622658] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-14T17:37:50.622796] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-14T17:37:50.623688] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-14T17:37:50.623764] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-14T17:37:50.625100] [DEBUG] [LOCAL ] CX: Trimmed 57447 records to 39740 (keeping 150 days of data) [2025-09-14T17:37:50.715280] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T17:37:50.864790] [DEBUG] [LOCAL ] CX: Primary data saved (39740 records). [2025-09-14T17:37:50.865000] [INFO ] [MAIN ] CX: Full history saved. [2025-09-14T17:37:50.865127] [INFO ] [MAIN ] Update Progress: 576/2370 symbols completed. CX took 23.1s. Estimated remaining: 3h 8m 55s. Rate: 9.5 symbols/min [2025-09-14T17:37:50.966060] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-14T17:37:51.064623] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:51.081120] [DEBUG] [LOCAL ] CXT: Loaded 13913 existing records from primary storage. [2025-09-14T17:37:51.081335] [INFO ] [MAIN ] CXT: Loaded 13913 existing records. [2025-09-14T17:37:51.270305] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:51.270593] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-14T17:37:51.270677] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-14T17:37:51.271201] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-14T17:37:51.271264] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-14T17:37:51.618422] [INFO ] [REMOTE ] CXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:51.678181] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:37:51.679970] [INFO ] [REMOTE ] CXE: Full fetch complete (8191 records). [2025-09-14T17:37:51.680094] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-14T17:37:51.763997] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-14T17:37:52.046778] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-14T17:37:52.046888] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-14T17:37:52.047121] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-14T17:37:52.047172] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-14T17:37:52.047660] [DEBUG] [LOCAL ] CXE: Trimmed 8191 records to 4713 (keeping 150 days of data) [2025-09-14T17:37:52.075342] [DEBUG] [LOCAL ] CXE: Primary data saved (4713 records). [2025-09-14T17:37:52.075531] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-14T17:37:52.075636] [INFO ] [MAIN ] Update Progress: 577/2370 symbols completed. CXE took 22.2s. Estimated remaining: 3h 8m 32s. Rate: 9.5 symbols/min [2025-09-14T17:37:52.252421] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:52.274461] [DEBUG] [LOCAL ] CXW: Loaded 19641 existing records from primary storage. [2025-09-14T17:37:52.274689] [INFO ] [MAIN ] CXW: Loaded 19641 existing records. [2025-09-14T17:37:52.452817] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:52.453108] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-14T17:37:52.453181] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-14T17:37:52.453763] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-14T17:37:52.453830] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-14T17:37:52.563985] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-14T17:37:52.807010] [INFO ] [REMOTE ] CXW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:53.346599] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:37:53.358714] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-14T17:37:53.637180] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:37:53.972295] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:37:54.158824] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-14T17:37:54.958852] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-14T17:37:55.478851] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T17:37:55.758877] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-14T17:37:56.558844] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-14T17:37:56.663375] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:37:57.244557] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:37:57.264808] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T17:37:57.358775] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-14T17:37:58.158828] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-14T17:37:58.699597] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T17:37:58.837285] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T17:37:58.958840] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-14T17:37:59.758838] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-14T17:38:00.297158] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:38:00.298661] [INFO ] [REMOTE ] CXH: Full fetch complete (4562 records). [2025-09-14T17:38:00.298764] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-14T17:38:00.441695] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:38:00.565285] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-14T17:38:00.700123] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-14T17:38:00.700237] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-14T17:38:00.700412] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-14T17:38:00.700465] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-14T17:38:00.700894] [DEBUG] [LOCAL ] CXH: Trimmed 4562 records to 3883 (keeping 150 days of data) [2025-09-14T17:38:00.723394] [DEBUG] [LOCAL ] CXH: Primary data saved (3883 records). [2025-09-14T17:38:00.723481] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-14T17:38:00.723573] [INFO ] [MAIN ] Update Progress: 578/2370 symbols completed. CXH took 27.7s. Estimated remaining: 3h 8m 33s. Rate: 9.5 symbols/min [2025-09-14T17:38:00.896279] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:00.909696] [DEBUG] [LOCAL ] CYD: Loaded 11837 existing records from primary storage. [2025-09-14T17:38:00.909839] [INFO ] [MAIN ] CYD: Loaded 11837 existing records. [2025-09-14T17:38:01.092187] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:01.092501] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-14T17:38:01.092561] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-14T17:38:01.092977] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-14T17:38:01.093037] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-14T17:38:01.366383] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-14T17:38:01.446897] [INFO ] [REMOTE ] CYD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:01.889969] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T17:38:02.158847] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-14T17:38:02.958870] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-14T17:38:03.241362] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:38:03.314517] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:38:03.758892] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-14T17:38:04.558832] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-14T17:38:04.681747] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:38:04.729151] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T17:38:05.358882] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-14T17:38:05.843306] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T17:38:06.158834] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-14T17:38:06.779303] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:38:06.782912] [INFO ] [REMOTE ] CXT: Full fetch complete (34030 records). [2025-09-14T17:38:06.783031] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-14T17:38:06.967402] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-14T17:38:07.175959] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-14T17:38:07.176318] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-14T17:38:07.176997] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-14T17:38:07.177286] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-14T17:38:07.207986] [DEBUG] [LOCAL ] CXT: Trimmed 34030 records to 22501 (keeping 150 days of data) [2025-09-14T17:38:07.210199] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:38:07.358858] [DEBUG] [LOCAL ] CXT: Primary data saved (22501 records). [2025-09-14T17:38:07.359020] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-14T17:38:07.359152] [INFO ] [MAIN ] Update Progress: 579/2370 symbols completed. CXT took 16.5s. Estimated remaining: 3h 8m 28s. Rate: 9.5 symbols/min [2025-09-14T17:38:07.537818] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:07.558185] [DEBUG] [LOCAL ] CYH: Loaded 21567 existing records from primary storage. [2025-09-14T17:38:07.558360] [INFO ] [MAIN ] CYH: Loaded 21567 existing records. [2025-09-14T17:38:07.760085] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:07.759720] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-14T17:38:07.761369] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-14T17:38:07.761466] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-14T17:38:07.762248] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-14T17:38:07.762337] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-14T17:38:08.122921] [INFO ] [REMOTE ] CYH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:08.563966] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-14T17:38:08.583169] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:38:09.209814] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T17:38:09.358833] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-14T17:38:10.158861] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-14T17:38:10.267739] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:38:10.545731] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:38:10.958849] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-14T17:38:11.388392] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:38:11.758830] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-14T17:38:12.565518] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-14T17:38:12.573777] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T17:38:12.801028] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T17:38:13.358835] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-14T17:38:14.158788] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-14T17:38:14.196116] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:38:14.763934] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T17:38:14.958833] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-14T17:38:15.500217] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T17:38:15.758820] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-14T17:38:16.155122] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T17:38:16.558792] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-14T17:38:16.931066] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T17:38:17.358834] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-14T17:38:17.906763] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T17:38:18.158876] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-14T17:38:18.558437] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T17:38:18.958829] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-14T17:38:19.758787] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-14T17:38:19.870675] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:38:20.070917] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T17:38:20.074779] [INFO ] [REMOTE ] CYD: Full fetch complete (28861 records). [2025-09-14T17:38:20.074875] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-14T17:38:20.445877] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-14T17:38:20.445994] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-14T17:38:20.446598] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-14T17:38:20.446675] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-14T17:38:20.447448] [DEBUG] [LOCAL ] CYD: Trimmed 28861 records to 19326 (keeping 150 days of data) [2025-09-14T17:38:20.559029] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-14T17:38:20.568482] [DEBUG] [LOCAL ] CYD: Primary data saved (19326 records). [2025-09-14T17:38:20.568723] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-14T17:38:20.568916] [INFO ] [MAIN ] Update Progress: 580/2370 symbols completed. CYD took 19.8s. Estimated remaining: 3h 8m 43s. Rate: 9.5 symbols/min [2025-09-14T17:38:20.745102] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:20.768525] [DEBUG] [LOCAL ] D: Loaded 24073 existing records from primary storage. [2025-09-14T17:38:20.768748] [INFO ] [MAIN ] D: Loaded 24073 existing records. [2025-09-14T17:38:20.948464] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:20.948794] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-14T17:38:20.948856] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-14T17:38:20.949610] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-14T17:38:20.949701] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-14T17:38:21.303503] [INFO ] [REMOTE ] D: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:21.359683] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-14T17:38:21.371425] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:38:22.158831] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-14T17:38:22.397289] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:38:22.958821] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-14T17:38:23.199320] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:38:23.681451] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T17:38:23.758815] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-14T17:38:24.486004] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T17:38:24.531067] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:38:24.536214] [INFO ] [REMOTE ] CXW: Full fetch complete (49044 records). [2025-09-14T17:38:24.536366] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-14T17:38:24.563979] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-14T17:38:24.974413] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-14T17:38:24.974541] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-14T17:38:24.975329] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-14T17:38:24.975406] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-14T17:38:24.976730] [DEBUG] [LOCAL ] CXW: Trimmed 49044 records to 33263 (keeping 150 days of data) [2025-09-14T17:38:25.191141] [DEBUG] [LOCAL ] CXW: Primary data saved (33263 records). [2025-09-14T17:38:25.191350] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-14T17:38:25.191506] [INFO ] [MAIN ] Update Progress: 581/2370 symbols completed. CXW took 33.1s. Estimated remaining: 3h 8m 31s. Rate: 9.5 symbols/min [2025-09-14T17:38:25.372345] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-14T17:38:25.377370] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:25.385519] [DEBUG] [LOCAL ] DAC: Loaded 5318 existing records from primary storage. [2025-09-14T17:38:25.385718] [INFO ] [MAIN ] DAC: Loaded 5318 existing records. [2025-09-14T17:38:25.562190] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:25.562434] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-14T17:38:25.562512] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-14T17:38:25.562800] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-14T17:38:25.562861] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-14T17:38:25.921188] [INFO ] [REMOTE ] DAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:26.158842] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-14T17:38:26.498558] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T17:38:26.698666] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:38:26.802736] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:38:26.807985] [INFO ] [REMOTE ] CXM: Full fetch complete (52000 records). [2025-09-14T17:38:26.808149] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-14T17:38:26.978310] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-14T17:38:27.190121] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-14T17:38:27.190236] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-14T17:38:27.191234] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-14T17:38:27.191309] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-14T17:38:27.192716] [DEBUG] [LOCAL ] CXM: Trimmed 52000 records to 35801 (keeping 150 days of data) [2025-09-14T17:38:27.399495] [DEBUG] [LOCAL ] CXM: Primary data saved (35801 records). [2025-09-14T17:38:27.399700] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-14T17:38:27.399802] [INFO ] [MAIN ] Update Progress: 582/2370 symbols completed. CXM took 39.3s. Estimated remaining: 3h 8m 12s. Rate: 9.5 symbols/min [2025-09-14T17:38:27.571566] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:27.594690] [DEBUG] [LOCAL ] DAL: Loaded 24113 existing records from primary storage. [2025-09-14T17:38:27.594880] [INFO ] [MAIN ] DAL: Loaded 24113 existing records. [2025-09-14T17:38:27.766867] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-14T17:38:27.774114] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:27.774326] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-14T17:38:27.774418] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-14T17:38:27.775172] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-14T17:38:27.775262] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-14T17:38:28.137312] [INFO ] [REMOTE ] DAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:28.558836] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-14T17:38:28.893696] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:38:29.358850] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-14T17:38:29.537788] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T17:38:29.629743] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:38:30.158841] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-14T17:38:30.958832] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-14T17:38:31.276898] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T17:38:31.585402] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T17:38:31.694322] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T17:38:31.699273] [INFO ] [REMOTE ] CYH: Full fetch complete (52836 records). [2025-09-14T17:38:31.699406] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-14T17:38:31.763940] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-14T17:38:32.079430] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-14T17:38:32.079557] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-14T17:38:32.080360] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-14T17:38:32.080442] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-14T17:38:32.081704] [DEBUG] [LOCAL ] CYH: Trimmed 52836 records to 36354 (keeping 150 days of data) [2025-09-14T17:38:32.294402] [DEBUG] [LOCAL ] CYH: Primary data saved (36354 records). [2025-09-14T17:38:32.294623] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-14T17:38:32.294797] [INFO ] [MAIN ] Update Progress: 583/2370 symbols completed. CYH took 24.9s. Estimated remaining: 3h 8m 2s. Rate: 9.5 symbols/min [2025-09-14T17:38:32.479743] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:32.503186] [DEBUG] [LOCAL ] DAN: Loaded 22225 existing records from primary storage. [2025-09-14T17:38:32.503394] [INFO ] [MAIN ] DAN: Loaded 22225 existing records. [2025-09-14T17:38:32.566874] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-14T17:38:32.683898] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:32.684164] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-14T17:38:32.684244] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-14T17:38:32.684924] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-14T17:38:32.685007] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-14T17:38:33.038158] [INFO ] [REMOTE ] DAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:33.358849] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-14T17:38:33.641563] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:38:34.158890] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-14T17:38:34.415399] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T17:38:34.457224] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T17:38:34.958850] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-14T17:38:35.758819] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-14T17:38:36.242604] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T17:38:36.374033] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T17:38:36.558840] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-14T17:38:37.234556] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T17:38:37.316443] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-14T17:38:37.358798] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-14T17:38:38.158913] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-14T17:38:38.958938] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-14T17:38:39.063403] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:38:39.758971] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-14T17:38:39.972361] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-14T17:38:40.272098] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:38:40.558865] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-14T17:38:40.603178] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T17:38:41.358866] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-14T17:38:42.110939] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:38:42.112524] [INFO ] [REMOTE ] DAC: Full fetch complete (14335 records). [2025-09-14T17:38:42.112611] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-14T17:38:42.168953] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-14T17:38:42.486509] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-14T17:38:42.486718] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-14T17:38:42.487215] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-14T17:38:42.503683] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-14T17:38:42.521447] [DEBUG] [LOCAL ] DAC: Trimmed 14335 records to 9159 (keeping 150 days of data) [2025-09-14T17:38:42.521299] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T17:38:42.592104] [DEBUG] [LOCAL ] DAC: Primary data saved (9159 records). [2025-09-14T17:38:42.592273] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-14T17:38:42.592375] [INFO ] [MAIN ] Update Progress: 584/2370 symbols completed. DAC took 17.4s. Estimated remaining: 3h 8m 8s. Rate: 9.5 symbols/min [2025-09-14T17:38:42.762462] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:42.771957] [DEBUG] [LOCAL ] DAO: Loaded 7542 existing records from primary storage. [2025-09-14T17:38:42.772099] [INFO ] [MAIN ] DAO: Loaded 7542 existing records. [2025-09-14T17:38:42.948152] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:42.948486] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-14T17:38:42.948558] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-14T17:38:42.948881] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-14T17:38:42.948941] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-14T17:38:42.969498] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-14T17:38:43.309018] [INFO ] [REMOTE ] DAO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:43.758881] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-14T17:38:44.346198] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-14T17:38:44.558828] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-14T17:38:44.949975] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T17:38:45.127584] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:38:45.133193] [INFO ] [REMOTE ] D: Full fetch complete (58324 records). [2025-09-14T17:38:45.133354] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-14T17:38:45.359949] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-14T17:38:45.520539] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-14T17:38:45.520688] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-14T17:38:45.521550] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-14T17:38:45.521759] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-14T17:38:45.551844] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:38:45.562740] [DEBUG] [LOCAL ] D: Trimmed 58324 records to 40397 (keeping 150 days of data) [2025-09-14T17:38:45.823834] [DEBUG] [LOCAL ] D: Primary data saved (40397 records). [2025-09-14T17:38:45.824005] [INFO ] [MAIN ] D: Full history saved. [2025-09-14T17:38:45.824111] [INFO ] [MAIN ] Update Progress: 585/2370 symbols completed. D took 25.3s. Estimated remaining: 3h 7m 52s. Rate: 9.5 symbols/min [2025-09-14T17:38:45.995465] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:46.017604] [DEBUG] [LOCAL ] DAR: Loaded 23500 existing records from primary storage. [2025-09-14T17:38:46.017814] [INFO ] [MAIN ] DAR: Loaded 23500 existing records. [2025-09-14T17:38:46.164093] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-14T17:38:46.200898] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:46.201176] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-14T17:38:46.201255] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-14T17:38:46.202159] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-14T17:38:46.202233] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-14T17:38:46.572493] [INFO ] [REMOTE ] DAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:46.958862] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-14T17:38:47.189251] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T17:38:47.758818] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-14T17:38:48.033145] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:38:48.558807] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-14T17:38:48.611380] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T17:38:49.358826] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-14T17:38:50.151542] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-14T17:38:50.163070] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-14T17:38:50.268113] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T17:38:50.654991] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T17:38:50.958848] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-14T17:38:51.268381] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T17:38:51.758841] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-14T17:38:52.544154] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:38:52.558777] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-14T17:38:53.196088] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T17:38:53.358824] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-14T17:38:54.158834] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-14T17:38:54.365539] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:38:54.958856] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-14T17:38:55.106247] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T17:38:55.580915] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T17:38:55.758839] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-14T17:38:56.558857] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-14T17:38:56.717741] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T17:38:56.940209] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:38:57.258616] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T17:38:57.263730] [INFO ] [REMOTE ] DAN: Full fetch complete (53332 records). [2025-09-14T17:38:57.263864] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-14T17:38:57.365250] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-14T17:38:57.671009] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-14T17:38:57.671155] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-14T17:38:57.672018] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-14T17:38:57.672101] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-14T17:38:57.673504] [DEBUG] [LOCAL ] DAN: Trimmed 53332 records to 36951 (keeping 150 days of data) [2025-09-14T17:38:57.790376] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:38:57.799396] [INFO ] [REMOTE ] DAL: Full fetch complete (58433 records). [2025-09-14T17:38:57.800627] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-14T17:38:58.162237] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-14T17:38:58.203489] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-14T17:38:58.204662] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-14T17:38:58.206149] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-14T17:38:58.207019] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-14T17:38:58.210669] [DEBUG] [LOCAL ] DAL: Trimmed 58433 records to 40493 (keeping 150 days of data) [2025-09-14T17:38:58.529673] [DEBUG] [LOCAL ] DAN: Primary data saved (36951 records). [2025-09-14T17:38:58.530689] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-14T17:38:58.534837] [INFO ] [MAIN ] Update Progress: 586/2370 symbols completed. DAN took 26.2s. Estimated remaining: 3h 8m 5s. Rate: 9.5 symbols/min [2025-09-14T17:38:58.720083] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:58.747754] [DEBUG] [LOCAL ] DAVA: Loaded 18392 existing records from primary storage. [2025-09-14T17:38:58.748632] [INFO ] [MAIN ] DAVA: Loaded 18392 existing records. [2025-09-14T17:38:58.748732] [DEBUG] [LOCAL ] DAL: Primary data saved (40493 records). [2025-09-14T17:38:58.790612] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-14T17:38:58.822048] [INFO ] [MAIN ] Update Progress: 587/2370 symbols completed. DAL took 31.4s. Estimated remaining: 3h 7m 40s. Rate: 9.5 symbols/min [2025-09-14T17:38:58.983512] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-14T17:38:59.023680] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:59.050506] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-14T17:38:59.077993] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-14T17:38:59.102714] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-14T17:38:59.102629] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:59.102859] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-14T17:38:59.393964] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:38:59.408683] [DEBUG] [LOCAL ] DAY: Loaded 22348 existing records from primary storage. [2025-09-14T17:38:59.414582] [INFO ] [MAIN ] DAY: Loaded 22348 existing records. [2025-09-14T17:38:59.580656] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:59.656357] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:59.656543] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-14T17:38:59.656602] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-14T17:38:59.657175] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-14T17:38:59.657240] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-14T17:38:59.763902] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-14T17:39:00.006037] [INFO ] [REMOTE ] DAY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:00.558795] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-14T17:39:00.896581] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T17:39:01.276627] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T17:39:01.358893] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-14T17:39:02.047469] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:39:02.158829] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-14T17:39:02.673508] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T17:39:02.958836] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-14T17:39:03.758832] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-14T17:39:04.558898] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-14T17:39:05.229018] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-14T17:39:05.292690] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (3.13 seconds). [2025-09-14T17:39:05.358800] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-14T17:39:05.620673] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T17:39:06.070712] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:39:06.158868] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-14T17:39:06.958836] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-14T17:39:07.196471] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T17:39:07.384330] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:39:07.758829] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-14T17:39:07.990492] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:39:08.558842] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-14T17:39:09.258487] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T17:39:09.358795] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-14T17:39:10.158863] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-14T17:39:10.388456] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:39:10.954247] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T17:39:10.962322] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-14T17:39:11.699758] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:39:11.702284] [INFO ] [REMOTE ] DAO: Full fetch complete (24603 records). [2025-09-14T17:39:11.702448] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-14T17:39:11.764969] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-14T17:39:12.080874] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-14T17:39:12.081015] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-14T17:39:12.081728] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-14T17:39:12.081909] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-14T17:39:12.093747] [DEBUG] [LOCAL ] DAO: Trimmed 24603 records to 13641 (keeping 150 days of data) [2025-09-14T17:39:12.146711] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T17:39:12.205513] [DEBUG] [LOCAL ] DAO: Primary data saved (13641 records). [2025-09-14T17:39:12.205719] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-14T17:39:12.205914] [INFO ] [MAIN ] Update Progress: 588/2370 symbols completed. DAO took 29.6s. Estimated remaining: 3h 7m 55s. Rate: 9.5 symbols/min [2025-09-14T17:39:12.373624] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:12.389063] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:39:12.394713] [INFO ] [REMOTE ] DAR: Full fetch complete (56332 records). [2025-09-14T17:39:12.394851] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-14T17:39:12.582981] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-14T17:39:12.589701] [DEBUG] [LOCAL ] DB: Loaded 23468 existing records from primary storage. [2025-09-14T17:39:12.673081] [INFO ] [MAIN ] DB: Loaded 23468 existing records. [2025-09-14T17:39:12.962387] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-14T17:39:12.979587] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-14T17:39:12.983866] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-14T17:39:12.984142] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-14T17:39:12.984006] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:12.984606] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-14T17:39:12.984708] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-14T17:39:12.985737] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-14T17:39:12.985854] [DEBUG] [LOCAL ] DAR: Trimmed 56332 records to 39024 (keeping 150 days of data) [2025-09-14T17:39:12.986108] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-14T17:39:13.359879] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-14T17:39:13.522945] [INFO ] [REMOTE ] DB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:13.578833] [DEBUG] [LOCAL ] DAR: Primary data saved (39024 records). [2025-09-14T17:39:13.578993] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-14T17:39:13.579088] [INFO ] [MAIN ] Update Progress: 589/2370 symbols completed. DAR took 27.8s. Estimated remaining: 3h 7m 34s. Rate: 9.5 symbols/min [2025-09-14T17:39:13.755771] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:13.775305] [DEBUG] [LOCAL ] DBD: Loaded 18458 existing records from primary storage. [2025-09-14T17:39:13.775499] [INFO ] [MAIN ] DBD: Loaded 18458 existing records. [2025-09-14T17:39:13.953810] [WARN ] [MAIN ] DBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:13.954098] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-14T17:39:13.954169] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-14T17:39:13.955078] [DEBUG] [LOCAL ] DBD: Deleted primary data file. [2025-09-14T17:39:13.955150] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-14T17:39:14.167980] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-14T17:39:14.323801] [INFO ] [REMOTE ] DBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:14.347332] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:39:14.958881] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-14T17:39:15.166323] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T17:39:15.758842] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-14T17:39:16.158192] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T17:39:16.177543] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-14T17:39:16.367491] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:39:16.558833] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-14T17:39:17.358826] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-14T17:39:17.698741] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-14T17:39:17.704151] [INFO ] [REMOTE ] DAVA: Full fetch complete (43330 records). [2025-09-14T17:39:17.704333] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-14T17:39:18.099514] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-14T17:39:18.099675] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-14T17:39:18.100563] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-14T17:39:18.100659] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-14T17:39:18.101956] [DEBUG] [LOCAL ] DAVA: Trimmed 43330 records to 30679 (keeping 150 days of data) [2025-09-14T17:39:18.166189] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-14T17:39:18.290671] [DEBUG] [LOCAL ] DAVA: Primary data saved (30679 records). [2025-09-14T17:39:18.290846] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-14T17:39:18.290964] [INFO ] [MAIN ] Update Progress: 590/2370 symbols completed. DAVA took 19.8s. Estimated remaining: 3h 7m 23s. Rate: 9.5 symbols/min [2025-09-14T17:39:18.466866] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:18.485934] [DEBUG] [LOCAL ] DBI: Loaded 19377 existing records from primary storage. [2025-09-14T17:39:18.486121] [INFO ] [MAIN ] DBI: Loaded 19377 existing records. [2025-09-14T17:39:18.664874] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:18.665126] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-14T17:39:18.665204] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-14T17:39:18.665767] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-14T17:39:18.665838] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-14T17:39:18.963973] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-14T17:39:19.031638] [INFO ] [REMOTE ] DBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:19.159241] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T17:39:19.758873] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-14T17:39:20.530074] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T17:39:20.558777] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-14T17:39:20.753879] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-14T17:39:21.225039] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T17:39:21.358821] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-14T17:39:21.597580] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:39:22.158806] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-14T17:39:22.958796] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-14T17:39:23.030323] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:39:23.758875] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-14T17:39:23.947809] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T17:39:24.443330] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T17:39:24.558789] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-14T17:39:25.144027] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T17:39:25.239073] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T17:39:25.358804] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-14T17:39:26.158841] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-14T17:39:26.804732] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:39:26.810671] [INFO ] [REMOTE ] DAY: Full fetch complete (54529 records). [2025-09-14T17:39:26.810804] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-14T17:39:26.962994] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-14T17:39:27.191768] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-14T17:39:27.191965] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-14T17:39:27.192798] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-14T17:39:27.192916] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-14T17:39:27.195657] [DEBUG] [LOCAL ] DAY: Trimmed 54529 records to 37479 (keeping 150 days of data) [2025-09-14T17:39:27.225460] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:39:27.454430] [DEBUG] [LOCAL ] DAY: Primary data saved (37479 records). [2025-09-14T17:39:27.454603] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-14T17:39:27.454790] [INFO ] [MAIN ] Update Progress: 591/2370 symbols completed. DAY took 28.6s. Estimated remaining: 3h 7m 25s. Rate: 9.5 symbols/min [2025-09-14T17:39:27.622269] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:27.630209] [DEBUG] [LOCAL ] DBL: Loaded 4934 existing records from primary storage. [2025-09-14T17:39:27.630353] [INFO ] [MAIN ] DBL: Loaded 4934 existing records. [2025-09-14T17:39:27.770074] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-14T17:39:27.844290] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:27.844529] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-14T17:39:27.844583] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-14T17:39:27.844897] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-14T17:39:27.844958] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-14T17:39:28.195197] [INFO ] [REMOTE ] DBL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:28.470913] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:39:28.558784] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-14T17:39:29.002850] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T17:39:29.038997] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:39:29.358824] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-14T17:39:30.158893] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-14T17:39:30.958845] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-14T17:39:31.169189] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T17:39:31.758914] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-14T17:39:31.911266] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T17:39:32.073447] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:39:32.558928] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-14T17:39:33.204675] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:39:33.358860] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-14T17:39:33.716869] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:39:34.158895] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-14T17:39:34.233941] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T17:39:34.958837] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-14T17:39:35.688164] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T17:39:35.758854] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-14T17:39:36.111281] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:39:36.558890] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-14T17:39:36.586630] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:39:37.358844] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-14T17:39:38.158933] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-14T17:39:38.221883] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T17:39:38.227514] [INFO ] [REMOTE ] DB: Full fetch complete (57049 records). [2025-09-14T17:39:38.227697] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-14T17:39:38.589090] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:39:38.619057] [INFO ] [REMOTE ] DBD: Full fetch complete (25049 records). [2025-09-14T17:39:38.625089] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-14T17:39:38.640524] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-14T17:39:38.640909] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-14T17:39:38.642238] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-14T17:39:38.674102] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-14T17:39:38.821799] [DEBUG] [LOCAL ] DB: Trimmed 57049 records to 39472 (keeping 150 days of data) [2025-09-14T17:39:38.986812] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-14T17:39:39.153733] [DEBUG] [VALIDATOR ] DBD: All expected trading days are present. [2025-09-14T17:39:39.154923] [DEBUG] [VALIDATOR ] DBD: Primary data validation passed. [2025-09-14T17:39:39.157691] [INFO ] [MAIN ] DBD: Fetched primary data is valid. [2025-09-14T17:39:39.156352] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:39:39.157793] [DEBUG] [LOCAL ] DBD: Saving primary data. [2025-09-14T17:39:39.172022] [DEBUG] [LOCAL ] DBD: Trimmed 25049 records to 18458 (keeping 150 days of data) [2025-09-14T17:39:39.401322] [DEBUG] [LOCAL ] DBD: Primary data saved (18458 records). [2025-09-14T17:39:39.402381] [INFO ] [MAIN ] DBD: Full history saved. [2025-09-14T17:39:39.402536] [INFO ] [MAIN ] Update Progress: 592/2370 symbols completed. DBD took 25.8s. Estimated remaining: 3h 7m 36s. Rate: 9.5 symbols/min [2025-09-14T17:39:39.579873] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:39.615072] [DEBUG] [LOCAL ] DBRG: Loaded 22262 existing records from primary storage. [2025-09-14T17:39:39.617055] [INFO ] [MAIN ] DBRG: Loaded 22262 existing records. [2025-09-14T17:39:39.725301] [DEBUG] [LOCAL ] DB: Primary data saved (39472 records). [2025-09-14T17:39:39.725948] [INFO ] [MAIN ] DB: Full history saved. [2025-09-14T17:39:39.736623] [INFO ] [MAIN ] Update Progress: 593/2370 symbols completed. DB took 27.5s. Estimated remaining: 3h 7m 12s. Rate: 9.5 symbols/min [2025-09-14T17:39:39.776856] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-14T17:39:39.880036] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:39.926787] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-14T17:39:39.971910] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-14T17:39:39.989153] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:39.990382] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-14T17:39:39.990524] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-14T17:39:40.131324] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T17:39:40.197692] [DEBUG] [LOCAL ] DCI: Loaded 16614 existing records from primary storage. [2025-09-14T17:39:40.233214] [INFO ] [MAIN ] DCI: Loaded 16614 existing records. [2025-09-14T17:39:40.567540] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:40.564122] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-14T17:39:40.570825] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:40.572160] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-14T17:39:40.572228] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-14T17:39:40.572765] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-14T17:39:40.572845] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-14T17:39:40.935841] [INFO ] [REMOTE ] DCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:41.358801] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-14T17:39:41.397195] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T17:39:41.460868] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:39:42.158863] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-14T17:39:42.958856] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-14T17:39:43.108033] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:39:43.292913] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T17:39:43.687612] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:39:43.689117] [INFO ] [REMOTE ] DBL: Full fetch complete (9843 records). [2025-09-14T17:39:43.689205] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-14T17:39:43.764297] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-14T17:39:44.070752] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-14T17:39:44.070877] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-14T17:39:44.071149] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-14T17:39:44.071203] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-14T17:39:44.071831] [DEBUG] [LOCAL ] DBL: Trimmed 9843 records to 7122 (keeping 150 days of data) [2025-09-14T17:39:44.117804] [DEBUG] [LOCAL ] DBL: Primary data saved (7122 records). [2025-09-14T17:39:44.118004] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-14T17:39:44.118131] [INFO ] [MAIN ] Update Progress: 594/2370 symbols completed. DBL took 16.7s. Estimated remaining: 3h 6m 59s. Rate: 9.5 symbols/min [2025-09-14T17:39:44.298842] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:44.308508] [DEBUG] [LOCAL ] DCO: Loaded 7642 existing records from primary storage. [2025-09-14T17:39:44.308717] [INFO ] [MAIN ] DCO: Loaded 7642 existing records. [2025-09-14T17:39:44.485795] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:44.486114] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-14T17:39:44.486180] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-14T17:39:44.486577] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-14T17:39:44.486667] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-14T17:39:44.563918] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-14T17:39:44.839864] [INFO ] [REMOTE ] DCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:45.032500] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:39:45.358855] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-14T17:39:46.158836] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-14T17:39:46.497007] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:39:46.935919] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T17:39:46.958817] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-14T17:39:46.979406] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T17:39:47.758894] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-14T17:39:48.331583] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:39:48.336852] [INFO ] [REMOTE ] DBI: Full fetch complete (49375 records). [2025-09-14T17:39:48.336994] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-14T17:39:48.563940] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-14T17:39:48.721490] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-14T17:39:48.721637] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-14T17:39:48.722539] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-14T17:39:48.722692] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-14T17:39:48.724226] [DEBUG] [LOCAL ] DBI: Trimmed 49375 records to 33452 (keeping 150 days of data) [2025-09-14T17:39:48.850849] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T17:39:48.971568] [DEBUG] [LOCAL ] DBI: Primary data saved (33452 records). [2025-09-14T17:39:48.971794] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-14T17:39:48.971934] [INFO ] [MAIN ] Update Progress: 595/2370 symbols completed. DBI took 30.7s. Estimated remaining: 3h 6m 49s. Rate: 9.5 symbols/min [2025-09-14T17:39:49.149455] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:49.173262] [DEBUG] [LOCAL ] DD: Loaded 23686 existing records from primary storage. [2025-09-14T17:39:49.173460] [INFO ] [MAIN ] DD: Loaded 23686 existing records. [2025-09-14T17:39:49.356574] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:49.356874] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-14T17:39:49.356936] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-14T17:39:49.357676] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-14T17:39:49.357739] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-14T17:39:49.369485] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-14T17:39:49.626788] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T17:39:49.731899] [INFO ] [REMOTE ] DD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:50.158892] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-14T17:39:50.958861] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-14T17:39:51.108577] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T17:39:51.758936] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-14T17:39:52.034217] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:39:52.559304] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:39:52.559379] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-14T17:39:52.641378] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T17:39:53.358879] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-14T17:39:54.158828] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-14T17:39:54.534192] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T17:39:54.815692] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:39:54.958849] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-14T17:39:55.589460] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T17:39:55.758823] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-14T17:39:55.897122] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T17:39:56.558832] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-14T17:39:57.293083] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:39:57.358794] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-14T17:39:58.158877] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-14T17:39:58.335257] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T17:39:58.606470] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-14T17:39:58.958890] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-14T17:39:59.753478] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T17:39:59.763459] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-14T17:39:59.944208] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:40:00.558891] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-14T17:40:01.358878] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-14T17:40:01.780406] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T17:40:01.997321] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:40:02.158882] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-14T17:40:02.910976] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T17:40:02.916527] [INFO ] [REMOTE ] DBRG: Full fetch complete (54329 records). [2025-09-14T17:40:02.916727] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-14T17:40:02.963996] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-14T17:40:03.240010] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T17:40:03.342504] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-14T17:40:03.342683] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-14T17:40:03.343758] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-14T17:40:03.343829] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-14T17:40:03.345665] [DEBUG] [LOCAL ] DBRG: Trimmed 54329 records to 37419 (keeping 150 days of data) [2025-09-14T17:40:03.592382] [DEBUG] [LOCAL ] DBRG: Primary data saved (37419 records). [2025-09-14T17:40:03.592630] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-14T17:40:03.592781] [INFO ] [MAIN ] Update Progress: 596/2370 symbols completed. DBRG took 24.2s. Estimated remaining: 3h 7m 7s. Rate: 9.5 symbols/min [2025-09-14T17:40:03.767214] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-14T17:40:03.771514] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:03.796465] [DEBUG] [LOCAL ] DDD: Loaded 22695 existing records from primary storage. [2025-09-14T17:40:03.796705] [INFO ] [MAIN ] DDD: Loaded 22695 existing records. [2025-09-14T17:40:03.985318] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:03.985699] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-14T17:40:03.985766] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-14T17:40:03.986502] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-14T17:40:03.986574] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-14T17:40:04.363494] [INFO ] [REMOTE ] DDD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:04.558854] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-14T17:40:04.728959] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T17:40:05.071894] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T17:40:05.358841] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-14T17:40:05.379362] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:40:06.000202] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:40:06.005261] [INFO ] [REMOTE ] DCI: Full fetch complete (40861 records). [2025-09-14T17:40:06.014286] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-14T17:40:06.163995] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-14T17:40:06.421929] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-14T17:40:06.422068] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-14T17:40:06.422821] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-14T17:40:06.422887] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-14T17:40:06.424228] [DEBUG] [LOCAL ] DCI: Trimmed 40861 records to 27720 (keeping 150 days of data) [2025-09-14T17:40:06.601582] [DEBUG] [LOCAL ] DCI: Primary data saved (27720 records). [2025-09-14T17:40:06.601854] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-14T17:40:06.601987] [INFO ] [MAIN ] Update Progress: 597/2370 symbols completed. DCI took 26.8s. Estimated remaining: 3h 6m 51s. Rate: 9.5 symbols/min [2025-09-14T17:40:06.958883] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-14T17:40:07.758795] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-14T17:40:08.277212] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T17:40:08.558821] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-14T17:40:08.679377] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T17:40:08.682731] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:40:08.685154] [INFO ] [REMOTE ] DCO: Full fetch complete (14529 records). [2025-09-14T17:40:08.696529] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-14T17:40:09.066806] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-14T17:40:09.066938] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-14T17:40:09.067402] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-14T17:40:09.067477] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-14T17:40:09.068080] [DEBUG] [LOCAL ] DCO: Trimmed 14529 records to 10870 (keeping 150 days of data) [2025-09-14T17:40:09.134416] [DEBUG] [LOCAL ] DCO: Primary data saved (10870 records). [2025-09-14T17:40:09.134673] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-14T17:40:09.134818] [INFO ] [MAIN ] Update Progress: 598/2370 symbols completed. DCO took 25.0s. Estimated remaining: 3h 6m 33s. Rate: 9.5 symbols/min [2025-09-14T17:40:09.358887] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-14T17:40:10.465032] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:40:10.477142] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-14T17:40:11.167476] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:40:11.178604] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-14T17:40:11.225870] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:40:11.232061] [INFO ] [REMOTE ] DD: Full fetch complete (57381 records). [2025-09-14T17:40:11.232263] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-14T17:40:11.613290] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-14T17:40:11.613410] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-14T17:40:11.614193] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-14T17:40:11.614253] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-14T17:40:11.615574] [DEBUG] [LOCAL ] DD: Trimmed 57381 records to 39762 (keeping 150 days of data) [2025-09-14T17:40:11.876554] [DEBUG] [LOCAL ] DD: Primary data saved (39762 records). [2025-09-14T17:40:11.876965] [INFO ] [MAIN ] DD: Full history saved. [2025-09-14T17:40:11.877144] [INFO ] [MAIN ] Update Progress: 599/2370 symbols completed. DD took 22.9s. Estimated remaining: 3h 6m 16s. Rate: 9.5 symbols/min [2025-09-14T17:40:12.650236] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T17:40:12.661765] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-14T17:40:14.567117] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:40:14.579920] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-14T17:40:16.280418] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T17:40:16.291175] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-14T17:40:18.188050] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:40:18.199334] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-14T17:40:20.054307] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T17:40:20.065837] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-14T17:40:20.712689] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:40:20.718536] [INFO ] [REMOTE ] DDD: Full fetch complete (55243 records). [2025-09-14T17:40:20.718752] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-14T17:40:21.110894] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-14T17:40:21.111016] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-14T17:40:21.111885] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-14T17:40:21.111947] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-14T17:40:21.113364] [DEBUG] [LOCAL ] DDD: Trimmed 55243 records to 38100 (keeping 150 days of data) [2025-09-14T17:40:21.331265] [DEBUG] [LOCAL ] DDD: Primary data saved (38100 records). [2025-09-14T17:40:21.331451] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-14T17:40:21.331551] [INFO ] [MAIN ] Update Progress: 600/2370 symbols completed. DDD took 17.7s. Estimated remaining: 3h 6m 19s. Rate: 9.5 symbols/min [2025-09-14T17:40:21.951604] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:22.091205] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:22.127219] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:22.129434] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:22.133177] [DEBUG] [LOCAL ] DDT: Loaded 917 existing records from primary storage. [2025-09-14T17:40:22.133812] [INFO ] [MAIN ] DDT: Loaded 917 existing records. [2025-09-14T17:40:22.255083] [DEBUG] [LOCAL ] DDS: Loaded 5774 existing records from primary storage. [2025-09-14T17:40:22.283422] [DEBUG] [LOCAL ] DDL: Loaded 13375 existing records from primary storage. [2025-09-14T17:40:22.345168] [DEBUG] [LOCAL ] DE: Loaded 21308 existing records from primary storage. [2025-09-14T17:40:22.288755] [INFO ] [MAIN ] DDS: Loaded 5774 existing records. [2025-09-14T17:40:22.351533] [INFO ] [MAIN ] DE: Loaded 21308 existing records. [2025-09-14T17:40:22.351228] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:22.361939] [INFO ] [MAIN ] DDL: Loaded 13375 existing records. [2025-09-14T17:40:22.608120] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-14T17:40:22.667318] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-14T17:40:22.757200] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-14T17:40:22.839501] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-14T17:40:22.834334] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:22.790705] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:22.870732] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-14T17:40:22.907949] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-14T17:40:22.913235] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-14T17:40:22.965695] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-14T17:40:22.978070] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:23.012594] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-14T17:40:23.025407] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-14T17:40:23.025499] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-14T17:40:23.036217] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-14T17:40:23.041421] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-14T17:40:23.080662] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-14T17:40:23.071939] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-14T17:40:23.139440] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-14T17:40:24.004742] [INFO ] [REMOTE ] DDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:24.063559] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-14T17:40:24.279694] [INFO ] [REMOTE ] DE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:24.275969] [INFO ] [REMOTE ] DDS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:24.280322] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-14T17:40:24.280102] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-14T17:40:24.363234] [INFO ] [REMOTE ] DDL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:24.363721] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-14T17:40:24.727637] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T17:40:24.729006] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-14T17:40:25.294067] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T17:40:25.297188] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-14T17:40:25.353989] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T17:40:25.355251] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-14T17:40:25.467209] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T17:40:25.474753] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-14T17:40:25.677955] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T17:40:25.688031] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-14T17:40:25.780527] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T17:40:25.782205] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-14T17:40:26.310243] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T17:40:26.311438] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-14T17:40:26.425322] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T17:40:26.429376] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-14T17:40:26.546360] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:40:26.557595] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-14T17:40:26.642962] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-14T17:40:26.644198] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-14T17:40:27.166347] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T17:40:27.167903] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-14T17:40:27.401409] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T17:40:27.585553] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:40:27.691627] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T17:40:27.758794] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-14T17:40:27.956060] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T17:40:28.558865] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-14T17:40:28.749374] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:40:29.358851] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-14T17:40:29.685250] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:40:29.686179] [INFO ] [REMOTE ] DDT: Full fetch complete (2195 records). [2025-09-14T17:40:29.686268] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-14T17:40:30.044733] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-14T17:40:30.044851] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-14T17:40:30.044987] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-14T17:40:30.045050] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-14T17:40:30.045410] [DEBUG] [LOCAL ] DDT: Trimmed 2195 records to 1389 (keeping 150 days of data) [2025-09-14T17:40:30.054778] [DEBUG] [LOCAL ] DDT: Primary data saved (1389 records). [2025-09-14T17:40:30.054860] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-14T17:40:30.054961] [INFO ] [MAIN ] Update Progress: 601/2370 symbols completed. DDT took 8.7s. Estimated remaining: 3h 6m 20s. Rate: 9.5 symbols/min [2025-09-14T17:40:30.163947] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-14T17:40:30.232738] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:30.250729] [DEBUG] [LOCAL ] DEA: Loaded 17034 existing records from primary storage. [2025-09-14T17:40:30.250919] [INFO ] [MAIN ] DEA: Loaded 17034 existing records. [2025-09-14T17:40:30.430018] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:30.430313] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-14T17:40:30.430500] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-14T17:40:30.431169] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-14T17:40:30.431236] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-14T17:40:30.812577] [INFO ] [REMOTE ] DEA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:30.824936] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T17:40:30.958805] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-14T17:40:31.137188] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:40:31.758893] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-14T17:40:32.564077] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-14T17:40:32.575877] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:40:32.652743] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T17:40:33.358847] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-14T17:40:34.158857] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-14T17:40:34.248215] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:40:34.632070] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T17:40:34.958909] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-14T17:40:35.758839] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-14T17:40:35.910402] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T17:40:35.935842] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T17:40:36.554599] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:40:36.558764] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-14T17:40:37.358888] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-14T17:40:37.371244] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:40:37.374564] [INFO ] [REMOTE ] DDS: Full fetch complete (14789 records). [2025-09-14T17:40:37.374721] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-14T17:40:37.769031] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-14T17:40:37.769166] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-14T17:40:37.769747] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-14T17:40:37.769810] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-14T17:40:37.770516] [DEBUG] [LOCAL ] DDS: Trimmed 14789 records to 9703 (keeping 150 days of data) [2025-09-14T17:40:37.836685] [DEBUG] [LOCAL ] DDS: Primary data saved (9703 records). [2025-09-14T17:40:37.836923] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-14T17:40:37.837050] [INFO ] [MAIN ] Update Progress: 602/2370 symbols completed. DDS took 16.5s. Estimated remaining: 3h 6m 18s. Rate: 9.5 symbols/min [2025-09-14T17:40:38.018007] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:38.033152] [DEBUG] [LOCAL ] DEC: Loaded 12270 existing records from primary storage. [2025-09-14T17:40:38.033359] [INFO ] [MAIN ] DEC: Loaded 12270 existing records. [2025-09-14T17:40:38.164083] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-14T17:40:38.230106] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:38.230437] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-14T17:40:38.230506] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-14T17:40:38.230997] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-14T17:40:38.231065] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-14T17:40:38.629239] [INFO ] [REMOTE ] DEC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:38.717802] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T17:40:38.958897] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-14T17:40:39.757752] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:40:39.767495] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-14T17:40:40.558881] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-14T17:40:40.798228] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:40:40.856344] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:40:41.358868] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-14T17:40:42.158876] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-14T17:40:42.278917] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T17:40:42.936070] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T17:40:42.958786] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-14T17:40:43.758914] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-14T17:40:44.003320] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T17:40:44.250891] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T17:40:44.558901] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-14T17:40:45.323765] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T17:40:45.358795] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-14T17:40:45.777578] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T17:40:46.158831] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-14T17:40:46.937244] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T17:40:46.958793] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-14T17:40:47.577401] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T17:40:47.758897] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-14T17:40:48.127633] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T17:40:48.132768] [INFO ] [REMOTE ] DE: Full fetch complete (52274 records). [2025-09-14T17:40:48.132888] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-14T17:40:48.538486] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T17:40:48.538592] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-14T17:40:48.546693] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-14T17:40:48.548069] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-14T17:40:48.548457] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-14T17:40:48.549760] [DEBUG] [LOCAL ] DE: Trimmed 52274 records to 35483 (keeping 150 days of data) [2025-09-14T17:40:48.608196] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-14T17:40:48.786547] [DEBUG] [LOCAL ] DE: Primary data saved (35483 records). [2025-09-14T17:40:48.786771] [INFO ] [MAIN ] DE: Full history saved. [2025-09-14T17:40:48.786901] [INFO ] [MAIN ] Update Progress: 603/2370 symbols completed. DE took 27.5s. Estimated remaining: 3h 6m 25s. Rate: 9.5 symbols/min [2025-09-14T17:40:48.954469] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:48.977692] [DEBUG] [LOCAL ] DECK: Loaded 23922 existing records from primary storage. [2025-09-14T17:40:48.977884] [INFO ] [MAIN ] DECK: Loaded 23922 existing records. [2025-09-14T17:40:49.150868] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:49.151165] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-14T17:40:49.151234] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-14T17:40:49.151994] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-14T17:40:49.152057] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-14T17:40:49.370176] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-14T17:40:49.523632] [INFO ] [REMOTE ] DECK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:49.778262] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T17:40:50.158846] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-14T17:40:50.831904] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T17:40:50.958878] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-14T17:40:51.758890] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-14T17:40:52.007383] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T17:40:52.373252] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:40:52.558950] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-14T17:40:53.092534] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T17:40:53.097146] [INFO ] [REMOTE ] DDL: Full fetch complete (39494 records). [2025-09-14T17:40:53.097281] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-14T17:40:53.363885] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-14T17:40:53.478468] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-14T17:40:53.478586] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-14T17:40:53.479279] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-14T17:40:53.479355] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-14T17:40:53.480497] [DEBUG] [LOCAL ] DDL: Trimmed 39494 records to 26209 (keeping 150 days of data) [2025-09-14T17:40:53.626192] [DEBUG] [LOCAL ] DDL: Primary data saved (26209 records). [2025-09-14T17:40:53.626359] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-14T17:40:53.626469] [INFO ] [MAIN ] Update Progress: 604/2370 symbols completed. DDL took 32.3s. Estimated remaining: 3h 6m 15s. Rate: 9.5 symbols/min [2025-09-14T17:40:53.795003] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:53.812106] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T17:40:53.834365] [DEBUG] [LOCAL ] DEI: Loaded 21269 existing records from primary storage. [2025-09-14T17:40:53.834553] [INFO ] [MAIN ] DEI: Loaded 21269 existing records. [2025-09-14T17:40:54.011403] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:54.011735] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-14T17:40:54.011796] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-14T17:40:54.012326] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-14T17:40:54.012389] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-14T17:40:54.168762] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-14T17:40:54.370517] [INFO ] [REMOTE ] DEI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:54.958877] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-14T17:40:55.365688] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:40:55.368569] [INFO ] [REMOTE ] DEC: Full fetch complete (34051 records). [2025-09-14T17:40:55.368697] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-14T17:40:55.744506] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-14T17:40:55.744864] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-14T17:40:55.745605] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-14T17:40:55.745954] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-14T17:40:55.758713] [DEBUG] [LOCAL ] DEC: Trimmed 34051 records to 21746 (keeping 150 days of data) [2025-09-14T17:40:55.758836] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-14T17:40:55.758557] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T17:40:55.765260] [INFO ] [REMOTE ] DEA: Full fetch complete (46468 records). [2025-09-14T17:40:55.765454] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-14T17:40:56.025756] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-14T17:40:56.317763] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-14T17:40:56.320803] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-14T17:40:56.321399] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-14T17:40:56.324442] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-14T17:40:56.337761] [DEBUG] [LOCAL ] DEC: Primary data saved (21746 records). [2025-09-14T17:40:56.338101] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-14T17:40:56.338256] [DEBUG] [LOCAL ] DEA: Trimmed 46468 records to 29951 (keeping 150 days of data) [2025-09-14T17:40:56.338371] [INFO ] [MAIN ] Update Progress: 605/2370 symbols completed. DEC took 18.5s. Estimated remaining: 3h 5m 58s. Rate: 9.5 symbols/min [2025-09-14T17:40:56.563796] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-14T17:40:56.610132] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:56.680977] [DEBUG] [LOCAL ] DELL: Loaded 24101 existing records from primary storage. [2025-09-14T17:40:56.701923] [INFO ] [MAIN ] DELL: Loaded 24101 existing records. [2025-09-14T17:40:56.882413] [DEBUG] [LOCAL ] DEA: Primary data saved (29951 records). [2025-09-14T17:40:56.902717] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:56.902604] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-14T17:40:56.902892] [INFO ] [MAIN ] Update Progress: 606/2370 symbols completed. DEA took 26.8s. Estimated remaining: 3h 5m 35s. Rate: 9.5 symbols/min [2025-09-14T17:40:56.903050] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-14T17:40:56.903162] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-14T17:40:56.946260] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-14T17:40:57.001456] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-14T17:40:57.186864] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:57.423319] [DEBUG] [LOCAL ] DEO: Loaded 22257 existing records from primary storage. [2025-09-14T17:40:57.455630] [INFO ] [MAIN ] DEO: Loaded 22257 existing records. [2025-09-14T17:40:57.459934] [INFO ] [REMOTE ] DELL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:57.460702] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-14T17:40:57.644268] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:57.644537] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-14T17:40:57.644594] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-14T17:40:57.645312] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-14T17:40:57.645375] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-14T17:40:57.845303] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T17:40:58.055370] [INFO ] [REMOTE ] DEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:58.158847] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-14T17:40:58.424340] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:40:58.958834] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-14T17:40:59.758861] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-14T17:40:59.931419] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-14T17:41:00.133503] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T17:41:00.558884] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-14T17:41:01.027778] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T17:41:01.358807] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-14T17:41:01.659309] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:41:02.158848] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-14T17:41:02.891132] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T17:41:02.958786] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-14T17:41:03.470288] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-14T17:41:03.624849] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T17:41:03.758844] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-14T17:41:04.558808] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-14T17:41:04.613840] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:41:05.358807] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-14T17:41:05.394499] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T17:41:06.158833] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-14T17:41:06.497131] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T17:41:06.958871] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-14T17:41:07.319333] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:41:07.758839] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-14T17:41:07.793295] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:41:08.558866] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-14T17:41:08.956966] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T17:41:09.358839] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-14T17:41:09.683504] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:41:10.158835] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-14T17:41:10.693724] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:41:10.699314] [INFO ] [REMOTE ] DECK: Full fetch complete (58002 records). [2025-09-14T17:41:10.699445] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-14T17:41:10.963484] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-14T17:41:11.101115] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-14T17:41:11.101405] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-14T17:41:11.102277] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-14T17:41:11.102485] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-14T17:41:11.104515] [DEBUG] [LOCAL ] DECK: Trimmed 58002 records to 40114 (keeping 150 days of data) [2025-09-14T17:41:11.133525] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:41:11.281365] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-14T17:41:11.452436] [DEBUG] [LOCAL ] DECK: Primary data saved (40114 records). [2025-09-14T17:41:11.452693] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-14T17:41:11.452819] [INFO ] [MAIN ] Update Progress: 607/2370 symbols completed. DECK took 22.7s. Estimated remaining: 3h 5m 52s. Rate: 9.5 symbols/min [2025-09-14T17:41:11.631177] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:11.646447] [DEBUG] [LOCAL ] DFH: Loaded 14327 existing records from primary storage. [2025-09-14T17:41:11.646677] [INFO ] [MAIN ] DFH: Loaded 14327 existing records. [2025-09-14T17:41:11.764029] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-14T17:41:11.843680] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:11.843979] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-14T17:41:11.844046] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-14T17:41:11.844520] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-14T17:41:11.844593] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-14T17:41:12.193982] [INFO ] [REMOTE ] DFH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:12.558821] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-14T17:41:12.997959] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T17:41:13.358835] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-14T17:41:13.546767] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T17:41:14.144956] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:41:14.158784] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-14T17:41:14.958848] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-14T17:41:15.110852] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:41:15.359375] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T17:41:15.591193] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:41:15.596284] [INFO ] [REMOTE ] DEI: Full fetch complete (52496 records). [2025-09-14T17:41:15.596418] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-14T17:41:15.772600] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-14T17:41:15.986972] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-14T17:41:15.987087] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-14T17:41:15.987801] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-14T17:41:15.987860] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-14T17:41:15.989355] [DEBUG] [LOCAL ] DEI: Trimmed 52496 records to 36290 (keeping 150 days of data) [2025-09-14T17:41:16.212160] [DEBUG] [LOCAL ] DEI: Primary data saved (36290 records). [2025-09-14T17:41:16.212345] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-14T17:41:16.212525] [INFO ] [MAIN ] Update Progress: 608/2370 symbols completed. DEI took 22.6s. Estimated remaining: 3h 5m 42s. Rate: 9.5 symbols/min [2025-09-14T17:41:16.381017] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:16.392083] [DEBUG] [LOCAL ] DFIN: Loaded 9184 existing records from primary storage. [2025-09-14T17:41:16.392252] [INFO ] [MAIN ] DFIN: Loaded 9184 existing records. [2025-09-14T17:41:16.564157] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-14T17:41:16.570704] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:16.571069] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-14T17:41:16.571161] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-14T17:41:16.571607] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-14T17:41:16.571701] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-14T17:41:16.930064] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:17.358901] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-14T17:41:17.431261] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T17:41:17.437003] [INFO ] [REMOTE ] DEO: Full fetch complete (53224 records). [2025-09-14T17:41:17.437150] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-14T17:41:17.817931] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-14T17:41:17.818083] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-14T17:41:17.818915] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-14T17:41:17.818988] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-14T17:41:17.820261] [DEBUG] [LOCAL ] DEO: Trimmed 53224 records to 36454 (keeping 150 days of data) [2025-09-14T17:41:18.049725] [DEBUG] [LOCAL ] DEO: Primary data saved (36454 records). [2025-09-14T17:41:18.049920] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-14T17:41:18.050045] [INFO ] [MAIN ] Update Progress: 609/2370 symbols completed. DEO took 21.1s. Estimated remaining: 3h 5m 22s. Rate: 9.5 symbols/min [2025-09-14T17:41:18.163886] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-14T17:41:18.231834] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:18.240738] [DEBUG] [LOCAL ] DFP: Loaded 5327 existing records from primary storage. [2025-09-14T17:41:18.240935] [INFO ] [MAIN ] DFP: Loaded 5327 existing records. [2025-09-14T17:41:18.418958] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:18.419250] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-14T17:41:18.419310] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-14T17:41:18.419606] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-14T17:41:18.419690] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-14T17:41:18.779519] [INFO ] [REMOTE ] DFP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:18.795193] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:41:18.853985] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-14T17:41:18.958789] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-14T17:41:19.759593] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-14T17:41:19.762122] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T17:41:20.558808] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-14T17:41:21.098029] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T17:41:21.361197] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-14T17:41:21.364122] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-14T17:41:21.927125] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T17:41:21.962006] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-14T17:41:22.158790] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-14T17:41:22.817757] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T17:41:22.958800] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-14T17:41:23.758839] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-14T17:41:24.558833] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-14T17:41:25.119663] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:41:25.237714] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-14T17:41:25.358795] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-14T17:41:25.381486] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:41:26.158824] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-14T17:41:26.958814] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-14T17:41:27.274795] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T17:41:27.758807] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-14T17:41:27.816847] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-14T17:41:28.324817] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T17:41:28.364604] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T17:41:28.558827] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-14T17:41:29.358826] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-14T17:41:29.900582] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:41:30.158793] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-14T17:41:30.327041] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:41:30.958825] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-14T17:41:31.553767] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T17:41:31.568730] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:41:31.758874] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-14T17:41:32.558834] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-14T17:41:33.102073] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:41:33.105774] [INFO ] [REMOTE ] DFH: Full fetch complete (36248 records). [2025-09-14T17:41:33.105933] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-14T17:41:33.365069] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-14T17:41:33.480096] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-14T17:41:33.480221] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-14T17:41:33.481016] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-14T17:41:33.481110] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-14T17:41:33.482056] [DEBUG] [LOCAL ] DFH: Trimmed 36248 records to 24215 (keeping 150 days of data) [2025-09-14T17:41:33.631888] [DEBUG] [LOCAL ] DFH: Primary data saved (24215 records). [2025-09-14T17:41:33.632051] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-14T17:41:33.632167] [INFO ] [MAIN ] Update Progress: 610/2370 symbols completed. DFH took 22.2s. Estimated remaining: 3h 5m 43s. Rate: 9.5 symbols/min [2025-09-14T17:41:33.798578] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:33.851297] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-14T17:41:33.849960] [DEBUG] [LOCAL ] DG: Loaded 23816 existing records from primary storage. [2025-09-14T17:41:33.851493] [INFO ] [MAIN ] DG: Loaded 23816 existing records. [2025-09-14T17:41:34.035977] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:34.036277] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-14T17:41:34.036359] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-14T17:41:34.037084] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-14T17:41:34.037149] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-14T17:41:34.175254] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-14T17:41:34.392012] [INFO ] [REMOTE ] DG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:34.399865] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T17:41:34.878806] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T17:41:34.886329] [INFO ] [REMOTE ] DELL: Full fetch complete (58416 records). [2025-09-14T17:41:34.886501] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-14T17:41:34.964060] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-14T17:41:35.284663] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-14T17:41:35.284791] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-14T17:41:35.287439] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-14T17:41:35.287572] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-14T17:41:35.288938] [DEBUG] [LOCAL ] DELL: Trimmed 58416 records to 40477 (keeping 150 days of data) [2025-09-14T17:41:35.557484] [DEBUG] [LOCAL ] DELL: Primary data saved (40477 records). [2025-09-14T17:41:35.557699] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-14T17:41:35.557823] [INFO ] [MAIN ] Update Progress: 611/2370 symbols completed. DELL took 39.2s. Estimated remaining: 3h 5m 24s. Rate: 9.5 symbols/min [2025-09-14T17:41:35.729190] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:35.752163] [DEBUG] [LOCAL ] DGX: Loaded 19786 existing records from primary storage. [2025-09-14T17:41:35.752374] [INFO ] [MAIN ] DGX: Loaded 19786 existing records. [2025-09-14T17:41:35.763899] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-14T17:41:35.940086] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:35.940423] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-14T17:41:35.940549] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-14T17:41:35.948123] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-14T17:41:35.948250] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-14T17:41:35.991441] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:41:36.301920] [INFO ] [REMOTE ] DGX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:36.558883] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-14T17:41:37.358881] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-14T17:41:37.770938] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T17:41:37.845925] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T17:41:38.158855] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-14T17:41:38.212755] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:41:38.215375] [INFO ] [REMOTE ] DFP: Full fetch complete (12715 records). [2025-09-14T17:41:38.215595] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-14T17:41:38.589429] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-14T17:41:38.589557] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-14T17:41:38.589895] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-14T17:41:38.589961] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-14T17:41:38.590599] [DEBUG] [LOCAL ] DFP: Trimmed 12715 records to 8600 (keeping 150 days of data) [2025-09-14T17:41:38.646148] [DEBUG] [LOCAL ] DFP: Primary data saved (8600 records). [2025-09-14T17:41:38.646345] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-14T17:41:38.646452] [INFO ] [MAIN ] Update Progress: 612/2370 symbols completed. DFP took 20.6s. Estimated remaining: 3h 5m 8s. Rate: 9.5 symbols/min [2025-09-14T17:41:38.822900] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:38.833623] [DEBUG] [LOCAL ] DHF: Loaded 9870 existing records from primary storage. [2025-09-14T17:41:38.833831] [INFO ] [MAIN ] DHF: Loaded 9870 existing records. [2025-09-14T17:41:38.964019] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-14T17:41:39.018501] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:39.018838] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-14T17:41:39.018905] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-14T17:41:39.019295] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-14T17:41:39.019358] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-14T17:41:39.374478] [INFO ] [REMOTE ] DHF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:39.758849] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-14T17:41:39.963314] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T17:41:40.004372] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T17:41:40.558824] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-14T17:41:40.679153] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:41:41.358855] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-14T17:41:41.670897] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:41:42.158851] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-14T17:41:42.958836] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-14T17:41:43.029537] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T17:41:43.758852] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-14T17:41:44.075614] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:41:44.267120] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T17:41:44.558900] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-14T17:41:45.358807] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-14T17:41:45.512410] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T17:41:45.544194] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T17:41:46.158841] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-14T17:41:46.408833] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T17:41:46.411469] [INFO ] [REMOTE ] DFIN: Full fetch complete (25954 records). [2025-09-14T17:41:46.411638] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-14T17:41:46.776383] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-14T17:41:46.776497] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-14T17:41:46.777100] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-14T17:41:46.777166] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-14T17:41:46.777969] [DEBUG] [LOCAL ] DFIN: Trimmed 25954 records to 16451 (keeping 150 days of data) [2025-09-14T17:41:46.874009] [DEBUG] [LOCAL ] DFIN: Primary data saved (16451 records). [2025-09-14T17:41:46.874175] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-14T17:41:46.874279] [INFO ] [MAIN ] Update Progress: 613/2370 symbols completed. DFIN took 30.7s. Estimated remaining: 3h 5m 7s. Rate: 9.5 symbols/min [2025-09-14T17:41:46.966539] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-14T17:41:47.050892] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:47.075035] [DEBUG] [LOCAL ] DHI: Loaded 23933 existing records from primary storage. [2025-09-14T17:41:47.075201] [INFO ] [MAIN ] DHI: Loaded 23933 existing records. [2025-09-14T17:41:47.255502] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:47.255827] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-14T17:41:47.255903] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-14T17:41:47.256786] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-14T17:41:47.256855] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-14T17:41:47.614980] [INFO ] [REMOTE ] DHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:47.649885] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-14T17:41:47.758793] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-14T17:41:48.239412] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:41:48.558884] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-14T17:41:49.358884] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-14T17:41:49.687023] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T17:41:50.158854] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-14T17:41:50.331024] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T17:41:50.381009] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:41:50.958840] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-14T17:41:51.758849] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-14T17:41:52.179383] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T17:41:52.558820] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-14T17:41:52.974619] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T17:41:53.296732] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T17:41:53.358789] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-14T17:41:54.158813] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-14T17:41:54.238874] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:41:54.958844] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-14T17:41:55.093062] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T17:41:55.772608] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-14T17:41:55.778683] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T17:41:56.558787] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-14T17:41:56.817924] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:41:56.943603] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T17:41:57.101257] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:41:57.105606] [INFO ] [REMOTE ] DGX: Full fetch complete (49923 records). [2025-09-14T17:41:57.105789] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-14T17:41:57.364057] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-14T17:41:57.512703] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-14T17:41:57.512831] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-14T17:41:57.513592] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-14T17:41:57.513683] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-14T17:41:57.514755] [DEBUG] [LOCAL ] DGX: Trimmed 49923 records to 33788 (keeping 150 days of data) [2025-09-14T17:41:57.727303] [DEBUG] [LOCAL ] DGX: Primary data saved (33788 records). [2025-09-14T17:41:57.727497] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-14T17:41:57.727601] [INFO ] [MAIN ] Update Progress: 614/2370 symbols completed. DGX took 22.2s. Estimated remaining: 3h 5m 14s. Rate: 9.5 symbols/min [2025-09-14T17:41:57.901310] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:57.925565] [DEBUG] [LOCAL ] DHR: Loaded 23865 existing records from primary storage. [2025-09-14T17:41:57.925794] [INFO ] [MAIN ] DHR: Loaded 23865 existing records. [2025-09-14T17:41:58.099403] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:58.099716] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-14T17:41:58.099780] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-14T17:41:58.100491] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-14T17:41:58.100554] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-14T17:41:58.164063] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-14T17:41:58.459113] [INFO ] [REMOTE ] DHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:58.958896] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-14T17:41:59.128620] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:41:59.758905] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-14T17:42:00.074565] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T17:42:00.558887] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-14T17:42:00.765700] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T17:42:00.825839] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T17:42:01.358922] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-14T17:42:02.158843] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-14T17:42:02.958806] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-14T17:42:03.159756] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-14T17:42:03.758885] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-14T17:42:04.436162] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-09-14T17:42:04.558879] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-14T17:42:04.863428] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-14T17:42:04.869594] [INFO ] [REMOTE ] DG: Full fetch complete (57969 records). [2025-09-14T17:42:04.869829] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-14T17:42:05.288590] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-14T17:42:05.288779] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-14T17:42:05.289895] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-14T17:42:05.289966] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-14T17:42:05.291701] [DEBUG] [LOCAL ] DG: Trimmed 57969 records to 40084 (keeping 150 days of data) [2025-09-14T17:42:05.370139] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:42:05.399276] [INFO ] [REMOTE ] DHF: Full fetch complete (22859 records). [2025-09-14T17:42:05.400708] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-14T17:42:05.813114] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-14T17:42:05.813439] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-14T17:42:05.814174] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-14T17:42:05.866019] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-14T17:42:05.909369] [DEBUG] [LOCAL ] DHF: Trimmed 22859 records to 16009 (keeping 150 days of data) [2025-09-14T17:42:06.027124] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (3.87 seconds). [2025-09-14T17:42:06.043948] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-14T17:42:06.066148] [DEBUG] [LOCAL ] DG: Primary data saved (40084 records). [2025-09-14T17:42:06.067046] [INFO ] [MAIN ] DG: Full history saved. [2025-09-14T17:42:06.067632] [INFO ] [MAIN ] Update Progress: 615/2370 symbols completed. DG took 32.4s. Estimated remaining: 3h 5m 13s. Rate: 9.5 symbols/min [2025-09-14T17:42:06.248736] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:06.261485] [DEBUG] [LOCAL ] DHF: Primary data saved (16009 records). [2025-09-14T17:42:06.261936] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-14T17:42:06.262115] [INFO ] [MAIN ] Update Progress: 616/2370 symbols completed. DHF took 27.6s. Estimated remaining: 3h 4m 49s. Rate: 9.5 symbols/min [2025-09-14T17:42:06.378111] [DEBUG] [LOCAL ] DHT: Loaded 20988 existing records from primary storage. [2025-09-14T17:42:06.443591] [INFO ] [MAIN ] DHT: Loaded 20988 existing records. [2025-09-14T17:42:06.500617] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:06.489904] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-14T17:42:06.586724] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-14T17:42:06.617995] [DEBUG] [LOCAL ] DHX: Loaded 5186 existing records from primary storage. [2025-09-14T17:42:06.663923] [INFO ] [MAIN ] DHX: Loaded 5186 existing records. [2025-09-14T17:42:06.684844] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:06.760401] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-14T17:42:06.787599] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-14T17:42:06.793940] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-14T17:42:06.814471] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-14T17:42:06.930881] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:06.971230] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-14T17:42:06.992439] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-14T17:42:07.079503] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-14T17:42:07.137786] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-14T17:42:07.340584] [INFO ] [REMOTE ] DHT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:07.391941] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-14T17:42:07.629570] [INFO ] [REMOTE ] DHX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:07.626389] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T17:42:07.635238] [INFO ] [REMOTE ] DHI: Full fetch complete (58044 records). [2025-09-14T17:42:07.635384] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-14T17:42:07.763866] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-14T17:42:08.020080] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-14T17:42:08.020242] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-14T17:42:08.021260] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-14T17:42:08.021355] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-14T17:42:08.022684] [DEBUG] [LOCAL ] DHI: Trimmed 58044 records to 40196 (keeping 150 days of data) [2025-09-14T17:42:08.153356] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T17:42:08.326716] [DEBUG] [LOCAL ] DHI: Primary data saved (40196 records). [2025-09-14T17:42:08.326890] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-14T17:42:08.326986] [INFO ] [MAIN ] Update Progress: 617/2370 symbols completed. DHI took 21.5s. Estimated remaining: 3h 4m 31s. Rate: 9.5 symbols/min [2025-09-14T17:42:08.496910] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:08.505103] [DEBUG] [LOCAL ] DIAX: Loaded 5907 existing records from primary storage. [2025-09-14T17:42:08.505279] [INFO ] [MAIN ] DIAX: Loaded 5907 existing records. [2025-09-14T17:42:08.560198] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-14T17:42:08.707784] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:08.708058] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-14T17:42:08.708117] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-14T17:42:08.708480] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-14T17:42:08.708542] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-14T17:42:09.067024] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:09.081197] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T17:42:09.112827] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:42:09.358827] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-14T17:42:10.158851] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-14T17:42:10.315299] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T17:42:10.348329] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T17:42:10.958851] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-14T17:42:11.758831] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-14T17:42:11.873451] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T17:42:11.894269] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T17:42:12.457312] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T17:42:12.558839] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-14T17:42:13.358814] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-14T17:42:13.573349] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:42:14.158837] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-14T17:42:14.958820] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-14T17:42:15.426711] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T17:42:15.758827] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-14T17:42:16.358933] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:42:16.558796] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-14T17:42:17.047158] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-09-14T17:42:17.358810] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-14T17:42:17.485929] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T17:42:17.655986] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:42:18.158839] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-14T17:42:18.881024] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T17:42:18.958793] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-14T17:42:19.758823] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-14T17:42:20.147834] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:42:20.532686] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-14T17:42:20.558768] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-14T17:42:20.734151] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T17:42:21.154734] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T17:42:21.358831] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-14T17:42:22.158817] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-14T17:42:22.178492] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:42:22.958818] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-14T17:42:22.993774] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:42:23.758879] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-14T17:42:24.558865] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-14T17:42:24.697783] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:42:24.723849] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T17:42:25.358871] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-14T17:42:25.401957] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T17:42:26.158841] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-14T17:42:26.958808] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-14T17:42:27.320576] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T17:42:27.363355] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:42:27.366055] [INFO ] [REMOTE ] DHX: Full fetch complete (15591 records). [2025-09-14T17:42:27.366155] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-14T17:42:27.761610] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-14T17:42:27.761221] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-14T17:42:27.761854] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-14T17:42:27.762301] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-14T17:42:27.762362] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-14T17:42:27.763955] [DEBUG] [LOCAL ] DHX: Trimmed 15591 records to 9236 (keeping 150 days of data) [2025-09-14T17:42:27.818731] [DEBUG] [LOCAL ] DHX: Primary data saved (9236 records). [2025-09-14T17:42:27.818917] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-14T17:42:27.819045] [INFO ] [MAIN ] Update Progress: 618/2370 symbols completed. DHX took 21.6s. Estimated remaining: 3h 5m 2s. Rate: 9.5 symbols/min [2025-09-14T17:42:27.987638] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:28.004759] [DEBUG] [LOCAL ] DIN: Loaded 16406 existing records from primary storage. [2025-09-14T17:42:28.004942] [INFO ] [MAIN ] DIN: Loaded 16406 existing records. [2025-09-14T17:42:28.183923] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:28.184219] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-14T17:42:28.184281] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-14T17:42:28.184920] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-14T17:42:28.184986] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-14T17:42:28.550343] [INFO ] [REMOTE ] DIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:28.558779] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-14T17:42:28.869488] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:42:29.308385] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T17:42:29.317168] [INFO ] [REMOTE ] DHT: Full fetch complete (52327 records). [2025-09-14T17:42:29.317444] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-14T17:42:29.364204] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-14T17:42:29.896281] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-14T17:42:29.896565] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-14T17:42:29.897736] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-14T17:42:29.897894] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-14T17:42:29.900138] [DEBUG] [LOCAL ] DHT: Trimmed 52327 records to 35605 (keeping 150 days of data) [2025-09-14T17:42:30.074720] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:42:30.121704] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:42:30.129885] [INFO ] [REMOTE ] DHR: Full fetch complete (58043 records). [2025-09-14T17:42:30.130557] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-14T17:42:30.164326] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-14T17:42:30.415246] [DEBUG] [LOCAL ] DHT: Primary data saved (35605 records). [2025-09-14T17:42:30.432708] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-14T17:42:30.432883] [INFO ] [MAIN ] Update Progress: 619/2370 symbols completed. DHT took 24.4s. Estimated remaining: 3h 4m 45s. Rate: 9.5 symbols/min [2025-09-14T17:42:30.823024] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:30.876459] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-14T17:42:30.876583] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-14T17:42:30.877488] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-14T17:42:30.877553] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-14T17:42:30.879085] [DEBUG] [LOCAL ] DHR: Trimmed 58043 records to 40171 (keeping 150 days of data) [2025-09-14T17:42:30.983663] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-14T17:42:30.997254] [DEBUG] [LOCAL ] DINO: Loaded 23755 existing records from primary storage. [2025-09-14T17:42:30.998096] [INFO ] [MAIN ] DINO: Loaded 23755 existing records. [2025-09-14T17:42:31.185884] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:31.188569] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-14T17:42:31.189362] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-14T17:42:31.191125] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-14T17:42:31.191891] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-14T17:42:31.571986] [INFO ] [REMOTE ] DINO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:31.703571] [DEBUG] [LOCAL ] DHR: Primary data saved (40171 records). [2025-09-14T17:42:31.703775] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-14T17:42:31.706820] [INFO ] [MAIN ] Update Progress: 620/2370 symbols completed. DHR took 34.0s. Estimated remaining: 3h 4m 25s. Rate: 9.5 symbols/min [2025-09-14T17:42:31.769754] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-14T17:42:31.870266] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T17:42:31.888243] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:31.890470] [INFO ] [REMOTE ] DIAX: Full fetch complete (13011 records). [2025-09-14T17:42:31.890596] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-14T17:42:32.185115] [DEBUG] [LOCAL ] DIS: Loaded 24148 existing records from primary storage. [2025-09-14T17:42:32.195893] [INFO ] [MAIN ] DIS: Loaded 24148 existing records. [2025-09-14T17:42:32.374120] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T17:42:32.392229] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-14T17:42:32.412319] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-14T17:42:32.423413] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-14T17:42:32.423742] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-14T17:42:32.500548] [DEBUG] [LOCAL ] DIAX: Trimmed 13011 records to 8704 (keeping 150 days of data) [2025-09-14T17:42:32.504012] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:32.504319] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-14T17:42:32.504663] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-14T17:42:32.527001] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-14T17:42:32.542990] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-14T17:42:32.563876] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-14T17:42:32.617413] [DEBUG] [LOCAL ] DIAX: Primary data saved (8704 records). [2025-09-14T17:42:32.640119] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-14T17:42:32.670062] [INFO ] [MAIN ] Update Progress: 621/2370 symbols completed. DIAX took 24.3s. Estimated remaining: 3h 4m 3s. Rate: 9.5 symbols/min [2025-09-14T17:42:33.029140] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:33.109808] [DEBUG] [LOCAL ] DIVY: Loaded 468 existing records from primary storage. [2025-09-14T17:42:33.108305] [INFO ] [REMOTE ] DIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:33.110206] [INFO ] [MAIN ] DIVY: Loaded 468 existing records. [2025-09-14T17:42:33.284157] [WARN ] [MAIN ] DIVY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:33.284459] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-14T17:42:33.284520] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-14T17:42:33.284763] [DEBUG] [LOCAL ] DIVY: Deleted primary data file. [2025-09-14T17:42:33.284823] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-14T17:42:33.373059] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-14T17:42:33.654011] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:33.687506] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T17:42:34.158801] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-14T17:42:34.229150] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T17:42:34.958839] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-14T17:42:35.375686] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-14T17:42:35.733780] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-14T17:42:35.758771] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-14T17:42:36.080551] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:42:36.558855] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-14T17:42:37.358845] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-14T17:42:37.710372] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-14T17:42:38.111239] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:42:38.155000] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-14T17:42:38.165750] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-14T17:42:38.958832] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-14T17:42:39.758850] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-14T17:42:39.791852] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T17:42:40.266929] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T17:42:40.515041] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T17:42:40.558793] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-14T17:42:41.358832] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-14T17:42:41.824086] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:42:42.158845] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-14T17:42:42.958824] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-14T17:42:43.118520] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T17:42:43.530990] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:42:43.758851] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-14T17:42:44.558858] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-14T17:42:44.966443] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-14T17:42:45.113260] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T17:42:45.343260] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T17:42:45.358779] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-14T17:42:45.982132] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:42:45.986508] [INFO ] [REMOTE ] DIN: Full fetch complete (40606 records). [2025-09-14T17:42:45.986625] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-14T17:42:46.164545] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-14T17:42:46.370114] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-14T17:42:46.370227] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-14T17:42:46.370915] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-14T17:42:46.370981] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-14T17:42:46.371970] [DEBUG] [LOCAL ] DIN: Trimmed 40606 records to 27267 (keeping 150 days of data) [2025-09-14T17:42:46.538715] [DEBUG] [LOCAL ] DIN: Primary data saved (27267 records). [2025-09-14T17:42:46.538909] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-14T17:42:46.539012] [INFO ] [MAIN ] Update Progress: 622/2370 symbols completed. DIN took 18.7s. Estimated remaining: 3h 4m 18s. Rate: 9.5 symbols/min [2025-09-14T17:42:46.714274] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:46.736832] [DEBUG] [LOCAL ] DK: Loaded 22433 existing records from primary storage. [2025-09-14T17:42:46.736998] [INFO ] [MAIN ] DK: Loaded 22433 existing records. [2025-09-14T17:42:46.910379] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:46.910680] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-14T17:42:46.910742] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-14T17:42:46.911323] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-14T17:42:46.911382] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-14T17:42:46.964002] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-14T17:42:47.271011] [INFO ] [REMOTE ] DK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:47.415404] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T17:42:47.758831] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-14T17:42:48.166172] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T17:42:48.558895] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-14T17:42:48.790446] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-14T17:42:48.920979] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-14T17:42:49.358846] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-14T17:42:50.158849] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-14T17:42:50.958832] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-14T17:42:51.257306] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:42:51.259545] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T17:42:51.271364] [INFO ] [REMOTE ] DIVY: Full fetch complete (1278 records). [2025-09-14T17:42:51.271535] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-14T17:42:51.447382] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T17:42:51.447615] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:42:51.447704] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:42:51.447779] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-14T17:42:51.447876] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-14T17:42:51.447943] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-14T17:42:51.448069] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-14T17:42:51.448193] [INFO ] [MAIN ] Update Progress: 623/2370 symbols completed. DIVY took 18.8s. Estimated remaining: 3h 4m 8s. Rate: 9.5 symbols/min [2025-09-14T17:42:51.622559] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:51.631659] [DEBUG] [LOCAL ] DKL: Loaded 6352 existing records from primary storage. [2025-09-14T17:42:51.631850] [INFO ] [MAIN ] DKL: Loaded 6352 existing records. [2025-09-14T17:42:51.763953] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-14T17:42:51.823551] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:51.823775] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-14T17:42:51.823840] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-14T17:42:51.824149] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-14T17:42:51.824211] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-14T17:42:52.178162] [INFO ] [REMOTE ] DKL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:52.508859] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-14T17:42:52.558790] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-14T17:42:53.035007] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:42:53.358848] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-14T17:42:54.158837] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-14T17:42:54.599210] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T17:42:54.958849] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-14T17:42:55.088452] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T17:42:55.294578] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T17:42:55.758830] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-14T17:42:56.270098] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:42:56.275655] [INFO ] [REMOTE ] DINO: Full fetch complete (57625 records). [2025-09-14T17:42:56.275808] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-14T17:42:56.564739] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-14T17:42:56.657535] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-14T17:42:56.657655] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-14T17:42:56.658376] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-14T17:42:56.658440] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-14T17:42:56.659613] [DEBUG] [LOCAL ] DINO: Trimmed 57625 records to 39866 (keeping 150 days of data) [2025-09-14T17:42:56.913560] [DEBUG] [LOCAL ] DINO: Primary data saved (39866 records). [2025-09-14T17:42:56.913809] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-14T17:42:56.913936] [INFO ] [MAIN ] Update Progress: 624/2370 symbols completed. DINO took 26.5s. Estimated remaining: 3h 3m 59s. Rate: 9.5 symbols/min [2025-09-14T17:42:57.095316] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:57.117805] [DEBUG] [LOCAL ] DKS: Loaded 22541 existing records from primary storage. [2025-09-14T17:42:57.117985] [INFO ] [MAIN ] DKS: Loaded 22541 existing records. [2025-09-14T17:42:57.325750] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:57.327769] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-14T17:42:57.327911] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-14T17:42:57.338907] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-14T17:42:57.339986] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-14T17:42:57.340071] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-14T17:42:57.370606] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-14T17:42:57.698233] [INFO ] [REMOTE ] DKS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:57.715562] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T17:42:57.811864] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T17:42:57.817915] [INFO ] [REMOTE ] DIS: Full fetch complete (58468 records). [2025-09-14T17:42:57.818111] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-14T17:42:58.163922] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-14T17:42:58.244133] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-14T17:42:58.244236] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-14T17:42:58.245011] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-14T17:42:58.245070] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-14T17:42:58.246446] [DEBUG] [LOCAL ] DIS: Trimmed 58468 records to 40528 (keeping 150 days of data) [2025-09-14T17:42:58.505872] [DEBUG] [LOCAL ] DIS: Primary data saved (40528 records). [2025-09-14T17:42:58.506044] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-14T17:42:58.506143] [INFO ] [MAIN ] Update Progress: 625/2370 symbols completed. DIS took 26.8s. Estimated remaining: 3h 3m 40s. Rate: 9.5 symbols/min [2025-09-14T17:42:58.673610] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:58.687742] [DEBUG] [LOCAL ] DLB: Loaded 13644 existing records from primary storage. [2025-09-14T17:42:58.687911] [INFO ] [MAIN ] DLB: Loaded 13644 existing records. [2025-09-14T17:42:58.870702] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:58.871013] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-14T17:42:58.871087] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-14T17:42:58.871551] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-14T17:42:58.871624] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-14T17:42:58.963937] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-14T17:42:59.244987] [INFO ] [REMOTE ] DLB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:59.758852] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-14T17:42:59.990599] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T17:43:00.413438] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T17:43:00.558839] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-14T17:43:01.093500] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:43:01.358831] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-14T17:43:02.158851] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-14T17:43:02.877857] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-14T17:43:02.958819] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-14T17:43:03.277662] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:43:03.355102] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T17:43:03.758843] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-14T17:43:04.216454] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T17:43:04.558809] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-14T17:43:04.623149] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:43:05.358846] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-14T17:43:06.150244] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:43:06.160350] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-14T17:43:06.593301] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:43:06.958856] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-14T17:43:07.138563] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T17:43:07.758842] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-14T17:43:08.208360] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:43:08.558836] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-14T17:43:09.358832] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-14T17:43:09.575869] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T17:43:10.158837] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-14T17:43:10.400870] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T17:43:10.451300] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:43:10.958826] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-14T17:43:11.559190] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:43:11.758839] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-14T17:43:12.558865] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-14T17:43:13.072195] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-14T17:43:13.358840] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-14T17:43:13.606863] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T17:43:13.641710] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:43:14.158827] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-14T17:43:14.849574] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T17:43:14.851803] [INFO ] [REMOTE ] DKL: Full fetch complete (22236 records). [2025-09-14T17:43:14.851898] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-14T17:43:14.961532] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-14T17:43:15.260049] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-14T17:43:15.260348] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-14T17:43:15.261235] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-14T17:43:15.261309] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-14T17:43:15.262787] [DEBUG] [LOCAL ] DKL: Trimmed 22236 records to 13168 (keeping 150 days of data) [2025-09-14T17:43:15.360472] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T17:43:15.390821] [DEBUG] [LOCAL ] DKL: Primary data saved (13168 records). [2025-09-14T17:43:15.391081] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-14T17:43:15.391225] [INFO ] [MAIN ] Update Progress: 626/2370 symbols completed. DKL took 23.9s. Estimated remaining: 3h 4m 3s. Rate: 9.5 symbols/min [2025-09-14T17:43:15.602403] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:15.607783] [DEBUG] [LOCAL ] DLNG: Loaded 2227 existing records from primary storage. [2025-09-14T17:43:15.607996] [INFO ] [MAIN ] DLNG: Loaded 2227 existing records. [2025-09-14T17:43:15.770307] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-14T17:43:15.792587] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:15.793692] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-14T17:43:15.793778] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-14T17:43:15.794075] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-14T17:43:15.794156] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-14T17:43:16.154948] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:16.461092] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:43:16.558833] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-14T17:43:17.358834] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-14T17:43:17.662997] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T17:43:18.118954] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:43:18.158802] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-14T17:43:18.958834] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-14T17:43:19.028681] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:43:19.758829] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-14T17:43:19.787062] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T17:43:19.942766] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T17:43:20.558830] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-14T17:43:21.330160] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T17:43:21.340448] [INFO ] [REMOTE ] DK: Full fetch complete (53678 records). [2025-09-14T17:43:21.341179] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T17:43:21.341258] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-14T17:43:21.364380] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-14T17:43:21.734468] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-14T17:43:21.734736] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-14T17:43:21.735607] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-14T17:43:21.735883] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-14T17:43:21.737528] [DEBUG] [LOCAL ] DK: Trimmed 53678 records to 37241 (keeping 150 days of data) [2025-09-14T17:43:21.864815] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:43:21.895295] [INFO ] [REMOTE ] DKS: Full fetch complete (54203 records). [2025-09-14T17:43:21.915904] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-14T17:43:22.162278] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-14T17:43:22.749405] [DEBUG] [LOCAL ] DK: Primary data saved (37241 records). [2025-09-14T17:43:22.749747] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-14T17:43:22.750040] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-14T17:43:22.749957] [INFO ] [MAIN ] DK: Full history saved. [2025-09-14T17:43:22.751701] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-14T17:43:22.751827] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-14T17:43:22.752096] [INFO ] [MAIN ] Update Progress: 627/2370 symbols completed. DK took 36.2s. Estimated remaining: 3h 3m 59s. Rate: 9.5 symbols/min [2025-09-14T17:43:22.862981] [DEBUG] [LOCAL ] DKS: Trimmed 54203 records to 37372 (keeping 150 days of data) [2025-09-14T17:43:23.012560] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-14T17:43:23.129381] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:23.154525] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T17:43:23.213313] [DEBUG] [LOCAL ] DLR: Loaded 22615 existing records from primary storage. [2025-09-14T17:43:23.222424] [INFO ] [MAIN ] DLR: Loaded 22615 existing records. [2025-09-14T17:43:23.508309] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:23.513025] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-14T17:43:23.516853] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-14T17:43:23.519724] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-14T17:43:23.521458] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-14T17:43:23.526062] [DEBUG] [LOCAL ] DKS: Primary data saved (37372 records). [2025-09-14T17:43:23.582101] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-14T17:43:23.608225] [INFO ] [MAIN ] Update Progress: 628/2370 symbols completed. DKS took 26.7s. Estimated remaining: 3h 3m 38s. Rate: 9.5 symbols/min [2025-09-14T17:43:23.766803] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-14T17:43:24.019491] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:43:24.056086] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:24.080900] [INFO ] [REMOTE ] DLB: Full fetch complete (35146 records). [2025-09-14T17:43:24.153476] [INFO ] [REMOTE ] DLR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:24.153704] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-14T17:43:24.267220] [DEBUG] [LOCAL ] DLX: Loaded 12805 existing records from primary storage. [2025-09-14T17:43:24.271876] [INFO ] [MAIN ] DLX: Loaded 12805 existing records. [2025-09-14T17:43:24.565085] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-14T17:43:24.694725] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:24.716331] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-14T17:43:24.757089] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-14T17:43:24.773899] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-14T17:43:24.786723] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-14T17:43:24.788852] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-14T17:43:24.803377] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-14T17:43:24.824083] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-14T17:43:24.829534] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-14T17:43:24.916358] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T17:43:24.917961] [DEBUG] [LOCAL ] DLB: Trimmed 35146 records to 23969 (keeping 150 days of data) [2025-09-14T17:43:25.304092] [INFO ] [REMOTE ] DLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:25.360749] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-14T17:43:25.369140] [DEBUG] [LOCAL ] DLB: Primary data saved (23969 records). [2025-09-14T17:43:25.369371] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-14T17:43:25.369523] [INFO ] [MAIN ] Update Progress: 629/2370 symbols completed. DLB took 26.9s. Estimated remaining: 3h 3m 19s. Rate: 9.5 symbols/min [2025-09-14T17:43:25.555553] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:25.568246] [DEBUG] [LOCAL ] DLY: Loaded 9108 existing records from primary storage. [2025-09-14T17:43:25.568451] [INFO ] [MAIN ] DLY: Loaded 9108 existing records. [2025-09-14T17:43:25.752236] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:25.752789] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-14T17:43:25.752859] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-14T17:43:25.753384] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-14T17:43:25.753455] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-14T17:43:26.134463] [INFO ] [REMOTE ] DLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:26.158826] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-14T17:43:26.468929] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T17:43:26.540301] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:43:26.958855] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-14T17:43:27.116276] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T17:43:27.758858] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-14T17:43:28.563917] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-14T17:43:28.577557] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T17:43:28.799127] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T17:43:29.021351] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:43:29.358835] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-14T17:43:30.010369] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T17:43:30.158884] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-14T17:43:30.958877] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-14T17:43:31.569954] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T17:43:31.758868] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-14T17:43:32.047893] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:43:32.558927] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-14T17:43:33.009428] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T17:43:33.208372] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:43:33.358845] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-14T17:43:34.158842] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-14T17:43:34.352868] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:43:34.958836] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-14T17:43:35.473188] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T17:43:35.758887] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-14T17:43:35.970533] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T17:43:36.354302] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T17:43:36.355888] [INFO ] [REMOTE ] DLNG: Full fetch complete (7420 records). [2025-09-14T17:43:36.355999] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-14T17:43:36.564019] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-14T17:43:36.714697] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-14T17:43:36.714805] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-14T17:43:36.715007] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-14T17:43:36.715059] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-14T17:43:36.715486] [DEBUG] [LOCAL ] DLNG: Trimmed 7420 records to 4441 (keeping 150 days of data) [2025-09-14T17:43:36.742773] [DEBUG] [LOCAL ] DLNG: Primary data saved (4441 records). [2025-09-14T17:43:36.742920] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-14T17:43:36.743054] [INFO ] [MAIN ] Update Progress: 630/2370 symbols completed. DLNG took 21.4s. Estimated remaining: 3h 3m 26s. Rate: 9.5 symbols/min [2025-09-14T17:43:36.914330] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:36.918636] [DEBUG] [LOCAL ] DMA: Loaded 2133 existing records from primary storage. [2025-09-14T17:43:36.918759] [INFO ] [MAIN ] DMA: Loaded 2133 existing records. [2025-09-14T17:43:37.099603] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:37.099923] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-14T17:43:37.099986] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-14T17:43:37.100212] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-14T17:43:37.100270] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-14T17:43:37.366747] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-14T17:43:37.457764] [INFO ] [REMOTE ] DMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:38.158798] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-14T17:43:38.476740] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T17:43:38.511860] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T17:43:38.958807] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-14T17:43:39.274830] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:43:39.758824] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-14T17:43:40.558794] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-14T17:43:40.662852] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:43:40.973270] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T17:43:41.358867] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-14T17:43:41.819622] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:43:42.079429] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T17:43:42.158792] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-14T17:43:42.958870] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-14T17:43:43.466598] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T17:43:43.758812] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-14T17:43:43.964967] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:43:43.968128] [INFO ] [REMOTE ] DLY: Full fetch complete (20330 records). [2025-09-14T17:43:43.968233] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-14T17:43:44.282025] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T17:43:44.365250] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-14T17:43:44.365361] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-14T17:43:44.365924] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-14T17:43:44.365988] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-14T17:43:44.366658] [DEBUG] [LOCAL ] DLY: Trimmed 20330 records to 13869 (keeping 150 days of data) [2025-09-14T17:43:44.453937] [DEBUG] [LOCAL ] DLY: Primary data saved (13869 records). [2025-09-14T17:43:44.454124] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-14T17:43:44.454267] [INFO ] [MAIN ] Update Progress: 631/2370 symbols completed. DLY took 19.1s. Estimated remaining: 3h 3m 24s. Rate: 9.5 symbols/min [2025-09-14T17:43:44.600923] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-14T17:43:44.674910] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:44.683095] [DEBUG] [LOCAL ] DMB: Loaded 4860 existing records from primary storage. [2025-09-14T17:43:44.683318] [INFO ] [MAIN ] DMB: Loaded 4860 existing records. [2025-09-14T17:43:44.868850] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:44.869173] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-14T17:43:44.869269] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-14T17:43:44.869578] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-14T17:43:44.869668] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-14T17:43:45.228834] [INFO ] [REMOTE ] DMB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:45.236230] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:43:45.239202] [INFO ] [REMOTE ] DLX: Full fetch complete (32570 records). [2025-09-14T17:43:45.239289] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-14T17:43:45.363885] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-14T17:43:45.611054] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-14T17:43:45.611167] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-14T17:43:45.611788] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-14T17:43:45.611857] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-14T17:43:45.612767] [DEBUG] [LOCAL ] DLX: Trimmed 32570 records to 21803 (keeping 150 days of data) [2025-09-14T17:43:45.759275] [DEBUG] [LOCAL ] DLX: Primary data saved (21803 records). [2025-09-14T17:43:45.759459] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-14T17:43:45.759591] [INFO ] [MAIN ] Update Progress: 632/2370 symbols completed. DLX took 22.1s. Estimated remaining: 3h 3m 4s. Rate: 9.5 symbols/min [2025-09-14T17:43:45.935778] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:45.942512] [DEBUG] [LOCAL ] DMO: Loaded 4389 existing records from primary storage. [2025-09-14T17:43:45.942686] [INFO ] [MAIN ] DMO: Loaded 4389 existing records. [2025-09-14T17:43:46.121516] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:46.121799] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-14T17:43:46.121862] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-14T17:43:46.122177] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-14T17:43:46.122240] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-14T17:43:46.164361] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-14T17:43:46.487900] [INFO ] [REMOTE ] DMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:46.857358] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T17:43:46.958841] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-14T17:43:47.153518] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T17:43:47.751771] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T17:43:47.758766] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-14T17:43:48.558835] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-14T17:43:48.599089] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:43:49.043218] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:43:49.358873] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-14T17:43:50.158859] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-14T17:43:50.958812] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-14T17:43:51.029883] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T17:43:51.102996] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:43:51.718208] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:43:51.758789] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-14T17:43:52.558884] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-14T17:43:52.604011] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T17:43:53.267115] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-14T17:43:53.358791] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-14T17:43:54.158845] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-14T17:43:54.178849] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T17:43:54.958843] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-14T17:43:55.726798] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T17:43:55.758895] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-14T17:43:55.894015] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T17:43:56.558872] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-14T17:43:56.577716] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:43:57.268152] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:43:57.275719] [INFO ] [REMOTE ] DLR: Full fetch complete (55849 records). [2025-09-14T17:43:57.275946] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-14T17:43:57.364044] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-14T17:43:57.661356] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-14T17:43:57.661465] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-14T17:43:57.662210] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-14T17:43:57.662270] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-14T17:43:57.663380] [DEBUG] [LOCAL ] DLR: Trimmed 55849 records to 38217 (keeping 150 days of data) [2025-09-14T17:43:57.913887] [DEBUG] [LOCAL ] DLR: Primary data saved (38217 records). [2025-09-14T17:43:57.914115] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-14T17:43:57.914235] [INFO ] [MAIN ] Update Progress: 633/2370 symbols completed. DLR took 35.2s. Estimated remaining: 3h 3m 13s. Rate: 9.5 symbols/min [2025-09-14T17:43:57.992554] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T17:43:58.087926] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:58.111399] [DEBUG] [LOCAL ] DNA: Loaded 21739 existing records from primary storage. [2025-09-14T17:43:58.111573] [INFO ] [MAIN ] DNA: Loaded 21739 existing records. [2025-09-14T17:43:58.165637] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-14T17:43:58.292272] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:58.292596] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-14T17:43:58.292700] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-14T17:43:58.293415] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-14T17:43:58.293480] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-14T17:43:58.640802] [INFO ] [REMOTE ] DNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:58.958867] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-14T17:43:59.044694] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:43:59.592972] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T17:43:59.758855] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-14T17:44:00.531412] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:44:00.533336] [INFO ] [REMOTE ] DMB: Full fetch complete (10769 records). [2025-09-14T17:44:00.533426] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-14T17:44:00.564057] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-14T17:44:00.911901] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-14T17:44:00.912010] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-14T17:44:00.912269] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-14T17:44:00.912320] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-14T17:44:00.912820] [DEBUG] [LOCAL ] DMB: Trimmed 10769 records to 8087 (keeping 150 days of data) [2025-09-14T17:44:00.961790] [DEBUG] [LOCAL ] DMB: Primary data saved (8087 records). [2025-09-14T17:44:00.961940] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-14T17:44:00.962038] [INFO ] [MAIN ] Update Progress: 634/2370 symbols completed. DMB took 16.5s. Estimated remaining: 3h 2m 58s. Rate: 9.5 symbols/min [2025-09-14T17:44:01.129092] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:01.148670] [DEBUG] [LOCAL ] DNOW: Loaded 19765 existing records from primary storage. [2025-09-14T17:44:01.148851] [INFO ] [MAIN ] DNOW: Loaded 19765 existing records. [2025-09-14T17:44:01.324720] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:01.325075] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-14T17:44:01.328990] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-14T17:44:01.329551] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T17:44:01.331063] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-14T17:44:01.331454] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-14T17:44:01.363872] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-14T17:44:01.693986] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:02.158865] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-14T17:44:02.799565] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:44:02.800872] [INFO ] [REMOTE ] DMA: Full fetch complete (5011 records). [2025-09-14T17:44:02.800957] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-14T17:44:02.971419] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-14T17:44:03.155581] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-14T17:44:03.155706] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-14T17:44:03.155904] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-14T17:44:03.155958] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-14T17:44:03.156371] [DEBUG] [LOCAL ] DMA: Trimmed 5011 records to 3632 (keeping 150 days of data) [2025-09-14T17:44:03.179965] [DEBUG] [LOCAL ] DMA: Primary data saved (3632 records). [2025-09-14T17:44:03.180088] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-14T17:44:03.180180] [INFO ] [MAIN ] Update Progress: 635/2370 symbols completed. DMA took 26.4s. Estimated remaining: 3h 2m 41s. Rate: 9.5 symbols/min [2025-09-14T17:44:03.347513] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:03.364297] [DEBUG] [LOCAL ] DNP: Loaded 14415 existing records from primary storage. [2025-09-14T17:44:03.364481] [INFO ] [MAIN ] DNP: Loaded 14415 existing records. [2025-09-14T17:44:03.540896] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:03.541284] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-14T17:44:03.541411] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-14T17:44:03.551546] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-14T17:44:03.564840] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-14T17:44:03.645081] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-14T17:44:03.765766] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-14T17:44:03.930766] [INFO ] [REMOTE ] DNP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:03.937278] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T17:44:04.558836] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-14T17:44:05.289893] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:44:05.358787] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-14T17:44:05.386996] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:44:06.158841] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-14T17:44:06.875236] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:44:06.958882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-14T17:44:07.758795] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-14T17:44:07.790632] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:44:08.558831] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-14T17:44:08.709394] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:44:09.250963] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T17:44:09.358825] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-14T17:44:09.397094] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T17:44:10.158827] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-14T17:44:10.922320] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:44:10.958815] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-14T17:44:11.758867] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-14T17:44:11.915896] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T17:44:12.042596] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T17:44:12.558849] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-14T17:44:13.262450] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T17:44:13.274876] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:44:13.276356] [INFO ] [REMOTE ] DMO: Full fetch complete (10517 records). [2025-09-14T17:44:13.276466] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-14T17:44:13.363956] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-14T17:44:13.649489] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-14T17:44:13.649602] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-14T17:44:13.649923] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-14T17:44:13.649994] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-14T17:44:13.650552] [DEBUG] [LOCAL ] DMO: Trimmed 10517 records to 7071 (keeping 150 days of data) [2025-09-14T17:44:13.698536] [DEBUG] [LOCAL ] DMO: Primary data saved (7071 records). [2025-09-14T17:44:13.698770] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-14T17:44:13.698892] [INFO ] [MAIN ] Update Progress: 636/2370 symbols completed. DMO took 27.9s. Estimated remaining: 3h 2m 46s. Rate: 9.5 symbols/min [2025-09-14T17:44:13.878871] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:13.904576] [DEBUG] [LOCAL ] DOC: Loaded 24019 existing records from primary storage. [2025-09-14T17:44:13.904792] [INFO ] [MAIN ] DOC: Loaded 24019 existing records. [2025-09-14T17:44:14.078699] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:14.078963] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-14T17:44:14.079027] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-14T17:44:14.079782] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-14T17:44:14.079849] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-14T17:44:14.169127] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-14T17:44:14.430020] [INFO ] [REMOTE ] DOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:14.958868] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-14T17:44:15.389018] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-14T17:44:15.741041] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:44:15.758765] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-14T17:44:16.383062] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T17:44:16.558823] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-14T17:44:17.036457] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:44:17.358837] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-14T17:44:18.010601] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T17:44:18.158824] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-14T17:44:18.645078] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T17:44:18.958817] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-14T17:44:19.758836] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-14T17:44:20.105779] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T17:44:20.542930] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:44:20.558779] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-14T17:44:21.177025] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T17:44:21.358823] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-14T17:44:22.104111] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:44:22.158801] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-14T17:44:22.958773] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-14T17:44:23.463700] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:44:23.758832] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-14T17:44:24.032871] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:44:24.473785] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:44:24.558834] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-14T17:44:24.744609] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:44:25.358837] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-14T17:44:26.158821] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-14T17:44:26.364610] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T17:44:26.387767] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T17:44:26.391475] [INFO ] [REMOTE ] DNP: Full fetch complete (36392 records). [2025-09-14T17:44:26.391580] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-14T17:44:26.760031] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-14T17:44:26.760140] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-14T17:44:26.760727] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-14T17:44:26.760796] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-14T17:44:26.761813] [DEBUG] [LOCAL ] DNP: Trimmed 36392 records to 24884 (keeping 150 days of data) [2025-09-14T17:44:26.918853] [DEBUG] [LOCAL ] DNP: Primary data saved (24884 records). [2025-09-14T17:44:26.919034] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-14T17:44:26.919139] [INFO ] [MAIN ] Update Progress: 637/2370 symbols completed. DNP took 23.7s. Estimated remaining: 3h 2m 58s. Rate: 9.5 symbols/min [2025-09-14T17:44:26.958799] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-14T17:44:27.758857] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-14T17:44:28.075497] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T17:44:28.231067] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:44:28.235515] [INFO ] [REMOTE ] DNOW: Full fetch complete (47501 records). [2025-09-14T17:44:28.235636] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-14T17:44:28.565394] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-14T17:44:28.616483] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-14T17:44:28.616686] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-14T17:44:28.617560] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-14T17:44:28.617703] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-14T17:44:28.619061] [DEBUG] [LOCAL ] DNOW: Trimmed 47501 records to 32346 (keeping 150 days of data) [2025-09-14T17:44:28.756037] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:44:28.852249] [DEBUG] [LOCAL ] DNOW: Primary data saved (32346 records). [2025-09-14T17:44:28.852434] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-14T17:44:28.852552] [INFO ] [MAIN ] Update Progress: 638/2370 symbols completed. DNOW took 27.9s. Estimated remaining: 3h 2m 40s. Rate: 9.5 symbols/min [2025-09-14T17:44:29.358882] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-14T17:44:30.229591] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T17:44:30.234840] [INFO ] [REMOTE ] DNA: Full fetch complete (53206 records). [2025-09-14T17:44:30.234990] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-14T17:44:30.638368] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-14T17:44:30.638488] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-14T17:44:30.639203] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-14T17:44:30.639262] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-14T17:44:30.640449] [DEBUG] [LOCAL ] DNA: Trimmed 53206 records to 36266 (keeping 150 days of data) [2025-09-14T17:44:30.854056] [DEBUG] [LOCAL ] DNA: Primary data saved (36266 records). [2025-09-14T17:44:30.854244] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-14T17:44:30.854342] [INFO ] [MAIN ] Update Progress: 639/2370 symbols completed. DNA took 32.9s. Estimated remaining: 3h 2m 22s. Rate: 9.5 symbols/min [2025-09-14T17:44:31.375352] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T17:44:31.388296] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-14T17:44:33.285088] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:44:33.303360] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-14T17:44:33.598681] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T17:44:33.605112] [INFO ] [REMOTE ] DOC: Full fetch complete (58180 records). [2025-09-14T17:44:33.605344] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-14T17:44:34.161500] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-14T17:44:34.161729] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-14T17:44:34.163272] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-14T17:44:34.163384] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-14T17:44:34.165309] [DEBUG] [LOCAL ] DOC: Trimmed 58180 records to 40314 (keeping 150 days of data) [2025-09-14T17:44:34.515209] [DEBUG] [LOCAL ] DOC: Primary data saved (40314 records). [2025-09-14T17:44:34.515407] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-14T17:44:34.515568] [INFO ] [MAIN ] Update Progress: 640/2370 symbols completed. DOC took 20.8s. Estimated remaining: 3h 2m 8s. Rate: 9.5 symbols/min [2025-09-14T17:44:35.127527] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:35.173027] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:35.201005] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:35.226344] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:35.269557] [DEBUG] [LOCAL ] DOCS: Loaded 22275 existing records from primary storage. [2025-09-14T17:44:35.270517] [INFO ] [MAIN ] DOCS: Loaded 22275 existing records. [2025-09-14T17:44:35.270419] [DEBUG] [LOCAL ] DOLE: Loaded 16980 existing records from primary storage. [2025-09-14T17:44:35.270079] [DEBUG] [LOCAL ] DOUG: Loaded 15055 existing records from primary storage. [2025-09-14T17:44:35.270772] [INFO ] [MAIN ] DOLE: Loaded 16980 existing records. [2025-09-14T17:44:35.276243] [INFO ] [MAIN ] DOUG: Loaded 15055 existing records. [2025-09-14T17:44:35.553889] [DEBUG] [LOCAL ] DOCN: Loaded 22968 existing records from primary storage. [2025-09-14T17:44:35.606109] [INFO ] [MAIN ] DOCN: Loaded 22968 existing records. [2025-09-14T17:44:35.744531] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:35.824293] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-14T17:44:35.912355] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:35.912590] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-14T17:44:35.950406] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-14T17:44:35.950289] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:35.960975] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-14T17:44:35.972040] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-14T17:44:35.983637] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-14T17:44:35.988881] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-14T17:44:35.998442] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-14T17:44:35.998498] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-14T17:44:35.994201] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-14T17:44:36.164374] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-14T17:44:36.242228] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-14T17:44:36.327749] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:36.516363] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-14T17:44:36.574048] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-14T17:44:36.788020] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-14T17:44:36.873531] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-14T17:44:37.207096] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:37.234291] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:37.285539] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-14T17:44:37.286022] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-14T17:44:37.559065] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:37.564210] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-14T17:44:37.642853] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:37.643182] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-14T17:44:38.663126] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:44:38.670607] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-14T17:44:38.994304] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T17:44:39.001511] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-14T17:44:39.248442] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:44:39.258419] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-14T17:44:39.286032] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T17:44:39.296271] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-14T17:44:40.100336] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:44:40.108136] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-14T17:44:40.188975] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T17:44:40.204498] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-14T17:44:40.936726] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T17:44:40.947414] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-14T17:44:41.122292] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:44:41.133820] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-14T17:44:41.500261] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T17:44:41.508620] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-14T17:44:41.571600] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:44:42.159016] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-14T17:44:42.468464] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:44:42.778533] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T17:44:42.958837] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-14T17:44:43.014703] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:44:43.687493] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T17:44:43.758847] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-14T17:44:44.520278] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T17:44:44.558776] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-14T17:44:45.358840] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-14T17:44:45.667583] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:44:46.158814] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-14T17:44:46.301625] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:44:46.911623] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T17:44:46.958847] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-14T17:44:47.201097] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T17:44:47.758829] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-14T17:44:48.445668] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:44:48.558817] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-14T17:44:49.358871] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-14T17:44:49.514049] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T17:44:50.078846] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T17:44:50.158779] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-14T17:44:50.848348] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:44:50.958775] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-14T17:44:51.758847] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-14T17:44:52.054515] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:44:52.303847] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T17:44:52.558828] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-14T17:44:52.916409] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:44:53.203985] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:44:53.210755] [INFO ] [REMOTE ] DOCN: Full fetch complete (54659 records). [2025-09-14T17:44:53.210994] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-14T17:44:53.365912] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-14T17:44:53.586249] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-14T17:44:53.586357] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-14T17:44:53.587094] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-14T17:44:53.587155] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-14T17:44:53.588332] [DEBUG] [LOCAL ] DOCN: Trimmed 54659 records to 38164 (keeping 150 days of data) [2025-09-14T17:44:53.819993] [DEBUG] [LOCAL ] DOCN: Primary data saved (38164 records). [2025-09-14T17:44:53.820407] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-14T17:44:53.820590] [INFO ] [MAIN ] Update Progress: 641/2370 symbols completed. DOCN took 19.3s. Estimated remaining: 3h 2m 37s. Rate: 9.5 symbols/min [2025-09-14T17:44:53.987673] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:54.008435] [DEBUG] [LOCAL ] DOV: Loaded 20083 existing records from primary storage. [2025-09-14T17:44:54.008619] [INFO ] [MAIN ] DOV: Loaded 20083 existing records. [2025-09-14T17:44:54.161285] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-14T17:44:54.182473] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:54.182760] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-14T17:44:54.182825] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-14T17:44:54.183582] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-14T17:44:54.183669] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-14T17:44:54.527771] [INFO ] [REMOTE ] DOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:54.794124] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T17:44:54.799683] [INFO ] [REMOTE ] DOLE: Full fetch complete (40361 records). [2025-09-14T17:44:54.799943] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-14T17:44:54.965398] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-14T17:44:55.184616] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-14T17:44:55.184895] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-14T17:44:55.185571] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-14T17:44:55.185728] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-14T17:44:55.194834] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T17:44:55.199119] [INFO ] [REMOTE ] DOUG: Full fetch complete (37989 records). [2025-09-14T17:44:55.199249] [DEBUG] [LOCAL ] DOLE: Trimmed 40361 records to 28724 (keeping 150 days of data) [2025-09-14T17:44:55.199377] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-14T17:44:55.702054] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-14T17:44:55.706316] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-14T17:44:55.707098] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-14T17:44:55.729247] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-14T17:44:55.751451] [DEBUG] [LOCAL ] DOUG: Trimmed 37989 records to 26246 (keeping 150 days of data) [2025-09-14T17:44:55.758961] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-14T17:44:55.851426] [DEBUG] [LOCAL ] DOLE: Primary data saved (28724 records). [2025-09-14T17:44:55.855888] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-14T17:44:55.864857] [INFO ] [MAIN ] Update Progress: 642/2370 symbols completed. DOLE took 21.3s. Estimated remaining: 3h 2m 19s. Rate: 9.5 symbols/min [2025-09-14T17:44:56.042788] [DEBUG] [LOCAL ] DOUG: Primary data saved (26246 records). [2025-09-14T17:44:56.071900] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-14T17:44:56.088757] [INFO ] [MAIN ] Update Progress: 643/2370 symbols completed. DOUG took 21.6s. Estimated remaining: 3h 1m 56s. Rate: 9.5 symbols/min [2025-09-14T17:44:56.090074] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:56.270344] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:56.280883] [DEBUG] [LOCAL ] DOW: Loaded 24143 existing records from primary storage. [2025-09-14T17:44:56.283190] [INFO ] [MAIN ] DOW: Loaded 24143 existing records. [2025-09-14T17:44:56.377983] [DEBUG] [LOCAL ] DPG: Loaded 5995 existing records from primary storage. [2025-09-14T17:44:56.388626] [INFO ] [MAIN ] DPG: Loaded 5995 existing records. [2025-09-14T17:44:56.538588] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:56.612423] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-14T17:44:56.612828] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-14T17:44:56.618982] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-14T17:44:56.645021] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-14T17:44:56.751578] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:56.815509] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-14T17:44:56.828739] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-14T17:44:56.898779] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-14T17:44:56.935110] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-14T17:44:57.147343] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T17:44:57.223233] [INFO ] [REMOTE ] DOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:57.248127] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-14T17:44:57.379450] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-14T17:44:57.515835] [INFO ] [REMOTE ] DPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:57.675379] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T17:44:58.158873] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-14T17:44:58.740001] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T17:44:58.958843] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-14T17:44:58.997341] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:44:59.100604] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:44:59.758844] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-14T17:44:59.894870] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T17:45:00.558851] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-14T17:45:01.358954] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-14T17:45:02.158871] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-14T17:45:02.283153] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-14T17:45:02.465298] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T17:45:02.958896] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-14T17:45:03.758900] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-14T17:45:04.664549] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (3.31 seconds). [2025-09-14T17:45:04.676952] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-14T17:45:05.199834] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-09-14T17:45:05.358859] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-14T17:45:05.557410] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:45:05.562582] [INFO ] [REMOTE ] DOCS: Full fetch complete (56131 records). [2025-09-14T17:45:05.562749] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-14T17:45:05.946342] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-14T17:45:05.946449] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-14T17:45:05.947209] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-14T17:45:05.947268] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-14T17:45:05.948419] [DEBUG] [LOCAL ] DOCS: Trimmed 56131 records to 38355 (keeping 150 days of data) [2025-09-14T17:45:06.206841] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-09-14T17:45:06.224890] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-14T17:45:06.239838] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T17:45:06.250194] [DEBUG] [LOCAL ] DOCS: Primary data saved (38355 records). [2025-09-14T17:45:06.250864] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-14T17:45:06.251410] [INFO ] [MAIN ] Update Progress: 644/2370 symbols completed. DOCS took 31.7s. Estimated remaining: 3h 2m 0s. Rate: 9.5 symbols/min [2025-09-14T17:45:06.424799] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:06.464326] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-14T17:45:06.484797] [DEBUG] [LOCAL ] DQ: Loaded 20624 existing records from primary storage. [2025-09-14T17:45:06.485010] [INFO ] [MAIN ] DQ: Loaded 20624 existing records. [2025-09-14T17:45:06.663922] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:06.664191] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-14T17:45:06.664267] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-14T17:45:06.664924] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-14T17:45:06.665004] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-14T17:45:06.963960] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-14T17:45:07.017137] [INFO ] [REMOTE ] DQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:07.758911] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-14T17:45:07.981869] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T17:45:08.558848] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-14T17:45:08.876913] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:45:09.341129] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:45:09.358774] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-14T17:45:09.542303] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T17:45:10.038265] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T17:45:10.158831] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-14T17:45:10.958831] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-14T17:45:11.758812] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-14T17:45:11.822919] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T17:45:12.558841] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-14T17:45:12.725736] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T17:45:13.029834] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T17:45:13.358839] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-14T17:45:14.158901] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-14T17:45:14.219019] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:45:14.958875] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-14T17:45:15.758812] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-14T17:45:15.963348] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-14T17:45:16.095998] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-14T17:45:16.098159] [INFO ] [REMOTE ] DPG: Full fetch complete (14329 records). [2025-09-14T17:45:16.098255] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-14T17:45:16.468456] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-14T17:45:16.468562] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-14T17:45:16.468944] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-14T17:45:16.468999] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-14T17:45:16.469511] [DEBUG] [LOCAL ] DPG: Trimmed 14329 records to 9966 (keeping 150 days of data) [2025-09-14T17:45:16.531482] [DEBUG] [LOCAL ] DPG: Primary data saved (9966 records). [2025-09-14T17:45:16.531666] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-14T17:45:16.531769] [INFO ] [MAIN ] Update Progress: 645/2370 symbols completed. DPG took 20.4s. Estimated remaining: 3h 2m 5s. Rate: 9.5 symbols/min [2025-09-14T17:45:16.563924] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-14T17:45:16.704195] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:16.722324] [DEBUG] [LOCAL ] DRD: Loaded 16385 existing records from primary storage. [2025-09-14T17:45:16.722507] [INFO ] [MAIN ] DRD: Loaded 16385 existing records. [2025-09-14T17:45:16.902187] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:16.902537] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-14T17:45:16.902603] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-14T17:45:16.903150] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-14T17:45:16.903215] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-14T17:45:17.260120] [INFO ] [REMOTE ] DRD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:17.366527] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-14T17:45:17.369125] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:45:17.445528] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T17:45:18.158842] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-14T17:45:18.444997] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:45:18.539737] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:45:18.958877] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-14T17:45:19.464973] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T17:45:19.623713] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:45:19.629342] [INFO ] [REMOTE ] DOW: Full fetch complete (58411 records). [2025-09-14T17:45:19.629482] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-14T17:45:19.769808] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-14T17:45:20.018044] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-14T17:45:20.018161] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-14T17:45:20.018943] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-14T17:45:20.019013] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-14T17:45:20.020281] [DEBUG] [LOCAL ] DOW: Trimmed 58411 records to 40473 (keeping 150 days of data) [2025-09-14T17:45:20.271627] [DEBUG] [LOCAL ] DOW: Primary data saved (40473 records). [2025-09-14T17:45:20.271801] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-14T17:45:20.271892] [INFO ] [MAIN ] Update Progress: 646/2370 symbols completed. DOW took 24.4s. Estimated remaining: 3h 1m 51s. Rate: 9.5 symbols/min [2025-09-14T17:45:20.440495] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:20.465343] [DEBUG] [LOCAL ] DRH: Loaded 22429 existing records from primary storage. [2025-09-14T17:45:20.465556] [INFO ] [MAIN ] DRH: Loaded 22429 existing records. [2025-09-14T17:45:20.567718] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-14T17:45:20.649286] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:20.649556] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-14T17:45:20.649623] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-14T17:45:20.650226] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-14T17:45:20.650298] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-14T17:45:21.003620] [INFO ] [REMOTE ] DRH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:21.358818] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-14T17:45:21.620029] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T17:45:22.158822] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-14T17:45:22.379325] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:45:22.959849] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-14T17:45:22.959740] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T17:45:23.430114] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:45:23.435095] [INFO ] [REMOTE ] DOV: Full fetch complete (49600 records). [2025-09-14T17:45:23.435333] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-14T17:45:23.778108] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-14T17:45:23.869553] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-14T17:45:23.869863] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-14T17:45:23.870675] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-14T17:45:23.870773] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-14T17:45:23.872236] [DEBUG] [LOCAL ] DOV: Trimmed 49600 records to 33991 (keeping 150 days of data) [2025-09-14T17:45:24.001532] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T17:45:24.129326] [DEBUG] [LOCAL ] DOV: Primary data saved (33991 records). [2025-09-14T17:45:24.129506] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-14T17:45:24.129611] [INFO ] [MAIN ] Update Progress: 647/2370 symbols completed. DOV took 30.3s. Estimated remaining: 3h 1m 38s. Rate: 9.5 symbols/min [2025-09-14T17:45:24.298458] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:24.318883] [DEBUG] [LOCAL ] DRI: Loaded 20687 existing records from primary storage. [2025-09-14T17:45:24.319035] [INFO ] [MAIN ] DRI: Loaded 20687 existing records. [2025-09-14T17:45:24.503429] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:24.503761] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-14T17:45:24.503830] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-14T17:45:24.504467] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-14T17:45:24.504532] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-14T17:45:24.568686] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-14T17:45:24.858529] [INFO ] [REMOTE ] DRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:25.358834] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-14T17:45:25.404508] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:45:26.158883] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-14T17:45:26.269470] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T17:45:26.278140] [INFO ] [REMOTE ] DQ: Full fetch complete (47303 records). [2025-09-14T17:45:26.278399] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-14T17:45:26.881789] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-14T17:45:26.881978] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-14T17:45:26.883487] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-14T17:45:26.883609] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-14T17:45:26.885487] [DEBUG] [LOCAL ] DQ: Trimmed 47303 records to 31915 (keeping 150 days of data) [2025-09-14T17:45:26.963382] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-14T17:45:27.151785] [DEBUG] [LOCAL ] DQ: Primary data saved (31915 records). [2025-09-14T17:45:27.151984] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-14T17:45:27.152092] [INFO ] [MAIN ] Update Progress: 648/2370 symbols completed. DQ took 20.9s. Estimated remaining: 3h 1m 23s. Rate: 9.5 symbols/min [2025-09-14T17:45:27.326958] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:27.332882] [DEBUG] [LOCAL ] DRLL: Loaded 3741 existing records from primary storage. [2025-09-14T17:45:27.333008] [INFO ] [MAIN ] DRLL: Loaded 3741 existing records. [2025-09-14T17:45:27.511500] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:27.511792] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-14T17:45:27.511852] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-14T17:45:27.512145] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-14T17:45:27.512203] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-14T17:45:27.879524] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:27.879931] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-14T17:45:27.910010] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-14T17:45:28.191750] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T17:45:28.558831] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-14T17:45:28.791994] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T17:45:29.358812] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-14T17:45:29.416484] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-14T17:45:30.162702] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-14T17:45:30.168415] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T17:45:30.317592] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T17:45:30.958855] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-14T17:45:31.758955] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-14T17:45:32.027972] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:45:32.453819] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T17:45:32.558876] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-14T17:45:33.358924] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-14T17:45:33.481349] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T17:45:33.502321] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T17:45:34.158908] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-14T17:45:34.840797] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:45:34.958876] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-14T17:45:35.758888] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-14T17:45:35.872439] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T17:45:36.560834] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-14T17:45:36.563747] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T17:45:36.593104] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:45:37.358847] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-14T17:45:38.158899] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-14T17:45:38.334566] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:45:38.892000] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:45:38.958834] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-14T17:45:39.758844] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-14T17:45:39.914023] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:45:40.566197] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-14T17:45:40.579657] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T17:45:40.580981] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:45:41.358854] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-14T17:45:42.143965] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T17:45:42.158832] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-14T17:45:42.387491] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:45:42.943064] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T17:45:42.958781] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-14T17:45:43.632991] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:45:43.634462] [INFO ] [REMOTE ] DRLL: Full fetch complete (11182 records). [2025-09-14T17:45:43.634546] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-14T17:45:43.763918] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-14T17:45:44.002276] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-14T17:45:44.002390] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-14T17:45:44.002783] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-14T17:45:44.002853] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-14T17:45:44.003491] [DEBUG] [LOCAL ] DRLL: Trimmed 11182 records to 6601 (keeping 150 days of data) [2025-09-14T17:45:44.044804] [DEBUG] [LOCAL ] DRLL: Primary data saved (6601 records). [2025-09-14T17:45:44.044984] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-14T17:45:44.045121] [INFO ] [MAIN ] Update Progress: 649/2370 symbols completed. DRLL took 16.9s. Estimated remaining: 3h 1m 45s. Rate: 9.5 symbols/min [2025-09-14T17:45:44.215721] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:44.233173] [DEBUG] [LOCAL ] DSL: Loaded 13007 existing records from primary storage. [2025-09-14T17:45:44.233427] [INFO ] [MAIN ] DSL: Loaded 13007 existing records. [2025-09-14T17:45:44.414509] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:44.414808] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-14T17:45:44.414872] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-14T17:45:44.415397] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-14T17:45:44.415499] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-14T17:45:44.564041] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-14T17:45:44.780335] [INFO ] [REMOTE ] DSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:45.353766] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:45:45.363872] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-14T17:45:46.065466] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T17:45:46.070488] [INFO ] [REMOTE ] DRD: Full fetch complete (38515 records). [2025-09-14T17:45:46.070605] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-14T17:45:46.166033] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-14T17:45:46.448195] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-14T17:45:46.448311] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-14T17:45:46.448945] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-14T17:45:46.449003] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-14T17:45:46.450167] [DEBUG] [LOCAL ] DRD: Trimmed 38515 records to 26676 (keeping 150 days of data) [2025-09-14T17:45:46.631903] [DEBUG] [LOCAL ] DRD: Primary data saved (26676 records). [2025-09-14T17:45:46.632018] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-14T17:45:46.631811] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:45:46.637978] [INFO ] [MAIN ] Update Progress: 650/2370 symbols completed. DRD took 30.1s. Estimated remaining: 3h 1m 29s. Rate: 9.5 symbols/min [2025-09-14T17:45:46.812165] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:46.819637] [DEBUG] [LOCAL ] DSM: Loaded 5911 existing records from primary storage. [2025-09-14T17:45:46.819793] [INFO ] [MAIN ] DSM: Loaded 5911 existing records. [2025-09-14T17:45:46.964370] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-14T17:45:47.002593] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:47.003561] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-14T17:45:47.003626] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-14T17:45:47.003974] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-14T17:45:47.004048] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-14T17:45:47.360704] [INFO ] [REMOTE ] DSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:47.687042] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:45:47.758839] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-14T17:45:48.120625] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:45:48.413957] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:45:48.419857] [INFO ] [REMOTE ] DRH: Full fetch complete (54405 records). [2025-09-14T17:45:48.419996] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-14T17:45:48.570548] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-14T17:45:48.821056] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-14T17:45:48.821163] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-14T17:45:48.821985] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-14T17:45:48.822046] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-14T17:45:48.824106] [DEBUG] [LOCAL ] DRH: Trimmed 54405 records to 37808 (keeping 150 days of data) [2025-09-14T17:45:49.048421] [DEBUG] [LOCAL ] DRH: Primary data saved (37808 records). [2025-09-14T17:45:49.048607] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-14T17:45:49.048769] [INFO ] [MAIN ] Update Progress: 651/2370 symbols completed. DRH took 28.8s. Estimated remaining: 3h 1m 12s. Rate: 9.5 symbols/min [2025-09-14T17:45:49.223394] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:49.226065] [DEBUG] [LOCAL ] DSMC: Loaded 681 existing records from primary storage. [2025-09-14T17:45:49.226157] [INFO ] [MAIN ] DSMC: Loaded 681 existing records. [2025-09-14T17:45:49.363938] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-14T17:45:49.420228] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:49.421284] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-14T17:45:49.421357] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-14T17:45:49.421578] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-14T17:45:49.421637] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-14T17:45:49.774091] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:50.158862] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-14T17:45:50.266981] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:45:50.824067] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T17:45:50.958793] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-14T17:45:51.142461] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T17:45:51.758845] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-14T17:45:52.160410] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T17:45:52.243709] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:45:52.558833] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-14T17:45:53.358798] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-14T17:45:53.436080] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:45:54.158798] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-14T17:45:54.539927] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T17:45:54.958794] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-14T17:45:55.296986] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T17:45:55.519427] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-14T17:45:55.758848] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-14T17:45:56.168330] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:45:56.175083] [INFO ] [REMOTE ] DRI: Full fetch complete (52006 records). [2025-09-14T17:45:56.175275] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-14T17:45:56.565581] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-14T17:45:56.582388] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-14T17:45:56.583847] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-14T17:45:56.584544] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-14T17:45:56.584745] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-14T17:45:56.586069] [DEBUG] [LOCAL ] DRI: Trimmed 52006 records to 35431 (keeping 150 days of data) [2025-09-14T17:45:56.812903] [DEBUG] [LOCAL ] DRI: Primary data saved (35431 records). [2025-09-14T17:45:56.813068] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-14T17:45:56.813224] [INFO ] [MAIN ] Update Progress: 652/2370 symbols completed. DRI took 32.7s. Estimated remaining: 3h 1m 10s. Rate: 9.5 symbols/min [2025-09-14T17:45:56.983225] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:56.994809] [DEBUG] [LOCAL ] DSU: Loaded 9890 existing records from primary storage. [2025-09-14T17:45:56.994954] [INFO ] [MAIN ] DSU: Loaded 9890 existing records. [2025-09-14T17:45:57.170580] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:57.170862] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-14T17:45:57.170922] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-14T17:45:57.171278] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-14T17:45:57.171337] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-14T17:45:57.365119] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-14T17:45:57.555794] [INFO ] [REMOTE ] DSU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:57.564880] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:45:57.981449] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T17:45:58.158844] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-14T17:45:58.958859] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-14T17:45:59.334135] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:45:59.693879] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T17:45:59.758798] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-14T17:46:00.188978] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-14T17:46:00.558829] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-14T17:46:01.358840] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-14T17:46:01.422543] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T17:46:01.766961] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-14T17:46:02.158832] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-14T17:46:02.958798] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-14T17:46:03.237456] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T17:46:03.694143] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T17:46:03.758866] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-14T17:46:04.378325] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:46:04.380232] [INFO ] [REMOTE ] DSM: Full fetch complete (18106 records). [2025-09-14T17:46:04.380325] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-14T17:46:04.571065] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-14T17:46:04.763612] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-14T17:46:04.763737] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-14T17:46:04.764138] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-14T17:46:04.764192] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-14T17:46:04.764782] [DEBUG] [LOCAL ] DSM: Trimmed 18106 records to 10547 (keeping 150 days of data) [2025-09-14T17:46:04.832812] [DEBUG] [LOCAL ] DSM: Primary data saved (10547 records). [2025-09-14T17:46:04.832990] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-14T17:46:04.833116] [INFO ] [MAIN ] Update Progress: 653/2370 symbols completed. DSM took 18.2s. Estimated remaining: 3h 1m 8s. Rate: 9.5 symbols/min [2025-09-14T17:46:05.001659] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:05.015483] [DEBUG] [LOCAL ] DSX: Loaded 10867 existing records from primary storage. [2025-09-14T17:46:05.015658] [INFO ] [MAIN ] DSX: Loaded 10867 existing records. [2025-09-14T17:46:05.189014] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:05.189268] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-14T17:46:05.189328] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-14T17:46:05.189792] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-14T17:46:05.189855] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-14T17:46:05.361717] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-14T17:46:05.554519] [INFO ] [REMOTE ] DSX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:05.925719] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T17:46:05.944353] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:46:06.158853] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-14T17:46:06.958821] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-14T17:46:07.624793] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T17:46:07.758844] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-14T17:46:08.077438] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T17:46:08.233057] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T17:46:08.558840] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-14T17:46:09.358843] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-14T17:46:09.683047] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T17:46:10.158834] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-14T17:46:10.408762] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T17:46:10.958789] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-14T17:46:11.259267] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T17:46:11.262435] [INFO ] [REMOTE ] DSL: Full fetch complete (30740 records). [2025-09-14T17:46:11.262542] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-14T17:46:11.426466] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:46:11.470199] [INFO ] [REMOTE ] DSMC: Full fetch complete (2236 records). [2025-09-14T17:46:11.527310] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-14T17:46:11.774116] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-14T17:46:11.856862] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-14T17:46:11.901545] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-14T17:46:11.921026] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-14T17:46:11.923456] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-14T17:46:11.983525] [DEBUG] [LOCAL ] DSL: Trimmed 30740 records to 20334 (keeping 150 days of data) [2025-09-14T17:46:12.003670] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-14T17:46:12.004002] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-14T17:46:12.004129] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-14T17:46:12.004206] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-14T17:46:12.004677] [DEBUG] [LOCAL ] DSMC: Trimmed 2236 records to 1241 (keeping 150 days of data) [2025-09-14T17:46:12.013858] [DEBUG] [LOCAL ] DSMC: Primary data saved (1241 records). [2025-09-14T17:46:12.079143] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-14T17:46:12.079430] [INFO ] [MAIN ] Update Progress: 654/2370 symbols completed. DSMC took 23.0s. Estimated remaining: 3h 1m 4s. Rate: 9.5 symbols/min [2025-09-14T17:46:12.288615] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:12.320997] [DEBUG] [LOCAL ] DT: Loaded 23671 existing records from primary storage. [2025-09-14T17:46:12.322417] [INFO ] [MAIN ] DT: Loaded 23671 existing records. [2025-09-14T17:46:12.430422] [DEBUG] [LOCAL ] DSL: Primary data saved (20334 records). [2025-09-14T17:46:12.470049] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-14T17:46:12.488089] [INFO ] [MAIN ] Update Progress: 655/2370 symbols completed. DSL took 28.4s. Estimated remaining: 3h 0m 42s. Rate: 9.5 symbols/min [2025-09-14T17:46:12.506692] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:12.569378] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-14T17:46:12.569559] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-14T17:46:12.608474] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-14T17:46:12.614579] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-14T17:46:12.635506] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-14T17:46:12.679121] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:12.797976] [DEBUG] [LOCAL ] DTB: Loaded 2630 existing records from primary storage. [2025-09-14T17:46:12.831550] [INFO ] [MAIN ] DTB: Loaded 2630 existing records. [2025-09-14T17:46:13.207278] [INFO ] [REMOTE ] DT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:13.211781] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:13.227080] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-14T17:46:13.227193] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-14T17:46:13.228267] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T17:46:13.233956] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-14T17:46:13.234137] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-14T17:46:13.374395] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-14T17:46:13.587633] [INFO ] [REMOTE ] DTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:13.837842] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:46:14.158859] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-14T17:46:14.958840] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-14T17:46:15.123448] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:46:15.513008] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T17:46:15.577628] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T17:46:15.758839] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-14T17:46:16.558841] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-14T17:46:16.973113] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T17:46:17.358855] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-14T17:46:18.158844] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-14T17:46:18.428674] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:46:18.580061] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:46:18.958888] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-14T17:46:19.086699] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:46:19.758897] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-14T17:46:20.380010] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T17:46:20.558840] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-14T17:46:20.763606] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T17:46:21.358822] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-14T17:46:21.627153] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T17:46:22.158830] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-14T17:46:22.958833] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-14T17:46:23.128530] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T17:46:23.212812] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:46:23.550760] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T17:46:23.758838] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-14T17:46:24.558834] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-14T17:46:24.739636] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:46:24.742490] [INFO ] [REMOTE ] DSU: Full fetch complete (23252 records). [2025-09-14T17:46:24.742630] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-14T17:46:25.041735] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T17:46:25.125058] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-14T17:46:25.125163] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-14T17:46:25.125956] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-14T17:46:25.126217] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-14T17:46:25.127247] [DEBUG] [LOCAL ] DSU: Trimmed 23252 records to 15655 (keeping 150 days of data) [2025-09-14T17:46:25.224446] [DEBUG] [LOCAL ] DSU: Primary data saved (15655 records). [2025-09-14T17:46:25.224625] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-14T17:46:25.224746] [INFO ] [MAIN ] Update Progress: 656/2370 symbols completed. DSU took 28.4s. Estimated remaining: 3h 0m 52s. Rate: 9.5 symbols/min [2025-09-14T17:46:25.363927] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-14T17:46:25.393731] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:25.415900] [DEBUG] [LOCAL ] DTE: Loaded 21312 existing records from primary storage. [2025-09-14T17:46:25.416078] [INFO ] [MAIN ] DTE: Loaded 21312 existing records. [2025-09-14T17:46:25.598228] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:25.598498] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-14T17:46:25.598559] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-14T17:46:25.599298] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-14T17:46:25.599363] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-14T17:46:25.954993] [INFO ] [REMOTE ] DTE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:26.158877] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-14T17:46:26.958870] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-14T17:46:27.167776] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:46:27.594174] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T17:46:27.758887] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-14T17:46:27.869661] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T17:46:28.558838] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-14T17:46:29.358837] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-14T17:46:29.686060] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T17:46:30.016269] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T17:46:30.158809] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-14T17:46:30.366086] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:46:30.958871] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-14T17:46:31.758856] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-14T17:46:31.868530] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:46:32.253841] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:46:32.558843] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-14T17:46:33.004415] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T17:46:33.010013] [INFO ] [REMOTE ] DT: Full fetch complete (57571 records). [2025-09-14T17:46:33.010162] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-14T17:46:33.382940] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-14T17:46:33.440200] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-14T17:46:33.440376] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-14T17:46:33.441149] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-14T17:46:33.441208] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-14T17:46:33.442464] [DEBUG] [LOCAL ] DT: Trimmed 57571 records to 39809 (keeping 150 days of data) [2025-09-14T17:46:33.697999] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T17:46:33.728188] [DEBUG] [LOCAL ] DT: Primary data saved (39809 records). [2025-09-14T17:46:33.728375] [INFO ] [MAIN ] DT: Full history saved. [2025-09-14T17:46:33.728477] [INFO ] [MAIN ] Update Progress: 657/2370 symbols completed. DT took 21.6s. Estimated remaining: 3h 0m 52s. Rate: 9.5 symbols/min [2025-09-14T17:46:33.899564] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:33.899809] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-14T17:46:33.899863] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-14T17:46:33.899978] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-14T17:46:33.900030] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-14T17:46:33.900082] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-14T17:46:33.900135] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-14T17:46:34.163922] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-14T17:46:34.183909] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:46:34.267212] [INFO ] [REMOTE ] DTF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:34.958846] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-14T17:46:35.315032] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T17:46:35.319554] [INFO ] [REMOTE ] DSX: Full fetch complete (27420 records). [2025-09-14T17:46:35.319881] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-14T17:46:35.619219] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:46:35.647132] [INFO ] [REMOTE ] DTB: Full fetch complete (4909 records). [2025-09-14T17:46:35.701996] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-14T17:46:35.741276] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-14T17:46:35.771398] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-14T17:46:35.763895] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-14T17:46:35.779159] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-14T17:46:35.789658] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-14T17:46:35.825488] [DEBUG] [LOCAL ] DSX: Trimmed 27420 records to 17812 (keeping 150 days of data) [2025-09-14T17:46:36.156463] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T17:46:36.157466] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-14T17:46:36.159886] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-14T17:46:36.160629] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-14T17:46:36.161519] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-14T17:46:36.163049] [DEBUG] [LOCAL ] DTB: Trimmed 4909 records to 3720 (keeping 150 days of data) [2025-09-14T17:46:36.193928] [DEBUG] [LOCAL ] DTB: Primary data saved (3720 records). [2025-09-14T17:46:36.195069] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-14T17:46:36.196214] [INFO ] [MAIN ] Update Progress: 658/2370 symbols completed. DTB took 23.7s. Estimated remaining: 3h 0m 35s. Rate: 9.5 symbols/min [2025-09-14T17:46:36.373958] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:36.378690] [DEBUG] [LOCAL ] DSX: Primary data saved (17812 records). [2025-09-14T17:46:36.378833] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-14T17:46:36.378931] [INFO ] [MAIN ] Update Progress: 659/2370 symbols completed. DSX took 31.5s. Estimated remaining: 3h 0m 13s. Rate: 9.5 symbols/min [2025-09-14T17:46:36.480001] [DEBUG] [LOCAL ] DTG: Loaded 2706 existing records from primary storage. [2025-09-14T17:46:36.482297] [INFO ] [MAIN ] DTG: Loaded 2706 existing records. [2025-09-14T17:46:36.572001] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-14T17:46:36.636821] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:36.734369] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:36.734748] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-14T17:46:36.734846] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-14T17:46:36.735253] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-14T17:46:36.735329] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-14T17:46:36.865162] [DEBUG] [LOCAL ] DTM: Loaded 18965 existing records from primary storage. [2025-09-14T17:46:36.898629] [INFO ] [MAIN ] DTM: Loaded 18965 existing records. [2025-09-14T17:46:37.268508] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:37.289791] [INFO ] [REMOTE ] DTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:37.289914] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-14T17:46:37.290020] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-14T17:46:37.290901] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-14T17:46:37.290968] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-14T17:46:37.364316] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-14T17:46:37.637281] [INFO ] [REMOTE ] DTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:38.099818] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T17:46:38.158779] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-14T17:46:38.421792] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:46:38.958859] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-14T17:46:39.000975] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:46:39.758839] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-14T17:46:40.121204] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-14T17:46:40.547577] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:46:40.558773] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-14T17:46:41.358827] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-14T17:46:41.738149] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-14T17:46:42.158812] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-14T17:46:42.467578] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T17:46:42.958826] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-14T17:46:43.353322] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T17:46:43.547266] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T17:46:43.758875] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-14T17:46:44.030628] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-14T17:46:44.558848] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-14T17:46:45.358874] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-14T17:46:46.158853] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-14T17:46:46.301673] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:46:46.812489] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T17:46:46.958876] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-14T17:46:47.216372] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-14T17:46:47.219880] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:46:47.758878] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-14T17:46:48.042195] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-14T17:46:48.558858] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-14T17:46:49.212033] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T17:46:49.358836] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-14T17:46:49.621605] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-14T17:46:49.622500] [INFO ] [REMOTE ] DTF: Full fetch complete (1332 records). [2025-09-14T17:46:49.622591] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-14T17:46:49.623027] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:46:49.623103] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:46:49.623150] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:46:49.623196] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-14T17:46:49.623264] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-14T17:46:49.623310] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-14T17:46:49.623389] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-14T17:46:49.623471] [INFO ] [MAIN ] Update Progress: 660/2370 symbols completed. DTF took 15.9s. Estimated remaining: 3h 0m 25s. Rate: 9.5 symbols/min [2025-09-14T17:46:49.794193] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:49.798098] [DEBUG] [LOCAL ] DTW: Loaded 2142 existing records from primary storage. [2025-09-14T17:46:49.798222] [INFO ] [MAIN ] DTW: Loaded 2142 existing records. [2025-09-14T17:46:49.975325] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:49.975609] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-14T17:46:49.975686] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-14T17:46:49.975966] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-14T17:46:49.976030] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-14T17:46:50.159301] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-14T17:46:50.350350] [INFO ] [REMOTE ] DTW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:50.958813] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-14T17:46:51.758884] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-14T17:46:52.003674] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:46:52.158617] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-14T17:46:52.558814] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-14T17:46:52.645799] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:46:53.358866] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-14T17:46:54.026408] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:46:54.031527] [INFO ] [REMOTE ] DTE: Full fetch complete (52205 records). [2025-09-14T17:46:54.031713] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-14T17:46:54.173554] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-14T17:46:54.414906] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-14T17:46:54.415029] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-14T17:46:54.415943] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-14T17:46:54.416093] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-14T17:46:54.417582] [DEBUG] [LOCAL ] DTE: Trimmed 52205 records to 35858 (keeping 150 days of data) [2025-09-14T17:46:54.440354] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:46:54.687728] [DEBUG] [LOCAL ] DTE: Primary data saved (35858 records). [2025-09-14T17:46:54.687908] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-14T17:46:54.688065] [INFO ] [MAIN ] Update Progress: 661/2370 symbols completed. DTE took 29.5s. Estimated remaining: 3h 0m 15s. Rate: 9.5 symbols/min [2025-09-14T17:46:54.867294] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:54.886620] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T17:46:54.897160] [DEBUG] [LOCAL ] DUK: Loaded 23903 existing records from primary storage. [2025-09-14T17:46:54.897301] [INFO ] [MAIN ] DUK: Loaded 23903 existing records. [2025-09-14T17:46:54.963944] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-14T17:46:55.077880] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:55.078203] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-14T17:46:55.078280] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-14T17:46:55.079084] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-14T17:46:55.079166] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-14T17:46:55.428838] [INFO ] [REMOTE ] DUK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:55.758868] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-14T17:46:56.406303] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:46:56.528221] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T17:46:56.558783] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-14T17:46:57.358820] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-14T17:46:58.158860] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-14T17:46:58.437401] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:46:58.565476] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T17:46:58.958817] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-14T17:46:58.974900] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:46:59.758832] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-14T17:47:00.387530] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T17:47:00.558812] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-14T17:47:00.889999] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:47:01.207124] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T17:47:01.358827] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-14T17:47:01.831102] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-14T17:47:02.158883] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-14T17:47:02.850560] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:47:02.958802] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-14T17:47:03.758833] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-14T17:47:04.381995] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T17:47:04.558873] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-14T17:47:05.235901] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-14T17:47:05.309842] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T17:47:05.358792] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-14T17:47:06.041237] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:47:06.042490] [INFO ] [REMOTE ] DTW: Full fetch complete (5159 records). [2025-09-14T17:47:06.042584] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-14T17:47:06.163927] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-14T17:47:06.415859] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-14T17:47:06.415992] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-14T17:47:06.416230] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-14T17:47:06.416297] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-14T17:47:06.416780] [DEBUG] [LOCAL ] DTW: Trimmed 5159 records to 3562 (keeping 150 days of data) [2025-09-14T17:47:06.439029] [DEBUG] [LOCAL ] DTW: Primary data saved (3562 records). [2025-09-14T17:47:06.439143] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-14T17:47:06.439287] [INFO ] [MAIN ] Update Progress: 662/2370 symbols completed. DTW took 16.8s. Estimated remaining: 3h 0m 23s. Rate: 9.5 symbols/min [2025-09-14T17:47:06.609106] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:06.613690] [DEBUG] [LOCAL ] DUKB: Loaded 2763 existing records from primary storage. [2025-09-14T17:47:06.613807] [INFO ] [MAIN ] DUKB: Loaded 2763 existing records. [2025-09-14T17:47:06.791165] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:06.791425] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-14T17:47:06.791502] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-14T17:47:06.791805] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-14T17:47:06.791879] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-14T17:47:06.895227] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:47:06.912309] [INFO ] [REMOTE ] DTG: Full fetch complete (6416 records). [2025-09-14T17:47:06.922671] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-14T17:47:06.958786] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-14T17:47:07.424101] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:07.531736] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-14T17:47:07.532032] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-14T17:47:07.532240] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-14T17:47:07.532299] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-14T17:47:07.532823] [DEBUG] [LOCAL ] DTG: Trimmed 6416 records to 4209 (keeping 150 days of data) [2025-09-14T17:47:07.559809] [DEBUG] [LOCAL ] DTG: Primary data saved (4209 records). [2025-09-14T17:47:07.559962] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-14T17:47:07.560060] [INFO ] [MAIN ] Update Progress: 663/2370 symbols completed. DTG took 31.4s. Estimated remaining: 3h 0m 3s. Rate: 9.5 symbols/min [2025-09-14T17:47:07.738108] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:07.750029] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T17:47:07.754675] [INFO ] [REMOTE ] DTM: Full fetch complete (48802 records). [2025-09-14T17:47:07.754817] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-14T17:47:07.766490] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-14T17:47:07.884963] [DEBUG] [LOCAL ] DV: Loaded 22743 existing records from primary storage. [2025-09-14T17:47:07.923885] [INFO ] [MAIN ] DV: Loaded 22743 existing records. [2025-09-14T17:47:08.305736] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:08.338031] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-14T17:47:08.338099] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-14T17:47:08.338214] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-14T17:47:08.338330] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-14T17:47:08.339287] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-14T17:47:08.339413] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-14T17:47:08.340281] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-14T17:47:08.340389] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-14T17:47:08.416992] [DEBUG] [LOCAL ] DTM: Trimmed 48802 records to 32519 (keeping 150 days of data) [2025-09-14T17:47:08.586091] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-14T17:47:08.807659] [INFO ] [REMOTE ] DV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:08.920378] [DEBUG] [LOCAL ] DTM: Primary data saved (32519 records). [2025-09-14T17:47:08.920563] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-14T17:47:08.920688] [INFO ] [MAIN ] Update Progress: 664/2370 symbols completed. DTM took 32.5s. Estimated remaining: 2h 59m 44s. Rate: 9.5 symbols/min [2025-09-14T17:47:09.088459] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:09.107874] [DEBUG] [LOCAL ] DVA: Loaded 18463 existing records from primary storage. [2025-09-14T17:47:09.108080] [INFO ] [MAIN ] DVA: Loaded 18463 existing records. [2025-09-14T17:47:09.291090] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:09.291345] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-14T17:47:09.291408] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-14T17:47:09.292082] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-14T17:47:09.292148] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-14T17:47:09.361381] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-14T17:47:09.401517] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T17:47:09.678188] [INFO ] [REMOTE ] DVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:09.714903] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:47:10.158834] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-14T17:47:10.958844] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-14T17:47:11.149961] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T17:47:11.551319] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:47:11.626600] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T17:47:11.758898] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-14T17:47:12.558897] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-14T17:47:13.358793] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-14T17:47:13.779385] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T17:47:14.158842] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-14T17:47:14.638905] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-14T17:47:14.958867] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-14T17:47:15.096372] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T17:47:15.727944] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:47:15.758792] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-14T17:47:16.558802] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-14T17:47:16.781618] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T17:47:17.164820] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T17:47:17.358829] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-14T17:47:18.050232] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T17:47:18.158824] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-14T17:47:18.560928] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T17:47:18.958844] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-14T17:47:19.723160] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T17:47:19.758817] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-14T17:47:19.854915] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T17:47:20.511913] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T17:47:20.558788] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-14T17:47:21.358833] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-14T17:47:21.927453] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-14T17:47:22.158837] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-14T17:47:22.257548] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T17:47:22.958830] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-14T17:47:23.567558] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:47:23.643452] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T17:47:23.758826] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-14T17:47:24.413239] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:47:24.558828] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-14T17:47:25.358837] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-14T17:47:26.158790] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-14T17:47:26.385959] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:47:26.750088] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:47:26.751228] [INFO ] [REMOTE ] DUKB: Full fetch complete (6948 records). [2025-09-14T17:47:26.751312] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-14T17:47:26.963963] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-14T17:47:27.122154] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-14T17:47:27.122333] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-14T17:47:27.122636] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-14T17:47:27.122776] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-14T17:47:27.123339] [DEBUG] [LOCAL ] DUKB: Trimmed 6948 records to 4720 (keeping 150 days of data) [2025-09-14T17:47:27.153187] [DEBUG] [LOCAL ] DUKB: Primary data saved (4720 records). [2025-09-14T17:47:27.153444] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-14T17:47:27.153550] [INFO ] [MAIN ] Update Progress: 665/2370 symbols completed. DUKB took 20.7s. Estimated remaining: 3h 0m 8s. Rate: 9.5 symbols/min [2025-09-14T17:47:27.232872] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T17:47:27.371029] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:27.395877] [DEBUG] [LOCAL ] DVN: Loaded 24112 existing records from primary storage. [2025-09-14T17:47:27.396115] [INFO ] [MAIN ] DVN: Loaded 24112 existing records. [2025-09-14T17:47:27.571232] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:27.571504] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-14T17:47:27.571575] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-14T17:47:27.572165] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-14T17:47:27.572231] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-14T17:47:27.764206] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-14T17:47:27.931607] [INFO ] [REMOTE ] DVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:28.516557] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T17:47:28.558791] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-14T17:47:29.022884] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T17:47:29.027511] [INFO ] [REMOTE ] DVA: Full fetch complete (45940 records). [2025-09-14T17:47:29.027670] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-14T17:47:29.361384] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-14T17:47:29.446609] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-14T17:47:29.446813] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-14T17:47:29.447579] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-14T17:47:29.447668] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-14T17:47:29.449032] [DEBUG] [LOCAL ] DVA: Trimmed 45940 records to 30946 (keeping 150 days of data) [2025-09-14T17:47:29.572765] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:47:29.696470] [DEBUG] [LOCAL ] DVA: Primary data saved (30946 records). [2025-09-14T17:47:29.696692] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-14T17:47:29.696804] [INFO ] [MAIN ] Update Progress: 666/2370 symbols completed. DVA took 20.8s. Estimated remaining: 2h 59m 52s. Rate: 9.5 symbols/min [2025-09-14T17:47:29.867982] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:29.893313] [DEBUG] [LOCAL ] DX: Loaded 23455 existing records from primary storage. [2025-09-14T17:47:29.893505] [INFO ] [MAIN ] DX: Loaded 23455 existing records. [2025-09-14T17:47:30.080258] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:30.080632] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-14T17:47:30.080837] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-14T17:47:30.081483] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-14T17:47:30.081549] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-14T17:47:30.164762] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-14T17:47:30.178992] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T17:47:30.229077] [INFO ] [REMOTE ] DUK: Full fetch complete (58150 records). [2025-09-14T17:47:30.257730] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-14T17:47:30.616459] [INFO ] [REMOTE ] DX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:30.854121] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-14T17:47:30.854237] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-14T17:47:30.855029] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-14T17:47:30.855101] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-14T17:47:30.856589] [DEBUG] [LOCAL ] DUK: Trimmed 58150 records to 40227 (keeping 150 days of data) [2025-09-14T17:47:30.960724] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-14T17:47:31.128868] [DEBUG] [LOCAL ] DUK: Primary data saved (40227 records). [2025-09-14T17:47:31.129040] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-14T17:47:31.129147] [INFO ] [MAIN ] Update Progress: 667/2370 symbols completed. DUK took 36.4s. Estimated remaining: 2h 59m 33s. Rate: 9.5 symbols/min [2025-09-14T17:47:31.302917] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:31.326042] [DEBUG] [LOCAL ] DXC: Loaded 22555 existing records from primary storage. [2025-09-14T17:47:31.326238] [INFO ] [MAIN ] DXC: Loaded 22555 existing records. [2025-09-14T17:47:31.521359] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:31.521680] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-14T17:47:31.521754] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-14T17:47:31.522383] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-14T17:47:31.522446] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-14T17:47:31.764047] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-14T17:47:31.863713] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T17:47:31.917096] [INFO ] [REMOTE ] DV: Full fetch complete (55514 records). [2025-09-14T17:47:31.922618] [INFO ] [REMOTE ] DXC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:31.923262] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-14T17:47:32.337439] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-14T17:47:32.337576] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-14T17:47:32.338597] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-14T17:47:32.338861] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-14T17:47:32.352008] [DEBUG] [LOCAL ] DV: Trimmed 55514 records to 38284 (keeping 150 days of data) [2025-09-14T17:47:32.374657] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-14T17:47:32.562199] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-14T17:47:32.618705] [DEBUG] [LOCAL ] DV: Primary data saved (38284 records). [2025-09-14T17:47:32.618899] [INFO ] [MAIN ] DV: Full history saved. [2025-09-14T17:47:32.619018] [INFO ] [MAIN ] Update Progress: 668/2370 symbols completed. DV took 25.1s. Estimated remaining: 2h 59m 15s. Rate: 9.5 symbols/min [2025-09-14T17:47:32.790592] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:32.806521] [DEBUG] [LOCAL ] DXYZ: Loaded 15671 existing records from primary storage. [2025-09-14T17:47:32.806717] [INFO ] [MAIN ] DXYZ: Loaded 15671 existing records. [2025-09-14T17:47:32.983668] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:32.983953] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-14T17:47:32.984017] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-14T17:47:32.984527] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-14T17:47:32.984603] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-14T17:47:33.348632] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:33.358780] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-14T17:47:33.625912] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T17:47:34.154527] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:47:34.163454] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-14T17:47:34.958878] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-14T17:47:35.549617] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-14T17:47:35.758864] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-14T17:47:36.080566] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:47:36.558856] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-14T17:47:36.855247] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:47:37.358943] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-14T17:47:37.758127] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T17:47:38.158812] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-14T17:47:38.276692] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T17:47:38.958859] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-14T17:47:39.087920] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:47:39.758832] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-14T17:47:40.169106] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T17:47:40.558872] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-14T17:47:40.905545] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:47:41.358862] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-14T17:47:41.425188] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T17:47:42.158853] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-14T17:47:42.336158] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T17:47:42.958941] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-14T17:47:43.299567] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T17:47:43.758804] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-14T17:47:43.802102] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:47:44.462981] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T17:47:44.558792] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-14T17:47:45.185283] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:47:45.358817] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-14T17:47:46.158865] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-14T17:47:46.442224] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:47:46.930857] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T17:47:46.958821] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-14T17:47:47.758915] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-14T17:47:48.105078] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T17:47:48.558825] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-14T17:47:48.605184] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T17:47:49.358891] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-14T17:47:49.712148] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:47:50.158871] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-14T17:47:50.258678] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:47:50.958885] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-14T17:47:51.068469] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T17:47:51.758898] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-14T17:47:51.829217] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-14T17:47:51.833674] [INFO ] [REMOTE ] DXYZ: Full fetch complete (40639 records). [2025-09-14T17:47:51.833901] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-14T17:47:52.237326] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-14T17:47:52.237507] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-14T17:47:52.238612] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-14T17:47:52.238741] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-14T17:47:52.240393] [DEBUG] [LOCAL ] DXYZ: Trimmed 40639 records to 26884 (keeping 150 days of data) [2025-09-14T17:47:52.410932] [DEBUG] [LOCAL ] DXYZ: Primary data saved (26884 records). [2025-09-14T17:47:52.411154] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-14T17:47:52.411291] [INFO ] [MAIN ] Update Progress: 669/2370 symbols completed. DXYZ took 19.8s. Estimated remaining: 2h 59m 42s. Rate: 9.5 symbols/min [2025-09-14T17:47:52.563448] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-14T17:47:52.600332] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:52.644085] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T17:47:52.654529] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T17:47:52.666543] [INFO ] [REMOTE ] DVN: Full fetch complete (58379 records). [2025-09-14T17:47:52.666852] [INFO ] [REMOTE ] DX: Full fetch complete (56960 records). [2025-09-14T17:47:52.673171] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-14T17:47:52.674752] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-14T17:47:52.676081] [DEBUG] [LOCAL ] DY: Loaded 12140 existing records from primary storage. [2025-09-14T17:47:52.724507] [INFO ] [MAIN ] DY: Loaded 12140 existing records. [2025-09-14T17:47:53.412345] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:53.562404] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-14T17:47:53.615823] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-14T17:47:53.687668] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-14T17:47:53.698884] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-14T17:47:53.699230] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-14T17:47:53.699142] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-14T17:47:53.700548] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-14T17:47:53.738045] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-14T17:47:53.777618] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-14T17:47:53.797463] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-14T17:47:53.813407] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-14T17:47:53.839757] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-14T17:47:53.857807] [DEBUG] [LOCAL ] DVN: Trimmed 58379 records to 40439 (keeping 150 days of data) [2025-09-14T17:47:53.977197] [DEBUG] [LOCAL ] DX: Trimmed 56960 records to 39442 (keeping 150 days of data) [2025-09-14T17:47:54.393327] [INFO ] [REMOTE ] DY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:54.396250] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-14T17:47:54.553149] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T17:47:54.577861] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-14T17:47:54.623786] [DEBUG] [LOCAL ] DX: Primary data saved (39442 records). [2025-09-14T17:47:54.625990] [INFO ] [MAIN ] DX: Full history saved. [2025-09-14T17:47:54.626857] [INFO ] [MAIN ] Update Progress: 670/2370 symbols completed. DX took 24.9s. Estimated remaining: 2h 59m 26s. Rate: 9.5 symbols/min [2025-09-14T17:47:54.920782] [DEBUG] [LOCAL ] DVN: Primary data saved (40439 records). [2025-09-14T17:47:54.949450] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-14T17:47:54.949708] [INFO ] [MAIN ] Update Progress: 671/2370 symbols completed. DVN took 27.8s. Estimated remaining: 2h 59m 4s. Rate: 9.5 symbols/min [2025-09-14T17:47:54.949296] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:55.141712] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:55.142895] [DEBUG] [LOCAL ] E: Loaded 14413 existing records from primary storage. [2025-09-14T17:47:55.143697] [INFO ] [MAIN ] E: Loaded 14413 existing records. [2025-09-14T17:47:55.331023] [DEBUG] [LOCAL ] EAF: Loaded 18628 existing records from primary storage. [2025-09-14T17:47:55.353731] [INFO ] [MAIN ] EAF: Loaded 18628 existing records. [2025-09-14T17:47:55.353902] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:55.428782] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-14T17:47:55.460390] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-14T17:47:55.469316] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-14T17:47:55.508496] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-14T17:47:55.555723] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:55.625596] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-14T17:47:55.676761] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-14T17:47:55.767409] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-14T17:47:55.861169] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-14T17:47:56.061254] [INFO ] [REMOTE ] E: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:56.061977] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-14T17:47:56.281212] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:47:56.344779] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-14T17:47:56.378526] [INFO ] [REMOTE ] EAF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:56.422247] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T17:47:56.558922] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-14T17:47:57.358842] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-14T17:47:57.397340] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T17:47:57.948936] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T17:47:58.158908] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-14T17:47:58.219239] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:47:58.747618] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T17:47:58.958850] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-14T17:47:59.310567] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T17:47:59.758868] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-14T17:48:00.558877] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-14T17:48:00.624187] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:48:01.072379] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T17:48:01.358855] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-14T17:48:01.734762] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T17:48:02.158862] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-14T17:48:02.958814] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-14T17:48:03.758892] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-14T17:48:04.138552] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-09-14T17:48:04.558869] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-14T17:48:04.599888] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T17:48:04.606558] [INFO ] [REMOTE ] DXC: Full fetch complete (53224 records). [2025-09-14T17:48:04.606915] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-14T17:48:05.021184] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-14T17:48:05.021369] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-14T17:48:05.022809] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-14T17:48:05.022895] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-14T17:48:05.031753] [DEBUG] [LOCAL ] DXC: Trimmed 53224 records to 37447 (keeping 150 days of data) [2025-09-14T17:48:05.042315] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T17:48:05.286498] [DEBUG] [LOCAL ] DXC: Primary data saved (37447 records). [2025-09-14T17:48:05.286781] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-14T17:48:05.286952] [INFO ] [MAIN ] Update Progress: 672/2370 symbols completed. DXC took 34.2s. Estimated remaining: 2h 59m 8s. Rate: 9.5 symbols/min [2025-09-14T17:48:05.371472] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-14T17:48:05.477540] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:05.483212] [DEBUG] [LOCAL ] EAI: Loaded 1656 existing records from primary storage. [2025-09-14T17:48:05.483512] [INFO ] [MAIN ] EAI: Loaded 1656 existing records. [2025-09-14T17:48:05.626986] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-09-14T17:48:05.726248] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:05.726593] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-14T17:48:05.726682] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-14T17:48:05.726996] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-14T17:48:05.727063] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-14T17:48:06.123827] [INFO ] [REMOTE ] EAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:06.158878] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-14T17:48:06.246558] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:48:06.433163] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T17:48:06.622675] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-14T17:48:06.958831] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-14T17:48:07.544027] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T17:48:07.758863] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-14T17:48:08.558901] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-14T17:48:09.358844] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-14T17:48:09.453669] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T17:48:09.499248] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T17:48:10.158837] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-14T17:48:10.750658] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:48:10.958932] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-14T17:48:11.758888] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-14T17:48:11.864519] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T17:48:12.270108] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T17:48:12.558857] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-14T17:48:13.266282] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T17:48:13.358818] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-14T17:48:14.158902] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-14T17:48:14.479594] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T17:48:14.958965] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-14T17:48:15.368384] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T17:48:15.740372] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T17:48:15.758828] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-14T17:48:16.100102] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:48:16.104182] [INFO ] [REMOTE ] DY: Full fetch complete (33449 records). [2025-09-14T17:48:16.104461] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-14T17:48:16.499967] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-14T17:48:16.500137] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-14T17:48:16.501157] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-14T17:48:16.501232] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-14T17:48:16.502458] [DEBUG] [LOCAL ] DY: Trimmed 33449 records to 21411 (keeping 150 days of data) [2025-09-14T17:48:16.573930] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-14T17:48:16.625955] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:48:16.676525] [DEBUG] [LOCAL ] DY: Primary data saved (21411 records). [2025-09-14T17:48:16.676733] [INFO ] [MAIN ] DY: Full history saved. [2025-09-14T17:48:16.676852] [INFO ] [MAIN ] Update Progress: 673/2370 symbols completed. DY took 24.3s. Estimated remaining: 2h 59m 14s. Rate: 9.5 symbols/min [2025-09-14T17:48:16.850933] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:16.863060] [DEBUG] [LOCAL ] EARN: Loaded 11109 existing records from primary storage. [2025-09-14T17:48:16.863242] [INFO ] [MAIN ] EARN: Loaded 11109 existing records. [2025-09-14T17:48:17.039602] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:17.039910] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-14T17:48:17.039973] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-14T17:48:17.040385] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-14T17:48:17.040444] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-14T17:48:17.366710] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-14T17:48:17.394109] [INFO ] [REMOTE ] EARN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:17.555783] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T17:48:18.027220] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T17:48:18.158846] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-14T17:48:18.958827] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-14T17:48:19.353805] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:48:19.758823] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-14T17:48:19.938004] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:48:19.941362] [INFO ] [REMOTE ] E: Full fetch complete (36533 records). [2025-09-14T17:48:19.941465] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-14T17:48:20.317412] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-14T17:48:20.317516] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-14T17:48:20.318107] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-14T17:48:20.318167] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-14T17:48:20.319202] [DEBUG] [LOCAL ] E: Trimmed 36533 records to 25020 (keeping 150 days of data) [2025-09-14T17:48:20.420436] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T17:48:20.483652] [DEBUG] [LOCAL ] E: Primary data saved (25020 records). [2025-09-14T17:48:20.483818] [INFO ] [MAIN ] E: Full history saved. [2025-09-14T17:48:20.483927] [INFO ] [MAIN ] Update Progress: 674/2370 symbols completed. E took 25.9s. Estimated remaining: 2h 59m 2s. Rate: 9.5 symbols/min [2025-09-14T17:48:20.563984] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-14T17:48:20.666939] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:20.692825] [DEBUG] [LOCAL ] EAT: Loaded 21973 existing records from primary storage. [2025-09-14T17:48:20.693037] [INFO ] [MAIN ] EAT: Loaded 21973 existing records. [2025-09-14T17:48:20.876058] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:20.876353] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-14T17:48:20.876418] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-14T17:48:20.877064] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-14T17:48:20.877128] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-14T17:48:21.227596] [INFO ] [REMOTE ] EAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:21.358874] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-14T17:48:22.158853] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-14T17:48:22.241495] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T17:48:22.757869] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:48:22.958832] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-14T17:48:23.317838] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T17:48:23.758860] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-14T17:48:24.558825] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-14T17:48:24.675257] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T17:48:24.710456] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T17:48:24.713548] [INFO ] [REMOTE ] EAF: Full fetch complete (48957 records). [2025-09-14T17:48:24.713679] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-14T17:48:25.084785] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-14T17:48:25.084888] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-14T17:48:25.085630] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-14T17:48:25.085718] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-14T17:48:25.086774] [DEBUG] [LOCAL ] EAF: Trimmed 48957 records to 33346 (keeping 150 days of data) [2025-09-14T17:48:25.277969] [DEBUG] [LOCAL ] EAF: Primary data saved (33346 records). [2025-09-14T17:48:25.278135] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-14T17:48:25.278272] [INFO ] [MAIN ] Update Progress: 675/2370 symbols completed. EAF took 30.3s. Estimated remaining: 2h 58m 51s. Rate: 9.5 symbols/min [2025-09-14T17:48:25.367529] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-14T17:48:25.450287] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:25.467156] [DEBUG] [LOCAL ] EB: Loaded 16215 existing records from primary storage. [2025-09-14T17:48:25.467315] [INFO ] [MAIN ] EB: Loaded 16215 existing records. [2025-09-14T17:48:25.640865] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:25.641176] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-14T17:48:25.641246] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-14T17:48:25.641844] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-14T17:48:25.641920] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-14T17:48:25.986897] [INFO ] [REMOTE ] EB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:26.158835] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-14T17:48:26.427354] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:48:26.874962] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:48:26.958830] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-14T17:48:27.759211] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-14T17:48:27.761582] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T17:48:28.505696] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T17:48:28.558780] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-14T17:48:28.973609] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T17:48:28.974633] [INFO ] [REMOTE ] EAI: Full fetch complete (4327 records). [2025-09-14T17:48:28.974734] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-14T17:48:29.322659] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-14T17:48:29.322759] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-14T17:48:29.322894] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-14T17:48:29.322944] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-14T17:48:29.323327] [DEBUG] [LOCAL ] EAI: Trimmed 4327 records to 2854 (keeping 150 days of data) [2025-09-14T17:48:29.342371] [DEBUG] [LOCAL ] EAI: Primary data saved (2854 records). [2025-09-14T17:48:29.342448] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-14T17:48:29.342552] [INFO ] [MAIN ] Update Progress: 676/2370 symbols completed. EAI took 24.1s. Estimated remaining: 2h 58m 39s. Rate: 9.5 symbols/min [2025-09-14T17:48:29.363967] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-14T17:48:29.515800] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:29.526770] [DEBUG] [LOCAL ] EBF: Loaded 8239 existing records from primary storage. [2025-09-14T17:48:29.526924] [INFO ] [MAIN ] EBF: Loaded 8239 existing records. [2025-09-14T17:48:29.701938] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:29.702373] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-14T17:48:29.702486] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-14T17:48:29.702896] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-14T17:48:29.708105] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-14T17:48:29.792384] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:48:30.083547] [INFO ] [REMOTE ] EBF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:30.158875] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-14T17:48:30.958878] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-14T17:48:31.420506] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:48:31.464274] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T17:48:31.758865] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-14T17:48:32.226953] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:48:32.558843] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-14T17:48:32.814917] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-14T17:48:32.817863] [INFO ] [REMOTE ] EARN: Full fetch complete (34557 records). [2025-09-14T17:48:32.817957] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-14T17:48:33.188828] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-14T17:48:33.188961] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-14T17:48:33.189544] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-14T17:48:33.189599] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-14T17:48:33.190407] [DEBUG] [LOCAL ] EARN: Trimmed 34557 records to 20708 (keeping 150 days of data) [2025-09-14T17:48:33.314413] [DEBUG] [LOCAL ] EARN: Primary data saved (20708 records). [2025-09-14T17:48:33.314566] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-14T17:48:33.314672] [INFO ] [MAIN ] Update Progress: 677/2370 symbols completed. EARN took 16.6s. Estimated remaining: 2h 58m 27s. Rate: 9.5 symbols/min [2025-09-14T17:48:33.358823] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-14T17:48:34.139388] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:48:34.158770] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-14T17:48:34.203875] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T17:48:34.958883] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-14T17:48:35.765584] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-14T17:48:35.781173] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:48:36.558790] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-14T17:48:36.919212] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:48:36.950764] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T17:48:37.358882] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-14T17:48:37.929453] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:48:38.158943] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-14T17:48:38.958853] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-14T17:48:39.175188] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:48:39.696113] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T17:48:39.758809] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-14T17:48:39.817583] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T17:48:40.558860] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-14T17:48:41.322918] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:48:41.358805] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-14T17:48:41.554891] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:48:42.158888] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-14T17:48:42.547836] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:48:42.551434] [INFO ] [REMOTE ] EB: Full fetch complete (41676 records). [2025-09-14T17:48:42.551598] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-14T17:48:42.929383] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-14T17:48:42.929496] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-14T17:48:42.930349] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-14T17:48:42.930425] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-14T17:48:42.941754] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:48:42.946006] [DEBUG] [LOCAL ] EB: Trimmed 41676 records to 27695 (keeping 150 days of data) [2025-09-14T17:48:42.993020] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-14T17:48:43.102687] [DEBUG] [LOCAL ] EB: Primary data saved (27695 records). [2025-09-14T17:48:43.102853] [INFO ] [MAIN ] EB: Full history saved. [2025-09-14T17:48:43.102949] [INFO ] [MAIN ] Update Progress: 678/2370 symbols completed. EB took 17.8s. Estimated remaining: 2h 58m 30s. Rate: 9.5 symbols/min [2025-09-14T17:48:43.758882] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-14T17:48:44.082577] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T17:48:44.558831] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-14T17:48:45.329860] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T17:48:45.358782] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-14T17:48:45.576056] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T17:48:46.158822] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-14T17:48:47.067693] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T17:48:47.070058] [INFO ] [REMOTE ] EBF: Full fetch complete (21518 records). [2025-09-14T17:48:47.070273] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-14T17:48:47.282806] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T17:48:47.398775] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-14T17:48:47.482866] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-14T17:48:47.482977] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-14T17:48:47.483502] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-14T17:48:47.483569] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-14T17:48:47.484203] [DEBUG] [LOCAL ] EBF: Trimmed 21518 records to 14154 (keeping 150 days of data) [2025-09-14T17:48:47.574392] [DEBUG] [LOCAL ] EBF: Primary data saved (14154 records). [2025-09-14T17:48:47.574587] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-14T17:48:47.574720] [INFO ] [MAIN ] Update Progress: 679/2370 symbols completed. EBF took 18.2s. Estimated remaining: 2h 58m 19s. Rate: 9.5 symbols/min [2025-09-14T17:48:48.115492] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:48:48.120715] [INFO ] [REMOTE ] EAT: Full fetch complete (54343 records). [2025-09-14T17:48:48.120843] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-14T17:48:48.496103] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-14T17:48:48.496209] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-14T17:48:48.497066] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-14T17:48:48.497131] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-14T17:48:48.498295] [DEBUG] [LOCAL ] EAT: Trimmed 54343 records to 37345 (keeping 150 days of data) [2025-09-14T17:48:48.725509] [DEBUG] [LOCAL ] EAT: Primary data saved (37345 records). [2025-09-14T17:48:48.725717] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-14T17:48:48.725820] [INFO ] [MAIN ] Update Progress: 680/2370 symbols completed. EAT took 28.2s. Estimated remaining: 2h 57m 59s. Rate: 9.5 symbols/min [2025-09-14T17:48:49.405011] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:49.394208] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:49.444782] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:49.443960] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:49.477909] [DEBUG] [LOCAL ] EBR: Loaded 19235 existing records from primary storage. [2025-09-14T17:48:49.483436] [INFO ] [MAIN ] EBR: Loaded 19235 existing records. [2025-09-14T17:48:49.484061] [DEBUG] [LOCAL ] ECAT: Loaded 13971 existing records from primary storage. [2025-09-14T17:48:49.498102] [DEBUG] [LOCAL ] EC: Loaded 21590 existing records from primary storage. [2025-09-14T17:48:49.499048] [DEBUG] [LOCAL ] EBS: Loaded 21227 existing records from primary storage. [2025-09-14T17:48:49.504349] [INFO ] [MAIN ] EC: Loaded 21590 existing records. [2025-09-14T17:48:49.499131] [INFO ] [MAIN ] ECAT: Loaded 13971 existing records. [2025-09-14T17:48:49.549634] [INFO ] [MAIN ] EBS: Loaded 21227 existing records. [2025-09-14T17:48:50.105586] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:50.197424] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:50.226885] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-14T17:48:50.230667] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-14T17:48:50.226797] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:50.230476] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:50.230576] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-14T17:48:50.231316] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-14T17:48:50.231127] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-14T17:48:50.231156] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-14T17:48:50.231575] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-14T17:48:50.231681] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-14T17:48:50.231715] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-14T17:48:50.232090] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-14T17:48:50.237690] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-14T17:48:50.252315] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-14T17:48:50.272798] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-14T17:48:50.237742] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-14T17:48:50.303527] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-14T17:48:50.298308] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-14T17:48:51.394570] [INFO ] [REMOTE ] EBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:51.460133] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-14T17:48:51.605251] [INFO ] [REMOTE ] EBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:51.610290] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:51.610596] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-14T17:48:51.610908] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-14T17:48:51.679092] [INFO ] [REMOTE ] EC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:51.679559] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-14T17:48:53.089023] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T17:48:53.098157] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-14T17:48:53.115155] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T17:48:53.121631] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-14T17:48:53.143225] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T17:48:53.150854] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-14T17:48:53.211217] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T17:48:53.358788] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-14T17:48:54.238025] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:48:54.245571] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-14T17:48:54.671323] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T17:48:54.851259] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:48:54.958809] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T17:48:54.958937] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-14T17:48:55.113123] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T17:48:55.758844] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-14T17:48:56.558804] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-14T17:48:56.593626] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:48:57.358843] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-14T17:48:57.444717] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:48:57.603422] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T17:48:58.158890] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-14T17:48:58.958817] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-14T17:48:59.275422] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:48:59.758807] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-14T17:48:59.788514] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T17:49:00.255100] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T17:49:00.558887] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-14T17:49:01.358906] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-14T17:49:01.621490] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:49:02.158896] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-14T17:49:02.707199] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T17:49:02.833119] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T17:49:02.958874] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-14T17:49:03.758841] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-14T17:49:03.878198] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:49:04.558860] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-14T17:49:04.929531] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:49:04.983318] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:49:05.358843] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-14T17:49:06.158844] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-14T17:49:06.295263] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:49:06.537109] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T17:49:06.958864] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-14T17:49:07.758836] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-14T17:49:07.876532] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:49:08.403189] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T17:49:08.558841] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-14T17:49:09.358830] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-14T17:49:09.469034] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:49:09.787268] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T17:49:09.792418] [INFO ] [REMOTE ] EBS: Full fetch complete (51133 records). [2025-09-14T17:49:09.792579] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-14T17:49:10.164042] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-14T17:49:10.181365] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-14T17:49:10.181506] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-14T17:49:10.182384] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-14T17:49:10.182614] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-14T17:49:10.183891] [DEBUG] [LOCAL ] EBS: Trimmed 51133 records to 35421 (keeping 150 days of data) [2025-09-14T17:49:10.392123] [DEBUG] [LOCAL ] EBS: Primary data saved (35421 records). [2025-09-14T17:49:10.392302] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-14T17:49:10.392404] [INFO ] [MAIN ] Update Progress: 681/2370 symbols completed. EBS took 21.7s. Estimated remaining: 2h 58m 31s. Rate: 9.5 symbols/min [2025-09-14T17:49:10.571175] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:10.591712] [DEBUG] [LOCAL ] ECC: Loaded 19237 existing records from primary storage. [2025-09-14T17:49:10.591877] [INFO ] [MAIN ] ECC: Loaded 19237 existing records. [2025-09-14T17:49:10.768108] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:10.768544] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-14T17:49:10.768662] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-14T17:49:10.769300] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-14T17:49:10.769490] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-14T17:49:10.922028] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T17:49:10.978057] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-14T17:49:11.169144] [INFO ] [REMOTE ] ECC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:11.758856] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-14T17:49:11.842656] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T17:49:11.847796] [INFO ] [REMOTE ] EC: Full fetch complete (54027 records). [2025-09-14T17:49:11.847921] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-14T17:49:12.156613] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T17:49:12.181345] [INFO ] [REMOTE ] ECAT: Full fetch complete (32210 records). [2025-09-14T17:49:12.191732] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-14T17:49:12.364701] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-14T17:49:12.364855] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-14T17:49:12.365985] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-14T17:49:12.376549] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-14T17:49:12.427135] [DEBUG] [LOCAL ] EC: Trimmed 54027 records to 36834 (keeping 150 days of data) [2025-09-14T17:49:12.579596] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-14T17:49:12.778235] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-14T17:49:12.787425] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-14T17:49:12.788799] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-14T17:49:12.838120] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-14T17:49:12.864215] [DEBUG] [LOCAL ] ECAT: Trimmed 32210 records to 21834 (keeping 150 days of data) [2025-09-14T17:49:13.029151] [DEBUG] [LOCAL ] ECAT: Primary data saved (21834 records). [2025-09-14T17:49:13.035392] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-14T17:49:13.035929] [INFO ] [MAIN ] Update Progress: 682/2370 symbols completed. ECAT took 24.3s. Estimated remaining: 2h 58m 16s. Rate: 9.5 symbols/min [2025-09-14T17:49:13.043050] [DEBUG] [LOCAL ] EC: Primary data saved (36834 records). [2025-09-14T17:49:13.088579] [INFO ] [MAIN ] EC: Full history saved. [2025-09-14T17:49:13.117746] [INFO ] [MAIN ] Update Progress: 683/2370 symbols completed. EC took 24.4s. Estimated remaining: 2h 57m 54s. Rate: 9.5 symbols/min [2025-09-14T17:49:13.347782] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:13.426297] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:13.429485] [DEBUG] [LOCAL ] ECCC: Loaded 278 existing records from primary storage. [2025-09-14T17:49:13.430282] [INFO ] [MAIN ] ECCC: Loaded 278 existing records. [2025-09-14T17:49:13.492870] [DEBUG] [LOCAL ] ECCU: Loaded 965 existing records from primary storage. [2025-09-14T17:49:13.519847] [INFO ] [MAIN ] ECCU: Loaded 965 existing records. [2025-09-14T17:49:13.753262] [WARN ] [MAIN ] ECCC: Insufficient historical data. Have data from 2025-06-17, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:13.795122] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-14T17:49:13.822541] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T17:49:13.842426] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-14T17:49:13.863515] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:13.879895] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-14T17:49:13.879357] [DEBUG] [LOCAL ] ECCC: Deleted primary data file. [2025-09-14T17:49:13.880359] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-14T17:49:13.881277] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-14T17:49:13.893516] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-09-14T17:49:13.894350] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-14T17:49:13.894128] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-14T17:49:14.588342] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:14.657287] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-14T17:49:14.656558] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:14.682290] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T17:49:14.958872] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-14T17:49:15.051205] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T17:49:15.223250] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T17:49:15.228058] [INFO ] [REMOTE ] EBR: Full fetch complete (46377 records). [2025-09-14T17:49:15.228180] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-14T17:49:15.649707] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-14T17:49:15.649867] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-14T17:49:15.650804] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-14T17:49:15.650873] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-14T17:49:15.652154] [DEBUG] [LOCAL ] EBR: Trimmed 46377 records to 31998 (keeping 150 days of data) [2025-09-14T17:49:15.759124] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-14T17:49:15.882685] [DEBUG] [LOCAL ] EBR: Primary data saved (31998 records). [2025-09-14T17:49:15.883000] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-14T17:49:15.883161] [INFO ] [MAIN ] Update Progress: 684/2370 symbols completed. EBR took 27.2s. Estimated remaining: 2h 57m 39s. Rate: 9.5 symbols/min [2025-09-14T17:49:16.170301] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:16.174251] [DEBUG] [LOCAL ] ECCW: Loaded 505 existing records from primary storage. [2025-09-14T17:49:16.174474] [INFO ] [MAIN ] ECCW: Loaded 505 existing records. [2025-09-14T17:49:16.212894] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T17:49:16.470882] [WARN ] [MAIN ] ECCW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:16.471518] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-14T17:49:16.471634] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-14T17:49:16.472019] [DEBUG] [LOCAL ] ECCW: Deleted primary data file. [2025-09-14T17:49:16.472127] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-14T17:49:16.564102] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-14T17:49:16.921611] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:16.953662] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T17:49:17.027040] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T17:49:17.358860] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-14T17:49:18.158869] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-14T17:49:18.778628] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T17:49:18.958875] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-14T17:49:19.143273] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:49:19.374524] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T17:49:19.758829] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-14T17:49:20.405246] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T17:49:20.558826] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-14T17:49:21.021594] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T17:49:21.358824] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-14T17:49:21.722517] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-14T17:49:22.158828] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-14T17:49:22.700942] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T17:49:22.958812] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-14T17:49:23.395300] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T17:49:23.758816] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-14T17:49:24.280871] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T17:49:24.558842] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-14T17:49:24.931014] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T17:49:25.358827] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-14T17:49:25.838122] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T17:49:26.158840] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-14T17:49:26.726251] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T17:49:26.958843] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-14T17:49:27.313808] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-14T17:49:27.758835] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-14T17:49:28.143990] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:49:28.144806] [INFO ] [REMOTE ] ECCU: Full fetch complete (3160 records). [2025-09-14T17:49:28.144898] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-14T17:49:28.493728] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-09-14T17:49:28.493831] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-09-14T17:49:28.493956] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-09-14T17:49:28.494008] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-09-14T17:49:28.494421] [DEBUG] [LOCAL ] ECCU: Trimmed 3160 records to 1685 (keeping 150 days of data) [2025-09-14T17:49:28.505398] [DEBUG] [LOCAL ] ECCU: Primary data saved (1685 records). [2025-09-14T17:49:28.505490] [INFO ] [MAIN ] ECCU: Full history saved. [2025-09-14T17:49:28.505587] [INFO ] [MAIN ] Update Progress: 685/2370 symbols completed. ECCU took 15.4s. Estimated remaining: 2h 57m 48s. Rate: 9.5 symbols/min [2025-09-14T17:49:28.566636] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-14T17:49:28.681447] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:28.683857] [DEBUG] [LOCAL ] ECCX: Loaded 463 existing records from primary storage. [2025-09-14T17:49:28.683948] [INFO ] [MAIN ] ECCX: Loaded 463 existing records. [2025-09-14T17:49:28.856932] [WARN ] [MAIN ] ECCX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:28.857202] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-14T17:49:28.857278] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-14T17:49:28.857508] [DEBUG] [LOCAL ] ECCX: Deleted primary data file. [2025-09-14T17:49:28.857571] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-14T17:49:29.106766] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:49:29.208541] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:29.358833] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-14T17:49:29.723590] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-14T17:49:30.158861] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-14T17:49:30.538710] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T17:49:30.958840] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-14T17:49:31.475844] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T17:49:31.758866] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-14T17:49:32.273958] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T17:49:32.558862] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-14T17:49:33.358935] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-14T17:49:33.818010] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T17:49:34.158844] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-14T17:49:34.228013] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T17:49:34.618364] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:49:34.958830] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-14T17:49:35.356008] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T17:49:35.758842] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-14T17:49:36.064546] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:49:36.065337] [INFO ] [REMOTE ] ECCC: Full fetch complete (946 records). [2025-09-14T17:49:36.065424] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-14T17:49:36.240099] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T17:49:36.240309] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:49:36.240361] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:49:36.240409] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-14T17:49:36.240474] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-14T17:49:36.240520] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-14T17:49:36.240587] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-14T17:49:36.240681] [INFO ] [MAIN ] Update Progress: 686/2370 symbols completed. ECCC took 23.2s. Estimated remaining: 2h 57m 45s. Rate: 9.5 symbols/min [2025-09-14T17:49:36.436858] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:36.451881] [DEBUG] [LOCAL ] ECG: Loaded 14015 existing records from primary storage. [2025-09-14T17:49:36.452030] [INFO ] [MAIN ] ECG: Loaded 14015 existing records. [2025-09-14T17:49:36.564041] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-14T17:49:36.633128] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:36.633407] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-14T17:49:36.633468] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-14T17:49:36.634078] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-14T17:49:36.634142] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-14T17:49:36.984481] [INFO ] [REMOTE ] ECG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:37.074508] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T17:49:37.358897] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-14T17:49:38.158897] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-14T17:49:38.673560] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:49:38.958869] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-14T17:49:39.663290] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T17:49:39.758784] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-14T17:49:40.514963] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:49:40.558772] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-14T17:49:41.358870] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-14T17:49:41.516206] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:49:41.680026] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-14T17:49:42.082003] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:49:42.158845] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-14T17:49:42.559732] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-14T17:49:42.958864] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-14T17:49:43.758857] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-14T17:49:44.133614] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T17:49:44.134529] [INFO ] [REMOTE ] ECCW: Full fetch complete (1177 records). [2025-09-14T17:49:44.134614] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-14T17:49:44.324250] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T17:49:44.324571] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:49:44.324690] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:49:44.324823] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-14T17:49:44.325002] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-14T17:49:44.325145] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-14T17:49:44.325301] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-14T17:49:44.325528] [INFO ] [MAIN ] Update Progress: 687/2370 symbols completed. ECCW took 28.4s. Estimated remaining: 2h 57m 43s. Rate: 9.5 symbols/min [2025-09-14T17:49:44.500527] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:44.523922] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:49:44.551509] [DEBUG] [LOCAL ] ECL: Loaded 20439 existing records from primary storage. [2025-09-14T17:49:44.551694] [INFO ] [MAIN ] ECL: Loaded 20439 existing records. [2025-09-14T17:49:44.563911] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-14T17:49:44.727480] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:44.727775] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-14T17:49:44.727842] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-14T17:49:44.728490] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-14T17:49:44.728553] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-14T17:49:45.068635] [INFO ] [REMOTE ] ECL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:45.358842] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-14T17:49:45.795497] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T17:49:45.936066] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:49:46.158867] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-14T17:49:46.958880] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-14T17:49:47.358153] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T17:49:47.762597] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-14T17:49:47.767482] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T17:49:48.558837] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-14T17:49:48.959107] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T17:49:48.959962] [INFO ] [REMOTE ] ECCX: Full fetch complete (1148 records). [2025-09-14T17:49:48.960044] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-14T17:49:49.141049] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T17:49:49.141277] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:49:49.141413] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:49:49.141523] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-14T17:49:49.141613] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-14T17:49:49.141693] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-14T17:49:49.141791] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-14T17:49:49.141890] [INFO ] [MAIN ] Update Progress: 688/2370 symbols completed. ECCX took 20.6s. Estimated remaining: 2h 57m 33s. Rate: 9.5 symbols/min [2025-09-14T17:49:49.274401] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T17:49:49.335073] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:49.344240] [DEBUG] [LOCAL ] ECO: Loaded 7702 existing records from primary storage. [2025-09-14T17:49:49.344374] [INFO ] [MAIN ] ECO: Loaded 7702 existing records. [2025-09-14T17:49:49.364577] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-14T17:49:49.523865] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:49.524108] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-14T17:49:49.524167] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-14T17:49:49.524511] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-14T17:49:49.524567] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-14T17:49:49.903744] [INFO ] [REMOTE ] ECO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:50.158868] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-14T17:49:50.958830] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-14T17:49:51.170615] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T17:49:51.247433] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:49:51.758853] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-14T17:49:52.434077] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T17:49:52.438903] [INFO ] [REMOTE ] ECC: Full fetch complete (46662 records). [2025-09-14T17:49:52.439041] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-14T17:49:52.563922] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-14T17:49:52.835877] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-14T17:49:52.836020] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-14T17:49:52.836795] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-14T17:49:52.836873] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-14T17:49:52.850009] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:49:52.854670] [DEBUG] [LOCAL ] ECC: Trimmed 46662 records to 32304 (keeping 150 days of data) [2025-09-14T17:49:53.063339] [DEBUG] [LOCAL ] ECC: Primary data saved (32304 records). [2025-09-14T17:49:53.063581] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-14T17:49:53.063733] [INFO ] [MAIN ] Update Progress: 689/2370 symbols completed. ECC took 42.7s. Estimated remaining: 2h 57m 21s. Rate: 9.5 symbols/min [2025-09-14T17:49:53.248249] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:53.273245] [DEBUG] [LOCAL ] ECVT: Loaded 19414 existing records from primary storage. [2025-09-14T17:49:53.273491] [INFO ] [MAIN ] ECVT: Loaded 19414 existing records. [2025-09-14T17:49:53.364061] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-14T17:49:53.466517] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:53.466844] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-14T17:49:53.466911] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-14T17:49:53.467533] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-14T17:49:53.467613] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-14T17:49:53.829113] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:54.158881] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-14T17:49:54.485758] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:49:54.536088] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:49:54.549748] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:49:54.553477] [INFO ] [REMOTE ] ECG: Full fetch complete (39074 records). [2025-09-14T17:49:54.553633] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-14T17:49:54.966358] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-14T17:49:54.965411] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-14T17:49:54.967436] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-14T17:49:54.968410] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-14T17:49:54.968487] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-14T17:49:54.969926] [DEBUG] [LOCAL ] ECG: Trimmed 39074 records to 24863 (keeping 150 days of data) [2025-09-14T17:49:55.115659] [DEBUG] [LOCAL ] ECG: Primary data saved (24863 records). [2025-09-14T17:49:55.115827] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-14T17:49:55.115939] [INFO ] [MAIN ] Update Progress: 690/2370 symbols completed. ECG took 18.9s. Estimated remaining: 2h 57m 4s. Rate: 9.5 symbols/min [2025-09-14T17:49:55.283910] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:55.306926] [DEBUG] [LOCAL ] ED: Loaded 23576 existing records from primary storage. [2025-09-14T17:49:55.307097] [INFO ] [MAIN ] ED: Loaded 23576 existing records. [2025-09-14T17:49:55.482714] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:55.482969] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-14T17:49:55.483028] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-14T17:49:55.483816] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-14T17:49:55.483883] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-14T17:49:55.764080] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-14T17:49:55.857960] [INFO ] [REMOTE ] ED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:56.559081] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-14T17:49:56.950224] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:49:56.987431] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T17:49:57.358860] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-14T17:49:57.612633] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T17:49:58.158918] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-14T17:49:58.958823] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-14T17:49:59.105501] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:49:59.715866] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:49:59.758780] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-14T17:49:59.776614] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T17:50:00.558857] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-14T17:50:01.012452] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T17:50:01.358859] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-14T17:50:02.075779] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T17:50:02.158884] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-14T17:50:02.964133] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-14T17:50:02.979476] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:50:03.238019] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T17:50:03.758836] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-14T17:50:04.558851] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-14T17:50:04.807577] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:50:04.929038] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T17:50:05.358879] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-14T17:50:05.854782] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T17:50:06.091428] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:50:06.093570] [INFO ] [REMOTE ] ECO: Full fetch complete (20577 records). [2025-09-14T17:50:06.093679] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-14T17:50:06.163918] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-14T17:50:06.476147] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-14T17:50:06.476287] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-14T17:50:06.476853] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-14T17:50:06.476924] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-14T17:50:06.478046] [DEBUG] [LOCAL ] ECO: Trimmed 20577 records to 13176 (keeping 150 days of data) [2025-09-14T17:50:06.563926] [DEBUG] [LOCAL ] ECO: Primary data saved (13176 records). [2025-09-14T17:50:06.564138] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-14T17:50:06.564352] [INFO ] [MAIN ] Update Progress: 691/2370 symbols completed. ECO took 17.4s. Estimated remaining: 2h 57m 10s. Rate: 9.5 symbols/min [2025-09-14T17:50:06.736862] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:06.750776] [DEBUG] [LOCAL ] EDD: Loaded 13013 existing records from primary storage. [2025-09-14T17:50:06.750933] [INFO ] [MAIN ] EDD: Loaded 13013 existing records. [2025-09-14T17:50:06.924962] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:06.925210] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-14T17:50:06.925271] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-14T17:50:06.925723] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-14T17:50:06.925798] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-14T17:50:06.967721] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-14T17:50:07.281198] [INFO ] [REMOTE ] EDD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:07.758833] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-14T17:50:07.902996] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:50:08.558975] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-14T17:50:08.708439] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:50:08.760261] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:50:09.358916] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-14T17:50:10.127724] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T17:50:10.158792] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-14T17:50:10.958825] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-14T17:50:11.338178] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T17:50:11.758886] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-14T17:50:11.861559] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:50:11.923704] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T17:50:12.558833] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-14T17:50:13.358852] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-14T17:50:13.790301] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T17:50:13.818148] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:50:14.158832] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-14T17:50:14.876926] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:50:14.958807] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-14T17:50:15.393991] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T17:50:15.758842] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-14T17:50:15.941802] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:50:15.946537] [INFO ] [REMOTE ] ECVT: Full fetch complete (46167 records). [2025-09-14T17:50:15.946706] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-14T17:50:16.326033] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-14T17:50:16.326142] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-14T17:50:16.326823] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-14T17:50:16.326879] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-14T17:50:16.327906] [DEBUG] [LOCAL ] ECVT: Trimmed 46167 records to 32268 (keeping 150 days of data) [2025-09-14T17:50:16.525274] [DEBUG] [LOCAL ] ECVT: Primary data saved (32268 records). [2025-09-14T17:50:16.525511] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-14T17:50:16.525685] [INFO ] [MAIN ] Update Progress: 692/2370 symbols completed. ECVT took 23.5s. Estimated remaining: 2h 57m 13s. Rate: 9.5 symbols/min [2025-09-14T17:50:16.563924] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-14T17:50:16.703979] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:16.710973] [DEBUG] [LOCAL ] EDF: Loaded 5276 existing records from primary storage. [2025-09-14T17:50:16.711168] [INFO ] [MAIN ] EDF: Loaded 5276 existing records. [2025-09-14T17:50:16.887933] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:16.888196] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-14T17:50:16.888255] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-14T17:50:16.888552] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-14T17:50:16.888618] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-14T17:50:17.260060] [INFO ] [REMOTE ] EDF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:17.274777] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:50:17.280456] [INFO ] [REMOTE ] ECL: Full fetch complete (50910 records). [2025-09-14T17:50:17.280621] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-14T17:50:17.365743] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-14T17:50:17.687169] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-14T17:50:17.687495] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-14T17:50:17.688914] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-14T17:50:17.689286] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-14T17:50:17.692184] [DEBUG] [LOCAL ] ECL: Trimmed 50910 records to 34722 (keeping 150 days of data) [2025-09-14T17:50:17.841135] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:50:17.988468] [DEBUG] [LOCAL ] ECL: Primary data saved (34722 records). [2025-09-14T17:50:17.988677] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-14T17:50:17.988797] [INFO ] [MAIN ] Update Progress: 693/2370 symbols completed. ECL took 33.7s. Estimated remaining: 2h 56m 54s. Rate: 9.5 symbols/min [2025-09-14T17:50:18.159512] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-14T17:50:18.161804] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:18.173531] [DEBUG] [LOCAL ] EDN: Loaded 7851 existing records from primary storage. [2025-09-14T17:50:18.173747] [INFO ] [MAIN ] EDN: Loaded 7851 existing records. [2025-09-14T17:50:18.371075] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:18.382351] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-14T17:50:18.383004] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-14T17:50:18.383429] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T17:50:18.387986] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-14T17:50:18.388762] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-14T17:50:18.746017] [INFO ] [REMOTE ] EDN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:18.958814] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-14T17:50:19.759007] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-14T17:50:20.041986] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:50:20.117422] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T17:50:20.558834] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-14T17:50:20.596028] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:50:21.358862] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-14T17:50:22.158866] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-14T17:50:22.379291] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:50:22.443488] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:50:22.915773] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:50:22.958792] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-14T17:50:23.758825] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-14T17:50:24.004855] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T17:50:24.558846] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-14T17:50:24.756114] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:50:25.358788] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-14T17:50:25.738581] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T17:50:26.158841] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-14T17:50:26.830503] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T17:50:26.958876] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-14T17:50:27.194017] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T17:50:27.758878] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-14T17:50:28.073478] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T17:50:28.558829] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-14T17:50:29.237617] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:50:29.258692] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:50:29.358846] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-14T17:50:30.158838] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-14T17:50:30.261782] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:50:30.837554] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T17:50:30.958807] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-14T17:50:31.758804] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-14T17:50:31.952320] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:50:32.558787] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-14T17:50:32.941979] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T17:50:33.358816] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-14T17:50:33.640330] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T17:50:33.643984] [INFO ] [REMOTE ] EDD: Full fetch complete (29727 records). [2025-09-14T17:50:33.644122] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-14T17:50:34.011085] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-14T17:50:34.011190] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-14T17:50:34.011839] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-14T17:50:34.011920] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-14T17:50:34.012740] [DEBUG] [LOCAL ] EDD: Trimmed 29727 records to 20453 (keeping 150 days of data) [2025-09-14T17:50:34.132935] [DEBUG] [LOCAL ] EDD: Primary data saved (20453 records). [2025-09-14T17:50:34.133098] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-14T17:50:34.133214] [INFO ] [MAIN ] Update Progress: 694/2370 symbols completed. EDD took 27.6s. Estimated remaining: 2h 57m 12s. Rate: 9.5 symbols/min [2025-09-14T17:50:34.164008] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-14T17:50:34.307297] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:34.326724] [DEBUG] [LOCAL ] EDU: Loaded 19969 existing records from primary storage. [2025-09-14T17:50:34.326929] [INFO ] [MAIN ] EDU: Loaded 19969 existing records. [2025-09-14T17:50:34.506525] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:34.506867] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-14T17:50:34.507102] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-14T17:50:34.513353] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-14T17:50:34.520824] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:50:34.520203] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-14T17:50:34.874249] [INFO ] [REMOTE ] EDU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:34.907290] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:50:34.912900] [INFO ] [REMOTE ] ED: Full fetch complete (57401 records). [2025-09-14T17:50:34.913087] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-14T17:50:34.966269] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-14T17:50:35.298142] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-14T17:50:35.298267] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-14T17:50:35.299190] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-14T17:50:35.299253] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-14T17:50:35.300816] [DEBUG] [LOCAL ] ED: Trimmed 57401 records to 39716 (keeping 150 days of data) [2025-09-14T17:50:35.572257] [DEBUG] [LOCAL ] ED: Primary data saved (39716 records). [2025-09-14T17:50:35.572456] [INFO ] [MAIN ] ED: Full history saved. [2025-09-14T17:50:35.572591] [INFO ] [MAIN ] Update Progress: 695/2370 symbols completed. ED took 40.5s. Estimated remaining: 2h 56m 54s. Rate: 9.5 symbols/min [2025-09-14T17:50:35.776322] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-14T17:50:35.779060] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:35.797919] [DEBUG] [LOCAL ] EE: Loaded 14896 existing records from primary storage. [2025-09-14T17:50:35.798095] [INFO ] [MAIN ] EE: Loaded 14896 existing records. [2025-09-14T17:50:35.988573] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:35.988889] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-14T17:50:35.988952] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-14T17:50:35.989484] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-14T17:50:35.989555] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-14T17:50:36.341133] [INFO ] [REMOTE ] EE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:36.558802] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-14T17:50:36.647588] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:50:36.650417] [INFO ] [REMOTE ] EDN: Full fetch complete (19755 records). [2025-09-14T17:50:36.650523] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-14T17:50:37.019414] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-14T17:50:37.019663] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-14T17:50:37.020115] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-14T17:50:37.020203] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-14T17:50:37.021102] [DEBUG] [LOCAL ] EDN: Trimmed 19755 records to 13165 (keeping 150 days of data) [2025-09-14T17:50:37.108517] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-14T17:50:37.130973] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:50:37.143065] [DEBUG] [LOCAL ] EDN: Primary data saved (13165 records). [2025-09-14T17:50:37.145106] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-14T17:50:37.145224] [INFO ] [MAIN ] Update Progress: 696/2370 symbols completed. EDN took 19.2s. Estimated remaining: 2h 56m 36s. Rate: 9.5 symbols/min [2025-09-14T17:50:37.188735] [INFO ] [REMOTE ] EDF: Full fetch complete (15198 records). [2025-09-14T17:50:37.225390] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-14T17:50:37.363880] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-14T17:50:37.420328] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:37.487195] [DEBUG] [LOCAL ] EEA: Loaded 1247 existing records from primary storage. [2025-09-14T17:50:37.511598] [INFO ] [MAIN ] EEA: Loaded 1247 existing records. [2025-09-14T17:50:37.867346] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-14T17:50:37.871804] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:37.871960] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-14T17:50:37.872387] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-14T17:50:37.872587] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-14T17:50:37.872626] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-14T17:50:37.872853] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-14T17:50:37.873413] [DEBUG] [LOCAL ] EDF: Trimmed 15198 records to 9711 (keeping 150 days of data) [2025-09-14T17:50:37.873463] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-14T17:50:37.873596] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-14T17:50:38.168933] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-14T17:50:38.306000] [INFO ] [REMOTE ] EEA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:38.313233] [DEBUG] [LOCAL ] EDF: Primary data saved (9711 records). [2025-09-14T17:50:38.313405] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-14T17:50:38.313507] [INFO ] [MAIN ] Update Progress: 697/2370 symbols completed. EDF took 21.8s. Estimated remaining: 2h 56m 17s. Rate: 9.5 symbols/min [2025-09-14T17:50:38.485060] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:38.490406] [DEBUG] [LOCAL ] EEX: Loaded 3564 existing records from primary storage. [2025-09-14T17:50:38.490537] [INFO ] [MAIN ] EEX: Loaded 3564 existing records. [2025-09-14T17:50:38.680196] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:38.680466] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-14T17:50:38.680527] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-14T17:50:38.680888] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-14T17:50:38.680968] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-14T17:50:38.963887] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-14T17:50:39.038025] [INFO ] [REMOTE ] EEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:39.225411] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T17:50:39.315354] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T17:50:39.503912] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T17:50:39.758865] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-14T17:50:40.558871] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-14T17:50:40.570884] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T17:50:41.188763] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T17:50:41.358843] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-14T17:50:42.158894] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-14T17:50:42.679677] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T17:50:42.958822] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-14T17:50:43.603567] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T17:50:43.680298] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:50:43.758850] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-14T17:50:44.558899] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-14T17:50:44.926258] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T17:50:45.364737] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-14T17:50:45.366553] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:50:45.874190] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T17:50:46.158847] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-14T17:50:46.958833] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-14T17:50:47.485329] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T17:50:47.747265] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:50:47.758771] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-14T17:50:48.239429] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-14T17:50:48.558846] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-14T17:50:49.358837] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-14T17:50:49.936175] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T17:50:50.158885] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-14T17:50:50.958797] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-14T17:50:51.047259] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T17:50:51.389834] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:50:51.390685] [INFO ] [REMOTE ] EEA: Full fetch complete (3063 records). [2025-09-14T17:50:51.390766] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-14T17:50:51.767428] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-14T17:50:51.749884] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-14T17:50:51.769147] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:50:51.769263] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-14T17:50:51.777569] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-14T17:50:51.777684] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-14T17:50:51.778580] [DEBUG] [LOCAL ] EEA: Trimmed 3063 records to 2030 (keeping 150 days of data) [2025-09-14T17:50:51.791824] [DEBUG] [LOCAL ] EEA: Primary data saved (2030 records). [2025-09-14T17:50:51.792005] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-14T17:50:51.792117] [INFO ] [MAIN ] Update Progress: 698/2370 symbols completed. EEA took 14.6s. Estimated remaining: 2h 56m 28s. Rate: 9.5 symbols/min [2025-09-14T17:50:51.972529] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:51.993423] [DEBUG] [LOCAL ] EFC: Loaded 20603 existing records from primary storage. [2025-09-14T17:50:51.993592] [INFO ] [MAIN ] EFC: Loaded 20603 existing records. [2025-09-14T17:50:52.176347] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:52.176632] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-14T17:50:52.176704] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-14T17:50:52.177435] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-14T17:50:52.177498] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-14T17:50:52.543328] [INFO ] [REMOTE ] EFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:52.558783] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-14T17:50:53.358878] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-14T17:50:53.667700] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:50:54.104760] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T17:50:54.158867] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-14T17:50:54.242367] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:50:54.868250] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T17:50:54.958791] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-14T17:50:55.758828] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-14T17:50:55.829075] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T17:50:56.558825] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-14T17:50:57.358854] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-14T17:50:57.566142] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:50:57.971532] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:50:58.158974] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-14T17:50:58.771909] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:50:58.958833] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-14T17:50:59.049360] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T17:50:59.758881] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-14T17:51:00.443727] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T17:51:00.558834] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-14T17:51:01.161963] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T17:51:01.168471] [INFO ] [REMOTE ] EDU: Full fetch complete (49945 records). [2025-09-14T17:51:01.168727] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-14T17:51:01.364087] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-14T17:51:01.771925] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-14T17:51:01.772104] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-14T17:51:01.773235] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-14T17:51:01.773317] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-14T17:51:01.774894] [DEBUG] [LOCAL ] EDU: Trimmed 49945 records to 33261 (keeping 150 days of data) [2025-09-14T17:51:02.056052] [DEBUG] [LOCAL ] EDU: Primary data saved (33261 records). [2025-09-14T17:51:02.056285] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-14T17:51:02.056424] [INFO ] [MAIN ] Update Progress: 699/2370 symbols completed. EDU took 27.9s. Estimated remaining: 2h 56m 31s. Rate: 9.5 symbols/min [2025-09-14T17:51:02.164034] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-14T17:51:02.304809] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:02.314267] [DEBUG] [LOCAL ] EFR: Loaded 6770 existing records from primary storage. [2025-09-14T17:51:02.314449] [INFO ] [MAIN ] EFR: Loaded 6770 existing records. [2025-09-14T17:51:02.510075] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:02.510372] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-14T17:51:02.510450] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-14T17:51:02.510928] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-14T17:51:02.511024] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-14T17:51:02.866433] [INFO ] [REMOTE ] EFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:02.963901] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-14T17:51:02.978843] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-14T17:51:03.580863] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-14T17:51:03.584852] [INFO ] [REMOTE ] EE: Full fetch complete (34453 records). [2025-09-14T17:51:03.585047] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-14T17:51:03.767878] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-14T17:51:03.993432] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-14T17:51:03.993601] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-14T17:51:03.994850] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-14T17:51:03.994923] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-14T17:51:03.996474] [DEBUG] [LOCAL ] EE: Trimmed 34453 records to 24503 (keeping 150 days of data) [2025-09-14T17:51:04.145202] [DEBUG] [LOCAL ] EE: Primary data saved (24503 records). [2025-09-14T17:51:04.145395] [INFO ] [MAIN ] EE: Full history saved. [2025-09-14T17:51:04.145621] [INFO ] [MAIN ] Update Progress: 700/2370 symbols completed. EE took 28.6s. Estimated remaining: 2h 56m 15s. Rate: 9.5 symbols/min [2025-09-14T17:51:04.313464] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:04.321836] [DEBUG] [LOCAL ] EFT: Loaded 5289 existing records from primary storage. [2025-09-14T17:51:04.321989] [INFO ] [MAIN ] EFT: Loaded 5289 existing records. [2025-09-14T17:51:04.494672] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:04.494999] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-14T17:51:04.495061] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-14T17:51:04.495389] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-14T17:51:04.495472] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-14T17:51:04.685763] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:51:04.704784] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-14T17:51:04.791594] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-14T17:51:04.872949] [INFO ] [REMOTE ] EFT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:05.358781] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-14T17:51:05.687096] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T17:51:05.847804] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:51:05.858729] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T17:51:06.158862] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-14T17:51:06.958821] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-14T17:51:07.668352] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T17:51:07.758839] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-14T17:51:07.844781] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:51:08.558855] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-14T17:51:08.844364] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:51:09.358844] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-14T17:51:09.583917] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T17:51:09.981453] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T17:51:10.158828] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-14T17:51:10.958826] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-14T17:51:11.758809] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-14T17:51:11.949008] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:51:12.012235] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T17:51:12.458870] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T17:51:12.460296] [INFO ] [REMOTE ] EEX: Full fetch complete (13802 records). [2025-09-14T17:51:12.460392] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-14T17:51:12.560265] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-14T17:51:12.817763] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-14T17:51:12.817877] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-14T17:51:12.818225] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-14T17:51:12.818296] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-14T17:51:12.818859] [DEBUG] [LOCAL ] EEX: Trimmed 13802 records to 7466 (keeping 150 days of data) [2025-09-14T17:51:12.862166] [DEBUG] [LOCAL ] EEX: Primary data saved (7466 records). [2025-09-14T17:51:12.862307] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-14T17:51:12.862425] [INFO ] [MAIN ] Update Progress: 701/2370 symbols completed. EEX took 34.5s. Estimated remaining: 2h 56m 14s. Rate: 9.5 symbols/min [2025-09-14T17:51:13.029547] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:13.050152] [DEBUG] [LOCAL ] EFX: Loaded 19847 existing records from primary storage. [2025-09-14T17:51:13.050320] [INFO ] [MAIN ] EFX: Loaded 19847 existing records. [2025-09-14T17:51:13.232494] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:13.232965] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-14T17:51:13.233057] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-14T17:51:13.233832] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-14T17:51:13.233920] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-14T17:51:13.372787] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-14T17:51:13.589069] [INFO ] [REMOTE ] EFX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:14.158864] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-14T17:51:14.794907] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-14T17:51:14.958831] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-14T17:51:15.406368] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T17:51:15.758814] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-14T17:51:15.967259] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:51:15.981044] [INFO ] [REMOTE ] EFC: Full fetch complete (50080 records). [2025-09-14T17:51:15.995191] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-14T17:51:16.042356] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:51:16.393885] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-14T17:51:16.394062] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-14T17:51:16.394846] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-14T17:51:16.394916] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-14T17:51:16.404575] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T17:51:16.410346] [DEBUG] [LOCAL ] EFC: Trimmed 50080 records to 34360 (keeping 150 days of data) [2025-09-14T17:51:16.586521] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-14T17:51:16.638967] [DEBUG] [LOCAL ] EFC: Primary data saved (34360 records). [2025-09-14T17:51:16.639112] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-14T17:51:16.639209] [INFO ] [MAIN ] Update Progress: 702/2370 symbols completed. EFC took 24.8s. Estimated remaining: 2h 56m 2s. Rate: 9.5 symbols/min [2025-09-14T17:51:16.809680] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:16.823695] [DEBUG] [LOCAL ] EFXT: Loaded 13067 existing records from primary storage. [2025-09-14T17:51:16.823889] [INFO ] [MAIN ] EFXT: Loaded 13067 existing records. [2025-09-14T17:51:16.997832] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:16.998098] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-14T17:51:16.998155] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-14T17:51:16.998636] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-14T17:51:16.998724] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-14T17:51:17.364553] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-14T17:51:17.369759] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:17.420495] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T17:51:18.158825] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-14T17:51:18.845352] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:51:18.958801] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-14T17:51:19.059584] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:51:19.705406] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:51:19.707322] [INFO ] [REMOTE ] EFT: Full fetch complete (13105 records). [2025-09-14T17:51:19.707408] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-14T17:51:19.768288] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-14T17:51:20.084941] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-14T17:51:20.085102] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-14T17:51:20.085734] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-14T17:51:20.085807] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-14T17:51:20.086897] [DEBUG] [LOCAL ] EFT: Trimmed 13105 records to 9263 (keeping 150 days of data) [2025-09-14T17:51:20.151766] [DEBUG] [LOCAL ] EFT: Primary data saved (9263 records). [2025-09-14T17:51:20.152047] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-14T17:51:20.152194] [INFO ] [MAIN ] Update Progress: 703/2370 symbols completed. EFT took 16.0s. Estimated remaining: 2h 55m 48s. Rate: 9.5 symbols/min [2025-09-14T17:51:20.337663] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:20.352331] [DEBUG] [LOCAL ] EG: Loaded 11541 existing records from primary storage. [2025-09-14T17:51:20.352598] [INFO ] [MAIN ] EG: Loaded 11541 existing records. [2025-09-14T17:51:20.536252] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:20.536628] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-14T17:51:20.536748] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-14T17:51:20.537451] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-14T17:51:20.537523] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-14T17:51:20.568557] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-14T17:51:20.896460] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:51:20.981824] [INFO ] [REMOTE ] EG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:21.358866] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-14T17:51:21.744317] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:51:22.158886] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-14T17:51:22.392792] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T17:51:22.958808] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-14T17:51:23.432537] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:51:23.758876] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-14T17:51:23.997897] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T17:51:24.558838] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-14T17:51:25.363010] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-14T17:51:25.368361] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T17:51:26.158869] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-14T17:51:26.333978] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:51:26.861036] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T17:51:26.863122] [INFO ] [REMOTE ] EFR: Full fetch complete (14647 records). [2025-09-14T17:51:26.863218] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-14T17:51:26.963929] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-14T17:51:27.244623] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-14T17:51:27.244777] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-14T17:51:27.245228] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-14T17:51:27.245303] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-14T17:51:27.245986] [DEBUG] [LOCAL ] EFR: Trimmed 14647 records to 10568 (keeping 150 days of data) [2025-09-14T17:51:27.310039] [DEBUG] [LOCAL ] EFR: Primary data saved (10568 records). [2025-09-14T17:51:27.310227] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-14T17:51:27.310353] [INFO ] [MAIN ] Update Progress: 704/2370 symbols completed. EFR took 25.3s. Estimated remaining: 2h 55m 44s. Rate: 9.5 symbols/min [2025-09-14T17:51:27.478905] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:27.500678] [DEBUG] [LOCAL ] EGO: Loaded 22922 existing records from primary storage. [2025-09-14T17:51:27.500853] [INFO ] [MAIN ] EGO: Loaded 22922 existing records. [2025-09-14T17:51:27.679035] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:27.679344] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-14T17:51:27.679439] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-14T17:51:27.680066] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-14T17:51:27.680144] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-14T17:51:27.764482] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-14T17:51:28.061253] [INFO ] [REMOTE ] EGO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:28.385417] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T17:51:28.492298] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-14T17:51:28.558786] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-14T17:51:28.740208] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T17:51:29.358833] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-14T17:51:30.158900] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-14T17:51:30.348078] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T17:51:30.441732] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:51:30.958872] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-14T17:51:31.758893] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-14T17:51:31.922496] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:51:32.406781] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:51:32.558881] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-14T17:51:32.749775] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:51:33.358861] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-14T17:51:34.158831] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-14T17:51:34.295247] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T17:51:34.711841] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:51:34.958867] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-14T17:51:35.074017] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T17:51:35.758859] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-14T17:51:36.558889] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-14T17:51:36.743774] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:51:36.949726] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:51:37.358905] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-14T17:51:38.158858] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-14T17:51:38.317383] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:51:38.548539] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T17:51:38.958886] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-14T17:51:39.758910] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-14T17:51:39.895306] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T17:51:40.371478] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T17:51:40.374579] [INFO ] [REMOTE ] EG: Full fetch complete (32162 records). [2025-09-14T17:51:40.374710] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-14T17:51:40.563556] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-14T17:51:40.750472] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-14T17:51:40.750597] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-14T17:51:40.751399] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-14T17:51:40.751597] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-14T17:51:40.752918] [DEBUG] [LOCAL ] EG: Trimmed 32162 records to 21242 (keeping 150 days of data) [2025-09-14T17:51:40.867874] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:51:40.918748] [DEBUG] [LOCAL ] EG: Primary data saved (21242 records). [2025-09-14T17:51:40.918907] [INFO ] [MAIN ] EG: Full history saved. [2025-09-14T17:51:40.919046] [INFO ] [MAIN ] Update Progress: 705/2370 symbols completed. EG took 20.8s. Estimated remaining: 2h 55m 55s. Rate: 9.5 symbols/min [2025-09-14T17:51:41.096303] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:41.113250] [DEBUG] [LOCAL ] EGP: Loaded 13823 existing records from primary storage. [2025-09-14T17:51:41.113427] [INFO ] [MAIN ] EGP: Loaded 13823 existing records. [2025-09-14T17:51:41.287196] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:41.287486] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-14T17:51:41.287561] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-14T17:51:41.288110] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-14T17:51:41.288173] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-14T17:51:41.364079] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-14T17:51:41.648264] [INFO ] [REMOTE ] EGP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:41.854282] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T17:51:41.859587] [INFO ] [REMOTE ] EFX: Full fetch complete (49050 records). [2025-09-14T17:51:41.859845] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-14T17:51:42.160019] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-14T17:51:42.222056] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T17:51:42.280114] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-14T17:51:42.280510] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-14T17:51:42.281498] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-14T17:51:42.281582] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-14T17:51:42.283562] [DEBUG] [LOCAL ] EFX: Trimmed 49050 records to 33339 (keeping 150 days of data) [2025-09-14T17:51:42.511449] [DEBUG] [LOCAL ] EFX: Primary data saved (33339 records). [2025-09-14T17:51:42.511733] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-14T17:51:42.511863] [INFO ] [MAIN ] Update Progress: 706/2370 symbols completed. EFX took 29.6s. Estimated remaining: 2h 55m 37s. Rate: 9.5 symbols/min [2025-09-14T17:51:42.705406] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:42.723026] [DEBUG] [LOCAL ] EGY: Loaded 18092 existing records from primary storage. [2025-09-14T17:51:42.723234] [INFO ] [MAIN ] EGY: Loaded 18092 existing records. [2025-09-14T17:51:42.906405] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:42.906731] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-14T17:51:42.906795] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-14T17:51:42.907416] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-14T17:51:42.907493] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-14T17:51:42.970371] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-14T17:51:43.274170] [INFO ] [REMOTE ] EGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:43.506103] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T17:51:43.758822] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-14T17:51:44.297039] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T17:51:44.558837] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-14T17:51:45.267598] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T17:51:45.358828] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-14T17:51:46.135365] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T17:51:46.158772] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-14T17:51:46.244157] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T17:51:46.248502] [INFO ] [REMOTE ] EFXT: Full fetch complete (32361 records). [2025-09-14T17:51:46.248710] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-14T17:51:46.635783] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-14T17:51:46.635919] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-14T17:51:46.636522] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-14T17:51:46.636584] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-14T17:51:46.637568] [DEBUG] [LOCAL ] EFXT: Trimmed 32361 records to 21439 (keeping 150 days of data) [2025-09-14T17:51:46.767448] [DEBUG] [LOCAL ] EFXT: Primary data saved (21439 records). [2025-09-14T17:51:46.767656] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-14T17:51:46.767786] [INFO ] [MAIN ] Update Progress: 707/2370 symbols completed. EFXT took 30.1s. Estimated remaining: 2h 55m 26s. Rate: 9.5 symbols/min [2025-09-14T17:51:46.937876] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:46.952484] [DEBUG] [LOCAL ] EHAB: Loaded 14201 existing records from primary storage. [2025-09-14T17:51:46.952693] [INFO ] [MAIN ] EHAB: Loaded 14201 existing records. [2025-09-14T17:51:46.958834] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-14T17:51:47.143323] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:47.143719] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-14T17:51:47.143791] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-14T17:51:47.144451] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-14T17:51:47.144524] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-14T17:51:47.510470] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:47.554538] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T17:51:47.758851] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-14T17:51:48.558888] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-14T17:51:48.877545] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:51:49.366746] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-14T17:51:49.370598] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T17:51:49.556997] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:51:50.158839] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-14T17:51:50.651325] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:51:50.958886] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-14T17:51:51.488577] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:51:51.758858] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-14T17:51:52.264543] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T17:51:52.558857] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-14T17:51:53.124055] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:51:53.358845] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-14T17:51:53.581523] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:51:54.158890] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-14T17:51:54.842949] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:51:54.958853] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-14T17:51:55.527074] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T17:51:55.758870] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-14T17:51:56.294335] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T17:51:56.558882] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-14T17:51:57.262110] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:51:57.358802] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-14T17:51:57.856145] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:51:57.859859] [INFO ] [REMOTE ] EGP: Full fetch complete (34631 records). [2025-09-14T17:51:57.859958] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-14T17:51:58.163916] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-14T17:51:58.238769] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-14T17:51:58.238942] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-14T17:51:58.239574] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-14T17:51:58.239704] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-14T17:51:58.240919] [DEBUG] [LOCAL ] EGP: Trimmed 34631 records to 22583 (keeping 150 days of data) [2025-09-14T17:51:58.357060] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T17:51:58.418186] [DEBUG] [LOCAL ] EGP: Primary data saved (22583 records). [2025-09-14T17:51:58.418356] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-14T17:51:58.418499] [INFO ] [MAIN ] Update Progress: 708/2370 symbols completed. EGP took 17.5s. Estimated remaining: 2h 55m 32s. Rate: 9.5 symbols/min [2025-09-14T17:51:58.586318] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:58.605266] [DEBUG] [LOCAL ] EHC: Loaded 18581 existing records from primary storage. [2025-09-14T17:51:58.605426] [INFO ] [MAIN ] EHC: Loaded 18581 existing records. [2025-09-14T17:51:58.784434] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:58.784759] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-14T17:51:58.784827] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-14T17:51:58.785418] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-14T17:51:58.785510] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-14T17:51:58.969347] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-14T17:51:59.136832] [INFO ] [REMOTE ] EHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:59.627399] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T17:51:59.758785] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-14T17:52:00.558885] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-14T17:52:00.683389] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:52:01.358832] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-14T17:52:01.449222] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T17:52:01.609718] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T17:52:02.158853] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-14T17:52:02.958841] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-14T17:52:02.984161] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T17:52:02.990077] [INFO ] [REMOTE ] EGO: Full fetch complete (55805 records). [2025-09-14T17:52:02.990245] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-14T17:52:03.398057] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-14T17:52:03.398214] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-14T17:52:03.399322] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-14T17:52:03.399394] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-14T17:52:03.402564] [DEBUG] [LOCAL ] EGO: Trimmed 55805 records to 38604 (keeping 150 days of data) [2025-09-14T17:52:03.642349] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T17:52:03.687039] [DEBUG] [LOCAL ] EGO: Primary data saved (38604 records). [2025-09-14T17:52:03.687321] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-14T17:52:03.687578] [INFO ] [MAIN ] Update Progress: 709/2370 symbols completed. EGO took 36.4s. Estimated remaining: 2h 55m 24s. Rate: 9.5 symbols/min [2025-09-14T17:52:03.765466] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-14T17:52:03.874762] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:03.884811] [DEBUG] [LOCAL ] EHI: Loaded 4906 existing records from primary storage. [2025-09-14T17:52:03.885041] [INFO ] [MAIN ] EHI: Loaded 4906 existing records. [2025-09-14T17:52:04.090626] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:04.091121] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-14T17:52:04.091194] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-14T17:52:04.091675] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-14T17:52:04.091750] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-14T17:52:04.464772] [INFO ] [REMOTE ] EHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:04.474197] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:52:04.477563] [INFO ] [REMOTE ] EHAB: Full fetch complete (32297 records). [2025-09-14T17:52:04.477762] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-14T17:52:04.558801] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-14T17:52:04.863902] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-14T17:52:04.864221] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-14T17:52:04.865008] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-14T17:52:04.884743] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-14T17:52:04.889301] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T17:52:04.899165] [DEBUG] [LOCAL ] EHAB: Trimmed 32297 records to 22977 (keeping 150 days of data) [2025-09-14T17:52:05.041588] [DEBUG] [LOCAL ] EHAB: Primary data saved (22977 records). [2025-09-14T17:52:05.041782] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-14T17:52:05.041964] [INFO ] [MAIN ] Update Progress: 710/2370 symbols completed. EHAB took 18.3s. Estimated remaining: 2h 55m 6s. Rate: 9.5 symbols/min [2025-09-14T17:52:05.212836] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:05.224752] [DEBUG] [LOCAL ] EIC: Loaded 10407 existing records from primary storage. [2025-09-14T17:52:05.224896] [INFO ] [MAIN ] EIC: Loaded 10407 existing records. [2025-09-14T17:52:05.365730] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-14T17:52:05.404441] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:05.404609] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-14T17:52:05.404687] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-14T17:52:05.405143] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-14T17:52:05.405207] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-14T17:52:05.757953] [INFO ] [REMOTE ] EIC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:06.168423] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-14T17:52:06.170689] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:52:06.297920] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T17:52:06.958841] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-14T17:52:07.758803] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-14T17:52:07.785635] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T17:52:08.489135] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T17:52:08.518114] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:52:08.558823] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-14T17:52:09.358841] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-14T17:52:09.956453] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T17:52:09.962852] [INFO ] [REMOTE ] EGY: Full fetch complete (45896 records). [2025-09-14T17:52:09.963110] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-14T17:52:10.166539] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-14T17:52:10.361238] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-14T17:52:10.361357] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-14T17:52:10.362141] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-14T17:52:10.362217] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-14T17:52:10.363281] [DEBUG] [LOCAL ] EGY: Trimmed 45896 records to 31091 (keeping 150 days of data) [2025-09-14T17:52:10.560633] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T17:52:10.580743] [DEBUG] [LOCAL ] EGY: Primary data saved (31091 records). [2025-09-14T17:52:10.580908] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-14T17:52:10.581039] [INFO ] [MAIN ] Update Progress: 711/2370 symbols completed. EGY took 28.1s. Estimated remaining: 2h 54m 57s. Rate: 9.5 symbols/min [2025-09-14T17:52:10.749321] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:10.751556] [DEBUG] [LOCAL ] EICA: Loaded 404 existing records from primary storage. [2025-09-14T17:52:10.751662] [INFO ] [MAIN ] EICA: Loaded 404 existing records. [2025-09-14T17:52:10.928979] [WARN ] [MAIN ] EICA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:10.929259] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-14T17:52:10.929318] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-14T17:52:10.929490] [DEBUG] [LOCAL ] EICA: Deleted primary data file. [2025-09-14T17:52:10.929551] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-14T17:52:10.964023] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-14T17:52:11.322015] [INFO ] [REMOTE ] EICA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:11.758862] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-14T17:52:11.802888] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T17:52:12.138221] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T17:52:12.229844] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:52:12.558832] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-14T17:52:13.358877] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-14T17:52:13.763861] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T17:52:14.164324] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-14T17:52:14.167887] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T17:52:14.958937] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-14T17:52:15.310978] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T17:52:15.758874] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-14T17:52:16.167005] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-14T17:52:16.528705] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:52:16.558815] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-14T17:52:17.358844] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-14T17:52:17.969632] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T17:52:18.150884] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T17:52:18.158766] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-14T17:52:18.958806] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-14T17:52:19.190436] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T17:52:19.758821] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-14T17:52:20.563911] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-14T17:52:20.579259] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T17:52:20.642760] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T17:52:21.358854] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-14T17:52:21.695599] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:52:21.755635] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-14T17:52:22.158846] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-14T17:52:22.545877] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T17:52:22.958842] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-14T17:52:23.759251] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-14T17:52:23.760099] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:52:24.558857] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-14T17:52:25.124454] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:52:25.358880] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-14T17:52:25.900232] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T17:52:26.158869] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-14T17:52:26.501018] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T17:52:26.598625] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T17:52:26.602783] [INFO ] [REMOTE ] EHC: Full fetch complete (45298 records). [2025-09-14T17:52:26.602922] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-14T17:52:26.962287] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-14T17:52:26.977830] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-14T17:52:26.977943] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-14T17:52:26.978715] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-14T17:52:26.978871] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-14T17:52:26.979979] [DEBUG] [LOCAL ] EHC: Trimmed 45298 records to 31562 (keeping 150 days of data) [2025-09-14T17:52:27.189595] [DEBUG] [LOCAL ] EHC: Primary data saved (31562 records). [2025-09-14T17:52:27.189802] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-14T17:52:27.189915] [INFO ] [MAIN ] Update Progress: 712/2370 symbols completed. EHC took 28.8s. Estimated remaining: 2h 55m 15s. Rate: 9.5 symbols/min [2025-09-14T17:52:27.357040] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:27.360134] [DEBUG] [LOCAL ] EICB: Loaded 1011 existing records from primary storage. [2025-09-14T17:52:27.360228] [INFO ] [MAIN ] EICB: Loaded 1011 existing records. [2025-09-14T17:52:27.450810] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T17:52:27.536605] [WARN ] [MAIN ] EICB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:27.536903] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-14T17:52:27.536972] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-14T17:52:27.537230] [DEBUG] [LOCAL ] EICB: Deleted primary data file. [2025-09-14T17:52:27.537287] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-14T17:52:27.768051] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-14T17:52:27.881830] [INFO ] [REMOTE ] EICB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:28.449733] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:52:28.451476] [INFO ] [REMOTE ] EHI: Full fetch complete (11448 records). [2025-09-14T17:52:28.451580] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-14T17:52:28.563925] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-14T17:52:28.813829] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-14T17:52:28.813978] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-14T17:52:28.814330] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-14T17:52:28.814399] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-14T17:52:28.814912] [DEBUG] [LOCAL ] EHI: Trimmed 11448 records to 7822 (keeping 150 days of data) [2025-09-14T17:52:28.862116] [DEBUG] [LOCAL ] EHI: Primary data saved (7822 records). [2025-09-14T17:52:28.862297] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-14T17:52:28.862428] [INFO ] [MAIN ] Update Progress: 713/2370 symbols completed. EHI took 25.2s. Estimated remaining: 2h 54m 58s. Rate: 9.5 symbols/min [2025-09-14T17:52:29.033891] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:29.036383] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-14T17:52:29.043153] [DEBUG] [LOCAL ] EICC: Loaded 4350 existing records from primary storage. [2025-09-14T17:52:29.043269] [INFO ] [MAIN ] EICC: Loaded 4350 existing records. [2025-09-14T17:52:29.218234] [WARN ] [MAIN ] EICC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:29.218518] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-14T17:52:29.218579] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-14T17:52:29.219140] [DEBUG] [LOCAL ] EICC: Deleted primary data file. [2025-09-14T17:52:29.219206] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-14T17:52:29.366355] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-14T17:52:29.572587] [INFO ] [REMOTE ] EICC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:30.158825] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-14T17:52:30.645026] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T17:52:30.891763] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T17:52:30.894256] [INFO ] [REMOTE ] EIC: Full fetch complete (27054 records). [2025-09-14T17:52:30.894506] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-14T17:52:30.963934] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-14T17:52:31.279143] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-14T17:52:31.279248] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-14T17:52:31.279833] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-14T17:52:31.279897] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-14T17:52:31.280600] [DEBUG] [LOCAL ] EIC: Trimmed 27054 records to 18009 (keeping 150 days of data) [2025-09-14T17:52:31.395558] [DEBUG] [LOCAL ] EIC: Primary data saved (18009 records). [2025-09-14T17:52:31.395758] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-14T17:52:31.395927] [INFO ] [MAIN ] Update Progress: 714/2370 symbols completed. EIC took 26.4s. Estimated remaining: 2h 54m 43s. Rate: 9.5 symbols/min [2025-09-14T17:52:31.511804] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T17:52:31.572491] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:31.583160] [DEBUG] [LOCAL ] EIG: Loaded 9773 existing records from primary storage. [2025-09-14T17:52:31.583340] [INFO ] [MAIN ] EIG: Loaded 9773 existing records. [2025-09-14T17:52:31.762906] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-14T17:52:31.762808] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:31.764444] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-14T17:52:31.764679] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-14T17:52:31.765044] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-14T17:52:31.765103] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-14T17:52:32.113819] [INFO ] [REMOTE ] EIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:32.261735] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T17:52:32.558840] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-14T17:52:33.021544] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:52:33.358864] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-14T17:52:33.634930] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-14T17:52:33.635775] [INFO ] [REMOTE ] EICA: Full fetch complete (870 records). [2025-09-14T17:52:33.635872] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-14T17:52:33.816076] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 144 unique days, need 150 days [2025-09-14T17:52:33.816329] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:52:33.816423] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:52:33.816517] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-14T17:52:33.816610] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-14T17:52:33.816716] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-14T17:52:33.816816] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-14T17:52:33.816944] [INFO ] [MAIN ] Update Progress: 715/2370 symbols completed. EICA took 23.2s. Estimated remaining: 2h 54m 27s. Rate: 9.5 symbols/min [2025-09-14T17:52:33.992741] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:34.016969] [DEBUG] [LOCAL ] EIX: Loaded 23962 existing records from primary storage. [2025-09-14T17:52:34.017149] [INFO ] [MAIN ] EIX: Loaded 23962 existing records. [2025-09-14T17:52:34.164186] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-14T17:52:34.205539] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:34.205840] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-14T17:52:34.205918] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-14T17:52:34.206598] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-14T17:52:34.206712] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-14T17:52:34.575613] [INFO ] [REMOTE ] EIX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:34.705062] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T17:52:34.958874] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-14T17:52:35.758883] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-14T17:52:36.558890] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-14T17:52:36.713086] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:52:36.754499] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:52:37.074278] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T17:52:37.358863] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-14T17:52:38.158803] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-14T17:52:38.425304] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:52:38.601118] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T17:52:38.958878] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-14T17:52:39.463578] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T17:52:39.758890] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-14T17:52:40.216087] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:52:40.558898] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-14T17:52:41.358864] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-14T17:52:41.826702] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T17:52:42.158845] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-14T17:52:42.557016] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T17:52:42.679401] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T17:52:42.958838] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-14T17:52:43.758872] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-14T17:52:44.204263] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T17:52:44.558885] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-14T17:52:44.938045] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:52:45.358892] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-14T17:52:45.772086] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T17:52:45.883105] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T17:52:46.158893] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-14T17:52:46.683057] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T17:52:46.958926] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-14T17:52:47.456216] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T17:52:47.758871] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-14T17:52:48.169612] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:52:48.170538] [INFO ] [REMOTE ] EICB: Full fetch complete (1985 records). [2025-09-14T17:52:48.170624] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-14T17:52:48.356486] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T17:52:48.356739] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:52:48.356796] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:52:48.356857] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-14T17:52:48.356970] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-14T17:52:48.357053] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-14T17:52:48.357126] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-14T17:52:48.357209] [INFO ] [MAIN ] Update Progress: 716/2370 symbols completed. EICB took 21.2s. Estimated remaining: 2h 54m 40s. Rate: 9.5 symbols/min [2025-09-14T17:52:48.562484] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-14T17:52:48.564201] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:48.590311] [DEBUG] [LOCAL ] EL: Loaded 24025 existing records from primary storage. [2025-09-14T17:52:48.590544] [INFO ] [MAIN ] EL: Loaded 24025 existing records. [2025-09-14T17:52:48.771671] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:48.771942] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-14T17:52:48.772005] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-14T17:52:48.772700] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-14T17:52:48.772764] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-14T17:52:49.062220] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:52:49.074951] [INFO ] [REMOTE ] EICC: Full fetch complete (6264 records). [2025-09-14T17:52:49.091071] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-14T17:52:49.249422] [INFO ] [REMOTE ] EL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:49.364096] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-14T17:52:49.531186] [DEBUG] [VALIDATOR ] EICC: All expected trading days are present. [2025-09-14T17:52:49.531291] [DEBUG] [VALIDATOR ] EICC: Primary data validation passed. [2025-09-14T17:52:49.531490] [INFO ] [MAIN ] EICC: Fetched primary data is valid. [2025-09-14T17:52:49.531545] [DEBUG] [LOCAL ] EICC: Saving primary data. [2025-09-14T17:52:49.531987] [DEBUG] [LOCAL ] EICC: Trimmed 6264 records to 4350 (keeping 150 days of data) [2025-09-14T17:52:49.558479] [DEBUG] [LOCAL ] EICC: Primary data saved (4350 records). [2025-09-14T17:52:49.558566] [INFO ] [MAIN ] EICC: Full history saved. [2025-09-14T17:52:49.558672] [INFO ] [MAIN ] Update Progress: 717/2370 symbols completed. EICC took 20.7s. Estimated remaining: 2h 54m 22s. Rate: 9.5 symbols/min [2025-09-14T17:52:50.158899] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-14T17:52:50.958840] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-14T17:52:51.254526] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T17:52:51.428437] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T17:52:51.758922] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-14T17:52:52.558881] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-14T17:52:52.628143] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T17:52:52.839569] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:52:53.358925] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-14T17:52:54.158872] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-14T17:52:54.380861] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T17:52:54.551460] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:52:54.958822] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-14T17:52:55.758815] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-14T17:52:56.037526] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:52:56.086505] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T17:52:56.558877] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-14T17:52:56.879492] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:52:56.882123] [INFO ] [REMOTE ] EIG: Full fetch complete (21632 records). [2025-09-14T17:52:56.882211] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-14T17:52:57.247165] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-14T17:52:57.247276] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-14T17:52:57.247789] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-14T17:52:57.247893] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-14T17:52:57.248610] [DEBUG] [LOCAL ] EIG: Trimmed 21632 records to 15585 (keeping 150 days of data) [2025-09-14T17:52:57.346873] [DEBUG] [LOCAL ] EIG: Primary data saved (15585 records). [2025-09-14T17:52:57.347053] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-14T17:52:57.347160] [INFO ] [MAIN ] Update Progress: 718/2370 symbols completed. EIG took 26.0s. Estimated remaining: 2h 54m 19s. Rate: 9.5 symbols/min [2025-09-14T17:52:57.358851] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-14T17:52:57.908463] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T17:52:58.158792] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-14T17:52:59.088345] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T17:52:59.100442] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-14T17:53:00.373944] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-14T17:53:00.386252] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-14T17:53:00.998684] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:53:01.010970] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-14T17:53:01.678144] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:53:01.683785] [INFO ] [REMOTE ] EIX: Full fetch complete (58038 records). [2025-09-14T17:53:01.683920] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-14T17:53:02.064769] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-14T17:53:02.064906] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-14T17:53:02.065753] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-14T17:53:02.065823] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-14T17:53:02.067147] [DEBUG] [LOCAL ] EIX: Trimmed 58038 records to 40171 (keeping 150 days of data) [2025-09-14T17:53:02.326346] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T17:53:02.339475] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-14T17:53:02.366924] [DEBUG] [LOCAL ] EIX: Primary data saved (40171 records). [2025-09-14T17:53:02.367190] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-14T17:53:02.367337] [INFO ] [MAIN ] Update Progress: 719/2370 symbols completed. EIX took 28.6s. Estimated remaining: 2h 54m 9s. Rate: 9.5 symbols/min [2025-09-14T17:53:04.682128] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-14T17:53:04.694816] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-14T17:53:06.676732] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:53:06.688708] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-14T17:53:07.003308] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:53:07.009823] [INFO ] [REMOTE ] EL: Full fetch complete (58159 records). [2025-09-14T17:53:07.009957] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-14T17:53:07.396604] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-14T17:53:07.396732] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-14T17:53:07.397492] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-14T17:53:07.397550] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-14T17:53:07.398816] [DEBUG] [LOCAL ] EL: Trimmed 58159 records to 40296 (keeping 150 days of data) [2025-09-14T17:53:07.663691] [DEBUG] [LOCAL ] EL: Primary data saved (40296 records). [2025-09-14T17:53:07.663853] [INFO ] [MAIN ] EL: Full history saved. [2025-09-14T17:53:07.663949] [INFO ] [MAIN ] Update Progress: 720/2370 symbols completed. EL took 19.3s. Estimated remaining: 2h 54m 1s. Rate: 9.5 symbols/min [2025-09-14T17:53:08.278835] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:08.408555] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:08.451978] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:08.419406] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:08.457713] [DEBUG] [LOCAL ] ELC: Loaded 1702 existing records from primary storage. [2025-09-14T17:53:08.458215] [INFO ] [MAIN ] ELC: Loaded 1702 existing records. [2025-09-14T17:53:08.600846] [DEBUG] [LOCAL ] ELME: Loaded 18347 existing records from primary storage. [2025-09-14T17:53:08.618352] [INFO ] [MAIN ] ELME: Loaded 18347 existing records. [2025-09-14T17:53:08.687004] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:08.693239] [DEBUG] [LOCAL ] ELAN: Loaded 23813 existing records from primary storage. [2025-09-14T17:53:08.704566] [INFO ] [MAIN ] ELAN: Loaded 23813 existing records. [2025-09-14T17:53:08.720490] [DEBUG] [LOCAL ] ELF: Loaded 23240 existing records from primary storage. [2025-09-14T17:53:08.742224] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-14T17:53:08.736926] [INFO ] [MAIN ] ELF: Loaded 23240 existing records. [2025-09-14T17:53:08.780299] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-14T17:53:08.955055] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-14T17:53:09.022104] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-14T17:53:09.222112] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:09.287088] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-14T17:53:09.343685] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:09.365895] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-14T17:53:09.360316] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:09.379414] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-14T17:53:09.379818] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-14T17:53:09.379954] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-14T17:53:09.380266] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-14T17:53:09.386068] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-14T17:53:09.386147] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-14T17:53:09.386325] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-14T17:53:09.401949] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-14T17:53:09.391556] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-14T17:53:09.531932] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-14T17:53:10.074686] [INFO ] [REMOTE ] ELC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:10.135044] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-14T17:53:10.782352] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:10.839038] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-14T17:53:10.861716] [INFO ] [REMOTE ] ELME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:10.900367] [INFO ] [REMOTE ] ELF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:10.900737] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T17:53:10.901553] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-14T17:53:10.903800] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-14T17:53:10.901941] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-14T17:53:11.452819] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T17:53:11.454253] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-14T17:53:12.073958] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T17:53:12.075589] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-14T17:53:12.368748] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T17:53:12.377091] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-14T17:53:12.620825] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T17:53:12.622371] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-14T17:53:12.698932] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T17:53:12.710022] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-14T17:53:13.211360] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-14T17:53:13.222537] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-14T17:53:13.266697] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T17:53:13.268553] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-14T17:53:13.664334] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T17:53:13.666036] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-14T17:53:13.843991] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:53:14.158830] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-14T17:53:14.210928] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-14T17:53:14.332955] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T17:53:14.958862] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-14T17:53:15.358983] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-14T17:53:15.722000] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:53:15.758830] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-14T17:53:16.558867] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-14T17:53:16.891280] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T17:53:17.358877] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-14T17:53:17.890338] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T17:53:18.037964] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T17:53:18.158829] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-14T17:53:18.678874] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:53:18.680204] [INFO ] [REMOTE ] ELC: Full fetch complete (3810 records). [2025-09-14T17:53:18.680300] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-14T17:53:18.964155] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-14T17:53:19.069136] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-14T17:53:19.069312] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-14T17:53:19.069555] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-14T17:53:19.069714] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-14T17:53:19.070338] [DEBUG] [LOCAL ] ELC: Trimmed 3810 records to 2672 (keeping 150 days of data) [2025-09-14T17:53:19.088573] [DEBUG] [LOCAL ] ELC: Primary data saved (2672 records). [2025-09-14T17:53:19.088875] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-14T17:53:19.089016] [INFO ] [MAIN ] Update Progress: 721/2370 symbols completed. ELC took 11.4s. Estimated remaining: 2h 54m 6s. Rate: 9.5 symbols/min [2025-09-14T17:53:19.261747] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:53:19.329758] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:19.343381] [DEBUG] [LOCAL ] ELP: Loaded 11525 existing records from primary storage. [2025-09-14T17:53:19.343580] [INFO ] [MAIN ] ELP: Loaded 11525 existing records. [2025-09-14T17:53:19.526712] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:19.527179] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-14T17:53:19.527242] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-14T17:53:19.527634] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-14T17:53:19.527743] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-14T17:53:19.765368] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-14T17:53:19.930848] [INFO ] [REMOTE ] ELP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:20.418215] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T17:53:20.558826] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-14T17:53:21.336636] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T17:53:21.358774] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-14T17:53:22.093316] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:53:22.158845] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-14T17:53:22.958871] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-14T17:53:23.220086] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T17:53:23.246591] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:53:23.758882] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-14T17:53:24.558844] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-14T17:53:24.652362] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:53:24.815942] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:53:25.358850] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-14T17:53:26.158883] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-14T17:53:26.410206] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T17:53:26.438839] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:53:26.958865] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-14T17:53:27.758839] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-14T17:53:27.849428] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:53:28.533605] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T17:53:28.539213] [INFO ] [REMOTE ] ELAN: Full fetch complete (57746 records). [2025-09-14T17:53:28.539336] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-14T17:53:28.570364] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-14T17:53:28.928695] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-14T17:53:28.928808] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-14T17:53:28.930238] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-14T17:53:28.930298] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-14T17:53:28.931588] [DEBUG] [LOCAL ] ELAN: Trimmed 57746 records to 40091 (keeping 150 days of data) [2025-09-14T17:53:29.178884] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T17:53:29.205012] [DEBUG] [LOCAL ] ELAN: Primary data saved (40091 records). [2025-09-14T17:53:29.205183] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-14T17:53:29.205293] [INFO ] [MAIN ] Update Progress: 722/2370 symbols completed. ELAN took 21.5s. Estimated remaining: 2h 54m 8s. Rate: 9.5 symbols/min [2025-09-14T17:53:29.373451] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-14T17:53:29.376056] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:29.379982] [DEBUG] [LOCAL ] ELPC: Loaded 311 existing records from primary storage. [2025-09-14T17:53:29.380236] [INFO ] [MAIN ] ELPC: Loaded 311 existing records. [2025-09-14T17:53:29.559363] [WARN ] [MAIN ] ELPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:29.559617] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-14T17:53:29.559696] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-14T17:53:29.560053] [DEBUG] [LOCAL ] ELPC: Deleted primary data file. [2025-09-14T17:53:29.560117] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-14T17:53:29.908247] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:30.036529] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:53:30.041524] [INFO ] [REMOTE ] ELME: Full fetch complete (42728 records). [2025-09-14T17:53:30.041732] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-14T17:53:30.163945] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-14T17:53:30.418191] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-14T17:53:30.418371] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-14T17:53:30.419218] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-14T17:53:30.419313] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-14T17:53:30.420500] [DEBUG] [LOCAL ] ELME: Trimmed 42728 records to 29297 (keeping 150 days of data) [2025-09-14T17:53:30.557470] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T17:53:30.642877] [DEBUG] [LOCAL ] ELME: Primary data saved (29297 records). [2025-09-14T17:53:30.643048] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-14T17:53:30.643168] [INFO ] [MAIN ] Update Progress: 723/2370 symbols completed. ELME took 23.0s. Estimated remaining: 2h 53m 51s. Rate: 9.5 symbols/min [2025-09-14T17:53:30.814466] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:30.838274] [DEBUG] [LOCAL ] ELS: Loaded 22338 existing records from primary storage. [2025-09-14T17:53:30.838444] [INFO ] [MAIN ] ELS: Loaded 22338 existing records. [2025-09-14T17:53:30.963948] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-14T17:53:31.021510] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:31.021802] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-14T17:53:31.021872] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-14T17:53:31.022534] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-14T17:53:31.022595] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-14T17:53:31.380217] [INFO ] [REMOTE ] ELS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:31.473274] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T17:53:31.521995] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T17:53:31.758865] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-14T17:53:32.558847] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-14T17:53:33.358804] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-14T17:53:33.820753] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T17:53:33.895920] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:53:34.158840] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-14T17:53:34.963920] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-14T17:53:34.978020] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:53:35.403927] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T17:53:35.758849] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-14T17:53:36.237674] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T17:53:36.392398] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-14T17:53:36.558880] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-14T17:53:37.358867] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-14T17:53:38.047477] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T17:53:38.052817] [INFO ] [REMOTE ] ELF: Full fetch complete (57026 records). [2025-09-14T17:53:38.052959] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-14T17:53:38.163993] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-14T17:53:38.442583] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-14T17:53:38.442861] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-14T17:53:38.443804] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-14T17:53:38.444317] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-14T17:53:38.445869] [DEBUG] [LOCAL ] ELF: Trimmed 57026 records to 39284 (keeping 150 days of data) [2025-09-14T17:53:38.541054] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T17:53:38.742051] [DEBUG] [LOCAL ] ELF: Primary data saved (39284 records). [2025-09-14T17:53:38.742302] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-14T17:53:38.742472] [INFO ] [MAIN ] Update Progress: 724/2370 symbols completed. ELF took 31.1s. Estimated remaining: 2h 53m 49s. Rate: 9.5 symbols/min [2025-09-14T17:53:38.910908] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:38.933547] [DEBUG] [LOCAL ] ELV: Loaded 23102 existing records from primary storage. [2025-09-14T17:53:38.933758] [INFO ] [MAIN ] ELV: Loaded 23102 existing records. [2025-09-14T17:53:38.964028] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-14T17:53:39.114498] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:39.114895] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-14T17:53:39.114960] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-14T17:53:39.115743] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-14T17:53:39.115810] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-14T17:53:39.477171] [INFO ] [REMOTE ] ELV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:39.492584] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T17:53:39.758840] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-14T17:53:40.558842] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-14T17:53:40.698692] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:53:41.228906] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T17:53:41.358847] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-14T17:53:41.409060] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:53:41.411707] [INFO ] [REMOTE ] ELP: Full fetch complete (28272 records). [2025-09-14T17:53:41.411796] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-14T17:53:41.777051] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-14T17:53:41.777170] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-14T17:53:41.777741] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-14T17:53:41.777807] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-14T17:53:41.778532] [DEBUG] [LOCAL ] ELP: Trimmed 28272 records to 19609 (keeping 150 days of data) [2025-09-14T17:53:41.890265] [DEBUG] [LOCAL ] ELP: Primary data saved (19609 records). [2025-09-14T17:53:41.890443] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-14T17:53:41.890559] [INFO ] [MAIN ] Update Progress: 725/2370 symbols completed. ELP took 22.8s. Estimated remaining: 2h 53m 35s. Rate: 9.5 symbols/min [2025-09-14T17:53:42.058725] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:42.066829] [DEBUG] [LOCAL ] EMA: Loaded 6458 existing records from primary storage. [2025-09-14T17:53:42.066956] [INFO ] [MAIN ] EMA: Loaded 6458 existing records. [2025-09-14T17:53:42.164523] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-14T17:53:42.244746] [WARN ] [MAIN ] EMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:42.244995] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-14T17:53:42.245053] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-14T17:53:42.245398] [DEBUG] [LOCAL ] EMA: Deleted primary data file. [2025-09-14T17:53:42.245476] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-14T17:53:42.602809] [INFO ] [REMOTE ] EMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:42.676906] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T17:53:42.958864] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-14T17:53:43.024701] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T17:53:43.758853] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-14T17:53:44.117190] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-14T17:53:44.558854] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-14T17:53:44.823412] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:53:44.823836] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-14T17:53:44.869625] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T17:53:45.358846] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-14T17:53:46.158869] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-14T17:53:46.526560] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T17:53:46.958866] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-14T17:53:47.191615] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:53:47.194769] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-14T17:53:47.196663] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T17:53:47.758824] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-14T17:53:48.558846] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-14T17:53:49.358865] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-14T17:53:49.439518] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T17:53:49.754828] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T17:53:50.158817] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-14T17:53:50.455030] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:53:50.508235] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:53:50.508936] [INFO ] [REMOTE ] ELPC: Full fetch complete (979 records). [2025-09-14T17:53:50.509017] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-14T17:53:50.690837] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T17:53:50.691078] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:53:50.691134] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:53:50.691196] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-14T17:53:50.691274] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-14T17:53:50.691324] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-14T17:53:50.691391] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-14T17:53:50.691505] [INFO ] [MAIN ] Update Progress: 726/2370 symbols completed. ELPC took 21.5s. Estimated remaining: 2h 53m 34s. Rate: 9.5 symbols/min [2025-09-14T17:53:50.860874] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:50.871592] [DEBUG] [LOCAL ] EMD: Loaded 9281 existing records from primary storage. [2025-09-14T17:53:50.871769] [INFO ] [MAIN ] EMD: Loaded 9281 existing records. [2025-09-14T17:53:50.963975] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-14T17:53:51.053727] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:51.053982] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-14T17:53:51.054044] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-14T17:53:51.054430] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-14T17:53:51.054503] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-14T17:53:51.298201] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:53:51.328390] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-14T17:53:51.406331] [INFO ] [REMOTE ] EMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:51.758854] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-14T17:53:52.558821] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-14T17:53:52.945993] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T17:53:52.947722] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:53:53.358884] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-14T17:53:54.158960] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-14T17:53:54.958915] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-14T17:53:55.199816] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:53:55.242854] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:53:55.758850] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-14T17:53:56.130021] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:53:56.558903] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-14T17:53:57.251708] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:53:57.358880] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-14T17:53:57.444095] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:53:58.159057] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-14T17:53:58.700250] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:53:58.709620] [INFO ] [REMOTE ] ELS: Full fetch complete (53269 records). [2025-09-14T17:53:58.709936] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-14T17:53:58.960455] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-14T17:53:59.298529] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-14T17:53:59.298722] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-14T17:53:59.299684] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-14T17:53:59.299754] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-14T17:53:59.301136] [DEBUG] [LOCAL ] ELS: Trimmed 53269 records to 37194 (keeping 150 days of data) [2025-09-14T17:53:59.423872] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T17:53:59.562830] [DEBUG] [LOCAL ] ELS: Primary data saved (37194 records). [2025-09-14T17:53:59.563007] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-14T17:53:59.563112] [INFO ] [MAIN ] Update Progress: 727/2370 symbols completed. ELS took 28.9s. Estimated remaining: 2h 53m 34s. Rate: 9.5 symbols/min [2025-09-14T17:53:59.731296] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:59.744986] [DEBUG] [LOCAL ] EME: Loaded 12676 existing records from primary storage. [2025-09-14T17:53:59.745142] [INFO ] [MAIN ] EME: Loaded 12676 existing records. [2025-09-14T17:53:59.765375] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-14T17:53:59.927159] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:59.927415] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-14T17:53:59.927491] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-14T17:53:59.927972] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-14T17:53:59.928034] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-14T17:54:00.295990] [INFO ] [REMOTE ] EME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:00.311923] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T17:54:00.558869] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-14T17:54:01.365672] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-14T17:54:01.367717] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T17:54:02.158793] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-14T17:54:02.233796] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-14T17:54:02.958894] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-14T17:54:03.758954] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-14T17:54:04.548057] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (3.18 seconds). [2025-09-14T17:54:04.558768] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-14T17:54:04.854345] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-09-14T17:54:04.857382] [INFO ] [REMOTE ] EMA: Full fetch complete (7118 records). [2025-09-14T17:54:04.857517] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-14T17:54:05.053042] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 75 unique days, need 150 days [2025-09-14T17:54:05.053346] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:54:05.053427] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:54:05.053557] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-14T17:54:05.053676] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-14T17:54:05.053762] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-14T17:54:05.053857] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-14T17:54:05.053990] [INFO ] [MAIN ] Update Progress: 728/2370 symbols completed. EMA took 23.2s. Estimated remaining: 2h 53m 25s. Rate: 9.5 symbols/min [2025-09-14T17:54:05.226969] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:05.239792] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T17:54:05.247268] [DEBUG] [LOCAL ] EMF: Loaded 1442 existing records from primary storage. [2025-09-14T17:54:05.247418] [INFO ] [MAIN ] EMF: Loaded 1442 existing records. [2025-09-14T17:54:05.363913] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-14T17:54:05.428201] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:05.428485] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-14T17:54:05.428547] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-14T17:54:05.428767] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-14T17:54:05.428826] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-14T17:54:05.789286] [INFO ] [REMOTE ] EMF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:06.052058] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-14T17:54:06.085541] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T17:54:06.158816] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-14T17:54:06.215269] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T17:54:06.727332] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:54:06.735561] [INFO ] [REMOTE ] ELV: Full fetch complete (54814 records). [2025-09-14T17:54:06.735777] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-14T17:54:06.966747] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-14T17:54:07.137311] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-14T17:54:07.137430] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-14T17:54:07.138260] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-14T17:54:07.138334] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-14T17:54:07.139631] [DEBUG] [LOCAL ] ELV: Trimmed 54814 records to 38179 (keeping 150 days of data) [2025-09-14T17:54:07.392215] [DEBUG] [LOCAL ] ELV: Primary data saved (38179 records). [2025-09-14T17:54:07.392412] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-14T17:54:07.392551] [INFO ] [MAIN ] Update Progress: 729/2370 symbols completed. ELV took 28.6s. Estimated remaining: 2h 53m 10s. Rate: 9.5 symbols/min [2025-09-14T17:54:07.561115] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:07.583473] [DEBUG] [LOCAL ] EMN: Loaded 22703 existing records from primary storage. [2025-09-14T17:54:07.583684] [INFO ] [MAIN ] EMN: Loaded 22703 existing records. [2025-09-14T17:54:07.691669] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T17:54:07.771803] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-14T17:54:07.776481] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:07.777670] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-14T17:54:07.777739] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-14T17:54:07.778291] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-14T17:54:07.778487] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-14T17:54:08.135041] [INFO ] [REMOTE ] EMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:08.558827] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-14T17:54:08.991383] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:54:09.358835] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-14T17:54:10.158838] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-14T17:54:10.314321] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:54:10.467066] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:54:10.958835] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-14T17:54:11.701694] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T17:54:11.758822] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-14T17:54:11.887011] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:54:12.386246] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T17:54:12.558848] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-14T17:54:13.358836] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-14T17:54:14.158783] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-14T17:54:14.375619] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T17:54:14.378039] [INFO ] [REMOTE ] EMD: Full fetch complete (23871 records). [2025-09-14T17:54:14.378141] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-14T17:54:14.814021] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T17:54:14.814633] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-14T17:54:14.824107] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-14T17:54:14.825151] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-14T17:54:14.825532] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-14T17:54:14.826261] [DEBUG] [LOCAL ] EMD: Trimmed 23871 records to 15058 (keeping 150 days of data) [2025-09-14T17:54:14.915882] [DEBUG] [LOCAL ] EMD: Primary data saved (15058 records). [2025-09-14T17:54:14.916055] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-14T17:54:14.916178] [INFO ] [MAIN ] Update Progress: 730/2370 symbols completed. EMD took 24.2s. Estimated remaining: 2h 53m 6s. Rate: 9.5 symbols/min [2025-09-14T17:54:14.969722] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-14T17:54:15.094442] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:15.103966] [DEBUG] [LOCAL ] EMO: Loaded 6508 existing records from primary storage. [2025-09-14T17:54:15.104114] [INFO ] [MAIN ] EMO: Loaded 6508 existing records. [2025-09-14T17:54:15.279940] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:15.280207] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-14T17:54:15.280269] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-14T17:54:15.280584] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-14T17:54:15.280684] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-14T17:54:15.642714] [INFO ] [REMOTE ] EMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:15.758809] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-14T17:54:15.967365] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:54:16.554546] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T17:54:16.558763] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-14T17:54:16.741209] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-14T17:54:17.358826] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-14T17:54:17.395054] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:54:17.876300] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T17:54:18.158779] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-14T17:54:18.958886] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-14T17:54:19.051412] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T17:54:19.672335] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T17:54:19.758830] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-14T17:54:20.284758] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T17:54:20.558853] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-14T17:54:21.358856] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-14T17:54:21.405528] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T17:54:21.763508] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T17:54:21.764492] [INFO ] [REMOTE ] EMF: Full fetch complete (4349 records). [2025-09-14T17:54:21.764591] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-14T17:54:22.137391] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-14T17:54:22.137552] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-14T17:54:22.137779] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-14T17:54:22.137916] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-14T17:54:22.138335] [DEBUG] [LOCAL ] EMF: Trimmed 4349 records to 2183 (keeping 150 days of data) [2025-09-14T17:54:22.152937] [DEBUG] [LOCAL ] EMF: Primary data saved (2183 records). [2025-09-14T17:54:22.153009] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-14T17:54:22.153176] [INFO ] [MAIN ] Update Progress: 731/2370 symbols completed. EMF took 17.1s. Estimated remaining: 2h 53m 2s. Rate: 9.5 symbols/min [2025-09-14T17:54:22.164144] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-14T17:54:22.338968] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:22.343133] [DEBUG] [LOCAL ] EMP: Loaded 1289 existing records from primary storage. [2025-09-14T17:54:22.343250] [INFO ] [MAIN ] EMP: Loaded 1289 existing records. [2025-09-14T17:54:22.521376] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:22.521720] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-14T17:54:22.521800] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-14T17:54:22.522078] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-14T17:54:22.522161] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-14T17:54:22.876567] [INFO ] [REMOTE ] EMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:22.958795] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-14T17:54:23.474270] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-14T17:54:23.758793] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-14T17:54:23.854223] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:54:24.558828] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-14T17:54:25.231361] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T17:54:25.358809] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-14T17:54:26.158851] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-14T17:54:26.906910] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T17:54:26.958836] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-14T17:54:27.161953] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T17:54:27.545172] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T17:54:27.758849] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-14T17:54:28.419628] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T17:54:28.558900] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-14T17:54:28.699171] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:54:29.358869] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-14T17:54:29.379556] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:54:30.158912] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-14T17:54:30.781962] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T17:54:30.958853] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-14T17:54:31.169875] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T17:54:31.758857] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-14T17:54:32.020164] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T17:54:32.558841] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-14T17:54:33.062809] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T17:54:33.358845] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-14T17:54:33.380575] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:54:33.915844] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:54:33.919400] [INFO ] [REMOTE ] EME: Full fetch complete (35241 records). [2025-09-14T17:54:33.919511] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-14T17:54:34.168437] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-14T17:54:34.300102] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-14T17:54:34.300234] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-14T17:54:34.301008] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-14T17:54:34.301082] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-14T17:54:34.302279] [DEBUG] [LOCAL ] EME: Trimmed 35241 records to 22709 (keeping 150 days of data) [2025-09-14T17:54:34.456925] [DEBUG] [LOCAL ] EME: Primary data saved (22709 records). [2025-09-14T17:54:34.457086] [INFO ] [MAIN ] EME: Full history saved. [2025-09-14T17:54:34.457222] [INFO ] [MAIN ] Update Progress: 732/2370 symbols completed. EME took 34.9s. Estimated remaining: 2h 53m 9s. Rate: 9.5 symbols/min [2025-09-14T17:54:34.642546] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:34.666655] [DEBUG] [LOCAL ] EMR: Loaded 23809 existing records from primary storage. [2025-09-14T17:54:34.666819] [INFO ] [MAIN ] EMR: Loaded 23809 existing records. [2025-09-14T17:54:34.849255] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:34.849532] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-14T17:54:34.849596] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-14T17:54:34.850306] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-14T17:54:34.850376] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-14T17:54:34.963960] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-14T17:54:35.204772] [INFO ] [REMOTE ] EMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:35.660820] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T17:54:35.758858] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-14T17:54:35.893762] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T17:54:35.896381] [INFO ] [REMOTE ] EMO: Full fetch complete (12900 records). [2025-09-14T17:54:35.896474] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-14T17:54:36.270111] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-14T17:54:36.270318] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-14T17:54:36.270788] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-14T17:54:36.270873] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-14T17:54:36.271746] [DEBUG] [LOCAL ] EMO: Trimmed 12900 records to 9565 (keeping 150 days of data) [2025-09-14T17:54:36.340827] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:54:36.350412] [INFO ] [REMOTE ] EMN: Full fetch complete (54264 records). [2025-09-14T17:54:36.351741] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-14T17:54:36.492393] [DEBUG] [LOCAL ] EMO: Primary data saved (9565 records). [2025-09-14T17:54:36.522769] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-14T17:54:36.531957] [INFO ] [MAIN ] Update Progress: 733/2370 symbols completed. EMO took 21.6s. Estimated remaining: 2h 52m 53s. Rate: 9.5 symbols/min [2025-09-14T17:54:36.559778] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-14T17:54:36.934603] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:36.953205] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-14T17:54:36.953784] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-14T17:54:36.954955] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-14T17:54:36.955112] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-14T17:54:36.956672] [DEBUG] [LOCAL ] EMN: Trimmed 54264 records to 38189 (keeping 150 days of data) [2025-09-14T17:54:37.075088] [DEBUG] [LOCAL ] ENB: Loaded 23951 existing records from primary storage. [2025-09-14T17:54:37.076563] [INFO ] [MAIN ] ENB: Loaded 23951 existing records. [2025-09-14T17:54:37.265398] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:37.267687] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-14T17:54:37.268619] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-14T17:54:37.271282] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-14T17:54:37.272127] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-14T17:54:37.361378] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-14T17:54:37.755410] [INFO ] [REMOTE ] ENB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:37.797678] [DEBUG] [LOCAL ] EMN: Primary data saved (38189 records). [2025-09-14T17:54:37.797897] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-14T17:54:37.798032] [INFO ] [MAIN ] Update Progress: 734/2370 symbols completed. EMN took 30.4s. Estimated remaining: 2h 52m 36s. Rate: 9.5 symbols/min [2025-09-14T17:54:37.979964] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:37.976981] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T17:54:37.985667] [DEBUG] [LOCAL ] ENFY: Loaded 1890 existing records from primary storage. [2025-09-14T17:54:37.985841] [INFO ] [MAIN ] ENFY: Loaded 1890 existing records. [2025-09-14T17:54:38.161331] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-14T17:54:38.173331] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:38.174367] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-14T17:54:38.174429] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-14T17:54:38.174697] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-14T17:54:38.174764] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-14T17:54:38.540153] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:38.572465] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T17:54:38.721797] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T17:54:38.958851] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-14T17:54:39.758835] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-14T17:54:40.292024] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T17:54:40.558874] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-14T17:54:40.962291] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T17:54:41.079877] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T17:54:41.358840] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-14T17:54:41.750878] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-14T17:54:42.158842] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-14T17:54:42.687400] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T17:54:42.958830] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-14T17:54:43.638343] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:54:43.639478] [INFO ] [REMOTE ] EMP: Full fetch complete (3192 records). [2025-09-14T17:54:43.639564] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-14T17:54:43.764034] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-14T17:54:44.025334] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-14T17:54:44.025489] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-14T17:54:44.025671] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-14T17:54:44.025730] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-14T17:54:44.026241] [DEBUG] [LOCAL ] EMP: Trimmed 3192 records to 2192 (keeping 150 days of data) [2025-09-14T17:54:44.040802] [DEBUG] [LOCAL ] EMP: Primary data saved (2192 records). [2025-09-14T17:54:44.040903] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-14T17:54:44.041010] [INFO ] [MAIN ] Update Progress: 735/2370 symbols completed. EMP took 21.9s. Estimated remaining: 2h 52m 29s. Rate: 9.5 symbols/min [2025-09-14T17:54:44.222046] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:44.245304] [DEBUG] [LOCAL ] ENIC: Loaded 16018 existing records from primary storage. [2025-09-14T17:54:44.245555] [INFO ] [MAIN ] ENIC: Loaded 16018 existing records. [2025-09-14T17:54:44.438132] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:44.438516] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-14T17:54:44.438582] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-14T17:54:44.439142] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-14T17:54:44.439208] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-14T17:54:44.552973] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T17:54:44.563907] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-14T17:54:44.833517] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:45.358840] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-14T17:54:46.158841] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-14T17:54:46.641369] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-14T17:54:46.668389] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:54:46.775332] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T17:54:46.958831] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-14T17:54:47.758863] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-14T17:54:48.558833] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-14T17:54:48.956934] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T17:54:49.358829] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-14T17:54:49.625596] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T17:54:50.020132] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T17:54:50.158830] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-14T17:54:50.886195] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T17:54:50.958909] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-14T17:54:51.746679] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:54:51.758774] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-14T17:54:51.777559] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:54:52.558839] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-14T17:54:53.268492] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:54:53.358836] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-14T17:54:53.863975] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T17:54:54.158893] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-14T17:54:54.474826] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:54:54.958889] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-14T17:54:55.432073] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:54:55.758857] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-14T17:54:56.558817] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-14T17:54:57.031543] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-14T17:54:57.295777] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T17:54:57.358832] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-14T17:54:58.158852] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-14T17:54:58.226337] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T17:54:58.958864] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-14T17:54:59.398997] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T17:54:59.404710] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-14T17:54:59.758894] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-14T17:55:00.558891] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-14T17:55:01.043905] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T17:55:01.048755] [INFO ] [REMOTE ] ENIC: Full fetch complete (39365 records). [2025-09-14T17:55:01.049065] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-14T17:55:01.145402] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-14T17:55:01.364035] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-14T17:55:01.484395] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-14T17:55:01.484515] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-14T17:55:01.485237] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-14T17:55:01.485298] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-14T17:55:01.486792] [DEBUG] [LOCAL ] ENIC: Trimmed 39365 records to 28052 (keeping 150 days of data) [2025-09-14T17:55:01.661747] [DEBUG] [LOCAL ] ENIC: Primary data saved (28052 records). [2025-09-14T17:55:01.661936] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-14T17:55:01.662040] [INFO ] [MAIN ] Update Progress: 736/2370 symbols completed. ENIC took 17.6s. Estimated remaining: 2h 52m 48s. Rate: 9.5 symbols/min [2025-09-14T17:55:01.835672] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:01.838173] [DEBUG] [LOCAL ] ENO: Loaded 738 existing records from primary storage. [2025-09-14T17:55:01.838308] [INFO ] [MAIN ] ENO: Loaded 738 existing records. [2025-09-14T17:55:02.042949] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:55:02.042702] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:02.045245] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-14T17:55:02.045357] [INFO ] [REMOTE ] ENFY: Full fetch complete (3614 records). [2025-09-14T17:55:02.045567] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-14T17:55:02.045757] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-14T17:55:02.051546] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-14T17:55:02.146688] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-14T17:55:02.168404] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-14T17:55:02.729969] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-14T17:55:02.773973] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-14T17:55:02.815043] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-14T17:55:02.814459] [INFO ] [REMOTE ] ENO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:02.815276] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-14T17:55:02.816398] [DEBUG] [LOCAL ] ENFY: Trimmed 3614 records to 2700 (keeping 150 days of data) [2025-09-14T17:55:02.874753] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-14T17:55:02.877059] [DEBUG] [LOCAL ] ENFY: Primary data saved (2700 records). [2025-09-14T17:55:02.888596] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:55:02.888790] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-14T17:55:02.889285] [INFO ] [MAIN ] Update Progress: 737/2370 symbols completed. ENFY took 25.1s. Estimated remaining: 2h 52m 30s. Rate: 9.5 symbols/min [2025-09-14T17:55:02.928104] [INFO ] [REMOTE ] EMR: Full fetch complete (57894 records). [2025-09-14T17:55:02.963890] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-14T17:55:02.976945] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-14T17:55:03.165617] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:03.404927] [DEBUG] [LOCAL ] ENOV: Loaded 21110 existing records from primary storage. [2025-09-14T17:55:03.407832] [INFO ] [MAIN ] ENOV: Loaded 21110 existing records. [2025-09-14T17:55:03.641292] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-14T17:55:03.687685] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-14T17:55:03.704027] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:03.704913] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-14T17:55:03.705056] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-14T17:55:03.705188] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-14T17:55:03.705370] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-14T17:55:03.706019] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-14T17:55:03.706156] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-14T17:55:03.740818] [DEBUG] [LOCAL ] EMR: Trimmed 57894 records to 40060 (keeping 150 days of data) [2025-09-14T17:55:03.764270] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-14T17:55:04.181557] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:04.364792] [DEBUG] [LOCAL ] EMR: Primary data saved (40060 records). [2025-09-14T17:55:04.364947] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-14T17:55:04.365044] [INFO ] [MAIN ] Update Progress: 738/2370 symbols completed. EMR took 29.9s. Estimated remaining: 2h 52m 13s. Rate: 9.5 symbols/min [2025-09-14T17:55:04.468232] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T17:55:04.540496] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:04.560185] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-14T17:55:04.560576] [DEBUG] [LOCAL ] ENR: Loaded 20210 existing records from primary storage. [2025-09-14T17:55:04.561715] [INFO ] [MAIN ] ENR: Loaded 20210 existing records. [2025-09-14T17:55:04.739475] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:04.739747] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-14T17:55:04.739808] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-14T17:55:04.740417] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-14T17:55:04.740477] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-14T17:55:05.097140] [INFO ] [REMOTE ] ENR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:05.132502] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T17:55:05.358853] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-14T17:55:06.063224] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T17:55:06.158797] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-14T17:55:06.958817] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-14T17:55:07.177259] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T17:55:07.389540] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-14T17:55:07.753551] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:55:07.762348] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-14T17:55:08.437215] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T17:55:08.558889] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-14T17:55:09.100204] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T17:55:09.358887] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-14T17:55:10.158837] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-14T17:55:10.958849] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-14T17:55:11.074354] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-14T17:55:11.080952] [INFO ] [REMOTE ] ENB: Full fetch complete (58211 records). [2025-09-14T17:55:11.081161] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-14T17:55:11.460487] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-14T17:55:11.460608] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-14T17:55:11.461392] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-14T17:55:11.461454] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-14T17:55:11.462816] [DEBUG] [LOCAL ] ENB: Trimmed 58211 records to 40294 (keeping 150 days of data) [2025-09-14T17:55:11.709468] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T17:55:11.745852] [DEBUG] [LOCAL ] ENB: Primary data saved (40294 records). [2025-09-14T17:55:11.746029] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-14T17:55:11.746156] [INFO ] [MAIN ] Update Progress: 739/2370 symbols completed. ENB took 35.2s. Estimated remaining: 2h 52m 9s. Rate: 9.5 symbols/min [2025-09-14T17:55:11.766739] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-14T17:55:11.929444] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:11.943258] [DEBUG] [LOCAL ] ENS: Loaded 12946 existing records from primary storage. [2025-09-14T17:55:11.943418] [INFO ] [MAIN ] ENS: Loaded 12946 existing records. [2025-09-14T17:55:12.117207] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:12.117443] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-14T17:55:12.117505] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-14T17:55:12.117940] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-14T17:55:12.118005] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-14T17:55:12.400094] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T17:55:12.476409] [INFO ] [REMOTE ] ENS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:12.558819] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-14T17:55:12.584511] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:55:13.023289] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-14T17:55:13.358836] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-14T17:55:13.852058] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T17:55:14.158837] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-14T17:55:14.958840] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-14T17:55:15.653425] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T17:55:15.758831] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-14T17:55:16.399554] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:55:16.558824] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-14T17:55:17.277131] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T17:55:17.358843] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-14T17:55:17.920411] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:55:18.158839] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-14T17:55:18.497450] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:55:18.498336] [INFO ] [REMOTE ] ENO: Full fetch complete (2253 records). [2025-09-14T17:55:18.498421] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-14T17:55:18.891887] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-14T17:55:18.892056] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-14T17:55:18.892250] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-14T17:55:18.892309] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-14T17:55:18.892817] [DEBUG] [LOCAL ] ENO: Trimmed 2253 records to 1267 (keeping 150 days of data) [2025-09-14T17:55:18.900999] [DEBUG] [LOCAL ] ENO: Primary data saved (1267 records). [2025-09-14T17:55:18.901079] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-14T17:55:18.901164] [INFO ] [MAIN ] Update Progress: 740/2370 symbols completed. ENO took 17.2s. Estimated remaining: 2h 52m 5s. Rate: 9.5 symbols/min [2025-09-14T17:55:18.963899] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-14T17:55:19.083989] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T17:55:19.117950] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:19.132766] [DEBUG] [LOCAL ] ENVA: Loaded 11316 existing records from primary storage. [2025-09-14T17:55:19.132943] [INFO ] [MAIN ] ENVA: Loaded 11316 existing records. [2025-09-14T17:55:19.306487] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:19.306795] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-14T17:55:19.306856] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-14T17:55:19.307342] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-14T17:55:19.307403] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-14T17:55:19.666471] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:19.758895] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-14T17:55:20.385778] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T17:55:20.558847] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-14T17:55:21.034224] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T17:55:21.358872] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-14T17:55:22.099027] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T17:55:22.158818] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-14T17:55:22.958839] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-14T17:55:23.117385] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:55:23.758874] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-14T17:55:23.831931] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T17:55:24.010322] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:55:24.558868] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-14T17:55:25.366668] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-14T17:55:25.391709] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T17:55:26.158860] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-14T17:55:26.197144] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T17:55:26.751126] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T17:55:26.958842] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-14T17:55:27.714715] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:55:27.758806] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-14T17:55:28.139310] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T17:55:28.558881] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-14T17:55:29.166619] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T17:55:29.358836] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-14T17:55:29.593362] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T17:55:30.158839] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-14T17:55:30.797439] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T17:55:30.958857] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-14T17:55:31.562121] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T17:55:31.758850] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-14T17:55:32.329294] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:55:32.347264] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:55:32.351982] [INFO ] [REMOTE ] ENOV: Full fetch complete (48612 records). [2025-09-14T17:55:32.352087] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-14T17:55:32.563947] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-14T17:55:32.736759] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-14T17:55:32.736880] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-14T17:55:32.737638] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-14T17:55:32.737712] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-14T17:55:32.738935] [DEBUG] [LOCAL ] ENOV: Trimmed 48612 records to 34517 (keeping 150 days of data) [2025-09-14T17:55:32.952773] [DEBUG] [LOCAL ] ENOV: Primary data saved (34517 records). [2025-09-14T17:55:32.952962] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-14T17:55:32.953068] [INFO ] [MAIN ] Update Progress: 741/2370 symbols completed. ENOV took 30.1s. Estimated remaining: 2h 52m 15s. Rate: 9.5 symbols/min [2025-09-14T17:55:33.127517] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:33.136679] [DEBUG] [LOCAL ] EOD: Loaded 7840 existing records from primary storage. [2025-09-14T17:55:33.136842] [INFO ] [MAIN ] EOD: Loaded 7840 existing records. [2025-09-14T17:55:33.315763] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:33.326008] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-14T17:55:33.326717] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:55:33.326774] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-14T17:55:33.330716] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-14T17:55:33.331057] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-14T17:55:33.362235] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-14T17:55:33.373407] [INFO ] [REMOTE ] ENR: Full fetch complete (45512 records). [2025-09-14T17:55:33.406179] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-14T17:55:33.985798] [INFO ] [REMOTE ] EOD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:34.072814] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-14T17:55:34.072935] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-14T17:55:34.073623] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-14T17:55:34.073698] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-14T17:55:34.074912] [DEBUG] [LOCAL ] ENR: Trimmed 45512 records to 33339 (keeping 150 days of data) [2025-09-14T17:55:34.166832] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-14T17:55:34.294692] [DEBUG] [LOCAL ] ENR: Primary data saved (33339 records). [2025-09-14T17:55:34.294895] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-14T17:55:34.295000] [INFO ] [MAIN ] Update Progress: 742/2370 symbols completed. ENR took 29.9s. Estimated remaining: 2h 51m 58s. Rate: 9.5 symbols/min [2025-09-14T17:55:34.470020] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:34.496579] [DEBUG] [LOCAL ] EOG: Loaded 23881 existing records from primary storage. [2025-09-14T17:55:34.496778] [INFO ] [MAIN ] EOG: Loaded 23881 existing records. [2025-09-14T17:55:34.670674] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:34.671004] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-14T17:55:34.671069] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-14T17:55:34.671869] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-14T17:55:34.671936] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-14T17:55:34.960351] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-14T17:55:34.960813] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T17:55:35.000480] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:55:35.068102] [INFO ] [REMOTE ] EOG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:35.758843] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-14T17:55:36.401140] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:55:36.558822] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-14T17:55:37.130197] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:55:37.133204] [INFO ] [REMOTE ] ENVA: Full fetch complete (28041 records). [2025-09-14T17:55:37.133310] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-14T17:55:37.364276] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-14T17:55:37.513062] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-14T17:55:37.513287] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-14T17:55:37.513977] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-14T17:55:37.514053] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-14T17:55:37.515118] [DEBUG] [LOCAL ] ENVA: Trimmed 28041 records to 18954 (keeping 150 days of data) [2025-09-14T17:55:37.650121] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T17:55:37.672790] [DEBUG] [LOCAL ] ENVA: Primary data saved (18954 records). [2025-09-14T17:55:37.673054] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-14T17:55:37.673189] [INFO ] [MAIN ] Update Progress: 743/2370 symbols completed. ENVA took 18.8s. Estimated remaining: 2h 51m 45s. Rate: 9.5 symbols/min [2025-09-14T17:55:37.860731] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:37.867362] [DEBUG] [LOCAL ] EOI: Loaded 4037 existing records from primary storage. [2025-09-14T17:55:37.867523] [INFO ] [MAIN ] EOI: Loaded 4037 existing records. [2025-09-14T17:55:38.049415] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:38.058684] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T17:55:38.058346] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-14T17:55:38.061834] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-14T17:55:38.062900] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-14T17:55:38.062995] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-14T17:55:38.163997] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-14T17:55:38.422821] [INFO ] [REMOTE ] EOI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:38.958812] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-14T17:55:39.091171] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T17:55:39.758836] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-14T17:55:40.083133] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T17:55:40.558836] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-14T17:55:40.570083] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T17:55:41.358855] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-14T17:55:41.443223] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:55:42.158832] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-14T17:55:42.958821] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-14T17:55:43.044421] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:55:43.299710] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:55:43.763113] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-14T17:55:43.764948] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T17:55:44.404524] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:55:44.408231] [INFO ] [REMOTE ] ENS: Full fetch complete (32091 records). [2025-09-14T17:55:44.408376] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-14T17:55:44.566936] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-14T17:55:44.809751] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-14T17:55:44.809878] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-14T17:55:44.810710] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-14T17:55:44.810804] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-14T17:55:44.811852] [DEBUG] [LOCAL ] ENS: Trimmed 32091 records to 21770 (keeping 150 days of data) [2025-09-14T17:55:44.955848] [DEBUG] [LOCAL ] ENS: Primary data saved (21770 records). [2025-09-14T17:55:44.956014] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-14T17:55:44.956116] [INFO ] [MAIN ] Update Progress: 744/2370 symbols completed. ENS took 33.2s. Estimated remaining: 2h 51m 41s. Rate: 9.5 symbols/min [2025-09-14T17:55:45.125576] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:45.134130] [DEBUG] [LOCAL ] EOS: Loaded 6391 existing records from primary storage. [2025-09-14T17:55:45.134305] [INFO ] [MAIN ] EOS: Loaded 6391 existing records. [2025-09-14T17:55:45.310382] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:45.310667] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-14T17:55:45.310732] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-14T17:55:45.311051] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-14T17:55:45.311110] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-14T17:55:45.364678] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-14T17:55:45.673157] [INFO ] [REMOTE ] EOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:46.158844] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-14T17:55:46.454372] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:55:46.706186] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-14T17:55:46.958808] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-14T17:55:47.250608] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:55:47.471060] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T17:55:47.758833] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-14T17:55:48.558783] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-14T17:55:48.941963] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T17:55:49.358880] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-14T17:55:49.781523] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:55:50.158919] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-14T17:55:50.957518] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T17:55:50.959880] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-14T17:55:51.227886] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:55:51.556958] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:55:51.758902] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-14T17:55:52.480478] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T17:55:52.558863] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-14T17:55:53.263858] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T17:55:53.358798] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-14T17:55:54.066253] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:55:54.067983] [INFO ] [REMOTE ] EOI: Full fetch complete (11662 records). [2025-09-14T17:55:54.068089] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-14T17:55:54.164108] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-14T17:55:54.454207] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-14T17:55:54.454357] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-14T17:55:54.454930] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-14T17:55:54.455005] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-14T17:55:54.455622] [DEBUG] [LOCAL ] EOI: Trimmed 11662 records to 7034 (keeping 150 days of data) [2025-09-14T17:55:54.506988] [DEBUG] [LOCAL ] EOI: Primary data saved (7034 records). [2025-09-14T17:55:54.507294] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-14T17:55:54.507475] [INFO ] [MAIN ] Update Progress: 745/2370 symbols completed. EOI took 16.8s. Estimated remaining: 2h 51m 41s. Rate: 9.5 symbols/min [2025-09-14T17:55:54.696461] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:54.701986] [DEBUG] [LOCAL ] EOT: Loaded 2952 existing records from primary storage. [2025-09-14T17:55:54.702131] [INFO ] [MAIN ] EOT: Loaded 2952 existing records. [2025-09-14T17:55:54.882106] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:54.882389] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-14T17:55:54.882471] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-14T17:55:54.882732] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-14T17:55:54.882794] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-14T17:55:54.963902] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-14T17:55:55.240201] [INFO ] [REMOTE ] EOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:55.758809] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-14T17:55:55.840558] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:55:55.842426] [INFO ] [REMOTE ] EOD: Full fetch complete (15389 records). [2025-09-14T17:55:55.842514] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-14T17:55:56.210795] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-14T17:55:56.210986] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-14T17:55:56.211439] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-14T17:55:56.211539] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-14T17:55:56.212311] [DEBUG] [LOCAL ] EOD: Trimmed 15389 records to 11000 (keeping 150 days of data) [2025-09-14T17:55:56.308517] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-14T17:55:56.338020] [DEBUG] [LOCAL ] EOD: Primary data saved (11000 records). [2025-09-14T17:55:56.338266] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-14T17:55:56.338424] [INFO ] [MAIN ] Update Progress: 746/2370 symbols completed. EOD took 23.4s. Estimated remaining: 2h 51m 25s. Rate: 9.5 symbols/min [2025-09-14T17:55:56.511012] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:56.528590] [DEBUG] [LOCAL ] EPAC: Loaded 12596 existing records from primary storage. [2025-09-14T17:55:56.528830] [INFO ] [MAIN ] EPAC: Loaded 12596 existing records. [2025-09-14T17:55:56.564073] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-14T17:55:56.715512] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:56.711918] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T17:55:56.718253] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-14T17:55:56.718322] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-14T17:55:56.718794] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-14T17:55:56.718857] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-14T17:55:57.071209] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:57.358859] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-14T17:55:57.739721] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T17:55:58.158891] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-14T17:55:58.243549] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:55:58.920469] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:55:58.958858] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-14T17:55:59.758899] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-14T17:56:00.558918] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-14T17:56:00.748605] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T17:56:01.226556] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:56:01.344631] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T17:56:01.358801] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-14T17:56:01.818656] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T17:56:02.158848] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-14T17:56:02.902578] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T17:56:02.958889] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-14T17:56:03.711191] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T17:56:03.758794] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-14T17:56:04.535152] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T17:56:04.558817] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-14T17:56:05.188530] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:56:05.190991] [INFO ] [REMOTE ] EOT: Full fetch complete (7507 records). [2025-09-14T17:56:05.191140] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-14T17:56:05.363105] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-14T17:56:05.801498] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-14T17:56:05.801687] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-14T17:56:05.802122] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-14T17:56:05.802196] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-14T17:56:05.803104] [DEBUG] [LOCAL ] EOT: Trimmed 7507 records to 5036 (keeping 150 days of data) [2025-09-14T17:56:05.845716] [DEBUG] [LOCAL ] EOT: Primary data saved (5036 records). [2025-09-14T17:56:05.846002] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-14T17:56:05.846154] [INFO ] [MAIN ] Update Progress: 747/2370 symbols completed. EOT took 11.3s. Estimated remaining: 2h 51m 26s. Rate: 9.5 symbols/min [2025-09-14T17:56:06.042369] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:06.062140] [DEBUG] [LOCAL ] EPAM: Loaded 16662 existing records from primary storage. [2025-09-14T17:56:06.062334] [INFO ] [MAIN ] EPAM: Loaded 16662 existing records. [2025-09-14T17:56:06.167975] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-14T17:56:06.250936] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:06.251204] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-14T17:56:06.251267] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-14T17:56:06.251860] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-14T17:56:06.251923] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-14T17:56:06.488907] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T17:56:06.634477] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:06.958830] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-14T17:56:07.758873] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-14T17:56:08.026464] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:56:08.581104] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-14T17:56:08.597747] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T17:56:08.875587] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T17:56:09.358861] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-14T17:56:09.483374] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T17:56:10.158840] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-14T17:56:10.402278] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T17:56:10.958894] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-14T17:56:11.301441] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T17:56:11.758778] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-14T17:56:12.072075] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T17:56:12.558839] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-14T17:56:12.642902] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:56:13.358846] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-14T17:56:13.937842] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T17:56:13.948275] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:56:13.950512] [INFO ] [REMOTE ] EOS: Full fetch complete (16992 records). [2025-09-14T17:56:13.950601] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-14T17:56:14.164010] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-14T17:56:14.313041] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-14T17:56:14.313140] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-14T17:56:14.313617] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-14T17:56:14.313691] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-14T17:56:14.314252] [DEBUG] [LOCAL ] EOS: Trimmed 16992 records to 10469 (keeping 150 days of data) [2025-09-14T17:56:14.381626] [DEBUG] [LOCAL ] EOS: Primary data saved (10469 records). [2025-09-14T17:56:14.381819] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-14T17:56:14.381933] [INFO ] [MAIN ] Update Progress: 748/2370 symbols completed. EOS took 29.4s. Estimated remaining: 2h 51m 24s. Rate: 9.5 symbols/min [2025-09-14T17:56:14.554279] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:14.574531] [DEBUG] [LOCAL ] EPC: Loaded 17949 existing records from primary storage. [2025-09-14T17:56:14.574707] [INFO ] [MAIN ] EPC: Loaded 17949 existing records. [2025-09-14T17:56:14.746808] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:14.747023] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-14T17:56:14.747081] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-14T17:56:14.747614] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-14T17:56:14.747698] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-14T17:56:14.964058] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-14T17:56:15.111893] [INFO ] [REMOTE ] EPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:15.701840] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:56:15.707723] [INFO ] [REMOTE ] EOG: Full fetch complete (58003 records). [2025-09-14T17:56:15.707893] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-14T17:56:15.770400] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-14T17:56:16.131058] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-14T17:56:16.131346] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-14T17:56:16.133995] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-14T17:56:16.135226] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T17:56:16.135389] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-14T17:56:16.147669] [DEBUG] [LOCAL ] EOG: Trimmed 58003 records to 40135 (keeping 150 days of data) [2025-09-14T17:56:16.431236] [DEBUG] [LOCAL ] EOG: Primary data saved (40135 records). [2025-09-14T17:56:16.431396] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-14T17:56:16.431506] [INFO ] [MAIN ] Update Progress: 749/2370 symbols completed. EOG took 42.1s. Estimated remaining: 2h 51m 9s. Rate: 9.5 symbols/min [2025-09-14T17:56:16.571308] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-14T17:56:16.604066] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:16.629549] [DEBUG] [LOCAL ] EPD: Loaded 23998 existing records from primary storage. [2025-09-14T17:56:16.629750] [INFO ] [MAIN ] EPD: Loaded 23998 existing records. [2025-09-14T17:56:16.813367] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:16.813631] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-14T17:56:16.813709] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-14T17:56:16.814814] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-14T17:56:16.815161] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-14T17:56:17.200718] [INFO ] [REMOTE ] EPD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:17.226344] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:56:17.358805] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-14T17:56:17.833503] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:56:18.158838] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-14T17:56:18.569584] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T17:56:18.958844] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-14T17:56:19.520703] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:56:19.523997] [INFO ] [REMOTE ] EPAC: Full fetch complete (29028 records). [2025-09-14T17:56:19.524175] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-14T17:56:19.765037] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-14T17:56:19.898931] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-14T17:56:19.899112] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-14T17:56:19.899770] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-14T17:56:19.899832] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-14T17:56:19.900971] [DEBUG] [LOCAL ] EPAC: Trimmed 29028 records to 19349 (keeping 150 days of data) [2025-09-14T17:56:20.011255] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:56:20.058250] [DEBUG] [LOCAL ] EPAC: Primary data saved (19349 records). [2025-09-14T17:56:20.058404] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-14T17:56:20.058508] [INFO ] [MAIN ] Update Progress: 750/2370 symbols completed. EPAC took 23.7s. Estimated remaining: 2h 50m 56s. Rate: 9.5 symbols/min [2025-09-14T17:56:20.229574] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:20.249442] [DEBUG] [LOCAL ] EPR: Loaded 20401 existing records from primary storage. [2025-09-14T17:56:20.249611] [INFO ] [MAIN ] EPR: Loaded 20401 existing records. [2025-09-14T17:56:20.423248] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:20.423504] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-14T17:56:20.423570] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-14T17:56:20.424248] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-14T17:56:20.424312] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-14T17:56:20.564010] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-14T17:56:20.775402] [INFO ] [REMOTE ] EPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:21.277629] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T17:56:21.358772] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-14T17:56:22.049234] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T17:56:22.158776] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-14T17:56:22.961750] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-14T17:56:22.967005] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:56:23.247570] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:56:23.758854] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-14T17:56:24.238975] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:56:24.558899] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-14T17:56:25.358850] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-14T17:56:25.568235] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:56:26.148376] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:56:26.158774] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-14T17:56:26.674181] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T17:56:26.958863] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-14T17:56:27.727530] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T17:56:27.758776] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-14T17:56:28.558842] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-14T17:56:28.873781] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T17:56:29.358811] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-14T17:56:29.422389] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:56:29.858308] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T17:56:30.158818] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-14T17:56:30.891242] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:56:30.958814] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-14T17:56:31.758789] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-14T17:56:31.858298] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T17:56:32.432030] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T17:56:32.558825] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-14T17:56:33.358823] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-14T17:56:33.447919] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:56:34.158821] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-14T17:56:34.358307] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:56:34.520701] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:56:34.958837] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-14T17:56:35.227706] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T17:56:35.232138] [INFO ] [REMOTE ] EPC: Full fetch complete (43765 records). [2025-09-14T17:56:35.232295] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-14T17:56:35.617495] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-14T17:56:35.617600] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-14T17:56:35.618262] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-14T17:56:35.618330] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-14T17:56:35.619514] [DEBUG] [LOCAL ] EPC: Trimmed 43765 records to 30114 (keeping 150 days of data) [2025-09-14T17:56:35.776835] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-14T17:56:35.815010] [DEBUG] [LOCAL ] EPC: Primary data saved (30114 records). [2025-09-14T17:56:35.815241] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-14T17:56:35.815468] [INFO ] [MAIN ] Update Progress: 751/2370 symbols completed. EPC took 21.4s. Estimated remaining: 2h 51m 10s. Rate: 9.5 symbols/min [2025-09-14T17:56:35.943780] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T17:56:36.024484] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:36.047927] [DEBUG] [LOCAL ] EPRT: Loaded 21359 existing records from primary storage. [2025-09-14T17:56:36.048104] [INFO ] [MAIN ] EPRT: Loaded 21359 existing records. [2025-09-14T17:56:36.229927] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:36.230294] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-14T17:56:36.230534] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-14T17:56:36.236394] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-14T17:56:36.242374] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-14T17:56:36.243398] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:56:36.349690] [INFO ] [REMOTE ] EPAM: Full fetch complete (43159 records). [2025-09-14T17:56:36.350247] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-14T17:56:36.565896] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-14T17:56:36.920468] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:37.011756] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-14T17:56:37.011869] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-14T17:56:37.012626] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-14T17:56:37.012702] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-14T17:56:37.013814] [DEBUG] [LOCAL ] EPAM: Trimmed 43159 records to 29270 (keeping 150 days of data) [2025-09-14T17:56:37.213792] [DEBUG] [LOCAL ] EPAM: Primary data saved (29270 records). [2025-09-14T17:56:37.213984] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-14T17:56:37.214118] [INFO ] [MAIN ] Update Progress: 752/2370 symbols completed. EPAM took 31.4s. Estimated remaining: 2h 50m 53s. Rate: 9.5 symbols/min [2025-09-14T17:56:37.363448] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-14T17:56:37.393559] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:37.402753] [DEBUG] [LOCAL ] EQBK: Loaded 5748 existing records from primary storage. [2025-09-14T17:56:37.402901] [INFO ] [MAIN ] EQBK: Loaded 5748 existing records. [2025-09-14T17:56:37.584612] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:37.584910] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-14T17:56:37.584986] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-14T17:56:37.585305] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-14T17:56:37.585382] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-14T17:56:37.938175] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:38.158772] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-14T17:56:38.722821] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T17:56:38.723619] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-14T17:56:38.958802] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-14T17:56:39.245012] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:56:39.758831] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-14T17:56:40.558832] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-14T17:56:41.051870] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-14T17:56:41.358785] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-14T17:56:41.383855] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T17:56:42.158811] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-14T17:56:42.530602] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T17:56:42.958838] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-14T17:56:43.065074] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-14T17:56:43.070544] [INFO ] [REMOTE ] EPD: Full fetch complete (58292 records). [2025-09-14T17:56:43.070703] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-14T17:56:43.454472] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-14T17:56:43.454585] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-14T17:56:43.455414] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-14T17:56:43.455502] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-14T17:56:43.457196] [DEBUG] [LOCAL ] EPD: Trimmed 58292 records to 40362 (keeping 150 days of data) [2025-09-14T17:56:43.723867] [DEBUG] [LOCAL ] EPD: Primary data saved (40362 records). [2025-09-14T17:56:43.724021] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-14T17:56:43.724132] [INFO ] [MAIN ] Update Progress: 753/2370 symbols completed. EPD took 27.3s. Estimated remaining: 2h 50m 48s. Rate: 9.5 symbols/min [2025-09-14T17:56:43.766783] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-14T17:56:43.835700] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:56:43.909454] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:43.941440] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:56:43.967847] [DEBUG] [LOCAL ] EQH: Loaded 23652 existing records from primary storage. [2025-09-14T17:56:43.968007] [INFO ] [MAIN ] EQH: Loaded 23652 existing records. [2025-09-14T17:56:44.151778] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:44.152120] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-14T17:56:44.152191] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-14T17:56:44.152847] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-14T17:56:44.152909] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-14T17:56:44.514027] [INFO ] [REMOTE ] EQH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:44.526460] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:56:44.531272] [INFO ] [REMOTE ] EPR: Full fetch complete (48197 records). [2025-09-14T17:56:44.531374] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-14T17:56:44.563872] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-14T17:56:44.917279] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-14T17:56:44.917412] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-14T17:56:44.918186] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-14T17:56:44.918244] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-14T17:56:44.919543] [DEBUG] [LOCAL ] EPR: Trimmed 48197 records to 33117 (keeping 150 days of data) [2025-09-14T17:56:45.142109] [DEBUG] [LOCAL ] EPR: Primary data saved (33117 records). [2025-09-14T17:56:45.142294] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-14T17:56:45.142411] [INFO ] [MAIN ] Update Progress: 754/2370 symbols completed. EPR took 25.1s. Estimated remaining: 2h 50m 31s. Rate: 9.5 symbols/min [2025-09-14T17:56:45.312292] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:45.335627] [DEBUG] [LOCAL ] EQNR: Loaded 23736 existing records from primary storage. [2025-09-14T17:56:45.335820] [INFO ] [MAIN ] EQNR: Loaded 23736 existing records. [2025-09-14T17:56:45.365995] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-14T17:56:45.514321] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:45.514566] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-14T17:56:45.514630] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-14T17:56:45.515318] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-14T17:56:45.515379] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-14T17:56:45.864255] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:46.158878] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-14T17:56:46.268244] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T17:56:46.398670] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T17:56:46.958879] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-14T17:56:47.758836] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-14T17:56:48.114936] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T17:56:48.268265] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T17:56:48.558862] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-14T17:56:49.358850] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-14T17:56:49.505145] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:56:49.887121] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T17:56:50.158829] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-14T17:56:50.235296] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T17:56:50.958838] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-14T17:56:51.758893] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-14T17:56:52.039395] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T17:56:52.450085] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T17:56:52.558815] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-14T17:56:52.639715] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T17:56:53.358875] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-14T17:56:54.158807] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-14T17:56:54.219889] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:56:54.958896] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-14T17:56:55.303676] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:56:55.520558] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T17:56:55.706762] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T17:56:55.758801] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-14T17:56:56.558838] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-14T17:56:57.358894] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-14T17:56:57.458125] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:56:57.781216] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T17:56:58.158917] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-14T17:56:58.933246] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T17:56:58.958779] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-14T17:56:59.758888] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-14T17:56:59.978716] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T17:57:00.558893] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-14T17:57:00.591036] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:57:00.607835] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:57:00.609703] [INFO ] [REMOTE ] EQBK: Full fetch complete (11453 records). [2025-09-14T17:57:00.609793] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-14T17:57:01.010761] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-14T17:57:01.010876] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-14T17:57:01.011299] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-14T17:57:01.011372] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-14T17:57:01.012013] [DEBUG] [LOCAL ] EQBK: Trimmed 11453 records to 8151 (keeping 150 days of data) [2025-09-14T17:57:01.063754] [DEBUG] [LOCAL ] EQBK: Primary data saved (8151 records). [2025-09-14T17:57:01.063959] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-14T17:57:01.064101] [INFO ] [MAIN ] Update Progress: 755/2370 symbols completed. EQBK took 23.8s. Estimated remaining: 2h 50m 45s. Rate: 9.5 symbols/min [2025-09-14T17:57:01.241918] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:01.264775] [DEBUG] [LOCAL ] EQR: Loaded 22987 existing records from primary storage. [2025-09-14T17:57:01.264943] [INFO ] [MAIN ] EQR: Loaded 22987 existing records. [2025-09-14T17:57:01.364700] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-14T17:57:01.442303] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:01.442554] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-14T17:57:01.442615] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-14T17:57:01.443334] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-14T17:57:01.443400] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-14T17:57:01.795723] [INFO ] [REMOTE ] EQR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:02.158837] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-14T17:57:02.653939] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-14T17:57:02.958829] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-14T17:57:03.758863] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-14T17:57:04.465865] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-14T17:57:04.470870] [INFO ] [REMOTE ] EPRT: Full fetch complete (52804 records). [2025-09-14T17:57:04.471008] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-14T17:57:04.854720] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-14T17:57:04.854997] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-14T17:57:04.855896] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-14T17:57:04.855975] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-14T17:57:04.857468] [DEBUG] [LOCAL ] EPRT: Trimmed 52804 records to 36216 (keeping 150 days of data) [2025-09-14T17:57:04.890364] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (3.53 seconds). [2025-09-14T17:57:04.996171] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-14T17:57:05.125600] [DEBUG] [LOCAL ] EPRT: Primary data saved (36216 records). [2025-09-14T17:57:05.125795] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-14T17:57:05.125902] [INFO ] [MAIN ] Update Progress: 756/2370 symbols completed. EPRT took 29.3s. Estimated remaining: 2h 50m 34s. Rate: 9.5 symbols/min [2025-09-14T17:57:05.295420] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:05.298678] [DEBUG] [LOCAL ] EQS: Loaded 1409 existing records from primary storage. [2025-09-14T17:57:05.298777] [INFO ] [MAIN ] EQS: Loaded 1409 existing records. [2025-09-14T17:57:05.482168] [WARN ] [MAIN ] EQS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:05.483251] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-14T17:57:05.483592] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-14T17:57:05.484391] [DEBUG] [LOCAL ] EQS: Deleted primary data file. [2025-09-14T17:57:05.484534] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-14T17:57:05.866478] [INFO ] [REMOTE ] EQS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:05.877285] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-14T17:57:05.891003] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-14T17:57:05.921284] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-14T17:57:06.158829] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-14T17:57:06.349750] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T17:57:06.827437] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:57:06.958800] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-14T17:57:07.758840] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-14T17:57:08.103883] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:57:08.145351] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-14T17:57:08.395586] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T17:57:08.558857] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-14T17:57:08.846846] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-14T17:57:09.358851] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-14T17:57:10.158828] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-14T17:57:10.570468] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-14T17:57:10.958849] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-14T17:57:11.029938] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-14T17:57:11.035419] [INFO ] [REMOTE ] EQNR: Full fetch complete (57725 records). [2025-09-14T17:57:11.035547] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-14T17:57:11.413330] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-14T17:57:11.413437] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-14T17:57:11.414257] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-14T17:57:11.414316] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-14T17:57:11.415478] [DEBUG] [LOCAL ] EQNR: Trimmed 57725 records to 39924 (keeping 150 days of data) [2025-09-14T17:57:11.515362] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-14T17:57:11.673136] [DEBUG] [LOCAL ] EQNR: Primary data saved (39924 records). [2025-09-14T17:57:11.673301] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-14T17:57:11.673397] [INFO ] [MAIN ] Update Progress: 757/2370 symbols completed. EQNR took 26.5s. Estimated remaining: 2h 50m 28s. Rate: 9.5 symbols/min [2025-09-14T17:57:11.758799] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-14T17:57:12.479063] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:57:12.484563] [INFO ] [REMOTE ] EQH: Full fetch complete (57291 records). [2025-09-14T17:57:12.484737] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-14T17:57:12.563893] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-14T17:57:12.878613] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-14T17:57:12.878741] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-14T17:57:12.879572] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-14T17:57:12.879657] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-14T17:57:12.880956] [DEBUG] [LOCAL ] EQH: Trimmed 57291 records to 39546 (keeping 150 days of data) [2025-09-14T17:57:13.128979] [DEBUG] [LOCAL ] EQH: Primary data saved (39546 records). [2025-09-14T17:57:13.129174] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-14T17:57:13.129285] [INFO ] [MAIN ] Update Progress: 758/2370 symbols completed. EQH took 29.4s. Estimated remaining: 2h 50m 11s. Rate: 9.5 symbols/min [2025-09-14T17:57:13.358823] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-14T17:57:14.669370] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:57:14.670830] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-14T17:57:14.967068] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-14T17:57:14.978504] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-14T17:57:15.421276] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T17:57:15.758874] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-14T17:57:16.401189] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:57:16.402399] [INFO ] [REMOTE ] EQS: Full fetch complete (1835 records). [2025-09-14T17:57:16.402487] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-14T17:57:16.587178] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-14T17:57:16.587403] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:57:16.587470] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:57:16.587541] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-14T17:57:16.587632] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-14T17:57:16.587725] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-14T17:57:16.587819] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-14T17:57:16.587929] [INFO ] [MAIN ] Update Progress: 759/2370 symbols completed. EQS took 11.5s. Estimated remaining: 2h 49m 59s. Rate: 9.5 symbols/min [2025-09-14T17:57:17.155514] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T17:57:17.167701] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-14T17:57:18.891083] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:57:18.901950] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-14T17:57:20.658024] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:57:20.669573] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-14T17:57:22.192697] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:57:22.203993] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-14T17:57:22.851512] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:57:22.856902] [INFO ] [REMOTE ] EQR: Full fetch complete (55569 records). [2025-09-14T17:57:22.857025] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-14T17:57:23.237338] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-14T17:57:23.237510] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-14T17:57:23.238291] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-14T17:57:23.238352] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-14T17:57:23.239660] [DEBUG] [LOCAL ] EQR: Trimmed 55569 records to 38710 (keeping 150 days of data) [2025-09-14T17:57:23.485340] [DEBUG] [LOCAL ] EQR: Primary data saved (38710 records). [2025-09-14T17:57:23.485579] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-14T17:57:23.485711] [INFO ] [MAIN ] Update Progress: 760/2370 symbols completed. EQR took 22.4s. Estimated remaining: 2h 49m 53s. Rate: 9.5 symbols/min [2025-09-14T17:57:24.020956] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:24.164423] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:24.173349] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:24.176183] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:24.182293] [DEBUG] [LOCAL ] EQV: Loaded 1338 existing records from primary storage. [2025-09-14T17:57:24.182470] [INFO ] [MAIN ] EQV: Loaded 1338 existing records. [2025-09-14T17:57:24.310793] [DEBUG] [LOCAL ] ERO: Loaded 18618 existing records from primary storage. [2025-09-14T17:57:24.372441] [INFO ] [MAIN ] ERO: Loaded 18618 existing records. [2025-09-14T17:57:24.409207] [DEBUG] [LOCAL ] ERJ: Loaded 22996 existing records from primary storage. [2025-09-14T17:57:24.393044] [DEBUG] [LOCAL ] EQT: Loaded 24053 existing records from primary storage. [2025-09-14T17:57:24.409702] [INFO ] [MAIN ] ERJ: Loaded 22996 existing records. [2025-09-14T17:57:24.414867] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:24.435341] [INFO ] [MAIN ] EQT: Loaded 24053 existing records. [2025-09-14T17:57:24.511402] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-14T17:57:24.597407] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-14T17:57:24.755565] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-14T17:57:24.847830] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-14T17:57:24.949978] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:24.950892] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:25.056073] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-14T17:57:25.062719] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-14T17:57:25.090716] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-14T17:57:25.098501] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-14T17:57:25.090942] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:25.136579] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-14T17:57:25.125914] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-14T17:57:25.137009] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-14T17:57:25.157885] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-14T17:57:25.183454] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-14T17:57:25.220108] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-14T17:57:25.403267] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-14T17:57:25.502310] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-14T17:57:26.344265] [INFO ] [REMOTE ] EQV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:26.408900] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-14T17:57:26.440021] [INFO ] [REMOTE ] ERO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:26.459553] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:26.480150] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-14T17:57:26.506813] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-14T17:57:26.642578] [INFO ] [REMOTE ] EQT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:26.643012] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-14T17:57:27.216556] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T17:57:27.218460] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-14T17:57:27.795255] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T17:57:27.797007] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-14T17:57:28.160747] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:57:28.169132] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-14T17:57:28.246869] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T17:57:28.248606] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-14T17:57:28.289215] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T17:57:28.300383] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-14T17:57:28.372717] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T17:57:28.383081] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-14T17:57:28.793126] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T17:57:28.794820] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-14T17:57:29.478314] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T17:57:29.481179] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T17:57:29.491816] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-14T17:57:29.493831] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-14T17:57:30.015279] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T17:57:30.158794] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-14T17:57:30.195538] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:57:30.237813] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:57:30.627822] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T17:57:30.958895] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-14T17:57:31.153363] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:57:31.758890] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-14T17:57:32.558849] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-14T17:57:32.812340] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:57:32.864258] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T17:57:33.358837] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-14T17:57:34.158917] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-14T17:57:34.464508] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T17:57:34.549290] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:57:34.550223] [INFO ] [REMOTE ] EQV: Full fetch complete (3390 records). [2025-09-14T17:57:34.550316] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-14T17:57:34.899937] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-14T17:57:34.900046] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-14T17:57:34.900170] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-14T17:57:34.900222] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-14T17:57:34.900586] [DEBUG] [LOCAL ] EQV: Trimmed 3390 records to 2163 (keeping 150 days of data) [2025-09-14T17:57:34.914533] [DEBUG] [LOCAL ] EQV: Primary data saved (2163 records). [2025-09-14T17:57:34.914619] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-14T17:57:34.914752] [INFO ] [MAIN ] Update Progress: 761/2370 symbols completed. EQV took 11.4s. Estimated remaining: 2h 49m 58s. Rate: 9.5 symbols/min [2025-09-14T17:57:34.967965] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-14T17:57:35.101758] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:35.160364] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T17:57:35.181957] [DEBUG] [LOCAL ] ES: Loaded 23517 existing records from primary storage. [2025-09-14T17:57:35.182159] [INFO ] [MAIN ] ES: Loaded 23517 existing records. [2025-09-14T17:57:35.361031] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:35.361301] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-14T17:57:35.361368] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-14T17:57:35.362171] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-14T17:57:35.362239] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-14T17:57:35.713412] [INFO ] [REMOTE ] ES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:35.758833] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-14T17:57:36.186873] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T17:57:36.558885] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-14T17:57:37.363948] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-14T17:57:37.380691] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:57:38.158908] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-14T17:57:38.311985] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:57:38.958861] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-14T17:57:39.281828] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:57:39.758828] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-14T17:57:39.854875] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:57:40.328947] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T17:57:40.558894] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-14T17:57:41.358922] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-14T17:57:41.965764] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T17:57:42.158787] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-14T17:57:42.286429] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:57:42.963603] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-14T17:57:42.972034] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:57:43.758904] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-14T17:57:44.246821] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-14T17:57:44.558840] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-14T17:57:44.695579] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:57:45.240127] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:57:45.245713] [INFO ] [REMOTE ] EQT: Full fetch complete (58361 records). [2025-09-14T17:57:45.245867] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-14T17:57:45.360169] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-14T17:57:45.644459] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-14T17:57:45.644683] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-14T17:57:45.645768] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-14T17:57:45.645969] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-14T17:57:45.671863] [DEBUG] [LOCAL ] EQT: Trimmed 58361 records to 40425 (keeping 150 days of data) [2025-09-14T17:57:45.673062] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T17:57:45.932210] [DEBUG] [LOCAL ] EQT: Primary data saved (40425 records). [2025-09-14T17:57:45.932373] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-14T17:57:45.932470] [INFO ] [MAIN ] Update Progress: 762/2370 symbols completed. EQT took 22.4s. Estimated remaining: 2h 50m 1s. Rate: 9.5 symbols/min [2025-09-14T17:57:46.098899] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:46.111733] [DEBUG] [LOCAL ] ESAB: Loaded 11656 existing records from primary storage. [2025-09-14T17:57:46.111889] [INFO ] [MAIN ] ESAB: Loaded 11656 existing records. [2025-09-14T17:57:46.166285] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-14T17:57:46.292734] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:46.292993] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-14T17:57:46.293053] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-14T17:57:46.293533] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-14T17:57:46.293595] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-14T17:57:46.655068] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:46.717730] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T17:57:46.722733] [INFO ] [REMOTE ] ERO: Full fetch complete (44956 records). [2025-09-14T17:57:46.722850] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-14T17:57:46.963946] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-14T17:57:47.140957] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-14T17:57:47.141076] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-14T17:57:47.141799] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-14T17:57:47.141859] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-14T17:57:47.143051] [DEBUG] [LOCAL ] ERO: Trimmed 44956 records to 30409 (keeping 150 days of data) [2025-09-14T17:57:47.323107] [DEBUG] [LOCAL ] ERO: Primary data saved (30409 records). [2025-09-14T17:57:47.323282] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-14T17:57:47.323401] [INFO ] [MAIN ] Update Progress: 763/2370 symbols completed. ERO took 23.8s. Estimated remaining: 2h 49m 45s. Rate: 9.5 symbols/min [2025-09-14T17:57:47.490903] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:47.500386] [DEBUG] [LOCAL ] ESE: Loaded 7782 existing records from primary storage. [2025-09-14T17:57:47.500518] [INFO ] [MAIN ] ESE: Loaded 7782 existing records. [2025-09-14T17:57:47.684750] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:47.684980] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-14T17:57:47.685048] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-14T17:57:47.685400] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-14T17:57:47.685485] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-14T17:57:47.766012] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-14T17:57:48.069154] [INFO ] [REMOTE ] ESE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:48.156390] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T17:57:48.558787] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-14T17:57:48.832157] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T17:57:48.943935] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:57:49.287761] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T17:57:49.358838] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-14T17:57:50.158912] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-14T17:57:50.590381] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T17:57:50.958917] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-14T17:57:51.165940] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T17:57:51.758857] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-14T17:57:52.558919] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-14T17:57:52.770382] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T17:57:52.865828] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T17:57:53.358874] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-14T17:57:54.120447] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:57:54.158783] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-14T17:57:54.903797] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T17:57:54.958794] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-14T17:57:55.758839] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-14T17:57:55.780781] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T17:57:55.789212] [INFO ] [REMOTE ] ERJ: Full fetch complete (55440 records). [2025-09-14T17:57:55.789367] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-14T17:57:56.182886] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-14T17:57:56.183062] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-14T17:57:56.183948] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-14T17:57:56.184018] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-14T17:57:56.185587] [DEBUG] [LOCAL ] ERJ: Trimmed 55440 records to 38090 (keeping 150 days of data) [2025-09-14T17:57:56.422115] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T17:57:56.467927] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:57:56.475667] [INFO ] [REMOTE ] ES: Full fetch complete (57157 records). [2025-09-14T17:57:56.476146] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-14T17:57:56.559580] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-14T17:57:56.591552] [DEBUG] [LOCAL ] ERJ: Primary data saved (38090 records). [2025-09-14T17:57:56.612797] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-14T17:57:56.685445] [INFO ] [MAIN ] Update Progress: 764/2370 symbols completed. ERJ took 33.2s. Estimated remaining: 2h 49m 45s. Rate: 9.5 symbols/min [2025-09-14T17:57:57.063707] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:57.063993] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-14T17:57:57.064622] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-14T17:57:57.065883] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-14T17:57:57.066067] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-14T17:57:57.067944] [DEBUG] [LOCAL ] ES: Trimmed 57157 records to 39539 (keeping 150 days of data) [2025-09-14T17:57:57.181785] [DEBUG] [LOCAL ] ESI: Loaded 22420 existing records from primary storage. [2025-09-14T17:57:57.185876] [INFO ] [MAIN ] ESI: Loaded 22420 existing records. [2025-09-14T17:57:57.376133] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-14T17:57:57.381986] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:57.386176] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-14T17:57:57.388803] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-14T17:57:57.393716] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-14T17:57:57.394054] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-14T17:57:57.887516] [INFO ] [REMOTE ] ESI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:57.888103] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T17:57:57.916546] [DEBUG] [LOCAL ] ES: Primary data saved (39539 records). [2025-09-14T17:57:57.916762] [INFO ] [MAIN ] ES: Full history saved. [2025-09-14T17:57:57.916951] [INFO ] [MAIN ] Update Progress: 765/2370 symbols completed. ES took 23.0s. Estimated remaining: 2h 49m 28s. Rate: 9.5 symbols/min [2025-09-14T17:57:58.091196] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:58.108803] [DEBUG] [LOCAL ] ESNT: Loaded 17075 existing records from primary storage. [2025-09-14T17:57:58.108977] [INFO ] [MAIN ] ESNT: Loaded 17075 existing records. [2025-09-14T17:57:58.171596] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-14T17:57:58.289545] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:58.289866] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-14T17:57:58.289942] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-14T17:57:58.290547] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-14T17:57:58.290611] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-14T17:57:58.651239] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:58.666031] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:57:58.958828] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-14T17:57:59.758805] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-14T17:57:59.829006] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:57:59.900986] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T17:58:00.558807] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-14T17:58:00.607388] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T17:58:01.358872] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-14T17:58:01.818239] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:58:02.158845] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-14T17:58:02.958851] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-14T17:58:02.984705] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T17:58:03.308033] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T17:58:03.758842] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-14T17:58:04.321109] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T17:58:04.558896] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-14T17:58:04.984168] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T17:58:05.358836] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-14T17:58:06.109535] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T17:58:06.158780] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-14T17:58:06.904902] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:58:06.958783] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-14T17:58:07.758831] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-14T17:58:07.884280] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T17:58:08.098376] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:58:08.101556] [INFO ] [REMOTE ] ESAB: Full fetch complete (27403 records). [2025-09-14T17:58:08.101687] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-14T17:58:08.480776] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-14T17:58:08.480919] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-14T17:58:08.482161] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-14T17:58:08.482226] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-14T17:58:08.483521] [DEBUG] [LOCAL ] ESAB: Trimmed 27403 records to 18378 (keeping 150 days of data) [2025-09-14T17:58:08.573531] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-14T17:58:08.610585] [DEBUG] [LOCAL ] ESAB: Primary data saved (18378 records). [2025-09-14T17:58:08.610805] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-14T17:58:08.610946] [INFO ] [MAIN ] Update Progress: 766/2370 symbols completed. ESAB took 22.7s. Estimated remaining: 2h 49m 30s. Rate: 9.5 symbols/min [2025-09-14T17:58:08.786881] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:08.819974] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:58:08.844723] [DEBUG] [LOCAL ] ESRT: Loaded 20999 existing records from primary storage. [2025-09-14T17:58:08.844916] [INFO ] [MAIN ] ESRT: Loaded 20999 existing records. [2025-09-14T17:58:09.026415] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:09.026817] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-14T17:58:09.026889] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-14T17:58:09.027494] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-14T17:58:09.027564] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-14T17:58:09.363932] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-14T17:58:09.392465] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:10.158877] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-14T17:58:10.269724] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T17:58:10.703168] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:58:10.705511] [INFO ] [REMOTE ] ESE: Full fetch complete (17923 records). [2025-09-14T17:58:10.705607] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-14T17:58:10.963968] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-14T17:58:11.074713] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-14T17:58:11.074854] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-14T17:58:11.075677] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-14T17:58:11.075744] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-14T17:58:11.076453] [DEBUG] [LOCAL ] ESE: Trimmed 17923 records to 12305 (keeping 150 days of data) [2025-09-14T17:58:11.162628] [DEBUG] [LOCAL ] ESE: Primary data saved (12305 records). [2025-09-14T17:58:11.162943] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-14T17:58:11.163340] [INFO ] [MAIN ] Update Progress: 767/2370 symbols completed. ESE took 23.8s. Estimated remaining: 2h 49m 16s. Rate: 9.5 symbols/min [2025-09-14T17:58:11.342631] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:11.377849] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T17:58:11.395158] [DEBUG] [LOCAL ] ESS: Loaded 13431 existing records from primary storage. [2025-09-14T17:58:11.395384] [INFO ] [MAIN ] ESS: Loaded 13431 existing records. [2025-09-14T17:58:11.581983] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:11.582299] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-14T17:58:11.582365] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-14T17:58:11.582901] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-14T17:58:11.582966] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-14T17:58:11.766759] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-14T17:58:11.935533] [INFO ] [REMOTE ] ESS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:12.542506] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:58:12.558777] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-14T17:58:13.363598] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-14T17:58:13.368741] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:58:13.757974] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T17:58:14.158819] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-14T17:58:14.958801] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-14T17:58:15.021536] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T17:58:15.758818] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-14T17:58:15.897252] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T17:58:16.393618] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:58:16.558799] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-14T17:58:17.358829] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-14T17:58:17.476314] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:58:17.752431] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:58:18.158816] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-14T17:58:18.843079] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:58:18.849899] [INFO ] [REMOTE ] ESI: Full fetch complete (55149 records). [2025-09-14T17:58:18.850173] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-14T17:58:18.962668] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-14T17:58:19.272244] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-14T17:58:19.272581] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-14T17:58:19.273849] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-14T17:58:19.274228] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-14T17:58:19.306795] [DEBUG] [LOCAL ] ESI: Trimmed 55149 records to 37839 (keeping 150 days of data) [2025-09-14T17:58:19.309053] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T17:58:19.601552] [DEBUG] [LOCAL ] ESI: Primary data saved (37839 records). [2025-09-14T17:58:19.601809] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-14T17:58:19.601979] [INFO ] [MAIN ] Update Progress: 768/2370 symbols completed. ESI took 22.9s. Estimated remaining: 2h 49m 14s. Rate: 9.5 symbols/min [2025-09-14T17:58:19.765274] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-14T17:58:19.776817] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:19.803526] [DEBUG] [LOCAL ] ESTC: Loaded 22442 existing records from primary storage. [2025-09-14T17:58:19.803816] [INFO ] [MAIN ] ESTC: Loaded 22442 existing records. [2025-09-14T17:58:19.994117] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:19.994485] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-14T17:58:19.994552] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-14T17:58:19.995250] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-14T17:58:19.995329] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-14T17:58:20.367114] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:20.392402] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T17:58:20.558869] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-14T17:58:21.363914] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-14T17:58:21.367603] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:58:22.166366] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-14T17:58:22.193072] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T17:58:22.939309] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:58:22.958789] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-14T17:58:23.438773] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:58:23.758864] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-14T17:58:24.558860] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-14T17:58:24.826851] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:58:25.149430] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:58:25.358889] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-14T17:58:25.933856] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:58:26.158842] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-14T17:58:26.958890] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-14T17:58:27.208385] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:58:27.758858] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-14T17:58:27.823936] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:58:28.385209] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T17:58:28.558822] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-14T17:58:29.301160] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T17:58:29.358809] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-14T17:58:29.950368] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T17:58:29.955083] [INFO ] [REMOTE ] ESRT: Full fetch complete (50067 records). [2025-09-14T17:58:29.955213] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-14T17:58:30.167564] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-14T17:58:30.348185] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-14T17:58:30.348296] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-14T17:58:30.349062] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-14T17:58:30.349139] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-14T17:58:30.350503] [DEBUG] [LOCAL ] ESRT: Trimmed 50067 records to 34810 (keeping 150 days of data) [2025-09-14T17:58:30.560418] [DEBUG] [LOCAL ] ESRT: Primary data saved (34810 records). [2025-09-14T17:58:30.560591] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-14T17:58:30.560714] [INFO ] [MAIN ] Update Progress: 769/2370 symbols completed. ESRT took 21.9s. Estimated remaining: 2h 49m 17s. Rate: 9.5 symbols/min [2025-09-14T17:58:30.731156] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:30.755149] [DEBUG] [LOCAL ] ET: Loaded 24152 existing records from primary storage. [2025-09-14T17:58:30.755325] [INFO ] [MAIN ] ET: Loaded 24152 existing records. [2025-09-14T17:58:30.928380] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:30.928620] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-14T17:58:30.928703] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-14T17:58:30.929471] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-14T17:58:30.929542] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-14T17:58:30.971665] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-14T17:58:31.322113] [INFO ] [REMOTE ] ET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:31.358634] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T17:58:31.540003] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T17:58:31.758833] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-14T17:58:32.079215] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:58:32.083386] [INFO ] [REMOTE ] ESNT: Full fetch complete (42814 records). [2025-09-14T17:58:32.083526] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-14T17:58:32.484697] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-14T17:58:32.484848] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-14T17:58:32.485931] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-14T17:58:32.486104] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-14T17:58:32.496364] [DEBUG] [LOCAL ] ESNT: Trimmed 42814 records to 28299 (keeping 150 days of data) [2025-09-14T17:58:32.509070] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T17:58:32.570233] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-14T17:58:32.696428] [DEBUG] [LOCAL ] ESNT: Primary data saved (28299 records). [2025-09-14T17:58:32.696599] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-14T17:58:32.696764] [INFO ] [MAIN ] Update Progress: 770/2370 symbols completed. ESNT took 34.8s. Estimated remaining: 2h 49m 2s. Rate: 9.5 symbols/min [2025-09-14T17:58:32.862374] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:32.869501] [DEBUG] [LOCAL ] ETB: Loaded 4590 existing records from primary storage. [2025-09-14T17:58:32.869660] [INFO ] [MAIN ] ETB: Loaded 4590 existing records. [2025-09-14T17:58:33.042995] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:33.043239] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-14T17:58:33.043313] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-14T17:58:33.043690] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-14T17:58:33.043764] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-14T17:58:33.363887] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-14T17:58:33.389999] [INFO ] [REMOTE ] ETB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:34.158830] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-14T17:58:34.791471] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T17:58:34.827901] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-14T17:58:34.958835] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-14T17:58:35.758839] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-14T17:58:35.925448] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:58:36.436282] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-14T17:58:36.558807] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-14T17:58:37.284671] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T17:58:37.358785] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-14T17:58:37.533576] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T17:58:38.158890] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-14T17:58:38.707515] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:58:38.710889] [INFO ] [REMOTE ] ESS: Full fetch complete (32692 records). [2025-09-14T17:58:38.711069] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-14T17:58:38.963942] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-14T17:58:39.086755] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-14T17:58:39.086881] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-14T17:58:39.087512] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-14T17:58:39.087579] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-14T17:58:39.088609] [DEBUG] [LOCAL ] ESS: Trimmed 32692 records to 22486 (keeping 150 days of data) [2025-09-14T17:58:39.240484] [DEBUG] [LOCAL ] ESS: Primary data saved (22486 records). [2025-09-14T17:58:39.240673] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-14T17:58:39.240815] [INFO ] [MAIN ] Update Progress: 771/2370 symbols completed. ESS took 28.1s. Estimated remaining: 2h 48m 56s. Rate: 9.5 symbols/min [2025-09-14T17:58:39.410854] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:39.423394] [DEBUG] [LOCAL ] ETD: Loaded 11853 existing records from primary storage. [2025-09-14T17:58:39.423541] [INFO ] [MAIN ] ETD: Loaded 11853 existing records. [2025-09-14T17:58:39.609673] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:39.626849] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-14T17:58:39.626934] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-14T17:58:39.627527] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-14T17:58:39.628770] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T17:58:39.628863] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-14T17:58:39.763872] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-14T17:58:39.993206] [INFO ] [REMOTE ] ETD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:40.566352] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-14T17:58:40.585248] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T17:58:40.873270] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:58:41.358824] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-14T17:58:42.119476] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T17:58:42.158790] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-14T17:58:42.854174] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T17:58:42.938910] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-14T17:58:42.958828] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-14T17:58:43.758948] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-14T17:58:43.802888] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T17:58:44.558864] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-14T17:58:45.358866] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-14T17:58:45.931695] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-14T17:58:45.944179] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T17:58:46.158832] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-14T17:58:46.184605] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T17:58:46.190187] [INFO ] [REMOTE ] ESTC: Full fetch complete (54502 records). [2025-09-14T17:58:46.190308] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-14T17:58:46.566793] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-14T17:58:46.566920] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-14T17:58:46.567720] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-14T17:58:46.567784] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-14T17:58:46.569112] [DEBUG] [LOCAL ] ESTC: Trimmed 54502 records to 37899 (keeping 150 days of data) [2025-09-14T17:58:46.806059] [DEBUG] [LOCAL ] ESTC: Primary data saved (37899 records). [2025-09-14T17:58:46.806236] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-14T17:58:46.806346] [INFO ] [MAIN ] Update Progress: 772/2370 symbols completed. ESTC took 27.2s. Estimated remaining: 2h 48m 53s. Rate: 9.5 symbols/min [2025-09-14T17:58:46.964107] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-14T17:58:46.996867] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:47.009235] [DEBUG] [LOCAL ] ETG: Loaded 6855 existing records from primary storage. [2025-09-14T17:58:47.009874] [INFO ] [MAIN ] ETG: Loaded 6855 existing records. [2025-09-14T17:58:47.199195] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:47.199552] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-14T17:58:47.199661] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-14T17:58:47.200104] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-14T17:58:47.200190] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-14T17:58:47.555925] [INFO ] [REMOTE ] ETG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:47.683331] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:58:47.684767] [INFO ] [REMOTE ] ETB: Full fetch complete (13958 records). [2025-09-14T17:58:47.684852] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-14T17:58:47.764041] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-14T17:58:48.055282] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-14T17:58:48.055417] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-14T17:58:48.055847] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-14T17:58:48.055910] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-14T17:58:48.056504] [DEBUG] [LOCAL ] ETB: Trimmed 13958 records to 8298 (keeping 150 days of data) [2025-09-14T17:58:48.108785] [DEBUG] [LOCAL ] ETB: Primary data saved (8298 records). [2025-09-14T17:58:48.108933] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-14T17:58:48.109034] [INFO ] [MAIN ] Update Progress: 773/2370 symbols completed. ETB took 15.4s. Estimated remaining: 2h 48m 36s. Rate: 9.5 symbols/min [2025-09-14T17:58:48.279085] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:48.289358] [DEBUG] [LOCAL ] ETJ: Loaded 7043 existing records from primary storage. [2025-09-14T17:58:48.289511] [INFO ] [MAIN ] ETJ: Loaded 7043 existing records. [2025-09-14T17:58:48.468397] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:48.469183] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-14T17:58:48.469304] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-14T17:58:48.469727] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-14T17:58:48.469884] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-14T17:58:48.560410] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-14T17:58:48.872568] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:48.869171] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-14T17:58:48.895057] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T17:58:49.358825] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-14T17:58:49.650566] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:58:50.158866] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-14T17:58:50.958828] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-14T17:58:51.276703] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:58:51.635578] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-14T17:58:51.758830] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-14T17:58:51.844601] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:58:52.558909] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-14T17:58:52.881964] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T17:58:53.358835] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-14T17:58:53.803623] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T17:58:54.158887] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-14T17:58:54.958900] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-14T17:58:55.281328] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:58:55.370220] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-14T17:58:55.376194] [INFO ] [REMOTE ] ET: Full fetch complete (58470 records). [2025-09-14T17:58:55.376405] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-14T17:58:55.766311] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-14T17:58:55.768552] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-14T17:58:55.768746] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-14T17:58:55.770122] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-14T17:58:55.770298] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-14T17:58:55.772239] [DEBUG] [LOCAL ] ET: Trimmed 58470 records to 40530 (keeping 150 days of data) [2025-09-14T17:58:56.040278] [DEBUG] [LOCAL ] ET: Primary data saved (40530 records). [2025-09-14T17:58:56.040438] [INFO ] [MAIN ] ET: Full history saved. [2025-09-14T17:58:56.040543] [INFO ] [MAIN ] Update Progress: 774/2370 symbols completed. ET took 25.5s. Estimated remaining: 2h 48m 33s. Rate: 9.5 symbols/min [2025-09-14T17:58:56.217290] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:56.241268] [DEBUG] [LOCAL ] ETN: Loaded 23515 existing records from primary storage. [2025-09-14T17:58:56.241455] [INFO ] [MAIN ] ETN: Loaded 23515 existing records. [2025-09-14T17:58:56.420130] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:56.420509] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-14T17:58:56.420737] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-14T17:58:56.437693] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-14T17:58:56.437845] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-14T17:58:56.471366] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T17:58:56.563898] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-14T17:58:56.800929] [INFO ] [REMOTE ] ETN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:57.002593] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T17:58:57.358865] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-14T17:58:57.424978] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T17:58:58.158849] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-14T17:58:58.744521] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:58:58.958839] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-14T17:58:59.295744] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T17:58:59.758844] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-14T17:58:59.892194] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:59:00.558851] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-14T17:59:00.718184] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T17:59:01.358788] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-14T17:59:01.748303] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:59:02.158902] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-14T17:59:02.376815] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T17:59:02.879270] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:59:02.958842] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-14T17:59:03.758806] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-14T17:59:03.872274] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:59:04.558835] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-14T17:59:05.078401] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T17:59:05.327880] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:59:05.329858] [INFO ] [REMOTE ] ETG: Full fetch complete (18440 records). [2025-09-14T17:59:05.329970] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-14T17:59:05.363892] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-14T17:59:05.702254] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-14T17:59:05.702361] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-14T17:59:05.702787] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-14T17:59:05.702847] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-14T17:59:05.703413] [DEBUG] [LOCAL ] ETG: Trimmed 18440 records to 12352 (keeping 150 days of data) [2025-09-14T17:59:05.780732] [DEBUG] [LOCAL ] ETG: Primary data saved (12352 records). [2025-09-14T17:59:05.780903] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-14T17:59:05.781003] [INFO ] [MAIN ] Update Progress: 775/2370 symbols completed. ETG took 19.0s. Estimated remaining: 2h 48m 34s. Rate: 9.5 symbols/min [2025-09-14T17:59:05.956481] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:05.961051] [DEBUG] [LOCAL ] ETO: Loaded 2778 existing records from primary storage. [2025-09-14T17:59:05.961195] [INFO ] [MAIN ] ETO: Loaded 2778 existing records. [2025-09-14T17:59:06.137133] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:06.137409] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-14T17:59:06.137471] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-14T17:59:06.137779] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-14T17:59:06.137852] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-14T17:59:06.168465] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-14T17:59:06.495073] [INFO ] [REMOTE ] ETO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:06.637423] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:59:06.640722] [INFO ] [REMOTE ] ETD: Full fetch complete (29547 records). [2025-09-14T17:59:06.640839] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-14T17:59:06.971127] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-14T17:59:07.021142] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-14T17:59:07.021258] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-14T17:59:07.022208] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-14T17:59:07.022475] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-14T17:59:07.023687] [DEBUG] [LOCAL ] ETD: Trimmed 29547 records to 20670 (keeping 150 days of data) [2025-09-14T17:59:07.164404] [DEBUG] [LOCAL ] ETD: Primary data saved (20670 records). [2025-09-14T17:59:07.164572] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-14T17:59:07.164689] [INFO ] [MAIN ] Update Progress: 776/2370 symbols completed. ETD took 27.9s. Estimated remaining: 2h 48m 17s. Rate: 9.5 symbols/min [2025-09-14T17:59:07.334687] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:07.358071] [DEBUG] [LOCAL ] ETR: Loaded 23843 existing records from primary storage. [2025-09-14T17:59:07.358272] [INFO ] [MAIN ] ETR: Loaded 23843 existing records. [2025-09-14T17:59:07.545220] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:07.545564] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-14T17:59:07.545633] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-14T17:59:07.546439] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-14T17:59:07.546544] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-14T17:59:07.765679] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-14T17:59:07.756595] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-14T17:59:07.953171] [INFO ] [REMOTE ] ETR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:08.129373] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:59:08.501034] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T17:59:08.558845] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-14T17:59:09.260885] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T17:59:09.358901] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-14T17:59:10.158835] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-14T17:59:10.344667] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:59:10.958839] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-14T17:59:10.982125] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:59:11.758843] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-14T17:59:12.558820] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-14T17:59:13.075385] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T17:59:13.358843] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-14T17:59:13.384475] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:59:13.487805] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T17:59:14.158827] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-14T17:59:14.865910] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:59:14.867962] [INFO ] [REMOTE ] ETJ: Full fetch complete (18594 records). [2025-09-14T17:59:14.868047] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-14T17:59:14.964997] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-14T17:59:15.236837] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-14T17:59:15.236945] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-14T17:59:15.237468] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-14T17:59:15.237538] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-14T17:59:15.238177] [DEBUG] [LOCAL ] ETJ: Trimmed 18594 records to 11407 (keeping 150 days of data) [2025-09-14T17:59:15.306233] [DEBUG] [LOCAL ] ETJ: Primary data saved (11407 records). [2025-09-14T17:59:15.306406] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-14T17:59:15.306510] [INFO ] [MAIN ] Update Progress: 777/2370 symbols completed. ETJ took 27.2s. Estimated remaining: 2h 48m 14s. Rate: 9.5 symbols/min [2025-09-14T17:59:15.480195] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:15.490962] [DEBUG] [LOCAL ] ETV: Loaded 8956 existing records from primary storage. [2025-09-14T17:59:15.491111] [INFO ] [MAIN ] ETV: Loaded 8956 existing records. [2025-09-14T17:59:15.684048] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:15.684536] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-14T17:59:15.684609] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-14T17:59:15.685337] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-14T17:59:15.685735] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-14T17:59:15.759357] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-14T17:59:15.992523] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-14T17:59:16.108589] [INFO ] [REMOTE ] ETV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:16.539694] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:59:16.558765] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-14T17:59:16.824234] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T17:59:17.091256] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T17:59:17.358857] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-14T17:59:18.158833] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-14T17:59:18.958801] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-14T17:59:19.335365] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:59:19.375386] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T17:59:19.639770] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T17:59:19.758857] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-14T17:59:20.558840] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-14T17:59:21.154882] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T17:59:21.156092] [INFO ] [REMOTE ] ETO: Full fetch complete (7168 records). [2025-09-14T17:59:21.156177] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-14T17:59:21.363893] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-14T17:59:21.512751] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-14T17:59:21.512934] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-14T17:59:21.513228] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-14T17:59:21.513347] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-14T17:59:21.514029] [DEBUG] [LOCAL ] ETO: Trimmed 7168 records to 4919 (keeping 150 days of data) [2025-09-14T17:59:21.545570] [DEBUG] [LOCAL ] ETO: Primary data saved (4919 records). [2025-09-14T17:59:21.545721] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-14T17:59:21.545818] [INFO ] [MAIN ] Update Progress: 778/2370 symbols completed. ETO took 15.8s. Estimated remaining: 2h 48m 8s. Rate: 9.5 symbols/min [2025-09-14T17:59:21.723622] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:21.763345] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T17:59:21.779789] [DEBUG] [LOCAL ] ETW: Loaded 10589 existing records from primary storage. [2025-09-14T17:59:21.780275] [INFO ] [MAIN ] ETW: Loaded 10589 existing records. [2025-09-14T17:59:21.954419] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:21.954716] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-14T17:59:21.954775] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-14T17:59:21.955248] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-14T17:59:21.955308] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-14T17:59:22.164114] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-14T17:59:22.313873] [INFO ] [REMOTE ] ETW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:22.958776] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-14T17:59:23.510759] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-14T17:59:23.758882] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-14T17:59:24.112458] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T17:59:24.205171] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T17:59:24.558870] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-14T17:59:25.358804] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-14T17:59:25.481047] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:59:25.610876] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T17:59:26.158864] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-14T17:59:26.958838] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-14T17:59:27.153711] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T17:59:27.221691] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T17:59:27.758832] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-14T17:59:28.558843] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-14T17:59:29.197858] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-14T17:59:29.358794] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-14T17:59:29.627180] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T17:59:29.662162] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T17:59:29.667599] [INFO ] [REMOTE ] ETN: Full fetch complete (57560 records). [2025-09-14T17:59:29.667762] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-14T17:59:30.028293] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:59:30.080719] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-14T17:59:30.080813] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-14T17:59:30.081748] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-14T17:59:30.081830] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-14T17:59:30.083033] [DEBUG] [LOCAL ] ETN: Trimmed 57560 records to 39663 (keeping 150 days of data) [2025-09-14T17:59:30.177167] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-14T17:59:30.345914] [DEBUG] [LOCAL ] ETN: Primary data saved (39663 records). [2025-09-14T17:59:30.346096] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-14T17:59:30.346204] [INFO ] [MAIN ] Update Progress: 779/2370 symbols completed. ETN took 34.3s. Estimated remaining: 2h 48m 7s. Rate: 9.5 symbols/min [2025-09-14T17:59:30.520556] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:30.525120] [DEBUG] [LOCAL ] ETX: Loaded 2927 existing records from primary storage. [2025-09-14T17:59:30.525217] [INFO ] [MAIN ] ETX: Loaded 2927 existing records. [2025-09-14T17:59:30.705320] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:30.705627] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-14T17:59:30.705712] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-14T17:59:30.706089] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-14T17:59:30.706152] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-14T17:59:30.965082] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-14T17:59:31.072409] [INFO ] [REMOTE ] ETX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:31.096024] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:59:31.758894] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-14T17:59:32.558873] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-14T17:59:32.666226] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:59:32.905158] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T17:59:32.948072] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T17:59:33.358881] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-14T17:59:34.158863] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-14T17:59:34.609735] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T17:59:34.652598] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T17:59:34.958864] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-14T17:59:35.502094] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:59:35.758841] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-14T17:59:36.387675] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T17:59:36.558856] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-14T17:59:37.172278] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:59:37.358834] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-14T17:59:38.158873] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-14T17:59:38.442743] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T17:59:38.777871] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T17:59:38.958852] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-14T17:59:39.758871] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-14T17:59:40.255272] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T17:59:40.469167] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:59:40.474605] [INFO ] [REMOTE ] ETR: Full fetch complete (57931 records). [2025-09-14T17:59:40.474762] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-14T17:59:40.564110] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-14T17:59:40.867389] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-14T17:59:40.867508] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-14T17:59:40.868327] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-14T17:59:40.868388] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-14T17:59:40.869782] [DEBUG] [LOCAL ] ETR: Trimmed 57931 records to 40047 (keeping 150 days of data) [2025-09-14T17:59:41.142411] [DEBUG] [LOCAL ] ETR: Primary data saved (40047 records). [2025-09-14T17:59:41.142568] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-14T17:59:41.142711] [INFO ] [MAIN ] Update Progress: 780/2370 symbols completed. ETR took 34.0s. Estimated remaining: 2h 48m 9s. Rate: 9.5 symbols/min [2025-09-14T17:59:41.313096] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:41.324221] [DEBUG] [LOCAL ] ETY: Loaded 9571 existing records from primary storage. [2025-09-14T17:59:41.324362] [INFO ] [MAIN ] ETY: Loaded 9571 existing records. [2025-09-14T17:59:41.366780] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-14T17:59:41.536902] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:41.537250] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-14T17:59:41.537341] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-14T17:59:41.542673] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-14T17:59:41.542874] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:59:41.543010] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-14T17:59:41.560723] [INFO ] [REMOTE ] ETV: Full fetch complete (23272 records). [2025-09-14T17:59:41.601135] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-14T17:59:42.197940] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-14T17:59:42.203228] [INFO ] [REMOTE ] ETY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:42.287521] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-14T17:59:42.288340] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T17:59:42.288400] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-14T17:59:42.291368] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-14T17:59:42.291768] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-14T17:59:42.292418] [DEBUG] [LOCAL ] ETV: Trimmed 23272 records to 15357 (keeping 150 days of data) [2025-09-14T17:59:42.385122] [DEBUG] [LOCAL ] ETV: Primary data saved (15357 records). [2025-09-14T17:59:42.385274] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-14T17:59:42.385383] [INFO ] [MAIN ] Update Progress: 781/2370 symbols completed. ETV took 27.1s. Estimated remaining: 2h 47m 53s. Rate: 9.5 symbols/min [2025-09-14T17:59:42.557075] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:42.566312] [DEBUG] [LOCAL ] EVC: Loaded 8122 existing records from primary storage. [2025-09-14T17:59:42.566451] [INFO ] [MAIN ] EVC: Loaded 8122 existing records. [2025-09-14T17:59:42.744986] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:42.745247] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-14T17:59:42.745308] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-14T17:59:42.745618] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-14T17:59:42.745717] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-14T17:59:42.964048] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-14T17:59:43.106655] [INFO ] [REMOTE ] EVC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:43.527623] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T17:59:43.758865] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-14T17:59:44.232157] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:59:44.558802] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-14T17:59:44.871371] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T17:59:45.358837] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-14T17:59:45.486193] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:59:45.955520] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T17:59:45.956849] [INFO ] [REMOTE ] ETX: Full fetch complete (5264 records). [2025-09-14T17:59:45.956939] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-14T17:59:46.166493] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-14T17:59:46.318460] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-14T17:59:46.318578] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-14T17:59:46.318768] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-14T17:59:46.318824] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-14T17:59:46.319242] [DEBUG] [LOCAL ] ETX: Trimmed 5264 records to 4115 (keeping 150 days of data) [2025-09-14T17:59:46.350813] [DEBUG] [LOCAL ] ETX: Primary data saved (4115 records). [2025-09-14T17:59:46.351079] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-14T17:59:46.351230] [INFO ] [MAIN ] Update Progress: 782/2370 symbols completed. ETX took 16.0s. Estimated remaining: 2h 47m 41s. Rate: 9.5 symbols/min [2025-09-14T17:59:46.521962] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:46.542794] [DEBUG] [LOCAL ] EVEX: Loaded 17036 existing records from primary storage. [2025-09-14T17:59:46.542975] [INFO ] [MAIN ] EVEX: Loaded 17036 existing records. [2025-09-14T17:59:46.719682] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:46.719974] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-14T17:59:46.720045] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-14T17:59:46.720551] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-14T17:59:46.720633] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-14T17:59:46.964108] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-14T17:59:47.077483] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:47.576062] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T17:59:47.758827] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-14T17:59:48.309709] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T17:59:48.558833] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-14T17:59:48.985268] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T17:59:49.358838] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-14T17:59:49.683568] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T17:59:50.158852] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-14T17:59:50.277504] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T17:59:50.958837] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-14T17:59:51.303567] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:59:51.758856] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-14T17:59:52.091535] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T17:59:52.558846] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-14T17:59:52.849003] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:59:52.852029] [INFO ] [REMOTE ] ETW: Full fetch complete (27290 records). [2025-09-14T17:59:52.852126] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-14T17:59:53.218863] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-14T17:59:53.218993] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-14T17:59:53.219548] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-14T17:59:53.219602] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-14T17:59:53.220447] [DEBUG] [LOCAL ] ETW: Trimmed 27290 records to 18395 (keeping 150 days of data) [2025-09-14T17:59:53.334584] [DEBUG] [LOCAL ] ETW: Primary data saved (18395 records). [2025-09-14T17:59:53.334762] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-14T17:59:53.334863] [INFO ] [MAIN ] Update Progress: 783/2370 symbols completed. ETW took 31.8s. Estimated remaining: 2h 47m 36s. Rate: 9.5 symbols/min [2025-09-14T17:59:53.365306] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-14T17:59:53.520851] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:53.528039] [DEBUG] [LOCAL ] EVF: Loaded 4415 existing records from primary storage. [2025-09-14T17:59:53.528192] [INFO ] [MAIN ] EVF: Loaded 4415 existing records. [2025-09-14T17:59:53.715092] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:53.726902] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-14T17:59:53.727444] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T17:59:53.727669] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-14T17:59:53.732443] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-14T17:59:53.732517] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-14T17:59:54.123500] [INFO ] [REMOTE ] EVF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:54.158899] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-14T17:59:54.429529] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T17:59:54.804820] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T17:59:54.958900] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-14T17:59:55.758830] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-14T17:59:55.782115] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T17:59:56.558844] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-14T17:59:57.096465] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T17:59:57.268276] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-14T17:59:57.358787] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-14T17:59:58.158884] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-14T17:59:58.759895] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:59:58.958797] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-14T17:59:59.011040] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T17:59:59.758811] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-14T17:59:59.822447] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T18:00:00.558895] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-14T18:00:00.997869] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T18:00:01.358929] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-14T18:00:01.462130] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T18:00:02.158890] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-14T18:00:02.958855] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-14T18:00:03.758830] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-14T18:00:03.847329] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-14T18:00:04.558831] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-14T18:00:05.137786] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-09-14T18:00:05.358867] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-14T18:00:05.621951] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-14T18:00:05.626930] [INFO ] [REMOTE ] EVC: Full fetch complete (22107 records). [2025-09-14T18:00:05.627227] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-14T18:00:06.003937] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T18:00:06.052972] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-14T18:00:06.053172] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-14T18:00:06.053832] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-14T18:00:06.054055] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-14T18:00:06.055029] [DEBUG] [LOCAL ] EVC: Trimmed 22107 records to 14021 (keeping 150 days of data) [2025-09-14T18:00:06.143350] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-09-14T18:00:06.159093] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-14T18:00:06.180954] [DEBUG] [LOCAL ] EVC: Primary data saved (14021 records). [2025-09-14T18:00:06.181206] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-14T18:00:06.181431] [INFO ] [MAIN ] Update Progress: 784/2370 symbols completed. EVC took 23.8s. Estimated remaining: 2h 47m 43s. Rate: 9.5 symbols/min [2025-09-14T18:00:06.355367] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:06.360976] [DEBUG] [LOCAL ] EVG: Loaded 2611 existing records from primary storage. [2025-09-14T18:00:06.361121] [INFO ] [MAIN ] EVG: Loaded 2611 existing records. [2025-09-14T18:00:06.552436] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:06.552812] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-14T18:00:06.552890] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-14T18:00:06.553176] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-14T18:00:06.553237] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-14T18:00:06.863281] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:00:06.952946] [INFO ] [REMOTE ] EVG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:06.958794] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-14T18:00:07.758843] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-14T18:00:07.963706] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:00:08.078795] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T18:00:08.558853] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-14T18:00:09.090739] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:00:09.358844] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-14T18:00:09.863730] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T18:00:09.868727] [INFO ] [REMOTE ] EVEX: Full fetch complete (30488 records). [2025-09-14T18:00:09.868872] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-14T18:00:10.162471] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-14T18:00:10.252152] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-14T18:00:10.252261] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-14T18:00:10.252853] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-14T18:00:10.252911] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-14T18:00:10.253825] [DEBUG] [LOCAL ] EVEX: Trimmed 30488 records to 22451 (keeping 150 days of data) [2025-09-14T18:00:10.366257] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:00:10.402632] [DEBUG] [LOCAL ] EVEX: Primary data saved (22451 records). [2025-09-14T18:00:10.402836] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-14T18:00:10.402977] [INFO ] [MAIN ] Update Progress: 785/2370 symbols completed. EVEX took 24.1s. Estimated remaining: 2h 47m 33s. Rate: 9.5 symbols/min [2025-09-14T18:00:10.574064] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:10.594870] [DEBUG] [LOCAL ] EVH: Loaded 22177 existing records from primary storage. [2025-09-14T18:00:10.595026] [INFO ] [MAIN ] EVH: Loaded 22177 existing records. [2025-09-14T18:00:10.770500] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:10.770761] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-14T18:00:10.770825] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-14T18:00:10.771372] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-14T18:00:10.771442] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-14T18:00:10.965767] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-14T18:00:11.052445] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:00:11.134510] [INFO ] [REMOTE ] EVH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:11.758796] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-14T18:00:11.933871] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:00:12.558866] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-14T18:00:13.358814] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-14T18:00:13.698787] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-14T18:00:13.720012] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:00:14.158834] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-14T18:00:14.257594] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:00:14.259403] [INFO ] [REMOTE ] EVF: Full fetch complete (9427 records). [2025-09-14T18:00:14.259510] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-14T18:00:14.628506] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-14T18:00:14.628622] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-14T18:00:14.628933] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-14T18:00:14.628997] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-14T18:00:14.629451] [DEBUG] [LOCAL ] EVF: Trimmed 9427 records to 6509 (keeping 150 days of data) [2025-09-14T18:00:14.672013] [DEBUG] [LOCAL ] EVF: Primary data saved (6509 records). [2025-09-14T18:00:14.672153] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-14T18:00:14.672266] [INFO ] [MAIN ] Update Progress: 786/2370 symbols completed. EVF took 21.3s. Estimated remaining: 2h 47m 22s. Rate: 9.5 symbols/min [2025-09-14T18:00:14.862945] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:14.870728] [DEBUG] [LOCAL ] EVN: Loaded 5269 existing records from primary storage. [2025-09-14T18:00:14.870870] [INFO ] [MAIN ] EVN: Loaded 5269 existing records. [2025-09-14T18:00:14.967595] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-14T18:00:15.067921] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:15.068252] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-14T18:00:15.068321] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-14T18:00:15.068693] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-14T18:00:15.068762] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-14T18:00:15.431924] [INFO ] [REMOTE ] EVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:15.758836] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-14T18:00:16.142212] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-14T18:00:16.146239] [INFO ] [REMOTE ] ETY: Full fetch complete (25631 records). [2025-09-14T18:00:16.146494] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-14T18:00:16.522426] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-14T18:00:16.522560] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-14T18:00:16.523184] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-14T18:00:16.523264] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-14T18:00:16.524220] [DEBUG] [LOCAL ] ETY: Trimmed 25631 records to 16489 (keeping 150 days of data) [2025-09-14T18:00:16.574469] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-14T18:00:16.635422] [DEBUG] [LOCAL ] ETY: Primary data saved (16489 records). [2025-09-14T18:00:16.635634] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-14T18:00:16.635810] [INFO ] [MAIN ] Update Progress: 787/2370 symbols completed. ETY took 35.5s. Estimated remaining: 2h 47m 7s. Rate: 9.5 symbols/min [2025-09-14T18:00:16.810094] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:16.825132] [DEBUG] [LOCAL ] EVR: Loaded 14361 existing records from primary storage. [2025-09-14T18:00:16.825291] [INFO ] [MAIN ] EVR: Loaded 14361 existing records. [2025-09-14T18:00:17.008253] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:17.008947] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-14T18:00:17.018005] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-14T18:00:17.018374] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T18:00:17.022329] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-14T18:00:17.022510] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-14T18:00:17.247461] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-14T18:00:17.363947] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-14T18:00:17.378340] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T18:00:17.460491] [INFO ] [REMOTE ] EVR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:18.158788] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-14T18:00:18.398635] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:00:18.958851] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-14T18:00:19.756760] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T18:00:19.764356] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-14T18:00:19.806610] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:00:20.558844] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-14T18:00:21.358841] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-14T18:00:21.424085] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:00:21.898378] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T18:00:22.144037] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:00:22.158826] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-14T18:00:22.926167] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T18:00:22.958841] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-14T18:00:23.758850] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-14T18:00:23.929796] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T18:00:24.529692] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T18:00:24.558810] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-14T18:00:25.203560] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T18:00:25.358820] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-14T18:00:26.158848] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-14T18:00:26.320944] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:00:26.958831] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-14T18:00:27.758837] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-14T18:00:28.325200] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T18:00:28.558865] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-14T18:00:28.570247] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T18:00:28.572078] [INFO ] [REMOTE ] EVN: Full fetch complete (12030 records). [2025-09-14T18:00:28.572166] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-14T18:00:28.930709] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-14T18:00:28.930844] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-14T18:00:28.931202] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-14T18:00:28.931259] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-14T18:00:28.932062] [DEBUG] [LOCAL ] EVN: Trimmed 12030 records to 7883 (keeping 150 days of data) [2025-09-14T18:00:28.987681] [DEBUG] [LOCAL ] EVN: Primary data saved (7883 records). [2025-09-14T18:00:28.987838] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-14T18:00:28.987943] [INFO ] [MAIN ] Update Progress: 788/2370 symbols completed. EVN took 14.3s. Estimated remaining: 2h 47m 13s. Rate: 9.5 symbols/min [2025-09-14T18:00:29.164745] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:29.175351] [DEBUG] [LOCAL ] EVT: Loaded 7432 existing records from primary storage. [2025-09-14T18:00:29.175544] [INFO ] [MAIN ] EVT: Loaded 7432 existing records. [2025-09-14T18:00:29.351217] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:29.351536] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-14T18:00:29.351608] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-14T18:00:29.352021] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-14T18:00:29.352094] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-14T18:00:29.384904] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-14T18:00:29.757446] [INFO ] [REMOTE ] EVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:29.784969] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-14T18:00:30.143725] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T18:00:30.161672] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-14T18:00:30.171571] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T18:00:30.935079] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T18:00:30.958786] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-14T18:00:31.758853] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-14T18:00:32.368081] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:00:32.558836] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-14T18:00:32.805687] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:00:33.358845] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-14T18:00:33.816954] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T18:00:34.158825] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-14T18:00:34.248320] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:00:34.958844] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-14T18:00:35.746751] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T18:00:35.761768] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-14T18:00:36.034670] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:00:36.558845] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-14T18:00:36.938884] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:00:37.358881] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-14T18:00:38.075318] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:00:38.076622] [INFO ] [REMOTE ] EVG: Full fetch complete (6165 records). [2025-09-14T18:00:38.076731] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-14T18:00:38.163938] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-14T18:00:38.448712] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-14T18:00:38.448860] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-14T18:00:38.449172] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-14T18:00:38.449251] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-14T18:00:38.449968] [DEBUG] [LOCAL ] EVG: Trimmed 6165 records to 4298 (keeping 150 days of data) [2025-09-14T18:00:38.502345] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T18:00:38.520789] [DEBUG] [LOCAL ] EVG: Primary data saved (4298 records). [2025-09-14T18:00:38.520934] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-14T18:00:38.521070] [INFO ] [MAIN ] Update Progress: 789/2370 symbols completed. EVG took 32.3s. Estimated remaining: 2h 47m 13s. Rate: 9.5 symbols/min [2025-09-14T18:00:38.697149] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:38.715058] [DEBUG] [LOCAL ] EVTC: Loaded 11753 existing records from primary storage. [2025-09-14T18:00:38.715223] [INFO ] [MAIN ] EVTC: Loaded 11753 existing records. [2025-09-14T18:00:38.893339] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:38.893622] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-14T18:00:38.893706] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-14T18:00:38.894121] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-14T18:00:38.894180] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-14T18:00:38.967811] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-14T18:00:39.246184] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:39.310942] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:00:39.758844] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-14T18:00:40.558882] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-14T18:00:40.899971] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T18:00:40.944586] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:00:41.358792] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-14T18:00:41.412927] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T18:00:42.158869] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-14T18:00:42.178688] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T18:00:42.958870] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-14T18:00:43.326153] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:00:43.758907] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-14T18:00:44.453814] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T18:00:44.459316] [INFO ] [REMOTE ] EVH: Full fetch complete (53726 records). [2025-09-14T18:00:44.459466] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-14T18:00:44.559692] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-14T18:00:44.844285] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-14T18:00:44.844506] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-14T18:00:44.845282] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-14T18:00:44.845456] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-14T18:00:44.856452] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T18:00:44.860343] [DEBUG] [LOCAL ] EVH: Trimmed 53726 records to 37038 (keeping 150 days of data) [2025-09-14T18:00:45.105424] [DEBUG] [LOCAL ] EVH: Primary data saved (37038 records). [2025-09-14T18:00:45.105742] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-14T18:00:45.105906] [INFO ] [MAIN ] Update Progress: 790/2370 symbols completed. EVH took 34.7s. Estimated remaining: 2h 47m 7s. Rate: 9.5 symbols/min [2025-09-14T18:00:45.279132] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:45.288194] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:00:45.291987] [INFO ] [REMOTE ] EVR: Full fetch complete (39454 records). [2025-09-14T18:00:45.292115] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-14T18:00:45.361296] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-14T18:00:45.570112] [DEBUG] [LOCAL ] EVTL: Loaded 20510 existing records from primary storage. [2025-09-14T18:00:45.596703] [INFO ] [MAIN ] EVTL: Loaded 20510 existing records. [2025-09-14T18:00:45.832917] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-14T18:00:45.868368] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-14T18:00:45.871755] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:45.872631] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-14T18:00:45.872756] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-14T18:00:45.872845] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-14T18:00:45.873035] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-14T18:00:45.873719] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-14T18:00:45.873794] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-14T18:00:45.873861] [DEBUG] [LOCAL ] EVR: Trimmed 39454 records to 25593 (keeping 150 days of data) [2025-09-14T18:00:46.163470] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-14T18:00:46.288449] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T18:00:46.340487] [INFO ] [REMOTE ] EVT: Full fetch complete (19275 records). [2025-09-14T18:00:46.357752] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-14T18:00:46.393896] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:46.796269] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-14T18:00:46.796717] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-14T18:00:46.797205] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-14T18:00:46.798097] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-14T18:00:46.799107] [DEBUG] [LOCAL ] EVT: Trimmed 19275 records to 12781 (keeping 150 days of data) [2025-09-14T18:00:46.877064] [DEBUG] [LOCAL ] EVR: Primary data saved (25593 records). [2025-09-14T18:00:46.880493] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-14T18:00:46.882764] [INFO ] [MAIN ] Update Progress: 791/2370 symbols completed. EVR took 30.2s. Estimated remaining: 2h 46m 51s. Rate: 9.5 symbols/min [2025-09-14T18:00:46.970745] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-14T18:00:47.164372] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:47.157832] [DEBUG] [LOCAL ] EVT: Primary data saved (12781 records). [2025-09-14T18:00:47.164911] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-14T18:00:47.165309] [INFO ] [MAIN ] Update Progress: 792/2370 symbols completed. EVT took 18.2s. Estimated remaining: 2h 46m 33s. Rate: 9.5 symbols/min [2025-09-14T18:00:47.295860] [DEBUG] [LOCAL ] EVTR: Loaded 11001 existing records from primary storage. [2025-09-14T18:00:47.296101] [INFO ] [MAIN ] EVTR: Loaded 11001 existing records. [2025-09-14T18:00:47.762927] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:47.783735] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T18:00:47.807941] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-14T18:00:47.832950] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:47.833268] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-14T18:00:47.833340] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-14T18:00:47.833916] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-14T18:00:47.833998] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-14T18:00:48.022966] [DEBUG] [LOCAL ] EW: Loaded 23877 existing records from primary storage. [2025-09-14T18:00:48.072622] [INFO ] [MAIN ] EW: Loaded 23877 existing records. [2025-09-14T18:00:48.512609] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:48.512807] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:48.513426] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-14T18:00:48.513504] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-14T18:00:48.514180] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-14T18:00:48.514248] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-14T18:00:48.569010] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-14T18:00:48.898217] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T18:00:48.902537] [INFO ] [REMOTE ] EW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:49.087023] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T18:00:49.358857] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-14T18:00:49.722334] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T18:00:50.158877] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-14T18:00:50.355371] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T18:00:50.958841] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-14T18:00:51.298067] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:00:51.758848] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-14T18:00:51.991679] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:00:52.558872] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-14T18:00:53.002218] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T18:00:53.358842] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-14T18:00:53.691362] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T18:00:54.158877] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-14T18:00:54.958838] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-14T18:00:55.076719] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T18:00:55.744396] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:00:55.758791] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-14T18:00:56.119502] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:00:56.558895] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-14T18:00:57.114491] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:00:57.117728] [INFO ] [REMOTE ] EVTC: Full fetch complete (28916 records). [2025-09-14T18:00:57.117821] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-14T18:00:57.363504] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-14T18:00:57.509935] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-14T18:00:57.510303] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-14T18:00:57.511585] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-14T18:00:57.511778] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-14T18:00:57.538116] [DEBUG] [LOCAL ] EVTC: Trimmed 28916 records to 19605 (keeping 150 days of data) [2025-09-14T18:00:57.542576] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T18:00:57.682144] [DEBUG] [LOCAL ] EVTC: Primary data saved (19605 records). [2025-09-14T18:00:57.682345] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-14T18:00:57.682472] [INFO ] [MAIN ] Update Progress: 793/2370 symbols completed. EVTC took 19.2s. Estimated remaining: 2h 46m 35s. Rate: 9.5 symbols/min [2025-09-14T18:00:57.854947] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:57.870272] [DEBUG] [LOCAL ] EXG: Loaded 14781 existing records from primary storage. [2025-09-14T18:00:57.870454] [INFO ] [MAIN ] EXG: Loaded 14781 existing records. [2025-09-14T18:00:58.074071] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:58.074875] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-14T18:00:58.075093] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-14T18:00:58.075692] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-14T18:00:58.075772] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-14T18:00:58.163920] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-14T18:00:58.441019] [INFO ] [REMOTE ] EXG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:58.556503] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T18:00:58.958872] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-14T18:00:59.758947] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-14T18:01:00.133224] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:01:00.558867] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-14T18:01:00.945958] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T18:01:01.340563] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:01:01.358775] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-14T18:01:02.158857] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-14T18:01:02.921964] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-14T18:01:02.958789] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-14T18:01:03.248432] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T18:01:03.390220] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T18:01:03.758831] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-14T18:01:04.558788] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-14T18:01:04.960421] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:01:05.067271] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-14T18:01:05.358843] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-14T18:01:06.158843] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-14T18:01:06.380742] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:01:06.867244] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:01:06.958802] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-14T18:01:07.236007] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T18:01:07.758834] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-14T18:01:08.509446] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T18:01:08.514003] [INFO ] [REMOTE ] EVTL: Full fetch complete (39210 records). [2025-09-14T18:01:08.514110] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-14T18:01:08.567931] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-14T18:01:08.903040] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-14T18:01:08.903164] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-14T18:01:08.903833] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-14T18:01:08.903893] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-14T18:01:08.904983] [DEBUG] [LOCAL ] EVTL: Trimmed 39210 records to 29725 (keeping 150 days of data) [2025-09-14T18:01:09.075307] [DEBUG] [LOCAL ] EVTL: Primary data saved (29725 records). [2025-09-14T18:01:09.075488] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-14T18:01:09.075592] [INFO ] [MAIN ] Update Progress: 794/2370 symbols completed. EVTL took 24.0s. Estimated remaining: 2h 46m 39s. Rate: 9.5 symbols/min [2025-09-14T18:01:09.244374] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:09.266199] [DEBUG] [LOCAL ] EXK: Loaded 23764 existing records from primary storage. [2025-09-14T18:01:09.266372] [INFO ] [MAIN ] EXK: Loaded 23764 existing records. [2025-09-14T18:01:09.365063] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-14T18:01:09.447245] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:09.447558] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-14T18:01:09.447657] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-14T18:01:09.448365] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-14T18:01:09.448437] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-14T18:01:09.799989] [INFO ] [REMOTE ] EXK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:09.853514] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T18:01:09.878064] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-14T18:01:10.158827] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-14T18:01:10.653065] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T18:01:10.958827] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-14T18:01:11.758886] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-14T18:01:12.047198] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T18:01:12.067008] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T18:01:12.070751] [INFO ] [REMOTE ] EVTR: Full fetch complete (24290 records). [2025-09-14T18:01:12.070874] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-14T18:01:12.443849] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-14T18:01:12.443964] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-14T18:01:12.444494] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-14T18:01:12.444547] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-14T18:01:12.445242] [DEBUG] [LOCAL ] EVTR: Trimmed 24290 records to 17332 (keeping 150 days of data) [2025-09-14T18:01:12.552586] [DEBUG] [LOCAL ] EVTR: Primary data saved (17332 records). [2025-09-14T18:01:12.552829] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-14T18:01:12.552936] [INFO ] [MAIN ] Update Progress: 795/2370 symbols completed. EVTR took 25.7s. Estimated remaining: 2h 46m 27s. Rate: 9.5 symbols/min [2025-09-14T18:01:12.564560] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-14T18:01:12.734460] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:12.749339] [DEBUG] [LOCAL ] EXP: Loaded 13332 existing records from primary storage. [2025-09-14T18:01:12.749539] [INFO ] [MAIN ] EXP: Loaded 13332 existing records. [2025-09-14T18:01:12.933225] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:12.933478] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-14T18:01:12.933541] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-14T18:01:12.934078] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-14T18:01:12.934144] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-14T18:01:13.347985] [INFO ] [REMOTE ] EXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:13.358845] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-14T18:01:13.767848] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T18:01:14.084697] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T18:01:14.158902] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-14T18:01:14.518962] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T18:01:14.958841] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-14T18:01:15.758794] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-14T18:01:16.284301] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T18:01:16.336328] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T18:01:16.467508] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:01:16.473359] [INFO ] [REMOTE ] EW: Full fetch complete (58056 records). [2025-09-14T18:01:16.473528] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-14T18:01:16.564036] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-14T18:01:16.861154] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-14T18:01:16.861285] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-14T18:01:16.862106] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-14T18:01:16.862170] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-14T18:01:16.863440] [DEBUG] [LOCAL ] EW: Trimmed 58056 records to 40167 (keeping 150 days of data) [2025-09-14T18:01:17.116332] [DEBUG] [LOCAL ] EW: Primary data saved (40167 records). [2025-09-14T18:01:17.116489] [INFO ] [MAIN ] EW: Full history saved. [2025-09-14T18:01:17.116589] [INFO ] [MAIN ] Update Progress: 796/2370 symbols completed. EW took 30.0s. Estimated remaining: 2h 46m 17s. Rate: 9.5 symbols/min [2025-09-14T18:01:17.284360] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:17.305269] [DEBUG] [LOCAL ] EXPD: Loaded 21396 existing records from primary storage. [2025-09-14T18:01:17.305422] [INFO ] [MAIN ] EXPD: Loaded 21396 existing records. [2025-09-14T18:01:17.367558] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-14T18:01:17.482058] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:17.482328] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-14T18:01:17.482392] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-14T18:01:17.483044] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-14T18:01:17.483109] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-14T18:01:17.872096] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:17.898090] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:01:18.158895] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-14T18:01:18.631043] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T18:01:18.958950] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-14T18:01:19.758865] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-14T18:01:20.140241] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:01:20.398100] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T18:01:20.558913] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-14T18:01:21.118042] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T18:01:21.358945] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-14T18:01:21.921081] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T18:01:22.158860] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-14T18:01:22.958864] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-14T18:01:23.319440] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T18:01:23.758914] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-14T18:01:24.077776] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T18:01:24.180409] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:01:24.558924] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-14T18:01:25.358901] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-14T18:01:25.670281] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:01:26.158937] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-14T18:01:26.352343] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T18:01:26.451618] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T18:01:26.958925] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-14T18:01:27.758920] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-14T18:01:28.568036] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-14T18:01:28.605517] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-14T18:01:28.809167] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:01:28.813495] [INFO ] [REMOTE ] EXG: Full fetch complete (38092 records). [2025-09-14T18:01:28.813847] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-14T18:01:29.222972] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-14T18:01:29.223853] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-14T18:01:29.225277] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-14T18:01:29.225542] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-14T18:01:29.227425] [DEBUG] [LOCAL ] EXG: Trimmed 38092 records to 25562 (keeping 150 days of data) [2025-09-14T18:01:29.363172] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-14T18:01:29.363399] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-14T18:01:29.447733] [DEBUG] [LOCAL ] EXG: Primary data saved (25562 records). [2025-09-14T18:01:29.447929] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-14T18:01:29.448047] [INFO ] [MAIN ] Update Progress: 797/2370 symbols completed. EXG took 31.8s. Estimated remaining: 2h 46m 22s. Rate: 9.5 symbols/min [2025-09-14T18:01:29.997709] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T18:01:30.158867] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-14T18:01:30.730847] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:01:30.734567] [INFO ] [REMOTE ] EXP: Full fetch complete (32927 records). [2025-09-14T18:01:30.734825] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-14T18:01:30.967814] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-14T18:01:31.141114] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-14T18:01:31.141332] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-14T18:01:31.142212] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-14T18:01:31.142403] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-14T18:01:31.143970] [DEBUG] [LOCAL ] EXP: Trimmed 32927 records to 22227 (keeping 150 days of data) [2025-09-14T18:01:31.267122] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T18:01:31.333814] [DEBUG] [LOCAL ] EXP: Primary data saved (22227 records). [2025-09-14T18:01:31.334055] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-14T18:01:31.334189] [INFO ] [MAIN ] Update Progress: 798/2370 symbols completed. EXP took 18.8s. Estimated remaining: 2h 46m 7s. Rate: 9.5 symbols/min [2025-09-14T18:01:31.758850] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-14T18:01:32.800234] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:01:32.812538] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-14T18:01:33.410824] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T18:01:33.421395] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-14T18:01:34.489180] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T18:01:34.495823] [INFO ] [REMOTE ] EXK: Full fetch complete (57602 records). [2025-09-14T18:01:34.496102] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-14T18:01:34.900742] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-14T18:01:34.900922] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-14T18:01:34.902386] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-14T18:01:34.902511] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-14T18:01:34.904284] [DEBUG] [LOCAL ] EXK: Trimmed 57602 records to 39936 (keeping 150 days of data) [2025-09-14T18:01:35.170664] [DEBUG] [LOCAL ] EXK: Primary data saved (39936 records). [2025-09-14T18:01:35.170970] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-14T18:01:35.171237] [INFO ] [MAIN ] Update Progress: 799/2370 symbols completed. EXK took 26.1s. Estimated remaining: 2h 45m 56s. Rate: 9.5 symbols/min [2025-09-14T18:01:35.205089] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:01:35.216859] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-14T18:01:36.954824] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T18:01:36.965610] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-14T18:01:37.607902] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:01:37.612846] [INFO ] [REMOTE ] EXPD: Full fetch complete (52518 records). [2025-09-14T18:01:37.612963] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-14T18:01:37.993987] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-14T18:01:37.994109] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-14T18:01:37.994877] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-14T18:01:37.994937] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-14T18:01:37.996085] [DEBUG] [LOCAL ] EXPD: Trimmed 52518 records to 36005 (keeping 150 days of data) [2025-09-14T18:01:38.241330] [DEBUG] [LOCAL ] EXPD: Primary data saved (36005 records). [2025-09-14T18:01:38.241515] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-14T18:01:38.241623] [INFO ] [MAIN ] Update Progress: 800/2370 symbols completed. EXPD took 21.1s. Estimated remaining: 2h 45m 43s. Rate: 9.5 symbols/min [2025-09-14T18:01:38.835788] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:38.869749] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:38.962290] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:38.997092] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:39.036927] [DEBUG] [LOCAL ] EXR: Loaded 20731 existing records from primary storage. [2025-09-14T18:01:39.037259] [DEBUG] [LOCAL ] FAF: Loaded 18506 existing records from primary storage. [2025-09-14T18:01:39.037566] [INFO ] [MAIN ] EXR: Loaded 20731 existing records. [2025-09-14T18:01:39.037633] [INFO ] [MAIN ] FAF: Loaded 18506 existing records. [2025-09-14T18:01:39.209687] [DEBUG] [LOCAL ] FBIN: Loaded 22518 existing records from primary storage. [2025-09-14T18:01:39.210329] [DEBUG] [LOCAL ] F: Loaded 24180 existing records from primary storage. [2025-09-14T18:01:39.277718] [INFO ] [MAIN ] FBIN: Loaded 22518 existing records. [2025-09-14T18:01:39.277814] [INFO ] [MAIN ] F: Loaded 24180 existing records. [2025-09-14T18:01:39.713530] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:39.713731] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:39.740475] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-14T18:01:39.785846] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-14T18:01:39.786065] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-14T18:01:39.775005] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-14T18:01:39.794769] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-14T18:01:39.820219] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-14T18:01:39.820330] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-14T18:01:39.907736] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-14T18:01:40.300357] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:40.387622] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-14T18:01:40.412515] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:40.461873] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-14T18:01:40.462021] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-14T18:01:40.478539] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-14T18:01:40.526272] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-14T18:01:40.554201] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-14T18:01:40.641199] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-14T18:01:40.720199] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-14T18:01:41.205535] [INFO ] [REMOTE ] FAF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:41.287421] [INFO ] [REMOTE ] EXR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:41.359981] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-14T18:01:41.380804] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-14T18:01:41.724009] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:41.727063] [INFO ] [REMOTE ] F: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:41.727426] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-14T18:01:41.727701] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-14T18:01:42.903774] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T18:01:42.910863] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-14T18:01:43.087020] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:01:43.096116] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-14T18:01:43.174767] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:01:43.185897] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-14T18:01:43.881934] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-14T18:01:43.893893] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-14T18:01:44.093908] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:01:44.102895] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-14T18:01:44.610734] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T18:01:44.621576] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-14T18:01:44.786889] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:01:44.796848] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-14T18:01:45.523514] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T18:01:45.533203] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-14T18:01:46.467912] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:01:46.478985] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-14T18:01:46.618994] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-14T18:01:46.631212] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-14T18:01:46.681004] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:01:46.958824] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-14T18:01:47.233472] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:01:47.758897] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-14T18:01:48.233627] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T18:01:48.384765] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:01:48.558840] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-14T18:01:49.014778] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:01:49.058688] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-14T18:01:49.358854] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-14T18:01:50.050977] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T18:01:50.158827] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-14T18:01:50.958836] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-14T18:01:51.758964] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-14T18:01:51.825502] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:01:51.866741] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-14T18:01:52.359183] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T18:01:52.558877] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-14T18:01:53.099469] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:01:53.358836] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-14T18:01:54.158835] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-14T18:01:54.393018] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:01:54.958884] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-14T18:01:55.713275] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T18:01:55.758844] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-14T18:01:55.942688] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-14T18:01:56.311537] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:01:56.384414] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:01:56.388581] [INFO ] [REMOTE ] FAF: Full fetch complete (45178 records). [2025-09-14T18:01:56.388715] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-14T18:01:56.563916] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-14T18:01:56.766418] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-14T18:01:56.766561] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-14T18:01:56.767487] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-14T18:01:56.767559] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-14T18:01:56.769034] [DEBUG] [LOCAL ] FAF: Trimmed 45178 records to 31749 (keeping 150 days of data) [2025-09-14T18:01:56.981115] [DEBUG] [LOCAL ] FAF: Primary data saved (31749 records). [2025-09-14T18:01:56.981305] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-14T18:01:56.981447] [INFO ] [MAIN ] Update Progress: 801/2370 symbols completed. FAF took 18.7s. Estimated remaining: 2h 46m 1s. Rate: 9.5 symbols/min [2025-09-14T18:01:57.158660] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:57.173440] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:01:57.178807] [INFO ] [REMOTE ] FBIN: Full fetch complete (54919 records). [2025-09-14T18:01:57.178960] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-14T18:01:57.278518] [DEBUG] [LOCAL ] FBK: Loaded 12995 existing records from primary storage. [2025-09-14T18:01:57.288802] [INFO ] [MAIN ] FBK: Loaded 12995 existing records. [2025-09-14T18:01:57.378751] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-14T18:01:57.671029] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:57.699933] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-14T18:01:57.705752] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-14T18:01:57.726884] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-14T18:01:57.761079] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-14T18:01:57.913210] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-14T18:01:57.939840] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-14T18:01:57.940711] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-14T18:01:57.941078] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-14T18:01:58.053998] [DEBUG] [LOCAL ] FBIN: Trimmed 54919 records to 38076 (keeping 150 days of data) [2025-09-14T18:01:58.198013] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-14T18:01:58.299776] [INFO ] [REMOTE ] FBK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:58.463891] [DEBUG] [LOCAL ] FBIN: Primary data saved (38076 records). [2025-09-14T18:01:58.464101] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-14T18:01:58.464222] [INFO ] [MAIN ] Update Progress: 802/2370 symbols completed. FBIN took 20.2s. Estimated remaining: 2h 45m 45s. Rate: 9.5 symbols/min [2025-09-14T18:01:58.635333] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:58.655571] [DEBUG] [LOCAL ] FBP: Loaded 20604 existing records from primary storage. [2025-09-14T18:01:58.655772] [INFO ] [MAIN ] FBP: Loaded 20604 existing records. [2025-09-14T18:01:58.834197] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:58.834443] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-14T18:01:58.834502] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-14T18:01:58.835088] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-14T18:01:58.835157] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-14T18:01:58.974179] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-14T18:01:59.188025] [INFO ] [REMOTE ] FBP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:59.324228] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T18:01:59.753438] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T18:01:59.758777] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-14T18:02:00.558860] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-14T18:02:00.625049] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:02:01.057789] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-14T18:02:01.358898] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-14T18:02:02.158854] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-14T18:02:02.862144] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T18:02:02.958880] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-14T18:02:03.431973] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T18:02:03.437059] [INFO ] [REMOTE ] EXR: Full fetch complete (49498 records). [2025-09-14T18:02:03.437222] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-14T18:02:03.765120] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-14T18:02:03.814492] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-14T18:02:03.814596] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-14T18:02:03.815400] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-14T18:02:03.815459] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-14T18:02:03.816554] [DEBUG] [LOCAL ] EXR: Trimmed 49498 records to 34050 (keeping 150 days of data) [2025-09-14T18:02:04.035243] [DEBUG] [LOCAL ] EXR: Primary data saved (34050 records). [2025-09-14T18:02:04.035454] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-14T18:02:04.035594] [INFO ] [MAIN ] Update Progress: 803/2370 symbols completed. EXR took 25.8s. Estimated remaining: 2h 45m 37s. Rate: 9.5 symbols/min [2025-09-14T18:02:04.210461] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:04.229015] [DEBUG] [LOCAL ] FBRT: Loaded 15172 existing records from primary storage. [2025-09-14T18:02:04.229186] [INFO ] [MAIN ] FBRT: Loaded 15172 existing records. [2025-09-14T18:02:04.415762] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:04.416054] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-14T18:02:04.416115] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-14T18:02:04.416598] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-14T18:02:04.416688] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-14T18:02:04.797584] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:04.797989] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-14T18:02:04.831210] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:02:04.898168] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T18:02:05.010311] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (3.65 seconds). [2025-09-14T18:02:05.358883] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-14T18:02:05.839499] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T18:02:06.158857] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-14T18:02:06.357004] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T18:02:06.958845] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-14T18:02:07.517966] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T18:02:07.758836] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-14T18:02:08.566963] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-14T18:02:08.586211] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:02:08.656254] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:02:08.663501] [INFO ] [REMOTE ] F: Full fetch complete (58500 records). [2025-09-14T18:02:08.663727] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-14T18:02:09.081703] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-14T18:02:09.081835] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-14T18:02:09.082756] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-14T18:02:09.082834] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-14T18:02:09.084283] [DEBUG] [LOCAL ] F: Trimmed 58500 records to 40560 (keeping 150 days of data) [2025-09-14T18:02:09.359075] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-14T18:02:09.373397] [DEBUG] [LOCAL ] F: Primary data saved (40560 records). [2025-09-14T18:02:09.373584] [INFO ] [MAIN ] F: Full history saved. [2025-09-14T18:02:09.373769] [INFO ] [MAIN ] Update Progress: 804/2370 symbols completed. F took 31.1s. Estimated remaining: 2h 45m 29s. Rate: 9.5 symbols/min [2025-09-14T18:02:09.552888] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:09.570688] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T18:02:09.582784] [DEBUG] [LOCAL ] FC: Loaded 7181 existing records from primary storage. [2025-09-14T18:02:09.582955] [INFO ] [MAIN ] FC: Loaded 7181 existing records. [2025-09-14T18:02:09.761901] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:09.762191] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-14T18:02:09.762255] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-14T18:02:09.762601] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-14T18:02:09.762707] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-14T18:02:10.116344] [INFO ] [REMOTE ] FC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:10.158797] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-14T18:02:10.870857] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:02:10.958836] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-14T18:02:11.202354] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T18:02:11.758852] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-14T18:02:12.325754] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:02:12.558833] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-14T18:02:12.963670] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T18:02:13.358817] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-14T18:02:14.158819] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-14T18:02:14.389245] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:02:14.838833] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:02:14.958838] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-14T18:02:15.618444] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:02:15.758799] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-14T18:02:16.074771] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T18:02:16.558902] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-14T18:02:17.091419] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T18:02:17.358856] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-14T18:02:17.497888] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T18:02:18.158869] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-14T18:02:18.905397] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T18:02:18.958919] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-14T18:02:19.094527] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:02:19.203427] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-14T18:02:19.206118] [INFO ] [REMOTE ] FBK: Full fetch complete (26373 records). [2025-09-14T18:02:19.206254] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-14T18:02:19.599794] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-14T18:02:19.599924] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-14T18:02:19.600575] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-14T18:02:19.600680] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-14T18:02:19.601559] [DEBUG] [LOCAL ] FBK: Trimmed 26373 records to 19646 (keeping 150 days of data) [2025-09-14T18:02:19.733268] [DEBUG] [LOCAL ] FBK: Primary data saved (19646 records). [2025-09-14T18:02:19.733473] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-14T18:02:19.733636] [INFO ] [MAIN ] Update Progress: 805/2370 symbols completed. FBK took 22.8s. Estimated remaining: 2h 45m 31s. Rate: 9.5 symbols/min [2025-09-14T18:02:19.763985] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-14T18:02:19.913213] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:19.931159] [DEBUG] [LOCAL ] FCF: Loaded 16948 existing records from primary storage. [2025-09-14T18:02:19.931344] [INFO ] [MAIN ] FCF: Loaded 16948 existing records. [2025-09-14T18:02:20.112627] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:20.113069] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-14T18:02:20.113145] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-14T18:02:20.113736] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-14T18:02:20.113800] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-14T18:02:20.469623] [INFO ] [REMOTE ] FCF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:20.558789] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-14T18:02:21.009519] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T18:02:21.358857] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-14T18:02:22.025491] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T18:02:22.158815] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-14T18:02:22.497132] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:02:22.958893] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-14T18:02:23.508591] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T18:02:23.652058] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T18:02:23.758838] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-14T18:02:24.558780] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-14T18:02:24.566757] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:02:24.568964] [INFO ] [REMOTE ] FC: Full fetch complete (16824 records). [2025-09-14T18:02:24.569064] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-14T18:02:24.939158] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-14T18:02:24.939263] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-14T18:02:24.939761] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-14T18:02:24.939821] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-14T18:02:24.940347] [DEBUG] [LOCAL ] FC: Trimmed 16824 records to 10642 (keeping 150 days of data) [2025-09-14T18:02:25.006719] [DEBUG] [LOCAL ] FC: Primary data saved (10642 records). [2025-09-14T18:02:25.006895] [INFO ] [MAIN ] FC: Full history saved. [2025-09-14T18:02:25.007039] [INFO ] [MAIN ] Update Progress: 806/2370 symbols completed. FC took 15.6s. Estimated remaining: 2h 45m 22s. Rate: 9.5 symbols/min [2025-09-14T18:02:25.179140] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:25.191166] [DEBUG] [LOCAL ] FCN: Loaded 10725 existing records from primary storage. [2025-09-14T18:02:25.191338] [INFO ] [MAIN ] FCN: Loaded 10725 existing records. [2025-09-14T18:02:25.362516] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-14T18:02:25.367118] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:25.368156] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-14T18:02:25.368219] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-14T18:02:25.368685] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-14T18:02:25.368749] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-14T18:02:25.720741] [INFO ] [REMOTE ] FCN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:26.083208] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:02:26.088560] [INFO ] [REMOTE ] FBP: Full fetch complete (50202 records). [2025-09-14T18:02:26.088696] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-14T18:02:26.164797] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-14T18:02:26.477366] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-14T18:02:26.477685] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-14T18:02:26.478422] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-14T18:02:26.478575] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-14T18:02:26.505581] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:02:26.505728] [DEBUG] [LOCAL ] FBP: Trimmed 50202 records to 34097 (keeping 150 days of data) [2025-09-14T18:02:26.734625] [DEBUG] [LOCAL ] FBP: Primary data saved (34097 records). [2025-09-14T18:02:26.734805] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-14T18:02:26.734939] [INFO ] [MAIN ] Update Progress: 807/2370 symbols completed. FBP took 28.3s. Estimated remaining: 2h 45m 7s. Rate: 9.5 symbols/min [2025-09-14T18:02:26.905669] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:26.923119] [DEBUG] [LOCAL ] FCPT: Loaded 16212 existing records from primary storage. [2025-09-14T18:02:26.923332] [INFO ] [MAIN ] FCPT: Loaded 16212 existing records. [2025-09-14T18:02:26.966798] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-14T18:02:27.108227] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:27.108504] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-14T18:02:27.108578] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-14T18:02:27.109235] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-14T18:02:27.109302] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-14T18:02:27.465120] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:27.477233] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T18:02:27.758831] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-14T18:02:28.558884] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-14T18:02:28.617501] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T18:02:29.172185] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T18:02:29.358888] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-14T18:02:30.079585] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:02:30.158784] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-14T18:02:30.697347] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:02:30.958860] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-14T18:02:31.541262] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:02:31.758864] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-14T18:02:32.329274] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:02:32.558962] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-14T18:02:32.753490] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T18:02:33.358898] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-14T18:02:34.149579] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:02:34.158798] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-14T18:02:34.958858] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-14T18:02:35.072141] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T18:02:35.573496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T18:02:35.758896] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-14T18:02:36.558852] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-14T18:02:36.588766] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:02:37.024456] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T18:02:37.358827] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-14T18:02:37.913019] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:02:38.158868] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-14T18:02:38.479932] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:02:38.585969] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T18:02:38.589628] [INFO ] [REMOTE ] FBRT: Full fetch complete (37190 records). [2025-09-14T18:02:38.589776] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-14T18:02:38.965848] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-14T18:02:39.020050] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-14T18:02:39.020257] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-14T18:02:39.021204] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-14T18:02:39.021270] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-14T18:02:39.022711] [DEBUG] [LOCAL ] FBRT: Trimmed 37190 records to 25573 (keeping 150 days of data) [2025-09-14T18:02:39.192822] [DEBUG] [LOCAL ] FBRT: Primary data saved (25573 records). [2025-09-14T18:02:39.192997] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-14T18:02:39.193109] [INFO ] [MAIN ] Update Progress: 808/2370 symbols completed. FBRT took 35.2s. Estimated remaining: 2h 45m 12s. Rate: 9.5 symbols/min [2025-09-14T18:02:39.363079] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:39.365508] [DEBUG] [LOCAL ] FCRX: Loaded 481 existing records from primary storage. [2025-09-14T18:02:39.365597] [INFO ] [MAIN ] FCRX: Loaded 481 existing records. [2025-09-14T18:02:39.539724] [WARN ] [MAIN ] FCRX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:39.540002] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-14T18:02:39.540064] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-14T18:02:39.540252] [DEBUG] [LOCAL ] FCRX: Deleted primary data file. [2025-09-14T18:02:39.540311] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-14T18:02:39.764068] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-14T18:02:39.915237] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:40.272183] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:02:40.558855] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-14T18:02:41.324971] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:02:41.358797] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-14T18:02:41.676295] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T18:02:42.059539] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:02:42.063605] [INFO ] [REMOTE ] FCF: Full fetch complete (43359 records). [2025-09-14T18:02:42.063774] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-14T18:02:42.163996] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-14T18:02:42.445118] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-14T18:02:42.445229] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-14T18:02:42.445967] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-14T18:02:42.446029] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-14T18:02:42.446991] [DEBUG] [LOCAL ] FCF: Trimmed 43359 records to 28808 (keeping 150 days of data) [2025-09-14T18:02:42.645581] [DEBUG] [LOCAL ] FCF: Primary data saved (28808 records). [2025-09-14T18:02:42.645869] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-14T18:02:42.646022] [INFO ] [MAIN ] Update Progress: 809/2370 symbols completed. FCF took 22.9s. Estimated remaining: 2h 45m 0s. Rate: 9.5 symbols/min [2025-09-14T18:02:42.743664] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T18:02:42.877518] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:42.888036] [DEBUG] [LOCAL ] FCT: Loaded 6765 existing records from primary storage. [2025-09-14T18:02:42.888240] [INFO ] [MAIN ] FCT: Loaded 6765 existing records. [2025-09-14T18:02:42.963986] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-14T18:02:43.070118] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:43.070398] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-14T18:02:43.070459] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-14T18:02:43.070882] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-14T18:02:43.070957] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-14T18:02:43.455983] [INFO ] [REMOTE ] FCT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:43.629685] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:02:43.632315] [INFO ] [REMOTE ] FCN: Full fetch complete (28528 records). [2025-09-14T18:02:43.632407] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-14T18:02:43.773512] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-14T18:02:43.998082] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-14T18:02:43.998191] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-14T18:02:43.998774] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-14T18:02:43.998829] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-14T18:02:43.999541] [DEBUG] [LOCAL ] FCN: Trimmed 28528 records to 19410 (keeping 150 days of data) [2025-09-14T18:02:44.121483] [DEBUG] [LOCAL ] FCN: Primary data saved (19410 records). [2025-09-14T18:02:44.121681] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-14T18:02:44.121785] [INFO ] [MAIN ] Update Progress: 810/2370 symbols completed. FCN took 19.1s. Estimated remaining: 2h 44m 45s. Rate: 9.5 symbols/min [2025-09-14T18:02:44.294437] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:44.317073] [DEBUG] [LOCAL ] FCX: Loaded 24065 existing records from primary storage. [2025-09-14T18:02:44.317247] [INFO ] [MAIN ] FCX: Loaded 24065 existing records. [2025-09-14T18:02:44.496905] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:44.497217] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-14T18:02:44.497279] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-14T18:02:44.497985] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-14T18:02:44.498050] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-14T18:02:44.564124] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-14T18:02:44.780867] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T18:02:44.859086] [INFO ] [REMOTE ] FCX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:44.977463] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-14T18:02:45.358892] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-14T18:02:45.789711] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T18:02:46.158880] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-14T18:02:46.958895] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-14T18:02:47.413085] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T18:02:47.758793] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-14T18:02:48.309078] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-14T18:02:48.558856] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-14T18:02:49.175320] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:02:49.358832] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-14T18:02:49.776882] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T18:02:50.158878] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-14T18:02:50.624654] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-14T18:02:50.922401] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-14T18:02:50.958830] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-14T18:02:51.758841] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-14T18:02:52.558865] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-14T18:02:53.125140] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T18:02:53.227439] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T18:02:53.265145] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T18:02:53.358846] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-14T18:02:53.768236] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:02:53.769103] [INFO ] [REMOTE ] FCRX: Full fetch complete (1257 records). [2025-09-14T18:02:53.769192] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-14T18:02:53.946048] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 140 unique days, need 150 days [2025-09-14T18:02:53.946276] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:02:53.946330] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:02:53.946378] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-14T18:02:53.946450] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-14T18:02:53.946501] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-14T18:02:53.946554] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-14T18:02:53.946629] [INFO ] [MAIN ] Update Progress: 811/2370 symbols completed. FCRX took 14.8s. Estimated remaining: 2h 44m 45s. Rate: 9.5 symbols/min [2025-09-14T18:02:54.121631] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:54.136727] [DEBUG] [LOCAL ] FDP: Loaded 12859 existing records from primary storage. [2025-09-14T18:02:54.136916] [INFO ] [MAIN ] FDP: Loaded 12859 existing records. [2025-09-14T18:02:54.165929] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-14T18:02:54.319399] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:54.319668] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-14T18:02:54.319727] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-14T18:02:54.320224] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-14T18:02:54.320284] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-14T18:02:54.679202] [INFO ] [REMOTE ] FDP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:54.958870] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-14T18:02:55.477453] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T18:02:55.758863] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-14T18:02:55.891253] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T18:02:56.132964] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T18:02:56.137254] [INFO ] [REMOTE ] FCPT: Full fetch complete (40752 records). [2025-09-14T18:02:56.137405] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-14T18:02:56.538732] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-14T18:02:56.538848] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-14T18:02:56.539572] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-14T18:02:56.539626] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-14T18:02:56.540714] [DEBUG] [LOCAL ] FCPT: Trimmed 40752 records to 27113 (keeping 150 days of data) [2025-09-14T18:02:56.592375] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-14T18:02:56.703531] [DEBUG] [LOCAL ] FCPT: Primary data saved (27113 records). [2025-09-14T18:02:56.703718] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-14T18:02:56.703818] [INFO ] [MAIN ] Update Progress: 812/2370 symbols completed. FCPT took 30.0s. Estimated remaining: 2h 44m 32s. Rate: 9.5 symbols/min [2025-09-14T18:02:56.877760] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:56.891717] [DEBUG] [LOCAL ] FDS: Loaded 11556 existing records from primary storage. [2025-09-14T18:02:56.891910] [INFO ] [MAIN ] FDS: Loaded 11556 existing records. [2025-09-14T18:02:57.067810] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:57.068083] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-14T18:02:57.068145] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-14T18:02:57.068597] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-14T18:02:57.068690] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-14T18:02:57.363998] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-14T18:02:57.417686] [INFO ] [REMOTE ] FDS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:58.158864] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-14T18:02:58.704911] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T18:02:58.756507] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-14T18:02:58.958896] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-14T18:02:59.069296] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:02:59.758840] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-14T18:03:00.293203] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T18:03:00.558893] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-14T18:03:01.358836] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-14T18:03:02.117770] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-14T18:03:02.145590] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:03:02.158779] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-14T18:03:02.958897] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-14T18:03:03.527310] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T18:03:03.758887] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-14T18:03:03.993241] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:03:04.558855] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-14T18:03:04.687713] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T18:03:05.358906] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-14T18:03:05.714919] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:03:06.158839] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-14T18:03:06.549871] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (3.59 seconds). [2025-09-14T18:03:06.571124] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:03:06.958820] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-14T18:03:07.349813] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:03:07.758853] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-14T18:03:08.032917] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T18:03:08.558889] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-14T18:03:08.768435] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:03:09.358889] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-14T18:03:09.941622] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:03:10.158883] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-14T18:03:10.958848] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-14T18:03:11.561280] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:03:11.687236] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-14T18:03:11.758839] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-14T18:03:12.427273] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:03:12.446589] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:03:12.450829] [INFO ] [REMOTE ] FDS: Full fetch complete (26938 records). [2025-09-14T18:03:12.451042] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-14T18:03:12.564144] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-14T18:03:12.846963] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-14T18:03:12.847086] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-14T18:03:12.847789] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-14T18:03:12.847850] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-14T18:03:12.848665] [DEBUG] [LOCAL ] FDS: Trimmed 26938 records to 18399 (keeping 150 days of data) [2025-09-14T18:03:12.966272] [DEBUG] [LOCAL ] FDS: Primary data saved (18399 records). [2025-09-14T18:03:12.966468] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-14T18:03:12.966572] [INFO ] [MAIN ] Update Progress: 813/2370 symbols completed. FDS took 16.3s. Estimated remaining: 2h 44m 45s. Rate: 9.5 symbols/min [2025-09-14T18:03:13.139925] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:13.163852] [DEBUG] [LOCAL ] FDX: Loaded 23067 existing records from primary storage. [2025-09-14T18:03:13.164050] [INFO ] [MAIN ] FDX: Loaded 23067 existing records. [2025-09-14T18:03:13.339032] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:13.339301] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-14T18:03:13.339361] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-14T18:03:13.340041] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-14T18:03:13.340104] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-14T18:03:13.368846] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-14T18:03:13.646498] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:03:13.715695] [INFO ] [REMOTE ] FDX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:14.158862] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-14T18:03:14.963932] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-14T18:03:14.972560] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T18:03:14.978528] [INFO ] [REMOTE ] FCX: Full fetch complete (58379 records). [2025-09-14T18:03:14.978686] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-14T18:03:15.376008] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-14T18:03:15.376698] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T18:03:15.376746] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-14T18:03:15.379538] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-14T18:03:15.379988] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-14T18:03:15.380055] [INFO ] [REMOTE ] FCT: Full fetch complete (15380 records). [2025-09-14T18:03:15.380320] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-14T18:03:15.482588] [DEBUG] [LOCAL ] FCX: Trimmed 58379 records to 40442 (keeping 150 days of data) [2025-09-14T18:03:15.769442] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-14T18:03:15.869850] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-14T18:03:15.873960] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-14T18:03:15.877958] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-14T18:03:15.881503] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-14T18:03:15.882551] [DEBUG] [LOCAL ] FCT: Trimmed 15380 records to 10451 (keeping 150 days of data) [2025-09-14T18:03:16.068050] [DEBUG] [LOCAL ] FCX: Primary data saved (40442 records). [2025-09-14T18:03:16.071393] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-14T18:03:16.073249] [DEBUG] [LOCAL ] FCT: Primary data saved (10451 records). [2025-09-14T18:03:16.073359] [INFO ] [MAIN ] Update Progress: 814/2370 symbols completed. FCX took 32.0s. Estimated remaining: 2h 44m 32s. Rate: 9.5 symbols/min [2025-09-14T18:03:16.073448] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-14T18:03:16.120071] [INFO ] [MAIN ] Update Progress: 815/2370 symbols completed. FCT took 33.5s. Estimated remaining: 2h 44m 14s. Rate: 9.5 symbols/min [2025-09-14T18:03:16.408491] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:16.431100] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:16.436434] [DEBUG] [LOCAL ] FENG: Loaded 578 existing records from primary storage. [2025-09-14T18:03:16.436620] [INFO ] [MAIN ] FENG: Loaded 578 existing records. [2025-09-14T18:03:16.563758] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T18:03:16.655133] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-14T18:03:16.658351] [WARN ] [MAIN ] FENG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:16.660232] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-14T18:03:16.661194] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-14T18:03:16.670498] [DEBUG] [LOCAL ] FENG: Deleted primary data file. [2025-09-14T18:03:16.672348] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-14T18:03:16.696373] [DEBUG] [LOCAL ] FE: Loaded 23888 existing records from primary storage. [2025-09-14T18:03:16.756328] [INFO ] [MAIN ] FE: Loaded 23888 existing records. [2025-09-14T18:03:17.226332] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:17.262773] [INFO ] [REMOTE ] FENG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:17.263007] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-14T18:03:17.263538] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-14T18:03:17.264389] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-14T18:03:17.264463] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-14T18:03:17.366443] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-14T18:03:17.648386] [INFO ] [REMOTE ] FE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:17.814122] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T18:03:17.887738] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-14T18:03:18.107901] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T18:03:18.158780] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-14T18:03:18.958917] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-14T18:03:19.460438] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T18:03:19.506767] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:03:19.758914] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-14T18:03:20.558848] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-14T18:03:21.231336] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T18:03:21.358848] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-14T18:03:21.587014] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T18:03:22.158831] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-14T18:03:22.958841] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-14T18:03:23.426871] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T18:03:23.578198] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T18:03:23.581290] [INFO ] [REMOTE ] FDP: Full fetch complete (33147 records). [2025-09-14T18:03:23.581390] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-14T18:03:23.759695] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-14T18:03:23.970301] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-14T18:03:23.970441] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-14T18:03:23.971168] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-14T18:03:23.971236] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-14T18:03:23.972548] [DEBUG] [LOCAL ] FDP: Trimmed 33147 records to 22780 (keeping 150 days of data) [2025-09-14T18:03:24.112523] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:03:24.170724] [DEBUG] [LOCAL ] FDP: Primary data saved (22780 records). [2025-09-14T18:03:24.170909] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-14T18:03:24.171035] [INFO ] [MAIN ] Update Progress: 816/2370 symbols completed. FDP took 30.2s. Estimated remaining: 2h 44m 11s. Rate: 9.5 symbols/min [2025-09-14T18:03:24.350066] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:24.370540] [DEBUG] [LOCAL ] FERG: Loaded 21137 existing records from primary storage. [2025-09-14T18:03:24.370726] [INFO ] [MAIN ] FERG: Loaded 21137 existing records. [2025-09-14T18:03:24.547320] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:24.547604] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-14T18:03:24.547693] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-14T18:03:24.548361] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-14T18:03:24.548427] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-14T18:03:24.568558] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-14T18:03:24.913335] [INFO ] [REMOTE ] FERG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:25.358887] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-14T18:03:26.158927] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-14T18:03:26.244521] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-14T18:03:26.967304] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-14T18:03:26.974246] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-14T18:03:27.319885] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:03:27.662791] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T18:03:27.758785] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-14T18:03:28.558956] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-14T18:03:28.951301] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-14T18:03:29.040669] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T18:03:29.358887] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-14T18:03:29.693373] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:03:29.711853] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-14T18:03:30.158863] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-14T18:03:30.958966] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-14T18:03:31.289019] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-14T18:03:31.758819] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-14T18:03:31.829234] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:03:32.558839] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-14T18:03:32.971435] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:03:32.972800] [INFO ] [REMOTE ] FENG: Full fetch complete (1673 records). [2025-09-14T18:03:32.972940] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-14T18:03:33.167422] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T18:03:33.167672] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:03:33.167728] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:03:33.167772] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-14T18:03:33.167866] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-14T18:03:33.167917] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-14T18:03:33.167970] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-14T18:03:33.168060] [INFO ] [MAIN ] Update Progress: 817/2370 symbols completed. FENG took 17.0s. Estimated remaining: 2h 44m 9s. Rate: 9.5 symbols/min [2025-09-14T18:03:33.356287] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:33.358858] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-14T18:03:33.367706] [DEBUG] [LOCAL ] FET: Loaded 6241 existing records from primary storage. [2025-09-14T18:03:33.367913] [INFO ] [MAIN ] FET: Loaded 6241 existing records. [2025-09-14T18:03:33.557195] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:33.557660] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-14T18:03:33.557758] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-14T18:03:33.558147] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-14T18:03:33.558215] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-14T18:03:33.995159] [INFO ] [REMOTE ] FET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:34.038211] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T18:03:34.158868] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-14T18:03:34.958896] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-14T18:03:35.424807] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T18:03:35.597972] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T18:03:35.758843] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-14T18:03:35.822534] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:03:36.558923] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-14T18:03:37.358805] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-14T18:03:37.454040] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:03:38.158899] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-14T18:03:38.629704] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T18:03:38.958895] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-14T18:03:39.139824] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T18:03:39.184327] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T18:03:39.758851] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-14T18:03:40.558797] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-14T18:03:41.107634] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T18:03:41.358866] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-14T18:03:41.704839] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T18:03:42.051162] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:03:42.056750] [INFO ] [REMOTE ] FDX: Full fetch complete (55825 records). [2025-09-14T18:03:42.056934] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-14T18:03:42.159684] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-14T18:03:42.489741] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-14T18:03:42.490158] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-14T18:03:42.491315] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-14T18:03:42.506959] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-14T18:03:42.522961] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T18:03:42.536187] [DEBUG] [LOCAL ] FDX: Trimmed 55825 records to 38650 (keeping 150 days of data) [2025-09-14T18:03:42.833689] [DEBUG] [LOCAL ] FDX: Primary data saved (38650 records). [2025-09-14T18:03:42.833970] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-14T18:03:42.834128] [INFO ] [MAIN ] Update Progress: 818/2370 symbols completed. FDX took 29.9s. Estimated remaining: 2h 44m 9s. Rate: 9.5 symbols/min [2025-09-14T18:03:42.964090] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-14T18:03:43.016974] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:43.030472] [DEBUG] [LOCAL ] FF: Loaded 10550 existing records from primary storage. [2025-09-14T18:03:43.031241] [INFO ] [MAIN ] FF: Loaded 10550 existing records. [2025-09-14T18:03:43.217842] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:43.218206] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-14T18:03:43.218348] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-14T18:03:43.218912] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-14T18:03:43.219012] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-14T18:03:43.597928] [INFO ] [REMOTE ] FF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:43.758898] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-14T18:03:44.080247] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T18:03:44.558926] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-14T18:03:44.733860] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T18:03:44.786441] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:03:45.239209] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:03:45.249045] [INFO ] [REMOTE ] FE: Full fetch complete (58095 records). [2025-09-14T18:03:45.249405] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-14T18:03:45.364463] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-14T18:03:45.728982] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-14T18:03:45.729123] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-14T18:03:45.730061] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-14T18:03:45.730123] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-14T18:03:45.731622] [DEBUG] [LOCAL ] FE: Trimmed 58095 records to 40224 (keeping 150 days of data) [2025-09-14T18:03:45.987744] [DEBUG] [LOCAL ] FE: Primary data saved (40224 records). [2025-09-14T18:03:45.987913] [INFO ] [MAIN ] FE: Full history saved. [2025-09-14T18:03:45.988007] [INFO ] [MAIN ] Update Progress: 819/2370 symbols completed. FE took 29.9s. Estimated remaining: 2h 43m 57s. Rate: 9.5 symbols/min [2025-09-14T18:03:46.163177] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:46.163308] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-14T18:03:46.169880] [DEBUG] [LOCAL ] FFA: Loaded 2112 existing records from primary storage. [2025-09-14T18:03:46.170333] [INFO ] [MAIN ] FFA: Loaded 2112 existing records. [2025-09-14T18:03:46.376838] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:46.378054] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-14T18:03:46.378120] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-14T18:03:46.378365] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-14T18:03:46.378434] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-14T18:03:46.725894] [INFO ] [REMOTE ] FFA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:46.849125] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:03:46.958901] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-14T18:03:47.105159] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T18:03:47.626048] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T18:03:47.758835] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-14T18:03:48.526338] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T18:03:48.558792] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-14T18:03:49.305150] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T18:03:49.358865] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-14T18:03:50.158883] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-14T18:03:50.713083] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T18:03:50.958875] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-14T18:03:51.623533] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T18:03:51.669071] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:03:51.674986] [INFO ] [REMOTE ] FERG: Full fetch complete (53134 records). [2025-09-14T18:03:51.675194] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-14T18:03:51.764401] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-14T18:03:52.079683] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-14T18:03:52.079831] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-14T18:03:52.080928] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-14T18:03:52.081001] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-14T18:03:52.082765] [DEBUG] [LOCAL ] FERG: Trimmed 53134 records to 36237 (keeping 150 days of data) [2025-09-14T18:03:52.341956] [DEBUG] [LOCAL ] FERG: Primary data saved (36237 records). [2025-09-14T18:03:52.342194] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-14T18:03:52.342318] [INFO ] [MAIN ] Update Progress: 820/2370 symbols completed. FERG took 28.2s. Estimated remaining: 2h 43m 51s. Rate: 9.5 symbols/min [2025-09-14T18:03:52.470693] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T18:03:52.538519] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:52.549725] [DEBUG] [LOCAL ] FFC: Loaded 7478 existing records from primary storage. [2025-09-14T18:03:52.549965] [INFO ] [MAIN ] FFC: Loaded 7478 existing records. [2025-09-14T18:03:52.563999] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-14T18:03:52.762585] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:52.763068] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-14T18:03:52.763137] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-14T18:03:52.763469] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-14T18:03:52.763530] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-14T18:03:53.130251] [INFO ] [REMOTE ] FFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:53.240725] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:03:53.358868] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-14T18:03:54.158875] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-14T18:03:54.359692] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T18:03:54.958903] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-14T18:03:54.985997] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:03:55.531708] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T18:03:55.758862] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-14T18:03:56.293209] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T18:03:56.295181] [INFO ] [REMOTE ] FFA: Full fetch complete (5978 records). [2025-09-14T18:03:56.295289] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-14T18:03:56.563999] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-14T18:03:56.702833] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-14T18:03:56.702983] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-14T18:03:56.703335] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-14T18:03:56.703398] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-14T18:03:56.704107] [DEBUG] [LOCAL ] FFA: Trimmed 5978 records to 3498 (keeping 150 days of data) [2025-09-14T18:03:56.729064] [DEBUG] [LOCAL ] FFA: Primary data saved (3498 records). [2025-09-14T18:03:56.729281] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-14T18:03:56.729432] [INFO ] [MAIN ] Update Progress: 821/2370 symbols completed. FFA took 10.7s. Estimated remaining: 2h 43m 40s. Rate: 9.5 symbols/min [2025-09-14T18:03:56.909055] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:56.929548] [DEBUG] [LOCAL ] FFWM: Loaded 15821 existing records from primary storage. [2025-09-14T18:03:56.929799] [INFO ] [MAIN ] FFWM: Loaded 15821 existing records. [2025-09-14T18:03:57.129600] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:57.130011] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-14T18:03:57.130090] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-14T18:03:57.130538] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-14T18:03:57.130613] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-14T18:03:57.364045] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-14T18:03:57.517690] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:57.917221] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T18:03:58.161799] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-14T18:03:58.167635] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T18:03:58.958865] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-14T18:03:59.676735] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:03:59.758832] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-14T18:04:00.060930] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T18:04:00.558831] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-14T18:04:00.757163] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T18:04:01.358863] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-14T18:04:01.517152] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T18:04:02.158895] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-14T18:04:02.748517] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:04:02.958853] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-14T18:04:03.758915] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-14T18:04:03.983821] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T18:04:04.292433] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:04:04.558864] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-14T18:04:04.716474] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T18:04:05.358858] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-14T18:04:05.554565] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:04:06.158828] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-14T18:04:06.556565] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T18:04:06.958833] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-14T18:04:07.182431] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T18:04:07.758899] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-14T18:04:07.964663] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T18:04:07.967356] [INFO ] [REMOTE ] FF: Full fetch complete (28201 records). [2025-09-14T18:04:07.967457] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-14T18:04:08.344636] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-14T18:04:08.344773] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-14T18:04:08.345501] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-14T18:04:08.345587] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-14T18:04:08.346443] [DEBUG] [LOCAL ] FF: Trimmed 28201 records to 18158 (keeping 150 days of data) [2025-09-14T18:04:08.466691] [DEBUG] [LOCAL ] FF: Primary data saved (18158 records). [2025-09-14T18:04:08.466842] [INFO ] [MAIN ] FF: Full history saved. [2025-09-14T18:04:08.466983] [INFO ] [MAIN ] Update Progress: 822/2370 symbols completed. FF took 25.6s. Estimated remaining: 2h 43m 44s. Rate: 9.5 symbols/min [2025-09-14T18:04:08.564797] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-14T18:04:08.638748] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:08.647901] [DEBUG] [LOCAL ] FG: Loaded 8386 existing records from primary storage. [2025-09-14T18:04:08.648043] [INFO ] [MAIN ] FG: Loaded 8386 existing records. [2025-09-14T18:04:08.798888] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T18:04:08.832060] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:08.835190] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-14T18:04:08.835447] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-14T18:04:08.836010] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-14T18:04:08.835930] [INFO ] [REMOTE ] FFC: Full fetch complete (18013 records). [2025-09-14T18:04:08.836175] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-14T18:04:08.856475] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-14T18:04:09.365937] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-14T18:04:09.517683] [INFO ] [REMOTE ] FG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:09.604654] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-14T18:04:09.604781] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-14T18:04:09.605287] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-14T18:04:09.605343] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-14T18:04:09.606005] [DEBUG] [LOCAL ] FFC: Trimmed 18013 records to 12077 (keeping 150 days of data) [2025-09-14T18:04:09.696953] [DEBUG] [LOCAL ] FFC: Primary data saved (12077 records). [2025-09-14T18:04:09.697156] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-14T18:04:09.697289] [INFO ] [MAIN ] Update Progress: 823/2370 symbols completed. FFC took 17.4s. Estimated remaining: 2h 43m 28s. Rate: 9.5 symbols/min [2025-09-14T18:04:09.873399] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:09.878673] [DEBUG] [LOCAL ] FGN: Loaded 1768 existing records from primary storage. [2025-09-14T18:04:09.878821] [INFO ] [MAIN ] FGN: Loaded 1768 existing records. [2025-09-14T18:04:10.070173] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:10.070900] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-14T18:04:10.071285] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-14T18:04:10.071633] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-14T18:04:10.071834] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-14T18:04:10.161519] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-14T18:04:10.298533] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:04:10.505021] [INFO ] [REMOTE ] FGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:10.514143] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:04:10.902076] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T18:04:10.958873] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-14T18:04:11.571348] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T18:04:11.758877] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-14T18:04:12.505911] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T18:04:12.558875] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-14T18:04:13.358850] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-14T18:04:13.615967] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:04:13.983500] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T18:04:14.158820] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-14T18:04:14.958834] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-14T18:04:15.139552] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T18:04:15.533658] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T18:04:15.758878] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-14T18:04:16.558811] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-14T18:04:16.774036] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:04:16.776403] [INFO ] [REMOTE ] FET: Full fetch complete (13564 records). [2025-09-14T18:04:16.776517] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-14T18:04:17.146531] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-14T18:04:17.146690] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-14T18:04:17.147070] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-14T18:04:17.147138] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-14T18:04:17.147708] [DEBUG] [LOCAL ] FET: Trimmed 13564 records to 9010 (keeping 150 days of data) [2025-09-14T18:04:17.206665] [DEBUG] [LOCAL ] FET: Primary data saved (9010 records). [2025-09-14T18:04:17.206922] [INFO ] [MAIN ] FET: Full history saved. [2025-09-14T18:04:17.207061] [INFO ] [MAIN ] Update Progress: 824/2370 symbols completed. FET took 44.0s. Estimated remaining: 2h 43m 24s. Rate: 9.5 symbols/min [2025-09-14T18:04:17.376459] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-14T18:04:17.379075] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:17.383920] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:04:17.390799] [DEBUG] [LOCAL ] FGSN: Loaded 2493 existing records from primary storage. [2025-09-14T18:04:17.390900] [INFO ] [MAIN ] FGSN: Loaded 2493 existing records. [2025-09-14T18:04:17.575356] [WARN ] [MAIN ] FGSN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:17.575661] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-14T18:04:17.575756] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-14T18:04:17.576061] [DEBUG] [LOCAL ] FGSN: Deleted primary data file. [2025-09-14T18:04:17.576123] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-14T18:04:17.934353] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:18.158850] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-14T18:04:18.651674] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T18:04:18.813952] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T18:04:18.958853] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-14T18:04:19.758883] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-14T18:04:20.281897] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T18:04:20.525058] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T18:04:20.558802] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-14T18:04:21.358867] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-14T18:04:21.713597] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T18:04:21.960259] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T18:04:22.158836] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-14T18:04:22.958863] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-14T18:04:23.427523] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T18:04:23.579355] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:04:23.758892] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-14T18:04:24.216694] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T18:04:24.217921] [INFO ] [REMOTE ] FGN: Full fetch complete (4325 records). [2025-09-14T18:04:24.218029] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-14T18:04:24.562744] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-14T18:04:24.587109] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-14T18:04:24.587218] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-14T18:04:24.587381] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-14T18:04:24.587434] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-14T18:04:24.587884] [DEBUG] [LOCAL ] FGN: Trimmed 4325 records to 2766 (keeping 150 days of data) [2025-09-14T18:04:24.606837] [DEBUG] [LOCAL ] FGN: Primary data saved (2766 records). [2025-09-14T18:04:24.607008] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-14T18:04:24.607145] [INFO ] [MAIN ] Update Progress: 825/2370 symbols completed. FGN took 14.9s. Estimated remaining: 2h 43m 20s. Rate: 9.5 symbols/min [2025-09-14T18:04:24.779590] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:24.798778] [DEBUG] [LOCAL ] FHI: Loaded 17471 existing records from primary storage. [2025-09-14T18:04:24.798959] [INFO ] [MAIN ] FHI: Loaded 17471 existing records. [2025-09-14T18:04:24.978262] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:24.978521] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-14T18:04:24.978584] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-14T18:04:24.979209] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-14T18:04:24.979279] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-14T18:04:25.340253] [INFO ] [REMOTE ] FHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:25.358784] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-14T18:04:25.805516] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-14T18:04:25.809375] [INFO ] [REMOTE ] FFWM: Full fetch complete (39541 records). [2025-09-14T18:04:25.809488] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-14T18:04:26.163978] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-14T18:04:26.211262] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-14T18:04:26.211375] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-14T18:04:26.212075] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-14T18:04:26.212133] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-14T18:04:26.213151] [DEBUG] [LOCAL ] FFWM: Trimmed 39541 records to 26759 (keeping 150 days of data) [2025-09-14T18:04:26.379923] [DEBUG] [LOCAL ] FFWM: Primary data saved (26759 records). [2025-09-14T18:04:26.380090] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-14T18:04:26.380190] [INFO ] [MAIN ] Update Progress: 826/2370 symbols completed. FFWM took 29.7s. Estimated remaining: 2h 43m 5s. Rate: 9.5 symbols/min [2025-09-14T18:04:26.558520] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:26.582516] [DEBUG] [LOCAL ] FHN: Loaded 23930 existing records from primary storage. [2025-09-14T18:04:26.582707] [INFO ] [MAIN ] FHN: Loaded 23930 existing records. [2025-09-14T18:04:26.757658] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:26.757937] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-14T18:04:26.757996] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-14T18:04:26.758674] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-14T18:04:26.758736] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-14T18:04:26.970384] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-14T18:04:27.115189] [INFO ] [REMOTE ] FHN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:27.135088] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T18:04:27.523767] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T18:04:27.758882] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-14T18:04:27.822047] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:04:28.558855] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-14T18:04:29.358856] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-14T18:04:29.566882] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T18:04:29.921480] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T18:04:30.158867] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-14T18:04:30.193245] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:04:30.958852] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-14T18:04:31.758846] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-14T18:04:32.034319] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:04:32.558812] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-14T18:04:32.654721] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T18:04:33.055213] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:04:33.246323] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T18:04:33.358847] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-14T18:04:34.158836] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-14T18:04:34.958799] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-14T18:04:35.051429] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:04:35.491581] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T18:04:35.758837] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-14T18:04:36.051218] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:04:36.226860] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T18:04:36.558891] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-14T18:04:37.358904] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-14T18:04:37.428393] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:04:37.920829] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:04:37.922986] [INFO ] [REMOTE ] FGSN: Full fetch complete (5586 records). [2025-09-14T18:04:37.923159] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-14T18:04:38.160398] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-14T18:04:38.396249] [DEBUG] [VALIDATOR ] FGSN: All expected trading days are present. [2025-09-14T18:04:38.396405] [DEBUG] [VALIDATOR ] FGSN: Primary data validation passed. [2025-09-14T18:04:38.396671] [INFO ] [MAIN ] FGSN: Fetched primary data is valid. [2025-09-14T18:04:38.396733] [DEBUG] [LOCAL ] FGSN: Saving primary data. [2025-09-14T18:04:38.397207] [DEBUG] [LOCAL ] FGSN: Trimmed 5586 records to 3585 (keeping 150 days of data) [2025-09-14T18:04:38.422932] [DEBUG] [LOCAL ] FGSN: Primary data saved (3585 records). [2025-09-14T18:04:38.423215] [INFO ] [MAIN ] FGSN: Full history saved. [2025-09-14T18:04:38.423378] [INFO ] [MAIN ] Update Progress: 827/2370 symbols completed. FGSN took 21.2s. Estimated remaining: 2h 43m 9s. Rate: 9.5 symbols/min [2025-09-14T18:04:38.622527] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:38.654927] [DEBUG] [LOCAL ] FI: Loaded 24037 existing records from primary storage. [2025-09-14T18:04:38.655161] [INFO ] [MAIN ] FI: Loaded 24037 existing records. [2025-09-14T18:04:38.839587] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:38.839972] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-14T18:04:38.840051] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-14T18:04:38.840878] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-14T18:04:38.840944] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-14T18:04:38.964052] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-14T18:04:39.296176] [INFO ] [REMOTE ] FI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:39.758882] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-14T18:04:39.903924] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:04:40.558902] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-14T18:04:40.661633] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:04:41.358934] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-14T18:04:41.895349] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-14T18:04:42.153825] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T18:04:42.164051] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-14T18:04:42.891864] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:04:42.958797] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-14T18:04:43.286707] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:04:43.758853] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-14T18:04:44.558813] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-14T18:04:44.728576] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:04:44.869378] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T18:04:45.358837] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-14T18:04:46.158829] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-14T18:04:46.271419] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T18:04:46.273614] [INFO ] [REMOTE ] FG: Full fetch complete (23074 records). [2025-09-14T18:04:46.273719] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-14T18:04:46.649207] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-14T18:04:46.649316] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-14T18:04:46.649839] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-14T18:04:46.649965] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-14T18:04:46.650815] [DEBUG] [LOCAL ] FG: Trimmed 23074 records to 15506 (keeping 150 days of data) [2025-09-14T18:04:46.751413] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-14T18:04:46.784977] [DEBUG] [LOCAL ] FG: Primary data saved (15506 records). [2025-09-14T18:04:46.785136] [INFO ] [MAIN ] FG: Full history saved. [2025-09-14T18:04:46.785257] [INFO ] [MAIN ] Update Progress: 828/2370 symbols completed. FG took 38.3s. Estimated remaining: 2h 43m 7s. Rate: 9.5 symbols/min [2025-09-14T18:04:46.955847] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:46.958851] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-14T18:04:46.968261] [DEBUG] [LOCAL ] FICO: Loaded 10582 existing records from primary storage. [2025-09-14T18:04:46.968375] [INFO ] [MAIN ] FICO: Loaded 10582 existing records. [2025-09-14T18:04:47.148619] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:47.148898] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-14T18:04:47.148958] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-14T18:04:47.149328] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-14T18:04:47.149388] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-14T18:04:47.503636] [INFO ] [REMOTE ] FICO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:47.758835] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-14T18:04:47.983985] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:04:48.397425] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:04:48.531585] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T18:04:48.558786] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-14T18:04:49.358802] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-14T18:04:49.725493] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:04:50.158869] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-14T18:04:50.958834] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-14T18:04:51.249661] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:04:51.317869] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T18:04:51.351227] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:04:51.357152] [INFO ] [REMOTE ] FHN: Full fetch complete (58017 records). [2025-09-14T18:04:51.357278] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-14T18:04:51.736586] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-14T18:04:51.736746] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-14T18:04:51.737634] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-14T18:04:51.737723] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-14T18:04:51.739142] [DEBUG] [LOCAL ] FHN: Trimmed 58017 records to 40144 (keeping 150 days of data) [2025-09-14T18:04:51.800857] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-14T18:04:52.007273] [DEBUG] [LOCAL ] FHN: Primary data saved (40144 records). [2025-09-14T18:04:52.007438] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-14T18:04:52.007535] [INFO ] [MAIN ] Update Progress: 829/2370 symbols completed. FHN took 25.6s. Estimated remaining: 2h 42m 58s. Rate: 9.5 symbols/min [2025-09-14T18:04:52.176579] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:52.189332] [DEBUG] [LOCAL ] FIG: Loaded 11805 existing records from primary storage. [2025-09-14T18:04:52.189485] [INFO ] [MAIN ] FIG: Loaded 11805 existing records. [2025-09-14T18:04:52.369854] [WARN ] [MAIN ] FIG: Insufficient historical data. Have data from 2025-07-31, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:52.370240] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-14T18:04:52.370327] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-14T18:04:52.376358] [DEBUG] [LOCAL ] FIG: Deleted primary data file. [2025-09-14T18:04:52.380703] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-14T18:04:52.387106] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:04:52.457322] [INFO ] [REMOTE ] FHI: Full fetch complete (43881 records). [2025-09-14T18:04:52.490911] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-14T18:04:52.563961] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-14T18:04:53.087159] [INFO ] [REMOTE ] FIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:53.156672] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-14T18:04:53.156806] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-14T18:04:53.157632] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-14T18:04:53.157712] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-14T18:04:53.158969] [DEBUG] [LOCAL ] FHI: Trimmed 43881 records to 30397 (keeping 150 days of data) [2025-09-14T18:04:53.355126] [DEBUG] [LOCAL ] FHI: Primary data saved (30397 records). [2025-09-14T18:04:53.355331] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-14T18:04:53.355461] [INFO ] [MAIN ] Update Progress: 830/2370 symbols completed. FHI took 28.7s. Estimated remaining: 2h 42m 43s. Rate: 9.5 symbols/min [2025-09-14T18:04:53.367981] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-14T18:04:53.534347] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:53.555768] [DEBUG] [LOCAL ] FIGS: Loaded 22026 existing records from primary storage. [2025-09-14T18:04:53.556079] [INFO ] [MAIN ] FIGS: Loaded 22026 existing records. [2025-09-14T18:04:53.742052] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:53.742342] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-14T18:04:53.742403] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-14T18:04:53.743075] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-14T18:04:53.743144] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-14T18:04:53.852142] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T18:04:54.126551] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:54.147050] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:04:54.158777] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-14T18:04:54.958924] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-14T18:04:55.113399] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T18:04:55.345348] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-14T18:04:55.758852] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-14T18:04:56.558875] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-14T18:04:57.088822] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:04:57.358838] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-14T18:04:58.061624] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T18:04:58.158852] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-14T18:04:58.379555] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T18:04:58.534683] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-14T18:04:58.958866] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-14T18:04:59.758841] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-14T18:05:00.152741] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:05:00.155167] [INFO ] [REMOTE ] FICO: Full fetch complete (21778 records). [2025-09-14T18:05:00.155259] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-14T18:05:00.518350] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-14T18:05:00.518461] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-14T18:05:00.519025] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-14T18:05:00.519090] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-14T18:05:00.519916] [DEBUG] [LOCAL ] FICO: Trimmed 21778 records to 16252 (keeping 150 days of data) [2025-09-14T18:05:00.563761] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-14T18:05:00.629857] [DEBUG] [LOCAL ] FICO: Primary data saved (16252 records). [2025-09-14T18:05:00.630188] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-14T18:05:00.630368] [INFO ] [MAIN ] Update Progress: 831/2370 symbols completed. FICO took 13.8s. Estimated remaining: 2h 42m 38s. Rate: 9.5 symbols/min [2025-09-14T18:05:00.805146] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:00.841931] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:05:00.861116] [DEBUG] [LOCAL ] FIHL: Loaded 17662 existing records from primary storage. [2025-09-14T18:05:00.861288] [INFO ] [MAIN ] FIHL: Loaded 17662 existing records. [2025-09-14T18:05:01.041221] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:01.041667] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-14T18:05:01.041743] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-14T18:05:01.042402] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-14T18:05:01.042470] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-14T18:05:01.374952] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-14T18:05:01.424711] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:02.158833] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-14T18:05:02.550802] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T18:05:02.750461] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-14T18:05:02.958837] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-14T18:05:03.286321] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T18:05:03.758838] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-14T18:05:03.989255] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T18:05:04.558818] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-14T18:05:04.846811] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:04.847157] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-14T18:05:05.358817] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-14T18:05:05.719192] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T18:05:05.755730] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T18:05:06.158772] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-14T18:05:06.958853] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-14T18:05:07.758929] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-14T18:05:08.540770] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-14T18:05:08.558771] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-14T18:05:09.358855] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-14T18:05:09.517938] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T18:05:09.730824] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-14T18:05:10.158856] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-14T18:05:10.667423] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-14T18:05:10.780312] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T18:05:10.958853] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-14T18:05:11.758888] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-14T18:05:12.290364] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-14T18:05:12.296188] [INFO ] [REMOTE ] FIG: Full fetch complete (12176 records). [2025-09-14T18:05:12.296372] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-14T18:05:12.509402] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-14T18:05:12.512680] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:05:12.514848] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T18:05:12.514948] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:05:12.524422] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-14T18:05:12.524964] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-14T18:05:12.525589] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-14T18:05:12.525715] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-14T18:05:12.526174] [INFO ] [MAIN ] Update Progress: 832/2370 symbols completed. FIG took 20.5s. Estimated remaining: 2h 42m 42s. Rate: 9.5 symbols/min [2025-09-14T18:05:12.564861] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-14T18:05:12.717867] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T18:05:12.719375] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:12.725961] [INFO ] [REMOTE ] FI: Full fetch complete (58126 records). [2025-09-14T18:05:12.726210] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-14T18:05:12.811354] [DEBUG] [LOCAL ] FINS: Loaded 3401 existing records from primary storage. [2025-09-14T18:05:12.832422] [INFO ] [MAIN ] FINS: Loaded 3401 existing records. [2025-09-14T18:05:13.217534] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:13.240049] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-14T18:05:13.270810] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-14T18:05:13.303170] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-14T18:05:13.322593] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-14T18:05:13.319562] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-14T18:05:13.322757] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-14T18:05:13.323691] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-14T18:05:13.356324] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-14T18:05:13.367854] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-14T18:05:13.434492] [DEBUG] [LOCAL ] FI: Trimmed 58126 records to 40371 (keeping 150 days of data) [2025-09-14T18:05:13.824962] [INFO ] [REMOTE ] FINS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:13.971332] [DEBUG] [LOCAL ] FI: Primary data saved (40371 records). [2025-09-14T18:05:13.971530] [INFO ] [MAIN ] FI: Full history saved. [2025-09-14T18:05:13.971654] [INFO ] [MAIN ] Update Progress: 833/2370 symbols completed. FI took 35.5s. Estimated remaining: 2h 42m 27s. Rate: 9.5 symbols/min [2025-09-14T18:05:14.140870] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:14.163253] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-14T18:05:14.163755] [DEBUG] [LOCAL ] FINV: Loaded 21701 existing records from primary storage. [2025-09-14T18:05:14.164679] [INFO ] [MAIN ] FINV: Loaded 21701 existing records. [2025-09-14T18:05:14.346259] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:14.346656] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-14T18:05:14.346764] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-14T18:05:14.347436] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-14T18:05:14.347501] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-14T18:05:14.488486] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T18:05:14.754604] [INFO ] [REMOTE ] FINV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:14.958850] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-14T18:05:15.020937] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:05:15.127149] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:05:15.758935] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-14T18:05:16.364108] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T18:05:16.505295] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:05:16.558829] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-14T18:05:17.358886] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-14T18:05:17.937524] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T18:05:18.158932] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-14T18:05:18.632428] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T18:05:18.958902] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-14T18:05:19.672777] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:05:19.758810] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-14T18:05:20.429707] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T18:05:20.435065] [INFO ] [REMOTE ] FIGS: Full fetch complete (53292 records). [2025-09-14T18:05:20.435263] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-14T18:05:20.563983] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-14T18:05:20.821209] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-14T18:05:20.821340] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-14T18:05:20.822203] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-14T18:05:20.822272] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-14T18:05:20.823673] [DEBUG] [LOCAL ] FIGS: Trimmed 53292 records to 36665 (keeping 150 days of data) [2025-09-14T18:05:21.040883] [DEBUG] [LOCAL ] FIGS: Primary data saved (36665 records). [2025-09-14T18:05:21.041054] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-14T18:05:21.041155] [INFO ] [MAIN ] Update Progress: 834/2370 symbols completed. FIGS took 27.7s. Estimated remaining: 2h 42m 22s. Rate: 9.5 symbols/min [2025-09-14T18:05:21.211207] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:21.233911] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:05:21.260080] [DEBUG] [LOCAL ] FIS: Loaded 23801 existing records from primary storage. [2025-09-14T18:05:21.260242] [INFO ] [MAIN ] FIS: Loaded 23801 existing records. [2025-09-14T18:05:21.360783] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-14T18:05:21.437784] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:21.438029] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-14T18:05:21.438097] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-14T18:05:21.438772] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-14T18:05:21.438835] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-14T18:05:21.793453] [INFO ] [REMOTE ] FIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:22.158790] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-14T18:05:22.270115] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:05:22.792603] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T18:05:22.823877] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T18:05:22.958873] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-14T18:05:23.758883] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-14T18:05:24.252779] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T18:05:24.558868] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-14T18:05:25.149423] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T18:05:25.358914] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-14T18:05:25.839577] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T18:05:25.844192] [INFO ] [REMOTE ] FIHL: Full fetch complete (43679 records). [2025-09-14T18:05:25.844365] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-14T18:05:26.160972] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-14T18:05:26.180668] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:05:26.250205] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-14T18:05:26.250340] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-14T18:05:26.251210] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-14T18:05:26.251275] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-14T18:05:26.252553] [DEBUG] [LOCAL ] FIHL: Trimmed 43679 records to 29260 (keeping 150 days of data) [2025-09-14T18:05:26.435523] [DEBUG] [LOCAL ] FIHL: Primary data saved (29260 records). [2025-09-14T18:05:26.435731] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-14T18:05:26.435854] [INFO ] [MAIN ] Update Progress: 835/2370 symbols completed. FIHL took 25.8s. Estimated remaining: 2h 42m 13s. Rate: 9.5 symbols/min [2025-09-14T18:05:26.606232] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:26.621233] [DEBUG] [LOCAL ] FIX: Loaded 12396 existing records from primary storage. [2025-09-14T18:05:26.621416] [INFO ] [MAIN ] FIX: Loaded 12396 existing records. [2025-09-14T18:05:26.804910] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:26.805236] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-14T18:05:26.805316] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-14T18:05:26.805915] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-14T18:05:26.805996] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-14T18:05:26.959320] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-14T18:05:27.160881] [INFO ] [REMOTE ] FIX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:27.733884] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T18:05:27.758828] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-14T18:05:27.911476] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:05:28.558893] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-14T18:05:29.309264] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:05:29.358842] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-14T18:05:30.138500] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T18:05:30.158921] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-14T18:05:30.830330] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T18:05:30.958900] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-14T18:05:31.626927] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:05:31.758899] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-14T18:05:32.378780] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T18:05:32.519927] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T18:05:32.558845] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-14T18:05:33.358844] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-14T18:05:34.130602] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T18:05:34.158886] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-14T18:05:34.424783] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:05:34.958872] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-14T18:05:35.758864] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-14T18:05:35.837568] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:05:36.558832] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-14T18:05:36.761573] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T18:05:37.036762] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T18:05:37.042872] [INFO ] [REMOTE ] FINV: Full fetch complete (48845 records). [2025-09-14T18:05:37.043153] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-14T18:05:37.365911] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-14T18:05:37.488007] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-14T18:05:37.488180] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-14T18:05:37.489399] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-14T18:05:37.489542] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-14T18:05:37.491268] [DEBUG] [LOCAL ] FINV: Trimmed 48845 records to 33673 (keeping 150 days of data) [2025-09-14T18:05:37.752293] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T18:05:37.771255] [DEBUG] [LOCAL ] FINV: Primary data saved (33673 records). [2025-09-14T18:05:37.771431] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-14T18:05:37.771557] [INFO ] [MAIN ] Update Progress: 836/2370 symbols completed. FINV took 23.8s. Estimated remaining: 2h 42m 16s. Rate: 9.5 symbols/min [2025-09-14T18:05:37.942555] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:37.945954] [DEBUG] [LOCAL ] FIXT: Loaded 1618 existing records from primary storage. [2025-09-14T18:05:37.946051] [INFO ] [MAIN ] FIXT: Loaded 1618 existing records. [2025-09-14T18:05:38.123441] [WARN ] [MAIN ] FIXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:38.123622] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:05:38.125023] [INFO ] [REMOTE ] FINS: Full fetch complete (8800 records). [2025-09-14T18:05:38.125109] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-14T18:05:38.125183] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-14T18:05:38.125287] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-14T18:05:38.164129] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-14T18:05:38.177512] [DEBUG] [LOCAL ] FIXT: Deleted primary data file. [2025-09-14T18:05:38.191494] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-14T18:05:38.845046] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-14T18:05:38.876628] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:38.876727] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-14T18:05:38.877302] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-14T18:05:38.877365] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-14T18:05:38.877850] [DEBUG] [LOCAL ] FINS: Trimmed 8800 records to 6552 (keeping 150 days of data) [2025-09-14T18:05:38.919098] [DEBUG] [LOCAL ] FINS: Primary data saved (6552 records). [2025-09-14T18:05:38.919276] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-14T18:05:38.919412] [INFO ] [MAIN ] Update Progress: 837/2370 symbols completed. FINS took 26.4s. Estimated remaining: 2h 42m 0s. Rate: 9.5 symbols/min [2025-09-14T18:05:38.958799] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-14T18:05:39.758835] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-14T18:05:40.011012] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:40.011351] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-14T18:05:40.146663] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T18:05:40.442972] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:05:40.558858] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-14T18:05:41.358855] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-14T18:05:42.026074] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:05:42.158851] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-14T18:05:42.412720] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:42.413059] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-14T18:05:42.958855] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-14T18:05:43.081942] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:05:43.758880] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-14T18:05:44.273042] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T18:05:44.558882] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-14T18:05:45.023288] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:45.023825] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-14T18:05:45.292508] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:05:45.358852] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-14T18:05:46.158900] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-14T18:05:46.799846] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:05:46.803320] [INFO ] [REMOTE ] FIX: Full fetch complete (34787 records). [2025-09-14T18:05:46.803431] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-14T18:05:46.959584] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-14T18:05:47.169624] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-14T18:05:47.169740] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-14T18:05:47.170264] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-14T18:05:47.170363] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-14T18:05:47.171171] [DEBUG] [LOCAL ] FIX: Trimmed 34787 records to 21542 (keeping 150 days of data) [2025-09-14T18:05:47.305948] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:47.306596] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-14T18:05:47.324064] [DEBUG] [LOCAL ] FIX: Primary data saved (21542 records). [2025-09-14T18:05:47.324227] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-14T18:05:47.324346] [INFO ] [MAIN ] Update Progress: 838/2370 symbols completed. FIX took 20.9s. Estimated remaining: 2h 41m 58s. Rate: 9.5 symbols/min [2025-09-14T18:05:47.372863] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T18:05:47.758892] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-14T18:05:48.192737] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-14T18:05:48.558833] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-14T18:05:49.214628] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:05:49.220227] [INFO ] [REMOTE ] FIS: Full fetch complete (58053 records). [2025-09-14T18:05:49.220363] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-14T18:05:49.362200] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-14T18:05:49.633955] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-14T18:05:49.634068] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-14T18:05:49.634938] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-14T18:05:49.635010] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-14T18:05:49.636314] [DEBUG] [LOCAL ] FIS: Trimmed 58053 records to 40130 (keeping 150 days of data) [2025-09-14T18:05:49.770894] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T18:05:49.920139] [DEBUG] [LOCAL ] FIS: Primary data saved (40130 records). [2025-09-14T18:05:49.920408] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-14T18:05:49.920544] [INFO ] [MAIN ] Update Progress: 839/2370 symbols completed. FIS took 28.9s. Estimated remaining: 2h 41m 45s. Rate: 9.5 symbols/min [2025-09-14T18:05:50.158846] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-14T18:05:50.648233] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T18:05:50.958869] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-14T18:05:51.449348] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T18:05:51.450306] [INFO ] [REMOTE ] FIXT: Full fetch complete (1618 records). [2025-09-14T18:05:51.450407] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-14T18:05:51.626432] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 62 unique days, need 150 days [2025-09-14T18:05:51.626677] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:05:51.626731] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:05:51.626778] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-14T18:05:51.626847] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-14T18:05:51.626918] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-14T18:05:51.626970] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-14T18:05:51.627046] [INFO ] [MAIN ] Update Progress: 840/2370 symbols completed. FIXT took 13.9s. Estimated remaining: 2h 41m 30s. Rate: 9.5 symbols/min [2025-09-14T18:05:52.209558] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:52.202260] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:52.343376] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:52.355187] [DEBUG] [LOCAL ] FLC: Loaded 2563 existing records from primary storage. [2025-09-14T18:05:52.372785] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:52.374209] [INFO ] [MAIN ] FLC: Loaded 2563 existing records. [2025-09-14T18:05:52.386064] [DEBUG] [LOCAL ] FLNG: Loaded 16146 existing records from primary storage. [2025-09-14T18:05:52.423115] [INFO ] [MAIN ] FLNG: Loaded 16146 existing records. [2025-09-14T18:05:52.684208] [DEBUG] [LOCAL ] FLO: Loaded 23396 existing records from primary storage. [2025-09-14T18:05:52.737698] [DEBUG] [LOCAL ] FLG: Loaded 23836 existing records from primary storage. [2025-09-14T18:05:52.765730] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:52.768971] [INFO ] [MAIN ] FLO: Loaded 23396 existing records. [2025-09-14T18:05:52.768899] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:52.797709] [INFO ] [MAIN ] FLG: Loaded 23836 existing records. [2025-09-14T18:05:52.802951] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-14T18:05:52.803021] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-14T18:05:52.835019] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-14T18:05:52.846224] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-14T18:05:52.856598] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-14T18:05:52.918134] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-14T18:05:52.907677] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-14T18:05:52.935324] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-14T18:05:53.123880] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:53.282422] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-14T18:05:53.356861] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-14T18:05:53.362417] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:53.474023] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-14T18:05:53.540918] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-14T18:05:53.549469] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-14T18:05:53.619107] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-14T18:05:53.720239] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-14T18:05:53.767480] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-14T18:05:54.019061] [INFO ] [REMOTE ] FLC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:54.100852] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-14T18:05:54.135242] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:54.172529] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-14T18:05:54.599258] [INFO ] [REMOTE ] FLO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:54.611014] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-14T18:05:54.636740] [INFO ] [REMOTE ] FLG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:54.637806] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-14T18:05:54.957761] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:05:54.959399] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-14T18:05:55.712950] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T18:05:55.736904] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:05:55.758774] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-14T18:05:56.329241] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T18:05:56.424832] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T18:05:56.558846] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-14T18:05:57.359685] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-14T18:05:57.364684] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:05:58.158839] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-14T18:05:58.265929] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T18:05:58.468234] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:05:58.958852] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-14T18:05:59.758836] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-14T18:05:59.983832] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:06:00.558874] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-14T18:06:00.636995] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:06:01.358828] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-14T18:06:01.556162] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T18:06:01.924507] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T18:06:02.158830] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-14T18:06:02.958852] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-14T18:06:03.758946] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-14T18:06:04.655549] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-14T18:06:04.657596] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-14T18:06:05.235937] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T18:06:05.358945] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-14T18:06:05.569788] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:06:05.826527] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (4.47 seconds). [2025-09-14T18:06:05.917372] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-14T18:06:06.158842] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-14T18:06:06.212395] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T18:06:06.958894] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-14T18:06:07.758863] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-14T18:06:07.967930] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T18:06:08.558832] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-14T18:06:08.688602] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:06:09.259820] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:06:09.358810] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-14T18:06:10.100405] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:06:10.158826] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-14T18:06:10.962387] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-14T18:06:10.967310] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:06:11.558161] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:06:11.559513] [INFO ] [REMOTE ] FLC: Full fetch complete (6095 records). [2025-09-14T18:06:11.559599] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-14T18:06:11.767429] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-14T18:06:11.921443] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-14T18:06:11.921545] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-14T18:06:11.921776] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-14T18:06:11.921831] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-14T18:06:11.922277] [DEBUG] [LOCAL ] FLC: Trimmed 6095 records to 3956 (keeping 150 days of data) [2025-09-14T18:06:11.948757] [DEBUG] [LOCAL ] FLC: Primary data saved (3956 records). [2025-09-14T18:06:11.948913] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-14T18:06:11.949039] [INFO ] [MAIN ] Update Progress: 841/2370 symbols completed. FLC took 20.3s. Estimated remaining: 2h 41m 49s. Rate: 9.4 symbols/min [2025-09-14T18:06:12.119475] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:12.150499] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T18:06:12.170462] [DEBUG] [LOCAL ] FLOC: Loaded 12277 existing records from primary storage. [2025-09-14T18:06:12.170621] [INFO ] [MAIN ] FLOC: Loaded 12277 existing records. [2025-09-14T18:06:12.349205] [WARN ] [MAIN ] FLOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:12.349489] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-14T18:06:12.349552] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-14T18:06:12.349978] [DEBUG] [LOCAL ] FLOC: Deleted primary data file. [2025-09-14T18:06:12.350048] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-14T18:06:12.568752] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-14T18:06:12.724475] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:13.358824] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-14T18:06:13.402609] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:06:14.158836] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-14T18:06:14.454150] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T18:06:14.751017] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T18:06:14.958839] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-14T18:06:15.758845] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-14T18:06:16.451585] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-14T18:06:16.478434] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:06:16.484092] [INFO ] [REMOTE ] FLG: Full fetch complete (58013 records). [2025-09-14T18:06:16.484228] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-14T18:06:16.563944] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-14T18:06:16.867787] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-14T18:06:16.867898] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-14T18:06:16.868728] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-14T18:06:16.868797] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-14T18:06:16.870004] [DEBUG] [LOCAL ] FLG: Trimmed 58013 records to 40127 (keeping 150 days of data) [2025-09-14T18:06:17.114171] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-14T18:06:17.122120] [INFO ] [REMOTE ] FLNG: Full fetch complete (37695 records). [2025-09-14T18:06:17.123062] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-14T18:06:17.363974] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-14T18:06:17.518974] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-14T18:06:17.519086] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-14T18:06:17.519791] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-14T18:06:17.520209] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-14T18:06:17.522862] [DEBUG] [LOCAL ] FLNG: Trimmed 37695 records to 25164 (keeping 150 days of data) [2025-09-14T18:06:17.633333] [DEBUG] [LOCAL ] FLG: Primary data saved (40127 records). [2025-09-14T18:06:17.633835] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-14T18:06:17.634025] [INFO ] [MAIN ] Update Progress: 842/2370 symbols completed. FLG took 26.0s. Estimated remaining: 2h 41m 41s. Rate: 9.5 symbols/min [2025-09-14T18:06:17.833682] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:17.865038] [DEBUG] [LOCAL ] FLR: Loaded 23838 existing records from primary storage. [2025-09-14T18:06:17.865218] [INFO ] [MAIN ] FLR: Loaded 23838 existing records. [2025-09-14T18:06:18.064196] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:18.065104] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-14T18:06:18.069477] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-14T18:06:18.086484] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-14T18:06:18.086625] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-14T18:06:18.303454] [DEBUG] [LOCAL ] FLNG: Primary data saved (25164 records). [2025-09-14T18:06:18.312129] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-14T18:06:18.320868] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T18:06:18.345495] [INFO ] [MAIN ] Update Progress: 843/2370 symbols completed. FLNG took 26.7s. Estimated remaining: 2h 41m 25s. Rate: 9.5 symbols/min [2025-09-14T18:06:18.407614] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-14T18:06:18.601085] [INFO ] [REMOTE ] FLR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:18.669758] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:18.692066] [DEBUG] [LOCAL ] FLS: Loaded 22488 existing records from primary storage. [2025-09-14T18:06:18.692226] [INFO ] [MAIN ] FLS: Loaded 22488 existing records. [2025-09-14T18:06:18.870166] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:18.870446] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-14T18:06:18.870511] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-14T18:06:18.871152] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-14T18:06:18.871231] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-14T18:06:18.967160] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-14T18:06:19.223100] [INFO ] [REMOTE ] FLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:19.259034] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:06:19.758842] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-14T18:06:19.803352] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T18:06:20.428872] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:06:20.434850] [INFO ] [REMOTE ] FLO: Full fetch complete (56350 records). [2025-09-14T18:06:20.434970] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-14T18:06:20.575444] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-14T18:06:20.821148] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-14T18:06:20.821322] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-14T18:06:20.822155] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-14T18:06:20.822213] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-14T18:06:20.823489] [DEBUG] [LOCAL ] FLO: Trimmed 56350 records to 39052 (keeping 150 days of data) [2025-09-14T18:06:20.950240] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-14T18:06:21.127088] [DEBUG] [LOCAL ] FLO: Primary data saved (39052 records). [2025-09-14T18:06:21.127301] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-14T18:06:21.127442] [INFO ] [MAIN ] Update Progress: 844/2370 symbols completed. FLO took 29.5s. Estimated remaining: 2h 41m 12s. Rate: 9.5 symbols/min [2025-09-14T18:06:21.301448] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:21.326435] [DEBUG] [LOCAL ] FLUT: Loaded 22737 existing records from primary storage. [2025-09-14T18:06:21.326609] [INFO ] [MAIN ] FLUT: Loaded 22737 existing records. [2025-09-14T18:06:21.364087] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-14T18:06:21.504318] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:21.504543] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-14T18:06:21.504602] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-14T18:06:21.505282] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-14T18:06:21.505345] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-14T18:06:21.856237] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:22.141335] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T18:06:22.158767] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-14T18:06:22.958878] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-14T18:06:23.451696] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T18:06:23.524510] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:06:23.758900] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-14T18:06:24.246678] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T18:06:24.558832] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-14T18:06:25.358799] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-14T18:06:25.494875] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T18:06:25.527734] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T18:06:26.158882] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-14T18:06:26.958836] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-14T18:06:27.353498] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-14T18:06:27.415160] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T18:06:27.758850] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-14T18:06:28.558834] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-14T18:06:28.826865] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:06:29.359454] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-14T18:06:29.362437] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:06:30.158827] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-14T18:06:30.244934] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:06:30.758368] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:06:30.958844] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-14T18:06:31.759638] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-14T18:06:31.762725] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:06:32.558865] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-14T18:06:32.736571] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T18:06:33.358878] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-14T18:06:33.499599] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:06:34.090555] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:06:34.093537] [INFO ] [REMOTE ] FLOC: Full fetch complete (31627 records). [2025-09-14T18:06:34.093634] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-14T18:06:34.166611] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-14T18:06:34.466514] [DEBUG] [VALIDATOR ] FLOC: All expected trading days are present. [2025-09-14T18:06:34.466631] [DEBUG] [VALIDATOR ] FLOC: Primary data validation passed. [2025-09-14T18:06:34.467257] [INFO ] [MAIN ] FLOC: Fetched primary data is valid. [2025-09-14T18:06:34.467401] [DEBUG] [LOCAL ] FLOC: Saving primary data. [2025-09-14T18:06:34.468434] [DEBUG] [LOCAL ] FLOC: Trimmed 31627 records to 20938 (keeping 150 days of data) [2025-09-14T18:06:34.602377] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T18:06:34.652483] [DEBUG] [LOCAL ] FLOC: Primary data saved (20938 records). [2025-09-14T18:06:34.652668] [INFO ] [MAIN ] FLOC: Full history saved. [2025-09-14T18:06:34.652785] [INFO ] [MAIN ] Update Progress: 845/2370 symbols completed. FLOC took 22.7s. Estimated remaining: 2h 41m 19s. Rate: 9.5 symbols/min [2025-09-14T18:06:34.825232] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:34.840392] [DEBUG] [LOCAL ] FLXR: Loaded 9963 existing records from primary storage. [2025-09-14T18:06:34.840598] [INFO ] [MAIN ] FLXR: Loaded 9963 existing records. [2025-09-14T18:06:34.964007] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-14T18:06:35.017246] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:35.017701] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-14T18:06:35.017767] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-14T18:06:35.018244] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-14T18:06:35.018324] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-14T18:06:35.376638] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:35.715552] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:06:35.758848] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-14T18:06:36.558846] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-14T18:06:36.589435] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:06:36.769174] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:06:37.358821] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-14T18:06:37.976211] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:06:38.158819] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-14T18:06:38.958841] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-14T18:06:39.195130] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:06:39.758827] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-14T18:06:39.965972] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:06:40.194168] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T18:06:40.200393] [INFO ] [REMOTE ] FLR: Full fetch complete (57729 records). [2025-09-14T18:06:40.200630] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-14T18:06:40.559973] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-14T18:06:40.652436] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-14T18:06:40.652558] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-14T18:06:40.653622] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-14T18:06:40.653806] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-14T18:06:40.655273] [DEBUG] [LOCAL ] FLR: Trimmed 57729 records to 40081 (keeping 150 days of data) [2025-09-14T18:06:40.785353] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:06:40.969205] [DEBUG] [LOCAL ] FLR: Primary data saved (40081 records). [2025-09-14T18:06:40.969372] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-14T18:06:40.969477] [INFO ] [MAIN ] Update Progress: 846/2370 symbols completed. FLR took 23.3s. Estimated remaining: 2h 41m 12s. Rate: 9.5 symbols/min [2025-09-14T18:06:41.139416] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:41.161494] [DEBUG] [LOCAL ] FMC: Loaded 23010 existing records from primary storage. [2025-09-14T18:06:41.161686] [INFO ] [MAIN ] FMC: Loaded 23010 existing records. [2025-09-14T18:06:41.340828] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:41.341105] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-14T18:06:41.341170] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-14T18:06:41.341846] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-14T18:06:41.341916] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-14T18:06:41.364066] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-14T18:06:41.729127] [INFO ] [REMOTE ] FMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:41.741472] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:06:42.158855] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-14T18:06:42.958911] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-14T18:06:43.190925] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:06:43.763917] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-14T18:06:43.792756] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T18:06:44.558900] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-14T18:06:44.691607] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:06:44.877064] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T18:06:44.963941] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:06:44.969246] [INFO ] [REMOTE ] FLS: Full fetch complete (54230 records). [2025-09-14T18:06:44.969370] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-14T18:06:45.359754] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-14T18:06:45.360017] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-14T18:06:45.360142] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-14T18:06:45.361697] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-14T18:06:45.361764] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-14T18:06:45.363034] [DEBUG] [LOCAL ] FLS: Trimmed 54230 records to 37556 (keeping 150 days of data) [2025-09-14T18:06:45.628752] [DEBUG] [LOCAL ] FLS: Primary data saved (37556 records). [2025-09-14T18:06:45.628978] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-14T18:06:45.629097] [INFO ] [MAIN ] Update Progress: 847/2370 symbols completed. FLS took 27.2s. Estimated remaining: 2h 41m 3s. Rate: 9.5 symbols/min [2025-09-14T18:06:45.798241] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:45.802297] [DEBUG] [LOCAL ] FMN: Loaded 2450 existing records from primary storage. [2025-09-14T18:06:45.802399] [INFO ] [MAIN ] FMN: Loaded 2450 existing records. [2025-09-14T18:06:45.980845] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:45.981127] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-14T18:06:45.981193] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-14T18:06:45.981455] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-14T18:06:45.981516] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-14T18:06:46.164483] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-14T18:06:46.342969] [INFO ] [REMOTE ] FMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:46.935376] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T18:06:46.940859] [INFO ] [REMOTE ] FLUT: Full fetch complete (55446 records). [2025-09-14T18:06:46.941017] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-14T18:06:46.964065] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-14T18:06:47.349025] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T18:06:47.370625] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-14T18:06:47.371460] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-14T18:06:47.372326] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-14T18:06:47.372388] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-14T18:06:47.373676] [DEBUG] [LOCAL ] FLUT: Trimmed 55446 records to 38069 (keeping 150 days of data) [2025-09-14T18:06:47.636486] [DEBUG] [LOCAL ] FLUT: Primary data saved (38069 records). [2025-09-14T18:06:47.636690] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-14T18:06:47.636814] [INFO ] [MAIN ] Update Progress: 848/2370 symbols completed. FLUT took 26.5s. Estimated remaining: 2h 40m 49s. Rate: 9.5 symbols/min [2025-09-14T18:06:47.763900] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-14T18:06:47.815022] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:47.828516] [DEBUG] [LOCAL ] FMS: Loaded 12543 existing records from primary storage. [2025-09-14T18:06:47.828752] [INFO ] [MAIN ] FMS: Loaded 12543 existing records. [2025-09-14T18:06:48.003544] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:48.003866] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-14T18:06:48.003931] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-14T18:06:48.004413] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-14T18:06:48.004473] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-14T18:06:48.355088] [INFO ] [REMOTE ] FMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:48.548517] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T18:06:48.558775] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-14T18:06:48.761057] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T18:06:49.355223] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T18:06:49.360623] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-14T18:06:50.158849] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-14T18:06:50.958815] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-14T18:06:51.275301] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T18:06:51.336595] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:06:51.758892] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-14T18:06:52.236049] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T18:06:52.558863] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-14T18:06:52.668878] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:06:53.358887] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-14T18:06:53.552993] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:06:53.556119] [INFO ] [REMOTE ] FLXR: Full fetch complete (20454 records). [2025-09-14T18:06:53.556242] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-14T18:06:53.939281] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-14T18:06:53.939576] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-14T18:06:53.948374] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-14T18:06:53.948496] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-14T18:06:53.949941] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T18:06:53.955248] [DEBUG] [LOCAL ] FLXR: Trimmed 20454 records to 15326 (keeping 150 days of data) [2025-09-14T18:06:54.058898] [DEBUG] [LOCAL ] FLXR: Primary data saved (15326 records). [2025-09-14T18:06:54.059084] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-14T18:06:54.059203] [INFO ] [MAIN ] Update Progress: 849/2370 symbols completed. FLXR took 19.4s. Estimated remaining: 2h 40m 43s. Rate: 9.5 symbols/min [2025-09-14T18:06:54.163935] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-14T18:06:54.232971] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:54.252559] [DEBUG] [LOCAL ] FMX: Loaded 18660 existing records from primary storage. [2025-09-14T18:06:54.252743] [INFO ] [MAIN ] FMX: Loaded 18660 existing records. [2025-09-14T18:06:54.428365] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:54.428671] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-14T18:06:54.428730] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-14T18:06:54.429290] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-14T18:06:54.429363] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-14T18:06:54.796999] [INFO ] [REMOTE ] FMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:54.958892] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-14T18:06:55.069970] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T18:06:55.758860] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-14T18:06:56.441358] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T18:06:56.558813] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-14T18:06:57.078725] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T18:06:57.358840] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-14T18:06:58.168480] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-14T18:06:58.171263] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:06:58.794124] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T18:06:58.958827] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-14T18:06:59.087475] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:06:59.758842] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-14T18:07:00.135678] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:07:00.558831] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-14T18:07:01.358843] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-14T18:07:01.520492] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:07:02.004860] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T18:07:02.158913] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-14T18:07:02.597717] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T18:07:02.958906] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-14T18:07:03.627134] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:07:03.758792] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-14T18:07:04.558891] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-14T18:07:04.851111] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:07:04.928856] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T18:07:05.291819] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T18:07:05.358875] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-14T18:07:06.158878] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-14T18:07:06.759394] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T18:07:06.958853] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-14T18:07:07.758803] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-14T18:07:07.847511] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:07:08.290591] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T18:07:08.334350] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T18:07:08.558899] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-14T18:07:09.358857] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-14T18:07:10.033408] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:07:10.158811] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-14T18:07:10.834723] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:07:10.958846] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-14T18:07:11.632402] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T18:07:11.637189] [INFO ] [REMOTE ] FMX: Full fetch complete (43878 records). [2025-09-14T18:07:11.637310] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-14T18:07:11.763927] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-14T18:07:12.020581] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-14T18:07:12.020736] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-14T18:07:12.021504] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-14T18:07:12.021570] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-14T18:07:12.022710] [DEBUG] [LOCAL ] FMX: Trimmed 43878 records to 30463 (keeping 150 days of data) [2025-09-14T18:07:12.216355] [DEBUG] [LOCAL ] FMX: Primary data saved (30463 records). [2025-09-14T18:07:12.216558] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-14T18:07:12.216688] [INFO ] [MAIN ] Update Progress: 850/2370 symbols completed. FMX took 18.2s. Estimated remaining: 2h 40m 57s. Rate: 9.4 symbols/min [2025-09-14T18:07:12.384229] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:12.386813] [DEBUG] [LOCAL ] FMY: Loaded 691 existing records from primary storage. [2025-09-14T18:07:12.386909] [INFO ] [MAIN ] FMY: Loaded 691 existing records. [2025-09-14T18:07:12.578545] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:07:12.576921] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-14T18:07:12.583864] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:12.586934] [INFO ] [REMOTE ] FMN: Full fetch complete (6881 records). [2025-09-14T18:07:12.587014] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-14T18:07:12.587209] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-14T18:07:12.587275] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-14T18:07:12.612681] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-14T18:07:12.668695] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-14T18:07:13.239284] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-14T18:07:13.269751] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-14T18:07:13.275891] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-14T18:07:13.296594] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-14T18:07:13.354166] [DEBUG] [LOCAL ] FMN: Trimmed 6881 records to 3943 (keeping 150 days of data) [2025-09-14T18:07:13.358902] [INFO ] [REMOTE ] FMY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:13.359461] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-14T18:07:13.403840] [DEBUG] [LOCAL ] FMN: Primary data saved (3943 records). [2025-09-14T18:07:13.416802] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-14T18:07:13.417562] [INFO ] [MAIN ] Update Progress: 851/2370 symbols completed. FMN took 27.8s. Estimated remaining: 2h 40m 42s. Rate: 9.5 symbols/min [2025-09-14T18:07:13.418808] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-14T18:07:13.598000] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:13.616283] [DEBUG] [LOCAL ] FN: Loaded 17182 existing records from primary storage. [2025-09-14T18:07:13.616455] [INFO ] [MAIN ] FN: Loaded 17182 existing records. [2025-09-14T18:07:13.797608] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:13.797996] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-14T18:07:13.798088] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-14T18:07:13.814140] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-14T18:07:13.814884] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T18:07:13.815022] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-14T18:07:13.925084] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T18:07:14.161820] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-14T18:07:14.189219] [INFO ] [REMOTE ] FN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:14.958907] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-14T18:07:15.378608] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T18:07:15.382304] [INFO ] [REMOTE ] FMS: Full fetch complete (32711 records). [2025-09-14T18:07:15.382408] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-14T18:07:15.474205] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T18:07:15.749244] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-14T18:07:15.749356] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-14T18:07:15.749997] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-14T18:07:15.750051] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-14T18:07:15.750849] [DEBUG] [LOCAL ] FMS: Trimmed 32711 records to 22575 (keeping 150 days of data) [2025-09-14T18:07:15.803072] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-14T18:07:15.896651] [DEBUG] [LOCAL ] FMS: Primary data saved (22575 records). [2025-09-14T18:07:15.896805] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-14T18:07:15.896912] [INFO ] [MAIN ] Update Progress: 852/2370 symbols completed. FMS took 28.3s. Estimated remaining: 2h 40m 29s. Rate: 9.5 symbols/min [2025-09-14T18:07:16.067391] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:16.091253] [DEBUG] [LOCAL ] FNB: Loaded 23671 existing records from primary storage. [2025-09-14T18:07:16.091631] [INFO ] [MAIN ] FNB: Loaded 23671 existing records. [2025-09-14T18:07:16.252386] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T18:07:16.272256] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:16.273772] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-14T18:07:16.273846] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-14T18:07:16.274555] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-14T18:07:16.274624] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-14T18:07:16.564117] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-14T18:07:16.639997] [INFO ] [REMOTE ] FNB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:17.322008] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:07:17.327755] [INFO ] [REMOTE ] FMC: Full fetch complete (56509 records). [2025-09-14T18:07:17.327968] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-14T18:07:17.364053] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-14T18:07:17.712307] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-14T18:07:17.712439] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-14T18:07:17.713587] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-14T18:07:17.713690] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-14T18:07:17.715142] [DEBUG] [LOCAL ] FMC: Trimmed 56509 records to 38798 (keeping 150 days of data) [2025-09-14T18:07:17.979749] [DEBUG] [LOCAL ] FMC: Primary data saved (38798 records). [2025-09-14T18:07:17.979996] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-14T18:07:17.980136] [INFO ] [MAIN ] Update Progress: 853/2370 symbols completed. FMC took 37.0s. Estimated remaining: 2h 40m 15s. Rate: 9.5 symbols/min [2025-09-14T18:07:18.158558] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:18.159342] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-14T18:07:18.184367] [DEBUG] [LOCAL ] FND: Loaded 23234 existing records from primary storage. [2025-09-14T18:07:18.184598] [INFO ] [MAIN ] FND: Loaded 23234 existing records. [2025-09-14T18:07:18.365803] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:18.366088] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-14T18:07:18.366152] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-14T18:07:18.366749] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-14T18:07:18.366811] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-14T18:07:18.714409] [INFO ] [REMOTE ] FND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:18.940090] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:07:18.958843] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-14T18:07:19.721896] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:07:19.758785] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-14T18:07:20.158008] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T18:07:20.558801] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-14T18:07:20.646891] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T18:07:20.929386] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-14T18:07:21.358893] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-14T18:07:22.158882] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-14T18:07:22.867533] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:07:22.958787] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-14T18:07:23.622941] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T18:07:23.758871] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-14T18:07:24.164763] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T18:07:24.535790] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:07:24.558819] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-14T18:07:25.150987] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T18:07:25.358862] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-14T18:07:26.158832] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-14T18:07:26.958900] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-14T18:07:27.216933] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:07:27.758879] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-14T18:07:28.051630] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:07:28.558833] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-14T18:07:28.715547] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T18:07:28.917855] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T18:07:28.918733] [INFO ] [REMOTE ] FMY: Full fetch complete (1509 records). [2025-09-14T18:07:28.918828] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-14T18:07:29.276365] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-14T18:07:29.276519] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-14T18:07:29.276692] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-14T18:07:29.276780] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-14T18:07:29.277166] [DEBUG] [LOCAL ] FMY: Trimmed 1509 records to 1043 (keeping 150 days of data) [2025-09-14T18:07:29.284240] [DEBUG] [LOCAL ] FMY: Primary data saved (1043 records). [2025-09-14T18:07:29.284334] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-14T18:07:29.284466] [INFO ] [MAIN ] Update Progress: 854/2370 symbols completed. FMY took 17.1s. Estimated remaining: 2h 40m 17s. Rate: 9.5 symbols/min [2025-09-14T18:07:29.363901] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-14T18:07:29.454130] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:29.475236] [DEBUG] [LOCAL ] FNF: Loaded 21988 existing records from primary storage. [2025-09-14T18:07:29.475412] [INFO ] [MAIN ] FNF: Loaded 21988 existing records. [2025-09-14T18:07:29.681836] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:29.682268] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-14T18:07:29.682372] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-14T18:07:29.683048] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-14T18:07:29.683126] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-14T18:07:29.818703] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:07:30.083035] [INFO ] [REMOTE ] FNF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:30.158781] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-14T18:07:30.860908] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:07:30.958844] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-14T18:07:31.758879] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-14T18:07:31.880631] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:07:32.120322] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:07:32.558828] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-14T18:07:33.358868] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-14T18:07:33.701809] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:07:34.158859] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-14T18:07:34.317912] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T18:07:34.937355] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:07:34.958794] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-14T18:07:35.758911] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-14T18:07:36.097561] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T18:07:36.465771] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:07:36.558884] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-14T18:07:36.873383] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T18:07:36.877616] [INFO ] [REMOTE ] FN: Full fetch complete (43521 records). [2025-09-14T18:07:36.877753] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-14T18:07:37.248302] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-14T18:07:37.248434] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-14T18:07:37.249232] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-14T18:07:37.249300] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-14T18:07:37.250512] [DEBUG] [LOCAL ] FN: Trimmed 43521 records to 28785 (keeping 150 days of data) [2025-09-14T18:07:37.359386] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-14T18:07:37.439900] [DEBUG] [LOCAL ] FN: Primary data saved (28785 records). [2025-09-14T18:07:37.440116] [INFO ] [MAIN ] FN: Full history saved. [2025-09-14T18:07:37.440280] [INFO ] [MAIN ] Update Progress: 855/2370 symbols completed. FN took 24.0s. Estimated remaining: 2h 40m 14s. Rate: 9.5 symbols/min [2025-09-14T18:07:37.625031] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:37.658782] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T18:07:37.683829] [DEBUG] [LOCAL ] FNV: Loaded 19924 existing records from primary storage. [2025-09-14T18:07:37.684023] [INFO ] [MAIN ] FNV: Loaded 19924 existing records. [2025-09-14T18:07:37.860056] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:37.860350] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-14T18:07:37.860412] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-14T18:07:37.861058] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-14T18:07:37.861128] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-14T18:07:38.164022] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-14T18:07:38.220335] [INFO ] [REMOTE ] FNV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:38.958811] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-14T18:07:39.033883] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:07:39.758830] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-14T18:07:40.052706] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:07:40.558830] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-14T18:07:40.785669] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:07:41.358876] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-14T18:07:41.601875] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T18:07:41.684387] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:07:41.690133] [INFO ] [REMOTE ] FNB: Full fetch complete (56923 records). [2025-09-14T18:07:41.690313] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-14T18:07:42.100837] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-14T18:07:42.101086] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-14T18:07:42.102166] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-14T18:07:42.102300] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-14T18:07:42.103814] [DEBUG] [LOCAL ] FNB: Trimmed 56923 records to 39382 (keeping 150 days of data) [2025-09-14T18:07:42.172503] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-14T18:07:42.227260] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:07:42.432633] [DEBUG] [LOCAL ] FNB: Primary data saved (39382 records). [2025-09-14T18:07:42.432901] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-14T18:07:42.433034] [INFO ] [MAIN ] Update Progress: 856/2370 symbols completed. FNB took 26.5s. Estimated remaining: 2h 40m 5s. Rate: 9.5 symbols/min [2025-09-14T18:07:42.610183] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:42.618750] [DEBUG] [LOCAL ] FOA: Loaded 5829 existing records from primary storage. [2025-09-14T18:07:42.618934] [INFO ] [MAIN ] FOA: Loaded 5829 existing records. [2025-09-14T18:07:42.803404] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:42.803800] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-14T18:07:42.803869] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-14T18:07:42.804255] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-14T18:07:42.804321] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-14T18:07:42.964162] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-14T18:07:43.181472] [INFO ] [REMOTE ] FOA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:43.758850] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-14T18:07:44.044384] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:07:44.558905] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-14T18:07:44.951023] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T18:07:45.358870] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-14T18:07:45.630437] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:07:45.651303] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T18:07:46.034983] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:07:46.040672] [INFO ] [REMOTE ] FND: Full fetch complete (56677 records). [2025-09-14T18:07:46.040848] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-14T18:07:46.163947] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-14T18:07:46.432846] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-14T18:07:46.432981] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-14T18:07:46.433954] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-14T18:07:46.434035] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-14T18:07:46.435494] [DEBUG] [LOCAL ] FND: Trimmed 56677 records to 39229 (keeping 150 days of data) [2025-09-14T18:07:46.666723] [DEBUG] [LOCAL ] FND: Primary data saved (39229 records). [2025-09-14T18:07:46.666907] [INFO ] [MAIN ] FND: Full history saved. [2025-09-14T18:07:46.667054] [INFO ] [MAIN ] Update Progress: 857/2370 symbols completed. FND took 28.7s. Estimated remaining: 2h 39m 55s. Rate: 9.5 symbols/min [2025-09-14T18:07:46.838075] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:46.843724] [DEBUG] [LOCAL ] FOF: Loaded 3470 existing records from primary storage. [2025-09-14T18:07:46.843845] [INFO ] [MAIN ] FOF: Loaded 3470 existing records. [2025-09-14T18:07:46.964016] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-14T18:07:47.026789] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:47.027083] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-14T18:07:47.027147] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-14T18:07:47.027399] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-14T18:07:47.027458] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-14T18:07:47.397854] [INFO ] [REMOTE ] FOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:47.410871] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T18:07:47.758837] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-14T18:07:48.558916] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-14T18:07:48.776815] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T18:07:48.895457] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:07:49.358888] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-14T18:07:49.419129] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:07:50.158830] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-14T18:07:50.329007] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T18:07:50.958924] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-14T18:07:51.758802] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-14T18:07:51.799588] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:07:51.820783] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:07:52.489987] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T18:07:52.558834] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-14T18:07:53.186303] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T18:07:53.358833] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-14T18:07:54.158851] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-14T18:07:54.185200] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:07:54.958854] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-14T18:07:54.968134] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T18:07:55.753162] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T18:07:55.758778] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-14T18:07:56.558827] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-14T18:07:57.339317] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T18:07:57.358787] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-14T18:07:57.619045] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:07:58.158812] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-14T18:07:58.274016] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T18:07:58.277339] [INFO ] [REMOTE ] FOA: Full fetch complete (14734 records). [2025-09-14T18:07:58.277518] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-14T18:07:58.643362] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-14T18:07:58.643519] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-14T18:07:58.643949] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-14T18:07:58.644015] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-14T18:07:58.644597] [DEBUG] [LOCAL ] FOA: Trimmed 14734 records to 9277 (keeping 150 days of data) [2025-09-14T18:07:58.701508] [DEBUG] [LOCAL ] FOA: Primary data saved (9277 records). [2025-09-14T18:07:58.701691] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-14T18:07:58.701812] [INFO ] [MAIN ] Update Progress: 858/2370 symbols completed. FOA took 16.3s. Estimated remaining: 2h 39m 59s. Rate: 9.5 symbols/min [2025-09-14T18:07:58.871523] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:58.883863] [DEBUG] [LOCAL ] FOR: Loaded 8200 existing records from primary storage. [2025-09-14T18:07:58.884031] [INFO ] [MAIN ] FOR: Loaded 8200 existing records. [2025-09-14T18:07:58.964054] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-14T18:07:59.078828] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:59.079332] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-14T18:07:59.085728] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-14T18:07:59.086630] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T18:07:59.089259] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-14T18:07:59.089659] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-14T18:07:59.461594] [INFO ] [REMOTE ] FOR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:59.758863] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-14T18:08:00.558829] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-14T18:08:00.786365] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:08:00.823454] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T18:08:01.226740] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T18:08:01.358882] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-14T18:08:02.008572] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:08:02.010044] [INFO ] [REMOTE ] FOF: Full fetch complete (8716 records). [2025-09-14T18:08:02.010165] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-14T18:08:02.163984] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-14T18:08:02.381194] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-14T18:08:02.381314] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-14T18:08:02.381616] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-14T18:08:02.381731] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-14T18:08:02.382229] [DEBUG] [LOCAL ] FOF: Trimmed 8716 records to 5849 (keeping 150 days of data) [2025-09-14T18:08:02.420085] [DEBUG] [LOCAL ] FOF: Primary data saved (5849 records). [2025-09-14T18:08:02.420263] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-14T18:08:02.420436] [INFO ] [MAIN ] Update Progress: 859/2370 symbols completed. FOF took 15.8s. Estimated remaining: 2h 39m 48s. Rate: 9.5 symbols/min [2025-09-14T18:08:02.596411] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:02.624340] [DEBUG] [LOCAL ] FOUR: Loaded 21959 existing records from primary storage. [2025-09-14T18:08:02.624538] [INFO ] [MAIN ] FOUR: Loaded 21959 existing records. [2025-09-14T18:08:02.810817] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:02.811179] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-14T18:08:02.811247] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-14T18:08:02.811878] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-14T18:08:02.811946] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-14T18:08:02.963972] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-14T18:08:03.180264] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:03.412089] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T18:08:03.678529] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:08:03.685090] [INFO ] [REMOTE ] FNF: Full fetch complete (53488 records). [2025-09-14T18:08:03.685229] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-14T18:08:03.763901] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-14T18:08:04.074846] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-14T18:08:04.074964] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-14T18:08:04.075869] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-14T18:08:04.075933] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-14T18:08:04.077155] [DEBUG] [LOCAL ] FNF: Trimmed 53488 records to 36881 (keeping 150 days of data) [2025-09-14T18:08:04.317371] [DEBUG] [LOCAL ] FNF: Primary data saved (36881 records). [2025-09-14T18:08:04.317560] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-14T18:08:04.317902] [INFO ] [MAIN ] Update Progress: 860/2370 symbols completed. FNF took 35.0s. Estimated remaining: 2h 39m 34s. Rate: 9.5 symbols/min [2025-09-14T18:08:04.495117] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:04.505069] [DEBUG] [LOCAL ] FPF: Loaded 8181 existing records from primary storage. [2025-09-14T18:08:04.505237] [INFO ] [MAIN ] FPF: Loaded 8181 existing records. [2025-09-14T18:08:04.567403] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-14T18:08:04.689554] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:04.689855] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-14T18:08:04.689919] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-14T18:08:04.690309] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-14T18:08:04.690368] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-14T18:08:05.037134] [INFO ] [REMOTE ] FPF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:05.358908] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-14T18:08:05.715339] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T18:08:05.951198] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:08:06.061736] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T18:08:06.158834] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-14T18:08:06.958820] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-14T18:08:07.337988] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:08:07.758841] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-14T18:08:08.097056] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:08:08.558869] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-14T18:08:09.358808] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-14T18:08:09.430023] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:08:09.484895] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:08:10.158833] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-14T18:08:10.958911] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-14T18:08:11.203655] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T18:08:11.226287] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T18:08:11.758883] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-14T18:08:11.843912] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:08:12.558882] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-14T18:08:12.938322] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:08:13.358892] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-14T18:08:14.158852] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-14T18:08:14.384994] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:08:14.509354] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:08:14.958901] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-14T18:08:15.101925] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T18:08:15.104284] [INFO ] [REMOTE ] FOR: Full fetch complete (22368 records). [2025-09-14T18:08:15.104383] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-14T18:08:15.477211] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-14T18:08:15.477360] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-14T18:08:15.477946] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-14T18:08:15.478007] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-14T18:08:15.478794] [DEBUG] [LOCAL ] FOR: Trimmed 22368 records to 14946 (keeping 150 days of data) [2025-09-14T18:08:15.571261] [DEBUG] [LOCAL ] FOR: Primary data saved (14946 records). [2025-09-14T18:08:15.571454] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-14T18:08:15.571558] [INFO ] [MAIN ] Update Progress: 861/2370 symbols completed. FOR took 16.9s. Estimated remaining: 2h 39m 36s. Rate: 9.5 symbols/min [2025-09-14T18:08:15.749899] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:15.760786] [DEBUG] [LOCAL ] FPH: Loaded 9084 existing records from primary storage. [2025-09-14T18:08:15.760431] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-14T18:08:15.761129] [INFO ] [MAIN ] FPH: Loaded 9084 existing records. [2025-09-14T18:08:15.944116] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:15.944358] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-14T18:08:15.944435] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-14T18:08:15.944807] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-14T18:08:15.944868] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-14T18:08:16.341491] [INFO ] [REMOTE ] FPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:16.558886] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-14T18:08:16.740422] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T18:08:16.958245] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:08:17.358873] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-14T18:08:17.567441] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T18:08:18.158838] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-14T18:08:18.721593] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T18:08:18.726401] [INFO ] [REMOTE ] FNV: Full fetch complete (50331 records). [2025-09-14T18:08:18.726528] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-14T18:08:18.968085] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-14T18:08:19.145209] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-14T18:08:19.145327] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-14T18:08:19.146210] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-14T18:08:19.146275] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-14T18:08:19.147920] [DEBUG] [LOCAL ] FNV: Trimmed 50331 records to 34341 (keeping 150 days of data) [2025-09-14T18:08:19.297262] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:08:19.404299] [DEBUG] [LOCAL ] FNV: Primary data saved (34341 records). [2025-09-14T18:08:19.404509] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-14T18:08:19.404631] [INFO ] [MAIN ] Update Progress: 862/2370 symbols completed. FNV took 42.0s. Estimated remaining: 2h 39m 25s. Rate: 9.5 symbols/min [2025-09-14T18:08:19.580514] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:19.596310] [DEBUG] [LOCAL ] FPI: Loaded 13743 existing records from primary storage. [2025-09-14T18:08:19.596502] [INFO ] [MAIN ] FPI: Loaded 13743 existing records. [2025-09-14T18:08:19.760420] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-14T18:08:19.781943] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:19.782218] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-14T18:08:19.782279] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-14T18:08:19.782793] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-14T18:08:19.782866] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-14T18:08:20.138029] [INFO ] [REMOTE ] FPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:20.149920] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T18:08:20.558885] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-14T18:08:21.358878] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-14T18:08:21.629769] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T18:08:21.671997] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:08:22.073633] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T18:08:22.158834] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-14T18:08:22.958862] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-14T18:08:23.758839] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-14T18:08:24.033087] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T18:08:24.067340] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T18:08:24.558852] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-14T18:08:24.901675] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:08:25.358878] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-14T18:08:25.493036] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T18:08:25.495134] [INFO ] [REMOTE ] FPF: Full fetch complete (18985 records). [2025-09-14T18:08:25.495235] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-14T18:08:25.866400] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-14T18:08:25.866526] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-14T18:08:25.867005] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-14T18:08:25.867064] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-14T18:08:25.867669] [DEBUG] [LOCAL ] FPF: Trimmed 18985 records to 13063 (keeping 150 days of data) [2025-09-14T18:08:25.951968] [DEBUG] [LOCAL ] FPF: Primary data saved (13063 records). [2025-09-14T18:08:25.952158] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-14T18:08:25.952270] [INFO ] [MAIN ] Update Progress: 863/2370 symbols completed. FPF took 21.6s. Estimated remaining: 2h 39m 19s. Rate: 9.5 symbols/min [2025-09-14T18:08:26.130581] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:26.142170] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T18:08:26.164223] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-14T18:08:26.166725] [DEBUG] [LOCAL ] FR: Loaded 20639 existing records from primary storage. [2025-09-14T18:08:26.166900] [INFO ] [MAIN ] FR: Loaded 20639 existing records. [2025-09-14T18:08:26.346949] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:26.347211] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-14T18:08:26.347289] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-14T18:08:26.347973] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-14T18:08:26.348035] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-14T18:08:26.722618] [INFO ] [REMOTE ] FR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:26.958848] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-14T18:08:27.310785] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T18:08:27.758888] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-14T18:08:28.558923] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-14T18:08:28.769589] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:08:29.305620] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:08:29.358933] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-14T18:08:29.518921] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T18:08:30.158849] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-14T18:08:30.450730] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T18:08:30.958882] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-14T18:08:31.624371] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:08:31.758865] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-14T18:08:32.558894] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-14T18:08:32.592004] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T18:08:33.363733] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-14T18:08:33.368871] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:08:33.717428] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:08:33.961179] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:08:33.963711] [INFO ] [REMOTE ] FPH: Full fetch complete (22296 records). [2025-09-14T18:08:33.963802] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-14T18:08:34.165133] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-14T18:08:34.345270] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-14T18:08:34.345382] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-14T18:08:34.345924] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-14T18:08:34.345985] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-14T18:08:34.346587] [DEBUG] [LOCAL ] FPH: Trimmed 22296 records to 14659 (keeping 150 days of data) [2025-09-14T18:08:34.429117] [DEBUG] [LOCAL ] FPH: Primary data saved (14659 records). [2025-09-14T18:08:34.429298] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-14T18:08:34.429397] [INFO ] [MAIN ] Update Progress: 864/2370 symbols completed. FPH took 18.9s. Estimated remaining: 2h 39m 17s. Rate: 9.5 symbols/min [2025-09-14T18:08:34.595523] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:34.603199] [DEBUG] [LOCAL ] FRA: Loaded 6196 existing records from primary storage. [2025-09-14T18:08:34.603346] [INFO ] [MAIN ] FRA: Loaded 6196 existing records. [2025-09-14T18:08:34.776403] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:34.776688] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-14T18:08:34.776749] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-14T18:08:34.777150] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-14T18:08:34.777210] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-14T18:08:34.966062] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-14T18:08:35.145560] [INFO ] [REMOTE ] FRA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:35.758848] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-14T18:08:35.890515] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T18:08:36.558845] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-14T18:08:36.985021] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T18:08:37.167050] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:08:37.358824] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-14T18:08:38.158822] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-14T18:08:38.187350] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T18:08:38.540741] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T18:08:38.958894] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-14T18:08:39.017384] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:08:39.758837] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-14T18:08:40.504610] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:08:40.558840] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-14T18:08:41.358890] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-14T18:08:41.695778] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T18:08:42.067312] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T18:08:42.098005] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T18:08:42.158807] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-14T18:08:42.958849] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-14T18:08:43.234550] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:08:43.743341] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:08:43.748625] [INFO ] [REMOTE ] FOUR: Full fetch complete (54043 records). [2025-09-14T18:08:43.748779] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-14T18:08:43.763989] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-14T18:08:44.134951] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-14T18:08:44.135058] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-14T18:08:44.135886] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-14T18:08:44.135947] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-14T18:08:44.137138] [DEBUG] [LOCAL ] FOUR: Trimmed 54043 records to 36977 (keeping 150 days of data) [2025-09-14T18:08:44.383654] [DEBUG] [LOCAL ] FOUR: Primary data saved (36977 records). [2025-09-14T18:08:44.383858] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-14T18:08:44.383987] [INFO ] [MAIN ] Update Progress: 865/2370 symbols completed. FOUR took 42.0s. Estimated remaining: 2h 39m 17s. Rate: 9.4 symbols/min [2025-09-14T18:08:44.568528] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-14T18:08:44.572189] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:44.584624] [DEBUG] [LOCAL ] FRGE: Loaded 6445 existing records from primary storage. [2025-09-14T18:08:44.585227] [INFO ] [MAIN ] FRGE: Loaded 6445 existing records. [2025-09-14T18:08:44.767395] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:44.767689] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-14T18:08:44.767753] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-14T18:08:44.768131] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-14T18:08:44.768192] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-14T18:08:44.934756] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T18:08:45.131611] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:45.358835] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-14T18:08:45.836918] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T18:08:46.158840] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-14T18:08:46.798317] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T18:08:46.847890] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T18:08:46.958827] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-14T18:08:47.758830] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-14T18:08:47.930505] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T18:08:48.558790] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-14T18:08:48.865544] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T18:08:48.869040] [INFO ] [REMOTE ] FPI: Full fetch complete (33787 records). [2025-09-14T18:08:48.869197] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-14T18:08:49.263564] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-14T18:08:49.264662] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-14T18:08:49.265850] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-14T18:08:49.265923] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-14T18:08:49.267312] [DEBUG] [LOCAL ] FPI: Trimmed 33787 records to 23691 (keeping 150 days of data) [2025-09-14T18:08:49.361495] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-14T18:08:49.431618] [DEBUG] [LOCAL ] FPI: Primary data saved (23691 records). [2025-09-14T18:08:49.431881] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-14T18:08:49.432034] [INFO ] [MAIN ] Update Progress: 866/2370 symbols completed. FPI took 30.0s. Estimated remaining: 2h 39m 8s. Rate: 9.5 symbols/min [2025-09-14T18:08:49.619948] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:49.646207] [DEBUG] [LOCAL ] FRO: Loaded 23166 existing records from primary storage. [2025-09-14T18:08:49.646453] [INFO ] [MAIN ] FRO: Loaded 23166 existing records. [2025-09-14T18:08:49.835833] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:49.836375] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-14T18:08:49.836527] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-14T18:08:49.843406] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-14T18:08:49.854492] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-14T18:08:49.888020] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T18:08:50.163918] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-14T18:08:50.222464] [INFO ] [REMOTE ] FRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:50.231828] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T18:08:50.958848] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-14T18:08:51.547670] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:08:51.758835] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-14T18:08:52.448530] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:08:52.558843] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-14T18:08:52.808625] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T18:08:53.358825] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-14T18:08:54.158819] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-14T18:08:54.249025] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:08:54.288723] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:08:54.958818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-14T18:08:54.970237] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:08:54.972213] [INFO ] [REMOTE ] FRA: Full fetch complete (16426 records). [2025-09-14T18:08:54.972301] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-14T18:08:55.326815] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-14T18:08:55.326936] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-14T18:08:55.327382] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-14T18:08:55.327432] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-14T18:08:55.328000] [DEBUG] [LOCAL ] FRA: Trimmed 16426 records to 10144 (keeping 150 days of data) [2025-09-14T18:08:55.395470] [DEBUG] [LOCAL ] FRA: Primary data saved (10144 records). [2025-09-14T18:08:55.395765] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-14T18:08:55.395892] [INFO ] [MAIN ] Update Progress: 867/2370 symbols completed. FRA took 21.0s. Estimated remaining: 2h 39m 1s. Rate: 9.5 symbols/min [2025-09-14T18:08:55.567522] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:55.588839] [DEBUG] [LOCAL ] FRT: Loaded 18749 existing records from primary storage. [2025-09-14T18:08:55.589057] [INFO ] [MAIN ] FRT: Loaded 18749 existing records. [2025-09-14T18:08:55.764421] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-14T18:08:55.770034] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:55.771303] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-14T18:08:55.771396] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-14T18:08:55.772000] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-14T18:08:55.772070] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-14T18:08:56.132323] [INFO ] [REMOTE ] FRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:56.559009] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-14T18:08:56.963956] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T18:08:57.060486] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T18:08:57.358826] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-14T18:08:57.857361] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T18:08:58.158854] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-14T18:08:58.958804] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-14T18:08:59.130945] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:08:59.453104] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T18:08:59.604779] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:08:59.609840] [INFO ] [REMOTE ] FR: Full fetch complete (50759 records). [2025-09-14T18:08:59.609984] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-14T18:08:59.765577] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-14T18:09:00.005142] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-14T18:09:00.005293] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-14T18:09:00.006549] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-14T18:09:00.006626] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-14T18:09:00.008311] [DEBUG] [LOCAL ] FR: Trimmed 50759 records to 35051 (keeping 150 days of data) [2025-09-14T18:09:00.263567] [DEBUG] [LOCAL ] FR: Primary data saved (35051 records). [2025-09-14T18:09:00.263897] [INFO ] [MAIN ] FR: Full history saved. [2025-09-14T18:09:00.264084] [INFO ] [MAIN ] Update Progress: 868/2370 symbols completed. FR took 34.3s. Estimated remaining: 2h 38m 52s. Rate: 9.5 symbols/min [2025-09-14T18:09:00.448969] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:00.468591] [DEBUG] [LOCAL ] FSCO: Loaded 16756 existing records from primary storage. [2025-09-14T18:09:00.468868] [INFO ] [MAIN ] FSCO: Loaded 16756 existing records. [2025-09-14T18:09:00.566572] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-14T18:09:00.665051] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:00.665460] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-14T18:09:00.665548] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-14T18:09:00.666064] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-14T18:09:00.666133] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-14T18:09:01.046130] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:01.358849] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-14T18:09:01.410426] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T18:09:01.707137] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-14T18:09:01.709072] [INFO ] [REMOTE ] FRGE: Full fetch complete (22251 records). [2025-09-14T18:09:01.709168] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-14T18:09:02.090566] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-14T18:09:02.090710] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-14T18:09:02.091542] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-14T18:09:02.091673] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-14T18:09:02.092459] [DEBUG] [LOCAL ] FRGE: Trimmed 22251 records to 11995 (keeping 150 days of data) [2025-09-14T18:09:02.161105] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-14T18:09:02.172856] [DEBUG] [LOCAL ] FRGE: Primary data saved (11995 records). [2025-09-14T18:09:02.173013] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-14T18:09:02.173119] [INFO ] [MAIN ] Update Progress: 869/2370 symbols completed. FRGE took 17.8s. Estimated remaining: 2h 38m 38s. Rate: 9.5 symbols/min [2025-09-14T18:09:02.368896] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:02.398368] [DEBUG] [LOCAL ] FSK: Loaded 21955 existing records from primary storage. [2025-09-14T18:09:02.398623] [INFO ] [MAIN ] FSK: Loaded 21955 existing records. [2025-09-14T18:09:02.574406] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:02.574746] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-14T18:09:02.574829] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-14T18:09:02.575459] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-14T18:09:02.575547] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-14T18:09:02.926437] [INFO ] [REMOTE ] FSK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:02.958778] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-14T18:09:03.168154] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T18:09:03.758827] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-14T18:09:04.558861] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-14T18:09:05.281711] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:09:05.358857] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-14T18:09:05.437599] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-09-14T18:09:05.640745] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-14T18:09:06.158887] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-14T18:09:06.332264] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:09:06.847483] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T18:09:06.958870] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-14T18:09:07.758862] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-14T18:09:07.922457] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T18:09:08.558894] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-14T18:09:08.609451] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T18:09:09.358920] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-14T18:09:09.709899] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T18:09:10.158894] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-14T18:09:10.313114] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:09:10.573525] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:09:10.958886] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-14T18:09:11.759013] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-14T18:09:12.266572] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-14T18:09:12.558952] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-14T18:09:12.618786] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T18:09:13.256056] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T18:09:13.358825] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-14T18:09:14.158855] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-14T18:09:14.273860] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:09:14.922561] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:09:14.958785] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-14T18:09:15.758872] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-14T18:09:16.130117] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-14T18:09:16.135441] [INFO ] [REMOTE ] FRO: Full fetch complete (56503 records). [2025-09-14T18:09:16.135602] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-14T18:09:16.529235] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-14T18:09:16.529358] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-14T18:09:16.530187] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-14T18:09:16.530249] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-14T18:09:16.531474] [DEBUG] [LOCAL ] FRO: Trimmed 56503 records to 38882 (keeping 150 days of data) [2025-09-14T18:09:16.590995] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-14T18:09:16.655842] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T18:09:16.663206] [INFO ] [REMOTE ] FSCO: Full fetch complete (39912 records). [2025-09-14T18:09:16.664490] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-14T18:09:17.150199] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-14T18:09:17.150315] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-14T18:09:17.151027] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-14T18:09:17.151104] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-14T18:09:17.153204] [DEBUG] [LOCAL ] FSCO: Trimmed 39912 records to 27469 (keeping 150 days of data) [2025-09-14T18:09:17.329284] [DEBUG] [LOCAL ] FSCO: Primary data saved (27469 records). [2025-09-14T18:09:17.333852] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-14T18:09:17.334020] [INFO ] [MAIN ] Update Progress: 870/2370 symbols completed. FSCO took 17.1s. Estimated remaining: 2h 38m 47s. Rate: 9.4 symbols/min [2025-09-14T18:09:17.443143] [DEBUG] [LOCAL ] FRO: Primary data saved (38882 records). [2025-09-14T18:09:17.445620] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-14T18:09:17.451422] [INFO ] [MAIN ] Update Progress: 871/2370 symbols completed. FRO took 28.0s. Estimated remaining: 2h 38m 30s. Rate: 9.5 symbols/min [2025-09-14T18:09:17.627417] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:17.699913] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:17.718364] [DEBUG] [LOCAL ] FSLY: Loaded 23041 existing records from primary storage. [2025-09-14T18:09:17.718556] [INFO ] [MAIN ] FSLY: Loaded 23041 existing records. [2025-09-14T18:09:17.834524] [DEBUG] [LOCAL ] FSM: Loaded 23865 existing records from primary storage. [2025-09-14T18:09:17.845543] [INFO ] [MAIN ] FSM: Loaded 23865 existing records. [2025-09-14T18:09:17.990519] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:18.019053] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-14T18:09:18.019546] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-14T18:09:18.045658] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-14T18:09:18.065492] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-14T18:09:18.130375] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:18.228204] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-14T18:09:18.231554] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-14T18:09:18.272249] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-14T18:09:18.290690] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-14T18:09:18.473178] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-14T18:09:18.547615] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-14T18:09:18.713077] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:18.786139] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-14T18:09:18.896188] [INFO ] [REMOTE ] FSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:18.926612] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-14T18:09:18.958782] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-14T18:09:19.758849] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-14T18:09:20.311516] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:09:20.512118] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:09:20.558876] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-14T18:09:20.707943] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:09:21.133319] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:09:21.358932] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-14T18:09:22.158842] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-14T18:09:22.554900] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T18:09:22.966360] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-14T18:09:22.989257] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:09:23.758900] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-14T18:09:23.988387] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:09:24.558839] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-14T18:09:24.792551] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:09:25.358938] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-14T18:09:25.869397] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:09:26.024537] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:09:26.030462] [INFO ] [REMOTE ] FRT: Full fetch complete (46028 records). [2025-09-14T18:09:26.030630] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-14T18:09:26.163941] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-14T18:09:26.417739] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-14T18:09:26.417879] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-14T18:09:26.418637] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-14T18:09:26.418727] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-14T18:09:26.419996] [DEBUG] [LOCAL ] FRT: Trimmed 46028 records to 31420 (keeping 150 days of data) [2025-09-14T18:09:26.573410] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T18:09:26.659259] [DEBUG] [LOCAL ] FRT: Primary data saved (31420 records). [2025-09-14T18:09:26.659479] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-14T18:09:26.659614] [INFO ] [MAIN ] Update Progress: 872/2370 symbols completed. FRT took 31.3s. Estimated remaining: 2h 38m 28s. Rate: 9.5 symbols/min [2025-09-14T18:09:26.828936] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:26.844859] [DEBUG] [LOCAL ] FSS: Loaded 14618 existing records from primary storage. [2025-09-14T18:09:26.845027] [INFO ] [MAIN ] FSS: Loaded 14618 existing records. [2025-09-14T18:09:26.963945] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-14T18:09:27.021882] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:27.022096] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-14T18:09:27.022154] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-14T18:09:27.022696] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-14T18:09:27.022757] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-14T18:09:27.392050] [INFO ] [REMOTE ] FSS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:27.758844] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-14T18:09:27.992596] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T18:09:28.481262] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T18:09:28.487914] [INFO ] [REMOTE ] FSK: Full fetch complete (53552 records). [2025-09-14T18:09:28.488135] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-14T18:09:28.564058] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-14T18:09:28.875818] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-14T18:09:28.875933] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-14T18:09:28.876809] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-14T18:09:28.876866] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-14T18:09:28.877947] [DEBUG] [LOCAL ] FSK: Trimmed 53552 records to 36388 (keeping 150 days of data) [2025-09-14T18:09:28.993920] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:09:29.157349] [DEBUG] [LOCAL ] FSK: Primary data saved (36388 records). [2025-09-14T18:09:29.157603] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-14T18:09:29.157817] [INFO ] [MAIN ] Update Progress: 873/2370 symbols completed. FSK took 27.0s. Estimated remaining: 2h 38m 16s. Rate: 9.5 symbols/min [2025-09-14T18:09:29.334355] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:29.339675] [DEBUG] [LOCAL ] FT: Loaded 2867 existing records from primary storage. [2025-09-14T18:09:29.339814] [INFO ] [MAIN ] FT: Loaded 2867 existing records. [2025-09-14T18:09:29.369977] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-14T18:09:29.516679] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:29.516943] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-14T18:09:29.517013] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-14T18:09:29.517274] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-14T18:09:29.517342] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-14T18:09:29.903668] [INFO ] [REMOTE ] FT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:30.158898] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-14T18:09:30.684168] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T18:09:30.821318] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T18:09:30.958853] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-14T18:09:31.579868] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T18:09:31.758840] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-14T18:09:31.959062] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-14T18:09:32.525458] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-14T18:09:32.558774] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-14T18:09:33.348883] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:09:33.358765] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-14T18:09:33.955346] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-14T18:09:34.158827] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-14T18:09:34.963126] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-14T18:09:34.965073] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T18:09:35.758883] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-14T18:09:36.374387] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T18:09:36.558852] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-14T18:09:37.358841] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-14T18:09:37.624735] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T18:09:38.163963] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-14T18:09:38.171955] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:09:38.176714] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T18:09:38.958829] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-14T18:09:39.549014] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:09:39.550372] [INFO ] [REMOTE ] FT: Full fetch complete (6669 records). [2025-09-14T18:09:39.550470] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-14T18:09:39.767871] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-14T18:09:39.927527] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-14T18:09:39.927754] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-14T18:09:39.927970] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-14T18:09:39.928027] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-14T18:09:39.928609] [DEBUG] [LOCAL ] FT: Trimmed 6669 records to 4756 (keeping 150 days of data) [2025-09-14T18:09:39.957014] [DEBUG] [LOCAL ] FT: Primary data saved (4756 records). [2025-09-14T18:09:39.957201] [INFO ] [MAIN ] FT: Full history saved. [2025-09-14T18:09:39.957374] [INFO ] [MAIN ] Update Progress: 874/2370 symbols completed. FT took 10.8s. Estimated remaining: 2h 38m 17s. Rate: 9.5 symbols/min [2025-09-14T18:09:40.133900] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T18:09:40.157377] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:40.175594] [DEBUG] [LOCAL ] FTHY: Loaded 5323 existing records from primary storage. [2025-09-14T18:09:40.175776] [INFO ] [MAIN ] FTHY: Loaded 5323 existing records. [2025-09-14T18:09:40.360479] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:40.360801] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-14T18:09:40.360864] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-14T18:09:40.361162] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-14T18:09:40.361220] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-14T18:09:40.568755] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-14T18:09:40.722096] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:41.358814] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-14T18:09:41.575404] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:09:42.158872] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-14T18:09:42.604929] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T18:09:42.958866] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-14T18:09:43.222074] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:09:43.554335] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T18:09:43.758815] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-14T18:09:44.558804] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-14T18:09:44.619320] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:09:45.218833] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:09:45.358824] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-14T18:09:46.158855] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-14T18:09:46.178833] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T18:09:46.185680] [INFO ] [REMOTE ] FSLY: Full fetch complete (55895 records). [2025-09-14T18:09:46.185813] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-14T18:09:46.582082] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-14T18:09:46.582198] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-14T18:09:46.583010] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-14T18:09:46.583076] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-14T18:09:46.584246] [DEBUG] [LOCAL ] FSLY: Trimmed 55895 records to 38359 (keeping 150 days of data) [2025-09-14T18:09:46.827121] [DEBUG] [LOCAL ] FSLY: Primary data saved (38359 records). [2025-09-14T18:09:46.827519] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-14T18:09:46.827674] [INFO ] [MAIN ] Update Progress: 875/2370 symbols completed. FSLY took 29.5s. Estimated remaining: 2h 38m 11s. Rate: 9.5 symbols/min [2025-09-14T18:09:46.960054] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-14T18:09:47.012166] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:47.037375] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:09:47.069249] [DEBUG] [LOCAL ] FTI: Loaded 23812 existing records from primary storage. [2025-09-14T18:09:47.069463] [INFO ] [MAIN ] FTI: Loaded 23812 existing records. [2025-09-14T18:09:47.260003] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:47.260313] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-14T18:09:47.260373] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-14T18:09:47.261068] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-14T18:09:47.261136] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-14T18:09:47.645922] [INFO ] [REMOTE ] FTI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:47.653735] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-14T18:09:47.670526] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:09:47.676256] [INFO ] [REMOTE ] FSM: Full fetch complete (57903 records). [2025-09-14T18:09:47.676435] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-14T18:09:47.763953] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-14T18:09:48.061274] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-14T18:09:48.061393] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-14T18:09:48.062231] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-14T18:09:48.062295] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-14T18:09:48.063951] [DEBUG] [LOCAL ] FSM: Trimmed 57903 records to 40060 (keeping 150 days of data) [2025-09-14T18:09:48.304754] [DEBUG] [LOCAL ] FSM: Primary data saved (40060 records). [2025-09-14T18:09:48.304983] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-14T18:09:48.305087] [INFO ] [MAIN ] Update Progress: 876/2370 symbols completed. FSM took 30.8s. Estimated remaining: 2h 37m 57s. Rate: 9.5 symbols/min [2025-09-14T18:09:48.478329] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:48.495429] [DEBUG] [LOCAL ] FTK: Loaded 15395 existing records from primary storage. [2025-09-14T18:09:48.495622] [INFO ] [MAIN ] FTK: Loaded 15395 existing records. [2025-09-14T18:09:48.564025] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-14T18:09:48.681193] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:48.681442] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-14T18:09:48.681516] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-14T18:09:48.682062] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-14T18:09:48.682130] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-14T18:09:49.045888] [INFO ] [REMOTE ] FTK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:49.064151] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T18:09:49.259488] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:09:49.358880] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-14T18:09:50.158835] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-14T18:09:50.406377] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T18:09:50.958848] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-14T18:09:51.478988] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T18:09:51.758862] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-14T18:09:51.823044] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:09:52.500532] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T18:09:52.558786] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-14T18:09:53.301532] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T18:09:53.358810] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-14T18:09:54.158862] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-14T18:09:54.326241] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T18:09:54.554410] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T18:09:54.557688] [INFO ] [REMOTE ] FSS: Full fetch complete (38183 records). [2025-09-14T18:09:54.557858] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-14T18:09:54.949148] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-14T18:09:54.949283] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-14T18:09:54.950261] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-14T18:09:54.950320] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-14T18:09:54.951416] [DEBUG] [LOCAL ] FSS: Trimmed 38183 records to 25400 (keeping 150 days of data) [2025-09-14T18:09:55.015259] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-14T18:09:55.137822] [DEBUG] [LOCAL ] FSS: Primary data saved (25400 records). [2025-09-14T18:09:55.138070] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-14T18:09:55.138211] [INFO ] [MAIN ] Update Progress: 877/2370 symbols completed. FSS took 28.5s. Estimated remaining: 2h 37m 51s. Rate: 9.5 symbols/min [2025-09-14T18:09:55.758832] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-14T18:09:56.539998] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T18:09:56.558812] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-14T18:09:56.827901] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T18:09:57.301033] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:09:57.302982] [INFO ] [REMOTE ] FTHY: Full fetch complete (12664 records). [2025-09-14T18:09:57.303133] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-14T18:09:57.368199] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-14T18:09:57.666983] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-14T18:09:57.667105] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-14T18:09:57.667458] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-14T18:09:57.667509] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-14T18:09:57.668013] [DEBUG] [LOCAL ] FTHY: Trimmed 12664 records to 8675 (keeping 150 days of data) [2025-09-14T18:09:57.723678] [DEBUG] [LOCAL ] FTHY: Primary data saved (8675 records). [2025-09-14T18:09:57.723866] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-14T18:09:57.723971] [INFO ] [MAIN ] Update Progress: 878/2370 symbols completed. FTHY took 17.8s. Estimated remaining: 2h 37m 38s. Rate: 9.5 symbols/min [2025-09-14T18:09:58.158836] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-14T18:09:59.087856] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T18:09:59.099558] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-14T18:09:59.324398] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:09:59.758859] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-14T18:10:00.797272] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:10:00.808993] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-14T18:10:00.889327] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T18:10:01.358845] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-14T18:10:02.886254] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T18:10:02.893960] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-14T18:10:02.955151] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-14T18:10:02.966815] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-14T18:10:04.612548] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:10:04.621414] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-14T18:10:04.736969] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:10:04.750203] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-14T18:10:05.600489] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T18:10:05.609291] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-14T18:10:06.633571] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T18:10:06.645472] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-14T18:10:07.146445] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T18:10:07.153892] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-14T18:10:08.345035] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T18:10:08.353382] [INFO ] [REMOTE ] FTI: Full fetch complete (57947 records). [2025-09-14T18:10:08.353577] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-14T18:10:08.540532] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T18:10:08.625665] [INFO ] [REMOTE ] FTK: Full fetch complete (33460 records). [2025-09-14T18:10:08.652314] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-14T18:10:08.857122] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-14T18:10:08.872510] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-14T18:10:08.909480] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-14T18:10:08.942486] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-14T18:10:09.037768] [DEBUG] [LOCAL ] FTI: Trimmed 57947 records to 40086 (keeping 150 days of data) [2025-09-14T18:10:09.185351] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-14T18:10:09.185553] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-14T18:10:09.212735] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-14T18:10:09.213412] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-14T18:10:09.221682] [DEBUG] [LOCAL ] FTK: Trimmed 33460 records to 25122 (keeping 150 days of data) [2025-09-14T18:10:09.495559] [DEBUG] [LOCAL ] FTK: Primary data saved (25122 records). [2025-09-14T18:10:09.496585] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-14T18:10:09.497275] [INFO ] [MAIN ] Update Progress: 879/2370 symbols completed. FTK took 21.2s. Estimated remaining: 2h 37m 41s. Rate: 9.5 symbols/min [2025-09-14T18:10:09.524743] [DEBUG] [LOCAL ] FTI: Primary data saved (40086 records). [2025-09-14T18:10:09.524932] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-14T18:10:09.525036] [INFO ] [MAIN ] Update Progress: 880/2370 symbols completed. FTI took 22.7s. Estimated remaining: 2h 37m 24s. Rate: 9.5 symbols/min [2025-09-14T18:10:10.117829] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:10.236215] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:10.241410] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:10.243280] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:10.250041] [DEBUG] [LOCAL ] FTWO: Loaded 905 existing records from primary storage. [2025-09-14T18:10:10.250202] [INFO ] [MAIN ] FTWO: Loaded 905 existing records. [2025-09-14T18:10:10.397261] [DEBUG] [LOCAL ] FTS: Loaded 19106 existing records from primary storage. [2025-09-14T18:10:10.386514] [DEBUG] [LOCAL ] FUBO: Loaded 24111 existing records from primary storage. [2025-09-14T18:10:10.419571] [INFO ] [MAIN ] FTS: Loaded 19106 existing records. [2025-09-14T18:10:10.425837] [INFO ] [MAIN ] FUBO: Loaded 24111 existing records. [2025-09-14T18:10:10.561796] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:10.488685] [DEBUG] [LOCAL ] FTV: Loaded 23744 existing records from primary storage. [2025-09-14T18:10:10.649966] [INFO ] [MAIN ] FTV: Loaded 23744 existing records. [2025-09-14T18:10:10.655380] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-14T18:10:10.702946] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-14T18:10:10.830059] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-14T18:10:10.897843] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-14T18:10:10.963403] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:10.988599] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-14T18:10:10.973322] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:11.009459] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-14T18:10:11.046633] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-14T18:10:11.101375] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:11.065090] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-14T18:10:11.117200] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-14T18:10:11.117125] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-14T18:10:11.139455] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-14T18:10:11.142863] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-14T18:10:11.208976] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-14T18:10:11.239792] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-14T18:10:11.267462] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-14T18:10:11.306552] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-14T18:10:12.038613] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:12.115610] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-14T18:10:12.333928] [INFO ] [REMOTE ] FTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:12.403060] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-14T18:10:12.595371] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:12.601259] [INFO ] [REMOTE ] FTV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:12.601632] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-14T18:10:12.601848] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-14T18:10:12.875800] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-14T18:10:12.877123] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-14T18:10:13.374732] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T18:10:13.376262] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-14T18:10:13.868691] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T18:10:13.870600] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-14T18:10:13.978999] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:10:13.989862] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-14T18:10:14.244610] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T18:10:14.246581] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-14T18:10:14.314903] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:10:14.902324] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:10:14.958797] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-14T18:10:15.109349] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-14T18:10:15.505711] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T18:10:15.613635] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:10:15.758799] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-14T18:10:16.558940] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-14T18:10:17.260478] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:10:17.358884] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-14T18:10:18.158825] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-14T18:10:18.528292] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:10:18.650132] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T18:10:18.958858] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-14T18:10:19.240403] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:10:19.758916] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-14T18:10:20.423408] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T18:10:20.558908] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-14T18:10:21.358853] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-14T18:10:21.669476] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T18:10:22.073942] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:10:22.158879] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-14T18:10:22.958909] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-14T18:10:23.223931] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T18:10:23.289205] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:10:23.290164] [INFO ] [REMOTE ] FTWO: Full fetch complete (2042 records). [2025-09-14T18:10:23.290251] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-14T18:10:23.709123] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-14T18:10:23.709358] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-14T18:10:23.709605] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-14T18:10:23.709836] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-14T18:10:23.710387] [DEBUG] [LOCAL ] FTWO: Trimmed 2042 records to 1288 (keeping 150 days of data) [2025-09-14T18:10:23.719338] [DEBUG] [LOCAL ] FTWO: Primary data saved (1288 records). [2025-09-14T18:10:23.719528] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-14T18:10:23.719700] [INFO ] [MAIN ] Update Progress: 881/2370 symbols completed. FTWO took 14.2s. Estimated remaining: 2h 37m 31s. Rate: 9.5 symbols/min [2025-09-14T18:10:23.763955] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-14T18:10:23.953012] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T18:10:23.954636] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:23.977306] [DEBUG] [LOCAL ] FUL: Loaded 10008 existing records from primary storage. [2025-09-14T18:10:23.977504] [INFO ] [MAIN ] FUL: Loaded 10008 existing records. [2025-09-14T18:10:24.150864] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:24.151147] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-14T18:10:24.151212] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-14T18:10:24.151628] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-14T18:10:24.151718] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-14T18:10:24.516223] [INFO ] [REMOTE ] FUL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:24.558838] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-14T18:10:25.358865] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-14T18:10:26.165589] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-14T18:10:26.186473] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-14T18:10:26.234316] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:10:26.958805] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-14T18:10:27.374567] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T18:10:27.742298] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T18:10:27.758791] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-14T18:10:28.504315] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:10:28.558802] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-14T18:10:29.103266] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T18:10:29.107576] [INFO ] [REMOTE ] FTS: Full fetch complete (45888 records). [2025-09-14T18:10:29.107726] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-14T18:10:29.367079] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-14T18:10:29.479007] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-14T18:10:29.479121] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-14T18:10:29.479797] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-14T18:10:29.479891] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-14T18:10:29.480892] [DEBUG] [LOCAL ] FTS: Trimmed 45888 records to 31771 (keeping 150 days of data) [2025-09-14T18:10:29.676484] [DEBUG] [LOCAL ] FTS: Primary data saved (31771 records). [2025-09-14T18:10:29.676696] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-14T18:10:29.676830] [INFO ] [MAIN ] Update Progress: 882/2370 symbols completed. FTS took 20.1s. Estimated remaining: 2h 37m 24s. Rate: 9.5 symbols/min [2025-09-14T18:10:29.848419] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:29.870943] [DEBUG] [LOCAL ] FUN: Loaded 23434 existing records from primary storage. [2025-09-14T18:10:29.871131] [INFO ] [MAIN ] FUN: Loaded 23434 existing records. [2025-09-14T18:10:30.058225] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:30.058586] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-14T18:10:30.058819] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-14T18:10:30.059546] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-14T18:10:30.059618] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-14T18:10:30.161946] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-14T18:10:30.439491] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:10:30.458503] [INFO ] [REMOTE ] FUN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:30.958861] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-14T18:10:31.428372] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T18:10:31.758900] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-14T18:10:32.114885] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T18:10:32.498327] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T18:10:32.558936] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-14T18:10:33.358875] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-14T18:10:34.165074] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-14T18:10:34.171794] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-14T18:10:34.437542] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T18:10:34.958856] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-14T18:10:35.162463] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T18:10:35.189575] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T18:10:35.758833] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-14T18:10:36.558841] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-14T18:10:37.087890] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-14T18:10:37.119784] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T18:10:37.358922] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-14T18:10:38.158835] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-14T18:10:38.487651] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T18:10:38.958890] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-14T18:10:39.214694] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-14T18:10:39.220369] [INFO ] [REMOTE ] FUBO: Full fetch complete (58379 records). [2025-09-14T18:10:39.220539] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-14T18:10:39.619658] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-14T18:10:39.619785] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-14T18:10:39.620686] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-14T18:10:39.621218] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-14T18:10:39.622579] [DEBUG] [LOCAL ] FUBO: Trimmed 58379 records to 40467 (keeping 150 days of data) [2025-09-14T18:10:39.737426] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:10:39.744275] [INFO ] [REMOTE ] FTV: Full fetch complete (57503 records). [2025-09-14T18:10:39.744659] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-14T18:10:39.766195] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-14T18:10:40.087295] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:10:40.201433] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-14T18:10:40.201545] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-14T18:10:40.203040] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-14T18:10:40.204262] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-14T18:10:40.207982] [DEBUG] [LOCAL ] FTV: Trimmed 57503 records to 39924 (keeping 150 days of data) [2025-09-14T18:10:40.558841] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-14T18:10:40.569447] [DEBUG] [LOCAL ] FUBO: Primary data saved (40467 records). [2025-09-14T18:10:40.571124] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-14T18:10:40.571758] [INFO ] [MAIN ] Update Progress: 883/2370 symbols completed. FUBO took 31.0s. Estimated remaining: 2h 37m 26s. Rate: 9.4 symbols/min [2025-09-14T18:10:40.753703] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:40.768424] [DEBUG] [LOCAL ] FVR: Loaded 9905 existing records from primary storage. [2025-09-14T18:10:40.769224] [INFO ] [MAIN ] FVR: Loaded 9905 existing records. [2025-09-14T18:10:40.937574] [DEBUG] [LOCAL ] FTV: Primary data saved (39924 records). [2025-09-14T18:10:40.957565] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:40.957741] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-14T18:10:40.958130] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-14T18:10:40.958290] [INFO ] [MAIN ] Update Progress: 884/2370 symbols completed. FTV took 31.4s. Estimated remaining: 2h 37m 9s. Rate: 9.5 symbols/min [2025-09-14T18:10:40.963869] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-14T18:10:41.025188] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-14T18:10:41.042607] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-14T18:10:41.251342] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:41.467019] [DEBUG] [LOCAL ] FVRR: Loaded 18423 existing records from primary storage. [2025-09-14T18:10:41.520593] [INFO ] [REMOTE ] FVR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:41.521034] [INFO ] [MAIN ] FVRR: Loaded 18423 existing records. [2025-09-14T18:10:41.533528] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-14T18:10:41.729956] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:41.731567] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T18:10:41.731798] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-14T18:10:41.739462] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-14T18:10:41.740197] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-14T18:10:41.740266] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-14T18:10:42.099392] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:42.158803] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-14T18:10:42.414775] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:10:42.631283] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:10:42.958838] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-14T18:10:43.685069] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T18:10:43.758788] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-14T18:10:44.161936] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T18:10:44.558824] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-14T18:10:45.358816] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-14T18:10:45.383041] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:10:46.158851] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-14T18:10:46.233198] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:10:46.490878] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T18:10:46.958859] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-14T18:10:47.758778] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-14T18:10:47.787892] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:10:48.100417] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:10:48.558837] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-14T18:10:49.061327] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T18:10:49.358829] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-14T18:10:49.985010] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:10:49.992830] [INFO ] [REMOTE ] FUL: Full fetch complete (35709 records). [2025-09-14T18:10:49.993002] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-14T18:10:50.159686] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-14T18:10:50.374962] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-14T18:10:50.375195] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-14T18:10:50.375970] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-14T18:10:50.376044] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-14T18:10:50.377052] [DEBUG] [LOCAL ] FUL: Trimmed 35709 records to 23457 (keeping 150 days of data) [2025-09-14T18:10:50.503527] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T18:10:50.571428] [DEBUG] [LOCAL ] FUL: Primary data saved (23457 records). [2025-09-14T18:10:50.571609] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-14T18:10:50.571752] [INFO ] [MAIN ] Update Progress: 885/2370 symbols completed. FUL took 26.9s. Estimated remaining: 2h 37m 8s. Rate: 9.5 symbols/min [2025-09-14T18:10:50.746457] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:50.748950] [DEBUG] [LOCAL ] FXED: Loaded 585 existing records from primary storage. [2025-09-14T18:10:50.749042] [INFO ] [MAIN ] FXED: Loaded 585 existing records. [2025-09-14T18:10:50.935020] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:50.935417] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-14T18:10:50.935504] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-14T18:10:50.935743] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-14T18:10:50.935811] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-14T18:10:50.966979] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-14T18:10:51.315103] [INFO ] [REMOTE ] FXED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:51.758800] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-14T18:10:51.846563] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:10:52.558794] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-14T18:10:52.874073] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T18:10:52.978509] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T18:10:53.358864] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-14T18:10:53.698585] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-14T18:10:54.015334] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:10:54.158821] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-14T18:10:54.958839] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-14T18:10:55.675192] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T18:10:55.758771] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-14T18:10:56.083955] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T18:10:56.558810] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-14T18:10:57.058057] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T18:10:57.063820] [INFO ] [REMOTE ] FUN: Full fetch complete (55533 records). [2025-09-14T18:10:57.064018] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-14T18:10:57.359704] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-14T18:10:57.463878] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-14T18:10:57.464058] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-14T18:10:57.465086] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-14T18:10:57.465169] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-14T18:10:57.466993] [DEBUG] [LOCAL ] FUN: Trimmed 55533 records to 39041 (keeping 150 days of data) [2025-09-14T18:10:57.586149] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:10:57.753078] [DEBUG] [LOCAL ] FUN: Primary data saved (39041 records). [2025-09-14T18:10:57.753272] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-14T18:10:57.753384] [INFO ] [MAIN ] Update Progress: 886/2370 symbols completed. FUN took 28.1s. Estimated remaining: 2h 37m 3s. Rate: 9.4 symbols/min [2025-09-14T18:10:57.865070] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T18:10:57.937592] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:57.960681] [DEBUG] [LOCAL ] G: Loaded 22348 existing records from primary storage. [2025-09-14T18:10:57.960860] [INFO ] [MAIN ] G: Loaded 22348 existing records. [2025-09-14T18:10:58.143614] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:58.143924] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-14T18:10:58.143985] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-14T18:10:58.144689] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-14T18:10:58.144754] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-14T18:10:58.165716] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-14T18:10:58.516610] [INFO ] [REMOTE ] G: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:58.630712] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T18:10:58.959001] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-14T18:10:59.758906] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-14T18:11:00.558847] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-14T18:11:00.632501] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:11:00.889176] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T18:11:00.893781] [INFO ] [REMOTE ] FVRR: Full fetch complete (44003 records). [2025-09-14T18:11:00.893944] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-14T18:11:01.201977] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T18:11:01.314904] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-14T18:11:01.315066] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-14T18:11:01.316336] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-14T18:11:01.316407] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-14T18:11:01.318209] [DEBUG] [LOCAL ] FVRR: Trimmed 44003 records to 30096 (keeping 150 days of data) [2025-09-14T18:11:01.372606] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-14T18:11:01.543913] [DEBUG] [LOCAL ] FVRR: Primary data saved (30096 records). [2025-09-14T18:11:01.544112] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-14T18:11:01.544219] [INFO ] [MAIN ] Update Progress: 887/2370 symbols completed. FVRR took 20.6s. Estimated remaining: 2h 36m 53s. Rate: 9.5 symbols/min [2025-09-14T18:11:01.720948] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:01.734241] [DEBUG] [LOCAL ] GAB: Loaded 11670 existing records from primary storage. [2025-09-14T18:11:01.734448] [INFO ] [MAIN ] GAB: Loaded 11670 existing records. [2025-09-14T18:11:01.920745] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:01.921075] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-14T18:11:01.921150] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-14T18:11:01.921508] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-14T18:11:01.921565] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-14T18:11:02.160698] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-14T18:11:02.184746] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T18:11:02.321754] [INFO ] [REMOTE ] GAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:02.958924] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-14T18:11:03.417315] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T18:11:03.758804] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-14T18:11:04.100403] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:11:04.508247] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:11:04.510557] [INFO ] [REMOTE ] FVR: Full fetch complete (23339 records). [2025-09-14T18:11:04.510759] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-14T18:11:04.563942] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-14T18:11:04.877286] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-14T18:11:04.877438] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-14T18:11:04.878088] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-14T18:11:04.878164] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-14T18:11:04.878885] [DEBUG] [LOCAL ] FVR: Trimmed 23339 records to 16555 (keeping 150 days of data) [2025-09-14T18:11:04.978873] [DEBUG] [LOCAL ] FVR: Primary data saved (16555 records). [2025-09-14T18:11:04.979071] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-14T18:11:04.979218] [INFO ] [MAIN ] Update Progress: 888/2370 symbols completed. FVR took 24.4s. Estimated remaining: 2h 36m 42s. Rate: 9.5 symbols/min [2025-09-14T18:11:05.147096] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:05.150561] [DEBUG] [LOCAL ] GAM: Loaded 1782 existing records from primary storage. [2025-09-14T18:11:05.150689] [INFO ] [MAIN ] GAM: Loaded 1782 existing records. [2025-09-14T18:11:05.326580] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:05.326874] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-14T18:11:05.326933] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-14T18:11:05.327205] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-14T18:11:05.327264] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-14T18:11:05.364026] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-14T18:11:05.687720] [INFO ] [REMOTE ] GAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:05.913543] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T18:11:06.015022] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T18:11:06.158859] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-14T18:11:06.648189] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T18:11:06.958902] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-14T18:11:07.322909] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T18:11:07.323750] [INFO ] [REMOTE ] FXED: Full fetch complete (1283 records). [2025-09-14T18:11:07.323862] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-14T18:11:07.707043] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-14T18:11:07.707171] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-14T18:11:07.707268] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-14T18:11:07.707321] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-14T18:11:07.707698] [DEBUG] [LOCAL ] FXED: Trimmed 1283 records to 881 (keeping 150 days of data) [2025-09-14T18:11:07.713749] [DEBUG] [LOCAL ] FXED: Primary data saved (881 records). [2025-09-14T18:11:07.713822] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-14T18:11:07.713907] [INFO ] [MAIN ] Update Progress: 889/2370 symbols completed. FXED took 17.1s. Estimated remaining: 2h 36m 29s. Rate: 9.5 symbols/min [2025-09-14T18:11:07.764373] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-14T18:11:07.891402] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:07.915833] [DEBUG] [LOCAL ] GAP: Loaded 24070 existing records from primary storage. [2025-09-14T18:11:07.916034] [INFO ] [MAIN ] GAP: Loaded 24070 existing records. [2025-09-14T18:11:08.097163] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:08.097551] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-14T18:11:08.097618] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-14T18:11:08.098307] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-14T18:11:08.098380] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-14T18:11:08.460048] [INFO ] [REMOTE ] GAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:08.558795] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-14T18:11:09.358835] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-14T18:11:09.586292] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:11:10.158836] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-14T18:11:10.233453] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:11:10.958798] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-14T18:11:11.442079] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-14T18:11:11.758854] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-14T18:11:11.885435] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T18:11:12.108775] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:11:12.558856] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-14T18:11:12.634470] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T18:11:13.358858] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-14T18:11:14.158909] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-14T18:11:14.427155] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T18:11:14.617473] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:11:14.950281] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T18:11:14.958773] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-14T18:11:15.651532] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T18:11:15.758822] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-14T18:11:16.558857] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-14T18:11:17.358835] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-14T18:11:17.676347] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:11:17.858303] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T18:11:18.158848] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-14T18:11:18.773413] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T18:11:18.958840] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-14T18:11:19.130518] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:11:19.508166] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-14T18:11:19.758856] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-14T18:11:20.452592] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T18:11:20.558854] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-14T18:11:21.358848] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-14T18:11:21.983737] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:11:22.158809] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-14T18:11:22.591811] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T18:11:22.958840] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-14T18:11:23.322255] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:11:23.758860] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-14T18:11:24.389211] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:11:24.390238] [INFO ] [REMOTE ] GAM: Full fetch complete (4990 records). [2025-09-14T18:11:24.390338] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-14T18:11:24.571089] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-14T18:11:24.755739] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-14T18:11:24.755880] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-14T18:11:24.756065] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-14T18:11:24.756117] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-14T18:11:24.756557] [DEBUG] [LOCAL ] GAM: Trimmed 4990 records to 2802 (keeping 150 days of data) [2025-09-14T18:11:24.773707] [DEBUG] [LOCAL ] GAM: Primary data saved (2802 records). [2025-09-14T18:11:24.773798] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-14T18:11:24.773889] [INFO ] [MAIN ] Update Progress: 890/2370 symbols completed. GAM took 19.8s. Estimated remaining: 2h 36m 41s. Rate: 9.4 symbols/min [2025-09-14T18:11:24.956059] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:24.966327] [DEBUG] [LOCAL ] GATX: Loaded 7402 existing records from primary storage. [2025-09-14T18:11:24.966512] [INFO ] [MAIN ] GATX: Loaded 7402 existing records. [2025-09-14T18:11:25.207507] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-14T18:11:25.204418] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:25.207995] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-14T18:11:25.220699] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-14T18:11:25.221541] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-14T18:11:25.221689] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-14T18:11:25.364008] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-14T18:11:25.708476] [INFO ] [REMOTE ] GATX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:26.158918] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-14T18:11:26.486681] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T18:11:26.667621] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T18:11:26.671462] [INFO ] [REMOTE ] GAB: Full fetch complete (29384 records). [2025-09-14T18:11:26.671573] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-14T18:11:26.962335] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-14T18:11:27.052530] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-14T18:11:27.052745] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-14T18:11:27.054085] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-14T18:11:27.054260] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-14T18:11:27.060939] [DEBUG] [LOCAL ] GAB: Trimmed 29384 records to 19836 (keeping 150 days of data) [2025-09-14T18:11:27.066759] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:11:27.184676] [DEBUG] [LOCAL ] GAB: Primary data saved (19836 records). [2025-09-14T18:11:27.184894] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-14T18:11:27.185095] [INFO ] [MAIN ] Update Progress: 891/2370 symbols completed. GAB took 25.6s. Estimated remaining: 2h 36m 28s. Rate: 9.5 symbols/min [2025-09-14T18:11:27.365297] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:27.374181] [DEBUG] [LOCAL ] GBAB: Loaded 6343 existing records from primary storage. [2025-09-14T18:11:27.374339] [INFO ] [MAIN ] GBAB: Loaded 6343 existing records. [2025-09-14T18:11:27.560627] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:27.560948] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-14T18:11:27.561010] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-14T18:11:27.561344] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-14T18:11:27.561404] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-14T18:11:27.766432] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-14T18:11:27.931332] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:28.558793] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-14T18:11:28.910342] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:11:29.083773] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T18:11:29.358882] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-14T18:11:30.016675] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T18:11:30.158831] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-14T18:11:30.831662] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:11:30.837294] [INFO ] [REMOTE ] G: Full fetch complete (54217 records). [2025-09-14T18:11:30.837412] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-14T18:11:30.964021] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-14T18:11:31.223738] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-14T18:11:31.224008] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-14T18:11:31.224902] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-14T18:11:31.225125] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-14T18:11:31.226361] [DEBUG] [LOCAL ] G: Trimmed 54217 records to 37400 (keeping 150 days of data) [2025-09-14T18:11:31.355057] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T18:11:31.505556] [DEBUG] [LOCAL ] G: Primary data saved (37400 records). [2025-09-14T18:11:31.505761] [INFO ] [MAIN ] G: Full history saved. [2025-09-14T18:11:31.505879] [INFO ] [MAIN ] Update Progress: 892/2370 symbols completed. G took 33.8s. Estimated remaining: 2h 36m 18s. Rate: 9.5 symbols/min [2025-09-14T18:11:31.673231] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:31.692215] [DEBUG] [LOCAL ] GBCI: Loaded 18526 existing records from primary storage. [2025-09-14T18:11:31.692394] [INFO ] [MAIN ] GBCI: Loaded 18526 existing records. [2025-09-14T18:11:31.765356] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-14T18:11:31.875221] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:31.875567] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-14T18:11:31.875629] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-14T18:11:31.876151] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-14T18:11:31.876210] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-14T18:11:32.221765] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:32.236984] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T18:11:32.558839] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-14T18:11:33.358897] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-14T18:11:33.586586] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T18:11:33.927409] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T18:11:34.158853] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-14T18:11:34.498675] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:11:34.958832] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-14T18:11:35.091876] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T18:11:35.758827] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-14T18:11:36.518756] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T18:11:36.558789] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-14T18:11:36.955549] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T18:11:37.358829] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-14T18:11:37.583495] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T18:11:38.158812] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-14T18:11:38.435620] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T18:11:38.958812] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-14T18:11:39.022240] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:11:39.643916] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:11:39.649618] [INFO ] [REMOTE ] GAP: Full fetch complete (58331 records). [2025-09-14T18:11:39.649840] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-14T18:11:39.764010] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-14T18:11:40.035591] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-14T18:11:40.035724] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-14T18:11:40.036568] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-14T18:11:40.036625] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-14T18:11:40.038261] [DEBUG] [LOCAL ] GAP: Trimmed 58331 records to 40398 (keeping 150 days of data) [2025-09-14T18:11:40.317020] [DEBUG] [LOCAL ] GAP: Primary data saved (40398 records). [2025-09-14T18:11:40.317190] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-14T18:11:40.317309] [INFO ] [MAIN ] Update Progress: 893/2370 symbols completed. GAP took 32.6s. Estimated remaining: 2h 36m 16s. Rate: 9.5 symbols/min [2025-09-14T18:11:40.484336] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:40.490511] [DEBUG] [LOCAL ] GBLI: Loaded 464 existing records from primary storage. [2025-09-14T18:11:40.490677] [INFO ] [MAIN ] GBLI: Loaded 464 existing records. [2025-09-14T18:11:40.568733] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-14T18:11:40.675002] [WARN ] [MAIN ] GBLI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:40.675265] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-14T18:11:40.675324] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-14T18:11:40.675595] [DEBUG] [LOCAL ] GBLI: Deleted primary data file. [2025-09-14T18:11:40.675683] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-14T18:11:41.036845] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:41.050163] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T18:11:41.358836] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-14T18:11:41.725289] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-14T18:11:42.158802] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-14T18:11:42.230416] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:11:42.474338] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-14T18:11:42.958837] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-14T18:11:43.758843] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-14T18:11:44.162282] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-14T18:11:44.570327] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T18:11:44.568635] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-14T18:11:45.006155] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T18:11:45.358825] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-14T18:11:46.158827] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-14T18:11:46.443961] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T18:11:46.958865] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-14T18:11:47.262094] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-14T18:11:47.332793] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T18:11:47.758886] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-14T18:11:48.558871] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-14T18:11:49.358876] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-14T18:11:49.388503] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:11:49.545449] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T18:11:49.925684] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:11:49.928566] [INFO ] [REMOTE ] GATX: Full fetch complete (18887 records). [2025-09-14T18:11:49.928683] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-14T18:11:50.164114] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-14T18:11:50.294927] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-14T18:11:50.295039] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-14T18:11:50.295525] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-14T18:11:50.295579] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-14T18:11:50.296578] [DEBUG] [LOCAL ] GATX: Trimmed 18887 records to 13288 (keeping 150 days of data) [2025-09-14T18:11:50.385678] [DEBUG] [LOCAL ] GATX: Primary data saved (13288 records). [2025-09-14T18:11:50.385873] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-14T18:11:50.385973] [INFO ] [MAIN ] Update Progress: 894/2370 symbols completed. GATX took 25.6s. Estimated remaining: 2h 36m 16s. Rate: 9.4 symbols/min [2025-09-14T18:11:50.552396] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:50.570111] [DEBUG] [LOCAL ] GBTG: Loaded 17488 existing records from primary storage. [2025-09-14T18:11:50.570320] [INFO ] [MAIN ] GBTG: Loaded 17488 existing records. [2025-09-14T18:11:50.749608] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:50.750007] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-14T18:11:50.750072] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-14T18:11:50.750743] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-14T18:11:50.750811] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-14T18:11:50.964054] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-14T18:11:51.114114] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:51.650246] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:11:51.758846] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-14T18:11:52.067493] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-14T18:11:52.079496] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:11:52.558835] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-14T18:11:53.018930] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T18:11:53.023028] [INFO ] [REMOTE ] GBCI: Full fetch complete (43618 records). [2025-09-14T18:11:53.023136] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-14T18:11:53.364008] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-14T18:11:53.404486] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-14T18:11:53.404617] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-14T18:11:53.405474] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-14T18:11:53.405558] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-14T18:11:53.406701] [DEBUG] [LOCAL ] GBCI: Trimmed 43618 records to 29959 (keeping 150 days of data) [2025-09-14T18:11:53.605558] [DEBUG] [LOCAL ] GBCI: Primary data saved (29959 records). [2025-09-14T18:11:53.605769] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-14T18:11:53.605887] [INFO ] [MAIN ] Update Progress: 895/2370 symbols completed. GBCI took 22.1s. Estimated remaining: 2h 36m 4s. Rate: 9.5 symbols/min [2025-09-14T18:11:53.777669] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:53.791149] [DEBUG] [LOCAL ] GBX: Loaded 12317 existing records from primary storage. [2025-09-14T18:11:53.791316] [INFO ] [MAIN ] GBX: Loaded 12317 existing records. [2025-09-14T18:11:54.004722] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:54.005001] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-14T18:11:54.005061] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-14T18:11:54.005608] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-14T18:11:54.005703] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-14T18:11:54.163721] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-14T18:11:54.371895] [INFO ] [REMOTE ] GBX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:54.380254] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T18:11:54.631349] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T18:11:54.958825] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-14T18:11:55.204682] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T18:11:55.205501] [INFO ] [REMOTE ] GBLI: Full fetch complete (1054 records). [2025-09-14T18:11:55.205588] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-14T18:11:55.421313] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T18:11:55.421622] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:11:55.421712] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:11:55.421780] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-14T18:11:55.421880] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-14T18:11:55.421944] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-14T18:11:55.422010] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-14T18:11:55.422119] [INFO ] [MAIN ] Update Progress: 896/2370 symbols completed. GBLI took 15.1s. Estimated remaining: 2h 35m 50s. Rate: 9.5 symbols/min [2025-09-14T18:11:55.599154] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:55.619609] [DEBUG] [LOCAL ] GCI: Loaded 19477 existing records from primary storage. [2025-09-14T18:11:55.619798] [INFO ] [MAIN ] GCI: Loaded 19477 existing records. [2025-09-14T18:11:55.763120] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-14T18:11:55.796713] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:55.796947] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-14T18:11:55.797004] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-14T18:11:55.797573] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-14T18:11:55.797634] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-14T18:11:56.149317] [INFO ] [REMOTE ] GCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:56.558862] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-14T18:11:57.241780] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T18:11:57.358843] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-14T18:11:57.859620] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T18:11:58.158845] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-14T18:11:58.814976] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:11:58.958862] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-14T18:11:59.546490] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:11:59.758818] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-14T18:12:00.503667] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T18:12:00.558853] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-14T18:12:01.358894] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-14T18:12:01.659958] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T18:12:01.999622] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:12:02.158851] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-14T18:12:02.958869] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-14T18:12:03.758847] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-14T18:12:04.641066] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (3.28 seconds). [2025-09-14T18:12:04.651588] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-14T18:12:04.720800] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-14T18:12:05.077560] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T18:12:05.079607] [INFO ] [REMOTE ] GBAB: Full fetch complete (14405 records). [2025-09-14T18:12:05.079744] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-14T18:12:05.360668] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-14T18:12:05.459471] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-14T18:12:05.459750] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-14T18:12:05.460230] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-14T18:12:05.460310] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-14T18:12:05.461049] [DEBUG] [LOCAL ] GBAB: Trimmed 14405 records to 9681 (keeping 150 days of data) [2025-09-14T18:12:05.538624] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-14T18:12:05.555940] [DEBUG] [LOCAL ] GBAB: Primary data saved (9681 records). [2025-09-14T18:12:05.556064] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-14T18:12:05.556155] [INFO ] [MAIN ] Update Progress: 897/2370 symbols completed. GBAB took 38.4s. Estimated remaining: 2h 35m 50s. Rate: 9.5 symbols/min [2025-09-14T18:12:05.725893] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:05.738552] [DEBUG] [LOCAL ] GCO: Loaded 9633 existing records from primary storage. [2025-09-14T18:12:05.738729] [INFO ] [MAIN ] GCO: Loaded 9633 existing records. [2025-09-14T18:12:05.914564] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:05.914854] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-14T18:12:05.914916] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-14T18:12:05.915330] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-14T18:12:05.915395] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-14T18:12:06.162895] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-14T18:12:06.267909] [INFO ] [REMOTE ] GCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:06.292825] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T18:12:06.581749] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:12:06.958842] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-14T18:12:07.758836] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-14T18:12:07.954750] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:12:08.012766] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:12:08.558881] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-14T18:12:09.311748] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:12:09.358793] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-14T18:12:10.117872] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T18:12:10.158790] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-14T18:12:10.470746] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T18:12:10.958894] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-14T18:12:11.617882] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:12:11.758816] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-14T18:12:12.356305] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T18:12:12.558861] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-14T18:12:12.820162] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:12:13.358848] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-14T18:12:14.019514] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T18:12:14.158843] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-14T18:12:14.276455] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T18:12:14.958822] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-14T18:12:15.476460] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T18:12:15.758847] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-14T18:12:16.334395] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T18:12:16.338802] [INFO ] [REMOTE ] GBTG: Full fetch complete (43457 records). [2025-09-14T18:12:16.338938] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-14T18:12:16.568143] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-14T18:12:16.715620] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-14T18:12:16.715752] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-14T18:12:16.716546] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-14T18:12:16.716603] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-14T18:12:16.717705] [DEBUG] [LOCAL ] GBTG: Trimmed 43457 records to 30281 (keeping 150 days of data) [2025-09-14T18:12:16.899280] [DEBUG] [LOCAL ] GBTG: Primary data saved (30281 records). [2025-09-14T18:12:16.899458] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-14T18:12:16.899559] [INFO ] [MAIN ] Update Progress: 898/2370 symbols completed. GBTG took 26.5s. Estimated remaining: 2h 35m 52s. Rate: 9.4 symbols/min [2025-09-14T18:12:17.072025] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:17.085766] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:12:17.097813] [DEBUG] [LOCAL ] GCTS: Loaded 8506 existing records from primary storage. [2025-09-14T18:12:17.097965] [INFO ] [MAIN ] GCTS: Loaded 8506 existing records. [2025-09-14T18:12:17.277447] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:17.277777] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-14T18:12:17.277839] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-14T18:12:17.278225] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-14T18:12:17.278287] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-14T18:12:17.368706] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-14T18:12:17.668187] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:18.158912] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-14T18:12:18.557008] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T18:12:18.958914] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-14T18:12:19.302514] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T18:12:19.758861] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-14T18:12:19.970312] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T18:12:20.067863] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T18:12:20.558841] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-14T18:12:20.707337] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T18:12:21.358846] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-14T18:12:21.439899] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:12:22.158860] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-14T18:12:22.573803] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T18:12:22.578575] [INFO ] [REMOTE ] GCI: Full fetch complete (48005 records). [2025-09-14T18:12:22.578758] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-14T18:12:22.960667] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-14T18:12:22.973033] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-14T18:12:22.973108] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-14T18:12:22.973960] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-14T18:12:22.974114] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-14T18:12:22.975365] [DEBUG] [LOCAL ] GCI: Trimmed 48005 records to 33004 (keeping 150 days of data) [2025-09-14T18:12:23.162022] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T18:12:23.166555] [INFO ] [REMOTE ] GCO: Full fetch complete (27820 records). [2025-09-14T18:12:23.167258] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-14T18:12:23.453974] [DEBUG] [LOCAL ] GCI: Primary data saved (33004 records). [2025-09-14T18:12:23.469696] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-14T18:12:23.480688] [INFO ] [MAIN ] Update Progress: 899/2370 symbols completed. GCI took 28.1s. Estimated remaining: 2h 35m 46s. Rate: 9.4 symbols/min [2025-09-14T18:12:23.574490] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-14T18:12:23.562084] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:12:23.595882] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-14T18:12:23.620727] [INFO ] [REMOTE ] GBX: Full fetch complete (32590 records). [2025-09-14T18:12:23.644913] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-14T18:12:23.665675] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-14T18:12:23.644988] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-14T18:12:23.734066] [DEBUG] [LOCAL ] GCO: Trimmed 27820 records to 17713 (keeping 150 days of data) [2025-09-14T18:12:23.766035] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-14T18:12:23.748454] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:23.922699] [DEBUG] [LOCAL ] GCV: Loaded 3208 existing records from primary storage. [2025-09-14T18:12:23.943002] [INFO ] [MAIN ] GCV: Loaded 3208 existing records. [2025-09-14T18:12:24.418159] [DEBUG] [LOCAL ] GCO: Primary data saved (17713 records). [2025-09-14T18:12:24.450895] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-14T18:12:24.421528] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:24.453278] [INFO ] [MAIN ] Update Progress: 900/2370 symbols completed. GCO took 18.9s. Estimated remaining: 2h 35m 31s. Rate: 9.5 symbols/min [2025-09-14T18:12:24.453608] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-14T18:12:24.454284] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-14T18:12:24.453953] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-14T18:12:24.466203] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-14T18:12:24.454765] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-14T18:12:24.492799] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-14T18:12:24.512494] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-14T18:12:24.576523] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-14T18:12:24.710363] [DEBUG] [LOCAL ] GBX: Trimmed 32590 records to 21172 (keeping 150 days of data) [2025-09-14T18:12:24.773400] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:25.115208] [DEBUG] [LOCAL ] GD: Loaded 20571 existing records from primary storage. [2025-09-14T18:12:25.109041] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:12:25.151325] [INFO ] [MAIN ] GD: Loaded 20571 existing records. [2025-09-14T18:12:25.156541] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-14T18:12:25.191088] [INFO ] [REMOTE ] GCV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:25.370560] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-14T18:12:25.420450] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:25.430292] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-14T18:12:25.431095] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-14T18:12:25.432344] [DEBUG] [LOCAL ] GBX: Primary data saved (21172 records). [2025-09-14T18:12:25.432464] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-14T18:12:25.432561] [INFO ] [MAIN ] Update Progress: 901/2370 symbols completed. GBX took 31.8s. Estimated remaining: 2h 35m 16s. Rate: 9.5 symbols/min [2025-09-14T18:12:25.444439] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-14T18:12:25.466906] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-14T18:12:25.780597] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:26.024791] [INFO ] [REMOTE ] GD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:26.027885] [DEBUG] [LOCAL ] GDDY: Loaded 22543 existing records from primary storage. [2025-09-14T18:12:26.028158] [INFO ] [MAIN ] GDDY: Loaded 22543 existing records. [2025-09-14T18:12:26.164032] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-14T18:12:26.225809] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:26.232076] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:12:26.232230] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-14T18:12:26.234037] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-14T18:12:26.235475] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-14T18:12:26.235561] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-14T18:12:26.586858] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:26.602870] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T18:12:26.958856] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-14T18:12:27.758876] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-14T18:12:28.134709] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T18:12:28.424793] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T18:12:28.558865] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-14T18:12:28.702065] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T18:12:29.358842] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-14T18:12:30.158848] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-14T18:12:30.527918] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:12:30.958896] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-14T18:12:31.090026] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T18:12:31.638314] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:12:31.758842] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-14T18:12:32.558851] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-14T18:12:33.319185] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-14T18:12:33.346229] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:12:33.358771] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-14T18:12:34.158895] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-14T18:12:34.405509] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:12:34.427506] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T18:12:34.958894] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-14T18:12:35.758810] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-14T18:12:35.862899] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:12:35.985339] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:12:35.989059] [INFO ] [REMOTE ] GCTS: Full fetch complete (20559 records). [2025-09-14T18:12:35.989228] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-14T18:12:36.366826] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-14T18:12:36.366936] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-14T18:12:36.367396] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-14T18:12:36.367448] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-14T18:12:36.368087] [DEBUG] [LOCAL ] GCTS: Trimmed 20559 records to 15783 (keeping 150 days of data) [2025-09-14T18:12:36.465039] [DEBUG] [LOCAL ] GCTS: Primary data saved (15783 records). [2025-09-14T18:12:36.465221] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-14T18:12:36.465323] [INFO ] [MAIN ] Update Progress: 902/2370 symbols completed. GCTS took 19.6s. Estimated remaining: 2h 35m 17s. Rate: 9.5 symbols/min [2025-09-14T18:12:36.563912] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-14T18:12:36.636541] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:36.639941] [DEBUG] [LOCAL ] GDIV: Loaded 1278 existing records from primary storage. [2025-09-14T18:12:36.640039] [INFO ] [MAIN ] GDIV: Loaded 1278 existing records. [2025-09-14T18:12:36.822558] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:36.823875] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-14T18:12:36.823939] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-14T18:12:36.824451] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-14T18:12:36.824513] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-14T18:12:37.180361] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:37.358828] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-14T18:12:37.594749] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:12:37.955569] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-14T18:12:38.158917] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-14T18:12:38.159873] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T18:12:38.605634] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T18:12:38.958838] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-14T18:12:39.758836] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-14T18:12:39.807866] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:12:40.558852] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-14T18:12:41.173114] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T18:12:41.358824] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-14T18:12:41.653520] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:12:42.158884] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-14T18:12:42.182152] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:12:42.958840] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-14T18:12:43.758874] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-14T18:12:43.986191] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:12:44.558850] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-14T18:12:44.591799] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:12:44.624768] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:12:45.200213] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:12:45.204851] [INFO ] [REMOTE ] GD: Full fetch complete (52250 records). [2025-09-14T18:12:45.204986] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-14T18:12:45.365763] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-14T18:12:45.591262] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-14T18:12:45.591382] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-14T18:12:45.592235] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-14T18:12:45.592297] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-14T18:12:45.593486] [DEBUG] [LOCAL ] GD: Trimmed 52250 records to 35042 (keeping 150 days of data) [2025-09-14T18:12:45.838944] [DEBUG] [LOCAL ] GD: Primary data saved (35042 records). [2025-09-14T18:12:45.839160] [INFO ] [MAIN ] GD: Full history saved. [2025-09-14T18:12:45.839304] [INFO ] [MAIN ] Update Progress: 903/2370 symbols completed. GD took 21.4s. Estimated remaining: 2h 35m 16s. Rate: 9.4 symbols/min [2025-09-14T18:12:46.009154] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:46.012294] [DEBUG] [LOCAL ] GDL: Loaded 1284 existing records from primary storage. [2025-09-14T18:12:46.012387] [INFO ] [MAIN ] GDL: Loaded 1284 existing records. [2025-09-14T18:12:46.163899] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-14T18:12:46.192481] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:46.192885] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-14T18:12:46.192950] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-14T18:12:46.193193] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-14T18:12:46.193252] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-14T18:12:46.550863] [INFO ] [REMOTE ] GDL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:46.895950] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:12:46.958872] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-14T18:12:47.176228] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:12:47.753612] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T18:12:47.758768] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-14T18:12:48.555616] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T18:12:48.558759] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-14T18:12:49.318566] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:12:49.320180] [INFO ] [REMOTE ] GCV: Full fetch complete (7384 records). [2025-09-14T18:12:49.320267] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-14T18:12:49.364137] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-14T18:12:49.694070] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-14T18:12:49.694184] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-14T18:12:49.694422] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-14T18:12:49.694534] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-14T18:12:49.695229] [DEBUG] [LOCAL ] GCV: Trimmed 7384 records to 5535 (keeping 150 days of data) [2025-09-14T18:12:49.727793] [DEBUG] [LOCAL ] GCV: Primary data saved (5535 records). [2025-09-14T18:12:49.727938] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-14T18:12:49.728117] [INFO ] [MAIN ] Update Progress: 904/2370 symbols completed. GCV took 26.2s. Estimated remaining: 2h 35m 5s. Rate: 9.5 symbols/min [2025-09-14T18:12:49.900456] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:49.905049] [DEBUG] [LOCAL ] GDO: Loaded 2747 existing records from primary storage. [2025-09-14T18:12:49.905159] [INFO ] [MAIN ] GDO: Loaded 2747 existing records. [2025-09-14T18:12:50.082556] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:50.082871] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-14T18:12:50.082974] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-14T18:12:50.083277] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-14T18:12:50.083339] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-14T18:12:50.164016] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-14T18:12:50.467325] [INFO ] [REMOTE ] GDO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:50.734532] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T18:12:50.958856] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-14T18:12:51.273457] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T18:12:51.357115] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-14T18:12:51.758844] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-14T18:12:52.453310] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:12:52.458912] [INFO ] [REMOTE ] GDDY: Full fetch complete (54314 records). [2025-09-14T18:12:52.459118] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-14T18:12:52.560856] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-14T18:12:52.846802] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-14T18:12:52.846943] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-14T18:12:52.847768] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-14T18:12:52.847827] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-14T18:12:52.849183] [DEBUG] [LOCAL ] GDDY: Trimmed 54314 records to 37225 (keeping 150 days of data) [2025-09-14T18:12:52.962550] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T18:12:53.102298] [DEBUG] [LOCAL ] GDDY: Primary data saved (37225 records). [2025-09-14T18:12:53.102487] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-14T18:12:53.102626] [INFO ] [MAIN ] Update Progress: 905/2370 symbols completed. GDDY took 27.7s. Estimated remaining: 2h 34m 54s. Rate: 9.5 symbols/min [2025-09-14T18:12:53.275907] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:53.293129] [DEBUG] [LOCAL ] GDOT: Loaded 16898 existing records from primary storage. [2025-09-14T18:12:53.293333] [INFO ] [MAIN ] GDOT: Loaded 16898 existing records. [2025-09-14T18:12:53.363948] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-14T18:12:53.484023] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:53.484293] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-14T18:12:53.484356] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-14T18:12:53.484875] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-14T18:12:53.484938] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-14T18:12:53.841481] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:54.032216] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T18:12:54.158796] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-14T18:12:54.958832] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-14T18:12:55.459374] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T18:12:55.476501] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T18:12:55.758816] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-14T18:12:56.558848] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-14T18:12:57.256028] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:12:57.358807] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-14T18:12:57.417992] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T18:12:57.823511] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T18:12:57.824554] [INFO ] [REMOTE ] GDIV: Full fetch complete (4192 records). [2025-09-14T18:12:57.824679] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-14T18:12:58.161859] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-14T18:12:58.186354] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-14T18:12:58.186471] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-14T18:12:58.186688] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-14T18:12:58.186764] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-14T18:12:58.187163] [DEBUG] [LOCAL ] GDIV: Trimmed 4192 records to 2692 (keeping 150 days of data) [2025-09-14T18:12:58.205178] [DEBUG] [LOCAL ] GDIV: Primary data saved (2692 records). [2025-09-14T18:12:58.205298] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-14T18:12:58.205403] [INFO ] [MAIN ] Update Progress: 906/2370 symbols completed. GDIV took 21.7s. Estimated remaining: 2h 34m 46s. Rate: 9.5 symbols/min [2025-09-14T18:12:58.381597] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:58.392278] [DEBUG] [LOCAL ] GDV: Loaded 8513 existing records from primary storage. [2025-09-14T18:12:58.392498] [INFO ] [MAIN ] GDV: Loaded 8513 existing records. [2025-09-14T18:12:58.582585] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:58.586199] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T18:12:58.586480] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-14T18:12:58.587800] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-14T18:12:58.588160] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-14T18:12:58.588231] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-14T18:12:58.938239] [INFO ] [REMOTE ] GDV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:58.958784] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-14T18:12:59.758852] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-14T18:13:00.414466] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:13:00.434361] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T18:13:00.558829] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-14T18:13:01.358899] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-14T18:13:02.158839] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-14T18:13:02.418004] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:13:02.511414] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T18:13:02.644335] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T18:13:02.958886] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-14T18:13:03.309397] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-14T18:13:03.758852] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-14T18:13:04.293012] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-14T18:13:04.558840] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-14T18:13:05.358788] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-14T18:13:05.521257] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T18:13:06.008028] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T18:13:06.158894] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-14T18:13:06.832950] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T18:13:06.958879] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-14T18:13:07.561799] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T18:13:07.758839] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-14T18:13:08.225293] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T18:13:08.558826] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-14T18:13:09.273363] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T18:13:09.358830] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-14T18:13:10.158808] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-14T18:13:10.574662] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T18:13:10.958918] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-14T18:13:11.714074] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T18:13:11.731926] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T18:13:11.758782] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-14T18:13:12.282287] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:13:12.283535] [INFO ] [REMOTE ] GDO: Full fetch complete (6448 records). [2025-09-14T18:13:12.283620] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-14T18:13:12.560358] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-14T18:13:12.638670] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-14T18:13:12.638785] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-14T18:13:12.638987] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-14T18:13:12.639041] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-14T18:13:12.639468] [DEBUG] [LOCAL ] GDO: Trimmed 6448 records to 4390 (keeping 150 days of data) [2025-09-14T18:13:12.668298] [DEBUG] [LOCAL ] GDO: Primary data saved (4390 records). [2025-09-14T18:13:12.668419] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-14T18:13:12.668530] [INFO ] [MAIN ] Update Progress: 907/2370 symbols completed. GDO took 22.9s. Estimated remaining: 2h 34m 53s. Rate: 9.4 symbols/min [2025-09-14T18:13:12.836856] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:12.861036] [DEBUG] [LOCAL ] GE: Loaded 24084 existing records from primary storage. [2025-09-14T18:13:12.861231] [INFO ] [MAIN ] GE: Loaded 24084 existing records. [2025-09-14T18:13:13.035247] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:13.035573] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-14T18:13:13.035658] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-14T18:13:13.036328] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-14T18:13:13.036391] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-14T18:13:13.365257] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-14T18:13:13.395574] [INFO ] [REMOTE ] GE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:13.719469] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:13:13.933852] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:13:13.934905] [INFO ] [REMOTE ] GDL: Full fetch complete (2536 records). [2025-09-14T18:13:13.934992] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-14T18:13:14.164010] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-14T18:13:14.285025] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-14T18:13:14.285149] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-14T18:13:14.285289] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-14T18:13:14.285343] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-14T18:13:14.285832] [DEBUG] [LOCAL ] GDL: Trimmed 2536 records to 1759 (keeping 150 days of data) [2025-09-14T18:13:14.297333] [DEBUG] [LOCAL ] GDL: Primary data saved (1759 records). [2025-09-14T18:13:14.297544] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-14T18:13:14.297683] [INFO ] [MAIN ] Update Progress: 908/2370 symbols completed. GDL took 28.5s. Estimated remaining: 2h 34m 39s. Rate: 9.5 symbols/min [2025-09-14T18:13:14.465800] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:14.477047] [DEBUG] [LOCAL ] GEF: Loaded 10019 existing records from primary storage. [2025-09-14T18:13:14.477246] [INFO ] [MAIN ] GEF: Loaded 10019 existing records. [2025-09-14T18:13:14.653003] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:14.653298] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-14T18:13:14.653380] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-14T18:13:14.653772] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-14T18:13:14.653835] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-14T18:13:14.967113] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-14T18:13:15.004394] [INFO ] [REMOTE ] GEF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:15.758833] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-14T18:13:15.911074] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T18:13:16.558819] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-14T18:13:16.674871] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T18:13:17.062925] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T18:13:17.358930] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-14T18:13:17.775204] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:13:18.158927] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-14T18:13:18.958807] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-14T18:13:19.067290] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T18:13:19.615729] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T18:13:19.758846] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-14T18:13:20.559110] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-14T18:13:20.560127] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:13:20.588114] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T18:13:21.358861] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-14T18:13:21.643952] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:13:22.158800] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-14T18:13:22.537027] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:13:22.958831] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-14T18:13:23.609174] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:13:23.613843] [INFO ] [REMOTE ] GDOT: Full fetch complete (41164 records). [2025-09-14T18:13:23.614041] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-14T18:13:23.763915] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-14T18:13:23.989590] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-14T18:13:23.989728] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-14T18:13:23.990413] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-14T18:13:23.990479] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-14T18:13:23.991464] [DEBUG] [LOCAL ] GDOT: Trimmed 41164 records to 27838 (keeping 150 days of data) [2025-09-14T18:13:24.170482] [DEBUG] [LOCAL ] GDOT: Primary data saved (27838 records). [2025-09-14T18:13:24.170690] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-14T18:13:24.170834] [INFO ] [MAIN ] Update Progress: 909/2370 symbols completed. GDOT took 31.1s. Estimated remaining: 2h 34m 38s. Rate: 9.4 symbols/min [2025-09-14T18:13:24.342939] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:24.360271] [DEBUG] [LOCAL ] GEL: Loaded 15870 existing records from primary storage. [2025-09-14T18:13:24.360461] [INFO ] [MAIN ] GEL: Loaded 15870 existing records. [2025-09-14T18:13:24.544406] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:24.544966] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-14T18:13:24.545033] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-14T18:13:24.545573] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-14T18:13:24.545676] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-14T18:13:24.566408] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-14T18:13:24.838654] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-14T18:13:24.938330] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T18:13:24.957923] [INFO ] [REMOTE ] GEL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:24.960258] [INFO ] [REMOTE ] GDV: Full fetch complete (21844 records). [2025-09-14T18:13:24.960363] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-14T18:13:25.320730] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-14T18:13:25.320856] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-14T18:13:25.321370] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-14T18:13:25.321425] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-14T18:13:25.322199] [DEBUG] [LOCAL ] GDV: Trimmed 21844 records to 14594 (keeping 150 days of data) [2025-09-14T18:13:25.369701] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-14T18:13:25.414298] [DEBUG] [LOCAL ] GDV: Primary data saved (14594 records). [2025-09-14T18:13:25.414444] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-14T18:13:25.414557] [INFO ] [MAIN ] Update Progress: 910/2370 symbols completed. GDV took 27.2s. Estimated remaining: 2h 34m 23s. Rate: 9.5 symbols/min [2025-09-14T18:13:25.584211] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:25.594155] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:13:25.618346] [DEBUG] [LOCAL ] GENI: Loaded 23670 existing records from primary storage. [2025-09-14T18:13:25.618532] [INFO ] [MAIN ] GENI: Loaded 23670 existing records. [2025-09-14T18:13:25.792200] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:25.792490] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-14T18:13:25.792551] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-14T18:13:25.793250] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-14T18:13:25.793316] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-14T18:13:26.148262] [INFO ] [REMOTE ] GENI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:26.158784] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-14T18:13:26.743789] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T18:13:26.958894] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-14T18:13:27.758832] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-14T18:13:27.868577] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:13:28.558943] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-14T18:13:28.611172] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:13:29.358900] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-14T18:13:29.844223] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:13:29.892916] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-14T18:13:30.158886] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-14T18:13:30.729954] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T18:13:30.958832] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-14T18:13:31.224224] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T18:13:31.758830] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-14T18:13:32.558886] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-14T18:13:32.850585] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T18:13:33.358830] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-14T18:13:33.586182] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:13:33.636401] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T18:13:34.158828] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-14T18:13:34.958901] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-14T18:13:35.525178] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T18:13:35.758855] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-14T18:13:36.044360] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:13:36.537997] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T18:13:36.558787] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-14T18:13:36.873860] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T18:13:37.358877] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-14T18:13:37.718392] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:13:37.767103] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:13:37.769947] [INFO ] [REMOTE ] GEF: Full fetch complete (22101 records). [2025-09-14T18:13:37.770038] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-14T18:13:38.141431] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-14T18:13:38.141559] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-14T18:13:38.142273] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-14T18:13:38.142343] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-14T18:13:38.143726] [DEBUG] [LOCAL ] GEF: Trimmed 22101 records to 15434 (keeping 150 days of data) [2025-09-14T18:13:38.184085] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-14T18:13:38.240866] [DEBUG] [LOCAL ] GEF: Primary data saved (15434 records). [2025-09-14T18:13:38.241062] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-14T18:13:38.241189] [INFO ] [MAIN ] Update Progress: 911/2370 symbols completed. GEF took 23.9s. Estimated remaining: 2h 34m 27s. Rate: 9.4 symbols/min [2025-09-14T18:13:38.416392] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:38.440294] [DEBUG] [LOCAL ] GEO: Loaded 23282 existing records from primary storage. [2025-09-14T18:13:38.440485] [INFO ] [MAIN ] GEO: Loaded 23282 existing records. [2025-09-14T18:13:38.613849] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:38.614143] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-14T18:13:38.614238] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-14T18:13:38.614841] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-14T18:13:38.614918] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-14T18:13:38.960807] [INFO ] [REMOTE ] GEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:38.960988] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-14T18:13:39.758840] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-14T18:13:40.403607] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-14T18:13:40.531861] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:13:40.558872] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-14T18:13:41.363994] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-14T18:13:41.386592] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T18:13:41.741248] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T18:13:41.746608] [INFO ] [REMOTE ] GEL: Full fetch complete (37971 records). [2025-09-14T18:13:41.746866] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-14T18:13:42.197041] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-14T18:13:42.225016] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T18:13:42.223832] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-14T18:13:42.231693] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-14T18:13:42.233473] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-14T18:13:42.234015] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-14T18:13:42.235145] [INFO ] [REMOTE ] GE: Full fetch complete (58390 records). [2025-09-14T18:13:42.235528] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-14T18:13:42.235626] [DEBUG] [LOCAL ] GEL: Trimmed 37971 records to 25309 (keeping 150 days of data) [2025-09-14T18:13:42.778273] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-14T18:13:42.779577] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-14T18:13:42.782460] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-14T18:13:42.783228] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-14T18:13:42.791758] [DEBUG] [LOCAL ] GE: Trimmed 58390 records to 40461 (keeping 150 days of data) [2025-09-14T18:13:42.944441] [DEBUG] [LOCAL ] GEL: Primary data saved (25309 records). [2025-09-14T18:13:42.945969] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-14T18:13:42.946938] [INFO ] [MAIN ] Update Progress: 912/2370 symbols completed. GEL took 18.8s. Estimated remaining: 2h 34m 18s. Rate: 9.4 symbols/min [2025-09-14T18:13:42.961056] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-14T18:13:43.142895] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:43.172358] [DEBUG] [LOCAL ] GES: Loaded 16479 existing records from primary storage. [2025-09-14T18:13:43.172601] [INFO ] [MAIN ] GES: Loaded 16479 existing records. [2025-09-14T18:13:43.457462] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:43.460449] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-14T18:13:43.462373] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-14T18:13:43.463899] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-14T18:13:43.464671] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-14T18:13:43.855225] [INFO ] [REMOTE ] GES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:43.863297] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-14T18:13:43.865060] [DEBUG] [LOCAL ] GE: Primary data saved (40461 records). [2025-09-14T18:13:43.865294] [INFO ] [MAIN ] GE: Full history saved. [2025-09-14T18:13:43.865439] [INFO ] [MAIN ] Update Progress: 913/2370 symbols completed. GE took 31.2s. Estimated remaining: 2h 34m 3s. Rate: 9.5 symbols/min [2025-09-14T18:13:44.048993] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:44.066903] [DEBUG] [LOCAL ] GETY: Loaded 15644 existing records from primary storage. [2025-09-14T18:13:44.067155] [INFO ] [MAIN ] GETY: Loaded 15644 existing records. [2025-09-14T18:13:44.250936] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:44.251377] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-14T18:13:44.251505] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-14T18:13:44.252167] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-14T18:13:44.252243] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-14T18:13:44.547064] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T18:13:44.628821] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-14T18:13:44.720521] [INFO ] [REMOTE ] GETY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:44.964706] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T18:13:45.291504] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:13:45.358872] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-14T18:13:46.158865] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-14T18:13:46.508144] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T18:13:46.958846] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-14T18:13:47.240705] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:13:47.766307] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-14T18:13:47.772741] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:13:48.558873] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-14T18:13:48.745722] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T18:13:49.291843] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T18:13:49.358866] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-14T18:13:50.060434] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:13:50.158836] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-14T18:13:50.903791] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T18:13:50.958827] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-14T18:13:51.758828] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-14T18:13:51.898363] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T18:13:52.561317] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-14T18:13:52.561225] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T18:13:53.278790] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T18:13:53.358863] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-14T18:13:54.158839] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-14T18:13:54.597998] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T18:13:54.842286] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:13:54.958879] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-14T18:13:55.359886] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:13:55.758889] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-14T18:13:56.558862] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-14T18:13:56.831161] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:13:57.335559] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:13:57.358785] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-14T18:13:58.101755] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:13:58.158840] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-14T18:13:58.836992] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T18:13:58.958867] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-14T18:13:59.474959] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:13:59.480880] [INFO ] [REMOTE ] GEO: Full fetch complete (56884 records). [2025-09-14T18:13:59.481056] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-14T18:13:59.763222] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-14T18:13:59.890226] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-14T18:13:59.890405] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-14T18:13:59.891509] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-14T18:13:59.891636] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-14T18:13:59.893174] [DEBUG] [LOCAL ] GEO: Trimmed 56884 records to 39206 (keeping 150 days of data) [2025-09-14T18:14:00.014388] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:14:00.187147] [DEBUG] [LOCAL ] GEO: Primary data saved (39206 records). [2025-09-14T18:14:00.187365] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-14T18:14:00.187489] [INFO ] [MAIN ] Update Progress: 914/2370 symbols completed. GEO took 21.9s. Estimated remaining: 2h 34m 13s. Rate: 9.4 symbols/min [2025-09-14T18:14:00.364684] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:00.389335] [DEBUG] [LOCAL ] GEV: Loaded 23696 existing records from primary storage. [2025-09-14T18:14:00.389537] [INFO ] [MAIN ] GEV: Loaded 23696 existing records. [2025-09-14T18:14:00.560926] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-14T18:14:00.564239] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:00.565229] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-14T18:14:00.565297] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-14T18:14:00.566083] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-14T18:14:00.566217] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-14T18:14:00.918116] [INFO ] [REMOTE ] GEV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:01.358876] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-14T18:14:01.555284] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T18:14:02.034418] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:14:02.043329] [INFO ] [REMOTE ] GES: Full fetch complete (44588 records). [2025-09-14T18:14:02.048854] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-14T18:14:02.163905] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-14T18:14:02.471529] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-14T18:14:02.471734] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-14T18:14:02.472860] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-14T18:14:02.472996] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-14T18:14:02.474375] [DEBUG] [LOCAL ] GES: Trimmed 44588 records to 28871 (keeping 150 days of data) [2025-09-14T18:14:02.638383] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-14T18:14:02.647691] [INFO ] [REMOTE ] GENI: Full fetch complete (57201 records). [2025-09-14T18:14:02.651365] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-14T18:14:02.970822] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-14T18:14:03.404774] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-14T18:14:03.408906] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-14T18:14:03.410387] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-14T18:14:03.411188] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-14T18:14:03.419864] [DEBUG] [LOCAL ] GES: Primary data saved (28871 records). [2025-09-14T18:14:03.422901] [INFO ] [MAIN ] GES: Full history saved. [2025-09-14T18:14:03.423473] [INFO ] [MAIN ] Update Progress: 915/2370 symbols completed. GES took 20.5s. Estimated remaining: 2h 34m 2s. Rate: 9.4 symbols/min [2025-09-14T18:14:03.429767] [DEBUG] [LOCAL ] GENI: Trimmed 57201 records to 39790 (keeping 150 days of data) [2025-09-14T18:14:03.807740] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:03.816760] [DEBUG] [LOCAL ] GF: Loaded 928 existing records from primary storage. [2025-09-14T18:14:03.818866] [INFO ] [MAIN ] GF: Loaded 928 existing records. [2025-09-14T18:14:04.026084] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:14:04.024235] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:04.096754] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-14T18:14:04.123687] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-14T18:14:04.123869] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-14T18:14:04.125782] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-14T18:14:04.126480] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-14T18:14:04.513021] [INFO ] [REMOTE ] GF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:04.523222] [DEBUG] [LOCAL ] GENI: Primary data saved (39790 records). [2025-09-14T18:14:04.523364] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-14T18:14:04.523473] [INFO ] [MAIN ] Update Progress: 916/2370 symbols completed. GENI took 39.1s. Estimated remaining: 2h 33m 47s. Rate: 9.5 symbols/min [2025-09-14T18:14:04.566283] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-14T18:14:04.695244] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:04.709834] [DEBUG] [LOCAL ] GFF: Loaded 12974 existing records from primary storage. [2025-09-14T18:14:04.710016] [INFO ] [MAIN ] GFF: Loaded 12974 existing records. [2025-09-14T18:14:04.884588] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:04.884880] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-14T18:14:04.884941] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-14T18:14:04.885477] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-14T18:14:04.885553] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-14T18:14:05.235610] [INFO ] [REMOTE ] GFF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:05.264362] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T18:14:05.358794] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-14T18:14:05.394535] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-14T18:14:05.683748] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:14:06.158923] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-14T18:14:06.323009] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T18:14:06.792010] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:14:06.958866] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-14T18:14:07.758845] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-14T18:14:08.307023] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-14T18:14:08.558888] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-14T18:14:09.104544] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T18:14:09.358830] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-14T18:14:09.963971] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T18:14:09.967922] [INFO ] [REMOTE ] GETY: Full fetch complete (40692 records). [2025-09-14T18:14:09.968034] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-14T18:14:10.169264] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-14T18:14:10.362047] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-14T18:14:10.362180] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-14T18:14:10.362896] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-14T18:14:10.362954] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-14T18:14:10.364057] [DEBUG] [LOCAL ] GETY: Trimmed 40692 records to 26329 (keeping 150 days of data) [2025-09-14T18:14:10.517717] [DEBUG] [LOCAL ] GETY: Primary data saved (26329 records). [2025-09-14T18:14:10.517900] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-14T18:14:10.518002] [INFO ] [MAIN ] Update Progress: 917/2370 symbols completed. GETY took 26.7s. Estimated remaining: 2h 33m 40s. Rate: 9.5 symbols/min [2025-09-14T18:14:10.958934] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-14T18:14:10.984775] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:14:11.758861] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-14T18:14:11.850806] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-14T18:14:12.374321] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T18:14:12.539037] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T18:14:12.558800] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-14T18:14:12.959188] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T18:14:13.358845] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-14T18:14:13.865964] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T18:14:14.158865] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-14T18:14:14.546681] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:14:14.547585] [INFO ] [REMOTE ] GF: Full fetch complete (4015 records). [2025-09-14T18:14:14.547689] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-14T18:14:14.914219] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-14T18:14:14.914345] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-14T18:14:14.914520] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-14T18:14:14.914574] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-14T18:14:14.915019] [DEBUG] [LOCAL ] GF: Trimmed 4015 records to 2145 (keeping 150 days of data) [2025-09-14T18:14:14.929730] [DEBUG] [LOCAL ] GF: Primary data saved (2145 records). [2025-09-14T18:14:14.929920] [INFO ] [MAIN ] GF: Full history saved. [2025-09-14T18:14:14.930025] [INFO ] [MAIN ] Update Progress: 918/2370 symbols completed. GF took 11.5s. Estimated remaining: 2h 33m 31s. Rate: 9.5 symbols/min [2025-09-14T18:14:14.958842] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-14T18:14:15.758862] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-14T18:14:17.396844] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T18:14:17.405189] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-14T18:14:17.552733] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-14T18:14:17.564470] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-14T18:14:18.834252] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:14:18.842231] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-14T18:14:19.626034] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T18:14:19.637855] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-14T18:14:20.129272] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:14:20.135786] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-14T18:14:21.436912] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T18:14:21.443803] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-14T18:14:22.222865] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-14T18:14:22.234963] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-14T18:14:22.927248] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:14:22.934837] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-14T18:14:23.480599] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:14:23.484106] [INFO ] [REMOTE ] GFF: Full fetch complete (33948 records). [2025-09-14T18:14:23.484273] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-14T18:14:23.869876] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-14T18:14:23.869995] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-14T18:14:23.870615] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-14T18:14:23.870684] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-14T18:14:23.871502] [DEBUG] [LOCAL ] GFF: Trimmed 33948 records to 22815 (keeping 150 days of data) [2025-09-14T18:14:24.036970] [DEBUG] [LOCAL ] GFF: Primary data saved (22815 records). [2025-09-14T18:14:24.037143] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-14T18:14:24.037242] [INFO ] [MAIN ] Update Progress: 919/2370 symbols completed. GFF took 19.5s. Estimated remaining: 2h 33m 29s. Rate: 9.5 symbols/min [2025-09-14T18:14:24.616295] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-14T18:14:24.627872] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-14T18:14:25.308216] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:14:25.313802] [INFO ] [REMOTE ] GEV: Full fetch complete (57828 records). [2025-09-14T18:14:25.313949] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-14T18:14:25.699464] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-14T18:14:25.699611] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-14T18:14:25.700561] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-14T18:14:25.700631] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-14T18:14:25.702080] [DEBUG] [LOCAL ] GEV: Trimmed 57828 records to 39972 (keeping 150 days of data) [2025-09-14T18:14:25.960875] [DEBUG] [LOCAL ] GEV: Primary data saved (39972 records). [2025-09-14T18:14:25.961063] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-14T18:14:25.961162] [INFO ] [MAIN ] Update Progress: 920/2370 symbols completed. GEV took 25.8s. Estimated remaining: 2h 33m 15s. Rate: 9.5 symbols/min [2025-09-14T18:14:26.447293] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:26.640629] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:26.677354] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:26.672997] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:26.683273] [DEBUG] [LOCAL ] GFR: Loaded 2403 existing records from primary storage. [2025-09-14T18:14:26.683505] [INFO ] [MAIN ] GFR: Loaded 2403 existing records. [2025-09-14T18:14:26.826754] [DEBUG] [LOCAL ] GGB: Loaded 23072 existing records from primary storage. [2025-09-14T18:14:26.827658] [DEBUG] [LOCAL ] GFI: Loaded 23660 existing records from primary storage. [2025-09-14T18:14:26.877978] [INFO ] [MAIN ] GFI: Loaded 23660 existing records. [2025-09-14T18:14:26.854132] [DEBUG] [LOCAL ] GFL: Loaded 20702 existing records from primary storage. [2025-09-14T18:14:26.906040] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:26.878058] [INFO ] [MAIN ] GGB: Loaded 23072 existing records. [2025-09-14T18:14:26.917427] [INFO ] [MAIN ] GFL: Loaded 20702 existing records. [2025-09-14T18:14:26.917520] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-14T18:14:27.005040] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-14T18:14:27.133524] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-14T18:14:27.229166] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-14T18:14:27.388877] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:27.632264] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:27.714472] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:27.733760] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-14T18:14:27.743352] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-14T18:14:27.752018] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-14T18:14:27.768904] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-14T18:14:27.751850] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-14T18:14:27.815487] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-14T18:14:27.821411] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-14T18:14:27.826762] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-14T18:14:27.826857] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-14T18:14:27.845487] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-14T18:14:27.845604] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-14T18:14:27.845752] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-14T18:14:28.183927] [INFO ] [REMOTE ] GFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:28.271636] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-14T18:14:28.981457] [INFO ] [REMOTE ] GFL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:29.037599] [INFO ] [REMOTE ] GFI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:29.062389] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-14T18:14:29.062670] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-14T18:14:29.082866] [INFO ] [REMOTE ] GGB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:29.084748] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-14T18:14:29.202186] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T18:14:29.205728] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-14T18:14:30.144697] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T18:14:30.148358] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-14T18:14:30.749979] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:14:30.760949] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-14T18:14:30.803266] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T18:14:30.824500] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-14T18:14:30.828021] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T18:14:30.832093] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-14T18:14:31.056401] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:14:31.067345] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-14T18:14:31.639692] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T18:14:31.758967] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-14T18:14:32.373979] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T18:14:32.432384] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:14:32.558869] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-14T18:14:32.730800] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:14:32.899738] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:14:33.358857] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-14T18:14:34.033745] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T18:14:34.158799] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-14T18:14:34.370800] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:14:34.743527] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T18:14:34.958851] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-14T18:14:35.758831] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-14T18:14:36.333204] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:14:36.334394] [INFO ] [REMOTE ] GFR: Full fetch complete (9156 records). [2025-09-14T18:14:36.334507] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-14T18:14:36.564022] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-14T18:14:36.702913] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-14T18:14:36.703032] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-14T18:14:36.703304] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-14T18:14:36.703358] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-14T18:14:36.703850] [DEBUG] [LOCAL ] GFR: Trimmed 9156 records to 5201 (keeping 150 days of data) [2025-09-14T18:14:36.732323] [DEBUG] [LOCAL ] GFR: Primary data saved (5201 records). [2025-09-14T18:14:36.732456] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-14T18:14:36.732555] [INFO ] [MAIN ] Update Progress: 921/2370 symbols completed. GFR took 10.8s. Estimated remaining: 2h 33m 16s. Rate: 9.5 symbols/min [2025-09-14T18:14:36.903326] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:36.920853] [DEBUG] [LOCAL ] GGG: Loaded 17558 existing records from primary storage. [2025-09-14T18:14:36.921024] [INFO ] [MAIN ] GGG: Loaded 17558 existing records. [2025-09-14T18:14:37.108912] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:37.109317] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-14T18:14:37.109448] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-14T18:14:37.110127] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-14T18:14:37.110196] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-14T18:14:37.360662] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-14T18:14:37.485967] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-14T18:14:37.535996] [INFO ] [REMOTE ] GGG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:38.158848] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-14T18:14:38.537492] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T18:14:38.958887] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-14T18:14:39.173322] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:14:39.261924] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:14:39.758831] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-14T18:14:40.558875] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-14T18:14:40.838687] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T18:14:41.031386] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T18:14:41.358863] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-14T18:14:42.158822] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-14T18:14:42.471291] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:14:42.956907] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:14:42.966482] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-14T18:14:43.758800] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-14T18:14:43.860682] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:14:44.558847] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-14T18:14:44.690147] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:14:45.358795] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-14T18:14:45.751192] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T18:14:46.132508] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:14:46.158779] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-14T18:14:46.919798] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:14:46.958801] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-14T18:14:47.528732] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T18:14:47.758842] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-14T18:14:48.558843] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-14T18:14:48.598688] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T18:14:48.603879] [INFO ] [REMOTE ] GGB: Full fetch complete (55417 records). [2025-09-14T18:14:48.603998] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-14T18:14:48.992538] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-14T18:14:48.992686] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-14T18:14:48.993471] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-14T18:14:48.993525] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-14T18:14:48.994804] [DEBUG] [LOCAL ] GGB: Trimmed 55417 records to 38585 (keeping 150 days of data) [2025-09-14T18:14:49.241182] [DEBUG] [LOCAL ] GGB: Primary data saved (38585 records). [2025-09-14T18:14:49.241373] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-14T18:14:49.241483] [INFO ] [MAIN ] Update Progress: 922/2370 symbols completed. GGB took 23.3s. Estimated remaining: 2h 33m 19s. Rate: 9.4 symbols/min [2025-09-14T18:14:49.363942] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-14T18:14:49.427744] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:49.437000] [DEBUG] [LOCAL ] GGT: Loaded 6258 existing records from primary storage. [2025-09-14T18:14:49.437175] [INFO ] [MAIN ] GGT: Loaded 6258 existing records. [2025-09-14T18:14:49.618616] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:49.619628] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-14T18:14:49.619711] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-14T18:14:49.620397] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-14T18:14:49.620458] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-14T18:14:49.997771] [INFO ] [REMOTE ] GGT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:50.029270] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-14T18:14:50.158825] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-14T18:14:50.289651] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:14:50.651783] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T18:14:50.958826] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-14T18:14:51.758855] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-14T18:14:52.312936] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T18:14:52.453876] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T18:14:52.458834] [INFO ] [REMOTE ] GFL: Full fetch complete (52375 records). [2025-09-14T18:14:52.458953] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-14T18:14:52.558971] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-14T18:14:52.617575] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:14:52.847423] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-14T18:14:52.847539] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-14T18:14:52.848342] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-14T18:14:52.848401] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-14T18:14:52.849503] [DEBUG] [LOCAL ] GFL: Trimmed 52375 records to 35480 (keeping 150 days of data) [2025-09-14T18:14:53.121486] [DEBUG] [LOCAL ] GFL: Primary data saved (35480 records). [2025-09-14T18:14:53.121738] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-14T18:14:53.121924] [INFO ] [MAIN ] Update Progress: 923/2370 symbols completed. GFL took 27.2s. Estimated remaining: 2h 33m 9s. Rate: 9.4 symbols/min [2025-09-14T18:14:53.313337] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:53.317192] [DEBUG] [LOCAL ] GGZ: Loaded 959 existing records from primary storage. [2025-09-14T18:14:53.317310] [INFO ] [MAIN ] GGZ: Loaded 959 existing records. [2025-09-14T18:14:53.364016] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-14T18:14:53.517837] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:53.518182] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-14T18:14:53.518264] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-14T18:14:53.518636] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-14T18:14:53.518753] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-14T18:14:53.930022] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:54.158816] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-14T18:14:54.237920] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T18:14:54.492205] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-14T18:14:54.958909] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-14T18:14:55.308828] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-14T18:14:55.314827] [INFO ] [REMOTE ] GFI: Full fetch complete (57717 records). [2025-09-14T18:14:55.314983] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-14T18:14:55.725142] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-14T18:14:55.725283] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-14T18:14:55.726352] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-14T18:14:55.726432] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-14T18:14:55.727963] [DEBUG] [LOCAL ] GFI: Trimmed 57717 records to 39887 (keeping 150 days of data) [2025-09-14T18:14:55.785188] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-14T18:14:55.994414] [DEBUG] [LOCAL ] GFI: Primary data saved (39887 records). [2025-09-14T18:14:55.994617] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-14T18:14:55.994762] [INFO ] [MAIN ] Update Progress: 924/2370 symbols completed. GFI took 30.0s. Estimated remaining: 2h 32m 57s. Rate: 9.5 symbols/min [2025-09-14T18:14:56.162889] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:56.166282] [DEBUG] [LOCAL ] GHC: Loaded 1325 existing records from primary storage. [2025-09-14T18:14:56.166381] [INFO ] [MAIN ] GHC: Loaded 1325 existing records. [2025-09-14T18:14:56.345659] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:56.346101] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-14T18:14:56.346235] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-14T18:14:56.346522] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-14T18:14:56.346582] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-14T18:14:56.582379] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-14T18:14:56.649299] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:14:56.667672] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:14:56.811758] [INFO ] [REMOTE ] GHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:57.152606] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T18:14:57.358893] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-14T18:14:58.007349] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T18:14:58.158883] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-14T18:14:58.958883] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-14T18:14:59.049313] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:14:59.758912] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-14T18:15:00.349137] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T18:15:00.558913] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-14T18:15:00.953087] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T18:15:01.358887] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-14T18:15:01.532117] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T18:15:01.536264] [INFO ] [REMOTE ] GGG: Full fetch complete (44546 records). [2025-09-14T18:15:01.536419] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-14T18:15:01.996240] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-14T18:15:01.996385] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-14T18:15:01.997303] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-14T18:15:01.997369] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-14T18:15:01.998755] [DEBUG] [LOCAL ] GGG: Trimmed 44546 records to 30224 (keeping 150 days of data) [2025-09-14T18:15:02.168981] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-14T18:15:02.208340] [DEBUG] [LOCAL ] GGG: Primary data saved (30224 records). [2025-09-14T18:15:02.208789] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-14T18:15:02.208927] [INFO ] [MAIN ] Update Progress: 925/2370 symbols completed. GGG took 25.5s. Estimated remaining: 2h 32m 51s. Rate: 9.5 symbols/min [2025-09-14T18:15:02.383703] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:02.387324] [DEBUG] [LOCAL ] GHG: Loaded 1297 existing records from primary storage. [2025-09-14T18:15:02.387493] [INFO ] [MAIN ] GHG: Loaded 1297 existing records. [2025-09-14T18:15:02.570268] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:02.570575] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-14T18:15:02.570637] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-14T18:15:02.570891] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-14T18:15:02.570951] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-14T18:15:02.932583] [INFO ] [REMOTE ] GHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:02.958819] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-14T18:15:02.971269] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T18:15:03.758896] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-14T18:15:04.558895] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-14T18:15:04.917105] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T18:15:05.203200] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-09-14T18:15:05.269064] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-14T18:15:05.314464] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-14T18:15:05.358812] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-14T18:15:05.859214] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-14T18:15:06.158871] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-14T18:15:06.593398] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-14T18:15:06.958840] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-14T18:15:07.758881] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-14T18:15:07.812865] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T18:15:08.418407] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T18:15:08.558886] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-14T18:15:09.092672] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T18:15:09.358826] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-14T18:15:10.158824] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-14T18:15:10.303944] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T18:15:10.541331] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-14T18:15:10.958856] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-14T18:15:11.538101] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T18:15:11.758855] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-14T18:15:12.438033] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T18:15:12.558845] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-14T18:15:13.165432] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T18:15:13.358899] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-14T18:15:14.158887] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-14T18:15:14.593660] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T18:15:14.595946] [INFO ] [REMOTE ] GGT: Full fetch complete (14853 records). [2025-09-14T18:15:14.596052] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-14T18:15:14.964004] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-14T18:15:15.004244] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-14T18:15:15.004379] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-14T18:15:15.004823] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-14T18:15:15.004892] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-14T18:15:15.005943] [DEBUG] [LOCAL ] GGT: Trimmed 14853 records to 11004 (keeping 150 days of data) [2025-09-14T18:15:15.080407] [DEBUG] [LOCAL ] GGT: Primary data saved (11004 records). [2025-09-14T18:15:15.080658] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-14T18:15:15.080803] [INFO ] [MAIN ] Update Progress: 926/2370 symbols completed. GGT took 25.8s. Estimated remaining: 2h 32m 55s. Rate: 9.4 symbols/min [2025-09-14T18:15:15.254065] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:15.259893] [DEBUG] [LOCAL ] GHI: Loaded 3414 existing records from primary storage. [2025-09-14T18:15:15.260066] [INFO ] [MAIN ] GHI: Loaded 3414 existing records. [2025-09-14T18:15:15.436922] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:15.437275] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-14T18:15:15.437358] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-14T18:15:15.437763] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-14T18:15:15.437841] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-14T18:15:15.764188] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-14T18:15:15.819616] [INFO ] [REMOTE ] GHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:15.821859] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:15:15.952293] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T18:15:16.558905] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-14T18:15:16.565450] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:15:16.566710] [INFO ] [REMOTE ] GGZ: Full fetch complete (2730 records). [2025-09-14T18:15:16.566836] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-14T18:15:17.036719] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-14T18:15:17.036851] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-14T18:15:17.037007] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-14T18:15:17.037060] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-14T18:15:17.037489] [DEBUG] [LOCAL ] GGZ: Trimmed 2730 records to 1716 (keeping 150 days of data) [2025-09-14T18:15:17.048673] [DEBUG] [LOCAL ] GGZ: Primary data saved (1716 records). [2025-09-14T18:15:17.048764] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-14T18:15:17.048874] [INFO ] [MAIN ] Update Progress: 927/2370 symbols completed. GGZ took 23.9s. Estimated remaining: 2h 32m 41s. Rate: 9.5 symbols/min [2025-09-14T18:15:17.233722] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:17.238031] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:15:17.244424] [DEBUG] [LOCAL ] GHLD: Loaded 2795 existing records from primary storage. [2025-09-14T18:15:17.244668] [INFO ] [MAIN ] GHLD: Loaded 2795 existing records. [2025-09-14T18:15:17.363910] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-14T18:15:17.468245] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:17.468595] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-14T18:15:17.468677] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-14T18:15:17.468969] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-14T18:15:17.469033] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-14T18:15:17.842719] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:18.158879] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-14T18:15:18.220959] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:15:18.541004] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T18:15:18.958898] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-14T18:15:19.608603] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T18:15:19.758853] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-14T18:15:20.440770] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:15:20.558844] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-14T18:15:21.334047] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T18:15:21.358808] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-14T18:15:22.149422] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T18:15:22.158771] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-14T18:15:22.671154] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T18:15:22.958866] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-14T18:15:23.700879] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-14T18:15:23.758838] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-14T18:15:24.066669] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T18:15:24.067563] [INFO ] [REMOTE ] GHC: Full fetch complete (2680 records). [2025-09-14T18:15:24.067665] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-14T18:15:24.424072] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-14T18:15:24.424222] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-14T18:15:24.424396] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-14T18:15:24.424470] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-14T18:15:24.425092] [DEBUG] [LOCAL ] GHC: Trimmed 2680 records to 2078 (keeping 150 days of data) [2025-09-14T18:15:24.439579] [DEBUG] [LOCAL ] GHC: Primary data saved (2078 records). [2025-09-14T18:15:24.439790] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-14T18:15:24.439929] [INFO ] [MAIN ] Update Progress: 928/2370 symbols completed. GHC took 28.4s. Estimated remaining: 2h 32m 37s. Rate: 9.4 symbols/min [2025-09-14T18:15:24.563990] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-14T18:15:24.624508] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:24.633848] [DEBUG] [LOCAL ] GHM: Loaded 6887 existing records from primary storage. [2025-09-14T18:15:24.634027] [INFO ] [MAIN ] GHM: Loaded 6887 existing records. [2025-09-14T18:15:24.807586] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:24.807904] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-14T18:15:24.807964] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-14T18:15:24.808288] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-14T18:15:24.808350] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-14T18:15:25.162106] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-14T18:15:25.161991] [INFO ] [REMOTE ] GHM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:25.358817] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-14T18:15:26.158884] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-14T18:15:26.658956] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T18:15:26.958869] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-14T18:15:27.548682] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T18:15:27.555175] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T18:15:27.758841] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-14T18:15:28.558844] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-14T18:15:28.768180] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T18:15:29.115757] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:15:29.117814] [INFO ] [REMOTE ] GHG: Full fetch complete (3344 records). [2025-09-14T18:15:29.118135] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-14T18:15:29.364034] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-14T18:15:29.484052] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-14T18:15:29.484189] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-14T18:15:29.484368] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-14T18:15:29.484423] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-14T18:15:29.484818] [DEBUG] [LOCAL ] GHG: Trimmed 3344 records to 2514 (keeping 150 days of data) [2025-09-14T18:15:29.499916] [DEBUG] [LOCAL ] GHG: Primary data saved (2514 records). [2025-09-14T18:15:29.500059] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-14T18:15:29.500172] [INFO ] [MAIN ] Update Progress: 929/2370 symbols completed. GHG took 27.3s. Estimated remaining: 2h 32m 28s. Rate: 9.5 symbols/min [2025-09-14T18:15:29.670504] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:29.681495] [DEBUG] [LOCAL ] GHY: Loaded 9224 existing records from primary storage. [2025-09-14T18:15:29.681681] [INFO ] [MAIN ] GHY: Loaded 9224 existing records. [2025-09-14T18:15:29.855164] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:29.855472] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-14T18:15:29.855557] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-14T18:15:29.855996] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-14T18:15:29.856058] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-14T18:15:30.164025] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-14T18:15:30.219380] [INFO ] [REMOTE ] GHY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:30.359002] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T18:15:30.710121] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T18:15:30.958832] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-14T18:15:31.758887] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-14T18:15:31.868616] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:15:32.558904] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-14T18:15:32.585997] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:15:33.128774] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-14T18:15:33.358842] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-14T18:15:34.158851] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-14T18:15:34.411610] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:15:34.958893] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-14T18:15:35.017951] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:15:35.758905] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-14T18:15:36.059187] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T18:15:36.413698] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T18:15:36.558842] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-14T18:15:37.358873] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-14T18:15:37.511568] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T18:15:38.019619] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:15:38.020893] [INFO ] [REMOTE ] GHI: Full fetch complete (7562 records). [2025-09-14T18:15:38.020976] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-14T18:15:38.164021] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-14T18:15:38.390438] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-14T18:15:38.390566] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-14T18:15:38.390815] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-14T18:15:38.390878] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-14T18:15:38.391400] [DEBUG] [LOCAL ] GHI: Trimmed 7562 records to 5287 (keeping 150 days of data) [2025-09-14T18:15:38.423621] [DEBUG] [LOCAL ] GHI: Primary data saved (5287 records). [2025-09-14T18:15:38.423769] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-14T18:15:38.423881] [INFO ] [MAIN ] Update Progress: 930/2370 symbols completed. GHI took 23.3s. Estimated remaining: 2h 32m 26s. Rate: 9.4 symbols/min [2025-09-14T18:15:38.594000] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:38.611618] [DEBUG] [LOCAL ] GIB: Loaded 14392 existing records from primary storage. [2025-09-14T18:15:38.611830] [INFO ] [MAIN ] GIB: Loaded 14392 existing records. [2025-09-14T18:15:38.789406] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:38.789719] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-14T18:15:38.789781] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-14T18:15:38.790270] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-14T18:15:38.790341] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-14T18:15:38.966870] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-14T18:15:39.152667] [INFO ] [REMOTE ] GIB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:39.389711] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T18:15:39.748660] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T18:15:39.758773] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-14T18:15:40.318164] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:15:40.319387] [INFO ] [REMOTE ] GHLD: Full fetch complete (4015 records). [2025-09-14T18:15:40.319475] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-14T18:15:40.563999] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-14T18:15:40.677945] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-14T18:15:40.678072] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-14T18:15:40.678246] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-14T18:15:40.678298] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-14T18:15:40.678801] [DEBUG] [LOCAL ] GHLD: Trimmed 4015 records to 3308 (keeping 150 days of data) [2025-09-14T18:15:40.700129] [DEBUG] [LOCAL ] GHLD: Primary data saved (3308 records). [2025-09-14T18:15:40.700285] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-14T18:15:40.700386] [INFO ] [MAIN ] Update Progress: 931/2370 symbols completed. GHLD took 23.7s. Estimated remaining: 2h 32m 13s. Rate: 9.5 symbols/min [2025-09-14T18:15:40.875011] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:40.882906] [DEBUG] [LOCAL ] GIC: Loaded 6401 existing records from primary storage. [2025-09-14T18:15:40.883063] [INFO ] [MAIN ] GIC: Loaded 6401 existing records. [2025-09-14T18:15:41.064742] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:41.065047] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-14T18:15:41.065144] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-14T18:15:41.065563] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-14T18:15:41.065665] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-14T18:15:41.363913] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-14T18:15:41.421522] [INFO ] [REMOTE ] GIC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:42.071211] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:15:42.158805] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-14T18:15:42.534259] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T18:15:42.958826] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-14T18:15:43.730538] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T18:15:43.758776] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-14T18:15:43.983749] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T18:15:44.558875] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-14T18:15:45.349141] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:15:45.358763] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-14T18:15:45.773551] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T18:15:46.114204] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T18:15:46.158819] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-14T18:15:46.958803] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-14T18:15:47.264434] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T18:15:47.758864] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-14T18:15:47.967056] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T18:15:48.372071] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:15:48.373905] [INFO ] [REMOTE ] GHM: Full fetch complete (16356 records). [2025-09-14T18:15:48.374010] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-14T18:15:48.566689] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-14T18:15:48.756259] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-14T18:15:48.756378] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-14T18:15:48.756887] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-14T18:15:48.756951] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-14T18:15:48.758609] [DEBUG] [LOCAL ] GHM: Trimmed 16356 records to 10444 (keeping 150 days of data) [2025-09-14T18:15:48.827307] [DEBUG] [LOCAL ] GHM: Primary data saved (10444 records). [2025-09-14T18:15:48.827484] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-14T18:15:48.827616] [INFO ] [MAIN ] Update Progress: 932/2370 symbols completed. GHM took 24.4s. Estimated remaining: 2h 32m 10s. Rate: 9.5 symbols/min [2025-09-14T18:15:48.997590] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:49.020772] [DEBUG] [LOCAL ] GIL: Loaded 19297 existing records from primary storage. [2025-09-14T18:15:49.020964] [INFO ] [MAIN ] GIL: Loaded 19297 existing records. [2025-09-14T18:15:49.194169] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:49.194449] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-14T18:15:49.194507] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-14T18:15:49.195185] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-14T18:15:49.195250] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-14T18:15:49.366309] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-14T18:15:49.551191] [INFO ] [REMOTE ] GIL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:49.683387] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T18:15:50.158870] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-14T18:15:50.862006] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:15:50.958810] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-14T18:15:51.717489] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:15:51.758799] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-14T18:15:51.932725] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T18:15:52.558886] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-14T18:15:53.349939] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:15:53.358856] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-14T18:15:53.767176] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:15:54.158844] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-14T18:15:54.846536] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T18:15:54.927757] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T18:15:54.958788] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-14T18:15:55.758871] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-14T18:15:55.798494] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:15:56.558878] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-14T18:15:56.898048] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T18:15:57.358881] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-14T18:15:57.458924] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T18:15:58.158819] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-14T18:15:58.832051] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:15:58.958858] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-14T18:15:59.758870] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-14T18:15:59.818951] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:15:59.990760] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T18:16:00.558886] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-14T18:16:01.121263] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T18:16:01.124872] [INFO ] [REMOTE ] GIB: Full fetch complete (35466 records). [2025-09-14T18:16:01.124976] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-14T18:16:01.363947] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-14T18:16:01.511969] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-14T18:16:01.512122] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-14T18:16:01.513204] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-14T18:16:01.513284] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-14T18:16:01.514370] [DEBUG] [LOCAL ] GIB: Trimmed 35466 records to 23149 (keeping 150 days of data) [2025-09-14T18:16:01.644408] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:16:01.648187] [INFO ] [REMOTE ] GIC: Full fetch complete (15189 records). [2025-09-14T18:16:01.648541] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-14T18:16:02.045586] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-14T18:16:02.045927] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-14T18:16:02.046393] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-14T18:16:02.046975] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-14T18:16:02.052746] [DEBUG] [LOCAL ] GIC: Trimmed 15189 records to 10183 (keeping 150 days of data) [2025-09-14T18:16:02.130381] [DEBUG] [LOCAL ] GIB: Primary data saved (23149 records). [2025-09-14T18:16:02.131338] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-14T18:16:02.131498] [INFO ] [MAIN ] Update Progress: 933/2370 symbols completed. GIB took 23.7s. Estimated remaining: 2h 32m 14s. Rate: 9.4 symbols/min [2025-09-14T18:16:02.163680] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-14T18:16:02.290591] [DEBUG] [LOCAL ] GIC: Primary data saved (10183 records). [2025-09-14T18:16:02.321035] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:02.321126] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-14T18:16:02.321337] [INFO ] [MAIN ] Update Progress: 934/2370 symbols completed. GIC took 21.6s. Estimated remaining: 2h 31m 58s. Rate: 9.4 symbols/min [2025-09-14T18:16:02.501537] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:02.510075] [DEBUG] [LOCAL ] GIS: Loaded 24107 existing records from primary storage. [2025-09-14T18:16:02.510487] [INFO ] [MAIN ] GIS: Loaded 24107 existing records. [2025-09-14T18:16:02.701185] [DEBUG] [LOCAL ] GKOS: Loaded 18710 existing records from primary storage. [2025-09-14T18:16:02.701305] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:02.701497] [INFO ] [MAIN ] GKOS: Loaded 18710 existing records. [2025-09-14T18:16:02.782289] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-14T18:16:02.803665] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-14T18:16:02.830399] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-14T18:16:02.863247] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-14T18:16:02.887216] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:02.962979] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-14T18:16:02.991223] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-14T18:16:02.997196] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-14T18:16:03.019204] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-14T18:16:03.390138] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T18:16:03.522825] [INFO ] [REMOTE ] GHY: Full fetch complete (23051 records). [2025-09-14T18:16:03.546611] [INFO ] [REMOTE ] GIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:03.565669] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-14T18:16:03.565561] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-14T18:16:03.761913] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:03.771314] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-14T18:16:03.783766] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-14T18:16:04.051390] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-14T18:16:04.051531] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-14T18:16:04.052124] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-14T18:16:04.052188] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-14T18:16:04.052988] [DEBUG] [LOCAL ] GHY: Trimmed 23051 records to 15424 (keeping 150 days of data) [2025-09-14T18:16:04.158853] [DEBUG] [LOCAL ] GHY: Primary data saved (15424 records). [2025-09-14T18:16:04.159041] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-14T18:16:04.159162] [INFO ] [MAIN ] Update Progress: 935/2370 symbols completed. GHY took 34.7s. Estimated remaining: 2h 31m 45s. Rate: 9.5 symbols/min [2025-09-14T18:16:04.338801] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:04.356716] [DEBUG] [LOCAL ] GL: Loaded 16711 existing records from primary storage. [2025-09-14T18:16:04.356902] [INFO ] [MAIN ] GL: Loaded 16711 existing records. [2025-09-14T18:16:04.529859] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:04.530144] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-14T18:16:04.530201] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-14T18:16:04.530810] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-14T18:16:04.530872] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-14T18:16:04.572395] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-14T18:16:04.879050] [INFO ] [REMOTE ] GL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:05.361762] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-14T18:16:05.368421] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:16:05.570234] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T18:16:06.072119] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:16:06.158860] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-14T18:16:06.958875] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-14T18:16:06.988995] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T18:16:07.758853] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-14T18:16:07.825804] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:16:08.558840] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-14T18:16:09.140313] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-14T18:16:09.358916] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-14T18:16:09.711439] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:16:10.158896] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-14T18:16:10.458815] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:16:10.958902] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-14T18:16:11.189220] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:16:11.758851] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-14T18:16:11.907615] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:16:12.070047] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T18:16:12.074971] [INFO ] [REMOTE ] GIL: Full fetch complete (46542 records). [2025-09-14T18:16:12.075096] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-14T18:16:12.454847] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-14T18:16:12.454976] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-14T18:16:12.458120] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-14T18:16:12.458210] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-14T18:16:12.459367] [DEBUG] [LOCAL ] GIL: Trimmed 46542 records to 32288 (keeping 150 days of data) [2025-09-14T18:16:12.558877] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-14T18:16:12.671707] [DEBUG] [LOCAL ] GIL: Primary data saved (32288 records). [2025-09-14T18:16:12.671904] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-14T18:16:12.672006] [INFO ] [MAIN ] Update Progress: 936/2370 symbols completed. GIL took 23.8s. Estimated remaining: 2h 31m 42s. Rate: 9.5 symbols/min [2025-09-14T18:16:12.845746] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:12.867574] [DEBUG] [LOCAL ] GLOB: Loaded 21977 existing records from primary storage. [2025-09-14T18:16:12.867783] [INFO ] [MAIN ] GLOB: Loaded 21977 existing records. [2025-09-14T18:16:13.044904] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:13.045191] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-14T18:16:13.045252] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-14T18:16:13.045971] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-14T18:16:13.046037] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-14T18:16:13.363977] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-14T18:16:13.431164] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:13.944598] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T18:16:14.158815] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-14T18:16:14.250685] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:16:14.835084] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:16:14.958889] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-14T18:16:15.758871] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-14T18:16:16.224955] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T18:16:16.290732] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T18:16:16.558852] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-14T18:16:17.297592] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:16:17.358866] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-14T18:16:18.158858] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-14T18:16:18.663068] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-14T18:16:18.958896] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-14T18:16:19.134971] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:16:19.750380] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T18:16:19.758767] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-14T18:16:20.558906] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-14T18:16:20.787047] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:16:21.358888] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-14T18:16:21.508671] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T18:16:22.064398] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:16:22.158806] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-14T18:16:22.826312] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:16:22.829947] [INFO ] [REMOTE ] GL: Full fetch complete (41707 records). [2025-09-14T18:16:22.830075] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-14T18:16:22.973195] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-14T18:16:23.208189] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-14T18:16:23.208329] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-14T18:16:23.209273] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-14T18:16:23.209335] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-14T18:16:23.210519] [DEBUG] [LOCAL ] GL: Trimmed 41707 records to 28207 (keeping 150 days of data) [2025-09-14T18:16:23.434661] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T18:16:23.452307] [DEBUG] [LOCAL ] GL: Primary data saved (28207 records). [2025-09-14T18:16:23.452507] [INFO ] [MAIN ] GL: Full history saved. [2025-09-14T18:16:23.452626] [INFO ] [MAIN ] Update Progress: 937/2370 symbols completed. GL took 19.3s. Estimated remaining: 2h 31m 42s. Rate: 9.4 symbols/min [2025-09-14T18:16:23.631462] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:23.638054] [DEBUG] [LOCAL ] GLP: Loaded 4318 existing records from primary storage. [2025-09-14T18:16:23.638272] [INFO ] [MAIN ] GLP: Loaded 4318 existing records. [2025-09-14T18:16:23.764002] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-14T18:16:23.826288] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:23.826637] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-14T18:16:23.826733] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-14T18:16:23.827077] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-14T18:16:23.827139] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-14T18:16:24.181089] [INFO ] [REMOTE ] GLP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:24.562529] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-14T18:16:24.565933] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:16:24.574120] [INFO ] [REMOTE ] GIS: Full fetch complete (58353 records). [2025-09-14T18:16:24.574315] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-14T18:16:24.957116] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:16:24.999927] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-14T18:16:25.000424] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-14T18:16:25.001352] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-14T18:16:25.001492] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-14T18:16:25.002755] [DEBUG] [LOCAL ] GIS: Trimmed 58353 records to 40420 (keeping 150 days of data) [2025-09-14T18:16:25.262339] [DEBUG] [LOCAL ] GIS: Primary data saved (40420 records). [2025-09-14T18:16:25.262527] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-14T18:16:25.262663] [INFO ] [MAIN ] Update Progress: 938/2370 symbols completed. GIS took 23.1s. Estimated remaining: 2h 31m 29s. Rate: 9.5 symbols/min [2025-09-14T18:16:25.361713] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-14T18:16:25.434349] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:25.457818] [DEBUG] [LOCAL ] GLW: Loaded 24014 existing records from primary storage. [2025-09-14T18:16:25.458020] [INFO ] [MAIN ] GLW: Loaded 24014 existing records. [2025-09-14T18:16:25.636749] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:25.637041] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-14T18:16:25.637101] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-14T18:16:25.637904] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-14T18:16:25.637970] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-14T18:16:25.985255] [INFO ] [REMOTE ] GLW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:26.068875] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:16:26.155892] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T18:16:26.160530] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-14T18:16:26.816537] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T18:16:26.958878] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-14T18:16:27.758909] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-14T18:16:28.479511] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-14T18:16:28.558842] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-14T18:16:28.637928] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:16:29.358889] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-14T18:16:29.515672] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T18:16:30.158844] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-14T18:16:30.882655] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T18:16:30.958916] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-14T18:16:31.140087] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T18:16:31.758896] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-14T18:16:31.865818] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T18:16:32.448830] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:16:32.454046] [INFO ] [REMOTE ] GKOS: Full fetch complete (46534 records). [2025-09-14T18:16:32.454257] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-14T18:16:32.558956] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-14T18:16:32.855851] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-14T18:16:32.855977] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-14T18:16:32.856758] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-14T18:16:32.856829] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-14T18:16:32.857937] [DEBUG] [LOCAL ] GKOS: Trimmed 46534 records to 31951 (keeping 150 days of data) [2025-09-14T18:16:33.060543] [DEBUG] [LOCAL ] GKOS: Primary data saved (31951 records). [2025-09-14T18:16:33.060750] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-14T18:16:33.060856] [INFO ] [MAIN ] Update Progress: 939/2370 symbols completed. GKOS took 30.7s. Estimated remaining: 2h 31m 25s. Rate: 9.5 symbols/min [2025-09-14T18:16:33.230327] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:33.253415] [DEBUG] [LOCAL ] GM: Loaded 24091 existing records from primary storage. [2025-09-14T18:16:33.253600] [INFO ] [MAIN ] GM: Loaded 24091 existing records. [2025-09-14T18:16:33.363876] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-14T18:16:33.438252] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:33.438560] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-14T18:16:33.438690] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-14T18:16:33.439440] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-14T18:16:33.439516] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-14T18:16:33.587364] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T18:16:33.799495] [INFO ] [REMOTE ] GM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:34.158814] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-14T18:16:34.273110] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T18:16:34.767143] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T18:16:34.958853] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-14T18:16:35.758860] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-14T18:16:36.558842] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-14T18:16:36.638877] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:16:36.807772] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T18:16:37.358889] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-14T18:16:37.562460] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:16:37.860561] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T18:16:38.158832] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-14T18:16:38.958869] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-14T18:16:39.111747] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T18:16:39.510816] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-14T18:16:39.758900] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-14T18:16:40.558891] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-14T18:16:41.358978] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-14T18:16:41.439998] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:16:41.442458] [INFO ] [REMOTE ] GLP: Full fetch complete (10449 records). [2025-09-14T18:16:41.442593] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-14T18:16:41.802138] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T18:16:41.888532] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-14T18:16:41.888691] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-14T18:16:41.888965] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-14T18:16:41.889126] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-14T18:16:41.889742] [DEBUG] [LOCAL ] GLP: Trimmed 10449 records to 7000 (keeping 150 days of data) [2025-09-14T18:16:41.934119] [DEBUG] [LOCAL ] GLP: Primary data saved (7000 records). [2025-09-14T18:16:41.934306] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-14T18:16:41.934531] [INFO ] [MAIN ] Update Progress: 940/2370 symbols completed. GLP took 18.5s. Estimated remaining: 2h 31m 22s. Rate: 9.4 symbols/min [2025-09-14T18:16:42.106076] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T18:16:42.169690] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-14T18:16:42.173118] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:42.197810] [DEBUG] [LOCAL ] GME: Loaded 24154 existing records from primary storage. [2025-09-14T18:16:42.197992] [INFO ] [MAIN ] GME: Loaded 24154 existing records. [2025-09-14T18:16:42.381622] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:42.381952] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-14T18:16:42.382016] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-14T18:16:42.382700] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-14T18:16:42.382766] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-14T18:16:42.734958] [INFO ] [REMOTE ] GME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:42.958831] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-14T18:16:43.758884] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-14T18:16:43.895257] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:16:44.089574] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T18:16:44.558845] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-14T18:16:44.763713] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T18:16:45.358818] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-14T18:16:46.158820] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-14T18:16:46.317264] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T18:16:46.360303] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:16:46.669122] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T18:16:46.958879] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-14T18:16:47.593329] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T18:16:47.758828] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-14T18:16:48.558805] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-14T18:16:48.714308] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:16:48.900525] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T18:16:48.906281] [INFO ] [REMOTE ] GLW: Full fetch complete (58306 records). [2025-09-14T18:16:48.906433] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-14T18:16:49.284954] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-14T18:16:49.285076] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-14T18:16:49.286036] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-14T18:16:49.286112] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-14T18:16:49.287429] [DEBUG] [LOCAL ] GLW: Trimmed 58306 records to 40377 (keeping 150 days of data) [2025-09-14T18:16:49.379124] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-14T18:16:49.559420] [DEBUG] [LOCAL ] GLW: Primary data saved (40377 records). [2025-09-14T18:16:49.559590] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-14T18:16:49.559706] [INFO ] [MAIN ] Update Progress: 941/2370 symbols completed. GLW took 24.3s. Estimated remaining: 2h 31m 18s. Rate: 9.4 symbols/min [2025-09-14T18:16:49.738355] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:49.760382] [DEBUG] [LOCAL ] GMED: Loaded 21411 existing records from primary storage. [2025-09-14T18:16:49.760570] [INFO ] [MAIN ] GMED: Loaded 21411 existing records. [2025-09-14T18:16:49.941779] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:49.942117] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-14T18:16:49.942181] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-14T18:16:49.942873] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-14T18:16:49.942937] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-14T18:16:50.165481] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-14T18:16:50.308891] [INFO ] [REMOTE ] GMED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:50.811132] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:16:50.817590] [INFO ] [REMOTE ] GM: Full fetch complete (58409 records). [2025-09-14T18:16:50.817804] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-14T18:16:50.966994] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-14T18:16:51.210023] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-14T18:16:51.210314] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-14T18:16:51.211437] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-14T18:16:51.223383] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-14T18:16:51.227287] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-14T18:16:51.233282] [INFO ] [REMOTE ] GLOB: Full fetch complete (50656 records). [2025-09-14T18:16:51.233437] [DEBUG] [LOCAL ] GM: Trimmed 58409 records to 40470 (keeping 150 days of data) [2025-09-14T18:16:51.234067] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-14T18:16:51.760467] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-14T18:16:51.838338] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-14T18:16:51.840491] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-14T18:16:51.843876] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-14T18:16:51.844660] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-14T18:16:51.850832] [DEBUG] [LOCAL ] GLOB: Trimmed 50656 records to 35854 (keeping 150 days of data) [2025-09-14T18:16:51.995438] [DEBUG] [LOCAL ] GM: Primary data saved (40470 records). [2025-09-14T18:16:51.996381] [INFO ] [MAIN ] GM: Full history saved. [2025-09-14T18:16:51.997435] [INFO ] [MAIN ] Update Progress: 942/2370 symbols completed. GM took 18.9s. Estimated remaining: 2h 31m 6s. Rate: 9.5 symbols/min [2025-09-14T18:16:52.256898] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:52.279374] [DEBUG] [LOCAL ] GMRE: Loaded 17252 existing records from primary storage. [2025-09-14T18:16:52.280578] [INFO ] [MAIN ] GMRE: Loaded 17252 existing records. [2025-09-14T18:16:52.474093] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:52.474571] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-14T18:16:52.474690] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-14T18:16:52.476106] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-14T18:16:52.476453] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-14T18:16:52.556128] [DEBUG] [LOCAL ] GLOB: Primary data saved (35854 records). [2025-09-14T18:16:52.585894] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-14T18:16:52.590913] [INFO ] [MAIN ] Update Progress: 943/2370 symbols completed. GLOB took 39.9s. Estimated remaining: 2h 30m 51s. Rate: 9.5 symbols/min [2025-09-14T18:16:52.985188] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:53.021080] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:53.021742] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-14T18:16:53.032860] [DEBUG] [LOCAL ] GNE: Loaded 10109 existing records from primary storage. [2025-09-14T18:16:53.033073] [INFO ] [MAIN ] GNE: Loaded 10109 existing records. [2025-09-14T18:16:53.209943] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:53.210201] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-14T18:16:53.210260] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-14T18:16:53.210699] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-14T18:16:53.210767] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-14T18:16:53.575171] [INFO ] [REMOTE ] GNE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:53.576074] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-14T18:16:53.608469] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T18:16:53.648484] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-14T18:16:54.128380] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T18:16:54.150967] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T18:16:54.158784] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-14T18:16:54.958868] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-14T18:16:55.649171] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T18:16:55.758830] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-14T18:16:56.558896] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-14T18:16:56.628315] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:16:56.773911] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:16:57.358842] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-14T18:16:58.158874] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-14T18:16:58.958954] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-14T18:16:59.164373] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:16:59.213307] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-14T18:16:59.264086] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T18:16:59.758840] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-14T18:16:59.873262] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T18:17:00.558914] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-14T18:17:01.358896] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-14T18:17:02.159456] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-14T18:17:02.718391] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-14T18:17:02.805489] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-14T18:17:02.958803] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-14T18:17:03.256309] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T18:17:03.758816] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-14T18:17:03.758883] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-14T18:17:04.558828] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-14T18:17:05.011227] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T18:17:05.358874] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-14T18:17:05.408137] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-14T18:17:05.965224] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:17:06.158858] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-14T18:17:06.958800] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-14T18:17:07.062798] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:17:07.758838] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-14T18:17:07.784783] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:17:08.019237] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:17:08.558855] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-14T18:17:09.358809] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-14T18:17:09.560156] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T18:17:10.158842] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-14T18:17:10.452181] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-14T18:17:10.958809] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-14T18:17:10.982000] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T18:17:11.758796] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-14T18:17:11.801239] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T18:17:11.803478] [INFO ] [REMOTE ] GNE: Full fetch complete (18062 records). [2025-09-14T18:17:11.803565] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-14T18:17:12.170209] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-14T18:17:12.170374] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-14T18:17:12.170999] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-14T18:17:12.171169] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-14T18:17:12.172209] [DEBUG] [LOCAL ] GNE: Trimmed 18062 records to 14647 (keeping 150 days of data) [2025-09-14T18:17:12.273363] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T18:17:12.309125] [DEBUG] [LOCAL ] GNE: Primary data saved (14647 records). [2025-09-14T18:17:12.309356] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-14T18:17:12.309540] [INFO ] [MAIN ] Update Progress: 944/2370 symbols completed. GNE took 19.7s. Estimated remaining: 2h 31m 4s. Rate: 9.4 symbols/min [2025-09-14T18:17:12.480308] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:12.498549] [DEBUG] [LOCAL ] GNK: Loaded 17582 existing records from primary storage. [2025-09-14T18:17:12.498793] [INFO ] [MAIN ] GNK: Loaded 17582 existing records. [2025-09-14T18:17:12.564055] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-14T18:17:12.681376] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:12.681735] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-14T18:17:12.681804] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-14T18:17:12.682388] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-14T18:17:12.682454] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-14T18:17:13.047220] [INFO ] [REMOTE ] GNK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:13.358856] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-14T18:17:13.827620] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:17:13.831626] [INFO ] [REMOTE ] GMRE: Full fetch complete (40252 records). [2025-09-14T18:17:13.831756] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-14T18:17:14.160587] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-14T18:17:14.204430] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-14T18:17:14.204579] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-14T18:17:14.205397] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-14T18:17:14.205695] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-14T18:17:14.206835] [DEBUG] [LOCAL ] GMRE: Trimmed 40252 records to 28453 (keeping 150 days of data) [2025-09-14T18:17:14.395756] [DEBUG] [LOCAL ] GMRE: Primary data saved (28453 records). [2025-09-14T18:17:14.395979] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-14T18:17:14.396168] [INFO ] [MAIN ] Update Progress: 945/2370 symbols completed. GMRE took 22.4s. Estimated remaining: 2h 30m 52s. Rate: 9.4 symbols/min [2025-09-14T18:17:14.579179] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:14.602249] [DEBUG] [LOCAL ] GNL: Loaded 20781 existing records from primary storage. [2025-09-14T18:17:14.602659] [INFO ] [MAIN ] GNL: Loaded 20781 existing records. [2025-09-14T18:17:14.832672] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-14T18:17:14.832831] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:14.844414] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-14T18:17:14.844491] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-14T18:17:14.845448] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-14T18:17:14.845550] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-14T18:17:14.962375] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-14T18:17:15.238588] [INFO ] [REMOTE ] GNL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:15.241630] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T18:17:15.758844] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-14T18:17:15.798693] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:17:16.558860] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-14T18:17:16.977621] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:17:16.983140] [INFO ] [REMOTE ] GMED: Full fetch complete (52615 records). [2025-09-14T18:17:16.983334] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-14T18:17:17.371510] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-14T18:17:17.392265] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-14T18:17:17.392635] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-14T18:17:17.394243] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-14T18:17:17.395020] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-14T18:17:17.436219] [DEBUG] [LOCAL ] GMED: Trimmed 52615 records to 36187 (keeping 150 days of data) [2025-09-14T18:17:17.441344] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T18:17:17.576554] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-14T18:17:17.712415] [DEBUG] [LOCAL ] GMED: Primary data saved (36187 records). [2025-09-14T18:17:17.712604] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-14T18:17:17.712759] [INFO ] [MAIN ] Update Progress: 946/2370 symbols completed. GMED took 28.2s. Estimated remaining: 2h 30m 41s. Rate: 9.5 symbols/min [2025-09-14T18:17:17.886591] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:17.909362] [DEBUG] [LOCAL ] GNRC: Loaded 20404 existing records from primary storage. [2025-09-14T18:17:17.909587] [INFO ] [MAIN ] GNRC: Loaded 20404 existing records. [2025-09-14T18:17:18.091340] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:18.091632] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-14T18:17:18.091717] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-14T18:17:18.092304] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-14T18:17:18.092367] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-14T18:17:18.163970] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-14T18:17:18.494612] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:18.903417] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:17:18.909231] [INFO ] [REMOTE ] GME: Full fetch complete (58435 records). [2025-09-14T18:17:18.909387] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-14T18:17:18.964112] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-14T18:17:19.299036] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-14T18:17:19.299200] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-14T18:17:19.300182] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-14T18:17:19.300330] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-14T18:17:19.301833] [DEBUG] [LOCAL ] GME: Trimmed 58435 records to 40527 (keeping 150 days of data) [2025-09-14T18:17:19.412057] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T18:17:19.591093] [DEBUG] [LOCAL ] GME: Primary data saved (40527 records). [2025-09-14T18:17:19.591273] [INFO ] [MAIN ] GME: Full history saved. [2025-09-14T18:17:19.591383] [INFO ] [MAIN ] Update Progress: 947/2370 symbols completed. GME took 37.7s. Estimated remaining: 2h 30m 28s. Rate: 9.5 symbols/min [2025-09-14T18:17:19.761838] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:19.761945] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-14T18:17:19.768613] [DEBUG] [LOCAL ] GNT: Loaded 3383 existing records from primary storage. [2025-09-14T18:17:19.768747] [INFO ] [MAIN ] GNT: Loaded 3383 existing records. [2025-09-14T18:17:19.944103] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:19.944380] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-14T18:17:19.944500] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-14T18:17:19.944772] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-14T18:17:19.944832] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-14T18:17:20.344699] [INFO ] [REMOTE ] GNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:20.558870] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-14T18:17:20.715451] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:17:21.358840] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-14T18:17:21.461091] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T18:17:21.495052] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:17:22.158829] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-14T18:17:22.856298] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:17:22.910936] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:17:22.958776] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-14T18:17:23.758839] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-14T18:17:24.558995] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-14T18:17:24.807031] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:17:24.842924] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:17:25.358868] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-14T18:17:26.158894] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-14T18:17:26.329067] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:17:26.959326] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-14T18:17:26.962730] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T18:17:26.989600] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:17:27.758828] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-14T18:17:28.563995] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-14T18:17:28.589705] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:17:29.293809] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T18:17:29.358879] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-14T18:17:29.889366] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T18:17:30.154406] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T18:17:30.158773] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-14T18:17:30.958898] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-14T18:17:30.981320] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T18:17:31.758828] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-14T18:17:32.558835] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-14T18:17:32.689572] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:17:33.276997] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T18:17:33.358814] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-14T18:17:33.440957] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:17:34.158840] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-14T18:17:34.866572] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:17:34.958853] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-14T18:17:35.570250] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:17:35.572030] [INFO ] [REMOTE ] GNT: Full fetch complete (8172 records). [2025-09-14T18:17:35.572120] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-14T18:17:35.759021] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-14T18:17:35.993388] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T18:17:35.993669] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-14T18:17:36.003225] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-14T18:17:36.004053] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-14T18:17:36.004253] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-14T18:17:36.005751] [DEBUG] [LOCAL ] GNT: Trimmed 8172 records to 5911 (keeping 150 days of data) [2025-09-14T18:17:36.050116] [DEBUG] [LOCAL ] GNT: Primary data saved (5911 records). [2025-09-14T18:17:36.050338] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-14T18:17:36.050508] [INFO ] [MAIN ] Update Progress: 948/2370 symbols completed. GNT took 16.5s. Estimated remaining: 2h 30m 37s. Rate: 9.4 symbols/min [2025-09-14T18:17:36.222764] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:36.231333] [DEBUG] [LOCAL ] GNTY: Loaded 4302 existing records from primary storage. [2025-09-14T18:17:36.231515] [INFO ] [MAIN ] GNTY: Loaded 4302 existing records. [2025-09-14T18:17:36.409067] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:36.409367] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-14T18:17:36.409428] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-14T18:17:36.409764] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-14T18:17:36.409839] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-14T18:17:36.567046] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-14T18:17:36.774908] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:37.358851] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-14T18:17:37.494363] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T18:17:38.006798] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T18:17:38.158835] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-14T18:17:38.463856] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T18:17:38.958841] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-14T18:17:39.659956] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:17:39.758799] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-14T18:17:40.260125] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T18:17:40.558853] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-14T18:17:41.355201] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:17:41.364823] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-14T18:17:42.059233] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T18:17:42.158832] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-14T18:17:42.366292] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T18:17:42.370422] [INFO ] [REMOTE ] GNK: Full fetch complete (44343 records). [2025-09-14T18:17:42.370559] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-14T18:17:42.701264] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T18:17:42.774818] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-14T18:17:42.774968] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-14T18:17:42.776012] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-14T18:17:42.776110] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-14T18:17:42.777471] [DEBUG] [LOCAL ] GNK: Trimmed 44343 records to 29950 (keeping 150 days of data) [2025-09-14T18:17:42.959373] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-14T18:17:42.976665] [DEBUG] [LOCAL ] GNK: Primary data saved (29950 records). [2025-09-14T18:17:42.976887] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-14T18:17:42.977064] [INFO ] [MAIN ] Update Progress: 949/2370 symbols completed. GNK took 30.7s. Estimated remaining: 2h 30m 31s. Rate: 9.4 symbols/min [2025-09-14T18:17:43.157832] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:43.184201] [DEBUG] [LOCAL ] GNW: Loaded 22935 existing records from primary storage. [2025-09-14T18:17:43.184449] [INFO ] [MAIN ] GNW: Loaded 22935 existing records. [2025-09-14T18:17:43.379474] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:43.379836] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-14T18:17:43.379910] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-14T18:17:43.380683] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-14T18:17:43.380754] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-14T18:17:43.771285] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-14T18:17:43.779259] [INFO ] [REMOTE ] GNW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:43.783036] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T18:17:43.789014] [INFO ] [REMOTE ] GNL: Full fetch complete (51621 records). [2025-09-14T18:17:43.789143] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-14T18:17:44.165098] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-14T18:17:44.165225] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-14T18:17:44.166228] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-14T18:17:44.166297] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-14T18:17:44.167500] [DEBUG] [LOCAL ] GNL: Trimmed 51621 records to 35163 (keeping 150 days of data) [2025-09-14T18:17:44.368605] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T18:17:44.407183] [DEBUG] [LOCAL ] GNL: Primary data saved (35163 records). [2025-09-14T18:17:44.407436] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-14T18:17:44.407575] [INFO ] [MAIN ] Update Progress: 950/2370 symbols completed. GNL took 30.0s. Estimated remaining: 2h 30m 17s. Rate: 9.4 symbols/min [2025-09-14T18:17:44.561851] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-14T18:17:44.583861] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:44.605576] [DEBUG] [LOCAL ] GOF: Loaded 18884 existing records from primary storage. [2025-09-14T18:17:44.605808] [INFO ] [MAIN ] GOF: Loaded 18884 existing records. [2025-09-14T18:17:44.781222] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:44.781543] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-14T18:17:44.781688] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-14T18:17:44.782301] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-14T18:17:44.782364] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-14T18:17:45.130813] [INFO ] [REMOTE ] GOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:45.358837] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-14T18:17:46.158833] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-14T18:17:46.425674] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T18:17:46.853243] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:17:46.858844] [INFO ] [REMOTE ] GNRC: Full fetch complete (49278 records). [2025-09-14T18:17:46.859046] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-14T18:17:46.964727] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-14T18:17:47.284732] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-14T18:17:47.284971] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-14T18:17:47.286152] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-14T18:17:47.286354] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-14T18:17:47.311325] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T18:17:47.320889] [DEBUG] [LOCAL ] GNRC: Trimmed 49278 records to 33818 (keeping 150 days of data) [2025-09-14T18:17:47.570448] [DEBUG] [LOCAL ] GNRC: Primary data saved (33818 records). [2025-09-14T18:17:47.570730] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-14T18:17:47.570908] [INFO ] [MAIN ] Update Progress: 951/2370 symbols completed. GNRC took 29.9s. Estimated remaining: 2h 30m 6s. Rate: 9.5 symbols/min [2025-09-14T18:17:47.744536] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:47.763149] [DEBUG] [LOCAL ] GOLF: Loaded 13308 existing records from primary storage. [2025-09-14T18:17:47.762594] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-14T18:17:47.763859] [INFO ] [MAIN ] GOLF: Loaded 13308 existing records. [2025-09-14T18:17:47.953500] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:47.953892] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-14T18:17:47.953962] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-14T18:17:47.954505] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-14T18:17:47.954577] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-14T18:17:48.343436] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:48.558871] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-14T18:17:48.897265] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:17:49.358793] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-14T18:17:49.776481] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T18:17:49.812633] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T18:17:50.158914] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-14T18:17:50.749994] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T18:17:50.943715] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:17:50.958781] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-14T18:17:51.758905] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-14T18:17:52.558915] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-14T18:17:52.634045] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:17:52.872620] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T18:17:53.358855] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-14T18:17:54.158890] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-14T18:17:54.383888] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T18:17:54.958911] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-14T18:17:55.020934] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:17:55.084894] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:17:55.758854] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-14T18:17:56.234635] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T18:17:56.558894] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-14T18:17:57.100792] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:17:57.358834] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-14T18:17:58.139714] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:17:58.158803] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-14T18:17:58.958905] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-14T18:17:59.156541] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T18:17:59.607635] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T18:17:59.758873] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-14T18:18:00.429323] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T18:18:00.558816] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-14T18:18:00.840493] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T18:18:01.358843] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-14T18:18:02.158883] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-14T18:18:02.202757] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T18:18:02.204181] [INFO ] [REMOTE ] GNTY: Full fetch complete (7304 records). [2025-09-14T18:18:02.204279] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-14T18:18:02.564779] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-14T18:18:02.564889] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-14T18:18:02.565092] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-14T18:18:02.565145] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-14T18:18:02.565586] [DEBUG] [LOCAL ] GNTY: Trimmed 7304 records to 5735 (keeping 150 days of data) [2025-09-14T18:18:02.600374] [DEBUG] [LOCAL ] GNTY: Primary data saved (5735 records). [2025-09-14T18:18:02.600499] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-14T18:18:02.600605] [INFO ] [MAIN ] Update Progress: 952/2370 symbols completed. GNTY took 26.5s. Estimated remaining: 2h 30m 13s. Rate: 9.4 symbols/min [2025-09-14T18:18:02.770976] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:02.796309] [DEBUG] [LOCAL ] GOOS: Loaded 20817 existing records from primary storage. [2025-09-14T18:18:02.796525] [INFO ] [MAIN ] GOOS: Loaded 20817 existing records. [2025-09-14T18:18:02.959700] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-14T18:18:02.989029] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:02.990594] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-14T18:18:02.990724] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-14T18:18:03.000132] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-14T18:18:03.014571] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-14T18:18:03.016607] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-14T18:18:03.374968] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:03.758829] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-14T18:18:04.138669] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T18:18:04.558833] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-14T18:18:05.358845] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-14T18:18:05.440613] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-14T18:18:05.530411] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-14T18:18:05.535147] [INFO ] [REMOTE ] GOF: Full fetch complete (46822 records). [2025-09-14T18:18:05.535277] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-14T18:18:05.918434] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-14T18:18:05.918559] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-14T18:18:05.919388] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-14T18:18:05.919463] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-14T18:18:05.920524] [DEBUG] [LOCAL ] GOF: Trimmed 46822 records to 31610 (keeping 150 days of data) [2025-09-14T18:18:06.120430] [DEBUG] [LOCAL ] GOF: Primary data saved (31610 records). [2025-09-14T18:18:06.120620] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-14T18:18:06.120746] [INFO ] [MAIN ] Update Progress: 953/2370 symbols completed. GOF took 21.7s. Estimated remaining: 2h 30m 2s. Rate: 9.4 symbols/min [2025-09-14T18:18:06.165692] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-14T18:18:06.300865] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:06.327335] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:18:06.340206] [DEBUG] [LOCAL ] GOTU: Loaded 15910 existing records from primary storage. [2025-09-14T18:18:06.340367] [INFO ] [MAIN ] GOTU: Loaded 15910 existing records. [2025-09-14T18:18:06.524679] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:06.524978] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-14T18:18:06.525060] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-14T18:18:06.525636] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-14T18:18:06.525739] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-14T18:18:06.888158] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:06.958827] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-14T18:18:07.012751] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T18:18:07.543739] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:18:07.546895] [INFO ] [REMOTE ] GOLF: Full fetch complete (35799 records). [2025-09-14T18:18:07.546997] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-14T18:18:07.767663] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-14T18:18:07.931732] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-14T18:18:07.932081] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-14T18:18:07.932796] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-14T18:18:07.932946] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-14T18:18:07.944362] [DEBUG] [LOCAL ] GOLF: Trimmed 35799 records to 23261 (keeping 150 days of data) [2025-09-14T18:18:07.963872] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:18:08.126712] [DEBUG] [LOCAL ] GOLF: Primary data saved (23261 records). [2025-09-14T18:18:08.126906] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-14T18:18:08.127017] [INFO ] [MAIN ] Update Progress: 954/2370 symbols completed. GOLF took 20.6s. Estimated remaining: 2h 29m 49s. Rate: 9.5 symbols/min [2025-09-14T18:18:08.308323] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:08.331269] [DEBUG] [LOCAL ] GPC: Loaded 20178 existing records from primary storage. [2025-09-14T18:18:08.331509] [INFO ] [MAIN ] GPC: Loaded 20178 existing records. [2025-09-14T18:18:08.523354] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:08.523634] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-14T18:18:08.523714] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-14T18:18:08.524339] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-14T18:18:08.524402] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-14T18:18:08.567624] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-14T18:18:08.883745] [INFO ] [REMOTE ] GPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:09.358823] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-14T18:18:09.836525] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T18:18:09.888464] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T18:18:09.894110] [INFO ] [REMOTE ] GNW: Full fetch complete (55716 records). [2025-09-14T18:18:09.894255] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-14T18:18:10.169071] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-14T18:18:10.304773] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-14T18:18:10.304916] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-14T18:18:10.305851] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-14T18:18:10.305914] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-14T18:18:10.307185] [DEBUG] [LOCAL ] GNW: Trimmed 55716 records to 38622 (keeping 150 days of data) [2025-09-14T18:18:10.540696] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T18:18:10.581451] [DEBUG] [LOCAL ] GNW: Primary data saved (38622 records). [2025-09-14T18:18:10.581624] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-14T18:18:10.581742] [INFO ] [MAIN ] Update Progress: 955/2370 symbols completed. GNW took 27.6s. Estimated remaining: 2h 29m 37s. Rate: 9.5 symbols/min [2025-09-14T18:18:10.756126] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:10.764808] [DEBUG] [LOCAL ] GPI: Loaded 6671 existing records from primary storage. [2025-09-14T18:18:10.764965] [INFO ] [MAIN ] GPI: Loaded 6671 existing records. [2025-09-14T18:18:10.946830] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:10.947571] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-14T18:18:10.947656] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-14T18:18:10.948038] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-14T18:18:10.948103] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-14T18:18:10.963975] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-14T18:18:11.320092] [INFO ] [REMOTE ] GPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:11.347528] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T18:18:11.758837] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-14T18:18:12.558839] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-14T18:18:12.696703] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T18:18:12.941246] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:18:13.358878] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-14T18:18:13.624353] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:18:14.158879] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-14T18:18:14.926890] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T18:18:14.958796] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-14T18:18:15.077168] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T18:18:15.758833] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-14T18:18:16.532500] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T18:18:16.558791] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-14T18:18:17.192554] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T18:18:17.358829] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-14T18:18:18.043619] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:18:18.158802] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-14T18:18:18.958863] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-14T18:18:19.455049] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:18:19.674007] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T18:18:19.758850] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-14T18:18:20.440195] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:18:20.558864] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-14T18:18:21.165242] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:18:21.358932] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-14T18:18:22.162968] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-14T18:18:22.167846] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:18:22.200618] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:18:22.958855] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-14T18:18:23.199039] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T18:18:23.758851] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-14T18:18:24.376672] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T18:18:24.380807] [INFO ] [REMOTE ] GOTU: Full fetch complete (43933 records). [2025-09-14T18:18:24.380924] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-14T18:18:24.566844] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-14T18:18:24.770828] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-14T18:18:24.770972] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-14T18:18:24.771845] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-14T18:18:24.771942] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-14T18:18:24.773150] [DEBUG] [LOCAL ] GOTU: Trimmed 43933 records to 28001 (keeping 150 days of data) [2025-09-14T18:18:24.930560] [DEBUG] [LOCAL ] GOTU: Primary data saved (28001 records). [2025-09-14T18:18:24.930765] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-14T18:18:24.930871] [INFO ] [MAIN ] Update Progress: 956/2370 symbols completed. GOTU took 18.8s. Estimated remaining: 2h 29m 43s. Rate: 9.4 symbols/min [2025-09-14T18:18:25.100097] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:25.104427] [DEBUG] [LOCAL ] GPJA: Loaded 2241 existing records from primary storage. [2025-09-14T18:18:25.104715] [INFO ] [MAIN ] GPJA: Loaded 2241 existing records. [2025-09-14T18:18:25.248181] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T18:18:25.320165] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:25.320951] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-14T18:18:25.321041] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-14T18:18:25.321371] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-14T18:18:25.321438] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-14T18:18:25.367746] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-14T18:18:25.699569] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:25.710459] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:18:26.158851] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-14T18:18:26.958851] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-14T18:18:27.076566] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T18:18:27.165662] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:18:27.617139] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T18:18:27.758838] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-14T18:18:28.301357] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T18:18:28.558837] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-14T18:18:29.358853] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-14T18:18:30.158866] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-14T18:18:30.404533] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T18:18:30.449466] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T18:18:30.818238] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T18:18:30.958828] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-14T18:18:31.541070] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-14T18:18:31.758887] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-14T18:18:32.558835] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-14T18:18:32.885737] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T18:18:33.358836] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-14T18:18:33.617632] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T18:18:34.042191] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T18:18:34.158838] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-14T18:18:34.731894] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T18:18:34.958833] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-14T18:18:35.524011] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T18:18:35.758842] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-14T18:18:36.558836] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-14T18:18:37.175953] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T18:18:37.177185] [INFO ] [REMOTE ] GPJA: Full fetch complete (4311 records). [2025-09-14T18:18:37.177275] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-14T18:18:37.364416] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-14T18:18:37.535203] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-14T18:18:37.535393] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-14T18:18:37.535593] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-14T18:18:37.535790] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-14T18:18:37.536337] [DEBUG] [LOCAL ] GPJA: Trimmed 4311 records to 3110 (keeping 150 days of data) [2025-09-14T18:18:37.582614] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:18:37.583465] [DEBUG] [LOCAL ] GPJA: Primary data saved (3110 records). [2025-09-14T18:18:37.593208] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-14T18:18:37.593604] [INFO ] [MAIN ] Update Progress: 957/2370 symbols completed. GPJA took 12.7s. Estimated remaining: 2h 29m 46s. Rate: 9.4 symbols/min [2025-09-14T18:18:37.712482] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T18:18:37.714863] [INFO ] [REMOTE ] GPI: Full fetch complete (16096 records). [2025-09-14T18:18:37.714956] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-14T18:18:38.084411] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-14T18:18:38.084539] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-14T18:18:38.084972] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-14T18:18:38.085046] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-14T18:18:38.088804] [DEBUG] [LOCAL ] GPI: Trimmed 16096 records to 10289 (keeping 150 days of data) [2025-09-14T18:18:38.155159] [DEBUG] [LOCAL ] GPI: Primary data saved (10289 records). [2025-09-14T18:18:38.155352] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-14T18:18:38.155476] [INFO ] [MAIN ] Update Progress: 958/2370 symbols completed. GPI took 27.6s. Estimated remaining: 2h 29m 31s. Rate: 9.4 symbols/min [2025-09-14T18:18:38.158786] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-14T18:18:38.958943] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-14T18:18:39.007350] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T18:18:39.014148] [INFO ] [REMOTE ] GPC: Full fetch complete (51324 records). [2025-09-14T18:18:39.014436] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-14T18:18:39.390278] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-14T18:18:39.390401] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-14T18:18:39.391335] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-14T18:18:39.391408] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-14T18:18:39.392934] [DEBUG] [LOCAL ] GPC: Trimmed 51324 records to 34452 (keeping 150 days of data) [2025-09-14T18:18:39.649135] [DEBUG] [LOCAL ] GPC: Primary data saved (34452 records). [2025-09-14T18:18:39.649450] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-14T18:18:39.649763] [INFO ] [MAIN ] Update Progress: 959/2370 symbols completed. GPC took 31.5s. Estimated remaining: 2h 29m 17s. Rate: 9.5 symbols/min [2025-09-14T18:18:40.457689] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T18:18:40.463298] [INFO ] [REMOTE ] GOOS: Full fetch complete (50184 records). [2025-09-14T18:18:40.463756] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-14T18:18:40.870951] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-14T18:18:40.871077] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-14T18:18:40.871837] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-14T18:18:40.871897] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-14T18:18:40.872952] [DEBUG] [LOCAL ] GOOS: Trimmed 50184 records to 34330 (keeping 150 days of data) [2025-09-14T18:18:41.087355] [DEBUG] [LOCAL ] GOOS: Primary data saved (34330 records). [2025-09-14T18:18:41.087533] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-14T18:18:41.087632] [INFO ] [MAIN ] Update Progress: 960/2370 symbols completed. GOOS took 38.5s. Estimated remaining: 2h 29m 4s. Rate: 9.5 symbols/min [2025-09-14T18:18:41.846629] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:41.847628] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:41.888958] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:41.870586] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:41.905203] [DEBUG] [LOCAL ] GPMT: Loaded 10455 existing records from primary storage. [2025-09-14T18:18:41.905455] [INFO ] [MAIN ] GPMT: Loaded 10455 existing records. [2025-09-14T18:18:41.988149] [DEBUG] [LOCAL ] GPOR: Loaded 10676 existing records from primary storage. [2025-09-14T18:18:42.015012] [INFO ] [MAIN ] GPOR: Loaded 10676 existing records. [2025-09-14T18:18:42.122485] [DEBUG] [LOCAL ] GPK: Loaded 23693 existing records from primary storage. [2025-09-14T18:18:42.179686] [DEBUG] [LOCAL ] GPN: Loaded 23125 existing records from primary storage. [2025-09-14T18:18:42.202452] [INFO ] [MAIN ] GPK: Loaded 23693 existing records. [2025-09-14T18:18:42.232124] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:42.237590] [INFO ] [MAIN ] GPN: Loaded 23125 existing records. [2025-09-14T18:18:42.312125] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-14T18:18:42.396753] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-14T18:18:42.510447] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:42.536450] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-14T18:18:42.605031] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-14T18:18:42.605825] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-14T18:18:42.740551] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-14T18:18:42.756140] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:42.794622] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:42.817971] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-14T18:18:42.810788] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-14T18:18:42.821750] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-14T18:18:42.821669] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-14T18:18:42.821987] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-14T18:18:42.821916] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-14T18:18:42.848244] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-14T18:18:42.862807] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-14T18:18:42.871864] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-14T18:18:43.032065] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-14T18:18:43.440555] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:43.463998] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-14T18:18:44.146413] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:44.175701] [INFO ] [REMOTE ] GPN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:44.202430] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-14T18:18:44.207821] [INFO ] [REMOTE ] GPK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:44.208342] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-14T18:18:44.210850] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-14T18:18:44.888170] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T18:18:44.893517] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-14T18:18:45.408885] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:18:45.413784] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-14T18:18:45.957501] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:18:45.967574] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-14T18:18:46.069468] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T18:18:46.079988] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-14T18:18:46.093888] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T18:18:46.158776] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-14T18:18:46.668501] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T18:18:46.958847] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-14T18:18:47.595245] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T18:18:47.655923] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:18:47.732713] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:18:47.758869] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-14T18:18:47.800444] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T18:18:48.558836] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-14T18:18:48.818929] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:18:49.358847] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-14T18:18:50.158864] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-14T18:18:50.561965] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T18:18:50.613101] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T18:18:50.958857] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-14T18:18:51.758895] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-14T18:18:51.984109] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:18:52.012119] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T18:18:52.558836] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-14T18:18:52.786097] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:18:53.358842] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-14T18:18:54.158797] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-14T18:18:54.405834] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T18:18:54.532068] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T18:18:54.958897] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-14T18:18:55.278355] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T18:18:55.758898] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-14T18:18:56.558789] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-14T18:18:56.820160] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:18:56.965700] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:18:57.107379] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:18:57.109564] [INFO ] [REMOTE ] GPMT: Full fetch complete (29299 records). [2025-09-14T18:18:57.109689] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-14T18:18:57.364038] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-14T18:18:57.479730] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-14T18:18:57.479867] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-14T18:18:57.480507] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-14T18:18:57.480570] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-14T18:18:57.481800] [DEBUG] [LOCAL ] GPMT: Trimmed 29299 records to 20904 (keeping 150 days of data) [2025-09-14T18:18:57.600371] [DEBUG] [LOCAL ] GPMT: Primary data saved (20904 records). [2025-09-14T18:18:57.600544] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-14T18:18:57.600707] [INFO ] [MAIN ] Update Progress: 961/2370 symbols completed. GPMT took 16.5s. Estimated remaining: 2h 29m 12s. Rate: 9.4 symbols/min [2025-09-14T18:18:57.770752] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:57.787054] [DEBUG] [LOCAL ] GPRK: Loaded 15961 existing records from primary storage. [2025-09-14T18:18:57.787217] [INFO ] [MAIN ] GPRK: Loaded 15961 existing records. [2025-09-14T18:18:57.970240] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:57.970556] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-14T18:18:57.970619] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-14T18:18:57.971138] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-14T18:18:57.971212] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-14T18:18:58.164050] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-14T18:18:58.346694] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:58.958834] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-14T18:18:59.222354] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T18:18:59.758867] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-14T18:19:00.048923] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T18:19:00.118443] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T18:19:00.558871] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-14T18:19:01.358859] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-14T18:19:01.919416] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T18:19:01.963372] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:19:02.158903] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-14T18:19:02.731551] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T18:19:02.958830] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-14T18:19:03.758806] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-14T18:19:04.037207] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T18:19:04.057171] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T18:19:04.060260] [INFO ] [REMOTE ] GPOR: Full fetch complete (24915 records). [2025-09-14T18:19:04.060363] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-14T18:19:04.445370] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-14T18:19:04.445538] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-14T18:19:04.446217] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-14T18:19:04.446284] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-14T18:19:04.447191] [DEBUG] [LOCAL ] GPOR: Trimmed 24915 records to 16535 (keeping 150 days of data) [2025-09-14T18:19:04.546441] [DEBUG] [LOCAL ] GPOR: Primary data saved (16535 records). [2025-09-14T18:19:04.546625] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-14T18:19:04.546761] [INFO ] [MAIN ] Update Progress: 962/2370 symbols completed. GPOR took 23.5s. Estimated remaining: 2h 29m 7s. Rate: 9.4 symbols/min [2025-09-14T18:19:04.567080] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-14T18:19:04.718091] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:04.730508] [DEBUG] [LOCAL ] GRBK: Loaded 11546 existing records from primary storage. [2025-09-14T18:19:04.730687] [INFO ] [MAIN ] GRBK: Loaded 11546 existing records. [2025-09-14T18:19:04.918402] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:04.918886] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-14T18:19:04.918981] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-14T18:19:04.919510] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-14T18:19:04.919582] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-14T18:19:05.289209] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:05.341931] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T18:19:05.358782] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-14T18:19:06.158898] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-14T18:19:06.527390] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T18:19:06.808911] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:19:06.958924] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-14T18:19:07.635690] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:19:07.641302] [INFO ] [REMOTE ] GPK: Full fetch complete (57062 records). [2025-09-14T18:19:07.641485] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-14T18:19:07.761956] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-14T18:19:08.098910] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-14T18:19:08.099740] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-14T18:19:08.102461] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-14T18:19:08.100902] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:19:08.111421] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-14T18:19:08.113973] [DEBUG] [LOCAL ] GPK: Trimmed 57062 records to 39725 (keeping 150 days of data) [2025-09-14T18:19:08.398383] [DEBUG] [LOCAL ] GPK: Primary data saved (39725 records). [2025-09-14T18:19:08.398635] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-14T18:19:08.398792] [INFO ] [MAIN ] Update Progress: 963/2370 symbols completed. GPK took 27.3s. Estimated remaining: 2h 28m 57s. Rate: 9.4 symbols/min [2025-09-14T18:19:08.565218] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-14T18:19:08.601128] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:08.607947] [DEBUG] [LOCAL ] GRC: Loaded 3842 existing records from primary storage. [2025-09-14T18:19:08.608168] [INFO ] [MAIN ] GRC: Loaded 3842 existing records. [2025-09-14T18:19:08.815242] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:08.815622] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-14T18:19:08.815723] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-14T18:19:08.816067] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-14T18:19:08.816139] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-14T18:19:09.181532] [INFO ] [REMOTE ] GRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:09.325769] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T18:19:09.358773] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-14T18:19:09.979518] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:19:10.158830] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-14T18:19:10.782756] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T18:19:10.958838] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-14T18:19:11.758827] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-14T18:19:11.806341] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T18:19:12.050443] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T18:19:12.255452] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T18:19:12.261075] [INFO ] [REMOTE ] GPN: Full fetch complete (56626 records). [2025-09-14T18:19:12.261220] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-14T18:19:12.564032] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-14T18:19:12.698915] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-14T18:19:12.699119] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-14T18:19:12.700244] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-14T18:19:12.700321] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-14T18:19:12.702136] [DEBUG] [LOCAL ] GPN: Trimmed 56626 records to 39199 (keeping 150 days of data) [2025-09-14T18:19:12.980906] [DEBUG] [LOCAL ] GPN: Primary data saved (39199 records). [2025-09-14T18:19:12.981116] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-14T18:19:12.981230] [INFO ] [MAIN ] Update Progress: 964/2370 symbols completed. GPN took 31.9s. Estimated remaining: 2h 28m 48s. Rate: 9.4 symbols/min [2025-09-14T18:19:13.153248] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:13.164205] [DEBUG] [LOCAL ] GRDN: Loaded 9421 existing records from primary storage. [2025-09-14T18:19:13.164393] [INFO ] [MAIN ] GRDN: Loaded 9421 existing records. [2025-09-14T18:19:13.343895] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:13.344197] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-14T18:19:13.344258] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-14T18:19:13.344701] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-14T18:19:13.344791] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-14T18:19:13.365960] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-14T18:19:13.709836] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:14.158863] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-14T18:19:14.203930] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:19:14.325468] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T18:19:14.958809] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-14T18:19:14.999991] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T18:19:15.758882] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-14T18:19:16.354531] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:19:16.558842] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-14T18:19:16.667324] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T18:19:17.358871] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-14T18:19:17.874186] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T18:19:18.158830] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-14T18:19:18.682492] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T18:19:18.686328] [INFO ] [REMOTE ] GPRK: Full fetch complete (42553 records). [2025-09-14T18:19:18.686460] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-14T18:19:18.963928] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-14T18:19:19.057654] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-14T18:19:19.057767] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-14T18:19:19.058453] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-14T18:19:19.058509] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-14T18:19:19.059734] [DEBUG] [LOCAL ] GPRK: Trimmed 42553 records to 28993 (keeping 150 days of data) [2025-09-14T18:19:19.244253] [DEBUG] [LOCAL ] GPRK: Primary data saved (28993 records). [2025-09-14T18:19:19.244435] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-14T18:19:19.244573] [INFO ] [MAIN ] Update Progress: 965/2370 symbols completed. GPRK took 21.6s. Estimated remaining: 2h 28m 41s. Rate: 9.4 symbols/min [2025-09-14T18:19:19.411220] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:19.429199] [DEBUG] [LOCAL ] GRMN: Loaded 18214 existing records from primary storage. [2025-09-14T18:19:19.429428] [INFO ] [MAIN ] GRMN: Loaded 18214 existing records. [2025-09-14T18:19:19.605523] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:19.605838] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-14T18:19:19.605913] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-14T18:19:19.606562] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-14T18:19:19.606628] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-14T18:19:19.728022] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T18:19:19.760161] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-14T18:19:20.007371] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:20.018246] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T18:19:20.558814] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-14T18:19:20.792061] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T18:19:21.358892] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-14T18:19:21.910069] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:19:22.158800] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-14T18:19:22.424632] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T18:19:22.427668] [INFO ] [REMOTE ] GRBK: Full fetch complete (30193 records). [2025-09-14T18:19:22.427767] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-14T18:19:22.699886] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:19:22.811048] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-14T18:19:22.811154] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-14T18:19:22.811754] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-14T18:19:22.811811] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-14T18:19:22.812575] [DEBUG] [LOCAL ] GRBK: Trimmed 30193 records to 19882 (keeping 150 days of data) [2025-09-14T18:19:22.936172] [DEBUG] [LOCAL ] GRBK: Primary data saved (19882 records). [2025-09-14T18:19:22.936397] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-14T18:19:22.936509] [INFO ] [MAIN ] Update Progress: 966/2370 symbols completed. GRBK took 18.4s. Estimated remaining: 2h 28m 31s. Rate: 9.5 symbols/min [2025-09-14T18:19:22.966670] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-14T18:19:23.113917] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:23.135184] [DEBUG] [LOCAL ] GRND: Loaded 22280 existing records from primary storage. [2025-09-14T18:19:23.135417] [INFO ] [MAIN ] GRND: Loaded 22280 existing records. [2025-09-14T18:19:23.325726] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:23.326020] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-14T18:19:23.326082] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-14T18:19:23.326795] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-14T18:19:23.326867] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-14T18:19:23.687251] [INFO ] [REMOTE ] GRND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:23.758836] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-14T18:19:24.213607] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T18:19:24.558849] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-14T18:19:24.664699] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:19:25.358864] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-14T18:19:26.061224] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T18:19:26.152338] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T18:19:26.161185] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-14T18:19:26.652336] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T18:19:26.958832] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-14T18:19:27.758836] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-14T18:19:28.102433] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:19:28.353172] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T18:19:28.558868] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-14T18:19:29.358857] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-14T18:19:29.401284] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T18:19:30.158872] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-14T18:19:30.394618] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T18:19:30.958876] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-14T18:19:31.058624] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T18:19:31.758837] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-14T18:19:31.836249] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T18:19:32.558943] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-14T18:19:33.358875] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-14T18:19:33.419429] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:19:33.664811] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:19:34.104018] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:19:34.105411] [INFO ] [REMOTE ] GRC: Full fetch complete (9660 records). [2025-09-14T18:19:34.105498] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-14T18:19:34.168994] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-14T18:19:34.519715] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-14T18:19:34.519875] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-14T18:19:34.520349] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-14T18:19:34.520443] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-14T18:19:34.521117] [DEBUG] [LOCAL ] GRC: Trimmed 9660 records to 6363 (keeping 150 days of data) [2025-09-14T18:19:34.560408] [DEBUG] [LOCAL ] GRC: Primary data saved (6363 records). [2025-09-14T18:19:34.560591] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-14T18:19:34.560763] [INFO ] [MAIN ] Update Progress: 967/2370 symbols completed. GRC took 26.2s. Estimated remaining: 2h 28m 33s. Rate: 9.4 symbols/min [2025-09-14T18:19:34.749430] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:34.765238] [DEBUG] [LOCAL ] GRNT: Loaded 15624 existing records from primary storage. [2025-09-14T18:19:34.765420] [INFO ] [MAIN ] GRNT: Loaded 15624 existing records. [2025-09-14T18:19:34.947577] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:34.947912] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-14T18:19:34.947972] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-14T18:19:34.948475] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-14T18:19:34.948548] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-14T18:19:34.969529] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-14T18:19:35.309538] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:35.758842] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-14T18:19:36.006012] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:19:36.332492] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T18:19:36.558834] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-14T18:19:36.768442] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T18:19:37.358816] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-14T18:19:37.603233] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T18:19:37.606370] [INFO ] [REMOTE ] GRDN: Full fetch complete (19367 records). [2025-09-14T18:19:37.606458] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-14T18:19:37.966685] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-14T18:19:37.966801] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-14T18:19:37.967265] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-14T18:19:37.967319] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-14T18:19:37.968175] [DEBUG] [LOCAL ] GRDN: Trimmed 19367 records to 15117 (keeping 150 days of data) [2025-09-14T18:19:38.056334] [DEBUG] [LOCAL ] GRDN: Primary data saved (15117 records). [2025-09-14T18:19:38.056512] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-14T18:19:38.056627] [INFO ] [MAIN ] Update Progress: 968/2370 symbols completed. GRDN took 25.1s. Estimated remaining: 2h 28m 22s. Rate: 9.4 symbols/min [2025-09-14T18:19:38.163927] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-14T18:19:38.228416] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:38.234573] [DEBUG] [LOCAL ] GROV: Loaded 4485 existing records from primary storage. [2025-09-14T18:19:38.234722] [INFO ] [MAIN ] GROV: Loaded 4485 existing records. [2025-09-14T18:19:38.411023] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:38.411335] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-14T18:19:38.411402] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-14T18:19:38.411715] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-14T18:19:38.411777] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-14T18:19:38.775020] [INFO ] [REMOTE ] GROV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:38.799049] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:19:38.958842] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-14T18:19:39.089572] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:19:39.758842] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-14T18:19:40.534158] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T18:19:40.558864] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-14T18:19:40.836205] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T18:19:41.358820] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-14T18:19:41.501886] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T18:19:42.158881] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-14T18:19:42.958800] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-14T18:19:43.032232] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T18:19:43.069910] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T18:19:43.760033] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-14T18:19:43.762952] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T18:19:44.558797] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-14T18:19:44.624673] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:19:45.358844] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-14T18:19:45.397036] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T18:19:46.042850] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:19:46.047550] [INFO ] [REMOTE ] GRMN: Full fetch complete (45792 records). [2025-09-14T18:19:46.047710] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-14T18:19:46.163979] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-14T18:19:46.422387] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-14T18:19:46.422507] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-14T18:19:46.423279] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-14T18:19:46.423354] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-14T18:19:46.424454] [DEBUG] [LOCAL ] GRMN: Trimmed 45792 records to 30492 (keeping 150 days of data) [2025-09-14T18:19:46.648265] [DEBUG] [LOCAL ] GRMN: Primary data saved (30492 records). [2025-09-14T18:19:46.648518] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-14T18:19:46.648796] [INFO ] [MAIN ] Update Progress: 969/2370 symbols completed. GRMN took 27.4s. Estimated remaining: 2h 28m 19s. Rate: 9.4 symbols/min [2025-09-14T18:19:46.826690] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:46.835096] [DEBUG] [LOCAL ] GRX: Loaded 2224 existing records from primary storage. [2025-09-14T18:19:46.835255] [INFO ] [MAIN ] GRX: Loaded 2224 existing records. [2025-09-14T18:19:46.963977] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-14T18:19:47.017683] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:47.018350] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-14T18:19:47.018434] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-14T18:19:47.018791] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-14T18:19:47.018864] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-14T18:19:47.130493] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T18:19:47.389807] [INFO ] [REMOTE ] GRX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:47.758831] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-14T18:19:48.558891] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-14T18:19:48.778004] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:19:48.855355] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T18:19:49.358877] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-14T18:19:50.139362] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:19:50.158775] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-14T18:19:50.731410] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T18:19:50.958854] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-14T18:19:51.233552] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:19:51.491807] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T18:19:51.758852] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-14T18:19:52.558826] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-14T18:19:53.138189] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T18:19:53.358863] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-14T18:19:53.497505] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T18:19:54.158838] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-14T18:19:54.772696] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T18:19:54.866026] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:19:54.958864] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-14T18:19:55.615012] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T18:19:55.758841] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-14T18:19:56.469028] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T18:19:56.558893] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-14T18:19:57.109773] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:19:57.111000] [INFO ] [REMOTE ] GROV: Full fetch complete (10121 records). [2025-09-14T18:19:57.111092] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-14T18:19:57.364038] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-14T18:19:57.485672] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-14T18:19:57.485800] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-14T18:19:57.486154] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-14T18:19:57.486219] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-14T18:19:57.486805] [DEBUG] [LOCAL ] GROV: Trimmed 10121 records to 6894 (keeping 150 days of data) [2025-09-14T18:19:57.529216] [DEBUG] [LOCAL ] GROV: Primary data saved (6894 records). [2025-09-14T18:19:57.529412] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-14T18:19:57.529549] [INFO ] [MAIN ] Update Progress: 970/2370 symbols completed. GROV took 19.5s. Estimated remaining: 2h 28m 19s. Rate: 9.4 symbols/min [2025-09-14T18:19:57.704159] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:57.758869] [DEBUG] [LOCAL ] GS: Loaded 39082 existing records from primary storage. [2025-09-14T18:19:57.759063] [INFO ] [MAIN ] GS: Loaded 39082 existing records. [2025-09-14T18:19:57.937667] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:57.937956] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-14T18:19:57.938016] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-14T18:19:57.939892] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-14T18:19:57.939966] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-14T18:19:58.167933] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-14T18:19:58.222840] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T18:19:58.301106] [INFO ] [REMOTE ] GS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:58.958946] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-14T18:19:59.507484] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:19:59.682801] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T18:19:59.758909] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-14T18:20:00.339512] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T18:20:00.558880] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-14T18:20:01.358868] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-14T18:20:02.041005] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:20:02.158892] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-14T18:20:02.958850] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-14T18:20:03.124022] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-14T18:20:03.129393] [INFO ] [REMOTE ] GRND: Full fetch complete (54272 records). [2025-09-14T18:20:03.129577] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-14T18:20:03.515655] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-14T18:20:03.515831] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-14T18:20:03.516611] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-14T18:20:03.516789] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-14T18:20:03.518258] [DEBUG] [LOCAL ] GRND: Trimmed 54272 records to 37643 (keeping 150 days of data) [2025-09-14T18:20:03.617184] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:20:03.647316] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:20:03.645141] [INFO ] [REMOTE ] GRX: Full fetch complete (4463 records). [2025-09-14T18:20:03.657072] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-14T18:20:03.763662] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-14T18:20:04.037690] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-14T18:20:04.038574] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-14T18:20:04.039001] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-14T18:20:04.039413] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-14T18:20:04.041257] [DEBUG] [LOCAL ] GRX: Trimmed 4463 records to 3275 (keeping 150 days of data) [2025-09-14T18:20:04.068868] [DEBUG] [LOCAL ] GRX: Primary data saved (3275 records). [2025-09-14T18:20:04.069930] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-14T18:20:04.070940] [INFO ] [MAIN ] Update Progress: 971/2370 symbols completed. GRX took 17.4s. Estimated remaining: 2h 28m 13s. Rate: 9.4 symbols/min [2025-09-14T18:20:04.329893] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:04.392463] [DEBUG] [LOCAL ] GSBD: Loaded 16667 existing records from primary storage. [2025-09-14T18:20:04.394292] [INFO ] [MAIN ] GSBD: Loaded 16667 existing records. [2025-09-14T18:20:04.562020] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-14T18:20:04.589104] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:04.591393] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-14T18:20:04.593719] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-14T18:20:04.596304] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-14T18:20:04.597929] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-14T18:20:04.660499] [DEBUG] [LOCAL ] GRND: Primary data saved (37643 records). [2025-09-14T18:20:04.690974] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-14T18:20:04.706522] [INFO ] [MAIN ] Update Progress: 972/2370 symbols completed. GRND took 41.8s. Estimated remaining: 2h 27m 58s. Rate: 9.4 symbols/min [2025-09-14T18:20:05.085658] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:05.171539] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:05.219180] [DEBUG] [LOCAL ] GSK: Loaded 23924 existing records from primary storage. [2025-09-14T18:20:05.219825] [INFO ] [MAIN ] GSK: Loaded 23924 existing records. [2025-09-14T18:20:05.220876] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:20:05.371789] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-14T18:20:05.408547] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:05.408732] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-14T18:20:05.408794] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-14T18:20:05.409581] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-14T18:20:05.409669] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-14T18:20:05.756158] [INFO ] [REMOTE ] GSK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:05.919072] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T18:20:05.922935] [INFO ] [REMOTE ] GRNT: Full fetch complete (36585 records). [2025-09-14T18:20:05.923039] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-14T18:20:06.168247] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-14T18:20:06.301400] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-14T18:20:06.301546] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-14T18:20:06.302303] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-14T18:20:06.302464] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-14T18:20:06.303410] [DEBUG] [LOCAL ] GRNT: Trimmed 36585 records to 25252 (keeping 150 days of data) [2025-09-14T18:20:06.430881] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:20:06.500570] [DEBUG] [LOCAL ] GRNT: Primary data saved (25252 records). [2025-09-14T18:20:06.500773] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-14T18:20:06.500877] [INFO ] [MAIN ] Update Progress: 973/2370 symbols completed. GRNT took 31.9s. Estimated remaining: 2h 27m 46s. Rate: 9.5 symbols/min [2025-09-14T18:20:06.684518] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:06.702040] [DEBUG] [LOCAL ] GSL: Loaded 14801 existing records from primary storage. [2025-09-14T18:20:06.702286] [INFO ] [MAIN ] GSL: Loaded 14801 existing records. [2025-09-14T18:20:06.879223] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:06.879563] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-14T18:20:06.879629] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-14T18:20:06.880234] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-14T18:20:06.880300] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-14T18:20:06.964150] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-14T18:20:07.241606] [INFO ] [REMOTE ] GSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:07.762991] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-14T18:20:07.767778] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T18:20:07.988934] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T18:20:08.558830] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-14T18:20:09.358787] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-14T18:20:09.753598] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:20:10.163938] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-14T18:20:10.178189] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:20:10.391800] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T18:20:10.958896] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-14T18:20:11.222150] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:20:11.758841] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-14T18:20:12.558860] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-14T18:20:12.683381] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:20:13.191295] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-14T18:20:13.358838] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-14T18:20:14.158862] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-14T18:20:14.332869] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:20:14.958857] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-14T18:20:15.416510] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T18:20:15.462946] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T18:20:15.758887] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-14T18:20:16.545596] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:20:16.558830] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-14T18:20:16.695350] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T18:20:16.700755] [INFO ] [REMOTE ] GS: Full fetch complete (56956 records). [2025-09-14T18:20:16.700891] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-14T18:20:17.086423] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-14T18:20:17.086568] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-14T18:20:17.087403] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-14T18:20:17.087487] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-14T18:20:17.088883] [DEBUG] [LOCAL ] GS: Trimmed 56956 records to 39082 (keeping 150 days of data) [2025-09-14T18:20:17.347860] [DEBUG] [LOCAL ] GS: Primary data saved (39082 records). [2025-09-14T18:20:17.348052] [INFO ] [MAIN ] GS: Full history saved. [2025-09-14T18:20:17.348166] [INFO ] [MAIN ] Update Progress: 974/2370 symbols completed. GS took 19.8s. Estimated remaining: 2h 27m 46s. Rate: 9.4 symbols/min [2025-09-14T18:20:17.369153] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-14T18:20:17.522480] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:17.545340] [DEBUG] [LOCAL ] GTES: Loaded 22423 existing records from primary storage. [2025-09-14T18:20:17.545580] [INFO ] [MAIN ] GTES: Loaded 22423 existing records. [2025-09-14T18:20:17.718671] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:17.718964] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-14T18:20:17.719025] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-14T18:20:17.719725] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-14T18:20:17.719789] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-14T18:20:18.085721] [INFO ] [REMOTE ] GTES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:18.158848] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-14T18:20:18.619698] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:20:18.958866] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-14T18:20:19.005795] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T18:20:19.758911] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-14T18:20:20.013523] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T18:20:20.422063] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:20:20.558841] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-14T18:20:21.358869] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-14T18:20:21.400030] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:20:22.165637] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-14T18:20:22.191612] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:20:22.906131] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T18:20:22.958798] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-14T18:20:23.758846] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-14T18:20:24.390232] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-14T18:20:24.424757] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T18:20:24.558894] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-14T18:20:25.331374] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:20:25.358779] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-14T18:20:26.158813] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-14T18:20:26.636991] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T18:20:26.826827] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:20:26.958843] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-14T18:20:27.408917] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:20:27.758827] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-14T18:20:28.466762] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:20:28.558804] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-14T18:20:29.140048] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T18:20:29.145790] [INFO ] [REMOTE ] GSK: Full fetch complete (58180 records). [2025-09-14T18:20:29.145960] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-14T18:20:29.366518] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-14T18:20:29.534985] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-14T18:20:29.535167] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-14T18:20:29.536266] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-14T18:20:29.536428] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-14T18:20:29.546989] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:20:29.551742] [INFO ] [REMOTE ] GSBD: Full fetch complete (42555 records). [2025-09-14T18:20:29.551908] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-14T18:20:29.551993] [DEBUG] [LOCAL ] GSK: Trimmed 58180 records to 40276 (keeping 150 days of data) [2025-09-14T18:20:30.047388] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-14T18:20:30.049863] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-14T18:20:30.052523] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-14T18:20:30.053108] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-14T18:20:30.057442] [DEBUG] [LOCAL ] GSBD: Trimmed 42555 records to 28373 (keeping 150 days of data) [2025-09-14T18:20:30.160503] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-14T18:20:30.375679] [DEBUG] [LOCAL ] GSBD: Primary data saved (28373 records). [2025-09-14T18:20:30.389017] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-14T18:20:30.391279] [INFO ] [MAIN ] Update Progress: 975/2370 symbols completed. GSBD took 26.3s. Estimated remaining: 2h 27m 49s. Rate: 9.4 symbols/min [2025-09-14T18:20:30.391057] [DEBUG] [LOCAL ] GSK: Primary data saved (40276 records). [2025-09-14T18:20:30.391458] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-14T18:20:30.437411] [INFO ] [MAIN ] Update Progress: 976/2370 symbols completed. GSK took 25.7s. Estimated remaining: 2h 27m 34s. Rate: 9.4 symbols/min [2025-09-14T18:20:30.751207] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:30.753156] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:30.787074] [DEBUG] [LOCAL ] GTN: Loaded 20463 existing records from primary storage. [2025-09-14T18:20:30.787513] [DEBUG] [LOCAL ] GTLS: Loaded 20550 existing records from primary storage. [2025-09-14T18:20:30.787856] [INFO ] [MAIN ] GTN: Loaded 20463 existing records. [2025-09-14T18:20:30.787933] [INFO ] [MAIN ] GTLS: Loaded 20550 existing records. [2025-09-14T18:20:31.147566] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:31.170847] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-14T18:20:31.170673] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:31.171201] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-14T18:20:31.171604] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-14T18:20:31.171921] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-14T18:20:31.172363] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-14T18:20:31.172551] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-14T18:20:31.183807] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-14T18:20:31.209899] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-14T18:20:31.692465] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T18:20:31.842530] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-14T18:20:31.906797] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-14T18:20:31.899596] [INFO ] [REMOTE ] GTN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:31.980851] [INFO ] [REMOTE ] GSL: Full fetch complete (36995 records). [2025-09-14T18:20:31.981211] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-14T18:20:31.984456] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:31.985688] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-14T18:20:32.369020] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-14T18:20:32.369205] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-14T18:20:32.369932] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-14T18:20:32.370014] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-14T18:20:32.370986] [DEBUG] [LOCAL ] GSL: Trimmed 36995 records to 24791 (keeping 150 days of data) [2025-09-14T18:20:32.527881] [DEBUG] [LOCAL ] GSL: Primary data saved (24791 records). [2025-09-14T18:20:32.528057] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-14T18:20:32.528163] [INFO ] [MAIN ] Update Progress: 977/2370 symbols completed. GSL took 26.0s. Estimated remaining: 2h 27m 21s. Rate: 9.5 symbols/min [2025-09-14T18:20:32.571172] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-14T18:20:32.698252] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:32.712257] [DEBUG] [LOCAL ] GTY: Loaded 13213 existing records from primary storage. [2025-09-14T18:20:32.712425] [INFO ] [MAIN ] GTY: Loaded 13213 existing records. [2025-09-14T18:20:32.925856] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:32.926174] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-14T18:20:32.926236] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-14T18:20:32.926787] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-14T18:20:32.926851] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-14T18:20:33.289852] [INFO ] [REMOTE ] GTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:33.358791] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-14T18:20:33.526275] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:20:33.698184] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:20:33.903902] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:20:34.158853] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-14T18:20:34.751452] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T18:20:34.958831] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-14T18:20:35.758861] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-14T18:20:35.989716] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:20:36.340505] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T18:20:36.558815] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-14T18:20:37.364519] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-14T18:20:37.370193] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T18:20:37.890789] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:20:38.158820] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-14T18:20:38.958845] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-14T18:20:39.216863] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:20:39.642872] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T18:20:39.758844] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-14T18:20:40.387335] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T18:20:40.558898] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-14T18:20:40.884862] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:20:41.358825] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-14T18:20:42.164015] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-14T18:20:42.184876] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T18:20:42.809507] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T18:20:42.958837] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-14T18:20:43.707917] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T18:20:43.758780] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-14T18:20:44.248538] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T18:20:44.253870] [INFO ] [REMOTE ] GTES: Full fetch complete (55342 records). [2025-09-14T18:20:44.253998] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-14T18:20:44.564108] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-14T18:20:44.642593] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-14T18:20:44.642758] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-14T18:20:44.643871] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-14T18:20:44.644029] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-14T18:20:44.645613] [DEBUG] [LOCAL ] GTES: Trimmed 55342 records to 37744 (keeping 150 days of data) [2025-09-14T18:20:44.760012] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:20:44.908112] [DEBUG] [LOCAL ] GTES: Primary data saved (37744 records). [2025-09-14T18:20:44.908296] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-14T18:20:44.908401] [INFO ] [MAIN ] Update Progress: 978/2370 symbols completed. GTES took 27.6s. Estimated remaining: 2h 27m 23s. Rate: 9.4 symbols/min [2025-09-14T18:20:45.076491] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:45.084357] [DEBUG] [LOCAL ] GUG: Loaded 5626 existing records from primary storage. [2025-09-14T18:20:45.084489] [INFO ] [MAIN ] GUG: Loaded 5626 existing records. [2025-09-14T18:20:45.265492] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:45.265799] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-14T18:20:45.265866] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-14T18:20:45.266316] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-14T18:20:45.266377] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-14T18:20:45.364826] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-14T18:20:45.625196] [INFO ] [REMOTE ] GUG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:46.158853] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-14T18:20:46.370426] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T18:20:46.673334] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T18:20:46.958877] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-14T18:20:47.758830] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-14T18:20:47.945101] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T18:20:48.351530] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T18:20:48.558857] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-14T18:20:48.936012] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T18:20:49.358894] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-14T18:20:50.035543] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:20:50.158879] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-14T18:20:50.856013] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T18:20:50.958847] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-14T18:20:51.050078] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T18:20:51.758842] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-14T18:20:52.255266] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T18:20:52.360221] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T18:20:52.558859] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-14T18:20:53.358934] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-14T18:20:53.564582] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:20:54.158878] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-14T18:20:54.936878] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T18:20:54.941762] [INFO ] [REMOTE ] GTN: Full fetch complete (49928 records). [2025-09-14T18:20:54.941883] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-14T18:20:54.964066] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-14T18:20:55.334121] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-14T18:20:55.334230] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-14T18:20:55.334989] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-14T18:20:55.335048] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-14T18:20:55.336120] [DEBUG] [LOCAL ] GTN: Trimmed 49928 records to 33979 (keeping 150 days of data) [2025-09-14T18:20:55.435485] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:20:55.441864] [INFO ] [REMOTE ] GTY: Full fetch complete (32895 records). [2025-09-14T18:20:55.446676] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-14T18:20:55.764309] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-14T18:20:55.842360] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-14T18:20:55.843270] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-14T18:20:55.847357] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-14T18:20:55.904082] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-14T18:20:55.909045] [DEBUG] [LOCAL ] GTY: Trimmed 32895 records to 22048 (keeping 150 days of data) [2025-09-14T18:20:56.051179] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T18:20:56.084787] [DEBUG] [LOCAL ] GTN: Primary data saved (33979 records). [2025-09-14T18:20:56.088256] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-14T18:20:56.091347] [INFO ] [MAIN ] Update Progress: 979/2370 symbols completed. GTN took 25.6s. Estimated remaining: 2h 27m 24s. Rate: 9.4 symbols/min [2025-09-14T18:20:56.171247] [DEBUG] [LOCAL ] GTY: Primary data saved (22048 records). [2025-09-14T18:20:56.181947] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-14T18:20:56.200275] [INFO ] [MAIN ] Update Progress: 980/2370 symbols completed. GTY took 23.7s. Estimated remaining: 2h 27m 9s. Rate: 9.4 symbols/min [2025-09-14T18:20:56.375725] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:56.450190] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:56.454346] [DEBUG] [LOCAL ] GUT: Loaded 7369 existing records from primary storage. [2025-09-14T18:20:56.454819] [INFO ] [MAIN ] GUT: Loaded 7369 existing records. [2025-09-14T18:20:56.562990] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-14T18:20:56.634926] [DEBUG] [LOCAL ] GVA: Loaded 14022 existing records from primary storage. [2025-09-14T18:20:56.651338] [INFO ] [MAIN ] GVA: Loaded 14022 existing records. [2025-09-14T18:20:56.654669] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:56.701032] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-14T18:20:56.759806] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-14T18:20:56.775434] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-14T18:20:56.792008] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:20:56.792086] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-14T18:20:56.870441] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:56.954092] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-14T18:20:56.955308] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-14T18:20:56.994976] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-14T18:20:57.032620] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-14T18:20:57.366773] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-14T18:20:57.370481] [INFO ] [REMOTE ] GUT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:57.568674] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T18:20:57.588286] [INFO ] [REMOTE ] GVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:57.593851] [INFO ] [REMOTE ] GTLS: Full fetch complete (46477 records). [2025-09-14T18:20:57.593986] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-14T18:20:57.965943] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-14T18:20:57.966051] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-14T18:20:57.966767] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-14T18:20:57.966826] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-14T18:20:57.967846] [DEBUG] [LOCAL ] GTLS: Trimmed 46477 records to 32460 (keeping 150 days of data) [2025-09-14T18:20:58.160509] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-14T18:20:58.185841] [DEBUG] [LOCAL ] GTLS: Primary data saved (32460 records). [2025-09-14T18:20:58.185995] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-14T18:20:58.186107] [INFO ] [MAIN ] Update Progress: 981/2370 symbols completed. GTLS took 27.8s. Estimated remaining: 2h 26m 56s. Rate: 9.5 symbols/min [2025-09-14T18:20:58.369726] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:58.380104] [DEBUG] [LOCAL ] GWH: Loaded 8345 existing records from primary storage. [2025-09-14T18:20:58.380316] [INFO ] [MAIN ] GWH: Loaded 8345 existing records. [2025-09-14T18:20:58.559223] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:58.559462] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-14T18:20:58.559521] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-14T18:20:58.559899] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-14T18:20:58.559961] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-14T18:20:58.715247] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T18:20:58.953238] [INFO ] [REMOTE ] GWH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:58.958788] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-14T18:20:59.612702] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:20:59.758834] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-14T18:20:59.872580] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:21:00.558839] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-14T18:21:01.358891] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-14T18:21:01.795735] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T18:21:02.158859] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-14T18:21:02.263972] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:21:02.958825] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-14T18:21:03.758866] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-14T18:21:03.998525] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-14T18:21:04.558852] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-14T18:21:04.734261] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T18:21:04.858759] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T18:21:05.178077] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:21:05.219837] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (3.06 seconds). [2025-09-14T18:21:05.358876] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-14T18:21:06.158894] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-14T18:21:06.944387] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:21:06.958791] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-14T18:21:07.365962] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T18:21:07.758879] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-14T18:21:08.338056] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T18:21:08.558825] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-14T18:21:08.769064] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T18:21:09.294572] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:21:09.296434] [INFO ] [REMOTE ] GUG: Full fetch complete (13529 records). [2025-09-14T18:21:09.296522] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-14T18:21:09.364001] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-14T18:21:09.673846] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-14T18:21:09.673963] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-14T18:21:09.674279] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-14T18:21:09.674332] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-14T18:21:09.674915] [DEBUG] [LOCAL ] GUG: Trimmed 13529 records to 9060 (keeping 150 days of data) [2025-09-14T18:21:09.731636] [DEBUG] [LOCAL ] GUG: Primary data saved (9060 records). [2025-09-14T18:21:09.731830] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-14T18:21:09.731948] [INFO ] [MAIN ] Update Progress: 982/2370 symbols completed. GUG took 24.8s. Estimated remaining: 2h 26m 57s. Rate: 9.4 symbols/min [2025-09-14T18:21:09.907765] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:09.926532] [DEBUG] [LOCAL ] GWRE: Loaded 17831 existing records from primary storage. [2025-09-14T18:21:09.926731] [INFO ] [MAIN ] GWRE: Loaded 17831 existing records. [2025-09-14T18:21:10.102272] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:10.102507] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-14T18:21:10.102566] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-14T18:21:10.103141] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-14T18:21:10.103205] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-14T18:21:10.165405] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-14T18:21:10.459082] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:10.468791] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T18:21:10.958910] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-14T18:21:11.097419] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:21:11.758880] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-14T18:21:12.563914] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-14T18:21:12.577753] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T18:21:13.305764] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:21:13.358868] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-14T18:21:13.397015] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:21:14.158870] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-14T18:21:14.958812] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-14T18:21:15.351634] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T18:21:15.541524] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T18:21:15.758828] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-14T18:21:16.558909] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-14T18:21:16.645210] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:21:17.358816] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-14T18:21:17.702297] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:21:18.073613] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:21:18.158828] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-14T18:21:18.213947] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:21:18.771206] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:21:18.774479] [INFO ] [REMOTE ] GVA: Full fetch complete (37284 records). [2025-09-14T18:21:18.774594] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-14T18:21:18.964058] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-14T18:21:19.152249] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-14T18:21:19.152355] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-14T18:21:19.153028] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-14T18:21:19.153095] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-14T18:21:19.154034] [DEBUG] [LOCAL ] GVA: Trimmed 37284 records to 24401 (keeping 150 days of data) [2025-09-14T18:21:19.306257] [DEBUG] [LOCAL ] GVA: Primary data saved (24401 records). [2025-09-14T18:21:19.306440] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-14T18:21:19.306581] [INFO ] [MAIN ] Update Progress: 983/2370 symbols completed. GVA took 23.1s. Estimated remaining: 2h 26m 55s. Rate: 9.4 symbols/min [2025-09-14T18:21:19.475340] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:19.486134] [DEBUG] [LOCAL ] GWW: Loaded 9228 existing records from primary storage. [2025-09-14T18:21:19.486277] [INFO ] [MAIN ] GWW: Loaded 9228 existing records. [2025-09-14T18:21:19.667559] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:19.667861] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-14T18:21:19.667934] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-14T18:21:19.668324] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-14T18:21:19.668384] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-14T18:21:19.768246] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-14T18:21:19.935394] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T18:21:19.961623] [INFO ] [REMOTE ] GUT: Full fetch complete (16905 records). [2025-09-14T18:21:19.962216] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-14T18:21:20.172405] [INFO ] [REMOTE ] GWW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:20.415890] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-14T18:21:20.416014] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-14T18:21:20.416587] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-14T18:21:20.416678] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-14T18:21:20.417306] [DEBUG] [LOCAL ] GUT: Trimmed 16905 records to 11603 (keeping 150 days of data) [2025-09-14T18:21:20.486049] [DEBUG] [LOCAL ] GUT: Primary data saved (11603 records). [2025-09-14T18:21:20.486250] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-14T18:21:20.486414] [INFO ] [MAIN ] Update Progress: 984/2370 symbols completed. GUT took 24.4s. Estimated remaining: 2h 26m 42s. Rate: 9.4 symbols/min [2025-09-14T18:21:20.563971] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-14T18:21:20.691129] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:20.711409] [DEBUG] [LOCAL ] GXO: Loaded 20413 existing records from primary storage. [2025-09-14T18:21:20.711578] [INFO ] [MAIN ] GXO: Loaded 20413 existing records. [2025-09-14T18:21:20.886507] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:20.886814] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-14T18:21:20.886892] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-14T18:21:20.887494] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-14T18:21:20.887570] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-14T18:21:21.238796] [INFO ] [REMOTE ] GXO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:21.255394] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T18:21:21.358816] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-14T18:21:22.158874] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-14T18:21:22.271015] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:21:22.316042] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:21:22.958857] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-14T18:21:23.395344] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:21:23.611080] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:21:23.612909] [INFO ] [REMOTE ] GWH: Full fetch complete (16184 records). [2025-09-14T18:21:23.613010] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-14T18:21:23.767424] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-14T18:21:23.994601] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-14T18:21:23.994737] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-14T18:21:23.995175] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-14T18:21:23.995244] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-14T18:21:23.995880] [DEBUG] [LOCAL ] GWH: Trimmed 16184 records to 12881 (keeping 150 days of data) [2025-09-14T18:21:24.068692] [DEBUG] [LOCAL ] GWH: Primary data saved (12881 records). [2025-09-14T18:21:24.068880] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-14T18:21:24.068998] [INFO ] [MAIN ] Update Progress: 985/2370 symbols completed. GWH took 25.9s. Estimated remaining: 2h 26m 31s. Rate: 9.5 symbols/min [2025-09-14T18:21:24.243443] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:24.246151] [DEBUG] [LOCAL ] GYLD: Loaded 828 existing records from primary storage. [2025-09-14T18:21:24.246250] [INFO ] [MAIN ] GYLD: Loaded 828 existing records. [2025-09-14T18:21:24.421420] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:24.421712] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-14T18:21:24.421770] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-14T18:21:24.421975] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-14T18:21:24.422033] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-14T18:21:24.565842] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-14T18:21:24.780215] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:25.138871] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:21:25.358821] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-14T18:21:26.158858] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-14T18:21:26.306557] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T18:21:26.368523] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:21:26.706574] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T18:21:26.958843] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-14T18:21:27.758830] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-14T18:21:28.205028] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T18:21:28.558849] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-14T18:21:29.362047] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-14T18:21:29.368816] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T18:21:29.613109] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T18:21:30.158844] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-14T18:21:30.968076] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-14T18:21:30.973277] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:21:31.468326] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T18:21:31.758832] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-14T18:21:32.003840] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:21:32.558831] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-14T18:21:33.355968] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:21:33.363793] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-14T18:21:33.708886] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-14T18:21:33.746937] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T18:21:34.158830] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-14T18:21:34.821678] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:21:34.826188] [INFO ] [REMOTE ] GWRE: Full fetch complete (45372 records). [2025-09-14T18:21:34.826302] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-14T18:21:34.970095] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-14T18:21:35.210130] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-14T18:21:35.210282] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-14T18:21:35.211166] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-14T18:21:35.211243] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-14T18:21:35.212462] [DEBUG] [LOCAL ] GWRE: Trimmed 45372 records to 30251 (keeping 150 days of data) [2025-09-14T18:21:35.404963] [DEBUG] [LOCAL ] GWRE: Primary data saved (30251 records). [2025-09-14T18:21:35.405147] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-14T18:21:35.405254] [INFO ] [MAIN ] Update Progress: 986/2370 symbols completed. GWRE took 25.7s. Estimated remaining: 2h 26m 32s. Rate: 9.4 symbols/min [2025-09-14T18:21:35.578877] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:35.599274] [DEBUG] [LOCAL ] H: Loaded 19974 existing records from primary storage. [2025-09-14T18:21:35.599438] [INFO ] [MAIN ] H: Loaded 19974 existing records. [2025-09-14T18:21:35.773963] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-14T18:21:35.779254] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:35.780345] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-14T18:21:35.780413] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-14T18:21:35.781104] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-14T18:21:35.781183] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-14T18:21:36.154986] [INFO ] [REMOTE ] H: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:36.230568] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T18:21:36.558821] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-14T18:21:36.818264] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:21:37.358848] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-14T18:21:37.741741] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:21:38.158848] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-14T18:21:38.582715] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T18:21:38.958821] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-14T18:21:39.073576] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:21:39.441635] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T18:21:39.758835] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-14T18:21:40.251023] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T18:21:40.558865] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-14T18:21:41.358847] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-14T18:21:41.923961] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T18:21:42.158873] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-14T18:21:42.958894] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-14T18:21:43.150440] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T18:21:43.400973] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T18:21:43.403436] [INFO ] [REMOTE ] GWW: Full fetch complete (21607 records). [2025-09-14T18:21:43.403547] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-14T18:21:43.763049] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-14T18:21:43.774115] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-14T18:21:43.774270] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-14T18:21:43.774825] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-14T18:21:43.774893] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-14T18:21:43.790789] [DEBUG] [LOCAL ] GWW: Trimmed 21607 records to 14121 (keeping 150 days of data) [2025-09-14T18:21:43.814819] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:21:43.916039] [DEBUG] [LOCAL ] GWW: Primary data saved (14121 records). [2025-09-14T18:21:43.916196] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-14T18:21:43.916336] [INFO ] [MAIN ] Update Progress: 987/2370 symbols completed. GWW took 24.6s. Estimated remaining: 2h 26m 29s. Rate: 9.4 symbols/min [2025-09-14T18:21:44.083577] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:44.101047] [DEBUG] [LOCAL ] HAE: Loaded 17418 existing records from primary storage. [2025-09-14T18:21:44.101202] [INFO ] [MAIN ] HAE: Loaded 17418 existing records. [2025-09-14T18:21:44.275691] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:44.275967] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-14T18:21:44.276042] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-14T18:21:44.276586] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-14T18:21:44.276674] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-14T18:21:44.563425] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-14T18:21:44.657771] [INFO ] [REMOTE ] HAE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:45.072455] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T18:21:45.073423] [INFO ] [REMOTE ] GYLD: Full fetch complete (1632 records). [2025-09-14T18:21:45.073524] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-14T18:21:45.361439] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-14T18:21:45.457803] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-14T18:21:45.457948] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-14T18:21:45.458077] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-14T18:21:45.458472] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-14T18:21:45.459124] [DEBUG] [LOCAL ] GYLD: Trimmed 1632 records to 1127 (keeping 150 days of data) [2025-09-14T18:21:45.469590] [DEBUG] [LOCAL ] GYLD: Primary data saved (1127 records). [2025-09-14T18:21:45.469854] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-14T18:21:45.470053] [INFO ] [MAIN ] Update Progress: 988/2370 symbols completed. GYLD took 21.4s. Estimated remaining: 2h 26m 16s. Rate: 9.4 symbols/min [2025-09-14T18:21:45.741072] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:45.803771] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T18:21:45.843367] [DEBUG] [LOCAL ] HAFN: Loaded 18589 existing records from primary storage. [2025-09-14T18:21:45.845113] [INFO ] [MAIN ] HAFN: Loaded 18589 existing records. [2025-09-14T18:21:46.126933] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:46.128890] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-14T18:21:46.128989] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-14T18:21:46.129749] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-14T18:21:46.131163] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-14T18:21:46.168016] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-14T18:21:46.624466] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:46.958899] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-14T18:21:47.087233] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:21:47.758916] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-14T18:21:47.918541] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T18:21:48.558862] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-14T18:21:48.598997] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:21:49.358870] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-14T18:21:49.408452] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:21:50.106495] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:21:50.158777] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-14T18:21:50.948596] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T18:21:50.958777] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-14T18:21:51.758907] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-14T18:21:51.981361] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:21:52.435493] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:21:52.558811] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-14T18:21:53.002878] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T18:21:53.358848] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-14T18:21:53.898763] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T18:21:54.158861] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-14T18:21:54.897285] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:21:54.958859] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-14T18:21:55.671238] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:21:55.758855] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-14T18:21:56.422003] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:21:56.426614] [INFO ] [REMOTE ] H: Full fetch complete (49058 records). [2025-09-14T18:21:56.426757] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-14T18:21:56.568939] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-14T18:21:56.808805] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-14T18:21:56.808925] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-14T18:21:56.809708] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-14T18:21:56.809774] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-14T18:21:56.810819] [DEBUG] [LOCAL ] H: Trimmed 49058 records to 33612 (keeping 150 days of data) [2025-09-14T18:21:56.934392] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T18:21:57.076912] [DEBUG] [LOCAL ] H: Primary data saved (33612 records). [2025-09-14T18:21:57.077096] [INFO ] [MAIN ] H: Full history saved. [2025-09-14T18:21:57.077237] [INFO ] [MAIN ] Update Progress: 989/2370 symbols completed. H took 21.7s. Estimated remaining: 2h 26m 17s. Rate: 9.4 symbols/min [2025-09-14T18:21:57.250970] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:57.274293] [DEBUG] [LOCAL ] HAL: Loaded 24078 existing records from primary storage. [2025-09-14T18:21:57.274470] [INFO ] [MAIN ] HAL: Loaded 24078 existing records. [2025-09-14T18:21:57.364237] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-14T18:21:57.453103] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:57.453359] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-14T18:21:57.453419] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-14T18:21:57.454151] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-14T18:21:57.454216] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-14T18:21:57.807668] [INFO ] [REMOTE ] HAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:58.113001] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T18:21:58.158848] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-14T18:21:58.925307] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T18:21:58.958782] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-14T18:21:59.694816] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:21:59.758813] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-14T18:22:00.558864] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-14T18:22:00.710544] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T18:22:01.320458] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:22:01.358792] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-14T18:22:02.042173] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:22:02.051106] [INFO ] [REMOTE ] HAE: Full fetch complete (43964 records). [2025-09-14T18:22:02.051343] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-14T18:22:02.163988] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-14T18:22:02.424067] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-14T18:22:02.424175] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-14T18:22:02.424918] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-14T18:22:02.424991] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-14T18:22:02.426023] [DEBUG] [LOCAL ] HAE: Trimmed 43964 records to 28379 (keeping 150 days of data) [2025-09-14T18:22:02.597832] [DEBUG] [LOCAL ] HAE: Primary data saved (28379 records). [2025-09-14T18:22:02.598004] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-14T18:22:02.598152] [INFO ] [MAIN ] Update Progress: 990/2370 symbols completed. HAE took 18.7s. Estimated remaining: 2h 26m 9s. Rate: 9.4 symbols/min [2025-09-14T18:22:02.767735] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:02.810468] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-14T18:22:02.829202] [DEBUG] [LOCAL ] HASI: Loaded 21285 existing records from primary storage. [2025-09-14T18:22:02.829369] [INFO ] [MAIN ] HASI: Loaded 21285 existing records. [2025-09-14T18:22:02.972778] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-14T18:22:03.012141] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:03.012419] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-14T18:22:03.012482] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-14T18:22:03.013160] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-14T18:22:03.013226] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-14T18:22:03.365629] [INFO ] [REMOTE ] HASI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:03.758894] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-14T18:22:03.920137] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:22:04.062766] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T18:22:04.068288] [INFO ] [REMOTE ] GXO: Full fetch complete (52543 records). [2025-09-14T18:22:04.068414] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-14T18:22:04.462780] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-14T18:22:04.462908] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-14T18:22:04.463684] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-14T18:22:04.463742] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-14T18:22:04.464999] [DEBUG] [LOCAL ] GXO: Trimmed 52543 records to 34988 (keeping 150 days of data) [2025-09-14T18:22:04.560598] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-14T18:22:04.702385] [DEBUG] [LOCAL ] GXO: Primary data saved (34988 records). [2025-09-14T18:22:04.702576] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-14T18:22:04.702722] [INFO ] [MAIN ] Update Progress: 991/2370 symbols completed. GXO took 44.2s. Estimated remaining: 2h 25m 57s. Rate: 9.4 symbols/min [2025-09-14T18:22:04.881726] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:04.906560] [DEBUG] [LOCAL ] HAYW: Loaded 21960 existing records from primary storage. [2025-09-14T18:22:04.906780] [INFO ] [MAIN ] HAYW: Loaded 21960 existing records. [2025-09-14T18:22:05.092946] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:05.093307] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-14T18:22:05.093496] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-14T18:22:05.094218] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-14T18:22:05.094290] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-14T18:22:05.389577] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-14T18:22:05.499202] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-14T18:22:05.546010] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:05.964245] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T18:22:06.158839] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-14T18:22:06.958870] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-14T18:22:07.160260] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:22:07.467710] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T18:22:07.758846] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-14T18:22:08.558885] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-14T18:22:09.047807] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T18:22:09.358865] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-14T18:22:09.590321] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:22:10.158841] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-14T18:22:10.284195] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:22:10.685764] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T18:22:10.690428] [INFO ] [REMOTE ] HAFN: Full fetch complete (48471 records). [2025-09-14T18:22:10.690584] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-14T18:22:10.963950] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-14T18:22:11.106739] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-14T18:22:11.106863] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-14T18:22:11.107672] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-14T18:22:11.107750] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-14T18:22:11.109312] [DEBUG] [LOCAL ] HAFN: Trimmed 48471 records to 32231 (keeping 150 days of data) [2025-09-14T18:22:11.305411] [DEBUG] [LOCAL ] HAFN: Primary data saved (32231 records). [2025-09-14T18:22:11.305625] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-14T18:22:11.305779] [INFO ] [MAIN ] Update Progress: 992/2370 symbols completed. HAFN took 25.8s. Estimated remaining: 2h 25m 51s. Rate: 9.4 symbols/min [2025-09-14T18:22:11.472667] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:11.477213] [DEBUG] [LOCAL ] HBB: Loaded 2448 existing records from primary storage. [2025-09-14T18:22:11.477331] [INFO ] [MAIN ] HBB: Loaded 2448 existing records. [2025-09-14T18:22:11.659127] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:11.659431] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-14T18:22:11.659494] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-14T18:22:11.659800] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-14T18:22:11.659862] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-14T18:22:11.765057] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-14T18:22:12.036685] [INFO ] [REMOTE ] HBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:12.068436] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:22:12.558910] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-14T18:22:12.800727] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T18:22:13.358932] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-14T18:22:13.992840] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-14T18:22:14.158844] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-14T18:22:14.253658] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:22:14.588976] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T18:22:14.958886] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-14T18:22:15.103338] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T18:22:15.758862] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-14T18:22:16.558855] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-14T18:22:16.620849] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T18:22:17.358839] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-14T18:22:17.501579] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:22:18.158933] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-14T18:22:18.729561] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-14T18:22:18.798593] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:22:18.943228] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T18:22:18.958785] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-14T18:22:19.608269] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:22:19.615268] [INFO ] [REMOTE ] HASI: Full fetch complete (51428 records). [2025-09-14T18:22:19.615450] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-14T18:22:19.765108] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-14T18:22:20.015112] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-14T18:22:20.015237] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-14T18:22:20.016154] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-14T18:22:20.016220] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-14T18:22:20.017359] [DEBUG] [LOCAL ] HASI: Trimmed 51428 records to 35913 (keeping 150 days of data) [2025-09-14T18:22:20.256595] [DEBUG] [LOCAL ] HASI: Primary data saved (35913 records). [2025-09-14T18:22:20.256783] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-14T18:22:20.256880] [INFO ] [MAIN ] Update Progress: 993/2370 symbols completed. HASI took 17.7s. Estimated remaining: 2h 25m 48s. Rate: 9.4 symbols/min [2025-09-14T18:22:20.434850] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:20.457862] [DEBUG] [LOCAL ] HBI: Loaded 23612 existing records from primary storage. [2025-09-14T18:22:20.458040] [INFO ] [MAIN ] HBI: Loaded 23612 existing records. [2025-09-14T18:22:20.561298] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-14T18:22:20.641073] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:20.641308] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-14T18:22:20.641369] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-14T18:22:20.642109] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-14T18:22:20.642175] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-14T18:22:20.988531] [INFO ] [REMOTE ] HBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:21.358841] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-14T18:22:22.027188] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T18:22:22.069350] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:22:22.158829] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-14T18:22:22.820576] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:22:22.958836] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-14T18:22:23.758905] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-14T18:22:23.833993] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T18:22:23.882456] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:22:24.558837] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-14T18:22:25.358873] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-14T18:22:25.607160] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:22:25.813608] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:22:26.158855] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-14T18:22:26.947758] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:22:26.958771] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-14T18:22:27.038554] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T18:22:27.549722] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T18:22:27.758880] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-14T18:22:28.558879] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-14T18:22:29.271621] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T18:22:29.358820] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-14T18:22:29.414675] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:22:30.029580] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:22:30.035010] [INFO ] [REMOTE ] HAYW: Full fetch complete (53022 records). [2025-09-14T18:22:30.035122] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-14T18:22:30.164075] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-14T18:22:30.435046] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-14T18:22:30.435161] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-14T18:22:30.436036] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-14T18:22:30.436102] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-14T18:22:30.437328] [DEBUG] [LOCAL ] HAYW: Trimmed 53022 records to 36396 (keeping 150 days of data) [2025-09-14T18:22:30.659825] [DEBUG] [LOCAL ] HAYW: Primary data saved (36396 records). [2025-09-14T18:22:30.660002] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-14T18:22:30.660104] [INFO ] [MAIN ] Update Progress: 994/2370 symbols completed. HAYW took 26.0s. Estimated remaining: 2h 25m 47s. Rate: 9.4 symbols/min [2025-09-14T18:22:30.832445] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:30.854830] [DEBUG] [LOCAL ] HBM: Loaded 23717 existing records from primary storage. [2025-09-14T18:22:30.854999] [INFO ] [MAIN ] HBM: Loaded 23717 existing records. [2025-09-14T18:22:30.968975] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-14T18:22:31.042316] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:31.042797] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-14T18:22:31.043039] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-14T18:22:31.058053] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T18:22:31.058122] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-14T18:22:31.058369] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-14T18:22:31.135027] [INFO ] [REMOTE ] HAL: Full fetch complete (58397 records). [2025-09-14T18:22:31.167514] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-14T18:22:31.723708] [INFO ] [REMOTE ] HBM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:31.767004] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-14T18:22:31.819636] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-14T18:22:31.819962] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-14T18:22:31.820937] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-14T18:22:31.826807] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-14T18:22:31.827865] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:22:31.831612] [DEBUG] [LOCAL ] HAL: Trimmed 58397 records to 40458 (keeping 150 days of data) [2025-09-14T18:22:32.099494] [DEBUG] [LOCAL ] HAL: Primary data saved (40458 records). [2025-09-14T18:22:32.099677] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-14T18:22:32.099780] [INFO ] [MAIN ] Update Progress: 995/2370 symbols completed. HAL took 35.0s. Estimated remaining: 2h 25m 34s. Rate: 9.4 symbols/min [2025-09-14T18:22:32.268285] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:32.288859] [DEBUG] [LOCAL ] HCA: Loaded 21104 existing records from primary storage. [2025-09-14T18:22:32.289036] [INFO ] [MAIN ] HCA: Loaded 21104 existing records. [2025-09-14T18:22:32.472796] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:32.473269] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-14T18:22:32.473331] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-14T18:22:32.474023] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-14T18:22:32.474084] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-14T18:22:32.563963] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-14T18:22:32.830552] [INFO ] [REMOTE ] HCA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:33.089421] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T18:22:33.090415] [INFO ] [REMOTE ] HBB: Full fetch complete (7591 records). [2025-09-14T18:22:33.090501] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-14T18:22:33.366071] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-14T18:22:33.457875] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-14T18:22:33.458093] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-14T18:22:33.458315] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-14T18:22:33.458384] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-14T18:22:33.459183] [DEBUG] [LOCAL ] HBB: Trimmed 7591 records to 4952 (keeping 150 days of data) [2025-09-14T18:22:33.515388] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:22:33.528863] [DEBUG] [LOCAL ] HBB: Primary data saved (4952 records). [2025-09-14T18:22:33.528962] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-14T18:22:33.529065] [INFO ] [MAIN ] Update Progress: 996/2370 symbols completed. HBB took 22.2s. Estimated remaining: 2h 25m 21s. Rate: 9.5 symbols/min [2025-09-14T18:22:33.697917] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:33.717342] [DEBUG] [LOCAL ] HCC: Loaded 20233 existing records from primary storage. [2025-09-14T18:22:33.717495] [INFO ] [MAIN ] HCC: Loaded 20233 existing records. [2025-09-14T18:22:33.898073] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:33.898354] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-14T18:22:33.898415] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-14T18:22:33.899124] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-14T18:22:33.899190] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-14T18:22:34.169436] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-14T18:22:34.261818] [INFO ] [REMOTE ] HCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:34.958832] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-14T18:22:35.151906] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:22:35.758827] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-14T18:22:36.120850] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T18:22:36.209416] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T18:22:36.558826] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-14T18:22:37.358837] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-14T18:22:37.652996] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:22:38.158881] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-14T18:22:38.549232] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T18:22:38.944526] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:22:38.958784] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-14T18:22:39.670803] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:22:39.758837] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-14T18:22:40.558860] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-14T18:22:40.773258] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:22:41.358842] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-14T18:22:41.633359] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T18:22:42.158848] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-14T18:22:42.378331] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T18:22:42.958865] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-14T18:22:43.037245] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T18:22:43.758827] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-14T18:22:43.861806] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:22:44.563886] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-14T18:22:44.578764] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:22:45.364883] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-14T18:22:45.379675] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:22:45.987042] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:22:46.158837] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-14T18:22:46.803683] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T18:22:46.958893] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-14T18:22:47.711606] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:22:47.758837] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-14T18:22:48.558839] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-14T18:22:48.734779] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:22:49.358813] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-14T18:22:49.453421] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T18:22:50.158830] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-14T18:22:50.413320] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T18:22:50.565185] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:22:50.570201] [INFO ] [REMOTE ] HCA: Full fetch complete (51838 records). [2025-09-14T18:22:50.570343] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-14T18:22:50.951953] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-14T18:22:50.952093] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-14T18:22:50.953046] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-14T18:22:50.953242] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-14T18:22:50.954928] [DEBUG] [LOCAL ] HCA: Trimmed 51838 records to 35505 (keeping 150 days of data) [2025-09-14T18:22:51.016418] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-14T18:22:51.090149] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:22:51.235540] [DEBUG] [LOCAL ] HCA: Primary data saved (35505 records). [2025-09-14T18:22:51.235780] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-14T18:22:51.235911] [INFO ] [MAIN ] Update Progress: 997/2370 symbols completed. HCA took 19.1s. Estimated remaining: 2h 25m 30s. Rate: 9.4 symbols/min [2025-09-14T18:22:51.758847] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-14T18:22:52.558890] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-14T18:22:52.861829] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T18:22:53.182160] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:22:53.208833] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:22:53.213433] [INFO ] [REMOTE ] HCC: Full fetch complete (49518 records). [2025-09-14T18:22:53.213548] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-14T18:22:53.367546] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-14T18:22:53.596149] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-14T18:22:53.596287] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-14T18:22:53.597118] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-14T18:22:53.597182] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-14T18:22:53.598772] [DEBUG] [LOCAL ] HCC: Trimmed 49518 records to 34006 (keeping 150 days of data) [2025-09-14T18:22:53.811820] [DEBUG] [LOCAL ] HCC: Primary data saved (34006 records). [2025-09-14T18:22:53.812001] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-14T18:22:53.812106] [INFO ] [MAIN ] Update Progress: 998/2370 symbols completed. HCC took 20.3s. Estimated remaining: 2h 25m 19s. Rate: 9.4 symbols/min [2025-09-14T18:22:54.158845] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-14T18:22:54.823173] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:22:54.828664] [INFO ] [REMOTE ] HBI: Full fetch complete (57719 records). [2025-09-14T18:22:54.828827] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-14T18:22:55.216516] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-14T18:22:55.216870] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-14T18:22:55.217853] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-14T18:22:55.217988] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-14T18:22:55.219502] [DEBUG] [LOCAL ] HBI: Trimmed 57719 records to 39850 (keeping 150 days of data) [2025-09-14T18:22:55.332531] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T18:22:55.346724] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-14T18:22:55.485721] [DEBUG] [LOCAL ] HBI: Primary data saved (39850 records). [2025-09-14T18:22:55.485898] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-14T18:22:55.486013] [INFO ] [MAIN ] Update Progress: 999/2370 symbols completed. HBI took 35.2s. Estimated remaining: 2h 25m 6s. Rate: 9.4 symbols/min [2025-09-14T18:22:57.005480] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T18:22:57.011279] [INFO ] [REMOTE ] HBM: Full fetch complete (57550 records). [2025-09-14T18:22:57.011474] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-14T18:22:57.398028] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-14T18:22:57.398165] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-14T18:22:57.399019] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-14T18:22:57.399093] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-14T18:22:57.400320] [DEBUG] [LOCAL ] HBM: Trimmed 57550 records to 39770 (keeping 150 days of data) [2025-09-14T18:22:57.692468] [DEBUG] [LOCAL ] HBM: Primary data saved (39770 records). [2025-09-14T18:22:57.692713] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-14T18:22:57.692883] [INFO ] [MAIN ] Update Progress: 1000/2370 symbols completed. HBM took 27.0s. Estimated remaining: 2h 24m 54s. Rate: 9.5 symbols/min [2025-09-14T18:22:58.441415] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:58.635971] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:58.588246] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:58.682375] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:58.683099] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-14T18:22:58.684066] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-14T18:22:58.690092] [DEBUG] [LOCAL ] HCI: Loaded 6530 existing records from primary storage. [2025-09-14T18:22:58.690503] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-14T18:22:58.690944] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-14T18:22:58.691077] [INFO ] [MAIN ] HCI: Loaded 6530 existing records. [2025-09-14T18:22:58.691225] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-14T18:22:58.755217] [DEBUG] [LOCAL ] HCXY: Removed from QA tracker. [2025-09-14T18:22:58.806008] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-14T18:22:58.900552] [DEBUG] [LOCAL ] HDB: Loaded 22844 existing records from primary storage. [2025-09-14T18:22:58.986174] [DEBUG] [LOCAL ] HD: Loaded 24024 existing records from primary storage. [2025-09-14T18:22:58.955841] [INFO ] [MAIN ] HDB: Loaded 22844 existing records. [2025-09-14T18:22:59.097432] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:59.111029] [INFO ] [MAIN ] HD: Loaded 24024 existing records. [2025-09-14T18:22:59.257127] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-14T18:22:59.351609] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-14T18:22:59.489375] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-14T18:22:59.545682] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-14T18:22:59.601886] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:59.650310] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-14T18:22:59.719155] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:59.802397] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-14T18:22:59.826248] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-14T18:22:59.841529] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:59.852019] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-14T18:22:59.884776] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-14T18:22:59.916197] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-14T18:22:59.926200] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-14T18:22:59.962140] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-14T18:22:59.962222] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-14T18:23:00.211454] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-14T18:23:00.276621] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-14T18:23:00.381362] [INFO ] [REMOTE ] HCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:00.408768] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-14T18:23:00.726155] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T18:23:00.809776] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-14T18:23:00.813913] [INFO ] [REMOTE ] HDB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:00.832373] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-14T18:23:00.836108] [INFO ] [REMOTE ] HD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:00.837395] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-14T18:23:01.036170] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-14T18:23:01.037096] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-14T18:23:01.242989] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-14T18:23:01.358828] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-14T18:23:04.915414] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-09-14T18:23:04.916382] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-14T18:23:05.219291] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-14T18:23:05.220252] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-14T18:23:05.288098] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (4.46 seconds). [2025-09-14T18:23:05.298123] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-14T18:23:05.481508] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (5.07 seconds). [2025-09-14T18:23:05.484358] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-14T18:23:05.672017] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-14T18:23:05.673081] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-14T18:23:05.895773] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T18:23:05.896526] [INFO ] [REMOTE ] HCXY: Full fetch complete (388 records). [2025-09-14T18:23:05.896615] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-14T18:23:05.897045] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T18:23:05.897122] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:23:05.897198] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:23:05.897268] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-14T18:23:05.897347] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-14T18:23:05.897404] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-14T18:23:05.897486] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-14T18:23:05.897579] [INFO ] [MAIN ] Update Progress: 1001/2370 symbols completed. HCXY took 8.2s. Estimated remaining: 2h 24m 50s. Rate: 9.5 symbols/min [2025-09-14T18:23:06.079081] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:06.115374] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:23:06.141270] [DEBUG] [LOCAL ] HE: Loaded 21983 existing records from primary storage. [2025-09-14T18:23:06.141540] [INFO ] [MAIN ] HE: Loaded 21983 existing records. [2025-09-14T18:23:06.163887] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-14T18:23:06.328882] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:06.329288] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-14T18:23:06.329368] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-14T18:23:06.343938] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-14T18:23:06.367072] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-14T18:23:06.458179] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (5.62 seconds). [2025-09-14T18:23:06.717491] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T18:23:06.779900] [INFO ] [REMOTE ] HE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:06.958853] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-14T18:23:07.145362] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T18:23:07.758837] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-14T18:23:08.558886] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-14T18:23:08.852246] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T18:23:08.904697] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T18:23:09.358824] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-14T18:23:09.557106] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T18:23:10.087628] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:23:10.158870] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-14T18:23:10.958841] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-14T18:23:11.086475] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T18:23:11.758808] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-14T18:23:12.103956] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:23:12.558896] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-14T18:23:12.620821] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:23:13.358884] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-14T18:23:13.583506] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T18:23:14.158830] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-14T18:23:14.282001] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T18:23:14.963910] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-14T18:23:14.993881] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T18:23:15.758853] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-14T18:23:16.558836] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-14T18:23:16.895892] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:23:16.918491] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:23:17.358944] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-14T18:23:17.361713] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T18:23:18.158877] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-14T18:23:18.290430] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:23:18.878585] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:23:18.884031] [INFO ] [REMOTE ] HDB: Full fetch complete (56493 records). [2025-09-14T18:23:18.884179] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-14T18:23:18.963901] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-14T18:23:19.276035] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-14T18:23:19.276151] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-14T18:23:19.277051] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-14T18:23:19.277120] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-14T18:23:19.278352] [DEBUG] [LOCAL ] HDB: Trimmed 56493 records to 38803 (keeping 150 days of data) [2025-09-14T18:23:19.531328] [DEBUG] [LOCAL ] HDB: Primary data saved (38803 records). [2025-09-14T18:23:19.531541] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-14T18:23:19.531687] [INFO ] [MAIN ] Update Progress: 1002/2370 symbols completed. HDB took 21.8s. Estimated remaining: 2h 24m 54s. Rate: 9.4 symbols/min [2025-09-14T18:23:19.723128] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:19.738331] [DEBUG] [LOCAL ] HEI: Loaded 13360 existing records from primary storage. [2025-09-14T18:23:19.738500] [INFO ] [MAIN ] HEI: Loaded 13360 existing records. [2025-09-14T18:23:19.768711] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-14T18:23:19.921478] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:19.921778] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-14T18:23:19.921855] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-14T18:23:19.922312] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-14T18:23:19.922375] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-14T18:23:20.241782] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T18:23:20.322062] [INFO ] [REMOTE ] HEI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:20.558832] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-14T18:23:21.358838] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-14T18:23:21.630670] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T18:23:21.632545] [INFO ] [REMOTE ] HCI: Full fetch complete (14889 records). [2025-09-14T18:23:21.632632] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-14T18:23:21.956945] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T18:23:22.043933] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-14T18:23:22.044192] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-14T18:23:22.044613] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-14T18:23:22.044759] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-14T18:23:22.045580] [DEBUG] [LOCAL ] HCI: Trimmed 14889 records to 10468 (keeping 150 days of data) [2025-09-14T18:23:22.121352] [DEBUG] [LOCAL ] HCI: Primary data saved (10468 records). [2025-09-14T18:23:22.121829] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-14T18:23:22.122067] [INFO ] [MAIN ] Update Progress: 1003/2370 symbols completed. HCI took 24.4s. Estimated remaining: 2h 24m 42s. Rate: 9.4 symbols/min [2025-09-14T18:23:22.164119] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-14T18:23:22.312700] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:23:22.339541] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:22.344684] [DEBUG] [LOCAL ] HEQ: Loaded 2530 existing records from primary storage. [2025-09-14T18:23:22.344785] [INFO ] [MAIN ] HEQ: Loaded 2530 existing records. [2025-09-14T18:23:22.525484] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:22.525796] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-14T18:23:22.525861] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-14T18:23:22.526112] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-14T18:23:22.526170] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-14T18:23:22.879094] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:22.958846] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-14T18:23:23.601877] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T18:23:23.674539] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:23:23.758900] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-14T18:23:24.558838] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-14T18:23:24.794380] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T18:23:24.994827] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-14T18:23:25.358828] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-14T18:23:26.158876] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-14T18:23:26.950908] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:23:26.959027] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-14T18:23:27.758829] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-14T18:23:27.814857] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:23:28.305049] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:23:28.314895] [INFO ] [REMOTE ] HD: Full fetch complete (58166 records). [2025-09-14T18:23:28.315080] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-14T18:23:28.492836] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T18:23:28.564265] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-14T18:23:28.728980] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-14T18:23:28.729095] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-14T18:23:28.730133] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-14T18:23:28.730200] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-14T18:23:28.731482] [DEBUG] [LOCAL ] HD: Trimmed 58166 records to 40285 (keeping 150 days of data) [2025-09-14T18:23:28.995326] [DEBUG] [LOCAL ] HD: Primary data saved (40285 records). [2025-09-14T18:23:28.995481] [INFO ] [MAIN ] HD: Full history saved. [2025-09-14T18:23:28.995621] [INFO ] [MAIN ] Update Progress: 1004/2370 symbols completed. HD took 31.3s. Estimated remaining: 2h 24m 37s. Rate: 9.4 symbols/min [2025-09-14T18:23:29.103991] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T18:23:29.175420] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:29.198855] [DEBUG] [LOCAL ] HESM: Loaded 22408 existing records from primary storage. [2025-09-14T18:23:29.199027] [INFO ] [MAIN ] HESM: Loaded 22408 existing records. [2025-09-14T18:23:29.367941] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-14T18:23:29.389278] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:29.390760] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-14T18:23:29.390830] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-14T18:23:29.391610] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-14T18:23:29.391715] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-14T18:23:29.748962] [INFO ] [REMOTE ] HESM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:30.158897] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-14T18:23:30.960534] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-14T18:23:30.962573] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T18:23:31.092365] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T18:23:31.758888] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-14T18:23:32.558830] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-14T18:23:32.731126] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:23:32.931219] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T18:23:33.253444] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T18:23:33.358829] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-14T18:23:34.158855] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-14T18:23:34.958909] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-14T18:23:35.158822] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:23:35.532859] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:23:35.758905] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-14T18:23:36.424677] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T18:23:36.558889] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-14T18:23:37.073197] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T18:23:37.079569] [INFO ] [REMOTE ] HE: Full fetch complete (53956 records). [2025-09-14T18:23:37.079962] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-14T18:23:37.139209] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T18:23:37.366229] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-14T18:23:37.514659] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-14T18:23:37.514798] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-14T18:23:37.515654] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-14T18:23:37.515721] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-14T18:23:37.517084] [DEBUG] [LOCAL ] HE: Trimmed 53956 records to 36684 (keeping 150 days of data) [2025-09-14T18:23:37.755117] [DEBUG] [LOCAL ] HE: Primary data saved (36684 records). [2025-09-14T18:23:37.755401] [INFO ] [MAIN ] HE: Full history saved. [2025-09-14T18:23:37.755569] [INFO ] [MAIN ] Update Progress: 1005/2370 symbols completed. HE took 31.9s. Estimated remaining: 2h 24m 34s. Rate: 9.4 symbols/min [2025-09-14T18:23:37.956086] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:37.958911] [DEBUG] [LOCAL ] HF: Loaded 93 existing records from primary storage. [2025-09-14T18:23:37.959064] [INFO ] [MAIN ] HF: Loaded 93 existing records. [2025-09-14T18:23:38.155770] [WARN ] [MAIN ] HF: Insufficient historical data. Have data from 2025-06-17, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:38.156110] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-14T18:23:38.156175] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-14T18:23:38.156444] [DEBUG] [LOCAL ] HF: Deleted primary data file. [2025-09-14T18:23:38.157067] [DEBUG] [LOCAL ] HF: Removed from QA tracker. [2025-09-14T18:23:38.157140] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-14T18:23:38.169476] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-14T18:23:38.546843] [INFO ] [REMOTE ] HF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:38.958842] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-14T18:23:39.124550] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:23:39.613050] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T18:23:39.637347] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:23:39.758780] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-14T18:23:40.558820] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-14T18:23:41.018007] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:23:41.021383] [INFO ] [REMOTE ] HEI: Full fetch complete (36458 records). [2025-09-14T18:23:41.021556] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-14T18:23:41.367830] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-14T18:23:41.423027] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-14T18:23:41.423158] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-14T18:23:41.424366] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-14T18:23:41.424444] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-14T18:23:41.426346] [DEBUG] [LOCAL ] HEI: Trimmed 36458 records to 23960 (keeping 150 days of data) [2025-09-14T18:23:41.599352] [DEBUG] [LOCAL ] HEI: Primary data saved (23960 records). [2025-09-14T18:23:41.599533] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-14T18:23:41.599683] [INFO ] [MAIN ] Update Progress: 1006/2370 symbols completed. HEI took 22.1s. Estimated remaining: 2h 24m 24s. Rate: 9.4 symbols/min [2025-09-14T18:23:41.783465] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:41.786260] [DEBUG] [LOCAL ] HFND: Loaded 583 existing records from primary storage. [2025-09-14T18:23:41.786351] [INFO ] [MAIN ] HFND: Loaded 583 existing records. [2025-09-14T18:23:41.869678] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T18:23:41.984026] [WARN ] [MAIN ] HFND: Insufficient historical data. Have data from 2025-06-17, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:41.984373] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-14T18:23:41.984456] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-14T18:23:41.984834] [DEBUG] [LOCAL ] HFND: Deleted primary data file. [2025-09-14T18:23:41.984913] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-14T18:23:42.170800] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-14T18:23:42.364599] [INFO ] [REMOTE ] HFND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:42.397502] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:23:42.577173] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-14T18:23:42.958819] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-14T18:23:43.244138] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-14T18:23:43.758837] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-14T18:23:44.558872] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-14T18:23:45.001262] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-14T18:23:45.358807] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-14T18:23:45.456763] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:23:45.649949] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-14T18:23:46.158852] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-14T18:23:46.435694] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-14T18:23:46.958878] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-14T18:23:47.266290] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-14T18:23:47.758846] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-14T18:23:48.558841] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-14T18:23:48.829863] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-14T18:23:49.358849] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-14T18:23:49.621206] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:23:50.151010] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T18:23:50.158784] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-14T18:23:50.612354] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T18:23:50.958907] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-14T18:23:51.758882] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-14T18:23:52.393987] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T18:23:52.558841] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-14T18:23:52.653877] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T18:23:53.190710] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:23:53.192227] [INFO ] [REMOTE ] HEQ: Full fetch complete (6465 records). [2025-09-14T18:23:53.192332] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-14T18:23:53.384360] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-14T18:23:53.567420] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-14T18:23:53.567524] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-14T18:23:53.567759] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-14T18:23:53.567820] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-14T18:23:53.568236] [DEBUG] [LOCAL ] HEQ: Trimmed 6465 records to 4247 (keeping 150 days of data) [2025-09-14T18:23:53.598201] [DEBUG] [LOCAL ] HEQ: Primary data saved (4247 records). [2025-09-14T18:23:53.598304] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-14T18:23:53.598444] [INFO ] [MAIN ] Update Progress: 1007/2370 symbols completed. HEQ took 31.5s. Estimated remaining: 2h 24m 25s. Rate: 9.4 symbols/min [2025-09-14T18:23:53.699321] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T18:23:53.705474] [INFO ] [REMOTE ] HF: Full fetch complete (294 records). [2025-09-14T18:23:53.721030] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-14T18:23:53.849437] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:53.968362] [DEBUG] [LOCAL ] HFRO: Loaded 8015 existing records from primary storage. [2025-09-14T18:23:53.964897] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-14T18:23:53.968557] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:23:53.968518] [INFO ] [MAIN ] HFRO: Loaded 8015 existing records. [2025-09-14T18:23:53.968727] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:23:54.010615] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-14T18:23:54.047551] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-14T18:23:54.068269] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-14T18:23:54.068596] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-14T18:23:54.089341] [INFO ] [MAIN ] Update Progress: 1008/2370 symbols completed. HF took 16.3s. Estimated remaining: 2h 24m 11s. Rate: 9.4 symbols/min [2025-09-14T18:23:54.144874] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:54.164595] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-14T18:23:54.187229] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-14T18:23:54.221534] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-14T18:23:54.255654] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-14T18:23:54.271261] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-14T18:23:54.384550] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:54.519824] [DEBUG] [LOCAL ] HGER: Loaded 6615 existing records from primary storage. [2025-09-14T18:23:54.570136] [INFO ] [MAIN ] HGER: Loaded 6615 existing records. [2025-09-14T18:23:54.753486] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T18:23:54.864237] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:54.886245] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:54.886698] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-14T18:23:54.886762] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-14T18:23:54.887169] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-14T18:23:54.887235] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-14T18:23:54.963923] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-14T18:23:55.247679] [INFO ] [REMOTE ] HGER: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:55.412121] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T18:23:55.758922] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-14T18:23:56.558808] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-14T18:23:56.851391] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T18:23:57.179699] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T18:23:57.358849] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-14T18:23:58.158859] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-14T18:23:58.178939] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:23:58.958855] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-14T18:23:59.277088] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T18:23:59.335380] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T18:23:59.758858] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-14T18:24:00.558841] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-14T18:24:00.636083] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T18:24:01.358864] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-14T18:24:02.158856] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-14T18:24:02.400301] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-14T18:24:02.406137] [INFO ] [REMOTE ] HESM: Full fetch complete (52468 records). [2025-09-14T18:24:02.406289] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-14T18:24:02.779750] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-14T18:24:02.779865] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-14T18:24:02.780618] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-14T18:24:02.780687] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-14T18:24:02.781738] [DEBUG] [LOCAL ] HESM: Trimmed 52468 records to 36270 (keeping 150 days of data) [2025-09-14T18:24:02.975991] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-14T18:24:03.042129] [DEBUG] [LOCAL ] HESM: Primary data saved (36270 records). [2025-09-14T18:24:03.042313] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-14T18:24:03.042451] [INFO ] [MAIN ] Update Progress: 1009/2370 symbols completed. HESM took 34.0s. Estimated remaining: 2h 24m 8s. Rate: 9.4 symbols/min [2025-09-14T18:24:03.209087] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:03.215527] [DEBUG] [LOCAL ] HGLB: Loaded 4108 existing records from primary storage. [2025-09-14T18:24:03.215670] [INFO ] [MAIN ] HGLB: Loaded 4108 existing records. [2025-09-14T18:24:03.389738] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:03.389994] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-14T18:24:03.390053] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-14T18:24:03.390368] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-14T18:24:03.390429] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-14T18:24:03.756726] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:03.768551] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-14T18:24:03.770017] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-14T18:24:04.426878] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T18:24:04.558856] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-14T18:24:04.729980] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-14T18:24:04.739847] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T18:24:05.036883] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-14T18:24:05.358850] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-14T18:24:06.158835] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-14T18:24:06.190765] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:24:06.958866] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-14T18:24:07.170191] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T18:24:07.380604] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:24:07.381468] [INFO ] [REMOTE ] HFND: Full fetch complete (1354 records). [2025-09-14T18:24:07.381557] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-14T18:24:07.556233] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T18:24:07.556469] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:24:07.556523] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:24:07.556569] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-14T18:24:07.556674] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-14T18:24:07.556729] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-14T18:24:07.556807] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-14T18:24:07.556896] [INFO ] [MAIN ] Update Progress: 1010/2370 symbols completed. HFND took 26.0s. Estimated remaining: 2h 23m 59s. Rate: 9.4 symbols/min [2025-09-14T18:24:07.723943] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:07.732912] [DEBUG] [LOCAL ] HGTY: Loaded 6852 existing records from primary storage. [2025-09-14T18:24:07.733043] [INFO ] [MAIN ] HGTY: Loaded 6852 existing records. [2025-09-14T18:24:07.763913] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-14T18:24:07.911067] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:07.911387] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-14T18:24:07.911465] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-14T18:24:07.911812] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-14T18:24:07.911889] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-14T18:24:08.260386] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:08.558833] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-14T18:24:08.763974] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:24:09.358883] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-14T18:24:09.389592] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:24:10.157479] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T18:24:10.159521] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-14T18:24:10.958824] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-14T18:24:11.122829] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T18:24:11.678741] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T18:24:11.758836] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-14T18:24:12.558836] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-14T18:24:12.592957] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T18:24:13.327109] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T18:24:13.358826] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-14T18:24:14.158846] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-14T18:24:14.187846] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T18:24:14.958899] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-14T18:24:15.702479] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:24:15.758819] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-14T18:24:16.558782] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-14T18:24:16.868693] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:24:16.976202] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T18:24:17.358818] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-14T18:24:17.516480] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T18:24:18.158837] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-14T18:24:18.235880] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T18:24:18.805745] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T18:24:18.958820] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-14T18:24:19.758832] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-14T18:24:19.807274] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T18:24:20.558831] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-14T18:24:20.721228] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:24:21.358825] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-14T18:24:21.485690] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:24:22.158818] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-14T18:24:22.199121] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T18:24:22.200952] [INFO ] [REMOTE ] HGLB: Full fetch complete (10828 records). [2025-09-14T18:24:22.201037] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-14T18:24:22.569137] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-14T18:24:22.569242] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-14T18:24:22.569782] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-14T18:24:22.569837] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-14T18:24:22.570344] [DEBUG] [LOCAL ] HGLB: Trimmed 10828 records to 6627 (keeping 150 days of data) [2025-09-14T18:24:22.611115] [DEBUG] [LOCAL ] HGLB: Primary data saved (6627 records). [2025-09-14T18:24:22.611303] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-14T18:24:22.611473] [INFO ] [MAIN ] Update Progress: 1011/2370 symbols completed. HGLB took 19.6s. Estimated remaining: 2h 24m 5s. Rate: 9.4 symbols/min [2025-09-14T18:24:22.781330] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:22.803098] [DEBUG] [LOCAL ] HGV: Loaded 21132 existing records from primary storage. [2025-09-14T18:24:22.803266] [INFO ] [MAIN ] HGV: Loaded 21132 existing records. [2025-09-14T18:24:22.973898] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-14T18:24:22.979857] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:22.980992] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-14T18:24:22.981077] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-14T18:24:22.981893] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-14T18:24:22.981979] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-14T18:24:23.144583] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:24:23.186996] [INFO ] [REMOTE ] HGER: Full fetch complete (12819 records). [2025-09-14T18:24:23.266581] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-14T18:24:23.488737] [INFO ] [REMOTE ] HGV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:23.740670] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-14T18:24:23.740781] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-14T18:24:23.741109] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-14T18:24:23.741160] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-14T18:24:23.741763] [DEBUG] [LOCAL ] HGER: Trimmed 12819 records to 10025 (keeping 150 days of data) [2025-09-14T18:24:23.771951] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-14T18:24:23.812837] [DEBUG] [LOCAL ] HGER: Primary data saved (10025 records). [2025-09-14T18:24:23.813139] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-14T18:24:23.813266] [INFO ] [MAIN ] Update Progress: 1012/2370 symbols completed. HGER took 29.7s. Estimated remaining: 2h 23m 51s. Rate: 9.4 symbols/min [2025-09-14T18:24:23.981149] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:24.002687] [DEBUG] [LOCAL ] HHH: Loaded 15296 existing records from primary storage. [2025-09-14T18:24:24.002945] [INFO ] [MAIN ] HHH: Loaded 15296 existing records. [2025-09-14T18:24:24.208352] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:24.208869] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-14T18:24:24.209003] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-14T18:24:24.214784] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-14T18:24:24.223039] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-14T18:24:24.223527] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:24:24.566026] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-14T18:24:24.607072] [INFO ] [REMOTE ] HHH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:24.786563] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T18:24:24.789284] [INFO ] [REMOTE ] HGTY: Full fetch complete (12935 records). [2025-09-14T18:24:24.789377] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-14T18:24:25.157113] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-14T18:24:25.157216] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-14T18:24:25.157560] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-14T18:24:25.157614] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-14T18:24:25.158133] [DEBUG] [LOCAL ] HGTY: Trimmed 12935 records to 9766 (keeping 150 days of data) [2025-09-14T18:24:25.220000] [DEBUG] [LOCAL ] HGTY: Primary data saved (9766 records). [2025-09-14T18:24:25.220153] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-14T18:24:25.220250] [INFO ] [MAIN ] Update Progress: 1013/2370 symbols completed. HGTY took 17.7s. Estimated remaining: 2h 23m 38s. Rate: 9.4 symbols/min [2025-09-14T18:24:25.365955] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-14T18:24:25.427840] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:25.442720] [DEBUG] [LOCAL ] HI: Loaded 12765 existing records from primary storage. [2025-09-14T18:24:25.442943] [INFO ] [MAIN ] HI: Loaded 12765 existing records. [2025-09-14T18:24:25.643340] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-07-01, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:25.643590] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-14T18:24:25.644030] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-14T18:24:25.644501] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-14T18:24:25.644563] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-14T18:24:25.998116] [INFO ] [REMOTE ] HI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:26.092028] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T18:24:26.158779] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-14T18:24:26.326493] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T18:24:26.329076] [INFO ] [REMOTE ] HFRO: Full fetch complete (19763 records). [2025-09-14T18:24:26.329165] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-14T18:24:26.695064] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-14T18:24:26.695174] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-14T18:24:26.695632] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-14T18:24:26.695706] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-14T18:24:26.696396] [DEBUG] [LOCAL ] HFRO: Trimmed 19763 records to 12029 (keeping 150 days of data) [2025-09-14T18:24:26.770167] [DEBUG] [LOCAL ] HFRO: Primary data saved (12029 records). [2025-09-14T18:24:26.770348] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-14T18:24:26.770457] [INFO ] [MAIN ] Update Progress: 1014/2370 symbols completed. HFRO took 33.2s. Estimated remaining: 2h 23m 25s. Rate: 9.5 symbols/min [2025-09-14T18:24:26.957045] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:26.958783] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-14T18:24:26.980997] [DEBUG] [LOCAL ] HIG: Loaded 22883 existing records from primary storage. [2025-09-14T18:24:26.981150] [INFO ] [MAIN ] HIG: Loaded 22883 existing records. [2025-09-14T18:24:27.169372] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:27.169607] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-14T18:24:27.169685] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-14T18:24:27.170375] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-14T18:24:27.170439] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-14T18:24:27.525755] [INFO ] [REMOTE ] HIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:27.763878] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-14T18:24:27.780473] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:24:28.297887] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T18:24:28.558826] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-14T18:24:29.358825] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-14T18:24:30.158807] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-14T18:24:30.189885] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-14T18:24:30.598925] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T18:24:30.958864] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-14T18:24:31.241601] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:24:31.272270] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T18:24:31.758842] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-14T18:24:31.925460] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T18:24:32.558829] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-14T18:24:33.358835] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-14T18:24:33.502469] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T18:24:33.698430] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:24:34.158834] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-14T18:24:34.945223] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:24:34.958785] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-14T18:24:35.704729] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:24:35.758777] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-14T18:24:36.558832] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-14T18:24:36.957272] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T18:24:37.358827] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-14T18:24:37.483782] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:24:37.869291] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T18:24:38.158829] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-14T18:24:38.478006] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:24:38.958829] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-14T18:24:39.758829] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-14T18:24:39.792524] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:24:40.558835] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-14T18:24:40.674722] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T18:24:41.218497] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:24:41.358841] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-14T18:24:42.158869] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-14T18:24:42.423195] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:24:42.856486] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:24:42.861547] [INFO ] [REMOTE ] HGV: Full fetch complete (50985 records). [2025-09-14T18:24:42.861811] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-14T18:24:42.964009] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-14T18:24:43.183340] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T18:24:43.294030] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-14T18:24:43.294161] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-14T18:24:43.295001] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-14T18:24:43.295067] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-14T18:24:43.296349] [DEBUG] [LOCAL ] HGV: Trimmed 50985 records to 35452 (keeping 150 days of data) [2025-09-14T18:24:43.520396] [DEBUG] [LOCAL ] HGV: Primary data saved (35452 records). [2025-09-14T18:24:43.520570] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-14T18:24:43.520716] [INFO ] [MAIN ] Update Progress: 1015/2370 symbols completed. HGV took 20.9s. Estimated remaining: 2h 23m 33s. Rate: 9.4 symbols/min [2025-09-14T18:24:43.688739] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:43.702944] [DEBUG] [LOCAL ] HII: Loaded 13986 existing records from primary storage. [2025-09-14T18:24:43.703098] [INFO ] [MAIN ] HII: Loaded 13986 existing records. [2025-09-14T18:24:43.765125] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-14T18:24:43.889367] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:43.889677] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-14T18:24:43.889739] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-14T18:24:43.890269] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-14T18:24:43.890332] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-14T18:24:44.296830] [INFO ] [REMOTE ] HII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:44.567204] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-14T18:24:44.598127] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:24:44.971482] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:24:45.358815] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-14T18:24:46.016065] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:24:46.158842] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-14T18:24:46.891206] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T18:24:46.958840] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-14T18:24:47.758890] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-14T18:24:47.992152] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:24:48.291593] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T18:24:48.295176] [INFO ] [REMOTE ] HHH: Full fetch complete (35842 records). [2025-09-14T18:24:48.295266] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-14T18:24:48.568490] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-14T18:24:48.665429] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-14T18:24:48.665548] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-14T18:24:48.666176] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-14T18:24:48.666232] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-14T18:24:48.667125] [DEBUG] [LOCAL ] HHH: Trimmed 35842 records to 25705 (keeping 150 days of data) [2025-09-14T18:24:48.822288] [DEBUG] [LOCAL ] HHH: Primary data saved (25705 records). [2025-09-14T18:24:48.822462] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-14T18:24:48.822561] [INFO ] [MAIN ] Update Progress: 1016/2370 symbols completed. HHH took 25.0s. Estimated remaining: 2h 23m 25s. Rate: 9.4 symbols/min [2025-09-14T18:24:48.991978] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:49.015740] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T18:24:49.039957] [DEBUG] [LOCAL ] HIMS: Loaded 24177 existing records from primary storage. [2025-09-14T18:24:49.040110] [INFO ] [MAIN ] HIMS: Loaded 24177 existing records. [2025-09-14T18:24:49.213624] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:49.213890] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-14T18:24:49.213950] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-14T18:24:49.214672] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-14T18:24:49.214735] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-14T18:24:49.364034] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-14T18:24:49.569070] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:50.158862] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-14T18:24:50.505301] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:24:50.523063] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T18:24:50.526433] [INFO ] [REMOTE ] HI: Full fetch complete (38174 records). [2025-09-14T18:24:50.526538] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-14T18:24:50.897127] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-14T18:24:50.897233] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-14T18:24:50.897885] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-14T18:24:50.897941] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-14T18:24:50.898806] [DEBUG] [LOCAL ] HI: Trimmed 38174 records to 26236 (keeping 150 days of data) [2025-09-14T18:24:50.964877] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-14T18:24:51.072178] [DEBUG] [LOCAL ] HI: Primary data saved (26236 records). [2025-09-14T18:24:51.072332] [INFO ] [MAIN ] HI: Full history saved. [2025-09-14T18:24:51.072434] [INFO ] [MAIN ] Update Progress: 1017/2370 symbols completed. HI took 25.9s. Estimated remaining: 2h 23m 13s. Rate: 9.4 symbols/min [2025-09-14T18:24:51.242181] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:51.253433] [DEBUG] [LOCAL ] HIO: Loaded 10218 existing records from primary storage. [2025-09-14T18:24:51.253592] [INFO ] [MAIN ] HIO: Loaded 10218 existing records. [2025-09-14T18:24:51.431348] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:51.431790] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-14T18:24:51.431863] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-14T18:24:51.432377] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-14T18:24:51.441806] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-14T18:24:51.541418] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-14T18:24:51.763986] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-14T18:24:51.833584] [INFO ] [REMOTE ] HIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:52.461181] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:24:52.558851] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-14T18:24:53.358843] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-14T18:24:53.895669] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T18:24:54.158833] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-14T18:24:54.397586] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-14T18:24:54.958862] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-14T18:24:55.096934] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T18:24:55.466699] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T18:24:55.758853] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-14T18:24:56.220751] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:24:56.558867] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-14T18:24:57.358839] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-14T18:24:58.028463] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-14T18:24:58.158849] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-14T18:24:58.347083] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T18:24:58.388376] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T18:24:58.958835] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-14T18:24:59.758883] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-14T18:25:00.488765] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:25:00.528583] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-14T18:25:00.558815] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-14T18:25:00.865674] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T18:25:01.358865] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-14T18:25:02.041141] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:25:02.047996] [INFO ] [REMOTE ] HIG: Full fetch complete (55525 records). [2025-09-14T18:25:02.048256] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-14T18:25:02.163948] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-14T18:25:02.436999] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-14T18:25:02.437124] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-14T18:25:02.437964] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-14T18:25:02.438027] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-14T18:25:02.439349] [DEBUG] [LOCAL ] HIG: Trimmed 55525 records to 38704 (keeping 150 days of data) [2025-09-14T18:25:02.709286] [DEBUG] [LOCAL ] HIG: Primary data saved (38704 records). [2025-09-14T18:25:02.709602] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-14T18:25:02.709722] [INFO ] [MAIN ] Update Progress: 1018/2370 symbols completed. HIG took 35.9s. Estimated remaining: 2h 23m 14s. Rate: 9.4 symbols/min [2025-09-14T18:25:02.879990] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:02.891296] [DEBUG] [LOCAL ] HIPO: Loaded 9567 existing records from primary storage. [2025-09-14T18:25:02.891451] [INFO ] [MAIN ] HIPO: Loaded 9567 existing records. [2025-09-14T18:25:02.966364] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-14T18:25:03.073277] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:03.073567] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-14T18:25:03.073627] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-14T18:25:03.074050] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-14T18:25:03.074110] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-14T18:25:03.435288] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:03.449071] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:25:03.488479] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-14T18:25:03.758830] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-14T18:25:04.542844] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T18:25:04.558798] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-14T18:25:05.200552] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:25:05.204010] [INFO ] [REMOTE ] HII: Full fetch complete (39889 records). [2025-09-14T18:25:05.204164] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-14T18:25:05.368821] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-14T18:25:05.586943] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-14T18:25:05.587052] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-14T18:25:05.587727] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-14T18:25:05.587785] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-14T18:25:05.588611] [DEBUG] [LOCAL ] HII: Trimmed 39889 records to 24776 (keeping 150 days of data) [2025-09-14T18:25:05.750631] [DEBUG] [LOCAL ] HII: Primary data saved (24776 records). [2025-09-14T18:25:05.750808] [INFO ] [MAIN ] HII: Full history saved. [2025-09-14T18:25:05.750919] [INFO ] [MAIN ] Update Progress: 1019/2370 symbols completed. HII took 22.2s. Estimated remaining: 2h 23m 3s. Rate: 9.4 symbols/min [2025-09-14T18:25:05.922615] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:05.943725] [DEBUG] [LOCAL ] HIW: Loaded 19950 existing records from primary storage. [2025-09-14T18:25:05.943957] [INFO ] [MAIN ] HIW: Loaded 19950 existing records. [2025-09-14T18:25:06.130478] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:06.131386] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-14T18:25:06.131450] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-14T18:25:06.132327] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-14T18:25:06.132391] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-14T18:25:06.163947] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-14T18:25:06.494637] [INFO ] [REMOTE ] HIW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:06.532452] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-09-14T18:25:06.576213] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:25:06.958889] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-14T18:25:07.077817] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T18:25:07.758868] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-14T18:25:08.168593] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T18:25:08.558803] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-14T18:25:08.939840] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:25:09.358816] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-14T18:25:10.135782] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:25:10.158790] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-14T18:25:10.958861] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-14T18:25:11.758819] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-14T18:25:11.809354] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:25:12.143206] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:25:12.270204] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-14T18:25:12.558851] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-14T18:25:12.974795] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T18:25:12.981722] [INFO ] [REMOTE ] HIO: Full fetch complete (27112 records). [2025-09-14T18:25:12.981872] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-14T18:25:13.364789] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-14T18:25:13.366537] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-14T18:25:13.367503] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-14T18:25:13.368174] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-14T18:25:13.368240] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-14T18:25:13.369070] [DEBUG] [LOCAL ] HIO: Trimmed 27112 records to 16072 (keeping 150 days of data) [2025-09-14T18:25:13.464028] [DEBUG] [LOCAL ] HIO: Primary data saved (16072 records). [2025-09-14T18:25:13.464201] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-14T18:25:13.464299] [INFO ] [MAIN ] Update Progress: 1020/2370 symbols completed. HIO took 22.4s. Estimated remaining: 2h 22m 59s. Rate: 9.4 symbols/min [2025-09-14T18:25:13.636976] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:13.647781] [DEBUG] [LOCAL ] HIX: Loaded 8971 existing records from primary storage. [2025-09-14T18:25:13.647969] [INFO ] [MAIN ] HIX: Loaded 8971 existing records. [2025-09-14T18:25:13.837142] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:13.837436] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-14T18:25:13.837498] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-14T18:25:13.837896] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-14T18:25:13.837956] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-14T18:25:14.164017] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-14T18:25:14.201028] [INFO ] [REMOTE ] HIX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:14.515560] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:25:14.965953] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-14T18:25:14.988764] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-14T18:25:15.758852] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-14T18:25:15.912714] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:25:16.038501] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:25:16.463721] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:25:16.469546] [INFO ] [REMOTE ] HIMS: Full fetch complete (58497 records). [2025-09-14T18:25:16.469776] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-14T18:25:16.567148] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-14T18:25:16.853290] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-14T18:25:16.853403] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-14T18:25:16.854222] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-14T18:25:16.854280] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-14T18:25:16.855509] [DEBUG] [LOCAL ] HIMS: Trimmed 58497 records to 40557 (keeping 150 days of data) [2025-09-14T18:25:17.123961] [DEBUG] [LOCAL ] HIMS: Primary data saved (40557 records). [2025-09-14T18:25:17.124148] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-14T18:25:17.124275] [INFO ] [MAIN ] Update Progress: 1021/2370 symbols completed. HIMS took 28.3s. Estimated remaining: 2h 22m 49s. Rate: 9.4 symbols/min [2025-09-14T18:25:17.330732] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:17.341025] [DEBUG] [LOCAL ] HKD: Loaded 8004 existing records from primary storage. [2025-09-14T18:25:17.341192] [INFO ] [MAIN ] HKD: Loaded 8004 existing records. [2025-09-14T18:25:17.363909] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-14T18:25:17.528918] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:17.529166] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-14T18:25:17.529227] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-14T18:25:17.529536] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-14T18:25:17.529598] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-14T18:25:17.892523] [INFO ] [REMOTE ] HKD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:18.158841] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-14T18:25:18.251547] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T18:25:18.702330] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:25:18.958848] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-14T18:25:19.461835] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T18:25:19.758840] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-14T18:25:20.039504] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T18:25:20.558792] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-14T18:25:20.576540] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:25:21.358793] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-14T18:25:21.680787] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:25:22.158874] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-14T18:25:22.637154] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T18:25:22.958828] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-14T18:25:23.279865] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T18:25:23.758872] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-14T18:25:24.460299] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:25:24.558822] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-14T18:25:24.839198] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:25:25.358822] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-14T18:25:26.023808] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T18:25:26.158793] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-14T18:25:26.429125] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:25:26.958835] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-14T18:25:27.758802] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-14T18:25:27.821355] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:25:28.133819] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T18:25:28.558809] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-14T18:25:28.707451] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T18:25:28.710344] [INFO ] [REMOTE ] HIPO: Full fetch complete (24406 records). [2025-09-14T18:25:28.710449] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-14T18:25:29.097902] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-14T18:25:29.098060] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-14T18:25:29.098758] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-14T18:25:29.098834] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-14T18:25:29.099875] [DEBUG] [LOCAL ] HIPO: Trimmed 24406 records to 16864 (keeping 150 days of data) [2025-09-14T18:25:29.210365] [DEBUG] [LOCAL ] HIPO: Primary data saved (16864 records). [2025-09-14T18:25:29.210580] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-14T18:25:29.210740] [INFO ] [MAIN ] Update Progress: 1022/2370 symbols completed. HIPO took 26.5s. Estimated remaining: 2h 22m 50s. Rate: 9.4 symbols/min [2025-09-14T18:25:29.365280] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-14T18:25:29.390861] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:29.416133] [DEBUG] [LOCAL ] HL: Loaded 24047 existing records from primary storage. [2025-09-14T18:25:29.416311] [INFO ] [MAIN ] HL: Loaded 24047 existing records. [2025-09-14T18:25:29.604905] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:29.605979] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T18:25:29.606150] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-14T18:25:29.610116] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-14T18:25:29.611089] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-14T18:25:29.611154] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-14T18:25:29.986312] [INFO ] [REMOTE ] HL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:30.042145] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:25:30.047373] [INFO ] [REMOTE ] HIW: Full fetch complete (48924 records). [2025-09-14T18:25:30.047530] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-14T18:25:30.163868] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-14T18:25:30.421141] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-14T18:25:30.421279] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-14T18:25:30.422118] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-14T18:25:30.422188] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-14T18:25:30.423507] [DEBUG] [LOCAL ] HIW: Trimmed 48924 records to 33336 (keeping 150 days of data) [2025-09-14T18:25:30.645936] [DEBUG] [LOCAL ] HIW: Primary data saved (33336 records). [2025-09-14T18:25:30.646120] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-14T18:25:30.646237] [INFO ] [MAIN ] Update Progress: 1023/2370 symbols completed. HIW took 24.9s. Estimated remaining: 2h 22m 37s. Rate: 9.4 symbols/min [2025-09-14T18:25:30.816566] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:30.837597] [DEBUG] [LOCAL ] HLF: Loaded 21911 existing records from primary storage. [2025-09-14T18:25:30.837801] [INFO ] [MAIN ] HLF: Loaded 21911 existing records. [2025-09-14T18:25:30.964022] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-14T18:25:31.015470] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:31.015801] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-14T18:25:31.015864] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-14T18:25:31.016394] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-14T18:25:31.016454] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-14T18:25:31.371209] [INFO ] [REMOTE ] HLF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:31.501720] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:25:31.758852] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-14T18:25:32.558850] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-14T18:25:32.847772] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T18:25:33.207165] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:25:33.358798] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-14T18:25:33.735139] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T18:25:34.158844] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-14T18:25:34.952484] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:25:34.962565] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-14T18:25:35.758810] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-14T18:25:36.105681] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:25:36.143454] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T18:25:36.558841] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-14T18:25:36.668539] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T18:25:37.358872] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-14T18:25:38.158833] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-14T18:25:38.235823] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:25:38.240379] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:25:38.241170] [INFO ] [REMOTE ] HKD: Full fetch complete (20173 records). [2025-09-14T18:25:38.251987] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-14T18:25:38.620419] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-14T18:25:38.620524] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-14T18:25:38.620981] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-14T18:25:38.621036] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-14T18:25:38.621706] [DEBUG] [LOCAL ] HKD: Trimmed 20173 records to 13529 (keeping 150 days of data) [2025-09-14T18:25:38.699498] [DEBUG] [LOCAL ] HKD: Primary data saved (13529 records). [2025-09-14T18:25:38.699689] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-14T18:25:38.699856] [INFO ] [MAIN ] Update Progress: 1024/2370 symbols completed. HKD took 21.6s. Estimated remaining: 2h 22m 33s. Rate: 9.4 symbols/min [2025-09-14T18:25:38.870143] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:38.889213] [DEBUG] [LOCAL ] HLI: Loaded 13869 existing records from primary storage. [2025-09-14T18:25:38.889397] [INFO ] [MAIN ] HLI: Loaded 13869 existing records. [2025-09-14T18:25:38.965678] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-14T18:25:39.069373] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:39.069624] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-14T18:25:39.069713] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-14T18:25:39.070251] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-14T18:25:39.070311] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-14T18:25:39.418952] [INFO ] [REMOTE ] HLI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:39.758798] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-14T18:25:40.250829] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T18:25:40.558886] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-14T18:25:41.089683] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:25:41.190312] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-14T18:25:41.358841] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-14T18:25:42.158833] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-14T18:25:42.255954] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:25:42.258236] [INFO ] [REMOTE ] HIX: Full fetch complete (21797 records). [2025-09-14T18:25:42.258357] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-14T18:25:42.618770] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-14T18:25:42.618905] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-14T18:25:42.619543] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-14T18:25:42.619676] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-14T18:25:42.620543] [DEBUG] [LOCAL ] HIX: Trimmed 21797 records to 15096 (keeping 150 days of data) [2025-09-14T18:25:42.709790] [DEBUG] [LOCAL ] HIX: Primary data saved (15096 records). [2025-09-14T18:25:42.710287] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-14T18:25:42.710449] [INFO ] [MAIN ] Update Progress: 1025/2370 symbols completed. HIX took 29.2s. Estimated remaining: 2h 22m 24s. Rate: 9.4 symbols/min [2025-09-14T18:25:42.943201] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:42.950271] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-14T18:25:42.962576] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-14T18:25:42.982564] [DEBUG] [LOCAL ] HLIO: Loaded 13223 existing records from primary storage. [2025-09-14T18:25:42.982759] [INFO ] [MAIN ] HLIO: Loaded 13223 existing records. [2025-09-14T18:25:43.159490] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:43.159783] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-14T18:25:43.159847] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-14T18:25:43.160253] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-14T18:25:43.160312] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-14T18:25:43.551159] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:43.594416] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:25:43.758820] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-14T18:25:44.558818] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-14T18:25:44.922869] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T18:25:45.249754] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T18:25:45.358826] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-14T18:25:46.158884] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-14T18:25:46.354037] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:25:46.449865] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T18:25:46.958849] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-14T18:25:47.463333] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:25:47.758793] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-14T18:25:48.139287] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:25:48.558890] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-14T18:25:49.307622] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:25:49.358786] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-14T18:25:50.158873] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-14T18:25:50.744209] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-14T18:25:50.958871] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-14T18:25:51.028417] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:25:51.435831] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T18:25:51.758930] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-14T18:25:51.957682] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:25:52.558840] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-14T18:25:53.103573] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:25:53.358832] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-14T18:25:54.158898] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-14T18:25:54.382090] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:25:54.958847] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-14T18:25:55.403558] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T18:25:55.522992] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T18:25:55.758916] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-14T18:25:56.349186] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T18:25:56.558869] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-14T18:25:57.056026] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T18:25:57.061450] [INFO ] [REMOTE ] HLF: Full fetch complete (53517 records). [2025-09-14T18:25:57.061691] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-14T18:25:57.306023] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:25:57.364180] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-14T18:25:57.379724] [INFO ] [REMOTE ] HLI: Full fetch complete (34116 records). [2025-09-14T18:25:57.381147] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-14T18:25:57.590725] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-14T18:25:57.591276] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-14T18:25:57.603443] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-14T18:25:57.608728] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-14T18:25:57.681706] [DEBUG] [LOCAL ] HLF: Trimmed 53517 records to 36855 (keeping 150 days of data) [2025-09-14T18:25:57.985940] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-14T18:25:57.986755] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-14T18:25:57.989275] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-14T18:25:57.990335] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-14T18:25:57.994542] [DEBUG] [LOCAL ] HLI: Trimmed 34116 records to 22943 (keeping 150 days of data) [2025-09-14T18:25:58.159710] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-14T18:25:58.233414] [DEBUG] [LOCAL ] HLI: Primary data saved (22943 records). [2025-09-14T18:25:58.233909] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-14T18:25:58.234027] [INFO ] [MAIN ] Update Progress: 1026/2370 symbols completed. HLI took 19.5s. Estimated remaining: 2h 22m 29s. Rate: 9.4 symbols/min [2025-09-14T18:25:58.425791] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:58.447221] [DEBUG] [LOCAL ] HLLY: Loaded 15167 existing records from primary storage. [2025-09-14T18:25:58.447717] [INFO ] [MAIN ] HLLY: Loaded 15167 existing records. [2025-09-14T18:25:58.580493] [DEBUG] [LOCAL ] HLF: Primary data saved (36855 records). [2025-09-14T18:25:58.609320] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-14T18:25:58.611684] [INFO ] [MAIN ] Update Progress: 1027/2370 symbols completed. HLF took 28.0s. Estimated remaining: 2h 22m 15s. Rate: 9.4 symbols/min [2025-09-14T18:25:58.682253] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:58.719629] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-14T18:25:58.741112] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-14T18:25:58.747082] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-14T18:25:58.796544] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-14T18:25:58.814991] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:59.117086] [DEBUG] [LOCAL ] HLN: Loaded 23751 existing records from primary storage. [2025-09-14T18:25:59.129254] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:25:59.129378] [INFO ] [MAIN ] HLN: Loaded 23751 existing records. [2025-09-14T18:25:59.286930] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-14T18:25:59.290372] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:59.403819] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:59.404091] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-14T18:25:59.404167] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-14T18:25:59.404870] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-14T18:25:59.404946] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-14T18:25:59.762948] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-14T18:25:59.766816] [INFO ] [REMOTE ] HLN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:59.989846] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-14T18:25:59.995664] [INFO ] [REMOTE ] HL: Full fetch complete (58347 records). [2025-09-14T18:25:59.995835] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-14T18:26:00.403696] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-14T18:26:00.403840] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-14T18:26:00.404884] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-14T18:26:00.404949] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-14T18:26:00.406437] [DEBUG] [LOCAL ] HL: Trimmed 58347 records to 40416 (keeping 150 days of data) [2025-09-14T18:26:00.591795] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-14T18:26:00.674727] [DEBUG] [LOCAL ] HL: Primary data saved (40416 records). [2025-09-14T18:26:00.674887] [INFO ] [MAIN ] HL: Full history saved. [2025-09-14T18:26:00.675005] [INFO ] [MAIN ] Update Progress: 1028/2370 symbols completed. HL took 31.5s. Estimated remaining: 2h 22m 3s. Rate: 9.4 symbols/min [2025-09-14T18:26:00.897868] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:00.920485] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:26:00.948523] [DEBUG] [LOCAL ] HLT: Loaded 22305 existing records from primary storage. [2025-09-14T18:26:00.948795] [INFO ] [MAIN ] HLT: Loaded 22305 existing records. [2025-09-14T18:26:01.093843] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:26:01.162116] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:01.162468] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-14T18:26:01.162539] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-14T18:26:01.163252] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-14T18:26:01.163321] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-14T18:26:01.368545] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-14T18:26:01.568220] [INFO ] [REMOTE ] HLT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:02.158903] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-14T18:26:02.533534] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-14T18:26:02.742744] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:26:02.958874] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-14T18:26:03.013403] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T18:26:03.758914] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-14T18:26:04.362621] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T18:26:04.558899] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-14T18:26:04.840571] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T18:26:05.358821] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-14T18:26:06.058718] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:26:06.118097] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T18:26:06.158797] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-14T18:26:06.958877] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-14T18:26:07.230239] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:26:07.758858] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-14T18:26:07.849898] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T18:26:08.558856] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-14T18:26:09.358848] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-14T18:26:09.440110] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T18:26:09.755418] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T18:26:10.158790] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-14T18:26:10.552568] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:26:10.958901] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-14T18:26:11.758840] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-14T18:26:11.986722] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:26:12.357832] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T18:26:12.437698] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:26:12.558870] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-14T18:26:13.358766] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-14T18:26:14.092681] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T18:26:14.158827] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-14T18:26:14.958805] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-14T18:26:14.992759] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T18:26:15.212177] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:26:15.215317] [INFO ] [REMOTE ] HLIO: Full fetch complete (29650 records). [2025-09-14T18:26:15.215425] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-14T18:26:15.593096] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-14T18:26:15.593244] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-14T18:26:15.593905] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-14T18:26:15.593966] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-14T18:26:15.595444] [DEBUG] [LOCAL ] HLIO: Trimmed 29650 records to 22033 (keeping 150 days of data) [2025-09-14T18:26:15.736287] [DEBUG] [LOCAL ] HLIO: Primary data saved (22033 records). [2025-09-14T18:26:15.736468] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-14T18:26:15.736598] [INFO ] [MAIN ] Update Progress: 1029/2370 symbols completed. HLIO took 33.0s. Estimated remaining: 2h 22m 8s. Rate: 9.4 symbols/min [2025-09-14T18:26:15.765665] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-14T18:26:15.912863] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:15.944436] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:26:15.970595] [DEBUG] [LOCAL ] HLX: Loaded 21455 existing records from primary storage. [2025-09-14T18:26:15.970800] [INFO ] [MAIN ] HLX: Loaded 21455 existing records. [2025-09-14T18:26:16.166927] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:16.167192] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-14T18:26:16.167256] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-14T18:26:16.167893] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-14T18:26:16.167966] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-14T18:26:16.517835] [INFO ] [REMOTE ] HLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:16.558848] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-14T18:26:17.222633] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:26:17.227685] [INFO ] [REMOTE ] HLT: Full fetch complete (55252 records). [2025-09-14T18:26:17.227818] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-14T18:26:17.367722] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-14T18:26:17.608075] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-14T18:26:17.608200] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-14T18:26:17.609149] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-14T18:26:17.609255] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-14T18:26:17.611192] [DEBUG] [LOCAL ] HLT: Trimmed 55252 records to 37911 (keeping 150 days of data) [2025-09-14T18:26:17.752862] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T18:26:17.920333] [DEBUG] [LOCAL ] HLT: Primary data saved (37911 records). [2025-09-14T18:26:17.920534] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-14T18:26:17.920700] [INFO ] [MAIN ] Update Progress: 1030/2370 symbols completed. HLT took 17.2s. Estimated remaining: 2h 21m 56s. Rate: 9.4 symbols/min [2025-09-14T18:26:18.102416] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:18.125329] [DEBUG] [LOCAL ] HMC: Loaded 20902 existing records from primary storage. [2025-09-14T18:26:18.125563] [INFO ] [MAIN ] HMC: Loaded 20902 existing records. [2025-09-14T18:26:18.164054] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-14T18:26:18.316822] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:18.317074] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-14T18:26:18.317136] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-14T18:26:18.318236] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-14T18:26:18.318327] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-14T18:26:18.675173] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T18:26:18.719961] [INFO ] [REMOTE ] HMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:18.720247] [INFO ] [REMOTE ] HLLY: Full fetch complete (34726 records). [2025-09-14T18:26:18.720898] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-14T18:26:18.965298] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-14T18:26:19.087470] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-14T18:26:19.087581] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-14T18:26:19.088289] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-14T18:26:19.088345] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-14T18:26:19.089290] [DEBUG] [LOCAL ] HLLY: Trimmed 34726 records to 24903 (keeping 150 days of data) [2025-09-14T18:26:19.237600] [DEBUG] [LOCAL ] HLLY: Primary data saved (24903 records). [2025-09-14T18:26:19.237783] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-14T18:26:19.237933] [INFO ] [MAIN ] Update Progress: 1031/2370 symbols completed. HLLY took 21.0s. Estimated remaining: 2h 21m 44s. Rate: 9.4 symbols/min [2025-09-14T18:26:19.405273] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:19.416664] [DEBUG] [LOCAL ] HMN: Loaded 10117 existing records from primary storage. [2025-09-14T18:26:19.416807] [INFO ] [MAIN ] HMN: Loaded 10117 existing records. [2025-09-14T18:26:19.596076] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:19.596382] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-14T18:26:19.596443] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-14T18:26:19.596843] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-14T18:26:19.596903] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-14T18:26:19.766865] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-14T18:26:19.951470] [INFO ] [REMOTE ] HMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:20.012394] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:26:20.014475] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T18:26:20.558873] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-14T18:26:21.358864] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-14T18:26:21.437045] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:26:22.158832] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-14T18:26:22.335954] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T18:26:22.492592] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T18:26:22.958836] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-14T18:26:23.711431] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:26:23.758787] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-14T18:26:23.860563] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T18:26:24.558829] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-14T18:26:25.358867] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-14T18:26:25.442275] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:26:25.467960] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T18:26:25.869847] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T18:26:26.158885] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-14T18:26:26.958831] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-14T18:26:27.601946] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T18:26:27.609257] [INFO ] [REMOTE ] HLN: Full fetch complete (57691 records). [2025-09-14T18:26:27.609571] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-14T18:26:27.775338] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-14T18:26:28.017287] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-14T18:26:28.017408] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-14T18:26:28.018331] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-14T18:26:28.018392] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-14T18:26:28.019694] [DEBUG] [LOCAL ] HLN: Trimmed 57691 records to 39960 (keeping 150 days of data) [2025-09-14T18:26:28.292025] [DEBUG] [LOCAL ] HLN: Primary data saved (39960 records). [2025-09-14T18:26:28.292224] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-14T18:26:28.292368] [INFO ] [MAIN ] Update Progress: 1032/2370 symbols completed. HLN took 29.7s. Estimated remaining: 2h 21m 41s. Rate: 9.4 symbols/min [2025-09-14T18:26:28.469721] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:28.500559] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:26:28.529875] [DEBUG] [LOCAL ] HMY: Loaded 23638 existing records from primary storage. [2025-09-14T18:26:28.530050] [INFO ] [MAIN ] HMY: Loaded 23638 existing records. [2025-09-14T18:26:28.564015] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-14T18:26:28.719016] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:28.719470] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-14T18:26:28.719682] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-14T18:26:28.726175] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-14T18:26:28.735153] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-14T18:26:28.736360] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T18:26:29.100698] [INFO ] [REMOTE ] HMY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:29.358834] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-14T18:26:29.473145] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:26:30.158832] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-14T18:26:30.958806] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-14T18:26:31.312001] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T18:26:31.398736] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T18:26:31.470441] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T18:26:31.758848] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-14T18:26:32.558828] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-14T18:26:33.358840] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-14T18:26:33.941844] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-14T18:26:34.158794] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-14T18:26:34.227766] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:26:34.629540] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T18:26:34.958837] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-14T18:26:35.758795] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-14T18:26:35.868813] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:26:36.114556] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T18:26:36.558882] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-14T18:26:37.269190] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T18:26:37.358827] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-14T18:26:37.566684] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T18:26:38.163873] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-14T18:26:38.182433] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T18:26:38.958822] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-14T18:26:39.173248] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:26:39.657545] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:26:39.662356] [INFO ] [REMOTE ] HMC: Full fetch complete (51330 records). [2025-09-14T18:26:39.662496] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-14T18:26:39.764243] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-14T18:26:40.041172] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-14T18:26:40.041298] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-14T18:26:40.042215] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-14T18:26:40.042295] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-14T18:26:40.043550] [DEBUG] [LOCAL ] HMC: Trimmed 51330 records to 34740 (keeping 150 days of data) [2025-09-14T18:26:40.247587] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T18:26:40.256326] [INFO ] [REMOTE ] HLX: Full fetch complete (52312 records). [2025-09-14T18:26:40.257888] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-14T18:26:40.532966] [DEBUG] [LOCAL ] HMC: Primary data saved (34740 records). [2025-09-14T18:26:40.560574] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-14T18:26:40.567793] [INFO ] [MAIN ] Update Progress: 1033/2370 symbols completed. HMC took 22.6s. Estimated remaining: 2h 21m 42s. Rate: 9.4 symbols/min [2025-09-14T18:26:40.567894] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-14T18:26:40.773064] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-14T18:26:40.808045] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-14T18:26:40.838708] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:40.837336] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-14T18:26:40.838869] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-14T18:26:40.840405] [DEBUG] [LOCAL ] HLX: Trimmed 52312 records to 35929 (keeping 150 days of data) [2025-09-14T18:26:40.939259] [DEBUG] [LOCAL ] HNGE: Loaded 18879 existing records from primary storage. [2025-09-14T18:26:40.940228] [INFO ] [MAIN ] HNGE: Loaded 18879 existing records. [2025-09-14T18:26:41.124963] [WARN ] [MAIN ] HNGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:41.126865] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-14T18:26:41.127444] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-14T18:26:41.128350] [DEBUG] [LOCAL ] HNGE: Deleted primary data file. [2025-09-14T18:26:41.129019] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-14T18:26:41.382173] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-14T18:26:41.581370] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:41.605360] [DEBUG] [LOCAL ] HLX: Primary data saved (35929 records). [2025-09-14T18:26:41.605498] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-14T18:26:41.605627] [INFO ] [MAIN ] Update Progress: 1034/2370 symbols completed. HLX took 25.9s. Estimated remaining: 2h 21m 29s. Rate: 9.4 symbols/min [2025-09-14T18:26:41.777508] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:41.792896] [DEBUG] [LOCAL ] HNI: Loaded 14334 existing records from primary storage. [2025-09-14T18:26:41.793048] [INFO ] [MAIN ] HNI: Loaded 14334 existing records. [2025-09-14T18:26:41.997156] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:41.997495] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-14T18:26:41.997562] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-14T18:26:41.998335] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-14T18:26:41.998601] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-14T18:26:42.159900] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-14T18:26:42.357534] [INFO ] [REMOTE ] HNI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:42.483838] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:26:42.484667] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-14T18:26:42.546193] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:26:42.623813] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:26:42.958826] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-14T18:26:43.212291] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:26:43.212868] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-14T18:26:43.758849] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-14T18:26:44.558866] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-14T18:26:45.012875] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T18:26:45.015346] [INFO ] [REMOTE ] HMN: Full fetch complete (24917 records). [2025-09-14T18:26:45.015439] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-14T18:26:45.358795] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-14T18:26:45.429696] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-14T18:26:45.432278] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-14T18:26:45.432215] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:26:45.438833] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-14T18:26:45.439681] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-14T18:26:45.441375] [DEBUG] [LOCAL ] HMN: Trimmed 24917 records to 18068 (keeping 150 days of data) [2025-09-14T18:26:45.573300] [DEBUG] [LOCAL ] HMN: Primary data saved (18068 records). [2025-09-14T18:26:45.573576] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-14T18:26:45.573731] [INFO ] [MAIN ] Update Progress: 1035/2370 symbols completed. HMN took 26.3s. Estimated remaining: 2h 21m 19s. Rate: 9.4 symbols/min [2025-09-14T18:26:45.755175] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:45.781813] [DEBUG] [LOCAL ] HOG: Loaded 22685 existing records from primary storage. [2025-09-14T18:26:45.782076] [INFO ] [MAIN ] HOG: Loaded 22685 existing records. [2025-09-14T18:26:45.983067] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:45.983390] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-14T18:26:45.983458] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-14T18:26:45.984256] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-14T18:26:45.984323] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-14T18:26:46.164002] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-14T18:26:46.359226] [INFO ] [REMOTE ] HOG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:46.958842] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-14T18:26:47.546938] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-14T18:26:47.578783] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T18:26:47.758853] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-14T18:26:48.385112] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:26:48.558919] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-14T18:26:48.811678] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:26:48.812836] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-14T18:26:49.358916] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-14T18:26:49.876061] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-14T18:26:49.944715] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T18:26:50.158857] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-14T18:26:50.958875] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-14T18:26:51.758962] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-14T18:26:52.048932] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:26:52.558898] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-14T18:26:52.586197] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T18:26:52.652446] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:26:53.358849] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-14T18:26:54.158843] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-14T18:26:54.310084] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:26:54.958922] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-14T18:26:55.013451] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:26:55.758946] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-14T18:26:56.215899] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T18:26:56.558889] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-14T18:26:56.725799] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T18:26:57.358829] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-14T18:26:57.468594] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T18:26:58.158871] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-14T18:26:58.427157] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-14T18:26:58.433414] [INFO ] [REMOTE ] HMY: Full fetch complete (57767 records). [2025-09-14T18:26:58.433603] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-14T18:26:58.829845] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-14T18:26:58.829953] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-14T18:26:58.830762] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-14T18:26:58.830822] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-14T18:26:58.832009] [DEBUG] [LOCAL ] HMY: Trimmed 57767 records to 39927 (keeping 150 days of data) [2025-09-14T18:26:59.007575] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-14T18:26:59.104123] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T18:26:59.145388] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T18:26:59.159658] [DEBUG] [LOCAL ] HMY: Primary data saved (39927 records). [2025-09-14T18:26:59.159937] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-14T18:26:59.160078] [INFO ] [MAIN ] Update Progress: 1036/2370 symbols completed. HMY took 30.9s. Estimated remaining: 2h 21m 22s. Rate: 9.4 symbols/min [2025-09-14T18:26:59.340595] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:59.362768] [DEBUG] [LOCAL ] HOMB: Loaded 19860 existing records from primary storage. [2025-09-14T18:26:59.363111] [INFO ] [MAIN ] HOMB: Loaded 19860 existing records. [2025-09-14T18:26:59.551535] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:59.551917] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-14T18:26:59.551985] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-14T18:26:59.552588] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-14T18:26:59.552708] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-14T18:26:59.766557] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-14T18:26:59.924008] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:00.560775] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-14T18:27:00.567211] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-14T18:27:00.575077] [INFO ] [REMOTE ] HNGE: Full fetch complete (23598 records). [2025-09-14T18:27:00.575296] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-14T18:27:00.811542] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 78 unique days, need 150 days [2025-09-14T18:27:00.812063] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:27:00.812123] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:27:00.812179] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-14T18:27:00.812271] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-14T18:27:00.812324] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-14T18:27:00.812406] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-14T18:27:00.812520] [INFO ] [MAIN ] Update Progress: 1037/2370 symbols completed. HNGE took 20.2s. Estimated remaining: 2h 21m 10s. Rate: 9.4 symbols/min [2025-09-14T18:27:01.358908] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-14T18:27:02.024811] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:27:02.158885] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-14T18:27:02.234430] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-14T18:27:02.958909] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-14T18:27:04.422836] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T18:27:04.429011] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-14T18:27:04.536936] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (3.18 seconds). [2025-09-14T18:27:04.558808] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-14T18:27:05.682373] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:27:05.691722] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-14T18:27:05.768534] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-14T18:27:05.981033] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T18:27:05.985428] [INFO ] [REMOTE ] HNI: Full fetch complete (31167 records). [2025-09-14T18:27:05.985589] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-14T18:27:06.162865] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-14T18:27:06.372353] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-14T18:27:06.372614] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-14T18:27:06.373830] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-14T18:27:06.373968] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-14T18:27:06.375122] [DEBUG] [LOCAL ] HNI: Trimmed 31167 records to 21400 (keeping 150 days of data) [2025-09-14T18:27:06.495605] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T18:27:06.562476] [DEBUG] [LOCAL ] HNI: Primary data saved (21400 records). [2025-09-14T18:27:06.562674] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-14T18:27:06.562795] [INFO ] [MAIN ] Update Progress: 1038/2370 symbols completed. HNI took 25.0s. Estimated remaining: 2h 21m 3s. Rate: 9.4 symbols/min [2025-09-14T18:27:06.918413] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:27:06.923816] [INFO ] [REMOTE ] HOG: Full fetch complete (55966 records). [2025-09-14T18:27:06.923933] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-14T18:27:06.966678] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-14T18:27:07.301386] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-14T18:27:07.301502] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-14T18:27:07.302361] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-14T18:27:07.302420] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-14T18:27:07.303707] [DEBUG] [LOCAL ] HOG: Trimmed 55966 records to 38253 (keeping 150 days of data) [2025-09-14T18:27:07.563654] [DEBUG] [LOCAL ] HOG: Primary data saved (38253 records). [2025-09-14T18:27:07.563857] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-14T18:27:07.563994] [INFO ] [MAIN ] Update Progress: 1039/2370 symbols completed. HOG took 22.0s. Estimated remaining: 2h 20m 50s. Rate: 9.5 symbols/min [2025-09-14T18:27:08.621333] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T18:27:08.632174] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-14T18:27:10.234922] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T18:27:10.243902] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-14T18:27:11.785396] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T18:27:11.797291] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-14T18:27:13.487843] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:27:13.498437] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-14T18:27:15.064969] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:27:15.074282] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-14T18:27:16.046014] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T18:27:16.051067] [INFO ] [REMOTE ] HOMB: Full fetch complete (47551 records). [2025-09-14T18:27:16.051198] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-14T18:27:16.429438] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-14T18:27:16.429552] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-14T18:27:16.430389] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-14T18:27:16.430470] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-14T18:27:16.431520] [DEBUG] [LOCAL ] HOMB: Trimmed 47551 records to 32060 (keeping 150 days of data) [2025-09-14T18:27:16.633711] [DEBUG] [LOCAL ] HOMB: Primary data saved (32060 records). [2025-09-14T18:27:16.633882] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-14T18:27:16.633985] [INFO ] [MAIN ] Update Progress: 1040/2370 symbols completed. HOMB took 17.5s. Estimated remaining: 2h 20m 47s. Rate: 9.4 symbols/min [2025-09-14T18:27:17.289817] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:17.334444] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:17.339276] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:17.356384] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:17.376357] [DEBUG] [LOCAL ] HOV: Loaded 7379 existing records from primary storage. [2025-09-14T18:27:17.385112] [INFO ] [MAIN ] HOV: Loaded 7379 existing records. [2025-09-14T18:27:17.391154] [DEBUG] [LOCAL ] HOUS: Loaded 19797 existing records from primary storage. [2025-09-14T18:27:17.444583] [INFO ] [MAIN ] HOUS: Loaded 19797 existing records. [2025-09-14T18:27:17.458924] [DEBUG] [LOCAL ] HPE: Loaded 24061 existing records from primary storage. [2025-09-14T18:27:17.518582] [DEBUG] [LOCAL ] HP: Loaded 23241 existing records from primary storage. [2025-09-14T18:27:17.528983] [INFO ] [MAIN ] HPE: Loaded 24061 existing records. [2025-09-14T18:27:17.558604] [INFO ] [MAIN ] HP: Loaded 23241 existing records. [2025-09-14T18:27:17.879091] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:18.157824] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:18.095592] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-14T18:27:18.158086] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-14T18:27:18.157670] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:18.158465] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-14T18:27:18.158862] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-14T18:27:18.152938] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:18.158776] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-14T18:27:18.159024] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-14T18:27:18.159521] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-14T18:27:18.159604] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-14T18:27:18.159673] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-14T18:27:18.159850] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-14T18:27:18.165668] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-14T18:27:18.165716] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-14T18:27:18.228430] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-14T18:27:18.212814] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-14T18:27:18.165762] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-14T18:27:18.244139] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-14T18:27:19.449669] [INFO ] [REMOTE ] HOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:19.610700] [INFO ] [REMOTE ] HP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:19.620739] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-14T18:27:19.621040] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-14T18:27:19.620375] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:19.698676] [INFO ] [REMOTE ] HPE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:19.690533] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-14T18:27:19.699094] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-14T18:27:20.668802] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:27:20.671577] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-14T18:27:20.902596] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:27:20.910546] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-14T18:27:21.343964] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T18:27:21.354369] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-14T18:27:21.549039] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:27:21.552024] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-14T18:27:21.593446] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T18:27:21.603819] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-14T18:27:22.389899] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:27:22.399698] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-14T18:27:22.633093] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:27:22.636486] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-14T18:27:23.325535] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:27:23.337288] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-14T18:27:23.512618] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T18:27:23.532301] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-14T18:27:23.532663] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T18:27:23.536930] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-14T18:27:23.874065] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:27:23.883952] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-14T18:27:24.278941] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T18:27:24.283810] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-14T18:27:24.834251] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:27:24.845500] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-14T18:27:25.073674] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T18:27:25.358863] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-14T18:27:25.439401] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T18:27:25.562457] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T18:27:26.158842] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-14T18:27:26.416808] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T18:27:26.466510] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T18:27:26.958870] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-14T18:27:27.613280] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T18:27:27.715327] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:27:27.717193] [INFO ] [REMOTE ] HOV: Full fetch complete (14767 records). [2025-09-14T18:27:27.717280] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-14T18:27:27.763877] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-14T18:27:28.082296] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-14T18:27:28.082441] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-14T18:27:28.082858] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-14T18:27:28.082922] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-14T18:27:28.083495] [DEBUG] [LOCAL ] HOV: Trimmed 14767 records to 10650 (keeping 150 days of data) [2025-09-14T18:27:28.148961] [DEBUG] [LOCAL ] HOV: Primary data saved (10650 records). [2025-09-14T18:27:28.149126] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-14T18:27:28.149230] [INFO ] [MAIN ] Update Progress: 1041/2370 symbols completed. HOV took 11.5s. Estimated remaining: 2h 20m 47s. Rate: 9.4 symbols/min [2025-09-14T18:27:28.329080] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:28.335196] [DEBUG] [LOCAL ] HPF: Loaded 3590 existing records from primary storage. [2025-09-14T18:27:28.335335] [INFO ] [MAIN ] HPF: Loaded 3590 existing records. [2025-09-14T18:27:28.512893] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:28.513197] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-14T18:27:28.513273] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-14T18:27:28.513532] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-14T18:27:28.513599] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-14T18:27:28.567531] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-14T18:27:28.871937] [INFO ] [REMOTE ] HPF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:29.358827] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-14T18:27:30.108618] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T18:27:30.158799] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-14T18:27:30.312449] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-14T18:27:30.415581] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:27:30.855923] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:27:30.958829] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-14T18:27:31.722616] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T18:27:31.758823] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-14T18:27:32.558841] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-14T18:27:33.230759] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:27:33.358826] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-14T18:27:34.158849] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-14T18:27:34.541428] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T18:27:34.958846] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-14T18:27:35.640024] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-14T18:27:35.758796] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-14T18:27:35.791961] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:27:36.558836] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-14T18:27:36.794414] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:27:37.358879] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-14T18:27:37.790750] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T18:27:38.089534] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T18:27:38.094468] [INFO ] [REMOTE ] HOUS: Full fetch complete (47464 records). [2025-09-14T18:27:38.094600] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-14T18:27:38.163927] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-14T18:27:38.225568] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:27:38.498561] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-14T18:27:38.498700] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-14T18:27:38.499722] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-14T18:27:38.499802] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-14T18:27:38.500992] [DEBUG] [LOCAL ] HOUS: Trimmed 47464 records to 33145 (keeping 150 days of data) [2025-09-14T18:27:38.700901] [DEBUG] [LOCAL ] HOUS: Primary data saved (33145 records). [2025-09-14T18:27:38.701102] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-14T18:27:38.701255] [INFO ] [MAIN ] Update Progress: 1042/2370 symbols completed. HOUS took 22.1s. Estimated remaining: 2h 20m 46s. Rate: 9.4 symbols/min [2025-09-14T18:27:38.880864] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:38.889557] [DEBUG] [LOCAL ] HPI: Loaded 5208 existing records from primary storage. [2025-09-14T18:27:38.889783] [INFO ] [MAIN ] HPI: Loaded 5208 existing records. [2025-09-14T18:27:38.964032] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-14T18:27:39.074474] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:39.074761] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-14T18:27:39.074824] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-14T18:27:39.075151] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-14T18:27:39.075212] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-14T18:27:39.427686] [INFO ] [REMOTE ] HPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:39.758831] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-14T18:27:39.827582] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:27:40.093451] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T18:27:40.221368] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-14T18:27:40.558860] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-14T18:27:41.358910] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-14T18:27:41.392344] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T18:27:42.158835] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-14T18:27:42.178960] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T18:27:42.849019] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:27:42.854988] [INFO ] [REMOTE ] HP: Full fetch complete (56297 records). [2025-09-14T18:27:42.855231] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-14T18:27:42.960331] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-14T18:27:43.253613] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-14T18:27:43.253761] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-14T18:27:43.254588] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-14T18:27:43.254672] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-14T18:27:43.256068] [DEBUG] [LOCAL ] HP: Trimmed 56297 records to 39084 (keeping 150 days of data) [2025-09-14T18:27:43.529187] [DEBUG] [LOCAL ] HP: Primary data saved (39084 records). [2025-09-14T18:27:43.529451] [INFO ] [MAIN ] HP: Full history saved. [2025-09-14T18:27:43.529591] [INFO ] [MAIN ] Update Progress: 1043/2370 symbols completed. HP took 26.9s. Estimated remaining: 2h 20m 38s. Rate: 9.4 symbols/min [2025-09-14T18:27:43.702485] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:43.711805] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T18:27:43.735099] [DEBUG] [LOCAL ] HPP: Loaded 23563 existing records from primary storage. [2025-09-14T18:27:43.735291] [INFO ] [MAIN ] HPP: Loaded 23563 existing records. [2025-09-14T18:27:43.764535] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-14T18:27:43.918103] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:43.918393] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-14T18:27:43.918464] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-14T18:27:43.919036] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-14T18:27:43.919099] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-14T18:27:44.282015] [INFO ] [REMOTE ] HPP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:44.296676] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T18:27:44.302147] [INFO ] [REMOTE ] HPE: Full fetch complete (58377 records). [2025-09-14T18:27:44.302319] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-14T18:27:44.564052] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-14T18:27:44.699874] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-14T18:27:44.700014] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-14T18:27:44.700964] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-14T18:27:44.701060] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-14T18:27:44.702511] [DEBUG] [LOCAL ] HPE: Trimmed 58377 records to 40437 (keeping 150 days of data) [2025-09-14T18:27:44.973516] [DEBUG] [LOCAL ] HPE: Primary data saved (40437 records). [2025-09-14T18:27:44.973722] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-14T18:27:44.973898] [INFO ] [MAIN ] Update Progress: 1044/2370 symbols completed. HPE took 28.3s. Estimated remaining: 2h 20m 25s. Rate: 9.4 symbols/min [2025-09-14T18:27:45.162181] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:45.184695] [DEBUG] [LOCAL ] HPQ: Loaded 24086 existing records from primary storage. [2025-09-14T18:27:45.184861] [INFO ] [MAIN ] HPQ: Loaded 24086 existing records. [2025-09-14T18:27:45.367299] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:27:45.366728] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-14T18:27:45.372575] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:45.374866] [INFO ] [REMOTE ] HPF: Full fetch complete (7706 records). [2025-09-14T18:27:45.376026] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-14T18:27:45.376190] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-14T18:27:45.376087] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-14T18:27:45.387989] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-14T18:27:45.440946] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-14T18:27:46.040346] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-14T18:27:46.074923] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-14T18:27:46.109580] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-14T18:27:46.113353] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:46.113798] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-14T18:27:46.114255] [DEBUG] [LOCAL ] HPF: Trimmed 7706 records to 5597 (keeping 150 days of data) [2025-09-14T18:27:46.149813] [DEBUG] [LOCAL ] HPF: Primary data saved (5597 records). [2025-09-14T18:27:46.149999] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-14T18:27:46.150129] [INFO ] [MAIN ] Update Progress: 1045/2370 symbols completed. HPF took 18.0s. Estimated remaining: 2h 20m 12s. Rate: 9.5 symbols/min [2025-09-14T18:27:46.163966] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-14T18:27:46.325979] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:46.333477] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T18:27:46.342088] [DEBUG] [LOCAL ] HPS: Loaded 5295 existing records from primary storage. [2025-09-14T18:27:46.342255] [INFO ] [MAIN ] HPS: Loaded 5295 existing records. [2025-09-14T18:27:46.530040] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:46.530379] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-14T18:27:46.530458] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-14T18:27:46.530826] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-14T18:27:46.530891] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-14T18:27:46.895709] [INFO ] [REMOTE ] HPS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:46.958838] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-14T18:27:47.758899] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-14T18:27:47.793931] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T18:27:48.150136] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:27:48.558927] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-14T18:27:49.358858] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-14T18:27:49.418868] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T18:27:49.427230] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:27:49.845363] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-14T18:27:50.158845] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-14T18:27:50.958865] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-14T18:27:51.758896] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-14T18:27:51.833426] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:27:51.868130] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T18:27:52.558873] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-14T18:27:52.648298] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:27:53.358881] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-14T18:27:54.148949] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:27:54.159326] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-14T18:27:54.229059] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:27:54.958887] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-14T18:27:54.985076] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:27:55.758909] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-14T18:27:56.558918] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-14T18:27:56.612952] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T18:27:56.962386] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T18:27:57.358865] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-14T18:27:58.094541] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:27:58.158870] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-14T18:27:58.951562] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T18:27:58.958772] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-14T18:27:59.530405] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T18:27:59.758826] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-14T18:27:59.850835] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T18:27:59.853009] [INFO ] [REMOTE ] HPI: Full fetch complete (10062 records). [2025-09-14T18:27:59.853094] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-14T18:28:00.211380] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-14T18:28:00.211480] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-14T18:28:00.211741] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-14T18:28:00.211797] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-14T18:28:00.212259] [DEBUG] [LOCAL ] HPI: Trimmed 10062 records to 7619 (keeping 150 days of data) [2025-09-14T18:28:00.260740] [DEBUG] [LOCAL ] HPI: Primary data saved (7619 records). [2025-09-14T18:28:00.260868] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-14T18:28:00.260982] [INFO ] [MAIN ] Update Progress: 1046/2370 symbols completed. HPI took 21.6s. Estimated remaining: 2h 20m 16s. Rate: 9.4 symbols/min [2025-09-14T18:28:00.428889] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:00.441080] [DEBUG] [LOCAL ] HQH: Loaded 11345 existing records from primary storage. [2025-09-14T18:28:00.441219] [INFO ] [MAIN ] HQH: Loaded 11345 existing records. [2025-09-14T18:28:00.563934] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-14T18:28:00.623600] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:00.623848] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-14T18:28:00.623909] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-14T18:28:00.632695] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-14T18:28:00.633533] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T18:28:00.633603] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-14T18:28:00.989475] [INFO ] [REMOTE ] HQH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:01.358887] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-14T18:28:02.158906] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-14T18:28:02.414509] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:28:02.457159] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:28:02.958840] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-14T18:28:03.758797] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-14T18:28:04.108032] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T18:28:04.153252] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T18:28:04.558856] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-14T18:28:05.358836] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-14T18:28:05.624355] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T18:28:05.651114] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:28:05.880149] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T18:28:06.158859] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-14T18:28:06.845333] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:28:06.846988] [INFO ] [REMOTE ] HPS: Full fetch complete (11380 records). [2025-09-14T18:28:06.847089] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-14T18:28:06.963974] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-14T18:28:07.226893] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-14T18:28:07.227105] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-14T18:28:07.227627] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-14T18:28:07.227759] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-14T18:28:07.229711] [DEBUG] [LOCAL ] HPS: Trimmed 11380 records to 7697 (keeping 150 days of data) [2025-09-14T18:28:07.290275] [DEBUG] [LOCAL ] HPS: Primary data saved (7697 records). [2025-09-14T18:28:07.290533] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-14T18:28:07.290705] [INFO ] [MAIN ] Update Progress: 1047/2370 symbols completed. HPS took 21.1s. Estimated remaining: 2h 20m 10s. Rate: 9.4 symbols/min [2025-09-14T18:28:07.475781] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:07.490473] [DEBUG] [LOCAL ] HQL: Loaded 7398 existing records from primary storage. [2025-09-14T18:28:07.490725] [INFO ] [MAIN ] HQL: Loaded 7398 existing records. [2025-09-14T18:28:07.686062] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:07.686471] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-14T18:28:07.686596] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-14T18:28:07.687125] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-14T18:28:07.687211] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-14T18:28:07.766839] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-14T18:28:08.061774] [INFO ] [REMOTE ] HQL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:08.270591] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T18:28:08.558882] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-14T18:28:09.351990] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T18:28:09.358762] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-14T18:28:09.535982] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:28:10.158879] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-14T18:28:10.396909] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T18:28:10.958884] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-14T18:28:11.758842] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-14T18:28:11.910511] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T18:28:12.100795] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T18:28:12.558801] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-14T18:28:12.844151] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:28:13.358846] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-14T18:28:13.903914] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:28:14.158850] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-14T18:28:14.272634] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:28:14.958880] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-14T18:28:15.758821] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-14T18:28:15.919772] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T18:28:16.147126] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:28:16.153354] [INFO ] [REMOTE ] HPP: Full fetch complete (54880 records). [2025-09-14T18:28:16.153607] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-14T18:28:16.404149] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-14T18:28:16.563889] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-14T18:28:16.617837] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-14T18:28:16.617957] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-14T18:28:16.619127] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-14T18:28:16.619208] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-14T18:28:16.620602] [DEBUG] [LOCAL ] HPP: Trimmed 54880 records to 38521 (keeping 150 days of data) [2025-09-14T18:28:16.860994] [DEBUG] [LOCAL ] HPP: Primary data saved (38521 records). [2025-09-14T18:28:16.861170] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-14T18:28:16.861285] [INFO ] [MAIN ] Update Progress: 1048/2370 symbols completed. HPP took 33.3s. Estimated remaining: 2h 20m 8s. Rate: 9.4 symbols/min [2025-09-14T18:28:17.036843] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:17.064163] [DEBUG] [LOCAL ] HR: Loaded 23459 existing records from primary storage. [2025-09-14T18:28:17.064332] [INFO ] [MAIN ] HR: Loaded 23459 existing records. [2025-09-14T18:28:17.246432] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:17.246745] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-14T18:28:17.246820] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-14T18:28:17.247569] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-14T18:28:17.247672] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-14T18:28:17.364089] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-14T18:28:17.611113] [INFO ] [REMOTE ] HR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:17.715206] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T18:28:18.158906] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-14T18:28:18.779245] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T18:28:18.794481] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T18:28:18.958839] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-14T18:28:19.758817] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-14T18:28:19.998663] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T18:28:20.001229] [INFO ] [REMOTE ] HQH: Full fetch complete (27208 records). [2025-09-14T18:28:20.001357] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-14T18:28:20.371618] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-14T18:28:20.371760] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-14T18:28:20.372393] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-14T18:28:20.372456] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-14T18:28:20.373278] [DEBUG] [LOCAL ] HQH: Trimmed 27208 records to 18918 (keeping 150 days of data) [2025-09-14T18:28:20.494673] [DEBUG] [LOCAL ] HQH: Primary data saved (18918 records). [2025-09-14T18:28:20.494852] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-14T18:28:20.494996] [INFO ] [MAIN ] Update Progress: 1049/2370 symbols completed. HQH took 20.2s. Estimated remaining: 2h 19m 58s. Rate: 9.4 symbols/min [2025-09-14T18:28:20.564076] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-14T18:28:20.669862] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:20.690817] [DEBUG] [LOCAL ] HRB: Loaded 21731 existing records from primary storage. [2025-09-14T18:28:20.690977] [INFO ] [MAIN ] HRB: Loaded 21731 existing records. [2025-09-14T18:28:20.865315] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:20.865585] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-14T18:28:20.865659] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-14T18:28:20.866232] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-14T18:28:20.866291] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-14T18:28:21.220809] [INFO ] [REMOTE ] HRB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:21.358797] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-14T18:28:21.796763] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T18:28:21.837061] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T18:28:22.127971] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:28:22.129956] [INFO ] [REMOTE ] HQL: Full fetch complete (17944 records). [2025-09-14T18:28:22.130063] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-14T18:28:22.164006] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-14T18:28:22.499126] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-14T18:28:22.499232] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-14T18:28:22.499809] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-14T18:28:22.499871] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-14T18:28:22.500488] [DEBUG] [LOCAL ] HQL: Trimmed 17944 records to 11831 (keeping 150 days of data) [2025-09-14T18:28:22.576291] [DEBUG] [LOCAL ] HQL: Primary data saved (11831 records). [2025-09-14T18:28:22.576453] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-14T18:28:22.576558] [INFO ] [MAIN ] Update Progress: 1050/2370 symbols completed. HQL took 15.3s. Estimated remaining: 2h 19m 46s. Rate: 9.4 symbols/min [2025-09-14T18:28:22.748627] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:22.765472] [DEBUG] [LOCAL ] HRI: Loaded 14087 existing records from primary storage. [2025-09-14T18:28:22.765701] [INFO ] [MAIN ] HRI: Loaded 14087 existing records. [2025-09-14T18:28:22.956393] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:22.956800] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-14T18:28:22.957165] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-14T18:28:22.957940] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-14T18:28:22.958025] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-14T18:28:22.963934] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-14T18:28:23.358379] [INFO ] [REMOTE ] HRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:23.758835] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-14T18:28:24.021308] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T18:28:24.421427] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:28:24.427869] [INFO ] [REMOTE ] HPQ: Full fetch complete (58348 records). [2025-09-14T18:28:24.428008] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-14T18:28:24.569140] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-14T18:28:24.815146] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-14T18:28:24.815360] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-14T18:28:24.816356] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-14T18:28:24.816459] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-14T18:28:24.818122] [DEBUG] [LOCAL ] HPQ: Trimmed 58348 records to 40412 (keeping 150 days of data) [2025-09-14T18:28:24.938746] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T18:28:25.114832] [DEBUG] [LOCAL ] HPQ: Primary data saved (40412 records). [2025-09-14T18:28:25.115000] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-14T18:28:25.115107] [INFO ] [MAIN ] Update Progress: 1051/2370 symbols completed. HPQ took 40.1s. Estimated remaining: 2h 19m 35s. Rate: 9.4 symbols/min [2025-09-14T18:28:25.282301] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:25.306407] [DEBUG] [LOCAL ] HRL: Loaded 23808 existing records from primary storage. [2025-09-14T18:28:25.306623] [INFO ] [MAIN ] HRL: Loaded 23808 existing records. [2025-09-14T18:28:25.367963] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-14T18:28:25.485855] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:25.486133] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-14T18:28:25.486199] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-14T18:28:25.487021] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-14T18:28:25.487089] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-14T18:28:25.843611] [INFO ] [REMOTE ] HRL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:26.089193] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T18:28:26.158787] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-14T18:28:26.898987] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T18:28:26.958785] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-14T18:28:27.486375] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:28:27.758831] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-14T18:28:28.558793] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-14T18:28:28.720755] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:28:29.358828] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-14T18:28:29.701920] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T18:28:30.058124] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T18:28:30.158847] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-14T18:28:30.958879] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-14T18:28:31.194468] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:28:31.758846] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-14T18:28:32.077483] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T18:28:32.369373] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:28:32.558828] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-14T18:28:33.358892] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-14T18:28:33.438797] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T18:28:34.158900] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-14T18:28:34.483279] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T18:28:34.958819] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-14T18:28:35.025183] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:28:35.282958] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:28:35.758898] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-14T18:28:36.558856] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-14T18:28:36.798785] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T18:28:37.358831] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-14T18:28:37.560765] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T18:28:38.021552] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:28:38.158842] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-14T18:28:38.958801] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-14T18:28:39.038798] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:28:39.758793] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-14T18:28:39.873512] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T18:28:40.334120] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T18:28:40.558834] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-14T18:28:41.369898] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-14T18:28:41.399133] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:28:41.996908] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:28:42.158825] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-14T18:28:42.958833] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-14T18:28:43.140266] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:28:43.758843] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-14T18:28:44.026149] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T18:28:44.046952] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:28:44.052553] [INFO ] [REMOTE ] HRI: Full fetch complete (36556 records). [2025-09-14T18:28:44.052902] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-14T18:28:44.447357] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-14T18:28:44.447607] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-14T18:28:44.449015] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-14T18:28:44.449150] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-14T18:28:44.450897] [DEBUG] [LOCAL ] HRI: Trimmed 36556 records to 24307 (keeping 150 days of data) [2025-09-14T18:28:44.571057] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:28:44.571177] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-14T18:28:44.643746] [INFO ] [REMOTE ] HRL: Full fetch complete (57710 records). [2025-09-14T18:28:44.647709] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-14T18:28:44.650076] [DEBUG] [LOCAL ] HRI: Primary data saved (24307 records). [2025-09-14T18:28:44.650671] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-14T18:28:44.650806] [INFO ] [MAIN ] Update Progress: 1052/2370 symbols completed. HRI took 22.1s. Estimated remaining: 2h 19m 45s. Rate: 9.4 symbols/min [2025-09-14T18:28:45.083128] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:45.264833] [DEBUG] [LOCAL ] HRTG: Loaded 14492 existing records from primary storage. [2025-09-14T18:28:45.282006] [INFO ] [MAIN ] HRTG: Loaded 14492 existing records. [2025-09-14T18:28:45.282195] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-14T18:28:45.325788] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-14T18:28:45.349019] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-14T18:28:45.375577] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-14T18:28:45.360227] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-14T18:28:45.468172] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:45.468818] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-14T18:28:45.468693] [DEBUG] [LOCAL ] HRL: Trimmed 57710 records to 39940 (keeping 150 days of data) [2025-09-14T18:28:45.469396] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-14T18:28:45.470003] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-14T18:28:45.470080] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-14T18:28:45.953359] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:46.102174] [DEBUG] [LOCAL ] HRL: Primary data saved (39940 records). [2025-09-14T18:28:46.102357] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-14T18:28:46.102482] [INFO ] [MAIN ] Update Progress: 1053/2370 symbols completed. HRL took 21.0s. Estimated remaining: 2h 19m 33s. Rate: 9.4 symbols/min [2025-09-14T18:28:46.166092] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-14T18:28:46.276307] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:46.298051] [DEBUG] [LOCAL ] HSBC: Loaded 22576 existing records from primary storage. [2025-09-14T18:28:46.298221] [INFO ] [MAIN ] HSBC: Loaded 22576 existing records. [2025-09-14T18:28:46.478258] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:46.478711] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-14T18:28:46.478815] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-14T18:28:46.489006] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-14T18:28:46.505371] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-14T18:28:46.587582] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T18:28:46.874047] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:46.905996] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T18:28:46.939499] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T18:28:46.958781] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-14T18:28:47.397377] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T18:28:47.403027] [INFO ] [REMOTE ] HR: Full fetch complete (56310 records). [2025-09-14T18:28:47.403206] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-14T18:28:47.762244] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-14T18:28:47.802842] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-14T18:28:47.802976] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-14T18:28:47.804162] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-14T18:28:47.804246] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-14T18:28:47.805921] [DEBUG] [LOCAL ] HR: Trimmed 56310 records to 39162 (keeping 150 days of data) [2025-09-14T18:28:48.067900] [DEBUG] [LOCAL ] HR: Primary data saved (39162 records). [2025-09-14T18:28:48.068070] [INFO ] [MAIN ] HR: Full history saved. [2025-09-14T18:28:48.068172] [INFO ] [MAIN ] Update Progress: 1054/2370 symbols completed. HR took 31.2s. Estimated remaining: 2h 19m 21s. Rate: 9.4 symbols/min [2025-09-14T18:28:48.242027] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:48.250135] [DEBUG] [LOCAL ] HSHP: Loaded 6495 existing records from primary storage. [2025-09-14T18:28:48.250280] [INFO ] [MAIN ] HSHP: Loaded 6495 existing records. [2025-09-14T18:28:48.430882] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:48.431373] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-14T18:28:48.431597] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-14T18:28:48.431996] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-14T18:28:48.432070] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-14T18:28:48.561266] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-14T18:28:48.577987] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T18:28:48.692571] [INFO ] [REMOTE ] HRB: Full fetch complete (52869 records). [2025-09-14T18:28:48.738238] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-14T18:28:48.922607] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:49.205224] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-14T18:28:49.205339] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-14T18:28:49.206244] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-14T18:28:49.206311] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-14T18:28:49.207506] [DEBUG] [LOCAL ] HRB: Trimmed 52869 records to 36481 (keeping 150 days of data) [2025-09-14T18:28:49.392618] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-14T18:28:49.463578] [DEBUG] [LOCAL ] HRB: Primary data saved (36481 records). [2025-09-14T18:28:49.463782] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-14T18:28:49.463897] [INFO ] [MAIN ] Update Progress: 1055/2370 symbols completed. HRB took 29.0s. Estimated remaining: 2h 19m 8s. Rate: 9.5 symbols/min [2025-09-14T18:28:49.639278] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:49.666670] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T18:28:49.695328] [DEBUG] [LOCAL ] HSY: Loaded 22597 existing records from primary storage. [2025-09-14T18:28:49.695564] [INFO ] [MAIN ] HSY: Loaded 22597 existing records. [2025-09-14T18:28:49.871374] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:49.871686] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-14T18:28:49.871785] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-14T18:28:49.872633] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-14T18:28:49.872760] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-14T18:28:50.160779] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-14T18:28:50.243098] [INFO ] [REMOTE ] HSY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:50.463756] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:28:50.958883] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-14T18:28:51.416712] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T18:28:51.758840] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-14T18:28:52.558872] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-14T18:28:52.788497] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T18:28:53.273998] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T18:28:53.358780] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-14T18:28:53.608998] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T18:28:54.158821] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-14T18:28:54.859247] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:28:54.958832] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-14T18:28:55.074302] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T18:28:55.758833] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-14T18:28:56.123463] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T18:28:56.558795] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-14T18:28:56.688725] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:28:57.358871] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-14T18:28:57.754863] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T18:28:58.158881] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-14T18:28:58.225855] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:28:58.958881] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-14T18:28:59.631203] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:28:59.758779] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-14T18:28:59.935137] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T18:29:00.558902] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-14T18:29:00.970202] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T18:29:00.973489] [INFO ] [REMOTE ] HRTG: Full fetch complete (33610 records). [2025-09-14T18:29:00.973605] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-14T18:29:01.345059] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-14T18:29:01.345167] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-14T18:29:01.345948] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-14T18:29:01.346053] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-14T18:29:01.347006] [DEBUG] [LOCAL ] HRTG: Trimmed 33610 records to 25534 (keeping 150 days of data) [2025-09-14T18:29:01.397766] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-14T18:29:01.506985] [DEBUG] [LOCAL ] HRTG: Primary data saved (25534 records). [2025-09-14T18:29:01.507285] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-14T18:29:01.507487] [INFO ] [MAIN ] Update Progress: 1056/2370 symbols completed. HRTG took 16.9s. Estimated remaining: 2h 19m 9s. Rate: 9.4 symbols/min [2025-09-14T18:29:01.684123] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:01.719368] [DEBUG] [LOCAL ] HTB: Loaded 3145 existing records from primary storage. [2025-09-14T18:29:01.721165] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:29:01.732097] [INFO ] [MAIN ] HTB: Loaded 3145 existing records. [2025-09-14T18:29:01.912701] [WARN ] [MAIN ] HTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:01.912960] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-14T18:29:01.913035] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-14T18:29:01.913352] [DEBUG] [LOCAL ] HTB: Deleted primary data file. [2025-09-14T18:29:01.913411] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-14T18:29:02.163928] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-14T18:29:02.267030] [INFO ] [REMOTE ] HTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:02.958830] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-14T18:29:03.100770] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T18:29:03.312613] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-14T18:29:03.374852] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:29:03.758858] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-14T18:29:04.558891] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-14T18:29:04.898621] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T18:29:04.984733] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T18:29:04.990112] [INFO ] [REMOTE ] HSBC: Full fetch complete (55792 records). [2025-09-14T18:29:04.990294] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-14T18:29:05.364720] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-14T18:29:05.386469] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-14T18:29:05.386696] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-14T18:29:05.388335] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-14T18:29:05.388574] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-14T18:29:05.390561] [DEBUG] [LOCAL ] HSBC: Trimmed 55792 records to 38237 (keeping 150 days of data) [2025-09-14T18:29:05.661395] [DEBUG] [LOCAL ] HSBC: Primary data saved (38237 records). [2025-09-14T18:29:05.661660] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-14T18:29:05.661790] [INFO ] [MAIN ] Update Progress: 1057/2370 symbols completed. HSBC took 19.6s. Estimated remaining: 2h 19m 0s. Rate: 9.4 symbols/min [2025-09-14T18:29:05.843265] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:05.853287] [DEBUG] [LOCAL ] HTD: Loaded 6316 existing records from primary storage. [2025-09-14T18:29:05.853504] [INFO ] [MAIN ] HTD: Loaded 6316 existing records. [2025-09-14T18:29:06.090856] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:06.091239] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-14T18:29:06.091306] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-14T18:29:06.091852] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-14T18:29:06.091920] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-14T18:29:06.164087] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-14T18:29:06.444491] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T18:29:06.479054] [INFO ] [REMOTE ] HTD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:06.952973] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T18:29:06.958759] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-14T18:29:07.758849] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-14T18:29:07.828334] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T18:29:08.344673] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T18:29:08.558880] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-14T18:29:09.319953] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T18:29:09.358779] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-14T18:29:10.111797] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-14T18:29:10.158809] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-14T18:29:10.921088] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T18:29:10.958805] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-14T18:29:11.758930] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-14T18:29:11.918183] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T18:29:12.558908] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-14T18:29:13.358880] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-14T18:29:13.428001] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:29:13.644694] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:29:14.117598] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T18:29:14.158855] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-14T18:29:14.797882] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:29:14.799352] [INFO ] [REMOTE ] HTB: Full fetch complete (6869 records). [2025-09-14T18:29:14.799439] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-14T18:29:14.962084] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-14T18:29:14.991760] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-14T18:29:14.992047] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:29:14.992100] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:29:14.992149] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-14T18:29:14.992222] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-14T18:29:14.992273] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-14T18:29:14.992335] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-14T18:29:14.992426] [INFO ] [MAIN ] Update Progress: 1058/2370 symbols completed. HTB took 13.5s. Estimated remaining: 2h 18m 57s. Rate: 9.4 symbols/min [2025-09-14T18:29:15.166331] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:15.168344] [DEBUG] [LOCAL ] HTFC: Loaded 156 existing records from primary storage. [2025-09-14T18:29:15.168430] [INFO ] [MAIN ] HTFC: Loaded 156 existing records. [2025-09-14T18:29:15.346120] [WARN ] [MAIN ] HTFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:15.346397] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-14T18:29:15.346461] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-14T18:29:15.346730] [DEBUG] [LOCAL ] HTFC: Deleted primary data file. [2025-09-14T18:29:15.347339] [DEBUG] [LOCAL ] HTFC: Removed from QA tracker. [2025-09-14T18:29:15.347403] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-14T18:29:15.701401] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:15.758830] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-14T18:29:16.083753] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T18:29:16.139262] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T18:29:16.558894] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-14T18:29:16.926946] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-14T18:29:17.358856] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-14T18:29:18.158849] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-14T18:29:18.439187] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T18:29:18.635503] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T18:29:18.958924] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-14T18:29:19.758904] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-14T18:29:20.558889] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-14T18:29:20.584220] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:29:20.818332] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:29:20.928863] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T18:29:21.358864] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-14T18:29:22.158827] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-14T18:29:22.205811] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T18:29:22.447813] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-14T18:29:22.958844] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-14T18:29:23.758834] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-14T18:29:24.558838] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-14T18:29:24.683975] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:29:24.778923] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T18:29:25.327206] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:29:25.329208] [INFO ] [REMOTE ] HSHP: Full fetch complete (17525 records). [2025-09-14T18:29:25.329292] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-14T18:29:25.364006] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-14T18:29:25.706280] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-14T18:29:25.706407] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-14T18:29:25.707006] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-14T18:29:25.707070] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-14T18:29:25.707706] [DEBUG] [LOCAL ] HSHP: Trimmed 17525 records to 10277 (keeping 150 days of data) [2025-09-14T18:29:25.768897] [DEBUG] [LOCAL ] HSHP: Primary data saved (10277 records). [2025-09-14T18:29:25.769085] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-14T18:29:25.769205] [INFO ] [MAIN ] Update Progress: 1059/2370 symbols completed. HSHP took 37.7s. Estimated remaining: 2h 18m 57s. Rate: 9.4 symbols/min [2025-09-14T18:29:25.937538] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:25.959818] [DEBUG] [LOCAL ] HTGC: Loaded 20628 existing records from primary storage. [2025-09-14T18:29:25.959993] [INFO ] [MAIN ] HTGC: Loaded 20628 existing records. [2025-09-14T18:29:26.138502] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:26.138766] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-14T18:29:26.138846] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-14T18:29:26.139506] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-14T18:29:26.139568] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-14T18:29:26.169543] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-14T18:29:26.522882] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:26.535400] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T18:29:26.958904] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-14T18:29:27.758868] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-14T18:29:27.869633] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T18:29:27.965884] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T18:29:28.062101] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-14T18:29:28.558826] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-14T18:29:29.358825] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-14T18:29:30.105567] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:29:30.158780] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-14T18:29:30.173329] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:29:30.175196] [INFO ] [REMOTE ] HTD: Full fetch complete (14157 records). [2025-09-14T18:29:30.175283] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-14T18:29:30.527883] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-14T18:29:30.527995] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-14T18:29:30.528345] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-14T18:29:30.528399] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-14T18:29:30.528928] [DEBUG] [LOCAL ] HTD: Trimmed 14157 records to 9986 (keeping 150 days of data) [2025-09-14T18:29:30.591993] [DEBUG] [LOCAL ] HTD: Primary data saved (9986 records). [2025-09-14T18:29:30.592156] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-14T18:29:30.592257] [INFO ] [MAIN ] Update Progress: 1060/2370 symbols completed. HTD took 24.9s. Estimated remaining: 2h 18m 48s. Rate: 9.4 symbols/min [2025-09-14T18:29:30.761387] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:30.777242] [DEBUG] [LOCAL ] HTH: Loaded 15124 existing records from primary storage. [2025-09-14T18:29:30.777430] [INFO ] [MAIN ] HTH: Loaded 15124 existing records. [2025-09-14T18:29:30.949828] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:30.950097] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-14T18:29:30.950155] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-14T18:29:30.950718] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-14T18:29:30.950780] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-14T18:29:30.963906] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-14T18:29:31.296705] [INFO ] [REMOTE ] HTH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:31.758860] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-14T18:29:32.113557] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:29:32.558879] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-14T18:29:32.679332] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T18:29:33.317029] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:29:33.358897] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-14T18:29:34.050629] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:29:34.056278] [INFO ] [REMOTE ] HSY: Full fetch complete (55149 records). [2025-09-14T18:29:34.056476] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-14T18:29:34.161558] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-14T18:29:34.458148] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-14T18:29:34.458387] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-14T18:29:34.459421] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-14T18:29:34.459516] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-14T18:29:34.461165] [DEBUG] [LOCAL ] HSY: Trimmed 55149 records to 38032 (keeping 150 days of data) [2025-09-14T18:29:34.597041] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T18:29:34.780105] [DEBUG] [LOCAL ] HSY: Primary data saved (38032 records). [2025-09-14T18:29:34.780324] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-14T18:29:34.780487] [INFO ] [MAIN ] Update Progress: 1061/2370 symbols completed. HSY took 45.3s. Estimated remaining: 2h 18m 39s. Rate: 9.4 symbols/min [2025-09-14T18:29:34.950927] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:34.961040] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-14T18:29:34.969436] [DEBUG] [LOCAL ] HUBB: Loaded 15477 existing records from primary storage. [2025-09-14T18:29:34.969683] [INFO ] [MAIN ] HUBB: Loaded 15477 existing records. [2025-09-14T18:29:35.151855] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:35.152113] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-14T18:29:35.152183] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-14T18:29:35.152863] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-14T18:29:35.152931] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-14T18:29:35.507843] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:35.531522] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:29:35.758840] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-14T18:29:36.558831] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-14T18:29:36.858859] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-14T18:29:36.860862] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T18:29:37.244702] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:29:37.358820] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-14T18:29:38.158825] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-14T18:29:38.958828] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-14T18:29:39.156839] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T18:29:39.171030] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-14T18:29:39.171794] [INFO ] [REMOTE ] HTFC: Full fetch complete (624 records). [2025-09-14T18:29:39.171880] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-14T18:29:39.350881] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-14T18:29:39.351133] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:29:39.351188] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:29:39.351235] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-14T18:29:39.351307] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-14T18:29:39.351355] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-14T18:29:39.351494] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-14T18:29:39.351589] [INFO ] [MAIN ] Update Progress: 1062/2370 symbols completed. HTFC took 24.4s. Estimated remaining: 2h 18m 31s. Rate: 9.4 symbols/min [2025-09-14T18:29:39.519998] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:39.539872] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:29:39.562026] [DEBUG] [LOCAL ] HUBS: Loaded 18114 existing records from primary storage. [2025-09-14T18:29:39.562208] [INFO ] [MAIN ] HUBS: Loaded 18114 existing records. [2025-09-14T18:29:39.736074] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:39.736339] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-14T18:29:39.736398] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-14T18:29:39.736959] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-14T18:29:39.737023] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-14T18:29:39.765580] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-14T18:29:40.103816] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:40.558867] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-14T18:29:41.358822] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-14T18:29:41.451838] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:29:42.158851] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-14T18:29:42.215866] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T18:29:42.958876] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-14T18:29:43.007144] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T18:29:43.503916] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:29:43.758882] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-14T18:29:44.095777] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:29:44.558844] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-14T18:29:45.266151] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:29:45.358863] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-14T18:29:46.098088] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:29:46.158856] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-14T18:29:46.958856] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-14T18:29:47.106423] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:29:47.583298] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:29:47.758871] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-14T18:29:48.558944] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-14T18:29:48.715566] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T18:29:49.350915] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:29:49.358804] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-14T18:29:49.818100] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:29:50.158832] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-14T18:29:50.905936] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T18:29:50.910502] [INFO ] [REMOTE ] HTGC: Full fetch complete (51713 records). [2025-09-14T18:29:50.910619] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-14T18:29:50.968298] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-14T18:29:51.311459] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-14T18:29:51.311602] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-14T18:29:51.312514] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-14T18:29:51.312578] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-14T18:29:51.314055] [DEBUG] [LOCAL ] HTGC: Trimmed 51713 records to 35510 (keeping 150 days of data) [2025-09-14T18:29:51.564918] [DEBUG] [LOCAL ] HTGC: Primary data saved (35510 records). [2025-09-14T18:29:51.565130] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-14T18:29:51.565298] [INFO ] [MAIN ] Update Progress: 1063/2370 symbols completed. HTGC took 25.8s. Estimated remaining: 2h 18m 32s. Rate: 9.4 symbols/min [2025-09-14T18:29:51.739730] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:51.760681] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-14T18:29:51.763609] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T18:29:51.787857] [DEBUG] [LOCAL ] HUM: Loaded 21830 existing records from primary storage. [2025-09-14T18:29:51.788034] [INFO ] [MAIN ] HUM: Loaded 21830 existing records. [2025-09-14T18:29:51.965685] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:51.965979] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-14T18:29:51.966154] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-14T18:29:51.966837] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-14T18:29:51.966908] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-14T18:29:52.084699] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:29:52.351666] [INFO ] [REMOTE ] HUM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:52.558901] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-14T18:29:53.300903] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:29:53.358831] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-14T18:29:54.158882] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-14T18:29:54.431056] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T18:29:54.807078] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T18:29:54.958852] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-14T18:29:55.362895] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T18:29:55.648632] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:29:55.652623] [INFO ] [REMOTE ] HUBB: Full fetch complete (41370 records). [2025-09-14T18:29:55.652815] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-14T18:29:55.764076] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-14T18:29:56.048783] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-14T18:29:56.048902] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-14T18:29:56.049775] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-14T18:29:56.049835] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-14T18:29:56.051030] [DEBUG] [LOCAL ] HUBB: Trimmed 41370 records to 27177 (keeping 150 days of data) [2025-09-14T18:29:56.228350] [DEBUG] [LOCAL ] HUBB: Primary data saved (27177 records). [2025-09-14T18:29:56.228516] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-14T18:29:56.228629] [INFO ] [MAIN ] Update Progress: 1064/2370 symbols completed. HUBB took 21.4s. Estimated remaining: 2h 18m 23s. Rate: 9.4 symbols/min [2025-09-14T18:29:56.403996] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:56.431205] [DEBUG] [LOCAL ] HUN: Loaded 23890 existing records from primary storage. [2025-09-14T18:29:56.431426] [INFO ] [MAIN ] HUN: Loaded 23890 existing records. [2025-09-14T18:29:56.563985] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-14T18:29:56.621370] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:56.621721] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-14T18:29:56.621789] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-14T18:29:56.622495] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-14T18:29:56.622562] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-14T18:29:56.976250] [INFO ] [REMOTE ] HUN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:57.356241] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T18:29:57.364826] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-14T18:29:57.919575] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T18:29:58.158876] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-14T18:29:58.958925] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-14T18:29:59.153264] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T18:29:59.758878] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-14T18:30:00.200420] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T18:30:00.273689] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T18:30:00.558939] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-14T18:30:00.960082] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T18:30:00.964706] [INFO ] [REMOTE ] HUBS: Full fetch complete (43294 records). [2025-09-14T18:30:00.964848] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-14T18:30:01.367298] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-14T18:30:01.384473] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-14T18:30:01.384587] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-14T18:30:01.385755] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-14T18:30:01.385921] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-14T18:30:01.387723] [DEBUG] [LOCAL ] HUBS: Trimmed 43294 records to 29603 (keeping 150 days of data) [2025-09-14T18:30:01.691040] [DEBUG] [LOCAL ] HUBS: Primary data saved (29603 records). [2025-09-14T18:30:01.691312] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-14T18:30:01.691573] [INFO ] [MAIN ] Update Progress: 1065/2370 symbols completed. HUBS took 22.3s. Estimated remaining: 2h 18m 16s. Rate: 9.4 symbols/min [2025-09-14T18:30:01.933722] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:01.968031] [DEBUG] [LOCAL ] HUYA: Loaded 20272 existing records from primary storage. [2025-09-14T18:30:01.968283] [INFO ] [MAIN ] HUYA: Loaded 20272 existing records. [2025-09-14T18:30:02.167632] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-14T18:30:02.220006] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:02.220349] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-14T18:30:02.220421] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-14T18:30:02.221134] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-14T18:30:02.221225] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-14T18:30:02.611461] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:02.660900] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T18:30:02.958949] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-14T18:30:03.758961] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-14T18:30:05.174368] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-14T18:30:05.179448] [INFO ] [REMOTE ] HTH: Full fetch complete (36623 records). [2025-09-14T18:30:05.179581] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-14T18:30:05.553608] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-14T18:30:05.553765] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-14T18:30:05.554449] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-14T18:30:05.554509] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-14T18:30:05.555341] [DEBUG] [LOCAL ] HTH: Trimmed 36623 records to 25401 (keeping 150 days of data) [2025-09-14T18:30:05.718136] [DEBUG] [LOCAL ] HTH: Primary data saved (25401 records). [2025-09-14T18:30:05.718313] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-14T18:30:05.718446] [INFO ] [MAIN ] Update Progress: 1066/2370 symbols completed. HTH took 35.1s. Estimated remaining: 2h 18m 6s. Rate: 9.4 symbols/min [2025-09-14T18:30:05.887067] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:05.894538] [DEBUG] [LOCAL ] HVT: Loaded 6026 existing records from primary storage. [2025-09-14T18:30:05.894692] [INFO ] [MAIN ] HVT: Loaded 6026 existing records. [2025-09-14T18:30:06.075457] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:06.076198] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-14T18:30:06.076369] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-14T18:30:06.076777] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-14T18:30:06.076848] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-14T18:30:06.514630] [INFO ] [REMOTE ] HVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:06.515886] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-14T18:30:06.522955] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (5.16 seconds). [2025-09-14T18:30:06.535935] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-14T18:30:06.584068] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (3.63 seconds). [2025-09-14T18:30:06.597594] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-14T18:30:06.665585] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (2.91 seconds). [2025-09-14T18:30:06.958908] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-14T18:30:07.439794] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T18:30:07.758949] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-14T18:30:08.436023] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:30:08.510263] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T18:30:08.558800] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-14T18:30:08.574927] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:30:08.940155] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:30:09.358823] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-14T18:30:10.158822] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-14T18:30:10.518969] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T18:30:10.542867] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:30:10.958848] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-14T18:30:11.758838] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-14T18:30:11.848875] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T18:30:12.183135] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T18:30:12.558843] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-14T18:30:13.358870] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-14T18:30:13.650395] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T18:30:14.158861] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-14T18:30:14.509435] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:30:14.539501] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T18:30:14.958860] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-14T18:30:15.758840] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-14T18:30:16.558844] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-14T18:30:16.907067] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T18:30:17.103402] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-14T18:30:17.176305] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-14T18:30:17.283335] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:30:17.288755] [INFO ] [REMOTE ] HUM: Full fetch complete (53326 records). [2025-09-14T18:30:17.288914] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-14T18:30:17.363892] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-14T18:30:17.675363] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-14T18:30:17.675532] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-14T18:30:17.676732] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-14T18:30:17.676805] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-14T18:30:17.678629] [DEBUG] [LOCAL ] HUM: Trimmed 53326 records to 36925 (keeping 150 days of data) [2025-09-14T18:30:17.924937] [DEBUG] [LOCAL ] HUM: Primary data saved (36925 records). [2025-09-14T18:30:17.925123] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-14T18:30:17.925250] [INFO ] [MAIN ] Update Progress: 1067/2370 symbols completed. HUM took 26.4s. Estimated remaining: 2h 18m 7s. Rate: 9.4 symbols/min [2025-09-14T18:30:18.094848] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:18.125832] [DEBUG] [LOCAL ] HWM: Loaded 23667 existing records from primary storage. [2025-09-14T18:30:18.126050] [INFO ] [MAIN ] HWM: Loaded 23667 existing records. [2025-09-14T18:30:18.163988] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-14T18:30:18.318658] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:18.319015] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-14T18:30:18.319095] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-14T18:30:18.319950] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-14T18:30:18.320029] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-14T18:30:18.686878] [INFO ] [REMOTE ] HWM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:18.958855] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-14T18:30:19.269077] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T18:30:19.758877] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-14T18:30:19.857445] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:30:19.877244] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:30:20.558879] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-14T18:30:21.225191] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T18:30:21.231861] [INFO ] [REMOTE ] HUN: Full fetch complete (57822 records). [2025-09-14T18:30:21.231990] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-14T18:30:21.363975] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-14T18:30:21.649471] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-14T18:30:21.649620] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-14T18:30:21.650574] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-14T18:30:21.650696] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-14T18:30:21.652163] [DEBUG] [LOCAL ] HUN: Trimmed 57822 records to 40015 (keeping 150 days of data) [2025-09-14T18:30:21.927767] [DEBUG] [LOCAL ] HUN: Primary data saved (40015 records). [2025-09-14T18:30:21.927933] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-14T18:30:21.928045] [INFO ] [MAIN ] Update Progress: 1068/2370 symbols completed. HUN took 25.7s. Estimated remaining: 2h 17m 58s. Rate: 9.4 symbols/min [2025-09-14T18:30:22.097886] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:22.119681] [DEBUG] [LOCAL ] HXL: Loaded 20269 existing records from primary storage. [2025-09-14T18:30:22.119880] [INFO ] [MAIN ] HXL: Loaded 20269 existing records. [2025-09-14T18:30:22.164323] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-14T18:30:22.300863] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:22.301130] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-14T18:30:22.301194] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-14T18:30:22.301891] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-14T18:30:22.301958] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-14T18:30:22.656745] [INFO ] [REMOTE ] HXL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:22.688097] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-14T18:30:22.707954] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T18:30:22.709930] [INFO ] [REMOTE ] HVT: Full fetch complete (17993 records). [2025-09-14T18:30:22.710023] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-14T18:30:22.963945] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-14T18:30:23.074138] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-14T18:30:23.074268] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-14T18:30:23.074745] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-14T18:30:23.074802] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-14T18:30:23.075493] [DEBUG] [LOCAL ] HVT: Trimmed 17993 records to 11292 (keeping 150 days of data) [2025-09-14T18:30:23.145973] [DEBUG] [LOCAL ] HVT: Primary data saved (11292 records). [2025-09-14T18:30:23.146138] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-14T18:30:23.146241] [INFO ] [MAIN ] Update Progress: 1069/2370 symbols completed. HVT took 17.4s. Estimated remaining: 2h 17m 45s. Rate: 9.4 symbols/min [2025-09-14T18:30:23.324154] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:23.331060] [DEBUG] [LOCAL ] HY: Loaded 4391 existing records from primary storage. [2025-09-14T18:30:23.331198] [INFO ] [MAIN ] HY: Loaded 4391 existing records. [2025-09-14T18:30:23.511335] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:23.511749] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-14T18:30:23.511853] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-14T18:30:23.512276] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-14T18:30:23.512348] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-14T18:30:23.757726] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-14T18:30:23.768864] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-14T18:30:23.915607] [INFO ] [REMOTE ] HY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:24.309137] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T18:30:24.558853] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-14T18:30:25.358919] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-14T18:30:25.391500] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:30:25.563439] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T18:30:26.158860] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-14T18:30:26.958852] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-14T18:30:27.758800] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-14T18:30:27.861510] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-14T18:30:28.200271] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T18:30:28.558892] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-14T18:30:28.693114] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-14T18:30:29.035086] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T18:30:29.040114] [INFO ] [REMOTE ] HUYA: Full fetch complete (47990 records). [2025-09-14T18:30:29.040232] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-14T18:30:29.380332] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-14T18:30:29.430084] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-14T18:30:29.430940] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T18:30:29.431002] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-14T18:30:29.435261] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-14T18:30:29.435423] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-14T18:30:29.438193] [DEBUG] [LOCAL ] HUYA: Trimmed 47990 records to 32446 (keeping 150 days of data) [2025-09-14T18:30:29.636573] [DEBUG] [LOCAL ] HUYA: Primary data saved (32446 records). [2025-09-14T18:30:29.636778] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-14T18:30:29.636894] [INFO ] [MAIN ] Update Progress: 1070/2370 symbols completed. HUYA took 27.9s. Estimated remaining: 2h 17m 39s. Rate: 9.4 symbols/min [2025-09-14T18:30:29.810585] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:29.810867] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-14T18:30:29.810933] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-14T18:30:29.811054] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-14T18:30:29.811105] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-14T18:30:29.811156] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-14T18:30:29.811200] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-14T18:30:30.159325] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-14T18:30:30.162685] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:30.889413] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:30:30.958810] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-14T18:30:31.242692] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:30:31.758855] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-14T18:30:32.558821] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-14T18:30:32.606133] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T18:30:32.815183] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:30:33.054136] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T18:30:33.358833] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-14T18:30:33.724493] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-14T18:30:34.158834] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-14T18:30:34.958857] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-14T18:30:35.758850] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-14T18:30:35.792799] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:30:36.031894] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T18:30:36.558824] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-14T18:30:37.358843] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-14T18:30:37.516135] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T18:30:38.158880] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-14T18:30:38.300923] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T18:30:38.357464] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:30:38.958855] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-14T18:30:39.758816] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-14T18:30:39.788974] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T18:30:39.791042] [INFO ] [REMOTE ] HY: Full fetch complete (11415 records). [2025-09-14T18:30:39.791135] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-14T18:30:40.104634] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-14T18:30:40.118706] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T18:30:40.208426] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-14T18:30:40.208545] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-14T18:30:40.208907] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-14T18:30:40.208981] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-14T18:30:40.209531] [DEBUG] [LOCAL ] HY: Trimmed 11415 records to 7350 (keeping 150 days of data) [2025-09-14T18:30:40.256176] [DEBUG] [LOCAL ] HY: Primary data saved (7350 records). [2025-09-14T18:30:40.256368] [INFO ] [MAIN ] HY: Full history saved. [2025-09-14T18:30:40.256565] [INFO ] [MAIN ] Update Progress: 1071/2370 symbols completed. HY took 17.1s. Estimated remaining: 2h 17m 38s. Rate: 9.4 symbols/min [2025-09-14T18:30:40.425180] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:40.427257] [DEBUG] [LOCAL ] HYBX: Loaded 179 existing records from primary storage. [2025-09-14T18:30:40.427358] [INFO ] [MAIN ] HYBX: Loaded 179 existing records. [2025-09-14T18:30:40.566975] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-14T18:30:40.607606] [WARN ] [MAIN ] HYBX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:40.607886] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-14T18:30:40.607959] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-14T18:30:40.608147] [DEBUG] [LOCAL ] HYBX: Deleted primary data file. [2025-09-14T18:30:40.608213] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-14T18:30:40.960499] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:40.968043] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T18:30:41.358837] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-14T18:30:41.744020] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T18:30:42.158871] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-14T18:30:42.958890] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-14T18:30:43.273276] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-14T18:30:43.758918] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-14T18:30:44.108299] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-14T18:30:44.153771] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T18:30:44.558867] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-14T18:30:45.358857] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-14T18:30:45.800297] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T18:30:46.158882] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-14T18:30:46.616421] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T18:30:46.620943] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T18:30:46.958853] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-14T18:30:47.356923] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T18:30:47.758864] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-14T18:30:48.442984] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:30:48.448585] [INFO ] [REMOTE ] HWM: Full fetch complete (57677 records). [2025-09-14T18:30:48.448777] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-14T18:30:48.564134] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-14T18:30:48.843156] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-14T18:30:48.843281] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-14T18:30:48.844139] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-14T18:30:48.844204] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-14T18:30:48.845670] [DEBUG] [LOCAL ] HWM: Trimmed 57677 records to 39910 (keeping 150 days of data) [2025-09-14T18:30:49.134622] [DEBUG] [LOCAL ] HWM: Primary data saved (39910 records). [2025-09-14T18:30:49.134903] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-14T18:30:49.135041] [INFO ] [MAIN ] Update Progress: 1072/2370 symbols completed. HWM took 31.2s. Estimated remaining: 2h 17m 35s. Rate: 9.4 symbols/min [2025-09-14T18:30:49.320938] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:49.328675] [DEBUG] [LOCAL ] HYI: Loaded 3888 existing records from primary storage. [2025-09-14T18:30:49.328910] [INFO ] [MAIN ] HYI: Loaded 3888 existing records. [2025-09-14T18:30:49.364020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-14T18:30:49.533971] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:49.534335] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-14T18:30:49.534402] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-14T18:30:49.534965] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-14T18:30:49.535114] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-14T18:30:49.707813] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-14T18:30:49.945847] [INFO ] [REMOTE ] HYI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:50.158889] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-14T18:30:50.353726] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T18:30:50.372867] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-14T18:30:50.373500] [INFO ] [REMOTE ] HYAC: Full fetch complete (664 records). [2025-09-14T18:30:50.373592] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-14T18:30:50.374039] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T18:30:50.374113] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:30:50.374167] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:30:50.374222] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-14T18:30:50.374304] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-14T18:30:50.374353] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-14T18:30:50.374436] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-14T18:30:50.374518] [INFO ] [MAIN ] Update Progress: 1073/2370 symbols completed. HYAC took 20.7s. Estimated remaining: 2h 17m 22s. Rate: 9.4 symbols/min [2025-09-14T18:30:50.542899] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:50.558817] [DEBUG] [LOCAL ] HYT: Loaded 14904 existing records from primary storage. [2025-09-14T18:30:50.558969] [INFO ] [MAIN ] HYT: Loaded 14904 existing records. [2025-09-14T18:30:50.734866] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:50.735108] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-14T18:30:50.735166] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-14T18:30:50.735768] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-14T18:30:50.735832] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-14T18:30:50.964047] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-14T18:30:51.090118] [INFO ] [REMOTE ] HYT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:51.758905] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-14T18:30:51.891308] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T18:30:52.558854] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-14T18:30:53.330612] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:30:53.358785] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-14T18:30:53.939103] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T18:30:54.065249] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:30:54.071991] [INFO ] [REMOTE ] HXL: Full fetch complete (50125 records). [2025-09-14T18:30:54.072187] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-14T18:30:54.163992] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-14T18:30:54.475482] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-14T18:30:54.475679] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-14T18:30:54.476608] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-14T18:30:54.476706] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-14T18:30:54.478074] [DEBUG] [LOCAL ] HXL: Trimmed 50125 records to 34690 (keeping 150 days of data) [2025-09-14T18:30:54.602004] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T18:30:54.713583] [DEBUG] [LOCAL ] HXL: Primary data saved (34690 records). [2025-09-14T18:30:54.713829] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-14T18:30:54.713957] [INFO ] [MAIN ] Update Progress: 1074/2370 symbols completed. HXL took 32.8s. Estimated remaining: 2h 17m 13s. Rate: 9.4 symbols/min [2025-09-14T18:30:54.889041] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:54.892149] [DEBUG] [LOCAL ] HYTR: Loaded 1200 existing records from primary storage. [2025-09-14T18:30:54.892260] [INFO ] [MAIN ] HYTR: Loaded 1200 existing records. [2025-09-14T18:30:54.964091] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-14T18:30:55.083347] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:55.083716] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-14T18:30:55.083787] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-14T18:30:55.084096] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-14T18:30:55.084159] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-14T18:30:55.515018] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T18:30:55.519298] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:55.758861] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-14T18:30:56.558895] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-14T18:30:56.580609] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:30:56.968453] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-14T18:30:57.358838] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-14T18:30:57.684145] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:30:57.684967] [INFO ] [REMOTE ] HYBX: Full fetch complete (488 records). [2025-09-14T18:30:57.685067] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-14T18:30:57.884679] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 134 unique days, need 150 days [2025-09-14T18:30:57.884898] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:30:57.884952] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:30:57.885000] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-14T18:30:57.885080] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-14T18:30:57.885129] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-14T18:30:57.885192] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-14T18:30:57.885269] [INFO ] [MAIN ] Update Progress: 1075/2370 symbols completed. HYBX took 17.6s. Estimated remaining: 2h 17m 3s. Rate: 9.4 symbols/min [2025-09-14T18:30:58.059477] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:58.072272] [DEBUG] [LOCAL ] HZO: Loaded 12182 existing records from primary storage. [2025-09-14T18:30:58.072412] [INFO ] [MAIN ] HZO: Loaded 12182 existing records. [2025-09-14T18:30:58.163915] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-14T18:30:58.260278] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:58.260612] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-14T18:30:58.260723] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-14T18:30:58.261228] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-14T18:30:58.261291] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-14T18:30:58.622734] [INFO ] [REMOTE ] HZO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:58.958821] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-14T18:30:59.099100] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T18:30:59.758848] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-14T18:31:00.479247] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:31:00.558883] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-14T18:31:00.808621] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:31:01.203373] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-14T18:31:01.358881] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-14T18:31:02.158847] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-14T18:31:02.393771] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:31:02.785470] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:31:02.958847] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-14T18:31:03.655338] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T18:31:03.758820] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-14T18:31:04.209002] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T18:31:04.558863] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-14T18:31:05.358843] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-14T18:31:06.035948] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:31:06.158876] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-14T18:31:06.221165] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:31:06.958860] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-14T18:31:07.707022] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-14T18:31:07.737904] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:31:07.758796] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-14T18:31:08.393989] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T18:31:08.558840] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-14T18:31:09.358832] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-14T18:31:09.388299] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:31:10.158835] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-14T18:31:10.777347] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:31:10.958854] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-14T18:31:11.122306] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:31:11.758832] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-14T18:31:12.261671] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:31:12.558821] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-14T18:31:12.630776] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T18:31:13.028537] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:31:13.029439] [INFO ] [REMOTE ] HYTR: Full fetch complete (3467 records). [2025-09-14T18:31:13.029524] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-14T18:31:13.364037] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-14T18:31:13.388594] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-14T18:31:13.388699] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-14T18:31:13.388841] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-14T18:31:13.388918] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-14T18:31:13.389309] [DEBUG] [LOCAL ] HYTR: Trimmed 3467 records to 2256 (keeping 150 days of data) [2025-09-14T18:31:13.404237] [DEBUG] [LOCAL ] HYTR: Primary data saved (2256 records). [2025-09-14T18:31:13.404338] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-14T18:31:13.404428] [INFO ] [MAIN ] Update Progress: 1076/2370 symbols completed. HYTR took 18.7s. Estimated remaining: 2h 17m 8s. Rate: 9.4 symbols/min [2025-09-14T18:31:13.579934] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:13.584767] [DEBUG] [LOCAL ] IAE: Loaded 2522 existing records from primary storage. [2025-09-14T18:31:13.584878] [INFO ] [MAIN ] IAE: Loaded 2522 existing records. [2025-09-14T18:31:13.760398] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:13.760691] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-14T18:31:13.760754] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-14T18:31:13.761051] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-14T18:31:13.761126] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-14T18:31:14.110634] [INFO ] [REMOTE ] IAE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:14.158824] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-14T18:31:14.768847] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T18:31:14.904198] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:31:14.958845] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-14T18:31:15.593976] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:31:15.595341] [INFO ] [REMOTE ] HYI: Full fetch complete (9778 records). [2025-09-14T18:31:15.595426] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-14T18:31:15.762501] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-14T18:31:15.959600] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-14T18:31:15.959734] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-14T18:31:15.960000] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-14T18:31:15.960052] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-14T18:31:15.960609] [DEBUG] [LOCAL ] HYI: Trimmed 9778 records to 6514 (keeping 150 days of data) [2025-09-14T18:31:16.008078] [DEBUG] [LOCAL ] HYI: Primary data saved (6514 records). [2025-09-14T18:31:16.008519] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-14T18:31:16.008634] [INFO ] [MAIN ] Update Progress: 1077/2370 symbols completed. HYI took 26.9s. Estimated remaining: 2h 16m 57s. Rate: 9.4 symbols/min [2025-09-14T18:31:16.558938] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-14T18:31:17.086174] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T18:31:17.358864] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-14T18:31:17.383914] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:31:18.158829] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-14T18:31:18.766495] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:31:18.958837] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-14T18:31:19.178493] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T18:31:19.599929] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T18:31:19.758841] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-14T18:31:20.558845] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-14T18:31:21.287510] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:31:21.312730] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:31:21.358821] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-14T18:31:21.867324] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T18:31:22.158832] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-14T18:31:22.958881] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-14T18:31:23.714600] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:31:23.758792] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-14T18:31:24.331102] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:31:24.558834] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-14T18:31:25.121909] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T18:31:25.125567] [INFO ] [REMOTE ] HYT: Full fetch complete (36040 records). [2025-09-14T18:31:25.125710] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-14T18:31:25.359111] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-14T18:31:25.435663] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:31:25.525025] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-14T18:31:25.525142] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-14T18:31:25.525988] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-14T18:31:25.526071] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-14T18:31:25.527241] [DEBUG] [LOCAL ] HYT: Trimmed 36040 records to 24744 (keeping 150 days of data) [2025-09-14T18:31:25.677015] [DEBUG] [LOCAL ] HYT: Primary data saved (24744 records). [2025-09-14T18:31:25.677215] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-14T18:31:25.677353] [INFO ] [MAIN ] Update Progress: 1078/2370 symbols completed. HYT took 35.3s. Estimated remaining: 2h 16m 55s. Rate: 9.4 symbols/min [2025-09-14T18:31:26.012267] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:31:26.016187] [INFO ] [REMOTE ] HZO: Full fetch complete (31482 records). [2025-09-14T18:31:26.016732] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-14T18:31:26.173754] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-14T18:31:26.413170] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-14T18:31:26.413286] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-14T18:31:26.413958] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-14T18:31:26.414017] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-14T18:31:26.414845] [DEBUG] [LOCAL ] HZO: Trimmed 31482 records to 21209 (keeping 150 days of data) [2025-09-14T18:31:26.552655] [DEBUG] [LOCAL ] HZO: Primary data saved (21209 records). [2025-09-14T18:31:26.552822] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-14T18:31:26.552973] [INFO ] [MAIN ] Update Progress: 1079/2370 symbols completed. HZO took 28.7s. Estimated remaining: 2h 16m 42s. Rate: 9.4 symbols/min [2025-09-14T18:31:27.002593] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T18:31:27.004526] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-14T18:31:27.585565] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:31:27.586764] [INFO ] [REMOTE ] IAE: Full fetch complete (6290 records). [2025-09-14T18:31:27.586848] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-14T18:31:27.937821] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-14T18:31:27.937943] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-14T18:31:27.938134] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-14T18:31:27.938187] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-14T18:31:27.938610] [DEBUG] [LOCAL ] IAE: Trimmed 6290 records to 4197 (keeping 150 days of data) [2025-09-14T18:31:27.963243] [DEBUG] [LOCAL ] IAE: Primary data saved (4197 records). [2025-09-14T18:31:27.963350] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-14T18:31:27.963445] [INFO ] [MAIN ] Update Progress: 1080/2370 symbols completed. IAE took 14.6s. Estimated remaining: 2h 16m 29s. Rate: 9.5 symbols/min [2025-09-14T18:31:28.574112] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:28.663054] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:28.664160] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:28.661713] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:28.700328] [DEBUG] [LOCAL ] IBP: Loaded 13686 existing records from primary storage. [2025-09-14T18:31:28.700673] [INFO ] [MAIN ] IBP: Loaded 13686 existing records. [2025-09-14T18:31:28.807302] [DEBUG] [LOCAL ] IBM: Loaded 24106 existing records from primary storage. [2025-09-14T18:31:28.812512] [DEBUG] [LOCAL ] IBN: Loaded 23597 existing records from primary storage. [2025-09-14T18:31:28.826556] [INFO ] [MAIN ] IBM: Loaded 24106 existing records. [2025-09-14T18:31:28.827086] [DEBUG] [LOCAL ] IAG: Loaded 23936 existing records from primary storage. [2025-09-14T18:31:28.859006] [INFO ] [MAIN ] IBN: Loaded 23597 existing records. [2025-09-14T18:31:28.897140] [INFO ] [MAIN ] IAG: Loaded 23936 existing records. [2025-09-14T18:31:29.051451] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:29.188232] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-14T18:31:29.253020] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-14T18:31:29.311138] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:29.358463] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-14T18:31:29.369133] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-14T18:31:29.391270] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-14T18:31:29.391469] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:29.401889] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-14T18:31:29.412583] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-14T18:31:29.417780] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-14T18:31:29.417948] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-14T18:31:29.443682] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-14T18:31:29.545002] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-14T18:31:29.587067] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-14T18:31:29.571532] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:29.663630] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-14T18:31:29.749555] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-14T18:31:29.791257] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-14T18:31:29.910095] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-14T18:31:30.668444] [INFO ] [REMOTE ] IBM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:30.734270] [INFO ] [REMOTE ] IBP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:30.774031] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-14T18:31:30.802315] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-14T18:31:31.075913] [INFO ] [REMOTE ] IBN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:31.086214] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-14T18:31:31.216183] [INFO ] [REMOTE ] IAG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:31.216892] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-14T18:31:31.914987] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:31:31.925621] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-14T18:31:32.084191] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T18:31:32.094844] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-14T18:31:32.367790] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T18:31:32.558793] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-14T18:31:32.613971] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T18:31:32.659034] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-14T18:31:32.718121] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T18:31:33.358837] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-14T18:31:33.722313] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T18:31:34.158822] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-14T18:31:34.298504] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T18:31:34.958824] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-14T18:31:35.758834] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-14T18:31:36.041812] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:31:36.370982] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:31:36.558819] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-14T18:31:36.682816] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T18:31:37.358820] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-14T18:31:37.868963] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T18:31:38.158886] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-14T18:31:38.958826] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-14T18:31:39.165074] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:31:39.257519] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T18:31:39.473366] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T18:31:39.758828] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-14T18:31:40.558876] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-14T18:31:40.682832] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T18:31:41.358865] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-14T18:31:41.772148] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:31:42.158936] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-14T18:31:42.958944] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-14T18:31:43.081216] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T18:31:43.667711] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T18:31:43.758804] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-14T18:31:43.910918] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T18:31:44.558838] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-14T18:31:45.358834] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-14T18:31:45.543997] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:31:45.585257] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T18:31:46.158881] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-14T18:31:46.440864] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:31:46.958830] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-14T18:31:47.529203] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:31:47.532512] [INFO ] [REMOTE ] IBP: Full fetch complete (32195 records). [2025-09-14T18:31:47.532610] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-14T18:31:47.764005] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-14T18:31:47.921997] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-14T18:31:47.922124] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-14T18:31:47.922929] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-14T18:31:47.923162] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-14T18:31:47.924485] [DEBUG] [LOCAL ] IBP: Trimmed 32195 records to 21904 (keeping 150 days of data) [2025-09-14T18:31:48.056031] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T18:31:48.119424] [DEBUG] [LOCAL ] IBP: Primary data saved (21904 records). [2025-09-14T18:31:48.119594] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-14T18:31:48.119793] [INFO ] [MAIN ] Update Progress: 1081/2370 symbols completed. IBP took 20.2s. Estimated remaining: 2h 16m 40s. Rate: 9.4 symbols/min [2025-09-14T18:31:48.289378] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:48.305102] [DEBUG] [LOCAL ] IBTA: Loaded 15677 existing records from primary storage. [2025-09-14T18:31:48.305244] [INFO ] [MAIN ] IBTA: Loaded 15677 existing records. [2025-09-14T18:31:48.484084] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:48.484396] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-14T18:31:48.484464] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-14T18:31:48.484908] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-14T18:31:48.484969] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-14T18:31:48.563979] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-14T18:31:48.838207] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:48.869814] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T18:31:49.358827] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-14T18:31:50.003792] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:31:50.009572] [INFO ] [REMOTE ] IBN: Full fetch complete (57546 records). [2025-09-14T18:31:50.009754] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-14T18:31:50.165054] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-14T18:31:50.415956] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-14T18:31:50.416080] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-14T18:31:50.416929] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-14T18:31:50.416988] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-14T18:31:50.418243] [DEBUG] [LOCAL ] IBN: Trimmed 57546 records to 39792 (keeping 150 days of data) [2025-09-14T18:31:50.676755] [DEBUG] [LOCAL ] IBN: Primary data saved (39792 records). [2025-09-14T18:31:50.677001] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-14T18:31:50.677272] [INFO ] [MAIN ] Update Progress: 1082/2370 symbols completed. IBN took 22.7s. Estimated remaining: 2h 16m 29s. Rate: 9.4 symbols/min [2025-09-14T18:31:50.912311] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-14T18:31:50.915461] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:50.960608] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-14T18:31:50.971886] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T18:31:50.993569] [DEBUG] [LOCAL ] ICE: Loaded 23621 existing records from primary storage. [2025-09-14T18:31:50.993766] [INFO ] [MAIN ] ICE: Loaded 23621 existing records. [2025-09-14T18:31:51.197182] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:51.197478] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-14T18:31:51.197541] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-14T18:31:51.198217] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-14T18:31:51.198288] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-14T18:31:51.642601] [INFO ] [REMOTE ] ICE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:51.758855] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-14T18:31:52.222557] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T18:31:52.558835] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-14T18:31:52.672029] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:31:53.358845] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-14T18:31:54.158885] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-14T18:31:54.465047] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:31:54.958953] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-14T18:31:55.056453] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T18:31:55.062349] [INFO ] [REMOTE ] IAG: Full fetch complete (58098 records). [2025-09-14T18:31:55.062511] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-14T18:31:55.490672] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T18:31:55.505557] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-14T18:31:55.506659] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-14T18:31:55.507962] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-14T18:31:55.508044] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-14T18:31:55.510405] [DEBUG] [LOCAL ] IAG: Trimmed 58098 records to 40237 (keeping 150 days of data) [2025-09-14T18:31:55.758971] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-14T18:31:55.772164] [DEBUG] [LOCAL ] IAG: Primary data saved (40237 records). [2025-09-14T18:31:55.772266] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-14T18:31:55.772386] [INFO ] [MAIN ] Update Progress: 1083/2370 symbols completed. IAG took 27.8s. Estimated remaining: 2h 16m 21s. Rate: 9.4 symbols/min [2025-09-14T18:31:55.944574] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:55.962199] [DEBUG] [LOCAL ] ICL: Loaded 16509 existing records from primary storage. [2025-09-14T18:31:55.962379] [INFO ] [MAIN ] ICL: Loaded 16509 existing records. [2025-09-14T18:31:56.138073] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:56.138389] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-14T18:31:56.138474] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-14T18:31:56.139082] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-14T18:31:56.139171] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-14T18:31:56.496043] [INFO ] [REMOTE ] ICL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:56.558776] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-14T18:31:56.729077] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:31:56.769256] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:31:57.358905] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-14T18:31:58.112215] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:31:58.158799] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-14T18:31:58.857728] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:31:58.958814] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-14T18:31:59.106669] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T18:31:59.758849] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-14T18:32:00.140899] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T18:32:00.558812] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-14T18:32:00.687254] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T18:32:01.358834] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-14T18:32:01.469702] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T18:32:01.476666] [INFO ] [REMOTE ] IBM: Full fetch complete (58282 records). [2025-09-14T18:32:01.476816] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-14T18:32:01.869476] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-14T18:32:01.869602] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-14T18:32:01.870579] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-14T18:32:01.870715] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-14T18:32:01.872580] [DEBUG] [LOCAL ] IBM: Trimmed 58282 records to 40393 (keeping 150 days of data) [2025-09-14T18:32:02.159002] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-14T18:32:02.180905] [DEBUG] [LOCAL ] IBM: Primary data saved (40393 records). [2025-09-14T18:32:02.181072] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-14T18:32:02.181224] [INFO ] [MAIN ] Update Progress: 1084/2370 symbols completed. IBM took 34.2s. Estimated remaining: 2h 16m 15s. Rate: 9.4 symbols/min [2025-09-14T18:32:02.361498] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:02.378240] [DEBUG] [LOCAL ] IDA: Loaded 14416 existing records from primary storage. [2025-09-14T18:32:02.378388] [INFO ] [MAIN ] IDA: Loaded 14416 existing records. [2025-09-14T18:32:02.554300] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:02.554582] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-14T18:32:02.554666] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-14T18:32:02.555218] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-14T18:32:02.555292] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-14T18:32:02.915118] [INFO ] [REMOTE ] IDA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:02.935893] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T18:32:02.958814] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-14T18:32:03.763996] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-14T18:32:03.784008] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:32:04.558823] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-14T18:32:04.599746] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:32:04.637619] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:32:05.358881] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-14T18:32:05.684058] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T18:32:06.158887] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-14T18:32:06.299370] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T18:32:06.958837] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-14T18:32:07.758812] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-14T18:32:07.881537] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T18:32:08.140524] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:32:08.558827] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-14T18:32:09.169486] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T18:32:09.174531] [INFO ] [REMOTE ] IBTA: Full fetch complete (40299 records). [2025-09-14T18:32:09.174667] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-14T18:32:09.375439] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-14T18:32:09.579263] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-14T18:32:09.579385] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-14T18:32:09.580515] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-14T18:32:09.580580] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-14T18:32:09.582694] [DEBUG] [LOCAL ] IBTA: Trimmed 40299 records to 26676 (keeping 150 days of data) [2025-09-14T18:32:09.750803] [DEBUG] [LOCAL ] IBTA: Primary data saved (26676 records). [2025-09-14T18:32:09.750996] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-14T18:32:09.751156] [INFO ] [MAIN ] Update Progress: 1085/2370 symbols completed. IBTA took 21.6s. Estimated remaining: 2h 16m 10s. Rate: 9.4 symbols/min [2025-09-14T18:32:09.931070] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:09.937830] [DEBUG] [LOCAL ] IDE: Loaded 4198 existing records from primary storage. [2025-09-14T18:32:09.937966] [INFO ] [MAIN ] IDE: Loaded 4198 existing records. [2025-09-14T18:32:10.116359] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:10.116887] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-14T18:32:10.116975] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-14T18:32:10.117236] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-14T18:32:10.117408] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-14T18:32:10.162286] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-14T18:32:10.389577] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T18:32:10.538575] [INFO ] [REMOTE ] IDE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:10.572967] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T18:32:10.958921] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-14T18:32:11.746709] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T18:32:11.764463] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-14T18:32:11.773544] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T18:32:12.535324] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:32:12.542003] [INFO ] [REMOTE ] ICE: Full fetch complete (57648 records). [2025-09-14T18:32:12.542216] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-14T18:32:12.564675] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-14T18:32:12.944205] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-14T18:32:12.944331] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-14T18:32:12.945297] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-14T18:32:12.945391] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-14T18:32:12.946824] [DEBUG] [LOCAL ] ICE: Trimmed 57648 records to 39805 (keeping 150 days of data) [2025-09-14T18:32:13.215981] [DEBUG] [LOCAL ] ICE: Primary data saved (39805 records). [2025-09-14T18:32:13.216187] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-14T18:32:13.216308] [INFO ] [MAIN ] Update Progress: 1086/2370 symbols completed. ICE took 22.5s. Estimated remaining: 2h 15m 60s. Rate: 9.4 symbols/min [2025-09-14T18:32:13.363978] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-14T18:32:13.387236] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:13.397750] [DEBUG] [LOCAL ] IDT: Loaded 7768 existing records from primary storage. [2025-09-14T18:32:13.397908] [INFO ] [MAIN ] IDT: Loaded 7768 existing records. [2025-09-14T18:32:13.573793] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:13.574023] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-14T18:32:13.574083] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-14T18:32:13.574494] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-14T18:32:13.574554] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-14T18:32:13.925111] [INFO ] [REMOTE ] IDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:14.158806] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-14T18:32:14.190267] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T18:32:14.968063] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-14T18:32:14.972671] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T18:32:15.038693] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T18:32:15.691017] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-14T18:32:15.758879] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-14T18:32:16.558838] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-14T18:32:17.292889] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:32:17.358789] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-14T18:32:18.119664] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T18:32:18.158802] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-14T18:32:18.885081] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T18:32:18.958838] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-14T18:32:19.765415] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-14T18:32:19.768264] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:32:20.100788] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:32:20.558890] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-14T18:32:20.838965] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T18:32:20.843236] [INFO ] [REMOTE ] ICL: Full fetch complete (42402 records). [2025-09-14T18:32:20.843349] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-14T18:32:21.214886] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-14T18:32:21.214992] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-14T18:32:21.215773] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-14T18:32:21.215837] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-14T18:32:21.216860] [DEBUG] [LOCAL ] ICL: Trimmed 42402 records to 28754 (keeping 150 days of data) [2025-09-14T18:32:21.378061] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-14T18:32:21.410630] [DEBUG] [LOCAL ] ICL: Primary data saved (28754 records). [2025-09-14T18:32:21.410798] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-14T18:32:21.410940] [INFO ] [MAIN ] Update Progress: 1087/2370 symbols completed. ICL took 25.6s. Estimated remaining: 2h 15m 56s. Rate: 9.4 symbols/min [2025-09-14T18:32:21.558567] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:32:21.590411] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:21.612121] [DEBUG] [LOCAL ] IEX: Loaded 17334 existing records from primary storage. [2025-09-14T18:32:21.612312] [INFO ] [MAIN ] IEX: Loaded 17334 existing records. [2025-09-14T18:32:21.799527] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:21.799822] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-14T18:32:21.799886] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-14T18:32:21.800514] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-14T18:32:21.800581] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-14T18:32:22.152543] [INFO ] [REMOTE ] IEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:22.158843] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-14T18:32:22.783518] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T18:32:22.958879] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-14T18:32:23.245286] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:32:23.758914] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-14T18:32:23.828683] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:32:24.558861] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-14T18:32:25.106487] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T18:32:25.358842] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-14T18:32:25.395371] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:32:25.683536] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T18:32:25.686835] [INFO ] [REMOTE ] IDA: Full fetch complete (34446 records). [2025-09-14T18:32:25.686979] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-14T18:32:26.063826] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-14T18:32:26.063938] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-14T18:32:26.064601] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-14T18:32:26.064672] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-14T18:32:26.065733] [DEBUG] [LOCAL ] IDA: Trimmed 34446 records to 25071 (keeping 150 days of data) [2025-09-14T18:32:26.161037] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-14T18:32:26.239899] [DEBUG] [LOCAL ] IDA: Primary data saved (25071 records). [2025-09-14T18:32:26.240067] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-14T18:32:26.240169] [INFO ] [MAIN ] Update Progress: 1088/2370 symbols completed. IDA took 24.1s. Estimated remaining: 2h 15m 47s. Rate: 9.4 symbols/min [2025-09-14T18:32:26.413405] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:26.436728] [DEBUG] [LOCAL ] IFF: Loaded 22945 existing records from primary storage. [2025-09-14T18:32:26.436926] [INFO ] [MAIN ] IFF: Loaded 22945 existing records. [2025-09-14T18:32:26.620230] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:26.620506] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-14T18:32:26.620570] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-14T18:32:26.621167] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-14T18:32:26.621232] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-14T18:32:26.962130] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-14T18:32:26.985955] [INFO ] [REMOTE ] IFF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:27.758845] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-14T18:32:27.853354] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:32:27.862920] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T18:32:28.558880] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-14T18:32:29.358837] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-14T18:32:29.477034] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:32:29.507547] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:32:30.158849] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-14T18:32:30.874924] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:32:30.876427] [INFO ] [REMOTE ] IDE: Full fetch complete (8961 records). [2025-09-14T18:32:30.876519] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-14T18:32:30.963943] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-14T18:32:31.249068] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-14T18:32:31.249336] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-14T18:32:31.249680] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-14T18:32:31.249737] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-14T18:32:31.250314] [DEBUG] [LOCAL ] IDE: Trimmed 8961 records to 6576 (keeping 150 days of data) [2025-09-14T18:32:31.306553] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:32:31.327862] [DEBUG] [LOCAL ] IDE: Primary data saved (6576 records). [2025-09-14T18:32:31.328000] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-14T18:32:31.328093] [INFO ] [MAIN ] Update Progress: 1089/2370 symbols completed. IDE took 21.6s. Estimated remaining: 2h 15m 40s. Rate: 9.4 symbols/min [2025-09-14T18:32:31.506192] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:31.515870] [DEBUG] [LOCAL ] IFN: Loaded 8347 existing records from primary storage. [2025-09-14T18:32:31.516005] [INFO ] [MAIN ] IFN: Loaded 8347 existing records. [2025-09-14T18:32:31.697869] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:31.698171] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-14T18:32:31.698234] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-14T18:32:31.698690] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-14T18:32:31.698757] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-14T18:32:31.764241] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-14T18:32:32.084004] [INFO ] [REMOTE ] IFN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:32.558846] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-14T18:32:32.675089] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:32:32.835268] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:32:33.358838] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-14T18:32:33.661634] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:32:34.158854] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-14T18:32:34.542329] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T18:32:34.964731] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-14T18:32:34.966609] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T18:32:35.758871] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-14T18:32:36.558826] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-14T18:32:36.850702] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:32:36.874917] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:32:37.358844] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-14T18:32:37.769718] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T18:32:38.158827] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-14T18:32:38.171016] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T18:32:38.958834] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-14T18:32:39.714028] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:32:39.716408] [INFO ] [REMOTE ] IDT: Full fetch complete (18012 records). [2025-09-14T18:32:39.716542] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-14T18:32:39.763902] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-14T18:32:40.099525] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-14T18:32:40.099808] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-14T18:32:40.100298] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-14T18:32:40.100440] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-14T18:32:40.101521] [DEBUG] [LOCAL ] IDT: Trimmed 18012 records to 13144 (keeping 150 days of data) [2025-09-14T18:32:40.190824] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-14T18:32:40.219693] [DEBUG] [LOCAL ] IDT: Primary data saved (13144 records). [2025-09-14T18:32:40.219879] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-14T18:32:40.219991] [INFO ] [MAIN ] Update Progress: 1090/2370 symbols completed. IDT took 27.0s. Estimated remaining: 2h 15m 36s. Rate: 9.4 symbols/min [2025-09-14T18:32:40.391041] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:40.401573] [DEBUG] [LOCAL ] IFS: Loaded 9357 existing records from primary storage. [2025-09-14T18:32:40.401737] [INFO ] [MAIN ] IFS: Loaded 9357 existing records. [2025-09-14T18:32:40.563440] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-14T18:32:40.586735] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:40.587793] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-14T18:32:40.587857] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-14T18:32:40.588200] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-14T18:32:40.588260] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-14T18:32:40.886141] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:32:40.969258] [INFO ] [REMOTE ] IFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:41.358895] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-14T18:32:42.158833] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-14T18:32:42.212596] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T18:32:42.240065] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T18:32:42.958812] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-14T18:32:43.066029] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:32:43.758836] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-14T18:32:44.200416] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T18:32:44.558905] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-14T18:32:44.978870] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T18:32:45.358882] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-14T18:32:45.831531] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T18:32:46.158841] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-14T18:32:46.657065] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T18:32:46.958875] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-14T18:32:47.139774] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T18:32:47.758891] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-14T18:32:48.558882] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-14T18:32:48.744267] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:32:49.111882] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:32:49.358879] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-14T18:32:49.384433] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:32:50.158857] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-14T18:32:50.353830] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:32:50.355965] [INFO ] [REMOTE ] IFN: Full fetch complete (20539 records). [2025-09-14T18:32:50.356056] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-14T18:32:50.733623] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-14T18:32:50.733864] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-14T18:32:50.734418] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-14T18:32:50.734480] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-14T18:32:50.735503] [DEBUG] [LOCAL ] IFN: Trimmed 20539 records to 13786 (keeping 150 days of data) [2025-09-14T18:32:50.824185] [DEBUG] [LOCAL ] IFN: Primary data saved (13786 records). [2025-09-14T18:32:50.824369] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-14T18:32:50.824474] [INFO ] [MAIN ] Update Progress: 1091/2370 symbols completed. IFN took 19.5s. Estimated remaining: 2h 15m 35s. Rate: 9.4 symbols/min [2025-09-14T18:32:50.966766] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-14T18:32:51.000469] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:51.007146] [DEBUG] [LOCAL ] IGA: Loaded 4546 existing records from primary storage. [2025-09-14T18:32:51.007294] [INFO ] [MAIN ] IGA: Loaded 4546 existing records. [2025-09-14T18:32:51.187213] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:51.187500] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-14T18:32:51.187582] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-14T18:32:51.188037] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-14T18:32:51.188104] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-14T18:32:51.544462] [INFO ] [REMOTE ] IGA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:51.706365] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:32:51.758803] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-14T18:32:52.198848] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T18:32:52.558846] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-14T18:32:53.284722] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T18:32:53.358863] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-14T18:32:53.677365] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T18:32:54.162225] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-14T18:32:54.163228] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T18:32:54.958812] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-14T18:32:55.281100] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:32:55.758889] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-14T18:32:55.986056] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T18:32:56.558842] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-14T18:32:56.894815] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T18:32:56.900046] [INFO ] [REMOTE ] IEX: Full fetch complete (41274 records). [2025-09-14T18:32:56.900342] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-14T18:32:57.286296] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-14T18:32:57.286485] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-14T18:32:57.287391] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-14T18:32:57.287487] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-14T18:32:57.289225] [DEBUG] [LOCAL ] IEX: Trimmed 41274 records to 28982 (keeping 150 days of data) [2025-09-14T18:32:57.381891] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-14T18:32:57.448601] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T18:32:57.525979] [DEBUG] [LOCAL ] IEX: Primary data saved (28982 records). [2025-09-14T18:32:57.526204] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-14T18:32:57.526371] [INFO ] [MAIN ] Update Progress: 1092/2370 symbols completed. IEX took 36.1s. Estimated remaining: 2h 15m 29s. Rate: 9.4 symbols/min [2025-09-14T18:32:57.702557] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:57.713726] [DEBUG] [LOCAL ] IGD: Loaded 8924 existing records from primary storage. [2025-09-14T18:32:57.713893] [INFO ] [MAIN ] IGD: Loaded 8924 existing records. [2025-09-14T18:32:57.911893] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:57.912292] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-14T18:32:57.912365] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-14T18:32:57.912838] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-14T18:32:57.912903] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-14T18:32:58.166169] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-14T18:32:58.293453] [INFO ] [REMOTE ] IGD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:58.539449] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:32:58.928146] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:32:58.934058] [INFO ] [REMOTE ] IFF: Full fetch complete (55300 records). [2025-09-14T18:32:58.934306] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-14T18:32:58.965668] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-14T18:32:59.330051] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-14T18:32:59.330346] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-14T18:32:59.331410] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-14T18:32:59.331484] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-14T18:32:59.333030] [DEBUG] [LOCAL ] IFF: Trimmed 55300 records to 38270 (keeping 150 days of data) [2025-09-14T18:32:59.590674] [DEBUG] [LOCAL ] IFF: Primary data saved (38270 records). [2025-09-14T18:32:59.590862] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-14T18:32:59.590985] [INFO ] [MAIN ] Update Progress: 1093/2370 symbols completed. IFF took 33.4s. Estimated remaining: 2h 15m 18s. Rate: 9.4 symbols/min [2025-09-14T18:32:59.763940] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-14T18:32:59.765776] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:59.771918] [DEBUG] [LOCAL ] IGI: Loaded 2169 existing records from primary storage. [2025-09-14T18:32:59.772227] [INFO ] [MAIN ] IGI: Loaded 2169 existing records. [2025-09-14T18:32:59.961068] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:59.961367] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-14T18:32:59.961503] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-14T18:32:59.961893] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-14T18:32:59.961967] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-14T18:33:00.350355] [INFO ] [REMOTE ] IGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:00.351828] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T18:33:00.558844] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-14T18:33:00.709664] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T18:33:00.712724] [INFO ] [REMOTE ] IFS: Full fetch complete (25152 records). [2025-09-14T18:33:00.712856] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-14T18:33:01.094787] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-14T18:33:01.094980] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-14T18:33:01.096280] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-14T18:33:01.096350] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-14T18:33:01.097433] [DEBUG] [LOCAL ] IFS: Trimmed 25152 records to 16626 (keeping 150 days of data) [2025-09-14T18:33:01.198390] [DEBUG] [LOCAL ] IFS: Primary data saved (16626 records). [2025-09-14T18:33:01.198601] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-14T18:33:01.198748] [INFO ] [MAIN ] Update Progress: 1094/2370 symbols completed. IFS took 21.0s. Estimated remaining: 2h 15m 6s. Rate: 9.4 symbols/min [2025-09-14T18:33:01.370239] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-14T18:33:01.373539] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:01.390665] [DEBUG] [LOCAL ] IGR: Loaded 14800 existing records from primary storage. [2025-09-14T18:33:01.390848] [INFO ] [MAIN ] IGR: Loaded 14800 existing records. [2025-09-14T18:33:01.571242] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:01.571511] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-14T18:33:01.571579] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-14T18:33:01.572234] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-14T18:33:01.572300] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-14T18:33:01.932031] [INFO ] [REMOTE ] IGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:02.158832] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-14T18:33:02.174447] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:33:02.958855] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-14T18:33:03.758837] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-14T18:33:04.569694] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T18:33:04.570966] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-14T18:33:04.589550] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-09-14T18:33:05.245131] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (3.09 seconds). [2025-09-14T18:33:05.294012] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-14T18:33:05.358837] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-14T18:33:05.924990] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-14T18:33:05.945987] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T18:33:06.158859] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-14T18:33:06.958844] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-14T18:33:07.028245] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:33:07.758804] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-14T18:33:08.075717] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:33:08.558867] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-14T18:33:08.706754] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T18:33:09.358867] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-14T18:33:09.915503] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T18:33:10.048531] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T18:33:10.158834] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-14T18:33:10.958851] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-14T18:33:11.095072] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:33:11.758826] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-14T18:33:11.863377] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T18:33:12.422138] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:33:12.558851] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-14T18:33:13.286678] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T18:33:13.358841] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-14T18:33:14.027011] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T18:33:14.158814] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-14T18:33:14.650622] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T18:33:14.651922] [INFO ] [REMOTE ] IGI: Full fetch complete (3965 records). [2025-09-14T18:33:14.652048] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-14T18:33:14.963974] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-14T18:33:15.031582] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-14T18:33:15.031730] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-14T18:33:15.031889] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-14T18:33:15.031939] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-14T18:33:15.032376] [DEBUG] [LOCAL ] IGI: Trimmed 3965 records to 2744 (keeping 150 days of data) [2025-09-14T18:33:15.050505] [DEBUG] [LOCAL ] IGI: Primary data saved (2744 records). [2025-09-14T18:33:15.050617] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-14T18:33:15.050767] [INFO ] [MAIN ] Update Progress: 1095/2370 symbols completed. IGI took 15.5s. Estimated remaining: 2h 15m 8s. Rate: 9.4 symbols/min [2025-09-14T18:33:15.234511] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:15.237911] [DEBUG] [LOCAL ] IH: Loaded 1551 existing records from primary storage. [2025-09-14T18:33:15.238005] [INFO ] [MAIN ] IH: Loaded 1551 existing records. [2025-09-14T18:33:15.421004] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:15.421304] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-14T18:33:15.421441] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-14T18:33:15.421686] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-14T18:33:15.421748] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-14T18:33:15.768349] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-14T18:33:15.947417] [INFO ] [REMOTE ] IH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:16.558884] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-14T18:33:17.252018] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-14T18:33:17.342430] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T18:33:17.344217] [INFO ] [REMOTE ] IGA: Full fetch complete (10309 records). [2025-09-14T18:33:17.344305] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-14T18:33:17.365044] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-14T18:33:17.674395] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-14T18:33:17.745512] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-14T18:33:17.745689] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-14T18:33:17.746005] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-14T18:33:17.746095] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-14T18:33:17.746729] [DEBUG] [LOCAL ] IGA: Trimmed 10309 records to 6969 (keeping 150 days of data) [2025-09-14T18:33:17.798918] [DEBUG] [LOCAL ] IGA: Primary data saved (6969 records). [2025-09-14T18:33:17.799116] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-14T18:33:17.799252] [INFO ] [MAIN ] Update Progress: 1096/2370 symbols completed. IGA took 27.0s. Estimated remaining: 2h 14m 57s. Rate: 9.4 symbols/min [2025-09-14T18:33:17.973161] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:17.978118] [DEBUG] [LOCAL ] IHD: Loaded 2954 existing records from primary storage. [2025-09-14T18:33:17.978232] [INFO ] [MAIN ] IHD: Loaded 2954 existing records. [2025-09-14T18:33:18.153667] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:18.153935] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-14T18:33:18.153996] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-14T18:33:18.154262] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-14T18:33:18.154322] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-14T18:33:18.165452] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-14T18:33:18.535091] [INFO ] [REMOTE ] IHD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:18.958801] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-14T18:33:18.995467] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:33:19.045214] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:33:19.758843] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-14T18:33:20.159537] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T18:33:20.558823] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-14T18:33:20.959242] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T18:33:21.358841] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-14T18:33:21.402188] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T18:33:21.404262] [INFO ] [REMOTE ] IGD: Full fetch complete (21153 records). [2025-09-14T18:33:21.404428] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-14T18:33:21.791496] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-14T18:33:21.791627] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-14T18:33:21.792345] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-14T18:33:21.792417] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-14T18:33:21.793424] [DEBUG] [LOCAL ] IGD: Trimmed 21153 records to 14033 (keeping 150 days of data) [2025-09-14T18:33:21.886293] [DEBUG] [LOCAL ] IGD: Primary data saved (14033 records). [2025-09-14T18:33:21.886488] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-14T18:33:21.886625] [INFO ] [MAIN ] Update Progress: 1097/2370 symbols completed. IGD took 24.4s. Estimated remaining: 2h 14m 48s. Rate: 9.4 symbols/min [2025-09-14T18:33:21.997006] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T18:33:22.070125] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:22.082681] [DEBUG] [LOCAL ] IHG: Loaded 10248 existing records from primary storage. [2025-09-14T18:33:22.082843] [INFO ] [MAIN ] IHG: Loaded 10248 existing records. [2025-09-14T18:33:22.164178] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-14T18:33:22.272553] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:22.272867] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-14T18:33:22.272963] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-14T18:33:22.273454] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-14T18:33:22.273525] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-14T18:33:22.650320] [INFO ] [REMOTE ] IHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:22.958831] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-14T18:33:23.099051] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T18:33:23.758908] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-14T18:33:24.202086] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:33:24.558876] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-14T18:33:24.956038] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:33:25.358821] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-14T18:33:25.395877] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T18:33:26.158877] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-14T18:33:26.939376] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T18:33:26.958777] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-14T18:33:26.996160] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:33:27.758828] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-14T18:33:27.941502] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T18:33:28.558924] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-14T18:33:29.358841] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-14T18:33:29.909042] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T18:33:29.911229] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T18:33:30.158828] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-14T18:33:30.408152] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:33:30.958851] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-14T18:33:31.372795] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T18:33:31.376333] [INFO ] [REMOTE ] IGR: Full fetch complete (33338 records). [2025-09-14T18:33:31.376467] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-14T18:33:31.478484] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T18:33:31.763134] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-14T18:33:31.763593] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-14T18:33:31.763900] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-14T18:33:31.765090] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-14T18:33:31.766251] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-14T18:33:31.767633] [DEBUG] [LOCAL ] IGR: Trimmed 33338 records to 22791 (keeping 150 days of data) [2025-09-14T18:33:31.902995] [DEBUG] [LOCAL ] IGR: Primary data saved (22791 records). [2025-09-14T18:33:31.903154] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-14T18:33:31.903265] [INFO ] [MAIN ] Update Progress: 1098/2370 symbols completed. IGR took 30.7s. Estimated remaining: 2h 14m 46s. Rate: 9.4 symbols/min [2025-09-14T18:33:32.074895] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:32.094512] [DEBUG] [LOCAL ] IHS: Loaded 16979 existing records from primary storage. [2025-09-14T18:33:32.094727] [INFO ] [MAIN ] IHS: Loaded 16979 existing records. [2025-09-14T18:33:32.272500] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:32.272814] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-14T18:33:32.272875] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-14T18:33:32.273409] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-14T18:33:32.273471] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-14T18:33:32.564002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-14T18:33:32.628519] [INFO ] [REMOTE ] IHS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:33.254228] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T18:33:33.358793] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-14T18:33:33.509774] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T18:33:34.158831] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-14T18:33:34.835442] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T18:33:34.958816] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-14T18:33:34.992067] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:33:35.758836] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-14T18:33:36.260919] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T18:33:36.317818] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T18:33:36.558825] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-14T18:33:37.358785] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-14T18:33:37.746889] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T18:33:37.848836] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-14T18:33:38.158834] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-14T18:33:38.930430] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:33:38.931865] [INFO ] [REMOTE ] IHD: Full fetch complete (8097 records). [2025-09-14T18:33:38.931952] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-14T18:33:38.963909] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-14T18:33:39.295303] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-14T18:33:39.295442] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-14T18:33:39.295728] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-14T18:33:39.295793] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-14T18:33:39.296414] [DEBUG] [LOCAL ] IHD: Trimmed 8097 records to 5208 (keeping 150 days of data) [2025-09-14T18:33:39.328310] [DEBUG] [LOCAL ] IHD: Primary data saved (5208 records). [2025-09-14T18:33:39.328494] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-14T18:33:39.328662] [INFO ] [MAIN ] Update Progress: 1099/2370 symbols completed. IHD took 21.5s. Estimated remaining: 2h 14m 41s. Rate: 9.4 symbols/min [2025-09-14T18:33:39.505706] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:39.510023] [DEBUG] [LOCAL ] IIF: Loaded 2345 existing records from primary storage. [2025-09-14T18:33:39.510147] [INFO ] [MAIN ] IIF: Loaded 2345 existing records. [2025-09-14T18:33:39.712578] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:39.712868] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-14T18:33:39.712931] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-14T18:33:39.713206] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-14T18:33:39.713277] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-14T18:33:39.763942] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-14T18:33:40.088220] [INFO ] [REMOTE ] IIF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:40.311441] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:33:40.364152] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T18:33:40.558856] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-14T18:33:41.358881] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-14T18:33:41.392945] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:33:42.158885] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-14T18:33:42.792233] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:33:42.820597] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T18:33:42.958879] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-14T18:33:43.756119] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T18:33:43.759166] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-14T18:33:44.453125] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T18:33:44.558842] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-14T18:33:45.358860] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-14T18:33:45.499265] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:33:45.993756] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:33:45.994727] [INFO ] [REMOTE ] IH: Full fetch complete (4209 records). [2025-09-14T18:33:45.994809] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-14T18:33:46.167872] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-14T18:33:46.353684] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-14T18:33:46.353790] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-14T18:33:46.353942] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-14T18:33:46.353994] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-14T18:33:46.354382] [DEBUG] [LOCAL ] IH: Trimmed 4209 records to 2015 (keeping 150 days of data) [2025-09-14T18:33:46.366299] [DEBUG] [LOCAL ] IH: Primary data saved (2015 records). [2025-09-14T18:33:46.366376] [INFO ] [MAIN ] IH: Full history saved. [2025-09-14T18:33:46.366462] [INFO ] [MAIN ] Update Progress: 1100/2370 symbols completed. IH took 31.3s. Estimated remaining: 2h 14m 36s. Rate: 9.4 symbols/min [2025-09-14T18:33:46.541408] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:46.550751] [DEBUG] [LOCAL ] IIIN: Loaded 6713 existing records from primary storage. [2025-09-14T18:33:46.550915] [INFO ] [MAIN ] IIIN: Loaded 6713 existing records. [2025-09-14T18:33:46.727977] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:46.728249] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-14T18:33:46.728311] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-14T18:33:46.728685] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-14T18:33:46.728749] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-14T18:33:46.967405] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-14T18:33:47.060219] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T18:33:47.101371] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:47.758847] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-14T18:33:48.545276] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T18:33:48.558769] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-14T18:33:49.137173] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T18:33:49.358837] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-14T18:33:49.613377] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:33:49.616065] [INFO ] [REMOTE ] IHG: Full fetch complete (27459 records). [2025-09-14T18:33:49.616159] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-14T18:33:49.999304] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-14T18:33:49.999409] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-14T18:33:50.000011] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-14T18:33:50.000070] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-14T18:33:50.000923] [DEBUG] [LOCAL ] IHG: Trimmed 27459 records to 18114 (keeping 150 days of data) [2025-09-14T18:33:50.132498] [DEBUG] [LOCAL ] IHG: Primary data saved (18114 records). [2025-09-14T18:33:50.132727] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-14T18:33:50.132881] [INFO ] [MAIN ] Update Progress: 1101/2370 symbols completed. IHG took 28.2s. Estimated remaining: 2h 14m 26s. Rate: 9.4 symbols/min [2025-09-14T18:33:50.167389] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-14T18:33:50.317282] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:50.326720] [DEBUG] [LOCAL ] IIM: Loaded 7522 existing records from primary storage. [2025-09-14T18:33:50.326894] [INFO ] [MAIN ] IIM: Loaded 7522 existing records. [2025-09-14T18:33:50.510065] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:50.510321] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-14T18:33:50.510381] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-14T18:33:50.510725] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-14T18:33:50.510811] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-14T18:33:50.897354] [INFO ] [REMOTE ] IIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:50.907851] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:33:50.958773] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-14T18:33:51.199185] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:33:51.758851] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-14T18:33:52.156029] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T18:33:52.507911] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T18:33:52.558810] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-14T18:33:53.358854] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-14T18:33:53.652520] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-14T18:33:53.917335] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:33:53.918499] [INFO ] [REMOTE ] IIF: Full fetch complete (6586 records). [2025-09-14T18:33:53.918589] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-14T18:33:54.163984] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-14T18:33:54.287772] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-14T18:33:54.288096] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-14T18:33:54.288382] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-14T18:33:54.288439] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-14T18:33:54.289184] [DEBUG] [LOCAL ] IIF: Trimmed 6586 records to 4212 (keeping 150 days of data) [2025-09-14T18:33:54.315924] [DEBUG] [LOCAL ] IIF: Primary data saved (4212 records). [2025-09-14T18:33:54.316028] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-14T18:33:54.316177] [INFO ] [MAIN ] Update Progress: 1102/2370 symbols completed. IIF took 15.0s. Estimated remaining: 2h 14m 17s. Rate: 9.4 symbols/min [2025-09-14T18:33:54.486340] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:54.503501] [DEBUG] [LOCAL ] IIPR: Loaded 13132 existing records from primary storage. [2025-09-14T18:33:54.503671] [INFO ] [MAIN ] IIPR: Loaded 13132 existing records. [2025-09-14T18:33:54.678124] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:54.678393] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-14T18:33:54.678456] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-14T18:33:54.678931] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-14T18:33:54.678998] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-14T18:33:54.963196] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-14T18:33:55.043336] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:55.243594] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:33:55.758845] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-14T18:33:56.558839] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-14T18:33:56.695339] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:33:57.214893] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:33:57.358819] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-14T18:33:57.989323] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T18:33:58.158838] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-14T18:33:58.725756] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:33:58.958883] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-14T18:33:59.135825] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T18:33:59.758844] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-14T18:34:00.083818] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:34:00.558805] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-14T18:34:00.626693] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:34:01.358838] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-14T18:34:01.713032] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:34:02.158860] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-14T18:34:02.958853] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-14T18:34:03.276496] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:34:03.334106] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:34:03.758872] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-14T18:34:04.558192] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T18:34:04.566418] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-14T18:34:05.115285] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T18:34:05.358852] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-14T18:34:05.595007] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T18:34:06.158871] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-14T18:34:06.671698] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T18:34:06.959197] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-14T18:34:07.359609] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T18:34:07.758922] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-14T18:34:08.558929] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-14T18:34:08.678540] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:34:09.239583] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:34:09.358801] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-14T18:34:09.650247] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:34:09.652784] [INFO ] [REMOTE ] IIM: Full fetch complete (18362 records). [2025-09-14T18:34:09.652873] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-14T18:34:10.027772] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-14T18:34:10.027891] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-14T18:34:10.028588] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-14T18:34:10.028687] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-14T18:34:10.029308] [DEBUG] [LOCAL ] IIM: Trimmed 18362 records to 11433 (keeping 150 days of data) [2025-09-14T18:34:10.108136] [DEBUG] [LOCAL ] IIM: Primary data saved (11433 records). [2025-09-14T18:34:10.108305] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-14T18:34:10.108417] [INFO ] [MAIN ] Update Progress: 1103/2370 symbols completed. IIM took 20.0s. Estimated remaining: 2h 14m 22s. Rate: 9.4 symbols/min [2025-09-14T18:34:10.163980] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-14T18:34:10.280932] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:10.301838] [DEBUG] [LOCAL ] IMAX: Loaded 19584 existing records from primary storage. [2025-09-14T18:34:10.301998] [INFO ] [MAIN ] IMAX: Loaded 19584 existing records. [2025-09-14T18:34:10.476767] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:10.477009] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-14T18:34:10.477070] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-14T18:34:10.477586] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-14T18:34:10.477670] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-14T18:34:10.833137] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:10.958821] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-14T18:34:10.994340] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:34:11.503818] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T18:34:11.758847] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-14T18:34:12.558835] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-14T18:34:12.780426] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T18:34:13.032729] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:34:13.036430] [INFO ] [REMOTE ] IIIN: Full fetch complete (18489 records). [2025-09-14T18:34:13.036564] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-14T18:34:13.364987] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-14T18:34:13.414193] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-14T18:34:13.414427] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-14T18:34:13.416164] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-14T18:34:13.416670] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-14T18:34:13.417904] [DEBUG] [LOCAL ] IIIN: Trimmed 18489 records to 12082 (keeping 150 days of data) [2025-09-14T18:34:13.482992] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T18:34:13.535383] [DEBUG] [LOCAL ] IIIN: Primary data saved (12082 records). [2025-09-14T18:34:13.535601] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-14T18:34:13.535731] [INFO ] [MAIN ] Update Progress: 1104/2370 symbols completed. IIIN took 27.2s. Estimated remaining: 2h 14m 12s. Rate: 9.4 symbols/min [2025-09-14T18:34:13.710305] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:13.734084] [DEBUG] [LOCAL ] INFA: Loaded 22154 existing records from primary storage. [2025-09-14T18:34:13.734248] [INFO ] [MAIN ] INFA: Loaded 22154 existing records. [2025-09-14T18:34:13.916764] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:13.917068] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-14T18:34:13.917134] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-14T18:34:13.917895] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-14T18:34:13.917959] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-14T18:34:14.168358] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-14T18:34:14.284572] [INFO ] [REMOTE ] INFA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:14.958833] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-14T18:34:15.089166] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:34:15.552149] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T18:34:15.556510] [INFO ] [REMOTE ] IHS: Full fetch complete (41214 records). [2025-09-14T18:34:15.556696] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-14T18:34:15.764031] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-14T18:34:15.958259] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-14T18:34:15.958379] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-14T18:34:15.959178] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-14T18:34:15.959239] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-14T18:34:15.960229] [DEBUG] [LOCAL ] IHS: Trimmed 41214 records to 29543 (keeping 150 days of data) [2025-09-14T18:34:16.138869] [DEBUG] [LOCAL ] IHS: Primary data saved (29543 records). [2025-09-14T18:34:16.139047] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-14T18:34:16.139157] [INFO ] [MAIN ] Update Progress: 1105/2370 symbols completed. IHS took 44.2s. Estimated remaining: 2h 14m 2s. Rate: 9.4 symbols/min [2025-09-14T18:34:16.307286] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:16.331575] [DEBUG] [LOCAL ] INFY: Loaded 24015 existing records from primary storage. [2025-09-14T18:34:16.331759] [INFO ] [MAIN ] INFY: Loaded 24015 existing records. [2025-09-14T18:34:16.514846] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:16.517298] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:34:16.517411] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-14T18:34:16.517608] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-14T18:34:16.521161] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-14T18:34:16.521239] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-14T18:34:16.551685] [INFO ] [REMOTE ] IIPR: Full fetch complete (32100 records). [2025-09-14T18:34:16.573739] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-14T18:34:16.583515] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-14T18:34:17.113512] [INFO ] [REMOTE ] INFY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:17.290082] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-14T18:34:17.291745] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-14T18:34:17.290782] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-14T18:34:17.292843] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-14T18:34:17.302673] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-14T18:34:17.303857] [DEBUG] [LOCAL ] IIPR: Trimmed 32100 records to 20957 (keeping 150 days of data) [2025-09-14T18:34:17.360929] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-14T18:34:17.446429] [DEBUG] [LOCAL ] IIPR: Primary data saved (20957 records). [2025-09-14T18:34:17.446676] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-14T18:34:17.446807] [INFO ] [MAIN ] Update Progress: 1106/2370 symbols completed. IIPR took 23.1s. Estimated remaining: 2h 13m 49s. Rate: 9.4 symbols/min [2025-09-14T18:34:17.631374] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:17.656347] [DEBUG] [LOCAL ] ING: Loaded 22777 existing records from primary storage. [2025-09-14T18:34:17.656594] [INFO ] [MAIN ] ING: Loaded 22777 existing records. [2025-09-14T18:34:17.856343] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:17.856866] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-14T18:34:17.856950] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-14T18:34:17.857934] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-14T18:34:17.858036] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-14T18:34:18.170627] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-14T18:34:18.257465] [INFO ] [REMOTE ] ING: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:18.290974] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T18:34:18.340621] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T18:34:18.958868] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-14T18:34:19.758846] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-14T18:34:19.943995] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:34:20.322566] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-14T18:34:20.448190] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T18:34:20.558872] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-14T18:34:21.358840] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-14T18:34:21.484340] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:34:21.841020] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T18:34:22.158830] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-14T18:34:22.958884] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-14T18:34:23.129656] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T18:34:23.758846] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-14T18:34:24.418356] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:34:24.527250] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T18:34:24.558791] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-14T18:34:25.358891] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-14T18:34:25.456823] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T18:34:26.158827] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-14T18:34:26.958833] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-14T18:34:27.045886] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:34:27.171982] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:34:27.758840] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-14T18:34:28.466933] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:34:28.558955] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-14T18:34:29.365200] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-14T18:34:29.397635] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:34:29.548234] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:34:30.158874] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-14T18:34:30.958921] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-14T18:34:31.075262] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:34:31.408091] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T18:34:31.413714] [INFO ] [REMOTE ] IMAX: Full fetch complete (46154 records). [2025-09-14T18:34:31.413989] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-14T18:34:31.761330] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-14T18:34:31.794776] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-14T18:34:31.794954] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-14T18:34:31.796170] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-14T18:34:31.796401] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-14T18:34:31.798176] [DEBUG] [LOCAL ] IMAX: Trimmed 46154 records to 32221 (keeping 150 days of data) [2025-09-14T18:34:31.937152] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T18:34:32.052869] [DEBUG] [LOCAL ] IMAX: Primary data saved (32221 records). [2025-09-14T18:34:32.053058] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-14T18:34:32.053175] [INFO ] [MAIN ] Update Progress: 1107/2370 symbols completed. IMAX took 21.9s. Estimated remaining: 2h 13m 53s. Rate: 9.4 symbols/min [2025-09-14T18:34:32.227499] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:32.240787] [DEBUG] [LOCAL ] INGM: Loaded 12297 existing records from primary storage. [2025-09-14T18:34:32.240944] [INFO ] [MAIN ] INGM: Loaded 12297 existing records. [2025-09-14T18:34:32.418457] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:32.418735] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-14T18:34:32.418801] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-14T18:34:32.419247] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-14T18:34:32.419314] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-14T18:34:32.568725] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-14T18:34:32.776171] [INFO ] [REMOTE ] INGM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:33.358841] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-14T18:34:33.520572] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T18:34:33.690951] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:34:34.158867] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-14T18:34:34.615486] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T18:34:34.958841] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-14T18:34:35.088521] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:34:35.758824] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-14T18:34:36.397272] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:34:36.506370] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T18:34:36.558812] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-14T18:34:37.260581] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:34:37.266174] [INFO ] [REMOTE ] INFY: Full fetch complete (58269 records). [2025-09-14T18:34:37.266312] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-14T18:34:37.363995] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-14T18:34:37.655182] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-14T18:34:37.655341] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-14T18:34:37.656220] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-14T18:34:37.656281] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-14T18:34:37.657478] [DEBUG] [LOCAL ] INFY: Trimmed 58269 records to 40348 (keeping 150 days of data) [2025-09-14T18:34:37.921588] [DEBUG] [LOCAL ] INFY: Primary data saved (40348 records). [2025-09-14T18:34:37.921768] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-14T18:34:37.921866] [INFO ] [MAIN ] Update Progress: 1108/2370 symbols completed. INFY took 21.8s. Estimated remaining: 2h 13m 46s. Rate: 9.4 symbols/min [2025-09-14T18:34:38.092625] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:38.109026] [DEBUG] [LOCAL ] INGR: Loaded 14773 existing records from primary storage. [2025-09-14T18:34:38.109202] [INFO ] [MAIN ] INGR: Loaded 14773 existing records. [2025-09-14T18:34:38.164328] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-14T18:34:38.288126] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:38.288393] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-14T18:34:38.288470] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-14T18:34:38.289092] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-14T18:34:38.289169] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-14T18:34:38.675712] [INFO ] [REMOTE ] INGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:38.958852] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-14T18:34:39.094214] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:34:39.227774] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:34:39.758870] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-14T18:34:40.366470] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:34:40.558825] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-14T18:34:41.143208] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T18:34:41.358855] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-14T18:34:42.158845] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-14T18:34:42.210222] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T18:34:42.679254] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T18:34:42.958844] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-14T18:34:43.207374] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:34:43.214747] [INFO ] [REMOTE ] INFA: Full fetch complete (54640 records). [2025-09-14T18:34:43.215015] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-14T18:34:43.602111] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-14T18:34:43.602240] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-14T18:34:43.603142] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-14T18:34:43.603208] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-14T18:34:43.604614] [DEBUG] [LOCAL ] INFA: Trimmed 54640 records to 37626 (keeping 150 days of data) [2025-09-14T18:34:43.780109] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-14T18:34:43.852888] [DEBUG] [LOCAL ] INFA: Primary data saved (37626 records). [2025-09-14T18:34:43.853095] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-14T18:34:43.853204] [INFO ] [MAIN ] Update Progress: 1109/2370 symbols completed. INFA took 30.3s. Estimated remaining: 2h 13m 39s. Rate: 9.4 symbols/min [2025-09-14T18:34:44.025342] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:44.043612] [DEBUG] [LOCAL ] INN: Loaded 18348 existing records from primary storage. [2025-09-14T18:34:44.043796] [INFO ] [MAIN ] INN: Loaded 18348 existing records. [2025-09-14T18:34:44.222586] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:44.222920] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-14T18:34:44.223001] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-14T18:34:44.223702] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-14T18:34:44.223786] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-14T18:34:44.561479] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-14T18:34:44.605789] [INFO ] [REMOTE ] INN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:44.630314] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:34:44.969075] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:34:45.349493] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T18:34:45.354786] [INFO ] [REMOTE ] ING: Full fetch complete (55229 records). [2025-09-14T18:34:45.354930] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-14T18:34:45.366683] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-14T18:34:45.769350] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-14T18:34:45.769539] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-14T18:34:45.770535] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-14T18:34:45.770596] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-14T18:34:45.772492] [DEBUG] [LOCAL ] ING: Trimmed 55229 records to 38033 (keeping 150 days of data) [2025-09-14T18:34:46.034656] [DEBUG] [LOCAL ] ING: Primary data saved (38033 records). [2025-09-14T18:34:46.034850] [INFO ] [MAIN ] ING: Full history saved. [2025-09-14T18:34:46.034959] [INFO ] [MAIN ] Update Progress: 1110/2370 symbols completed. ING took 28.6s. Estimated remaining: 2h 13m 28s. Rate: 9.4 symbols/min [2025-09-14T18:34:46.163973] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-14T18:34:46.219560] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:46.233371] [DEBUG] [LOCAL ] INR: Loaded 12353 existing records from primary storage. [2025-09-14T18:34:46.233523] [INFO ] [MAIN ] INR: Loaded 12353 existing records. [2025-09-14T18:34:46.415760] [WARN ] [MAIN ] INR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:46.416029] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-14T18:34:46.416090] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-14T18:34:46.416680] [DEBUG] [LOCAL ] INR: Deleted primary data file. [2025-09-14T18:34:46.416742] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-14T18:34:46.766066] [INFO ] [REMOTE ] INR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:46.784889] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:34:46.958808] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-14T18:34:47.758883] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-14T18:34:47.916557] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:34:47.996249] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T18:34:48.558794] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-14T18:34:48.816905] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T18:34:49.358883] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-14T18:34:49.744051] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T18:34:50.158915] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-14T18:34:50.335041] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T18:34:50.339433] [INFO ] [REMOTE ] INGM: Full fetch complete (31601 records). [2025-09-14T18:34:50.339616] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-14T18:34:50.729176] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-14T18:34:50.729278] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-14T18:34:50.729898] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-14T18:34:50.729954] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-14T18:34:50.730798] [DEBUG] [LOCAL ] INGM: Trimmed 31601 records to 20645 (keeping 150 days of data) [2025-09-14T18:34:50.862716] [DEBUG] [LOCAL ] INGM: Primary data saved (20645 records). [2025-09-14T18:34:50.862885] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-14T18:34:50.862995] [INFO ] [MAIN ] Update Progress: 1111/2370 symbols completed. INGM took 18.8s. Estimated remaining: 2h 13m 20s. Rate: 9.4 symbols/min [2025-09-14T18:34:50.968001] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-14T18:34:51.042709] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:51.060999] [DEBUG] [LOCAL ] INSP: Loaded 18199 existing records from primary storage. [2025-09-14T18:34:51.061151] [INFO ] [MAIN ] INSP: Loaded 18199 existing records. [2025-09-14T18:34:51.234795] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:51.235014] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-14T18:34:51.235072] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-14T18:34:51.235703] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-14T18:34:51.235767] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-14T18:34:51.586022] [INFO ] [REMOTE ] INSP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:51.674868] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:34:51.758779] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-14T18:34:52.401276] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T18:34:52.558873] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-14T18:34:53.221079] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:34:53.358845] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-14T18:34:53.787126] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T18:34:54.158797] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-14T18:34:54.860582] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:34:54.958775] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-14T18:34:55.675595] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:34:55.758772] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-14T18:34:56.264817] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T18:34:56.558874] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-14T18:34:57.244243] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T18:34:57.358833] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-14T18:34:58.002614] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:34:58.158825] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-14T18:34:58.840180] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T18:34:58.958818] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-14T18:34:59.574429] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T18:34:59.758887] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-14T18:35:00.159800] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:35:00.175941] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:35:00.179747] [INFO ] [REMOTE ] INGR: Full fetch complete (36752 records). [2025-09-14T18:35:00.179849] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-14T18:35:00.559792] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-14T18:35:00.560023] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-14T18:35:00.560142] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-14T18:35:00.561095] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-14T18:35:00.561816] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-14T18:35:00.562842] [DEBUG] [LOCAL ] INGR: Trimmed 36752 records to 24281 (keeping 150 days of data) [2025-09-14T18:35:00.726399] [DEBUG] [LOCAL ] INGR: Primary data saved (24281 records). [2025-09-14T18:35:00.726574] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-14T18:35:00.726695] [INFO ] [MAIN ] Update Progress: 1112/2370 symbols completed. INGR took 22.8s. Estimated remaining: 2h 13m 17s. Rate: 9.4 symbols/min [2025-09-14T18:35:00.896375] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:00.913855] [DEBUG] [LOCAL ] INSW: Loaded 17408 existing records from primary storage. [2025-09-14T18:35:00.914018] [INFO ] [MAIN ] INSW: Loaded 17408 existing records. [2025-09-14T18:35:01.095459] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:01.095821] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-14T18:35:01.095890] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-14T18:35:01.096521] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-14T18:35:01.096583] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-14T18:35:01.363915] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-14T18:35:01.473859] [INFO ] [REMOTE ] INSW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:02.136321] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:35:02.158785] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-14T18:35:02.860505] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T18:35:02.958863] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-14T18:35:03.758927] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-14T18:35:03.989731] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T18:35:04.558847] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-14T18:35:04.933277] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T18:35:05.358878] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-14T18:35:05.869146] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T18:35:06.163981] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-14T18:35:06.176729] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T18:35:06.183237] [INFO ] [REMOTE ] INSP: Full fetch complete (39610 records). [2025-09-14T18:35:06.183391] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-14T18:35:06.569239] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-14T18:35:06.569436] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-14T18:35:06.570438] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-14T18:35:06.570618] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-14T18:35:06.596075] [DEBUG] [LOCAL ] INSP: Trimmed 39610 records to 28161 (keeping 150 days of data) [2025-09-14T18:35:06.597271] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T18:35:06.788274] [DEBUG] [LOCAL ] INSP: Primary data saved (28161 records). [2025-09-14T18:35:06.788471] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-14T18:35:06.788601] [INFO ] [MAIN ] Update Progress: 1113/2370 symbols completed. INSP took 15.9s. Estimated remaining: 2h 13m 10s. Rate: 9.4 symbols/min [2025-09-14T18:35:06.957694] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:06.958813] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-14T18:35:06.982288] [DEBUG] [LOCAL ] INVH: Loaded 23770 existing records from primary storage. [2025-09-14T18:35:06.982456] [INFO ] [MAIN ] INVH: Loaded 23770 existing records. [2025-09-14T18:35:07.159555] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:07.159829] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-14T18:35:07.159911] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-14T18:35:07.160842] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-14T18:35:07.160916] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-14T18:35:07.514436] [INFO ] [REMOTE ] INVH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:07.549938] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:35:07.758990] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-14T18:35:08.558840] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-14T18:35:08.801118] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:35:09.358830] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-14T18:35:09.404564] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T18:35:09.894780] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:35:10.158829] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-14T18:35:10.958798] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-14T18:35:11.060748] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:35:11.758894] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-14T18:35:11.959511] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:35:12.310062] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:35:12.558871] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-14T18:35:13.358797] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-14T18:35:13.612333] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T18:35:13.709823] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T18:35:14.158792] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-14T18:35:14.427688] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T18:35:14.430726] [INFO ] [REMOTE ] INR: Full fetch complete (29891 records). [2025-09-14T18:35:14.430830] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-14T18:35:14.800505] [DEBUG] [VALIDATOR ] INR: All expected trading days are present. [2025-09-14T18:35:14.800623] [DEBUG] [VALIDATOR ] INR: Primary data validation passed. [2025-09-14T18:35:14.801244] [INFO ] [MAIN ] INR: Fetched primary data is valid. [2025-09-14T18:35:14.801300] [DEBUG] [LOCAL ] INR: Saving primary data. [2025-09-14T18:35:14.802103] [DEBUG] [LOCAL ] INR: Trimmed 29891 records to 19412 (keeping 150 days of data) [2025-09-14T18:35:14.926985] [DEBUG] [LOCAL ] INR: Primary data saved (19412 records). [2025-09-14T18:35:14.927241] [INFO ] [MAIN ] INR: Full history saved. [2025-09-14T18:35:14.927403] [INFO ] [MAIN ] Update Progress: 1114/2370 symbols completed. INR took 28.9s. Estimated remaining: 2h 13m 6s. Rate: 9.4 symbols/min [2025-09-14T18:35:14.963949] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-14T18:35:15.105059] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:15.117800] [DEBUG] [LOCAL ] INVX: Loaded 12520 existing records from primary storage. [2025-09-14T18:35:15.117945] [INFO ] [MAIN ] INVX: Loaded 12520 existing records. [2025-09-14T18:35:15.294331] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:15.294579] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-14T18:35:15.294639] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-14T18:35:15.295104] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-14T18:35:15.295166] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-14T18:35:15.649625] [INFO ] [REMOTE ] INVX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:15.758851] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-14T18:35:16.072344] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:35:16.558885] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-14T18:35:16.624453] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:35:17.183943] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:35:17.358859] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-14T18:35:18.158816] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-14T18:35:18.647688] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T18:35:18.860392] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T18:35:18.958795] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-14T18:35:19.421370] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T18:35:19.631334] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:35:19.635439] [INFO ] [REMOTE ] INN: Full fetch complete (45095 records). [2025-09-14T18:35:19.635607] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-14T18:35:19.763974] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-14T18:35:20.043746] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-14T18:35:20.043864] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-14T18:35:20.044796] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-14T18:35:20.044873] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-14T18:35:20.046077] [DEBUG] [LOCAL ] INN: Trimmed 45095 records to 31920 (keeping 150 days of data) [2025-09-14T18:35:20.251874] [DEBUG] [LOCAL ] INN: Primary data saved (31920 records). [2025-09-14T18:35:20.252088] [INFO ] [MAIN ] INN: Full history saved. [2025-09-14T18:35:20.252295] [INFO ] [MAIN ] Update Progress: 1115/2370 symbols completed. INN took 36.4s. Estimated remaining: 2h 12m 59s. Rate: 9.4 symbols/min [2025-09-14T18:35:20.422237] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:20.446112] [DEBUG] [LOCAL ] IONQ: Loaded 24180 existing records from primary storage. [2025-09-14T18:35:20.446294] [INFO ] [MAIN ] IONQ: Loaded 24180 existing records. [2025-09-14T18:35:20.563912] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-14T18:35:20.624529] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:20.624801] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-14T18:35:20.624876] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-14T18:35:20.625622] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-14T18:35:20.625739] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-14T18:35:21.084330] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:21.358924] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-14T18:35:21.754380] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T18:35:22.158947] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-14T18:35:22.225150] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:35:22.958844] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-14T18:35:23.758833] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-14T18:35:23.862447] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:35:24.023565] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:35:24.090401] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-09-14T18:35:24.558829] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-14T18:35:25.354163] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T18:35:25.363010] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-14T18:35:26.158813] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-14T18:35:26.614031] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T18:35:26.958855] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-14T18:35:27.758424] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:35:27.766618] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-14T18:35:28.174273] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-09-14T18:35:28.558798] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-14T18:35:28.590326] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:35:29.111557] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:35:29.358820] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-14T18:35:30.158889] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-14T18:35:30.772622] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T18:35:30.906087] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:35:30.911588] [INFO ] [REMOTE ] INVH: Full fetch complete (57695 records). [2025-09-14T18:35:30.911740] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-14T18:35:30.966212] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-14T18:35:31.303238] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-14T18:35:31.303352] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-14T18:35:31.304201] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-14T18:35:31.304258] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-14T18:35:31.305588] [DEBUG] [LOCAL ] INVH: Trimmed 57695 records to 39992 (keeping 150 days of data) [2025-09-14T18:35:31.429255] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-14T18:35:31.593213] [DEBUG] [LOCAL ] INVH: Primary data saved (39992 records). [2025-09-14T18:35:31.593409] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-14T18:35:31.593542] [INFO ] [MAIN ] Update Progress: 1116/2370 symbols completed. INVH took 24.8s. Estimated remaining: 2h 12m 58s. Rate: 9.4 symbols/min [2025-09-14T18:35:31.772093] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:31.768168] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-14T18:35:31.796998] [DEBUG] [LOCAL ] IOT: Loaded 24018 existing records from primary storage. [2025-09-14T18:35:31.797218] [INFO ] [MAIN ] IOT: Loaded 24018 existing records. [2025-09-14T18:35:31.972608] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:31.972880] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-14T18:35:31.972941] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-14T18:35:31.973600] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-14T18:35:31.973689] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-14T18:35:32.324106] [INFO ] [REMOTE ] IOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:32.340896] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:35:32.558818] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-14T18:35:33.133392] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:35:33.137581] [INFO ] [REMOTE ] INVX: Full fetch complete (32011 records). [2025-09-14T18:35:33.137924] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-14T18:35:33.363979] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-14T18:35:33.546274] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-14T18:35:33.546399] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-14T18:35:33.547242] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-14T18:35:33.547309] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-14T18:35:33.548487] [DEBUG] [LOCAL ] INVX: Trimmed 32011 records to 21811 (keeping 150 days of data) [2025-09-14T18:35:33.682595] [DEBUG] [LOCAL ] INVX: Primary data saved (21811 records). [2025-09-14T18:35:33.682787] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-14T18:35:33.682934] [INFO ] [MAIN ] Update Progress: 1117/2370 symbols completed. INVX took 18.8s. Estimated remaining: 2h 12m 47s. Rate: 9.4 symbols/min [2025-09-14T18:35:34.158873] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-14T18:35:34.606577] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-14T18:35:34.630308] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:35:34.634521] [INFO ] [REMOTE ] INSW: Full fetch complete (44624 records). [2025-09-14T18:35:34.634687] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-14T18:35:34.963943] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-14T18:35:35.011991] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-14T18:35:35.012118] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-14T18:35:35.012878] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-14T18:35:35.012945] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-14T18:35:35.013914] [DEBUG] [LOCAL ] INSW: Trimmed 44624 records to 29866 (keeping 150 days of data) [2025-09-14T18:35:35.223183] [DEBUG] [LOCAL ] INSW: Primary data saved (29866 records). [2025-09-14T18:35:35.223374] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-14T18:35:35.223494] [INFO ] [MAIN ] Update Progress: 1118/2370 symbols completed. INSW took 34.5s. Estimated remaining: 2h 12m 35s. Rate: 9.4 symbols/min [2025-09-14T18:35:35.395343] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T18:35:35.758843] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-14T18:35:37.579198] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:35:37.591191] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-14T18:35:37.803531] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-14T18:35:37.814862] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-14T18:35:39.566955] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:35:39.578709] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-14T18:35:39.910315] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T18:35:39.922937] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-14T18:35:41.354013] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T18:35:41.365590] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-14T18:35:42.826795] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-14T18:35:42.839136] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-14T18:35:42.915618] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:35:42.926894] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-14T18:35:44.789943] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:35:44.801940] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-14T18:35:45.331449] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-14T18:35:45.337335] [INFO ] [REMOTE ] IONQ: Full fetch complete (58468 records). [2025-09-14T18:35:45.337576] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-14T18:35:45.729610] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-14T18:35:45.729757] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-14T18:35:45.730717] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-14T18:35:45.730781] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-14T18:35:45.735426] [DEBUG] [LOCAL ] IONQ: Trimmed 58468 records to 40528 (keeping 150 days of data) [2025-09-14T18:35:46.006963] [DEBUG] [LOCAL ] IONQ: Primary data saved (40528 records). [2025-09-14T18:35:46.007130] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-14T18:35:46.007251] [INFO ] [MAIN ] Update Progress: 1119/2370 symbols completed. IONQ took 25.8s. Estimated remaining: 2h 12m 34s. Rate: 9.4 symbols/min [2025-09-14T18:35:46.924421] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-14T18:35:46.936395] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-14T18:35:48.759442] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-14T18:35:48.764888] [INFO ] [REMOTE ] IOT: Full fetch complete (58129 records). [2025-09-14T18:35:48.765008] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-14T18:35:49.159103] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-14T18:35:49.159296] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-14T18:35:49.160308] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-14T18:35:49.160443] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-14T18:35:49.164517] [DEBUG] [LOCAL ] IOT: Trimmed 58129 records to 40234 (keeping 150 days of data) [2025-09-14T18:35:49.437757] [DEBUG] [LOCAL ] IOT: Primary data saved (40234 records). [2025-09-14T18:35:49.437978] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-14T18:35:49.438223] [INFO ] [MAIN ] Update Progress: 1120/2370 symbols completed. IOT took 17.8s. Estimated remaining: 2h 12m 24s. Rate: 9.4 symbols/min [2025-09-14T18:35:50.028893] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:50.074224] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:50.163058] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:50.183486] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:50.190112] [DEBUG] [LOCAL ] IPI: Loaded 8688 existing records from primary storage. [2025-09-14T18:35:50.190427] [INFO ] [MAIN ] IPI: Loaded 8688 existing records. [2025-09-14T18:35:50.326466] [DEBUG] [LOCAL ] IQI: Loaded 8665 existing records from primary storage. [2025-09-14T18:35:50.330928] [DEBUG] [LOCAL ] IPG: Loaded 23811 existing records from primary storage. [2025-09-14T18:35:50.337391] [INFO ] [MAIN ] IQI: Loaded 8665 existing records. [2025-09-14T18:35:50.342846] [INFO ] [MAIN ] IPG: Loaded 23811 existing records. [2025-09-14T18:35:50.540330] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:50.565811] [DEBUG] [LOCAL ] IP: Loaded 23828 existing records from primary storage. [2025-09-14T18:35:50.581687] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-14T18:35:50.632795] [INFO ] [MAIN ] IP: Loaded 23828 existing records. [2025-09-14T18:35:50.632681] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-14T18:35:50.674836] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-14T18:35:50.704290] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-14T18:35:50.896378] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:50.906764] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:50.956983] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-14T18:35:50.988991] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-14T18:35:51.007523] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-14T18:35:51.007859] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-14T18:35:51.013252] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-14T18:35:51.013175] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-14T18:35:51.122785] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-14T18:35:51.175855] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-14T18:35:51.181119] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:51.249950] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-14T18:35:51.341176] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-14T18:35:51.359990] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-14T18:35:51.395393] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-14T18:35:51.997530] [INFO ] [REMOTE ] IPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:52.062353] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-14T18:35:52.407856] [INFO ] [REMOTE ] IPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:52.462380] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-14T18:35:52.500387] [INFO ] [REMOTE ] IQI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:52.528266] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-14T18:35:52.557457] [INFO ] [REMOTE ] IP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:52.558463] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-14T18:35:53.451942] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T18:35:53.462220] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-14T18:35:53.495365] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:35:53.499582] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-14T18:35:54.028163] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T18:35:54.033191] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-14T18:35:54.450382] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T18:35:54.463573] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-14T18:35:54.568446] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T18:35:54.582951] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-14T18:35:54.626687] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:35:54.632121] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-14T18:35:55.044774] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T18:35:55.048936] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-14T18:35:55.364453] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T18:35:55.376233] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-14T18:35:55.520614] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:35:55.526169] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-14T18:35:55.812985] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T18:35:55.824494] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-14T18:35:56.254616] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T18:35:56.260749] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-14T18:35:56.527198] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T18:35:56.539519] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-14T18:35:56.565982] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T18:35:56.572185] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-14T18:35:56.640520] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T18:35:57.100781] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T18:35:57.358852] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-14T18:35:57.396181] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T18:35:58.158851] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-14T18:35:58.401053] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T18:35:58.457776] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T18:35:58.958862] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-14T18:35:59.271439] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:35:59.758890] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-14T18:36:00.558881] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-14T18:36:00.762042] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:36:00.849774] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:36:01.358858] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-14T18:36:01.892039] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:36:02.158876] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-14T18:36:02.958865] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-14T18:36:03.758884] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-14T18:36:12.574375] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (8.82 seconds). [2025-09-14T18:36:12.579683] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-14T18:36:13.026535] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (11.67 seconds). [2025-09-14T18:36:13.037814] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-14T18:36:13.108912] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (10.15 seconds). [2025-09-14T18:36:13.121009] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-14T18:36:13.274618] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (11.12 seconds). [2025-09-14T18:36:13.280116] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-14T18:36:14.151921] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:36:14.159223] [INFO ] [REMOTE ] IP: Full fetch complete (58005 records). [2025-09-14T18:36:14.159502] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-14T18:36:14.729098] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-14T18:36:14.736088] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-14T18:36:14.738252] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-14T18:36:14.737105] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-14T18:36:14.738536] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-14T18:36:14.742050] [INFO ] [REMOTE ] IPI: Full fetch complete (22843 records). [2025-09-14T18:36:14.742207] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-14T18:36:14.825294] [DEBUG] [LOCAL ] IP: Trimmed 58005 records to 40086 (keeping 150 days of data) [2025-09-14T18:36:15.221137] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-14T18:36:15.228845] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-14T18:36:15.229082] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-14T18:36:15.233531] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-14T18:36:15.234084] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-14T18:36:15.234807] [INFO ] [REMOTE ] IQI: Full fetch complete (20187 records). [2025-09-14T18:36:15.238530] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-14T18:36:15.241124] [DEBUG] [LOCAL ] IPI: Trimmed 22843 records to 15746 (keeping 150 days of data) [2025-09-14T18:36:15.709229] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-14T18:36:15.798763] [DEBUG] [LOCAL ] IPI: Primary data saved (15746 records). [2025-09-14T18:36:15.818606] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-14T18:36:15.819330] [INFO ] [MAIN ] Update Progress: 1121/2370 symbols completed. IPI took 26.4s. Estimated remaining: 2h 12m 40s. Rate: 9.4 symbols/min [2025-09-14T18:36:15.819160] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-14T18:36:16.007206] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-14T18:36:16.018302] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-14T18:36:16.030720] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-14T18:36:16.044781] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-14T18:36:16.092380] [DEBUG] [LOCAL ] IQI: Trimmed 20187 records to 13766 (keeping 150 days of data) [2025-09-14T18:36:16.167150] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:16.255189] [DEBUG] [LOCAL ] IP: Primary data saved (40086 records). [2025-09-14T18:36:16.256737] [INFO ] [MAIN ] IP: Full history saved. [2025-09-14T18:36:16.258557] [INFO ] [MAIN ] Update Progress: 1122/2370 symbols completed. IP took 26.8s. Estimated remaining: 2h 12m 27s. Rate: 9.4 symbols/min [2025-09-14T18:36:16.273478] [DEBUG] [LOCAL ] IQV: Loaded 22064 existing records from primary storage. [2025-09-14T18:36:16.297012] [INFO ] [MAIN ] IQV: Loaded 22064 existing records. [2025-09-14T18:36:16.606137] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:16.661171] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:16.662707] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-14T18:36:16.663081] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-14T18:36:16.664879] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-14T18:36:16.665469] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-14T18:36:16.698924] [DEBUG] [LOCAL ] IQI: Primary data saved (13766 records). [2025-09-14T18:36:16.731344] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-14T18:36:16.759596] [INFO ] [MAIN ] Update Progress: 1123/2370 symbols completed. IQI took 27.3s. Estimated remaining: 2h 12m 14s. Rate: 9.4 symbols/min [2025-09-14T18:36:16.963491] [DEBUG] [LOCAL ] IR: Loaded 23456 existing records from primary storage. [2025-09-14T18:36:16.993200] [INFO ] [MAIN ] IR: Loaded 23456 existing records. [2025-09-14T18:36:17.271983] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:17.383966] [INFO ] [REMOTE ] IQV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:17.389865] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-14T18:36:17.433360] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:17.433715] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-14T18:36:17.433787] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-14T18:36:17.434588] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-14T18:36:17.434685] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-14T18:36:17.612614] [DEBUG] [LOCAL ] IRM: Loaded 21556 existing records from primary storage. [2025-09-14T18:36:17.637548] [INFO ] [MAIN ] IRM: Loaded 21556 existing records. [2025-09-14T18:36:17.997057] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:18.000958] [INFO ] [REMOTE ] IR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:18.001813] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-14T18:36:18.001943] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-14T18:36:18.001704] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-14T18:36:18.003056] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-14T18:36:18.003313] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-14T18:36:18.362280] [INFO ] [REMOTE ] IRM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:18.362681] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-14T18:36:19.081016] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-09-14T18:36:19.092681] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-14T18:36:19.959539] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T18:36:19.981921] [INFO ] [REMOTE ] IPG: Full fetch complete (58004 records). [2025-09-14T18:36:19.995738] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-14T18:36:20.005286] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-14T18:36:20.090368] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-14T18:36:20.395825] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-14T18:36:20.396262] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-14T18:36:20.397608] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-14T18:36:20.397753] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-14T18:36:20.425841] [DEBUG] [LOCAL ] IPG: Trimmed 58004 records to 40092 (keeping 150 days of data) [2025-09-14T18:36:20.428150] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-14T18:36:20.439126] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-14T18:36:20.719422] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-14T18:36:20.741353] [DEBUG] [LOCAL ] IPG: Primary data saved (40092 records). [2025-09-14T18:36:20.751667] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-14T18:36:20.751805] [INFO ] [MAIN ] Update Progress: 1124/2370 symbols completed. IPG took 31.3s. Estimated remaining: 2h 12m 5s. Rate: 9.4 symbols/min [2025-09-14T18:36:20.751589] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-14T18:36:20.921241] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:20.933731] [DEBUG] [LOCAL ] IRS: Loaded 10380 existing records from primary storage. [2025-09-14T18:36:20.933890] [INFO ] [MAIN ] IRS: Loaded 10380 existing records. [2025-09-14T18:36:21.106623] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:21.106912] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-14T18:36:21.106971] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-14T18:36:21.107376] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-14T18:36:21.107434] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-14T18:36:21.453175] [INFO ] [REMOTE ] IRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:21.453517] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-14T18:36:22.073409] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:36:22.084487] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-14T18:36:22.573602] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T18:36:22.585286] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-14T18:36:22.619217] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:36:22.630796] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-14T18:36:22.878485] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T18:36:22.883055] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-14T18:36:23.854654] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:36:23.875753] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-14T18:36:23.877603] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T18:36:23.882318] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-14T18:36:24.245035] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T18:36:24.256014] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-14T18:36:24.597800] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T18:36:24.609546] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-14T18:36:24.634505] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T18:36:24.639241] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-14T18:36:25.797822] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T18:36:25.816952] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-14T18:36:25.830951] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T18:36:25.836277] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-14T18:36:25.872920] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T18:36:25.884299] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-14T18:36:26.919510] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-14T18:36:26.930916] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-14T18:36:27.342359] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:36:27.347448] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-14T18:36:27.894569] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T18:36:27.905319] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-14T18:36:28.164332] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-14T18:36:28.175164] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-14T18:36:28.992837] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:36:28.998081] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-14T18:36:29.295397] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-14T18:36:29.306381] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-14T18:36:29.709192] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:36:29.720880] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-14T18:36:29.761580] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:36:29.990590] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:36:30.158838] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-14T18:36:30.958805] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-14T18:36:31.200583] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:36:31.367248] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T18:36:31.666869] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:36:31.722587] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:36:31.726268] [INFO ] [REMOTE ] IRS: Full fetch complete (22865 records). [2025-09-14T18:36:31.726360] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-14T18:36:31.763998] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-14T18:36:32.088446] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-14T18:36:32.088558] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-14T18:36:32.089174] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-14T18:36:32.089256] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-14T18:36:32.089979] [DEBUG] [LOCAL ] IRS: Trimmed 22865 records to 16383 (keeping 150 days of data) [2025-09-14T18:36:32.190381] [DEBUG] [LOCAL ] IRS: Primary data saved (16383 records). [2025-09-14T18:36:32.191030] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-14T18:36:32.191133] [INFO ] [MAIN ] Update Progress: 1125/2370 symbols completed. IRS took 11.4s. Estimated remaining: 2h 12m 4s. Rate: 9.4 symbols/min [2025-09-14T18:36:32.370585] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:32.396750] [DEBUG] [LOCAL ] IRT: Loaded 22787 existing records from primary storage. [2025-09-14T18:36:32.396955] [INFO ] [MAIN ] IRT: Loaded 22787 existing records. [2025-09-14T18:36:32.582670] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:32.578104] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-14T18:36:32.583121] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-14T18:36:32.584015] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-14T18:36:32.584686] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-14T18:36:32.584859] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-14T18:36:32.663274] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:36:32.704856] [INFO ] [REMOTE ] IQV: Full fetch complete (54933 records). [2025-09-14T18:36:32.730753] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-14T18:36:33.162144] [INFO ] [REMOTE ] IRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:33.351741] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-14T18:36:33.351878] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-14T18:36:33.352691] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-14T18:36:33.352750] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-14T18:36:33.354041] [DEBUG] [LOCAL ] IQV: Trimmed 54933 records to 37989 (keeping 150 days of data) [2025-09-14T18:36:33.358854] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-14T18:36:33.602174] [DEBUG] [LOCAL ] IQV: Primary data saved (37989 records). [2025-09-14T18:36:33.602376] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-14T18:36:33.602484] [INFO ] [MAIN ] Update Progress: 1126/2370 symbols completed. IQV took 17.8s. Estimated remaining: 2h 11m 52s. Rate: 9.4 symbols/min [2025-09-14T18:36:33.790954] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:33.800382] [DEBUG] [LOCAL ] ISD: Loaded 6734 existing records from primary storage. [2025-09-14T18:36:33.800557] [INFO ] [MAIN ] ISD: Loaded 6734 existing records. [2025-09-14T18:36:33.987892] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:33.988192] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-14T18:36:33.988263] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-14T18:36:33.988717] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-14T18:36:33.988785] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-14T18:36:34.166608] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-14T18:36:34.360689] [INFO ] [REMOTE ] ISD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:34.421675] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:36:34.964171] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-14T18:36:34.972736] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:36:34.978226] [INFO ] [REMOTE ] IRM: Full fetch complete (54086 records). [2025-09-14T18:36:34.978341] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-14T18:36:35.358327] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-14T18:36:35.358506] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-14T18:36:35.359393] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-14T18:36:35.359513] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-14T18:36:35.384197] [DEBUG] [LOCAL ] IRM: Trimmed 54086 records to 36689 (keeping 150 days of data) [2025-09-14T18:36:35.385716] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T18:36:35.640953] [DEBUG] [LOCAL ] IRM: Primary data saved (36689 records). [2025-09-14T18:36:35.641135] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-14T18:36:35.641237] [INFO ] [MAIN ] Update Progress: 1127/2370 symbols completed. IRM took 18.9s. Estimated remaining: 2h 11m 41s. Rate: 9.4 symbols/min [2025-09-14T18:36:35.763615] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-14T18:36:35.815484] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:35.831286] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T18:36:35.837420] [INFO ] [REMOTE ] IR: Full fetch complete (57334 records). [2025-09-14T18:36:35.837555] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-14T18:36:35.972786] [DEBUG] [LOCAL ] IT: Loaded 19899 existing records from primary storage. [2025-09-14T18:36:36.002294] [INFO ] [MAIN ] IT: Loaded 19899 existing records. [2025-09-14T18:36:36.408381] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:36.425948] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-14T18:36:36.426207] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-14T18:36:36.426287] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-14T18:36:36.426425] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-14T18:36:36.427271] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-14T18:36:36.427469] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-14T18:36:36.428108] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-14T18:36:36.428337] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-14T18:36:36.471156] [DEBUG] [LOCAL ] IR: Trimmed 57334 records to 39643 (keeping 150 days of data) [2025-09-14T18:36:36.586858] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-14T18:36:36.906563] [INFO ] [REMOTE ] IT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:37.032510] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T18:36:37.080243] [DEBUG] [LOCAL ] IR: Primary data saved (39643 records). [2025-09-14T18:36:37.080427] [INFO ] [MAIN ] IR: Full history saved. [2025-09-14T18:36:37.080533] [INFO ] [MAIN ] Update Progress: 1128/2370 symbols completed. IR took 20.8s. Estimated remaining: 2h 11m 30s. Rate: 9.4 symbols/min [2025-09-14T18:36:37.262571] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:37.276893] [DEBUG] [LOCAL ] ITGR: Loaded 12464 existing records from primary storage. [2025-09-14T18:36:37.277076] [INFO ] [MAIN ] ITGR: Loaded 12464 existing records. [2025-09-14T18:36:37.364079] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-14T18:36:37.466900] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:37.467219] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-14T18:36:37.467300] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-14T18:36:37.467870] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-14T18:36:37.467958] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-14T18:36:37.837746] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:38.158836] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-14T18:36:38.468826] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:36:38.740092] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T18:36:38.958875] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-14T18:36:39.275134] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T18:36:39.758836] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-14T18:36:40.205183] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T18:36:40.558954] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-14T18:36:40.927316] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:36:41.358882] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-14T18:36:41.990162] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T18:36:42.158848] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-14T18:36:42.958834] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-14T18:36:43.239239] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:36:43.758885] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-14T18:36:43.967952] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:36:44.018176] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T18:36:44.558821] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-14T18:36:45.358879] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-14T18:36:45.418840] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T18:36:46.146752] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:36:46.158768] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-14T18:36:46.435911] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T18:36:46.958854] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-14T18:36:47.725723] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:36:47.758791] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-14T18:36:48.483205] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T18:36:48.558828] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-14T18:36:49.358851] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-14T18:36:49.494479] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T18:36:50.019849] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:36:50.078408] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T18:36:50.158825] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-14T18:36:50.958850] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-14T18:36:51.758898] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-14T18:36:51.927932] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:36:52.558886] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-14T18:36:52.686175] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T18:36:52.833489] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T18:36:53.217464] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:36:53.222429] [INFO ] [REMOTE ] IT: Full fetch complete (43617 records). [2025-09-14T18:36:53.222565] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-14T18:36:53.363982] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-14T18:36:53.607664] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-14T18:36:53.607791] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-14T18:36:53.609088] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-14T18:36:53.609182] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-14T18:36:53.610507] [DEBUG] [LOCAL ] IT: Trimmed 43617 records to 31043 (keeping 150 days of data) [2025-09-14T18:36:53.813762] [DEBUG] [LOCAL ] IT: Primary data saved (31043 records). [2025-09-14T18:36:53.813976] [INFO ] [MAIN ] IT: Full history saved. [2025-09-14T18:36:53.814091] [INFO ] [MAIN ] Update Progress: 1129/2370 symbols completed. IT took 18.2s. Estimated remaining: 2h 11m 35s. Rate: 9.4 symbols/min [2025-09-14T18:36:53.999037] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:54.014361] [DEBUG] [LOCAL ] ITT: Loaded 12496 existing records from primary storage. [2025-09-14T18:36:54.014534] [INFO ] [MAIN ] ITT: Loaded 12496 existing records. [2025-09-14T18:36:54.166293] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-14T18:36:54.194284] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:54.194466] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-14T18:36:54.194526] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-14T18:36:54.195019] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-14T18:36:54.195082] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-14T18:36:54.552703] [INFO ] [REMOTE ] ITT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:54.750698] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:36:54.958793] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-14T18:36:55.251850] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T18:36:55.758850] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-14T18:36:56.558858] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-14T18:36:56.653909] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T18:36:57.196565] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:36:57.358816] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-14T18:36:58.056690] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T18:36:58.158836] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-14T18:36:58.928897] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T18:36:58.941949] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:36:58.943839] [INFO ] [REMOTE ] ISD: Full fetch complete (17298 records). [2025-09-14T18:36:58.943926] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-14T18:36:58.965317] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-14T18:36:59.351170] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-14T18:36:59.351302] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-14T18:36:59.351785] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-14T18:36:59.351846] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-14T18:36:59.352587] [DEBUG] [LOCAL ] ISD: Trimmed 17298 records to 11353 (keeping 150 days of data) [2025-09-14T18:36:59.431203] [DEBUG] [LOCAL ] ISD: Primary data saved (11353 records). [2025-09-14T18:36:59.431389] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-14T18:36:59.431506] [INFO ] [MAIN ] Update Progress: 1130/2370 symbols completed. ISD took 25.8s. Estimated remaining: 2h 11m 27s. Rate: 9.4 symbols/min [2025-09-14T18:36:59.606618] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:59.629818] [DEBUG] [LOCAL ] ITUB: Loaded 23909 existing records from primary storage. [2025-09-14T18:36:59.629997] [INFO ] [MAIN ] ITUB: Loaded 23909 existing records. [2025-09-14T18:36:59.764055] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-14T18:36:59.820174] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:59.820509] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-14T18:36:59.820571] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-14T18:36:59.821383] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-14T18:36:59.821448] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-14T18:37:00.198416] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:00.271027] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T18:37:00.558885] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-14T18:37:01.358847] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-14T18:37:01.604841] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:37:01.608284] [INFO ] [REMOTE ] ITGR: Full fetch complete (33792 records). [2025-09-14T18:37:01.608427] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-14T18:37:02.011996] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-14T18:37:02.028077] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-14T18:37:02.041180] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-14T18:37:02.041452] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-14T18:37:02.043501] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-14T18:37:02.055190] [DEBUG] [LOCAL ] ITGR: Trimmed 33792 records to 22907 (keeping 150 days of data) [2025-09-14T18:37:02.159041] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-14T18:37:02.207705] [DEBUG] [LOCAL ] ITGR: Primary data saved (22907 records). [2025-09-14T18:37:02.207897] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-14T18:37:02.208019] [INFO ] [MAIN ] Update Progress: 1131/2370 symbols completed. ITGR took 25.1s. Estimated remaining: 2h 11m 17s. Rate: 9.4 symbols/min [2025-09-14T18:37:02.378963] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:02.398351] [DEBUG] [LOCAL ] ITW: Loaded 20232 existing records from primary storage. [2025-09-14T18:37:02.398537] [INFO ] [MAIN ] ITW: Loaded 20232 existing records. [2025-09-14T18:37:02.578779] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:02.579069] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-14T18:37:02.579138] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-14T18:37:02.579815] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-14T18:37:02.579880] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-14T18:37:02.933087] [INFO ] [REMOTE ] ITW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:02.946884] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T18:37:02.952198] [INFO ] [REMOTE ] IRT: Full fetch complete (54780 records). [2025-09-14T18:37:02.952362] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-14T18:37:02.964205] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-14T18:37:03.333729] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-14T18:37:03.333931] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-14T18:37:03.334869] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-14T18:37:03.334939] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-14T18:37:03.351898] [DEBUG] [LOCAL ] IRT: Trimmed 54780 records to 37875 (keeping 150 days of data) [2025-09-14T18:37:03.366719] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T18:37:03.619308] [DEBUG] [LOCAL ] IRT: Primary data saved (37875 records). [2025-09-14T18:37:03.619482] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-14T18:37:03.619598] [INFO ] [MAIN ] Update Progress: 1132/2370 symbols completed. IRT took 31.4s. Estimated remaining: 2h 11m 5s. Rate: 9.4 symbols/min [2025-09-14T18:37:03.761831] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-14T18:37:03.791852] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:03.813262] [DEBUG] [LOCAL ] IVR: Loaded 21303 existing records from primary storage. [2025-09-14T18:37:03.813423] [INFO ] [MAIN ] IVR: Loaded 21303 existing records. [2025-09-14T18:37:03.991927] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:03.992224] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-14T18:37:03.992289] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-14T18:37:03.992917] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-14T18:37:03.992979] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-14T18:37:04.343326] [INFO ] [REMOTE ] IVR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:04.558835] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-14T18:37:05.219334] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-14T18:37:05.358914] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-14T18:37:05.470841] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:37:06.158912] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-14T18:37:06.612762] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-14T18:37:06.958917] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-14T18:37:07.242618] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T18:37:07.307773] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:37:07.758862] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-14T18:37:08.558844] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-14T18:37:08.770806] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T18:37:09.358948] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-14T18:37:09.687283] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:37:09.824060] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T18:37:10.158862] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-14T18:37:10.958817] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-14T18:37:11.176458] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T18:37:11.758808] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-14T18:37:12.095023] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:37:12.558865] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-14T18:37:13.063961] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:37:13.358842] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-14T18:37:13.954350] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T18:37:14.158840] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-14T18:37:14.223068] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:37:14.958794] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-14T18:37:15.042873] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:37:15.758854] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-14T18:37:16.080865] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T18:37:16.558835] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-14T18:37:16.708265] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T18:37:17.358880] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-14T18:37:17.527987] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T18:37:17.984074] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T18:37:18.158871] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-14T18:37:18.934928] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:37:18.938019] [INFO ] [REMOTE ] ITT: Full fetch complete (36525 records). [2025-09-14T18:37:18.938120] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-14T18:37:18.968962] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-14T18:37:19.339934] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-14T18:37:19.340114] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-14T18:37:19.341563] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-14T18:37:19.341776] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-14T18:37:19.343835] [DEBUG] [LOCAL ] ITT: Trimmed 36525 records to 24053 (keeping 150 days of data) [2025-09-14T18:37:19.444791] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T18:37:19.561035] [DEBUG] [LOCAL ] ITT: Primary data saved (24053 records). [2025-09-14T18:37:19.561267] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-14T18:37:19.561410] [INFO ] [MAIN ] Update Progress: 1133/2370 symbols completed. ITT took 25.7s. Estimated remaining: 2h 11m 9s. Rate: 9.4 symbols/min [2025-09-14T18:37:19.743157] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:19.759476] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-14T18:37:19.761129] [DEBUG] [LOCAL ] IVT: Loaded 13702 existing records from primary storage. [2025-09-14T18:37:19.761329] [INFO ] [MAIN ] IVT: Loaded 13702 existing records. [2025-09-14T18:37:19.937209] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:19.937472] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-14T18:37:19.937531] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-14T18:37:19.938109] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-14T18:37:19.938172] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-14T18:37:20.286511] [INFO ] [REMOTE ] IVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:20.558779] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-14T18:37:20.726881] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:37:21.358832] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-14T18:37:21.626503] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T18:37:22.156944] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:37:22.166328] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-14T18:37:22.778068] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T18:37:22.958844] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-14T18:37:23.677216] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:37:23.758842] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-14T18:37:24.112365] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T18:37:24.117026] [INFO ] [REMOTE ] ITW: Full fetch complete (50652 records). [2025-09-14T18:37:24.117154] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-14T18:37:24.433316] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T18:37:24.456151] [INFO ] [REMOTE ] IVR: Full fetch complete (51785 records). [2025-09-14T18:37:24.488577] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-14T18:37:24.564741] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-14T18:37:24.565709] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-14T18:37:24.565784] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-14T18:37:24.593821] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-14T18:37:24.621699] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-14T18:37:24.691592] [DEBUG] [LOCAL ] ITW: Trimmed 50652 records to 34479 (keeping 150 days of data) [2025-09-14T18:37:25.010958] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-14T18:37:25.011552] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-14T18:37:25.013556] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-14T18:37:25.013851] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-14T18:37:25.016930] [DEBUG] [LOCAL ] IVR: Trimmed 51785 records to 35633 (keeping 150 days of data) [2025-09-14T18:37:25.335845] [DEBUG] [LOCAL ] IVR: Primary data saved (35633 records). [2025-09-14T18:37:25.336031] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-14T18:37:25.336155] [INFO ] [MAIN ] Update Progress: 1134/2370 symbols completed. IVR took 21.7s. Estimated remaining: 2h 11m 2s. Rate: 9.4 symbols/min [2025-09-14T18:37:25.367841] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-14T18:37:25.514931] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:25.523126] [DEBUG] [LOCAL ] ITW: Primary data saved (34479 records). [2025-09-14T18:37:25.523295] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-14T18:37:25.523496] [INFO ] [MAIN ] Update Progress: 1135/2370 symbols completed. ITW took 23.3s. Estimated remaining: 2h 10m 49s. Rate: 9.4 symbols/min [2025-09-14T18:37:25.636976] [DEBUG] [LOCAL ] IVZ: Loaded 23728 existing records from primary storage. [2025-09-14T18:37:25.652617] [INFO ] [MAIN ] IVZ: Loaded 23728 existing records. [2025-09-14T18:37:25.785454] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:25.884894] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:25.888658] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-14T18:37:25.888743] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-14T18:37:25.888932] [DEBUG] [LOCAL ] IX: Loaded 8945 existing records from primary storage. [2025-09-14T18:37:25.889089] [INFO ] [MAIN ] IX: Loaded 8945 existing records. [2025-09-14T18:37:25.894981] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-14T18:37:25.950606] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-14T18:37:26.202927] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:26.226306] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-14T18:37:26.266341] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-14T18:37:26.310238] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-14T18:37:26.354265] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-14T18:37:26.537090] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:26.537759] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-14T18:37:26.794819] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T18:37:26.821867] [INFO ] [REMOTE ] IX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:26.872386] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T18:37:26.958800] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-14T18:37:27.758876] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-14T18:37:28.203998] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T18:37:28.319929] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T18:37:28.558825] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-14T18:37:28.588394] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:37:29.358844] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-14T18:37:30.158829] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-14T18:37:30.444430] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:37:30.958816] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-14T18:37:31.275699] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T18:37:31.320677] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T18:37:31.758839] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-14T18:37:32.558861] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-14T18:37:32.997692] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T18:37:33.019290] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T18:37:33.358850] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-14T18:37:34.158885] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-14T18:37:34.216248] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T18:37:34.222069] [INFO ] [REMOTE ] ITUB: Full fetch complete (57969 records). [2025-09-14T18:37:34.222197] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-14T18:37:34.624438] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-14T18:37:34.624567] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-14T18:37:34.625858] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-14T18:37:34.626092] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-14T18:37:34.630711] [DEBUG] [LOCAL ] ITUB: Trimmed 57969 records to 40153 (keeping 150 days of data) [2025-09-14T18:37:34.756298] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T18:37:34.929469] [DEBUG] [LOCAL ] ITUB: Primary data saved (40153 records). [2025-09-14T18:37:34.929665] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-14T18:37:34.929801] [INFO ] [MAIN ] Update Progress: 1136/2370 symbols completed. ITUB took 35.5s. Estimated remaining: 2h 10m 46s. Rate: 9.4 symbols/min [2025-09-14T18:37:34.963916] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-14T18:37:35.108151] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:35.129627] [DEBUG] [LOCAL ] J: Loaded 17340 existing records from primary storage. [2025-09-14T18:37:35.129875] [INFO ] [MAIN ] J: Loaded 17340 existing records. [2025-09-14T18:37:35.323144] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:35.323506] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-14T18:37:35.323713] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-14T18:37:35.324489] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-14T18:37:35.324566] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-14T18:37:35.612703] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T18:37:35.734313] [INFO ] [REMOTE ] J: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:35.758833] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-14T18:37:36.558819] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-14T18:37:36.638011] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T18:37:37.314917] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:37:37.358801] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-14T18:37:37.553047] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T18:37:38.158931] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-14T18:37:38.958838] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-14T18:37:39.061138] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T18:37:39.423594] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:37:39.758858] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-14T18:37:40.427517] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:37:40.558840] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-14T18:37:41.358817] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-14T18:37:41.424706] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:37:41.912560] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:37:42.158831] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-14T18:37:42.958806] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-14T18:37:42.998532] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:37:43.347166] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T18:37:43.350412] [INFO ] [REMOTE ] IVT: Full fetch complete (33844 records). [2025-09-14T18:37:43.350523] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-14T18:37:43.729443] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-14T18:37:43.729614] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-14T18:37:43.730438] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-14T18:37:43.730506] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-14T18:37:43.732442] [DEBUG] [LOCAL ] IVT: Trimmed 33844 records to 22821 (keeping 150 days of data) [2025-09-14T18:37:43.792781] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-14T18:37:43.882242] [DEBUG] [LOCAL ] IVT: Primary data saved (22821 records). [2025-09-14T18:37:43.882414] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-14T18:37:43.882539] [INFO ] [MAIN ] Update Progress: 1137/2370 symbols completed. IVT took 24.3s. Estimated remaining: 2h 10m 43s. Rate: 9.4 symbols/min [2025-09-14T18:37:44.058088] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:44.078252] [DEBUG] [LOCAL ] JBGS: Loaded 18567 existing records from primary storage. [2025-09-14T18:37:44.078449] [INFO ] [MAIN ] JBGS: Loaded 18567 existing records. [2025-09-14T18:37:44.272040] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:44.272326] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-14T18:37:44.272404] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-14T18:37:44.273025] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-14T18:37:44.273093] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-14T18:37:44.567692] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-14T18:37:44.663488] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:44.719462] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T18:37:45.358870] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-14T18:37:45.918351] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:37:45.964205] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T18:37:46.158843] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-14T18:37:46.958919] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-14T18:37:47.074110] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T18:37:47.758866] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-14T18:37:48.028742] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:37:48.558844] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-14T18:37:48.726872] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:37:48.748480] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:37:49.227361] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:37:49.236376] [INFO ] [REMOTE ] IVZ: Full fetch complete (57723 records). [2025-09-14T18:37:49.236695] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-14T18:37:49.363893] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-14T18:37:49.653999] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-14T18:37:49.654112] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-14T18:37:49.655097] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-14T18:37:49.655179] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-14T18:37:49.656444] [DEBUG] [LOCAL ] IVZ: Trimmed 57723 records to 39955 (keeping 150 days of data) [2025-09-14T18:37:49.940288] [DEBUG] [LOCAL ] IVZ: Primary data saved (39955 records). [2025-09-14T18:37:49.940547] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-14T18:37:49.940792] [INFO ] [MAIN ] Update Progress: 1138/2370 symbols completed. IVZ took 24.6s. Estimated remaining: 2h 10m 36s. Rate: 9.4 symbols/min [2025-09-14T18:37:50.118430] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:50.127072] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:37:50.130422] [INFO ] [REMOTE ] IX: Full fetch complete (23694 records). [2025-09-14T18:37:50.130530] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-14T18:37:50.164091] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-14T18:37:50.254657] [DEBUG] [LOCAL ] JBI: Loaded 18248 existing records from primary storage. [2025-09-14T18:37:50.301296] [INFO ] [MAIN ] JBI: Loaded 18248 existing records. [2025-09-14T18:37:50.730088] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:50.736309] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-14T18:37:50.736715] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-14T18:37:50.736638] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-14T18:37:50.737396] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-14T18:37:50.737526] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-14T18:37:50.737592] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-14T18:37:50.738367] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-14T18:37:50.738541] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-14T18:37:50.770279] [DEBUG] [LOCAL ] IX: Trimmed 23694 records to 16716 (keeping 150 days of data) [2025-09-14T18:37:50.968800] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-14T18:37:51.185764] [INFO ] [REMOTE ] JBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:51.208723] [DEBUG] [LOCAL ] IX: Primary data saved (16716 records). [2025-09-14T18:37:51.208926] [INFO ] [MAIN ] IX: Full history saved. [2025-09-14T18:37:51.209056] [INFO ] [MAIN ] Update Progress: 1139/2370 symbols completed. IX took 25.7s. Estimated remaining: 2h 10m 24s. Rate: 9.4 symbols/min [2025-09-14T18:37:51.385385] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:51.407514] [DEBUG] [LOCAL ] JBL: Loaded 21764 existing records from primary storage. [2025-09-14T18:37:51.407729] [INFO ] [MAIN ] JBL: Loaded 21764 existing records. [2025-09-14T18:37:51.586883] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:51.587165] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-14T18:37:51.587223] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-14T18:37:51.587884] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-14T18:37:51.587946] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-14T18:37:51.764541] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-14T18:37:51.965398] [INFO ] [REMOTE ] JBL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:51.990889] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:37:52.558796] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-14T18:37:52.590379] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:37:53.358828] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-14T18:37:53.626277] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T18:37:54.158799] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-14T18:37:54.546142] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:37:54.861491] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:37:54.958827] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-14T18:37:55.758837] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-14T18:37:55.837398] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T18:37:56.558829] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-14T18:37:56.924127] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:37:57.358833] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-14T18:37:57.413779] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T18:37:58.158827] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-14T18:37:58.277588] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T18:37:58.816322] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:37:58.820852] [INFO ] [REMOTE ] J: Full fetch complete (44417 records). [2025-09-14T18:37:58.820981] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-14T18:37:58.967303] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-14T18:37:59.207151] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-14T18:37:59.207338] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-14T18:37:59.208173] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-14T18:37:59.208303] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-14T18:37:59.209698] [DEBUG] [LOCAL ] J: Trimmed 44417 records to 29890 (keeping 150 days of data) [2025-09-14T18:37:59.344010] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-14T18:37:59.464636] [DEBUG] [LOCAL ] J: Primary data saved (29890 records). [2025-09-14T18:37:59.464876] [INFO ] [MAIN ] J: Full history saved. [2025-09-14T18:37:59.464981] [INFO ] [MAIN ] Update Progress: 1140/2370 symbols completed. J took 24.5s. Estimated remaining: 2h 10m 20s. Rate: 9.4 symbols/min [2025-09-14T18:37:59.639924] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:59.658071] [DEBUG] [LOCAL ] JBND: Loaded 12005 existing records from primary storage. [2025-09-14T18:37:59.658347] [INFO ] [MAIN ] JBND: Loaded 12005 existing records. [2025-09-14T18:37:59.764009] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-14T18:37:59.861112] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:59.861529] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-14T18:37:59.861611] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-14T18:37:59.862264] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-14T18:37:59.862501] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-14T18:38:00.230740] [INFO ] [REMOTE ] JBND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:00.558855] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-14T18:38:00.719143] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T18:38:01.358884] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-14T18:38:01.706569] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T18:38:01.963614] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T18:38:02.158881] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-14T18:38:02.942231] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T18:38:02.958783] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-14T18:38:03.552414] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T18:38:03.758848] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-14T18:38:04.558834] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-14T18:38:04.610071] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:38:05.358804] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-14T18:38:05.822797] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T18:38:05.848538] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T18:38:06.158843] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-14T18:38:06.735883] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T18:38:06.958927] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-14T18:38:07.010843] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:38:07.758829] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-14T18:38:08.558861] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-14T18:38:08.940971] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T18:38:08.973122] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T18:38:09.358901] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-14T18:38:09.887875] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T18:38:09.892404] [INFO ] [REMOTE ] JBI: Full fetch complete (48166 records). [2025-09-14T18:38:09.892596] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-14T18:38:10.164009] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-14T18:38:10.288431] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-14T18:38:10.288535] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-14T18:38:10.289321] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-14T18:38:10.289377] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-14T18:38:10.290424] [DEBUG] [LOCAL ] JBI: Trimmed 48166 records to 32393 (keeping 150 days of data) [2025-09-14T18:38:10.481445] [DEBUG] [LOCAL ] JBI: Primary data saved (32393 records). [2025-09-14T18:38:10.481617] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-14T18:38:10.481751] [INFO ] [MAIN ] Update Progress: 1141/2370 symbols completed. JBI took 20.5s. Estimated remaining: 2h 10m 19s. Rate: 9.4 symbols/min [2025-09-14T18:38:10.654322] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:10.668460] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T18:38:10.692250] [DEBUG] [LOCAL ] JBS: Loaded 23682 existing records from primary storage. [2025-09-14T18:38:10.692398] [INFO ] [MAIN ] JBS: Loaded 23682 existing records. [2025-09-14T18:38:10.884211] [WARN ] [MAIN ] JBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:10.884467] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-14T18:38:10.884527] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-14T18:38:10.885208] [DEBUG] [LOCAL ] JBS: Deleted primary data file. [2025-09-14T18:38:10.885271] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-14T18:38:10.964352] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-14T18:38:11.244025] [INFO ] [REMOTE ] JBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:11.758903] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-14T18:38:12.115730] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T18:38:12.558902] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-14T18:38:12.762655] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:38:12.990222] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T18:38:13.270934] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:38:13.276021] [INFO ] [REMOTE ] JBL: Full fetch complete (52422 records). [2025-09-14T18:38:13.276179] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-14T18:38:13.364000] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-14T18:38:13.655275] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-14T18:38:13.655398] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-14T18:38:13.656301] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-14T18:38:13.656378] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-14T18:38:13.657576] [DEBUG] [LOCAL ] JBL: Trimmed 52422 records to 35773 (keeping 150 days of data) [2025-09-14T18:38:13.906724] [DEBUG] [LOCAL ] JBL: Primary data saved (35773 records). [2025-09-14T18:38:13.906914] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-14T18:38:13.907061] [INFO ] [MAIN ] Update Progress: 1142/2370 symbols completed. JBL took 22.7s. Estimated remaining: 2h 10m 9s. Rate: 9.4 symbols/min [2025-09-14T18:38:14.079151] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:14.095152] [DEBUG] [LOCAL ] JBTM: Loaded 14015 existing records from primary storage. [2025-09-14T18:38:14.095312] [INFO ] [MAIN ] JBTM: Loaded 14015 existing records. [2025-09-14T18:38:14.168005] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-14T18:38:14.273483] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:14.273798] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-14T18:38:14.273866] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-14T18:38:14.274428] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-09-14T18:38:14.274493] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-14T18:38:14.508625] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:38:14.560084] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-14T18:38:14.648169] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:14.802367] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:38:14.958865] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-14T18:38:15.758842] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-14T18:38:16.147690] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T18:38:16.151329] [INFO ] [REMOTE ] JBND: Full fetch complete (26273 records). [2025-09-14T18:38:16.151423] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-14T18:38:16.524063] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-14T18:38:16.524178] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-14T18:38:16.524835] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-14T18:38:16.524896] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-14T18:38:16.525748] [DEBUG] [LOCAL ] JBND: Trimmed 26273 records to 19070 (keeping 150 days of data) [2025-09-14T18:38:16.577239] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-14T18:38:16.645609] [DEBUG] [LOCAL ] JBND: Primary data saved (19070 records). [2025-09-14T18:38:16.645802] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-14T18:38:16.645966] [INFO ] [MAIN ] Update Progress: 1143/2370 symbols completed. JBND took 17.2s. Estimated remaining: 2h 9m 59s. Rate: 9.4 symbols/min [2025-09-14T18:38:16.815134] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:16.820345] [DEBUG] [LOCAL ] JCE: Loaded 3260 existing records from primary storage. [2025-09-14T18:38:16.820461] [INFO ] [MAIN ] JCE: Loaded 3260 existing records. [2025-09-14T18:38:16.998914] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:16.999202] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-14T18:38:16.999280] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-14T18:38:16.999684] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-14T18:38:16.999765] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-14T18:38:17.372186] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-14T18:38:17.372090] [INFO ] [REMOTE ] JCE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:17.403087] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:38:17.663322] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:38:17.663771] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-14T18:38:18.129464] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:38:18.158778] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-14T18:38:18.958899] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-14T18:38:19.054201] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T18:38:19.758900] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-14T18:38:20.490633] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T18:38:20.533883] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:38:20.558802] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-14T18:38:21.214896] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:38:21.219747] [INFO ] [REMOTE ] JBGS: Full fetch complete (45761 records). [2025-09-14T18:38:21.219928] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-14T18:38:21.364682] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-14T18:38:21.643581] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-14T18:38:21.643749] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-14T18:38:21.644526] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-14T18:38:21.644587] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-14T18:38:21.645848] [DEBUG] [LOCAL ] JBGS: Trimmed 45761 records to 31869 (keeping 150 days of data) [2025-09-14T18:38:21.857655] [DEBUG] [LOCAL ] JBGS: Primary data saved (31869 records). [2025-09-14T18:38:21.857833] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-14T18:38:21.857962] [INFO ] [MAIN ] Update Progress: 1144/2370 symbols completed. JBGS took 38.0s. Estimated remaining: 2h 9m 51s. Rate: 9.4 symbols/min [2025-09-14T18:38:22.031386] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:22.058470] [DEBUG] [LOCAL ] JCI: Loaded 23970 existing records from primary storage. [2025-09-14T18:38:22.058627] [INFO ] [MAIN ] JCI: Loaded 23970 existing records. [2025-09-14T18:38:22.159160] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-14T18:38:22.239456] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:22.239847] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-14T18:38:22.240042] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-14T18:38:22.245541] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-14T18:38:22.246557] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-14T18:38:22.246477] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T18:38:22.481621] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:38:22.541786] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-14T18:38:22.623388] [INFO ] [REMOTE ] JCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:22.958836] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-14T18:38:23.220864] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:38:23.221202] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-14T18:38:23.758844] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-14T18:38:24.558830] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-14T18:38:25.147011] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:38:25.190318] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T18:38:25.358846] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-14T18:38:26.158832] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-14T18:38:26.189395] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:38:26.958827] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-14T18:38:27.719810] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T18:38:27.746035] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:38:27.758771] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-14T18:38:28.558830] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-14T18:38:29.060884] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T18:38:29.292453] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T18:38:29.358786] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-14T18:38:30.158775] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-14T18:38:30.546493] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:38:30.832225] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:38:30.833851] [INFO ] [REMOTE ] JCE: Full fetch complete (6569 records). [2025-09-14T18:38:30.833939] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-14T18:38:30.972256] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-14T18:38:31.200628] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-14T18:38:31.200971] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-14T18:38:31.201192] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-14T18:38:31.201275] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-14T18:38:31.201822] [DEBUG] [LOCAL ] JCE: Trimmed 6569 records to 4706 (keeping 150 days of data) [2025-09-14T18:38:31.230312] [DEBUG] [LOCAL ] JCE: Primary data saved (4706 records). [2025-09-14T18:38:31.230419] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-14T18:38:31.230527] [INFO ] [MAIN ] Update Progress: 1145/2370 symbols completed. JCE took 14.6s. Estimated remaining: 2h 9m 48s. Rate: 9.4 symbols/min [2025-09-14T18:38:31.399197] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:31.425548] [DEBUG] [LOCAL ] JEF: Loaded 22051 existing records from primary storage. [2025-09-14T18:38:31.425752] [INFO ] [MAIN ] JEF: Loaded 22051 existing records. [2025-09-14T18:38:31.605703] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:31.605974] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-14T18:38:31.606033] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-14T18:38:31.606992] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-14T18:38:31.607057] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-14T18:38:31.778268] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-14T18:38:31.964379] [INFO ] [REMOTE ] JEF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:32.558782] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-14T18:38:33.100212] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-14T18:38:33.358883] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-14T18:38:34.005258] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-14T18:38:34.145460] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T18:38:34.158758] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-14T18:38:34.720725] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T18:38:34.958823] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-14T18:38:35.758894] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-14T18:38:36.287385] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T18:38:36.558830] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-14T18:38:36.944365] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T18:38:37.358814] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-14T18:38:37.530706] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:38:38.158814] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-14T18:38:38.216711] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:38:38.929419] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T18:38:38.958793] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-14T18:38:39.758834] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-14T18:38:39.797138] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T18:38:39.802495] [INFO ] [REMOTE ] JBS: Full fetch complete (23682 records). [2025-09-14T18:38:39.802594] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-14T18:38:39.994756] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 62 unique days, need 150 days [2025-09-14T18:38:39.995145] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:38:39.995204] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:38:39.995281] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-14T18:38:39.995370] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-14T18:38:39.995428] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-14T18:38:39.995521] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-14T18:38:39.995668] [INFO ] [MAIN ] Update Progress: 1146/2370 symbols completed. JBS took 29.5s. Estimated remaining: 2h 9m 44s. Rate: 9.4 symbols/min [2025-09-14T18:38:40.172430] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:40.192401] [DEBUG] [LOCAL ] JELD: Loaded 20114 existing records from primary storage. [2025-09-14T18:38:40.192558] [INFO ] [MAIN ] JELD: Loaded 20114 existing records. [2025-09-14T18:38:40.327215] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:38:40.399956] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:40.400198] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-14T18:38:40.400258] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-14T18:38:40.400791] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-14T18:38:40.400852] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-14T18:38:40.558913] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-14T18:38:40.757247] [INFO ] [REMOTE ] JELD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:41.364592] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-14T18:38:41.369228] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:38:41.373055] [INFO ] [REMOTE ] JBTM: Full fetch complete (35011 records). [2025-09-14T18:38:41.373148] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-14T18:38:41.747832] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-09-14T18:38:41.747957] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-09-14T18:38:41.748710] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-09-14T18:38:41.748771] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-09-14T18:38:41.749697] [DEBUG] [LOCAL ] JBTM: Trimmed 35011 records to 24291 (keeping 150 days of data) [2025-09-14T18:38:41.885448] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T18:38:41.948444] [DEBUG] [LOCAL ] JBTM: Primary data saved (24291 records). [2025-09-14T18:38:41.948632] [INFO ] [MAIN ] JBTM: Full history saved. [2025-09-14T18:38:41.948802] [INFO ] [MAIN ] Update Progress: 1147/2370 symbols completed. JBTM took 28.0s. Estimated remaining: 2h 9m 33s. Rate: 9.4 symbols/min [2025-09-14T18:38:42.121350] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:42.126826] [DEBUG] [LOCAL ] JEQ: Loaded 3748 existing records from primary storage. [2025-09-14T18:38:42.126948] [INFO ] [MAIN ] JEQ: Loaded 3748 existing records. [2025-09-14T18:38:42.163954] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-14T18:38:42.303627] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:42.303881] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-14T18:38:42.303949] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-14T18:38:42.304222] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-14T18:38:42.304281] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-14T18:38:42.658004] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:42.958846] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-14T18:38:43.062314] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T18:38:43.758889] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-14T18:38:43.776993] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T18:38:43.961566] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T18:38:44.558841] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-14T18:38:45.350725] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:38:45.359922] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-14T18:38:45.481841] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T18:38:46.158834] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-14T18:38:46.958859] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-14T18:38:47.398935] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T18:38:47.758853] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-14T18:38:47.969700] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:38:48.558854] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-14T18:38:48.727997] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:38:49.358847] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-14T18:38:49.714750] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T18:38:50.158844] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-14T18:38:50.299002] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:38:50.958855] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-14T18:38:51.034525] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:38:51.758851] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-14T18:38:51.799742] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T18:38:51.942347] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:38:52.558810] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-14T18:38:53.151116] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:38:53.354719] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T18:38:53.358760] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-14T18:38:54.027205] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T18:38:54.158816] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-14T18:38:54.958862] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-14T18:38:55.758924] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-14T18:38:55.894661] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T18:38:56.181576] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T18:38:56.430688] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T18:38:56.558875] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-14T18:38:57.358830] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-14T18:38:58.158862] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-14T18:38:58.196447] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T18:38:58.453422] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T18:38:58.958895] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-14T18:38:59.668778] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:38:59.670004] [INFO ] [REMOTE ] JEQ: Full fetch complete (9301 records). [2025-09-14T18:38:59.670100] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-14T18:38:59.766960] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-14T18:39:00.040385] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-14T18:39:00.040753] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-14T18:39:00.041025] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-14T18:39:00.041175] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-14T18:39:00.042063] [DEBUG] [LOCAL ] JEQ: Trimmed 9301 records to 5984 (keeping 150 days of data) [2025-09-14T18:39:00.101514] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T18:39:00.120351] [DEBUG] [LOCAL ] JEQ: Primary data saved (5984 records). [2025-09-14T18:39:00.120932] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-14T18:39:00.121056] [INFO ] [MAIN ] Update Progress: 1148/2370 symbols completed. JEQ took 18.2s. Estimated remaining: 2h 9m 40s. Rate: 9.4 symbols/min [2025-09-14T18:39:00.287993] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:00.303230] [DEBUG] [LOCAL ] JFR: Loaded 13627 existing records from primary storage. [2025-09-14T18:39:00.303384] [INFO ] [MAIN ] JFR: Loaded 13627 existing records. [2025-09-14T18:39:00.479840] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:00.480214] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-14T18:39:00.480318] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-14T18:39:00.486054] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-14T18:39:00.493293] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:39:00.493362] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-14T18:39:00.566816] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-14T18:39:00.529610] [INFO ] [REMOTE ] JEF: Full fetch complete (54481 records). [2025-09-14T18:39:00.598303] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-14T18:39:01.150332] [INFO ] [REMOTE ] JFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:01.238822] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-14T18:39:01.238935] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-14T18:39:01.239786] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-14T18:39:01.239847] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-14T18:39:01.241065] [DEBUG] [LOCAL ] JEF: Trimmed 54481 records to 37153 (keeping 150 days of data) [2025-09-14T18:39:01.359024] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-14T18:39:01.488986] [DEBUG] [LOCAL ] JEF: Primary data saved (37153 records). [2025-09-14T18:39:01.489210] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-14T18:39:01.489381] [INFO ] [MAIN ] Update Progress: 1149/2370 symbols completed. JEF took 30.3s. Estimated remaining: 2h 9m 28s. Rate: 9.4 symbols/min [2025-09-14T18:39:01.666591] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:01.682949] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T18:39:01.693881] [INFO ] [REMOTE ] JCI: Full fetch complete (58229 records). [2025-09-14T18:39:01.694150] [DEBUG] [LOCAL ] JGH: Loaded 5404 existing records from primary storage. [2025-09-14T18:39:01.694494] [INFO ] [MAIN ] JGH: Loaded 5404 existing records. [2025-09-14T18:39:01.694420] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-14T18:39:02.046575] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:02.080477] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-14T18:39:02.130037] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-14T18:39:02.163735] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-14T18:39:02.192316] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-14T18:39:02.205042] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-14T18:39:02.431184] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-14T18:39:02.467270] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-14T18:39:02.537580] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-14T18:39:02.585568] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-14T18:39:02.670096] [DEBUG] [LOCAL ] JCI: Trimmed 58229 records to 40310 (keeping 150 days of data) [2025-09-14T18:39:02.674258] [INFO ] [REMOTE ] JGH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:02.959476] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-14T18:39:02.960116] [DEBUG] [LOCAL ] JCI: Primary data saved (40310 records). [2025-09-14T18:39:02.961166] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-14T18:39:02.961304] [INFO ] [MAIN ] Update Progress: 1150/2370 symbols completed. JCI took 41.1s. Estimated remaining: 2h 9m 16s. Rate: 9.4 symbols/min [2025-09-14T18:39:03.135199] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:03.156072] [DEBUG] [LOCAL ] JHG: Loaded 20795 existing records from primary storage. [2025-09-14T18:39:03.156284] [INFO ] [MAIN ] JHG: Loaded 20795 existing records. [2025-09-14T18:39:03.336523] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:03.336821] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-14T18:39:03.336919] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-14T18:39:03.337526] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-14T18:39:03.337590] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-14T18:39:03.714263] [INFO ] [REMOTE ] JHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:03.758791] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-14T18:39:04.954974] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (3.60 seconds). [2025-09-14T18:39:04.960132] [INFO ] [REMOTE ] JELD: Full fetch complete (49987 records). [2025-09-14T18:39:04.960299] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-14T18:39:05.297022] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-14T18:39:05.346576] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-14T18:39:05.349114] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-14T18:39:05.349189] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-14T18:39:05.350980] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-14T18:39:05.351128] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-14T18:39:05.352247] [DEBUG] [LOCAL ] JELD: Trimmed 49987 records to 34820 (keeping 150 days of data) [2025-09-14T18:39:05.556560] [DEBUG] [LOCAL ] JELD: Primary data saved (34820 records). [2025-09-14T18:39:05.556764] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-14T18:39:05.556886] [INFO ] [MAIN ] Update Progress: 1151/2370 symbols completed. JELD took 25.6s. Estimated remaining: 2h 9m 6s. Rate: 9.4 symbols/min [2025-09-14T18:39:05.724534] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:05.727781] [DEBUG] [LOCAL ] JHI: Loaded 1417 existing records from primary storage. [2025-09-14T18:39:05.727879] [INFO ] [MAIN ] JHI: Loaded 1417 existing records. [2025-09-14T18:39:05.905951] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:05.906507] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-14T18:39:05.906699] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-14T18:39:05.907050] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-14T18:39:05.907194] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-14T18:39:06.085859] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T18:39:06.093569] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (3.93 seconds). [2025-09-14T18:39:06.124450] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-14T18:39:06.160113] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-14T18:39:06.258232] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-14T18:39:06.347151] [INFO ] [REMOTE ] JHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:06.958855] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-14T18:39:07.145553] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T18:39:07.258851] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T18:39:07.758867] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-14T18:39:08.436793] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:39:08.558829] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-14T18:39:09.278297] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T18:39:09.279143] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T18:39:09.358806] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-14T18:39:10.158828] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-14T18:39:10.598557] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T18:39:10.958870] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-14T18:39:11.758860] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-14T18:39:11.929948] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:39:11.959159] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T18:39:12.371692] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T18:39:12.558916] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-14T18:39:13.358906] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-14T18:39:14.164299] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-14T18:39:14.173917] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:39:14.436102] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:39:14.958865] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-14T18:39:15.758909] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-14T18:39:16.210257] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T18:39:16.558920] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-14T18:39:16.688662] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-14T18:39:17.191624] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T18:39:17.358856] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-14T18:39:17.436229] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:39:18.158816] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-14T18:39:18.358423] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:39:18.786163] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T18:39:18.958811] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-14T18:39:19.758839] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-14T18:39:19.823684] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:39:20.558848] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-14T18:39:21.358862] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-14T18:39:21.424672] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T18:39:21.426951] [INFO ] [REMOTE ] JGH: Full fetch complete (11413 records). [2025-09-14T18:39:21.427050] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-14T18:39:21.788955] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-14T18:39:21.802588] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-14T18:39:21.808027] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-14T18:39:21.823792] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-14T18:39:21.823934] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-14T18:39:21.826361] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T18:39:21.836776] [DEBUG] [LOCAL ] JGH: Trimmed 11413 records to 8181 (keeping 150 days of data) [2025-09-14T18:39:21.893447] [DEBUG] [LOCAL ] JGH: Primary data saved (8181 records). [2025-09-14T18:39:21.893687] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-14T18:39:21.893805] [INFO ] [MAIN ] Update Progress: 1152/2370 symbols completed. JGH took 20.4s. Estimated remaining: 2h 9m 10s. Rate: 9.4 symbols/min [2025-09-14T18:39:22.066915] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:22.070971] [DEBUG] [LOCAL ] JHS: Loaded 1573 existing records from primary storage. [2025-09-14T18:39:22.071097] [INFO ] [MAIN ] JHS: Loaded 1573 existing records. [2025-09-14T18:39:22.164044] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-14T18:39:22.249542] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:22.249813] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-14T18:39:22.249874] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-14T18:39:22.250083] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-14T18:39:22.250147] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-14T18:39:22.596794] [INFO ] [REMOTE ] JHS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:22.958842] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-14T18:39:23.758863] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-14T18:39:23.857151] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T18:39:23.896378] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T18:39:24.230382] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:39:24.232227] [INFO ] [REMOTE ] JHI: Full fetch complete (3943 records). [2025-09-14T18:39:24.232368] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-14T18:39:24.563952] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-14T18:39:24.619425] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-14T18:39:24.619530] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-14T18:39:24.619730] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-14T18:39:24.619786] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-14T18:39:24.620154] [DEBUG] [LOCAL ] JHI: Trimmed 3943 records to 2528 (keeping 150 days of data) [2025-09-14T18:39:24.636823] [DEBUG] [LOCAL ] JHI: Primary data saved (2528 records). [2025-09-14T18:39:24.636907] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-14T18:39:24.637012] [INFO ] [MAIN ] Update Progress: 1153/2370 symbols completed. JHI took 19.1s. Estimated remaining: 2h 8m 60s. Rate: 9.4 symbols/min [2025-09-14T18:39:24.810014] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:24.840962] [DEBUG] [LOCAL ] JHX: Loaded 23886 existing records from primary storage. [2025-09-14T18:39:24.841134] [INFO ] [MAIN ] JHX: Loaded 23886 existing records. [2025-09-14T18:39:25.020421] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:25.020697] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-14T18:39:25.020779] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-14T18:39:25.021423] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-14T18:39:25.021490] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-14T18:39:25.371722] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-14T18:39:25.376023] [INFO ] [REMOTE ] JHX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:25.925184] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T18:39:25.959667] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:39:26.158858] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-14T18:39:26.958842] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-14T18:39:27.481700] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T18:39:27.485178] [INFO ] [REMOTE ] JFR: Full fetch complete (34737 records). [2025-09-14T18:39:27.485315] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-14T18:39:27.763940] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-14T18:39:27.870302] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-14T18:39:27.870421] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-14T18:39:27.871125] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-14T18:39:27.871184] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-14T18:39:27.872199] [DEBUG] [LOCAL ] JFR: Trimmed 34737 records to 21807 (keeping 150 days of data) [2025-09-14T18:39:28.025719] [DEBUG] [LOCAL ] JFR: Primary data saved (21807 records). [2025-09-14T18:39:28.025889] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-14T18:39:28.026014] [INFO ] [MAIN ] Update Progress: 1154/2370 symbols completed. JFR took 27.9s. Estimated remaining: 2h 8m 50s. Rate: 9.4 symbols/min [2025-09-14T18:39:28.196157] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:28.205603] [DEBUG] [LOCAL ] JILL: Loaded 6963 existing records from primary storage. [2025-09-14T18:39:28.205754] [INFO ] [MAIN ] JILL: Loaded 6963 existing records. [2025-09-14T18:39:28.384517] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:28.384819] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-14T18:39:28.384883] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-14T18:39:28.385216] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-14T18:39:28.385274] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-14T18:39:28.564288] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-14T18:39:28.751110] [INFO ] [REMOTE ] JILL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:28.803620] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T18:39:28.866900] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T18:39:29.358861] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-14T18:39:30.158835] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-14T18:39:30.322317] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:39:30.522183] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-14T18:39:30.657688] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T18:39:30.958846] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-14T18:39:31.648942] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T18:39:31.758851] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-14T18:39:32.558829] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-14T18:39:32.775006] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T18:39:33.358824] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-14T18:39:34.158827] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-14T18:39:34.320267] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T18:39:34.373836] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T18:39:34.958830] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-14T18:39:35.596083] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:39:35.601841] [INFO ] [REMOTE ] JHG: Full fetch complete (52103 records). [2025-09-14T18:39:35.602268] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-14T18:39:35.768483] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-14T18:39:36.038580] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-14T18:39:36.038741] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-14T18:39:36.039766] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-14T18:39:36.039850] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-14T18:39:36.041521] [DEBUG] [LOCAL ] JHG: Trimmed 52103 records to 35896 (keeping 150 days of data) [2025-09-14T18:39:36.189673] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T18:39:36.310575] [DEBUG] [LOCAL ] JHG: Primary data saved (35896 records). [2025-09-14T18:39:36.310766] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-14T18:39:36.310895] [INFO ] [MAIN ] Update Progress: 1155/2370 symbols completed. JHG took 33.3s. Estimated remaining: 2h 8m 46s. Rate: 9.4 symbols/min [2025-09-14T18:39:36.480856] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:36.504735] [DEBUG] [LOCAL ] JKS: Loaded 17278 existing records from primary storage. [2025-09-14T18:39:36.504954] [INFO ] [MAIN ] JKS: Loaded 17278 existing records. [2025-09-14T18:39:36.568975] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-14T18:39:36.620337] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T18:39:36.698394] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:36.698632] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-14T18:39:36.698708] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-14T18:39:36.699240] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-14T18:39:36.699303] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-14T18:39:37.067466] [INFO ] [REMOTE ] JKS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:37.358850] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-14T18:39:37.704248] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T18:39:38.158864] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-14T18:39:38.958869] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-14T18:39:39.180360] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T18:39:39.758893] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-14T18:39:39.961151] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T18:39:39.986146] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:39:40.374843] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:39:40.558889] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-14T18:39:41.358873] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-14T18:39:41.939571] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:39:41.940825] [INFO ] [REMOTE ] JHS: Full fetch complete (3250 records). [2025-09-14T18:39:41.940908] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-14T18:39:42.164013] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-14T18:39:42.312347] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-14T18:39:42.312464] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-14T18:39:42.312728] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-14T18:39:42.312795] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-14T18:39:42.313443] [DEBUG] [LOCAL ] JHS: Trimmed 3250 records to 2243 (keeping 150 days of data) [2025-09-14T18:39:42.352205] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T18:39:42.364540] [DEBUG] [LOCAL ] JHS: Primary data saved (2243 records). [2025-09-14T18:39:42.364673] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-14T18:39:42.364781] [INFO ] [MAIN ] Update Progress: 1156/2370 symbols completed. JHS took 20.5s. Estimated remaining: 2h 8m 39s. Rate: 9.4 symbols/min [2025-09-14T18:39:42.542669] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:42.566688] [DEBUG] [LOCAL ] JLL: Loaded 14877 existing records from primary storage. [2025-09-14T18:39:42.566926] [INFO ] [MAIN ] JLL: Loaded 14877 existing records. [2025-09-14T18:39:42.763551] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:42.763977] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-14T18:39:42.764143] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-14T18:39:42.764869] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-14T18:39:42.764951] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-14T18:39:42.970398] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-14T18:39:43.119713] [INFO ] [REMOTE ] JLL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:43.306270] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:39:43.758887] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-14T18:39:44.558834] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-14T18:39:44.869461] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T18:39:45.358897] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-14T18:39:45.443096] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:39:45.597717] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T18:39:46.158860] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-14T18:39:46.958859] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-14T18:39:47.040451] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:39:47.653762] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T18:39:47.758839] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-14T18:39:48.558884] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-14T18:39:48.823590] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:39:49.358844] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-14T18:39:49.490504] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:39:49.705406] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T18:39:50.158832] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-14T18:39:50.958885] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-14T18:39:51.067626] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:39:51.711305] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:39:51.758777] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-14T18:39:52.558820] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-14T18:39:52.703541] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-14T18:39:52.709117] [INFO ] [REMOTE ] JHX: Full fetch complete (49137 records). [2025-09-14T18:39:52.709250] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-14T18:39:53.103298] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-14T18:39:53.103512] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-14T18:39:53.104472] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-14T18:39:53.104617] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-14T18:39:53.106262] [DEBUG] [LOCAL ] JHX: Trimmed 49137 records to 39971 (keeping 150 days of data) [2025-09-14T18:39:53.207176] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:39:53.229699] [INFO ] [REMOTE ] JILL: Full fetch complete (17701 records). [2025-09-14T18:39:53.235309] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-14T18:39:53.268577] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:39:53.361234] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-14T18:39:53.777150] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-14T18:39:53.778733] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-14T18:39:53.779963] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-14T18:39:53.780989] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-14T18:39:53.784806] [DEBUG] [LOCAL ] JILL: Trimmed 17701 records to 11746 (keeping 150 days of data) [2025-09-14T18:39:53.866521] [DEBUG] [LOCAL ] JILL: Primary data saved (11746 records). [2025-09-14T18:39:53.867579] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-14T18:39:53.868344] [INFO ] [MAIN ] Update Progress: 1157/2370 symbols completed. JILL took 25.8s. Estimated remaining: 2h 8m 39s. Rate: 9.4 symbols/min [2025-09-14T18:39:53.873675] [DEBUG] [LOCAL ] JHX: Primary data saved (39971 records). [2025-09-14T18:39:53.873902] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-14T18:39:53.874016] [INFO ] [MAIN ] Update Progress: 1158/2370 symbols completed. JHX took 29.2s. Estimated remaining: 2h 8m 25s. Rate: 9.4 symbols/min [2025-09-14T18:39:54.158904] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-14T18:39:54.949662] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T18:39:54.958764] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-14T18:39:55.518587] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T18:39:55.758817] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-14T18:39:56.621245] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T18:39:56.630350] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-14T18:39:57.201418] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:39:57.358858] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-14T18:39:58.083534] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T18:39:58.158782] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-14T18:39:58.538967] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:39:58.958818] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-14T18:39:59.509918] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T18:39:59.514267] [INFO ] [REMOTE ] JKS: Full fetch complete (43917 records). [2025-09-14T18:39:59.514371] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-14T18:39:59.816192] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T18:39:59.838594] [INFO ] [REMOTE ] JLL: Full fetch complete (35293 records). [2025-09-14T18:39:59.874390] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-14T18:39:59.969220] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-14T18:39:59.983266] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-14T18:40:00.014049] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-14T18:40:00.043917] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-14T18:40:00.105946] [DEBUG] [LOCAL ] JKS: Trimmed 43917 records to 28986 (keeping 150 days of data) [2025-09-14T18:40:00.416184] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-14T18:40:00.417030] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-14T18:40:00.418502] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-14T18:40:00.418907] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-14T18:40:00.422208] [DEBUG] [LOCAL ] JLL: Trimmed 35293 records to 24398 (keeping 150 days of data) [2025-09-14T18:40:00.632295] [DEBUG] [LOCAL ] JKS: Primary data saved (28986 records). [2025-09-14T18:40:00.634781] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-14T18:40:00.634985] [INFO ] [MAIN ] Update Progress: 1159/2370 symbols completed. JKS took 24.3s. Estimated remaining: 2h 8m 20s. Rate: 9.4 symbols/min [2025-09-14T18:40:00.662542] [DEBUG] [LOCAL ] JLL: Primary data saved (24398 records). [2025-09-14T18:40:00.662744] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-14T18:40:00.662874] [INFO ] [MAIN ] Update Progress: 1160/2370 symbols completed. JLL took 18.3s. Estimated remaining: 2h 8m 7s. Rate: 9.4 symbols/min [2025-09-14T18:40:01.176569] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:01.244809] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:01.382112] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:01.406715] [DEBUG] [LOCAL ] JLS: Loaded 1639 existing records from primary storage. [2025-09-14T18:40:01.404051] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:01.407283] [INFO ] [MAIN ] JLS: Loaded 1639 existing records. [2025-09-14T18:40:01.491878] [DEBUG] [LOCAL ] JMM: Loaded 795 existing records from primary storage. [2025-09-14T18:40:01.524320] [INFO ] [MAIN ] JMM: Loaded 795 existing records. [2025-09-14T18:40:01.614794] [DEBUG] [LOCAL ] JMIA: Loaded 23232 existing records from primary storage. [2025-09-14T18:40:01.677528] [DEBUG] [LOCAL ] JNJ: Loaded 24164 existing records from primary storage. [2025-09-14T18:40:01.677667] [INFO ] [MAIN ] JMIA: Loaded 23232 existing records. [2025-09-14T18:40:01.746739] [INFO ] [MAIN ] JNJ: Loaded 24164 existing records. [2025-09-14T18:40:01.762383] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:01.891583] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-14T18:40:01.966615] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-14T18:40:02.073929] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-14T18:40:02.160299] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-14T18:40:02.145169] [WARN ] [MAIN ] JMM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:02.224075] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:02.241339] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-14T18:40:02.275339] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-14T18:40:02.291478] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:02.291336] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-14T18:40:02.310292] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-14T18:40:02.326343] [DEBUG] [LOCAL ] JMM: Deleted primary data file. [2025-09-14T18:40:02.326429] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-14T18:40:02.343364] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-14T18:40:02.354084] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-14T18:40:02.364510] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-14T18:40:02.411671] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-14T18:40:02.512362] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-14T18:40:02.578307] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-14T18:40:03.544800] [INFO ] [REMOTE ] JLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:03.565860] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-14T18:40:03.644752] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:03.671821] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-14T18:40:03.755070] [INFO ] [REMOTE ] JMM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:03.792910] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-14T18:40:03.792448] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:03.793976] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-14T18:40:04.619843] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:40:04.621287] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-14T18:40:04.631347] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T18:40:04.632355] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-14T18:40:05.075323] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T18:40:05.077019] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-14T18:40:05.151948] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T18:40:05.358906] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-14T18:40:05.914045] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T18:40:05.984294] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-14T18:40:06.072046] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-14T18:40:06.090210] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T18:40:06.158875] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-14T18:40:06.732178] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T18:40:06.958841] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-14T18:40:07.758852] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-14T18:40:08.558929] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-14T18:40:08.884812] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:40:09.199664] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T18:40:09.358871] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-14T18:40:09.991738] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T18:40:10.158791] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-14T18:40:10.190268] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-14T18:40:10.890227] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T18:40:10.958801] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-14T18:40:11.758875] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-14T18:40:12.207410] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T18:40:12.558803] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-14T18:40:12.891481] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:40:13.112594] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T18:40:13.358885] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-14T18:40:14.158942] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-14T18:40:14.692091] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T18:40:14.958888] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-14T18:40:15.758839] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-14T18:40:15.841228] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:40:15.842105] [INFO ] [REMOTE ] JMM: Full fetch complete (1963 records). [2025-09-14T18:40:15.842195] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-14T18:40:16.036132] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-14T18:40:16.068964] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T18:40:16.069627] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:40:16.070096] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:40:16.070156] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-14T18:40:16.070240] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-14T18:40:16.070294] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-14T18:40:16.070366] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-14T18:40:16.070456] [INFO ] [MAIN ] Update Progress: 1161/2370 symbols completed. JMM took 15.4s. Estimated remaining: 2h 8m 10s. Rate: 9.4 symbols/min [2025-09-14T18:40:16.238900] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:16.263810] [DEBUG] [LOCAL ] JOBY: Loaded 24178 existing records from primary storage. [2025-09-14T18:40:16.263981] [INFO ] [MAIN ] JOBY: Loaded 24178 existing records. [2025-09-14T18:40:16.441496] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:16.441818] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-14T18:40:16.441903] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-14T18:40:16.442568] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-14T18:40:16.442638] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-14T18:40:16.563988] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-14T18:40:16.830173] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:17.358875] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-14T18:40:17.456703] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:40:18.158929] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-14T18:40:18.267084] [DEBUG] [REMOTE ] JMIA: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-14T18:40:18.267598] [WARN ] [REMOTE ] JMIA: No data returned for month 2025-06 [2025-09-14T18:40:18.958862] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-14T18:40:19.320064] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-14T18:40:19.758888] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-14T18:40:19.877987] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-14T18:40:20.558835] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-14T18:40:20.912148] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T18:40:21.358910] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-14T18:40:21.960467] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-14T18:40:22.158891] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-14T18:40:22.897567] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-14T18:40:22.958768] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-14T18:40:23.486656] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-14T18:40:23.758858] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-14T18:40:24.392905] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T18:40:24.558851] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-14T18:40:25.358846] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-14T18:40:25.452756] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-14T18:40:25.514321] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-14T18:40:25.520135] [INFO ] [REMOTE ] JMIA: Full fetch complete (47403 records). [2025-09-14T18:40:25.520300] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-14T18:40:25.707976] [WARN ] [VALIDATOR ] JMIA: Validation failed - insufficient historical data. Have 130 unique days, need 150 days [2025-09-14T18:40:25.708611] [FATAL] [MAIN ] JMIA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:40:25.708728] [WARN ] [MAIN ] JMIA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:40:25.708788] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-14T18:40:25.708866] [DEBUG] [LOCAL ] JMIA: No primary data file found to delete. [2025-09-14T18:40:25.708915] [INFO ] [LOCAL ] JMIA: Starting deletion of derivative data. [2025-09-14T18:40:25.708969] [DEBUG] [LOCAL ] JMIA: No derivative data file found to delete. [2025-09-14T18:40:25.709061] [INFO ] [MAIN ] Update Progress: 1162/2370 symbols completed. JMIA took 25.0s. Estimated remaining: 2h 8m 7s. Rate: 9.4 symbols/min [2025-09-14T18:40:25.892170] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:25.904316] [DEBUG] [LOCAL ] JOE: Loaded 10211 existing records from primary storage. [2025-09-14T18:40:25.904484] [INFO ] [MAIN ] JOE: Loaded 10211 existing records. [2025-09-14T18:40:26.084839] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T18:40:26.090082] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:26.092081] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-14T18:40:26.092147] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-14T18:40:26.092699] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-14T18:40:26.092761] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-14T18:40:26.168684] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-14T18:40:26.453171] [INFO ] [REMOTE ] JOE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:26.759309] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:40:26.760537] [INFO ] [REMOTE ] JLS: Full fetch complete (4391 records). [2025-09-14T18:40:26.760657] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-14T18:40:26.963950] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-14T18:40:27.157465] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-14T18:40:27.228949] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-14T18:40:27.229075] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-14T18:40:27.229573] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-14T18:40:27.229632] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-14T18:40:27.230212] [DEBUG] [LOCAL ] JLS: Trimmed 4391 records to 2934 (keeping 150 days of data) [2025-09-14T18:40:27.250444] [DEBUG] [LOCAL ] JLS: Primary data saved (2934 records). [2025-09-14T18:40:27.250590] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-14T18:40:27.250758] [INFO ] [MAIN ] Update Progress: 1163/2370 symbols completed. JLS took 26.6s. Estimated remaining: 2h 7m 55s. Rate: 9.4 symbols/min [2025-09-14T18:40:27.417003] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:27.422409] [DEBUG] [LOCAL ] JOF: Loaded 3354 existing records from primary storage. [2025-09-14T18:40:27.422516] [INFO ] [MAIN ] JOF: Loaded 3354 existing records. [2025-09-14T18:40:27.594366] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:27.594624] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-14T18:40:27.594701] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-14T18:40:27.595024] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-14T18:40:27.595084] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-14T18:40:27.763128] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-14T18:40:27.946432] [INFO ] [REMOTE ] JOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:28.558846] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-14T18:40:29.358795] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-14T18:40:29.491181] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:40:29.555058] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T18:40:29.672878] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-14T18:40:30.029686] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:40:30.035303] [INFO ] [REMOTE ] JNJ: Full fetch complete (58433 records). [2025-09-14T18:40:30.035438] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-14T18:40:30.174590] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-14T18:40:30.413854] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-14T18:40:30.413954] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-14T18:40:30.414813] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-14T18:40:30.414876] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-14T18:40:30.416124] [DEBUG] [LOCAL ] JNJ: Trimmed 58433 records to 40493 (keeping 150 days of data) [2025-09-14T18:40:30.678473] [DEBUG] [LOCAL ] JNJ: Primary data saved (40493 records). [2025-09-14T18:40:30.678627] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-14T18:40:30.678735] [INFO ] [MAIN ] Update Progress: 1164/2370 symbols completed. JNJ took 30.0s. Estimated remaining: 2h 7m 46s. Rate: 9.4 symbols/min [2025-09-14T18:40:30.849752] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:30.866737] [DEBUG] [LOCAL ] JPC: Loaded 16463 existing records from primary storage. [2025-09-14T18:40:30.866896] [INFO ] [MAIN ] JPC: Loaded 16463 existing records. [2025-09-14T18:40:30.964372] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-14T18:40:31.040685] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:31.040937] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-14T18:40:31.041005] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-14T18:40:31.041669] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-14T18:40:31.041734] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-14T18:40:31.387517] [INFO ] [REMOTE ] JPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:31.590128] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T18:40:31.758826] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-14T18:40:31.914945] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T18:40:32.558821] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-14T18:40:33.358824] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-14T18:40:33.393318] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T18:40:33.516065] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:40:34.158828] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-14T18:40:34.839543] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T18:40:34.958795] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-14T18:40:35.758828] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-14T18:40:35.972998] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-14T18:40:36.174345] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T18:40:36.284059] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:40:36.558830] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-14T18:40:37.319181] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T18:40:37.358836] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-14T18:40:38.158938] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-14T18:40:38.211713] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T18:40:38.958865] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-14T18:40:39.276198] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:40:39.758872] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-14T18:40:40.565982] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-14T18:40:40.570756] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:40:41.358864] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-14T18:40:41.709133] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:40:42.072977] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:40:42.075117] [INFO ] [REMOTE ] JOF: Full fetch complete (7483 records). [2025-09-14T18:40:42.075232] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-14T18:40:42.166305] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-14T18:40:42.454989] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-14T18:40:42.455119] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-14T18:40:42.455347] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-14T18:40:42.455407] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-14T18:40:42.456636] [DEBUG] [LOCAL ] JOF: Trimmed 7483 records to 5158 (keeping 150 days of data) [2025-09-14T18:40:42.489182] [DEBUG] [LOCAL ] JOF: Primary data saved (5158 records). [2025-09-14T18:40:42.489440] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-14T18:40:42.489575] [INFO ] [MAIN ] Update Progress: 1165/2370 symbols completed. JOF took 15.2s. Estimated remaining: 2h 7m 45s. Rate: 9.4 symbols/min [2025-09-14T18:40:42.660228] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:42.703435] [DEBUG] [LOCAL ] JPI: Loaded 2039 existing records from primary storage. [2025-09-14T18:40:42.703938] [INFO ] [MAIN ] JPI: Loaded 2039 existing records. [2025-09-14T18:40:42.749451] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-09-14T18:40:42.899466] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:42.899742] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-14T18:40:42.899813] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-14T18:40:42.900063] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-14T18:40:42.900123] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-14T18:40:42.964004] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-14T18:40:43.257619] [INFO ] [REMOTE ] JPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:43.481547] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T18:40:43.758838] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-14T18:40:44.356946] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T18:40:44.408031] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T18:40:44.558839] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-14T18:40:45.358870] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-14T18:40:45.767329] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T18:40:46.158846] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-14T18:40:46.555556] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T18:40:46.722344] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:40:46.727746] [INFO ] [REMOTE ] JOE: Full fetch complete (27011 records). [2025-09-14T18:40:46.728010] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-14T18:40:46.965438] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-14T18:40:47.105318] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-14T18:40:47.105440] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-14T18:40:47.106135] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-14T18:40:47.106197] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-14T18:40:47.107037] [DEBUG] [LOCAL ] JOE: Trimmed 27011 records to 17984 (keeping 150 days of data) [2025-09-14T18:40:47.218954] [DEBUG] [LOCAL ] JOE: Primary data saved (17984 records). [2025-09-14T18:40:47.219160] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-14T18:40:47.219274] [INFO ] [MAIN ] Update Progress: 1166/2370 symbols completed. JOE took 21.5s. Estimated remaining: 2h 7m 37s. Rate: 9.4 symbols/min [2025-09-14T18:40:47.387776] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:47.413697] [DEBUG] [LOCAL ] JPM: Loaded 24205 existing records from primary storage. [2025-09-14T18:40:47.413864] [INFO ] [MAIN ] JPM: Loaded 24205 existing records. [2025-09-14T18:40:47.589805] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:47.590078] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-14T18:40:47.590139] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-14T18:40:47.591002] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-14T18:40:47.591087] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-14T18:40:47.731977] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T18:40:47.778634] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-14T18:40:47.961947] [INFO ] [REMOTE ] JPM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:48.558860] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-14T18:40:49.352504] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:40:49.359520] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-14T18:40:49.370437] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T18:40:50.158845] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-14T18:40:50.958899] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-14T18:40:51.108746] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T18:40:51.758841] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-14T18:40:52.189771] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-14T18:40:52.257994] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T18:40:52.558788] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-14T18:40:52.676556] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T18:40:53.358880] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-14T18:40:54.158850] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-14T18:40:54.853728] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:40:54.922000] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T18:40:54.958787] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-14T18:40:55.030537] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-14T18:40:55.037218] [INFO ] [REMOTE ] JOBY: Full fetch complete (58475 records). [2025-09-14T18:40:55.037424] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-14T18:40:55.420056] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-14T18:40:55.420169] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-14T18:40:55.421079] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-14T18:40:55.421144] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-14T18:40:55.422446] [DEBUG] [LOCAL ] JOBY: Trimmed 58475 records to 40550 (keeping 150 days of data) [2025-09-14T18:40:55.638874] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T18:40:55.679651] [DEBUG] [LOCAL ] JOBY: Primary data saved (40550 records). [2025-09-14T18:40:55.679814] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-14T18:40:55.679935] [INFO ] [MAIN ] Update Progress: 1167/2370 symbols completed. JOBY took 39.6s. Estimated remaining: 2h 7m 33s. Rate: 9.4 symbols/min [2025-09-14T18:40:55.763966] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-14T18:40:55.849100] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:55.865146] [DEBUG] [LOCAL ] JQC: Loaded 15015 existing records from primary storage. [2025-09-14T18:40:55.865309] [INFO ] [MAIN ] JQC: Loaded 15015 existing records. [2025-09-14T18:40:56.041504] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:56.041792] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-14T18:40:56.041856] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-14T18:40:56.042351] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-14T18:40:56.042420] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-14T18:40:56.393152] [INFO ] [REMOTE ] JQC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:56.558820] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-14T18:40:57.118706] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T18:40:57.122793] [INFO ] [REMOTE ] JPC: Full fetch complete (40703 records). [2025-09-14T18:40:57.122892] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-14T18:40:57.235340] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:40:57.364090] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-14T18:40:57.514836] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-14T18:40:57.514946] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-14T18:40:57.515796] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-14T18:40:57.515874] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-14T18:40:57.516856] [DEBUG] [LOCAL ] JPC: Trimmed 40703 records to 27300 (keeping 150 days of data) [2025-09-14T18:40:57.686949] [DEBUG] [LOCAL ] JPC: Primary data saved (27300 records). [2025-09-14T18:40:57.687122] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-14T18:40:57.687245] [INFO ] [MAIN ] Update Progress: 1168/2370 symbols completed. JPC took 27.0s. Estimated remaining: 2h 7m 22s. Rate: 9.4 symbols/min [2025-09-14T18:40:57.857268] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:57.867841] [DEBUG] [LOCAL ] JRI: Loaded 7353 existing records from primary storage. [2025-09-14T18:40:57.868046] [INFO ] [MAIN ] JRI: Loaded 7353 existing records. [2025-09-14T18:40:58.072694] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:58.073053] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-14T18:40:58.073173] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-14T18:40:58.073547] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-14T18:40:58.073623] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-14T18:40:58.163970] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-14T18:40:58.589625] [INFO ] [REMOTE ] JRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:58.651338] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T18:40:58.883086] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T18:40:58.958910] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-14T18:40:59.758859] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-14T18:41:00.180299] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T18:41:00.373906] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T18:41:00.375175] [INFO ] [REMOTE ] JPI: Full fetch complete (5843 records). [2025-09-14T18:41:00.375268] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-14T18:41:00.564867] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-14T18:41:00.764480] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-14T18:41:00.764616] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-14T18:41:00.764896] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-14T18:41:00.764968] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-14T18:41:00.765513] [DEBUG] [LOCAL ] JPI: Trimmed 5843 records to 4000 (keeping 150 days of data) [2025-09-14T18:41:00.791609] [DEBUG] [LOCAL ] JPI: Primary data saved (4000 records). [2025-09-14T18:41:00.791759] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-14T18:41:00.791902] [INFO ] [MAIN ] Update Progress: 1169/2370 symbols completed. JPI took 18.3s. Estimated remaining: 2h 7m 12s. Rate: 9.4 symbols/min [2025-09-14T18:41:00.971140] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:00.979500] [DEBUG] [LOCAL ] JRS: Loaded 5500 existing records from primary storage. [2025-09-14T18:41:00.979681] [INFO ] [MAIN ] JRS: Loaded 5500 existing records. [2025-09-14T18:41:01.170804] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:01.171141] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-14T18:41:01.171204] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-14T18:41:01.171550] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-14T18:41:01.171611] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-14T18:41:01.360726] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-14T18:41:01.548079] [INFO ] [REMOTE ] JRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:01.883092] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T18:41:02.158880] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-14T18:41:02.744113] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T18:41:02.958892] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-14T18:41:03.575383] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T18:41:03.758849] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-14T18:41:04.029528] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T18:41:04.558871] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-14T18:41:05.307116] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:41:05.358822] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-14T18:41:05.451672] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:41:06.158871] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-14T18:41:06.922055] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T18:41:06.958807] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-14T18:41:07.089711] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:41:07.758863] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-14T18:41:08.369016] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:41:08.558833] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-14T18:41:08.568410] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T18:41:09.358876] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-14T18:41:09.844143] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:41:10.031580] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T18:41:10.158844] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-14T18:41:10.958846] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-14T18:41:11.758884] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-14T18:41:11.840378] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T18:41:11.874541] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:41:12.558829] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-14T18:41:12.762377] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:41:13.358832] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-14T18:41:13.563355] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:41:14.050152] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T18:41:14.158822] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-14T18:41:14.958852] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-14T18:41:15.206722] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T18:41:15.758861] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-14T18:41:16.034143] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:41:16.558857] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-14T18:41:16.996388] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T18:41:17.358825] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-14T18:41:17.511731] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T18:41:18.105463] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:41:18.107290] [INFO ] [REMOTE ] JRS: Full fetch complete (11964 records). [2025-09-14T18:41:18.107379] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-14T18:41:18.163958] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-14T18:41:18.484874] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-14T18:41:18.484993] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-14T18:41:18.485630] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-14T18:41:18.485713] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-14T18:41:18.486269] [DEBUG] [LOCAL ] JRS: Trimmed 11964 records to 8399 (keeping 150 days of data) [2025-09-14T18:41:18.537530] [DEBUG] [LOCAL ] JRS: Primary data saved (8399 records). [2025-09-14T18:41:18.537777] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-14T18:41:18.537923] [INFO ] [MAIN ] Update Progress: 1170/2370 symbols completed. JRS took 17.7s. Estimated remaining: 2h 7m 18s. Rate: 9.4 symbols/min [2025-09-14T18:41:18.713390] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:18.734525] [DEBUG] [LOCAL ] JXN: Loaded 19441 existing records from primary storage. [2025-09-14T18:41:18.734726] [INFO ] [MAIN ] JXN: Loaded 19441 existing records. [2025-09-14T18:41:18.921382] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:18.921760] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-14T18:41:18.921828] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-14T18:41:18.922422] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-14T18:41:18.922491] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-14T18:41:18.966100] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-14T18:41:19.321904] [INFO ] [REMOTE ] JXN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:19.676954] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:41:19.758853] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-14T18:41:19.956970] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:41:20.558839] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-14T18:41:21.256777] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T18:41:21.281205] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:41:21.286997] [INFO ] [REMOTE ] JPM: Full fetch complete (58473 records). [2025-09-14T18:41:21.287138] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-14T18:41:21.363886] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-14T18:41:21.675387] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-14T18:41:21.675495] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-14T18:41:21.676437] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-14T18:41:21.676503] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-14T18:41:21.677833] [DEBUG] [LOCAL ] JPM: Trimmed 58473 records to 40534 (keeping 150 days of data) [2025-09-14T18:41:21.947925] [DEBUG] [LOCAL ] JPM: Primary data saved (40534 records). [2025-09-14T18:41:21.948093] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-14T18:41:21.948229] [INFO ] [MAIN ] Update Progress: 1171/2370 symbols completed. JPM took 34.7s. Estimated remaining: 2h 7m 8s. Rate: 9.4 symbols/min [2025-09-14T18:41:22.122711] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:22.144841] [DEBUG] [LOCAL ] K: Loaded 22655 existing records from primary storage. [2025-09-14T18:41:22.145012] [INFO ] [MAIN ] K: Loaded 22655 existing records. [2025-09-14T18:41:22.165344] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-14T18:41:22.330707] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:22.331226] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-14T18:41:22.338663] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-14T18:41:22.339770] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-14T18:41:22.339714] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T18:41:22.342991] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-14T18:41:22.700189] [INFO ] [REMOTE ] K: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:22.958828] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-14T18:41:23.363975] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T18:41:23.367709] [INFO ] [REMOTE ] JQC: Full fetch complete (36773 records). [2025-09-14T18:41:23.367810] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-14T18:41:23.742567] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-14T18:41:23.742692] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-14T18:41:23.743365] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-14T18:41:23.743422] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-14T18:41:23.744436] [DEBUG] [LOCAL ] JQC: Trimmed 36773 records to 24817 (keeping 150 days of data) [2025-09-14T18:41:23.795516] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-14T18:41:23.910547] [DEBUG] [LOCAL ] JQC: Primary data saved (24817 records). [2025-09-14T18:41:23.910791] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-14T18:41:23.910934] [INFO ] [MAIN ] Update Progress: 1172/2370 symbols completed. JQC took 28.2s. Estimated remaining: 2h 6m 58s. Rate: 9.4 symbols/min [2025-09-14T18:41:24.094684] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-14T18:41:24.096071] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:24.101105] [INFO ] [REMOTE ] JRI: Full fetch complete (16702 records). [2025-09-14T18:41:24.101300] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-14T18:41:24.211775] [DEBUG] [LOCAL ] KAI: Loaded 5480 existing records from primary storage. [2025-09-14T18:41:24.238341] [INFO ] [MAIN ] KAI: Loaded 5480 existing records. [2025-09-14T18:41:24.565860] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-14T18:41:24.631323] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:24.674499] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-14T18:41:24.674728] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-14T18:41:24.674776] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-14T18:41:24.674947] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-14T18:41:24.675379] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-14T18:41:24.675426] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-14T18:41:24.675882] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-14T18:41:24.675999] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-14T18:41:24.709133] [DEBUG] [LOCAL ] JRI: Trimmed 16702 records to 11176 (keeping 150 days of data) [2025-09-14T18:41:25.100102] [INFO ] [REMOTE ] KAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:25.116572] [DEBUG] [LOCAL ] JRI: Primary data saved (11176 records). [2025-09-14T18:41:25.116845] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-14T18:41:25.117015] [INFO ] [MAIN ] Update Progress: 1173/2370 symbols completed. JRI took 27.4s. Estimated remaining: 2h 6m 46s. Rate: 9.4 symbols/min [2025-09-14T18:41:25.298223] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:25.319233] [DEBUG] [LOCAL ] KAR: Loaded 18280 existing records from primary storage. [2025-09-14T18:41:25.319422] [INFO ] [MAIN ] KAR: Loaded 18280 existing records. [2025-09-14T18:41:25.381368] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-14T18:41:25.499046] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:25.499314] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-14T18:41:25.499378] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-14T18:41:25.499971] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-14T18:41:25.500048] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-14T18:41:25.856820] [INFO ] [REMOTE ] KAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:25.883422] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T18:41:26.158855] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-14T18:41:26.481927] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T18:41:26.750404] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T18:41:26.958834] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-14T18:41:27.625482] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T18:41:27.758832] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-14T18:41:28.558831] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-14T18:41:28.772351] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:41:29.358843] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-14T18:41:29.621221] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:41:29.715519] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T18:41:30.158830] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-14T18:41:30.765274] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:41:30.958833] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-14T18:41:31.760304] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-14T18:41:31.788296] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:41:31.808279] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T18:41:32.558851] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-14T18:41:33.358817] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-14T18:41:33.615264] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T18:41:33.665871] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:41:34.158826] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-14T18:41:34.958807] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-14T18:41:35.021500] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:41:35.758884] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-14T18:41:36.025825] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T18:41:36.555029] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:41:36.563449] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-14T18:41:37.006732] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T18:41:37.358898] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-14T18:41:38.158856] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-14T18:41:38.403451] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T18:41:38.439222] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T18:41:38.958877] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-14T18:41:39.766182] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-14T18:41:39.771728] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:41:40.005311] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T18:41:40.558827] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-14T18:41:41.369530] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-14T18:41:41.376181] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T18:41:41.591400] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T18:41:42.158881] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-14T18:41:42.802999] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:41:42.811900] [INFO ] [REMOTE ] JXN: Full fetch complete (50109 records). [2025-09-14T18:41:42.812101] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-14T18:41:42.964680] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-14T18:41:43.200980] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-14T18:41:43.201155] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-14T18:41:43.202102] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-14T18:41:43.202171] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-14T18:41:43.203597] [DEBUG] [LOCAL ] JXN: Trimmed 50109 records to 33633 (keeping 150 days of data) [2025-09-14T18:41:43.233783] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:41:43.456055] [DEBUG] [LOCAL ] JXN: Primary data saved (33633 records). [2025-09-14T18:41:43.456255] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-14T18:41:43.456400] [INFO ] [MAIN ] Update Progress: 1174/2370 symbols completed. JXN took 24.9s. Estimated remaining: 2h 6m 52s. Rate: 9.4 symbols/min [2025-09-14T18:41:43.626368] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:43.638210] [DEBUG] [LOCAL ] KB: Loaded 10850 existing records from primary storage. [2025-09-14T18:41:43.638360] [INFO ] [MAIN ] KB: Loaded 10850 existing records. [2025-09-14T18:41:43.763978] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-14T18:41:43.831094] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:43.831405] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-14T18:41:43.831488] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-14T18:41:43.831961] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-14T18:41:43.832051] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-14T18:41:44.214991] [INFO ] [REMOTE ] KB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:44.558873] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-14T18:41:44.660560] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:41:44.675771] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T18:41:45.241356] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:41:45.247310] [INFO ] [REMOTE ] K: Full fetch complete (54002 records). [2025-09-14T18:41:45.247482] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-14T18:41:45.364007] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-14T18:41:45.637092] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-14T18:41:45.637212] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-14T18:41:45.638046] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-14T18:41:45.638107] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-14T18:41:45.639350] [DEBUG] [LOCAL ] K: Trimmed 54002 records to 37697 (keeping 150 days of data) [2025-09-14T18:41:45.881438] [DEBUG] [LOCAL ] K: Primary data saved (37697 records). [2025-09-14T18:41:45.881607] [INFO ] [MAIN ] K: Full history saved. [2025-09-14T18:41:45.881758] [INFO ] [MAIN ] Update Progress: 1175/2370 symbols completed. K took 23.9s. Estimated remaining: 2h 6m 41s. Rate: 9.4 symbols/min [2025-09-14T18:41:46.052731] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:46.063551] [DEBUG] [LOCAL ] KBDC: Loaded 9004 existing records from primary storage. [2025-09-14T18:41:46.063712] [INFO ] [MAIN ] KBDC: Loaded 9004 existing records. [2025-09-14T18:41:46.165014] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-14T18:41:46.245806] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:46.246067] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-14T18:41:46.246137] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-14T18:41:46.246489] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-14T18:41:46.246549] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-14T18:41:46.595457] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:46.958871] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-14T18:41:47.052518] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:41:47.433417] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T18:41:47.758882] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-14T18:41:48.029609] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:41:48.558855] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-14T18:41:49.152481] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T18:41:49.358822] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-14T18:41:49.550301] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T18:41:50.001824] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:41:50.006775] [INFO ] [REMOTE ] KAR: Full fetch complete (43702 records). [2025-09-14T18:41:50.006948] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-14T18:41:50.163948] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-14T18:41:50.414317] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-14T18:41:50.414457] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-14T18:41:50.415469] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-14T18:41:50.415563] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-14T18:41:50.417038] [DEBUG] [LOCAL ] KAR: Trimmed 43702 records to 29952 (keeping 150 days of data) [2025-09-14T18:41:50.628577] [DEBUG] [LOCAL ] KAR: Primary data saved (29952 records). [2025-09-14T18:41:50.628841] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-14T18:41:50.628982] [INFO ] [MAIN ] Update Progress: 1176/2370 symbols completed. KAR took 25.5s. Estimated remaining: 2h 6m 33s. Rate: 9.4 symbols/min [2025-09-14T18:41:50.805750] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:50.811353] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:41:50.813573] [INFO ] [REMOTE ] KAI: Full fetch complete (15371 records). [2025-09-14T18:41:50.814104] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-14T18:41:50.959615] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-14T18:41:51.142715] [DEBUG] [LOCAL ] KBH: Loaded 22109 existing records from primary storage. [2025-09-14T18:41:51.143270] [INFO ] [MAIN ] KBH: Loaded 22109 existing records. [2025-09-14T18:41:51.334528] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-14T18:41:51.340306] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-14T18:41:51.351096] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-14T18:41:51.356289] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-14T18:41:51.415321] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:51.415421] [DEBUG] [LOCAL ] KAI: Trimmed 15371 records to 9945 (keeping 150 days of data) [2025-09-14T18:41:51.416058] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-14T18:41:51.416317] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-14T18:41:51.417153] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-14T18:41:51.417225] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-14T18:41:51.651432] [DEBUG] [LOCAL ] KAI: Primary data saved (9945 records). [2025-09-14T18:41:51.669700] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-14T18:41:51.679535] [INFO ] [MAIN ] Update Progress: 1177/2370 symbols completed. KAI took 27.8s. Estimated remaining: 2h 6m 22s. Rate: 9.4 symbols/min [2025-09-14T18:41:51.770284] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-14T18:41:52.032412] [INFO ] [REMOTE ] KBH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:52.063036] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:52.081021] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T18:41:52.104260] [DEBUG] [LOCAL ] KBR: Loaded 21644 existing records from primary storage. [2025-09-14T18:41:52.104429] [INFO ] [MAIN ] KBR: Loaded 21644 existing records. [2025-09-14T18:41:52.298446] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:52.298776] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-14T18:41:52.298839] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-14T18:41:52.299422] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-14T18:41:52.299483] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-14T18:41:52.563893] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-14T18:41:52.650104] [INFO ] [REMOTE ] KBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:52.798206] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:41:53.358869] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-14T18:41:54.158887] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-14T18:41:54.320392] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:41:54.958839] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-14T18:41:55.291008] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T18:41:55.430916] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T18:41:55.758853] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-14T18:41:56.558877] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-14T18:41:56.771825] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T18:41:56.812181] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T18:41:57.358850] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-14T18:41:57.920241] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T18:41:58.158781] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-14T18:41:58.477445] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:41:58.958863] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-14T18:41:59.758917] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-14T18:42:00.035060] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:42:00.079327] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T18:42:00.558945] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-14T18:42:01.358876] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-14T18:42:01.527718] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:42:02.158898] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-14T18:42:02.419877] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:42:02.958898] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-14T18:42:03.759015] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-14T18:42:05.098300] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (3.74 seconds). [2025-09-14T18:42:05.105115] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-14T18:42:05.491632] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T18:42:05.497387] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-14T18:42:05.856850] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-09-14T18:42:06.158891] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-14T18:42:06.335266] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (4.18 seconds). [2025-09-14T18:42:06.367709] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T18:42:06.396429] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T18:42:06.958906] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-14T18:42:07.758920] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-14T18:42:08.026666] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T18:42:08.077217] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T18:42:08.080862] [INFO ] [REMOTE ] KBDC: Full fetch complete (21717 records). [2025-09-14T18:42:08.080975] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-14T18:42:08.465844] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-14T18:42:08.465972] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-14T18:42:08.466474] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-14T18:42:08.466530] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-14T18:42:08.467211] [DEBUG] [LOCAL ] KBDC: Trimmed 21717 records to 14766 (keeping 150 days of data) [2025-09-14T18:42:08.556997] [DEBUG] [LOCAL ] KBDC: Primary data saved (14766 records). [2025-09-14T18:42:08.557182] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-14T18:42:08.557296] [INFO ] [MAIN ] Update Progress: 1178/2370 symbols completed. KBDC took 22.7s. Estimated remaining: 2h 6m 26s. Rate: 9.4 symbols/min [2025-09-14T18:42:08.568826] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-14T18:42:08.732210] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:08.740296] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T18:42:08.744094] [INFO ] [REMOTE ] KB: Full fetch complete (26867 records). [2025-09-14T18:42:08.744493] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-14T18:42:08.928935] [DEBUG] [LOCAL ] KD: Loaded 23562 existing records from primary storage. [2025-09-14T18:42:08.945861] [INFO ] [MAIN ] KD: Loaded 23562 existing records. [2025-09-14T18:42:09.343607] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:09.356431] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-14T18:42:09.356527] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-14T18:42:09.356759] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-14T18:42:09.357188] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-14T18:42:09.358331] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-14T18:42:09.358480] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-14T18:42:09.358838] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-14T18:42:09.359462] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-14T18:42:09.359579] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-14T18:42:09.396086] [DEBUG] [LOCAL ] KB: Trimmed 26867 records to 18330 (keeping 150 days of data) [2025-09-14T18:42:09.656110] [DEBUG] [LOCAL ] KB: Primary data saved (18330 records). [2025-09-14T18:42:09.659623] [INFO ] [MAIN ] KB: Full history saved. [2025-09-14T18:42:09.676153] [INFO ] [MAIN ] Update Progress: 1179/2370 symbols completed. KB took 26.2s. Estimated remaining: 2h 6m 14s. Rate: 9.4 symbols/min [2025-09-14T18:42:10.025585] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:10.047814] [INFO ] [REMOTE ] KD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:10.051658] [DEBUG] [LOCAL ] KEN: Loaded 1983 existing records from primary storage. [2025-09-14T18:42:10.051751] [INFO ] [MAIN ] KEN: Loaded 1983 existing records. [2025-09-14T18:42:10.163880] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-14T18:42:10.231435] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:10.231972] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-14T18:42:10.232035] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-14T18:42:10.232278] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-14T18:42:10.232337] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-14T18:42:10.593484] [INFO ] [REMOTE ] KEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:10.626188] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:42:10.958905] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-14T18:42:11.250876] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T18:42:11.481561] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-14T18:42:11.758934] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-14T18:42:12.043016] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T18:42:12.558848] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-14T18:42:13.204717] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T18:42:13.358869] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-14T18:42:13.526409] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:42:14.158891] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-14T18:42:14.958892] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-14T18:42:15.019906] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T18:42:15.025788] [INFO ] [REMOTE ] KBH: Full fetch complete (53034 records). [2025-09-14T18:42:15.025949] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-14T18:42:15.429459] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-14T18:42:15.429586] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-14T18:42:15.430443] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-14T18:42:15.430502] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-14T18:42:15.431672] [DEBUG] [LOCAL ] KBH: Trimmed 53034 records to 36402 (keeping 150 days of data) [2025-09-14T18:42:15.678747] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-14T18:42:15.713060] [DEBUG] [LOCAL ] KBH: Primary data saved (36402 records). [2025-09-14T18:42:15.713232] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-14T18:42:15.713334] [INFO ] [MAIN ] Update Progress: 1180/2370 symbols completed. KBH took 25.1s. Estimated remaining: 2h 6m 8s. Rate: 9.4 symbols/min [2025-09-14T18:42:15.767419] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-14T18:42:15.886004] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:15.903469] [DEBUG] [LOCAL ] KEP: Loaded 15566 existing records from primary storage. [2025-09-14T18:42:15.903630] [INFO ] [MAIN ] KEP: Loaded 15566 existing records. [2025-09-14T18:42:16.083245] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:16.083515] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-14T18:42:16.083581] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-14T18:42:16.084072] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-14T18:42:16.084138] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-14T18:42:16.495803] [INFO ] [REMOTE ] KEP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:16.502110] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T18:42:16.558822] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-14T18:42:17.358884] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-14T18:42:17.385763] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:42:17.863839] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T18:42:18.159010] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-14T18:42:18.502435] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:42:18.752823] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T18:42:18.958822] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-14T18:42:19.643067] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:42:19.758818] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-14T18:42:20.558871] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-14T18:42:21.358845] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-14T18:42:21.659327] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T18:42:21.700749] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:42:22.158871] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-14T18:42:22.804361] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T18:42:22.958830] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-14T18:42:23.758869] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-14T18:42:23.969949] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:42:24.331442] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T18:42:24.418506] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:42:24.423823] [INFO ] [REMOTE ] KBR: Full fetch complete (52872 records). [2025-09-14T18:42:24.423995] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-14T18:42:24.571221] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-14T18:42:24.843216] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-14T18:42:24.843354] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-14T18:42:24.844226] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-14T18:42:24.844290] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-14T18:42:24.845781] [DEBUG] [LOCAL ] KBR: Trimmed 52872 records to 36186 (keeping 150 days of data) [2025-09-14T18:42:25.079465] [DEBUG] [LOCAL ] KBR: Primary data saved (36186 records). [2025-09-14T18:42:25.079935] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-14T18:42:25.080144] [INFO ] [MAIN ] Update Progress: 1181/2370 symbols completed. KBR took 33.4s. Estimated remaining: 2h 6m 4s. Rate: 9.4 symbols/min [2025-09-14T18:42:25.255111] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:25.275477] [DEBUG] [LOCAL ] KEX: Loaded 17037 existing records from primary storage. [2025-09-14T18:42:25.275703] [INFO ] [MAIN ] KEX: Loaded 17037 existing records. [2025-09-14T18:42:25.364603] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-14T18:42:25.468798] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:25.469164] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-14T18:42:25.469233] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-14T18:42:25.469986] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-14T18:42:25.470061] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-14T18:42:25.832449] [INFO ] [REMOTE ] KEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:26.044501] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:42:26.045396] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T18:42:26.158796] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-14T18:42:26.958900] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-14T18:42:27.758834] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-14T18:42:27.809355] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T18:42:27.810342] [INFO ] [REMOTE ] KEN: Full fetch complete (4845 records). [2025-09-14T18:42:27.810439] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-14T18:42:28.172925] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-14T18:42:28.173168] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-14T18:42:28.173397] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-14T18:42:28.192997] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-14T18:42:28.194461] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T18:42:28.202712] [DEBUG] [LOCAL ] KEN: Trimmed 4845 records to 3435 (keeping 150 days of data) [2025-09-14T18:42:28.223908] [DEBUG] [LOCAL ] KEN: Primary data saved (3435 records). [2025-09-14T18:42:28.224034] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-14T18:42:28.224167] [INFO ] [MAIN ] Update Progress: 1182/2370 symbols completed. KEN took 18.5s. Estimated remaining: 2h 5m 55s. Rate: 9.4 symbols/min [2025-09-14T18:42:28.399963] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:28.427154] [DEBUG] [LOCAL ] KEY: Loaded 23624 existing records from primary storage. [2025-09-14T18:42:28.427429] [INFO ] [MAIN ] KEY: Loaded 23624 existing records. [2025-09-14T18:42:28.571143] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-14T18:42:28.622568] [WARN ] [MAIN ] KEY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:28.622948] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-14T18:42:28.623017] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-14T18:42:28.623858] [DEBUG] [LOCAL ] KEY: Deleted primary data file. [2025-09-14T18:42:28.623931] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-14T18:42:29.007355] [INFO ] [REMOTE ] KEY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:29.358866] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-14T18:42:30.149246] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-14T18:42:30.159336] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-14T18:42:30.425005] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T18:42:30.867057] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:42:30.958816] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-14T18:42:31.758850] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-14T18:42:31.801516] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:42:32.558829] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-14T18:42:32.846843] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:42:33.358936] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-14T18:42:33.728996] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T18:42:33.853023] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T18:42:34.158841] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-14T18:42:34.958848] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-14T18:42:35.338694] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:42:35.611258] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T18:42:35.758801] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-14T18:42:36.469047] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:42:36.558786] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-14T18:42:37.032421] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T18:42:37.358908] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-14T18:42:37.803061] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-14T18:42:37.806020] [INFO ] [REMOTE ] KEP: Full fetch complete (31963 records). [2025-09-14T18:42:37.806111] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-14T18:42:38.170775] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-14T18:42:38.185002] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-14T18:42:38.185120] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-14T18:42:38.185991] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-14T18:42:38.186159] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-14T18:42:38.187107] [DEBUG] [LOCAL ] KEP: Trimmed 31963 records to 24446 (keeping 150 days of data) [2025-09-14T18:42:38.339137] [DEBUG] [LOCAL ] KEP: Primary data saved (24446 records). [2025-09-14T18:42:38.339306] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-14T18:42:38.339420] [INFO ] [MAIN ] Update Progress: 1183/2370 symbols completed. KEP took 22.6s. Estimated remaining: 2h 5m 52s. Rate: 9.4 symbols/min [2025-09-14T18:42:38.512848] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:38.533295] [DEBUG] [LOCAL ] KEYS: Loaded 19057 existing records from primary storage. [2025-09-14T18:42:38.533471] [INFO ] [MAIN ] KEYS: Loaded 19057 existing records. [2025-09-14T18:42:38.718727] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:38.719026] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-14T18:42:38.719088] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-14T18:42:38.719828] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-14T18:42:38.719892] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-14T18:42:38.973061] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-14T18:42:39.110759] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:39.328801] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T18:42:39.695960] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T18:42:39.758818] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-14T18:42:40.558834] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-14T18:42:40.700674] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:42:41.285670] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:42:41.358815] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-14T18:42:42.158903] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-14T18:42:42.338148] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T18:42:42.490409] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:42:42.496589] [INFO ] [REMOTE ] KD: Full fetch complete (56896 records). [2025-09-14T18:42:42.496827] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-14T18:42:42.888289] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-14T18:42:42.888485] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-14T18:42:42.889476] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-14T18:42:42.889599] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-14T18:42:42.891072] [DEBUG] [LOCAL ] KD: Trimmed 56896 records to 39273 (keeping 150 days of data) [2025-09-14T18:42:42.984023] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-14T18:42:43.020634] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:42:43.207471] [DEBUG] [LOCAL ] KD: Primary data saved (39273 records). [2025-09-14T18:42:43.207703] [INFO ] [MAIN ] KD: Full history saved. [2025-09-14T18:42:43.207830] [INFO ] [MAIN ] Update Progress: 1184/2370 symbols completed. KD took 34.7s. Estimated remaining: 2h 5m 44s. Rate: 9.4 symbols/min [2025-09-14T18:42:43.374121] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:43.376618] [DEBUG] [LOCAL ] KF: Loaded 683 existing records from primary storage. [2025-09-14T18:42:43.376732] [INFO ] [MAIN ] KF: Loaded 683 existing records. [2025-09-14T18:42:43.552393] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:43.552722] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-14T18:42:43.552794] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-14T18:42:43.553011] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-14T18:42:43.553069] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-14T18:42:43.769591] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-14T18:42:43.924117] [INFO ] [REMOTE ] KF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:44.558833] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-14T18:42:44.688235] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T18:42:45.358870] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-14T18:42:45.741462] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T18:42:45.781538] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T18:42:46.072877] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:42:46.077962] [INFO ] [REMOTE ] KEX: Full fetch complete (40715 records). [2025-09-14T18:42:46.078160] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-14T18:42:46.163908] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-14T18:42:46.468005] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-14T18:42:46.468161] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-14T18:42:46.468907] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-14T18:42:46.468970] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-14T18:42:46.470138] [DEBUG] [LOCAL ] KEX: Trimmed 40715 records to 28008 (keeping 150 days of data) [2025-09-14T18:42:46.650757] [DEBUG] [LOCAL ] KEX: Primary data saved (28008 records). [2025-09-14T18:42:46.650972] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-14T18:42:46.651128] [INFO ] [MAIN ] Update Progress: 1185/2370 symbols completed. KEX took 21.6s. Estimated remaining: 2h 5m 35s. Rate: 9.4 symbols/min [2025-09-14T18:42:46.813404] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T18:42:46.830451] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:46.843387] [DEBUG] [LOCAL ] KFRC: Loaded 9789 existing records from primary storage. [2025-09-14T18:42:46.843534] [INFO ] [MAIN ] KFRC: Loaded 9789 existing records. [2025-09-14T18:42:46.964028] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-14T18:42:47.027909] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:47.028175] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-14T18:42:47.028254] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-14T18:42:47.028701] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-14T18:42:47.028764] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-14T18:42:47.381234] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:47.652094] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T18:42:47.758833] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-14T18:42:48.371999] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T18:42:48.558830] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-14T18:42:49.199897] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T18:42:49.358832] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-14T18:42:50.158915] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-14T18:42:50.958854] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-14T18:42:51.263053] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:42:51.522883] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T18:42:51.758859] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-14T18:42:51.899479] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T18:42:52.432972] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:42:52.438138] [INFO ] [REMOTE ] KEY: Full fetch complete (57927 records). [2025-09-14T18:42:52.438254] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-14T18:42:52.563971] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-14T18:42:52.632538] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T18:42:52.633140] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:42:52.633193] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:42:52.633250] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-14T18:42:52.633319] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-14T18:42:52.633367] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-14T18:42:52.633427] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-14T18:42:52.633525] [INFO ] [MAIN ] Update Progress: 1186/2370 symbols completed. KEY took 24.4s. Estimated remaining: 2h 5m 28s. Rate: 9.4 symbols/min [2025-09-14T18:42:52.800013] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:52.806894] [DEBUG] [LOCAL ] KFS: Loaded 3986 existing records from primary storage. [2025-09-14T18:42:52.807092] [INFO ] [MAIN ] KFS: Loaded 3986 existing records. [2025-09-14T18:42:52.985621] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:52.985890] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-14T18:42:52.985952] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-14T18:42:52.986179] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-14T18:42:52.986243] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-14T18:42:53.355410] [INFO ] [REMOTE ] KFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:53.358784] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-14T18:42:54.158843] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-14T18:42:54.329440] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T18:42:54.366085] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T18:42:54.669461] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T18:42:54.958843] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-14T18:42:55.705961] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T18:42:55.758836] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-14T18:42:56.558812] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-14T18:42:57.358839] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-14T18:42:57.448911] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:42:57.614207] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T18:42:57.750068] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:42:57.750895] [INFO ] [REMOTE ] KF: Full fetch complete (2672 records). [2025-09-14T18:42:57.750977] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-14T18:42:58.134146] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-14T18:42:58.134309] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-14T18:42:58.134464] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-14T18:42:58.134718] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-14T18:42:58.136046] [DEBUG] [LOCAL ] KF: Trimmed 2672 records to 1764 (keeping 150 days of data) [2025-09-14T18:42:58.147692] [DEBUG] [LOCAL ] KF: Primary data saved (1764 records). [2025-09-14T18:42:58.147817] [INFO ] [MAIN ] KF: Full history saved. [2025-09-14T18:42:58.147944] [INFO ] [MAIN ] Update Progress: 1187/2370 symbols completed. KF took 14.9s. Estimated remaining: 2h 5m 21s. Rate: 9.4 symbols/min [2025-09-14T18:42:58.164014] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-14T18:42:58.326829] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:58.341336] [DEBUG] [LOCAL ] KFY: Loaded 13481 existing records from primary storage. [2025-09-14T18:42:58.341527] [INFO ] [MAIN ] KFY: Loaded 13481 existing records. [2025-09-14T18:42:58.524431] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:58.524765] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-14T18:42:58.524830] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-14T18:42:58.525304] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-14T18:42:58.525369] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-14T18:42:58.879597] [INFO ] [REMOTE ] KFY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:58.958817] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-14T18:42:59.758816] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-14T18:42:59.835349] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:43:00.282185] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T18:43:00.558853] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-14T18:43:00.706867] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T18:43:01.358829] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-14T18:43:02.158792] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-14T18:43:02.392271] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:43:02.591459] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T18:43:02.958818] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-14T18:43:03.062104] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T18:43:03.758920] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-14T18:43:04.488335] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T18:43:04.558889] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-14T18:43:05.358850] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-14T18:43:05.429430] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:43:05.471946] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T18:43:06.158899] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-14T18:43:06.896591] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:43:06.901664] [INFO ] [REMOTE ] KEYS: Full fetch complete (47520 records). [2025-09-14T18:43:06.901947] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-14T18:43:06.927698] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T18:43:06.963931] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-14T18:43:07.376274] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-14T18:43:07.376400] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-14T18:43:07.377319] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-14T18:43:07.377389] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-14T18:43:07.378512] [DEBUG] [LOCAL ] KEYS: Trimmed 47520 records to 32034 (keeping 150 days of data) [2025-09-14T18:43:07.589140] [DEBUG] [LOCAL ] KEYS: Primary data saved (32034 records). [2025-09-14T18:43:07.589360] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-14T18:43:07.589487] [INFO ] [MAIN ] Update Progress: 1188/2370 symbols completed. KEYS took 29.2s. Estimated remaining: 2h 5m 18s. Rate: 9.4 symbols/min [2025-09-14T18:43:07.771952] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:07.766245] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-14T18:43:07.800466] [DEBUG] [LOCAL ] KGC: Loaded 24068 existing records from primary storage. [2025-09-14T18:43:07.800663] [INFO ] [MAIN ] KGC: Loaded 24068 existing records. [2025-09-14T18:43:07.983395] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:07.983994] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-14T18:43:07.991509] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-14T18:43:07.992694] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T18:43:07.995231] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-14T18:43:07.996216] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-14T18:43:08.366866] [INFO ] [REMOTE ] KGC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:08.558894] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-14T18:43:09.029521] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T18:43:09.358887] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-14T18:43:10.158888] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-14T18:43:10.558420] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T18:43:10.779099] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:43:10.797102] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T18:43:10.958811] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-14T18:43:11.758888] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-14T18:43:12.412573] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T18:43:12.558848] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-14T18:43:13.358865] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-14T18:43:13.890112] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T18:43:14.069545] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-14T18:43:14.158806] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-14T18:43:14.167719] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:43:14.169218] [INFO ] [REMOTE ] KFS: Full fetch complete (8358 records). [2025-09-14T18:43:14.169313] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-14T18:43:14.533445] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-14T18:43:14.533546] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-14T18:43:14.533805] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-14T18:43:14.533868] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-14T18:43:14.534312] [DEBUG] [LOCAL ] KFS: Trimmed 8358 records to 6394 (keeping 150 days of data) [2025-09-14T18:43:14.571759] [DEBUG] [LOCAL ] KFS: Primary data saved (6394 records). [2025-09-14T18:43:14.571873] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-14T18:43:14.571997] [INFO ] [MAIN ] Update Progress: 1189/2370 symbols completed. KFS took 21.9s. Estimated remaining: 2h 5m 12s. Rate: 9.4 symbols/min [2025-09-14T18:43:14.742075] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:14.762513] [DEBUG] [LOCAL ] KGS: Loaded 21043 existing records from primary storage. [2025-09-14T18:43:14.762690] [INFO ] [MAIN ] KGS: Loaded 21043 existing records. [2025-09-14T18:43:14.944284] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:14.944558] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-14T18:43:14.944620] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-14T18:43:14.945288] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-14T18:43:14.945358] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-14T18:43:14.965788] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-14T18:43:15.320756] [INFO ] [REMOTE ] KGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:15.758841] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-14T18:43:16.252815] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T18:43:16.442104] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-14T18:43:16.558825] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-14T18:43:17.358800] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-14T18:43:17.388169] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T18:43:17.616341] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:43:17.985976] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:43:17.989918] [INFO ] [REMOTE ] KFY: Full fetch complete (33193 records). [2025-09-14T18:43:17.990069] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-14T18:43:18.171196] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-14T18:43:18.377605] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-14T18:43:18.377731] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-14T18:43:18.378458] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-14T18:43:18.378524] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-14T18:43:18.380480] [DEBUG] [LOCAL ] KFY: Trimmed 33193 records to 22010 (keeping 150 days of data) [2025-09-14T18:43:18.520927] [DEBUG] [LOCAL ] KFY: Primary data saved (22010 records). [2025-09-14T18:43:18.521096] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-14T18:43:18.521222] [INFO ] [MAIN ] Update Progress: 1190/2370 symbols completed. KFY took 20.4s. Estimated remaining: 2h 5m 3s. Rate: 9.4 symbols/min [2025-09-14T18:43:18.694128] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:18.720534] [DEBUG] [LOCAL ] KIM: Loaded 23670 existing records from primary storage. [2025-09-14T18:43:18.720756] [INFO ] [MAIN ] KIM: Loaded 23670 existing records. [2025-09-14T18:43:18.899040] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:18.899300] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-14T18:43:18.899359] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-14T18:43:18.900072] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-14T18:43:18.900143] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-14T18:43:18.963914] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-14T18:43:19.261320] [INFO ] [REMOTE ] KIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:19.377840] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:43:19.758901] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-14T18:43:20.464182] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T18:43:20.558831] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-14T18:43:21.358804] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-14T18:43:21.456100] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T18:43:22.164214] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-14T18:43:22.173742] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T18:43:22.232036] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:43:22.958829] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-14T18:43:23.701073] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T18:43:23.758803] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-14T18:43:24.558833] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-14T18:43:25.187472] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-14T18:43:25.358780] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-14T18:43:25.711954] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:43:26.158842] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-14T18:43:26.542626] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T18:43:26.958806] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-14T18:43:27.386898] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T18:43:27.758815] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-14T18:43:27.992036] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:43:27.995050] [INFO ] [REMOTE ] KFRC: Full fetch complete (20121 records). [2025-09-14T18:43:27.995162] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-14T18:43:28.312660] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T18:43:28.405841] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-14T18:43:28.405940] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-14T18:43:28.406437] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-14T18:43:28.406502] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-14T18:43:28.407396] [DEBUG] [LOCAL ] KFRC: Trimmed 20121 records to 14958 (keeping 150 days of data) [2025-09-14T18:43:28.512264] [DEBUG] [LOCAL ] KFRC: Primary data saved (14958 records). [2025-09-14T18:43:28.512431] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-14T18:43:28.512546] [INFO ] [MAIN ] Update Progress: 1191/2370 symbols completed. KFRC took 41.9s. Estimated remaining: 2h 5m 0s. Rate: 9.4 symbols/min [2025-09-14T18:43:28.566543] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-14T18:43:28.688109] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:28.700569] [DEBUG] [LOCAL ] KIO: Loaded 9970 existing records from primary storage. [2025-09-14T18:43:28.700740] [INFO ] [MAIN ] KIO: Loaded 9970 existing records. [2025-09-14T18:43:28.879109] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:28.879372] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-14T18:43:28.879430] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-14T18:43:28.879807] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-14T18:43:28.879866] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-14T18:43:29.227314] [INFO ] [REMOTE ] KIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:29.342623] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:43:29.358778] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-14T18:43:30.158815] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-14T18:43:30.709936] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-14T18:43:30.958852] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-14T18:43:31.032059] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:43:31.579020] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:43:31.758834] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-14T18:43:32.558832] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-14T18:43:33.133755] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-14T18:43:33.358870] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-14T18:43:33.653812] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:43:33.893759] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:43:34.158858] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-14T18:43:34.958834] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-14T18:43:35.251058] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-14T18:43:35.256624] [INFO ] [REMOTE ] KGC: Full fetch complete (58377 records). [2025-09-14T18:43:35.256776] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-14T18:43:35.588065] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T18:43:35.690432] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-14T18:43:35.690591] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-14T18:43:35.691855] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-14T18:43:35.691925] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-14T18:43:35.693682] [DEBUG] [LOCAL ] KGC: Trimmed 58377 records to 40440 (keeping 150 days of data) [2025-09-14T18:43:35.772204] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-14T18:43:36.017256] [DEBUG] [LOCAL ] KGC: Primary data saved (40440 records). [2025-09-14T18:43:36.017513] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-14T18:43:36.017804] [INFO ] [MAIN ] Update Progress: 1192/2370 symbols completed. KGC took 28.4s. Estimated remaining: 2h 4m 55s. Rate: 9.4 symbols/min [2025-09-14T18:43:36.204162] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:36.229322] [DEBUG] [LOCAL ] KKR: Loaded 23973 existing records from primary storage. [2025-09-14T18:43:36.229507] [INFO ] [MAIN ] KKR: Loaded 23973 existing records. [2025-09-14T18:43:36.405029] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:36.405369] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-14T18:43:36.405433] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-14T18:43:36.406378] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-14T18:43:36.406445] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-14T18:43:36.560314] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-14T18:43:36.761397] [INFO ] [REMOTE ] KKR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:36.792618] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:43:37.128732] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T18:43:37.358781] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-14T18:43:37.748085] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T18:43:38.158842] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-14T18:43:38.958845] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-14T18:43:39.081216] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T18:43:39.105884] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T18:43:39.758811] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-14T18:43:39.841618] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T18:43:40.558856] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-14T18:43:41.015579] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:43:41.020887] [INFO ] [REMOTE ] KGS: Full fetch complete (49537 records). [2025-09-14T18:43:41.021012] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-14T18:43:41.381214] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-14T18:43:41.398396] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-14T18:43:41.398509] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-14T18:43:41.399325] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-14T18:43:41.399498] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-14T18:43:41.400699] [DEBUG] [LOCAL ] KGS: Trimmed 49537 records to 34220 (keeping 150 days of data) [2025-09-14T18:43:41.624625] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:43:41.651542] [DEBUG] [LOCAL ] KGS: Primary data saved (34220 records). [2025-09-14T18:43:41.651757] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-14T18:43:41.651894] [INFO ] [MAIN ] Update Progress: 1193/2370 symbols completed. KGS took 27.1s. Estimated remaining: 2h 4m 48s. Rate: 9.4 symbols/min [2025-09-14T18:43:41.836636] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:41.852491] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:43:41.859965] [DEBUG] [LOCAL ] KKRS: Loaded 2258 existing records from primary storage. [2025-09-14T18:43:41.860215] [INFO ] [MAIN ] KKRS: Loaded 2258 existing records. [2025-09-14T18:43:41.902424] [INFO ] [REMOTE ] KIM: Full fetch complete (57707 records). [2025-09-14T18:43:41.934145] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-14T18:43:42.183326] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-14T18:43:42.183249] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:42.233704] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-14T18:43:42.253729] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-14T18:43:42.318605] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-14T18:43:42.348087] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-14T18:43:42.597562] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-14T18:43:42.661349] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-14T18:43:42.698749] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-14T18:43:42.717004] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-14T18:43:42.765361] [DEBUG] [LOCAL ] KIM: Trimmed 57707 records to 39911 (keeping 150 days of data) [2025-09-14T18:43:42.800639] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:42.983711] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-14T18:43:43.066597] [DEBUG] [LOCAL ] KIM: Primary data saved (39911 records). [2025-09-14T18:43:43.066827] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-14T18:43:43.066956] [INFO ] [MAIN ] Update Progress: 1194/2370 symbols completed. KIM took 24.5s. Estimated remaining: 2h 4m 37s. Rate: 9.4 symbols/min [2025-09-14T18:43:43.246861] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:43.254583] [DEBUG] [LOCAL ] KKRT: Loaded 5715 existing records from primary storage. [2025-09-14T18:43:43.254765] [INFO ] [MAIN ] KKRT: Loaded 5715 existing records. [2025-09-14T18:43:43.435275] [WARN ] [MAIN ] KKRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:43.435880] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-14T18:43:43.435970] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-14T18:43:43.436489] [DEBUG] [LOCAL ] KKRT: Deleted primary data file. [2025-09-14T18:43:43.436686] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-14T18:43:43.545537] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T18:43:43.750786] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T18:43:43.766898] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-14T18:43:43.835294] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:44.558858] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-14T18:43:44.812204] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T18:43:45.243144] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T18:43:45.358851] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-14T18:43:46.143547] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T18:43:46.158819] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-14T18:43:46.902559] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-14T18:43:46.958858] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-14T18:43:47.610677] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T18:43:47.758922] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-14T18:43:48.558806] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-14T18:43:48.949856] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T18:43:49.006467] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T18:43:49.358855] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-14T18:43:49.601566] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:49.601967] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-14T18:43:50.158884] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-14T18:43:50.789461] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T18:43:50.958895] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-14T18:43:51.227078] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:51.227430] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-14T18:43:51.758829] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-14T18:43:52.558804] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-14T18:43:52.776471] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:43:52.778885] [INFO ] [REMOTE ] KIO: Full fetch complete (23492 records). [2025-09-14T18:43:52.778976] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-14T18:43:53.147519] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-14T18:43:53.147688] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-14T18:43:53.148283] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-14T18:43:53.148346] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-14T18:43:53.149345] [DEBUG] [LOCAL ] KIO: Trimmed 23492 records to 15563 (keeping 150 days of data) [2025-09-14T18:43:53.246611] [DEBUG] [LOCAL ] KIO: Primary data saved (15563 records). [2025-09-14T18:43:53.246802] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-14T18:43:53.246932] [INFO ] [MAIN ] Update Progress: 1195/2370 symbols completed. KIO took 24.7s. Estimated remaining: 2h 4m 34s. Rate: 9.4 symbols/min [2025-09-14T18:43:53.364461] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-14T18:43:53.419632] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:53.423520] [DEBUG] [LOCAL ] KLAR: Loaded 953 existing records from primary storage. [2025-09-14T18:43:53.423628] [INFO ] [MAIN ] KLAR: Loaded 953 existing records. [2025-09-14T18:43:53.607801] [WARN ] [MAIN ] KLAR: Insufficient historical data. Have data from 2025-09-10, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:53.608218] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-14T18:43:53.608516] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-14T18:43:53.620224] [DEBUG] [LOCAL ] KLAR: Deleted primary data file. [2025-09-14T18:43:53.636425] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-14T18:43:53.705340] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:53.712699] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T18:43:53.735518] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-14T18:43:54.014204] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:54.158826] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-14T18:43:54.598975] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T18:43:54.958839] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-14T18:43:55.242227] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:55.242578] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-14T18:43:55.758903] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-14T18:43:56.558861] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-14T18:43:56.734770] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T18:43:57.136822] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:43:57.138547] [INFO ] [REMOTE ] KKRS: Full fetch complete (6320 records). [2025-09-14T18:43:57.138728] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-14T18:43:57.369242] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-14T18:43:57.729628] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-14T18:43:57.729813] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-14T18:43:57.730201] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-14T18:43:57.730298] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-14T18:43:57.731067] [DEBUG] [LOCAL ] KKRS: Trimmed 6320 records to 4649 (keeping 150 days of data) [2025-09-14T18:43:57.769166] [DEBUG] [LOCAL ] KKRS: Primary data saved (4649 records). [2025-09-14T18:43:57.769467] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-14T18:43:57.769672] [INFO ] [MAIN ] Update Progress: 1196/2370 symbols completed. KKRS took 16.1s. Estimated remaining: 2h 4m 26s. Rate: 9.4 symbols/min [2025-09-14T18:43:58.006382] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:58.025705] [DEBUG] [LOCAL ] KLC: Loaded 15947 existing records from primary storage. [2025-09-14T18:43:58.025932] [INFO ] [MAIN ] KLC: Loaded 15947 existing records. [2025-09-14T18:43:58.163941] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-14T18:43:58.228534] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:58.228797] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-14T18:43:58.228858] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-14T18:43:58.229278] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-14T18:43:58.229337] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-14T18:43:58.593329] [INFO ] [REMOTE ] KLC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:58.609447] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T18:43:58.958832] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-14T18:43:59.181257] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T18:43:59.758850] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-14T18:43:59.998055] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:59.998415] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-14T18:44:00.170932] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:44:00.558849] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-14T18:44:01.358836] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-14T18:44:01.673701] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:44:02.158794] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-14T18:44:02.387167] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T18:44:02.958844] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-14T18:44:03.649828] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T18:44:03.758795] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-14T18:44:03.778013] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T18:44:04.558857] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-14T18:44:05.269902] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:44:05.284613] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:44:05.286088] [INFO ] [REMOTE ] KKRT: Full fetch complete (7851 records). [2025-09-14T18:44:05.286176] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-14T18:44:05.363886] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-14T18:44:05.469047] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 73 unique days, need 150 days [2025-09-14T18:44:05.469347] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:44:05.469420] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:44:05.469478] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-14T18:44:05.469561] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-14T18:44:05.469623] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-14T18:44:05.469703] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-14T18:44:05.469801] [INFO ] [MAIN ] Update Progress: 1197/2370 symbols completed. KKRT took 22.4s. Estimated remaining: 2h 4m 21s. Rate: 9.4 symbols/min [2025-09-14T18:44:05.689362] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:05.689757] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-14T18:44:06.158865] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-14T18:44:06.958835] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-14T18:44:07.230575] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T18:44:07.758835] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-14T18:44:08.005836] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:08.006194] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-14T18:44:08.369700] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:44:08.558848] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-14T18:44:09.250770] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:44:09.256396] [INFO ] [REMOTE ] KKR: Full fetch complete (58204 records). [2025-09-14T18:44:09.256555] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-14T18:44:09.359227] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-14T18:44:09.641170] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-14T18:44:09.641276] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-14T18:44:09.642205] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-14T18:44:09.642266] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-14T18:44:09.643505] [DEBUG] [LOCAL ] KKR: Trimmed 58204 records to 40272 (keeping 150 days of data) [2025-09-14T18:44:09.703162] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:09.743845] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-14T18:44:09.922118] [DEBUG] [LOCAL ] KKR: Primary data saved (40272 records). [2025-09-14T18:44:09.922280] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-14T18:44:09.922380] [INFO ] [MAIN ] Update Progress: 1198/2370 symbols completed. KKR took 33.9s. Estimated remaining: 2h 4m 13s. Rate: 9.4 symbols/min [2025-09-14T18:44:10.158913] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-14T18:44:10.958930] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-14T18:44:11.221433] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:11.221823] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-14T18:44:11.562848] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T18:44:11.758892] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-14T18:44:12.004934] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:12.005300] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-14T18:44:12.558825] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-14T18:44:13.079809] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:44:13.081633] [INFO ] [REMOTE ] KLAR: Full fetch complete (953 records). [2025-09-14T18:44:13.081732] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-14T18:44:13.255736] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 3 unique days, need 150 days [2025-09-14T18:44:13.255942] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:44:13.255996] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:44:13.256043] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-14T18:44:13.256173] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-14T18:44:13.256235] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-14T18:44:13.256303] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-14T18:44:13.256449] [INFO ] [MAIN ] Update Progress: 1199/2370 symbols completed. KLAR took 20.0s. Estimated remaining: 2h 4m 4s. Rate: 9.4 symbols/min [2025-09-14T18:44:13.358791] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-14T18:44:14.801942] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:44:14.809699] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-14T18:44:16.277207] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:44:16.285766] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-14T18:44:17.593707] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T18:44:17.597985] [INFO ] [REMOTE ] KLC: Full fetch complete (38290 records). [2025-09-14T18:44:17.598156] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-14T18:44:17.986245] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-14T18:44:17.986429] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-14T18:44:17.987125] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-14T18:44:17.987190] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-14T18:44:17.988083] [DEBUG] [LOCAL ] KLC: Trimmed 38290 records to 26667 (keeping 150 days of data) [2025-09-14T18:44:18.144003] [DEBUG] [LOCAL ] KLC: Primary data saved (26667 records). [2025-09-14T18:44:18.144168] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-14T18:44:18.144276] [INFO ] [MAIN ] Update Progress: 1200/2370 symbols completed. KLC took 20.4s. Estimated remaining: 2h 3m 56s. Rate: 9.4 symbols/min [2025-09-14T18:44:18.761173] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:18.904621] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:18.933960] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:18.945577] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:18.954186] [DEBUG] [LOCAL ] KMPB: Loaded 1684 existing records from primary storage. [2025-09-14T18:44:18.954599] [INFO ] [MAIN ] KMPB: Loaded 1684 existing records. [2025-09-14T18:44:19.197021] [DEBUG] [LOCAL ] KMI: Loaded 24055 existing records from primary storage. [2025-09-14T18:44:19.202343] [DEBUG] [LOCAL ] KLG: Loaded 18758 existing records from primary storage. [2025-09-14T18:44:19.203631] [DEBUG] [LOCAL ] KMPR: Loaded 19234 existing records from primary storage. [2025-09-14T18:44:19.245003] [INFO ] [MAIN ] KLG: Loaded 18758 existing records. [2025-09-14T18:44:19.224095] [INFO ] [MAIN ] KMI: Loaded 24055 existing records. [2025-09-14T18:44:19.284584] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:19.290001] [INFO ] [MAIN ] KMPR: Loaded 19234 existing records. [2025-09-14T18:44:19.446168] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-14T18:44:19.490740] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-14T18:44:19.592293] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-14T18:44:19.662559] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-14T18:44:19.819112] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:19.885827] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:19.900047] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:19.921826] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-14T18:44:19.958505] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-14T18:44:19.942707] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-14T18:44:19.953182] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-14T18:44:19.959080] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-14T18:44:19.959290] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-14T18:44:19.970343] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-14T18:44:19.973711] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-14T18:44:19.984551] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-14T18:44:19.964720] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-14T18:44:20.000189] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-14T18:44:20.011433] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-14T18:44:20.987406] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:21.082047] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-14T18:44:21.194564] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:21.252833] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-14T18:44:21.291600] [INFO ] [REMOTE ] KMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:21.355091] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-14T18:44:21.369548] [INFO ] [REMOTE ] KLG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:21.372072] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-14T18:44:21.838793] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-14T18:44:21.840115] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-14T18:44:22.469130] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:44:22.470967] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-14T18:44:22.681118] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:44:22.687359] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-14T18:44:22.807088] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T18:44:22.815893] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-14T18:44:23.073313] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-14T18:44:23.074808] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-14T18:44:23.551920] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-14T18:44:23.562337] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-14T18:44:23.610312] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T18:44:23.758869] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-14T18:44:23.830077] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:44:24.384806] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T18:44:24.538257] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:44:24.558811] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-14T18:44:25.358852] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-14T18:44:25.607813] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-14T18:44:25.945811] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T18:44:26.160668] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-14T18:44:26.167744] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T18:44:26.958838] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-14T18:44:27.758841] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-14T18:44:28.280249] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T18:44:28.298140] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-14T18:44:28.547494] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:44:28.558764] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-14T18:44:29.358846] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-14T18:44:29.987385] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:44:30.158833] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-14T18:44:30.958830] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-14T18:44:31.003448] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T18:44:31.505019] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:44:31.505922] [INFO ] [REMOTE ] KMPB: Full fetch complete (3837 records). [2025-09-14T18:44:31.506005] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-14T18:44:31.763941] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-14T18:44:31.869390] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-14T18:44:31.869492] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-14T18:44:31.869638] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-14T18:44:31.869727] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-14T18:44:31.870129] [DEBUG] [LOCAL ] KMPB: Trimmed 3837 records to 2589 (keeping 150 days of data) [2025-09-14T18:44:31.886948] [DEBUG] [LOCAL ] KMPB: Primary data saved (2589 records). [2025-09-14T18:44:31.887039] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-14T18:44:31.887138] [INFO ] [MAIN ] Update Progress: 1201/2370 symbols completed. KMPB took 13.7s. Estimated remaining: 2h 3m 57s. Rate: 9.4 symbols/min [2025-09-14T18:44:32.062608] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:32.084986] [DEBUG] [LOCAL ] KMT: Loaded 19389 existing records from primary storage. [2025-09-14T18:44:32.085250] [INFO ] [MAIN ] KMT: Loaded 19389 existing records. [2025-09-14T18:44:32.278166] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:32.278557] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-14T18:44:32.278743] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-14T18:44:32.279724] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-14T18:44:32.279800] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-14T18:44:32.490051] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-14T18:44:32.567301] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-14T18:44:32.701029] [INFO ] [REMOTE ] KMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:33.333177] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:44:33.358771] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-14T18:44:34.053946] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T18:44:34.158775] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-14T18:44:34.950174] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:44:34.958790] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-14T18:44:35.758848] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-14T18:44:35.804883] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:44:36.558814] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-14T18:44:36.851813] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T18:44:37.069184] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T18:44:37.358923] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-14T18:44:38.015600] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:44:38.020298] [INFO ] [REMOTE ] KMPR: Full fetch complete (39728 records). [2025-09-14T18:44:38.020423] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-14T18:44:38.160436] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-14T18:44:38.423021] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-14T18:44:38.423883] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:44:38.424017] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-14T18:44:38.435211] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-14T18:44:38.435470] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-14T18:44:38.436819] [DEBUG] [LOCAL ] KMPR: Trimmed 39728 records to 29412 (keeping 150 days of data) [2025-09-14T18:44:38.619607] [DEBUG] [LOCAL ] KMPR: Primary data saved (29412 records). [2025-09-14T18:44:38.619782] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-14T18:44:38.619896] [INFO ] [MAIN ] Update Progress: 1202/2370 symbols completed. KMPR took 20.5s. Estimated remaining: 2h 3m 51s. Rate: 9.4 symbols/min [2025-09-14T18:44:38.789317] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:38.815423] [DEBUG] [LOCAL ] KMX: Loaded 23801 existing records from primary storage. [2025-09-14T18:44:38.815630] [INFO ] [MAIN ] KMX: Loaded 23801 existing records. [2025-09-14T18:44:38.965461] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-14T18:44:38.993445] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:38.993598] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-14T18:44:38.993694] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-14T18:44:38.994350] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-14T18:44:38.994409] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-14T18:44:39.349710] [INFO ] [REMOTE ] KMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:39.708805] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:44:39.712936] [INFO ] [REMOTE ] KLG: Full fetch complete (45848 records). [2025-09-14T18:44:39.713033] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-14T18:44:39.767132] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-14T18:44:40.095033] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-14T18:44:40.095204] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-14T18:44:40.096231] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-14T18:44:40.096323] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-14T18:44:40.121002] [DEBUG] [LOCAL ] KLG: Trimmed 45848 records to 31211 (keeping 150 days of data) [2025-09-14T18:44:40.120868] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T18:44:40.320345] [DEBUG] [LOCAL ] KLG: Primary data saved (31211 records). [2025-09-14T18:44:40.320513] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-14T18:44:40.320623] [INFO ] [MAIN ] Update Progress: 1203/2370 symbols completed. KLG took 22.2s. Estimated remaining: 2h 3m 40s. Rate: 9.4 symbols/min [2025-09-14T18:44:40.489149] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:40.507576] [DEBUG] [LOCAL ] KN: Loaded 16594 existing records from primary storage. [2025-09-14T18:44:40.507761] [INFO ] [MAIN ] KN: Loaded 16594 existing records. [2025-09-14T18:44:40.570347] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-14T18:44:40.686630] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:40.686880] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-14T18:44:40.686937] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-14T18:44:40.687388] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-14T18:44:40.687447] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-14T18:44:41.038161] [INFO ] [REMOTE ] KN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:41.358827] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-14T18:44:41.544389] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T18:44:42.158868] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-14T18:44:42.385479] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T18:44:42.803413] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T18:44:42.959161] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-14T18:44:43.764810] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-14T18:44:43.778575] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:44:44.177750] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T18:44:44.558953] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-14T18:44:45.358866] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-14T18:44:45.602745] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T18:44:46.158913] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-14T18:44:46.695369] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:44:46.821256] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T18:44:46.958905] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-14T18:44:47.758815] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-14T18:44:47.998923] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:44:48.037832] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T18:44:48.558838] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-14T18:44:49.358893] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-14T18:44:49.858473] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T18:44:50.158921] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-14T18:44:50.623007] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:44:50.767664] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:44:50.958898] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-14T18:44:51.613030] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:44:51.619597] [INFO ] [REMOTE ] KMI: Full fetch complete (58373 records). [2025-09-14T18:44:51.619860] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-14T18:44:51.763949] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-14T18:44:52.030158] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-14T18:44:52.030333] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-14T18:44:52.031443] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-14T18:44:52.031617] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-14T18:44:52.056766] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T18:44:52.065954] [DEBUG] [LOCAL ] KMI: Trimmed 58373 records to 40433 (keeping 150 days of data) [2025-09-14T18:44:52.345451] [DEBUG] [LOCAL ] KMI: Primary data saved (40433 records). [2025-09-14T18:44:52.345709] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-14T18:44:52.345890] [INFO ] [MAIN ] Update Progress: 1204/2370 symbols completed. KMI took 34.2s. Estimated remaining: 2h 3m 39s. Rate: 9.4 symbols/min [2025-09-14T18:44:52.520233] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:52.537805] [DEBUG] [LOCAL ] KNF: Loaded 16938 existing records from primary storage. [2025-09-14T18:44:52.537997] [INFO ] [MAIN ] KNF: Loaded 16938 existing records. [2025-09-14T18:44:52.569077] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-14T18:44:52.737397] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:52.737713] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-14T18:44:52.737794] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-14T18:44:52.738369] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-14T18:44:52.738431] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-14T18:44:53.101782] [INFO ] [REMOTE ] KNF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:53.366606] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-14T18:44:53.369031] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:44:54.158890] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-14T18:44:54.478000] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T18:44:54.949832] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:44:54.958773] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-14T18:44:55.647336] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T18:44:55.758827] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-14T18:44:56.112929] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T18:44:56.558840] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-14T18:44:57.349117] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:44:57.358912] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-14T18:44:57.717872] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-14T18:44:58.158859] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-14T18:44:58.969904] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-14T18:44:58.975226] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T18:44:59.465991] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T18:44:59.758879] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-14T18:45:00.558837] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-14T18:45:00.952675] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T18:45:00.981454] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:45:00.986202] [INFO ] [REMOTE ] KMT: Full fetch complete (46896 records). [2025-09-14T18:45:00.986325] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-14T18:45:01.363165] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-14T18:45:01.378117] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-14T18:45:01.378361] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-14T18:45:01.379604] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-14T18:45:01.379732] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-14T18:45:01.382009] [DEBUG] [LOCAL ] KMT: Trimmed 46896 records to 32243 (keeping 150 days of data) [2025-09-14T18:45:01.510771] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T18:45:01.645668] [DEBUG] [LOCAL ] KMT: Primary data saved (32243 records). [2025-09-14T18:45:01.645961] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-14T18:45:01.646158] [INFO ] [MAIN ] Update Progress: 1205/2370 symbols completed. KMT took 29.8s. Estimated remaining: 2h 3m 35s. Rate: 9.4 symbols/min [2025-09-14T18:45:01.857131] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:01.864822] [DEBUG] [LOCAL ] KNOP: Loaded 4043 existing records from primary storage. [2025-09-14T18:45:01.865017] [INFO ] [MAIN ] KNOP: Loaded 4043 existing records. [2025-09-14T18:45:02.069600] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:02.070090] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-14T18:45:02.070164] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-14T18:45:02.070712] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-14T18:45:02.070797] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-14T18:45:02.164223] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-14T18:45:02.478012] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:02.958909] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-14T18:45:03.758959] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-14T18:45:05.352942] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-14T18:45:05.357386] [INFO ] [REMOTE ] KN: Full fetch complete (42904 records). [2025-09-14T18:45:05.357494] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-14T18:45:05.770074] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-14T18:45:05.770361] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-14T18:45:05.771187] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-14T18:45:05.771303] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-14T18:45:05.772434] [DEBUG] [LOCAL ] KN: Trimmed 42904 records to 28476 (keeping 150 days of data) [2025-09-14T18:45:05.900037] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (3.74 seconds). [2025-09-14T18:45:05.911312] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-14T18:45:05.985479] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-14T18:45:05.988495] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-14T18:45:06.002399] [DEBUG] [LOCAL ] KN: Primary data saved (28476 records). [2025-09-14T18:45:06.002526] [INFO ] [MAIN ] KN: Full history saved. [2025-09-14T18:45:06.002628] [INFO ] [MAIN ] Update Progress: 1206/2370 symbols completed. KN took 25.7s. Estimated remaining: 2h 3m 27s. Rate: 9.4 symbols/min [2025-09-14T18:45:06.178971] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:06.189205] [DEBUG] [LOCAL ] KNSL: Loaded 8519 existing records from primary storage. [2025-09-14T18:45:06.189372] [INFO ] [MAIN ] KNSL: Loaded 8519 existing records. [2025-09-14T18:45:06.364208] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:06.364479] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-14T18:45:06.364538] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-14T18:45:06.364896] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-14T18:45:06.364958] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-14T18:45:06.727629] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:06.728234] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-14T18:45:06.762889] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (5.40 seconds). [2025-09-14T18:45:06.857306] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:45:06.958829] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-14T18:45:07.523963] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:45:07.722669] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:45:07.728213] [INFO ] [REMOTE ] KMX: Full fetch complete (57319 records). [2025-09-14T18:45:07.728334] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-14T18:45:07.763996] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-14T18:45:08.133419] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-14T18:45:08.144940] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-14T18:45:08.146059] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-14T18:45:08.146679] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-14T18:45:08.147133] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T18:45:08.153427] [DEBUG] [LOCAL ] KMX: Trimmed 57319 records to 40060 (keeping 150 days of data) [2025-09-14T18:45:08.394786] [DEBUG] [LOCAL ] KMX: Primary data saved (40060 records). [2025-09-14T18:45:08.394953] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-14T18:45:08.395073] [INFO ] [MAIN ] Update Progress: 1207/2370 symbols completed. KMX took 29.8s. Estimated remaining: 2h 3m 17s. Rate: 9.4 symbols/min [2025-09-14T18:45:08.567012] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-14T18:45:08.596045] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:08.618855] [DEBUG] [LOCAL ] KNTK: Loaded 21067 existing records from primary storage. [2025-09-14T18:45:08.619035] [INFO ] [MAIN ] KNTK: Loaded 21067 existing records. [2025-09-14T18:45:08.813378] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:08.813669] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-14T18:45:08.813733] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-14T18:45:08.814466] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-14T18:45:08.814537] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-14T18:45:09.094741] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:45:09.194168] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:09.358838] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-14T18:45:09.701888] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:45:10.158845] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-14T18:45:10.711573] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:45:10.958834] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-14T18:45:11.758885] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-14T18:45:11.822542] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:45:11.865012] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:45:12.260802] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T18:45:12.265148] [INFO ] [REMOTE ] KNF: Full fetch complete (38637 records). [2025-09-14T18:45:12.265309] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-14T18:45:12.563946] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-14T18:45:12.650414] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-14T18:45:12.650521] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-14T18:45:12.651238] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-14T18:45:12.651298] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-14T18:45:12.652500] [DEBUG] [LOCAL ] KNF: Trimmed 38637 records to 26885 (keeping 150 days of data) [2025-09-14T18:45:12.833320] [DEBUG] [LOCAL ] KNF: Primary data saved (26885 records). [2025-09-14T18:45:12.833494] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-14T18:45:12.833611] [INFO ] [MAIN ] Update Progress: 1208/2370 symbols completed. KNF took 20.5s. Estimated remaining: 2h 3m 9s. Rate: 9.4 symbols/min [2025-09-14T18:45:13.007565] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:13.029840] [DEBUG] [LOCAL ] KNX: Loaded 23430 existing records from primary storage. [2025-09-14T18:45:13.030008] [INFO ] [MAIN ] KNX: Loaded 23430 existing records. [2025-09-14T18:45:13.204077] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:13.204335] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-14T18:45:13.204394] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-14T18:45:13.205083] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-14T18:45:13.205155] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-14T18:45:13.365578] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-14T18:45:13.580366] [INFO ] [REMOTE ] KNX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:13.937375] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T18:45:14.158842] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-14T18:45:14.283355] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T18:45:14.958828] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-14T18:45:15.758839] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-14T18:45:15.978406] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T18:45:16.134502] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T18:45:16.558841] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-14T18:45:17.358834] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-14T18:45:17.905220] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T18:45:18.158858] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-14T18:45:18.275677] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:45:18.958850] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-14T18:45:19.041075] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:45:19.365239] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T18:45:19.758834] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-14T18:45:20.277036] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T18:45:20.293917] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:45:20.558840] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-14T18:45:21.358830] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-14T18:45:21.370141] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:45:21.373222] [INFO ] [REMOTE ] KNOP: Full fetch complete (10635 records). [2025-09-14T18:45:21.373356] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-14T18:45:21.743802] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-14T18:45:21.743947] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-14T18:45:21.744352] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-14T18:45:21.744439] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-14T18:45:21.745136] [DEBUG] [LOCAL ] KNOP: Trimmed 10635 records to 6675 (keeping 150 days of data) [2025-09-14T18:45:21.790438] [DEBUG] [LOCAL ] KNOP: Primary data saved (6675 records). [2025-09-14T18:45:21.790680] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-14T18:45:21.790962] [INFO ] [MAIN ] Update Progress: 1209/2370 symbols completed. KNOP took 20.1s. Estimated remaining: 2h 3m 5s. Rate: 9.4 symbols/min [2025-09-14T18:45:21.962976] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:21.990460] [DEBUG] [LOCAL ] KO: Loaded 24178 existing records from primary storage. [2025-09-14T18:45:21.990661] [INFO ] [MAIN ] KO: Loaded 24178 existing records. [2025-09-14T18:45:22.161470] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-14T18:45:22.164982] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:22.166606] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-14T18:45:22.166716] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-14T18:45:22.167528] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-14T18:45:22.167605] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-14T18:45:22.524027] [INFO ] [REMOTE ] KO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:22.958812] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-14T18:45:23.228894] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T18:45:23.294934] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T18:45:23.758827] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-14T18:45:24.558816] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-14T18:45:24.648464] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T18:45:25.358824] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-14T18:45:25.607533] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T18:45:25.904378] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:45:25.912209] [INFO ] [REMOTE ] KNSL: Full fetch complete (20039 records). [2025-09-14T18:45:25.912468] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-14T18:45:26.163926] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-14T18:45:26.287331] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-14T18:45:26.287460] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-14T18:45:26.288077] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-14T18:45:26.288150] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-14T18:45:26.289496] [DEBUG] [LOCAL ] KNSL: Trimmed 20039 records to 13657 (keeping 150 days of data) [2025-09-14T18:45:26.377832] [DEBUG] [LOCAL ] KNSL: Primary data saved (13657 records). [2025-09-14T18:45:26.378011] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-14T18:45:26.378160] [INFO ] [MAIN ] Update Progress: 1210/2370 symbols completed. KNSL took 20.4s. Estimated remaining: 2h 2m 57s. Rate: 9.4 symbols/min [2025-09-14T18:45:26.547699] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:26.568162] [DEBUG] [LOCAL ] KODK: Loaded 19615 existing records from primary storage. [2025-09-14T18:45:26.568343] [INFO ] [MAIN ] KODK: Loaded 19615 existing records. [2025-09-14T18:45:26.756502] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:26.756813] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-14T18:45:26.756877] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-14T18:45:26.757524] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-14T18:45:26.757600] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-14T18:45:26.969511] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-14T18:45:27.125151] [INFO ] [REMOTE ] KODK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:27.152280] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-14T18:45:27.622044] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T18:45:27.758827] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-14T18:45:28.558829] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-14T18:45:28.729054] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T18:45:29.358900] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-14T18:45:30.158796] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-14T18:45:30.485314] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T18:45:30.597450] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-14T18:45:30.958892] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-14T18:45:31.758831] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-14T18:45:31.864390] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-14T18:45:32.558866] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-14T18:45:32.882565] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-14T18:45:33.358846] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-14T18:45:33.827349] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T18:45:33.939449] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-14T18:45:34.011467] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T18:45:34.158850] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-14T18:45:34.868789] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:45:34.874387] [INFO ] [REMOTE ] KNX: Full fetch complete (57153 records). [2025-09-14T18:45:34.874571] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-14T18:45:34.966308] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-14T18:45:35.285116] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-14T18:45:35.285323] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-14T18:45:35.286415] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-14T18:45:35.286538] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-14T18:45:35.288015] [DEBUG] [LOCAL ] KNX: Trimmed 57153 records to 39453 (keeping 150 days of data) [2025-09-14T18:45:35.427232] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T18:45:35.588799] [DEBUG] [LOCAL ] KNX: Primary data saved (39453 records). [2025-09-14T18:45:35.588976] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-14T18:45:35.589093] [INFO ] [MAIN ] Update Progress: 1211/2370 symbols completed. KNX took 22.8s. Estimated remaining: 2h 2m 53s. Rate: 9.4 symbols/min [2025-09-14T18:45:35.769022] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-14T18:45:35.772000] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:35.785895] [DEBUG] [LOCAL ] KOF: Loaded 11840 existing records from primary storage. [2025-09-14T18:45:35.786543] [INFO ] [MAIN ] KOF: Loaded 11840 existing records. [2025-09-14T18:45:35.964577] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:35.964927] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-14T18:45:35.964989] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-14T18:45:35.965847] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-14T18:45:35.965919] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-14T18:45:36.318039] [INFO ] [REMOTE ] KOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:36.558896] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-14T18:45:37.358821] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-14T18:45:37.453308] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T18:45:37.745090] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-14T18:45:38.158897] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-14T18:45:38.222621] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:45:38.958850] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-14T18:45:39.037928] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:45:39.758897] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-14T18:45:40.558872] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-14T18:45:40.667549] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-14T18:45:40.752754] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:45:40.814219] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T18:45:41.358891] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-14T18:45:41.830482] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T18:45:41.835665] [INFO ] [REMOTE ] KNTK: Full fetch complete (49698 records). [2025-09-14T18:45:41.835791] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-14T18:45:42.171930] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-14T18:45:42.223328] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-14T18:45:42.223445] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-14T18:45:42.224340] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-14T18:45:42.224427] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-14T18:45:42.225704] [DEBUG] [LOCAL ] KNTK: Trimmed 49698 records to 35256 (keeping 150 days of data) [2025-09-14T18:45:42.458771] [DEBUG] [LOCAL ] KNTK: Primary data saved (35256 records). [2025-09-14T18:45:42.458961] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-14T18:45:42.459076] [INFO ] [MAIN ] Update Progress: 1212/2370 symbols completed. KNTK took 34.1s. Estimated remaining: 2h 2m 47s. Rate: 9.4 symbols/min [2025-09-14T18:45:42.630433] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:42.639707] [DEBUG] [LOCAL ] KOP: Loaded 7486 existing records from primary storage. [2025-09-14T18:45:42.639869] [INFO ] [MAIN ] KOP: Loaded 7486 existing records. [2025-09-14T18:45:42.832262] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:42.832750] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-14T18:45:42.833032] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-14T18:45:42.833588] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-14T18:45:42.833843] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-14T18:45:42.961954] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-14T18:45:42.966869] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T18:45:43.235579] [INFO ] [REMOTE ] KOP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:43.758855] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-14T18:45:44.180709] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T18:45:44.558855] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-14T18:45:44.765897] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T18:45:45.051192] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-14T18:45:45.358829] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-14T18:45:46.028292] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:45:46.158818] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-14T18:45:46.487844] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:45:46.958886] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-14T18:45:47.758879] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-14T18:45:48.006538] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T18:45:48.072507] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T18:45:48.558835] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-14T18:45:48.946847] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T18:45:49.358892] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-14T18:45:50.158885] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-14T18:45:50.511463] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:45:50.958845] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-14T18:45:51.196509] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-14T18:45:51.460082] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T18:45:51.603312] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T18:45:51.758887] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-14T18:45:52.558845] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-14T18:45:52.771931] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T18:45:53.358797] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-14T18:45:53.622754] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:45:54.158795] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-14T18:45:54.452951] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:45:54.456408] [INFO ] [REMOTE ] KOF: Full fetch complete (28624 records). [2025-09-14T18:45:54.456510] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-14T18:45:54.835007] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-14T18:45:54.835122] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-14T18:45:54.835828] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-14T18:45:54.835888] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-14T18:45:54.836756] [DEBUG] [LOCAL ] KOF: Trimmed 28624 records to 19800 (keeping 150 days of data) [2025-09-14T18:45:54.961048] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-14T18:45:54.961143] [DEBUG] [LOCAL ] KOF: Primary data saved (19800 records). [2025-09-14T18:45:54.962198] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-14T18:45:54.962310] [INFO ] [MAIN ] Update Progress: 1213/2370 symbols completed. KOF took 19.4s. Estimated remaining: 2h 2m 47s. Rate: 9.4 symbols/min [2025-09-14T18:45:55.132167] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:55.134685] [DEBUG] [LOCAL ] KORE: Loaded 884 existing records from primary storage. [2025-09-14T18:45:55.134772] [INFO ] [MAIN ] KORE: Loaded 884 existing records. [2025-09-14T18:45:55.307887] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:55.308149] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-14T18:45:55.308207] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-14T18:45:55.308508] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-14T18:45:55.308570] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-14T18:45:55.661554] [INFO ] [REMOTE ] KORE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:55.758885] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-14T18:45:55.844503] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T18:45:55.890633] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:45:56.458899] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T18:45:56.558883] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-14T18:45:57.040963] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-14T18:45:57.358830] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-14T18:45:58.090882] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:45:58.096834] [INFO ] [REMOTE ] KO: Full fetch complete (58498 records). [2025-09-14T18:45:58.097071] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-14T18:45:58.164889] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-14T18:45:58.496120] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-14T18:45:58.496224] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-14T18:45:58.497113] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-14T18:45:58.497170] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-14T18:45:58.498399] [DEBUG] [LOCAL ] KO: Trimmed 58498 records to 40558 (keeping 150 days of data) [2025-09-14T18:45:58.778850] [DEBUG] [LOCAL ] KO: Primary data saved (40558 records). [2025-09-14T18:45:58.779006] [INFO ] [MAIN ] KO: Full history saved. [2025-09-14T18:45:58.779101] [INFO ] [MAIN ] Update Progress: 1214/2370 symbols completed. KO took 37.0s. Estimated remaining: 2h 2m 38s. Rate: 9.4 symbols/min [2025-09-14T18:45:58.937729] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:45:58.958864] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-14T18:45:58.956468] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:58.959917] [INFO ] [REMOTE ] KOP: Full fetch complete (19460 records). [2025-09-14T18:45:58.960279] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-14T18:45:59.078465] [DEBUG] [LOCAL ] KOS: Loaded 15646 existing records from primary storage. [2025-09-14T18:45:59.093880] [INFO ] [MAIN ] KOS: Loaded 15646 existing records. [2025-09-14T18:45:59.509537] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:59.517337] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-14T18:45:59.517676] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-14T18:45:59.517456] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T18:45:59.517931] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-14T18:45:59.518399] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-14T18:45:59.520023] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-14T18:45:59.519673] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-14T18:45:59.520728] [DEBUG] [LOCAL ] KOP: Trimmed 19460 records to 12894 (keeping 150 days of data) [2025-09-14T18:45:59.520791] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-14T18:45:59.520948] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-14T18:45:59.766041] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-14T18:45:59.908354] [DEBUG] [LOCAL ] KOP: Primary data saved (12894 records). [2025-09-14T18:45:59.938222] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-14T18:45:59.947324] [INFO ] [MAIN ] Update Progress: 1215/2370 symbols completed. KOP took 17.5s. Estimated remaining: 2h 2m 27s. Rate: 9.4 symbols/min [2025-09-14T18:45:59.972418] [INFO ] [REMOTE ] KOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:00.140472] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:00.164522] [DEBUG] [LOCAL ] KR: Loaded 24096 existing records from primary storage. [2025-09-14T18:46:00.164753] [INFO ] [MAIN ] KR: Loaded 24096 existing records. [2025-09-14T18:46:00.344221] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:00.344517] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-14T18:46:00.344594] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-14T18:46:00.345339] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-14T18:46:00.345417] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-14T18:46:00.563984] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-14T18:46:00.696457] [INFO ] [REMOTE ] KR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:01.358257] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:46:01.359759] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-14T18:46:01.370939] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T18:46:01.375273] [INFO ] [REMOTE ] KODK: Full fetch complete (47264 records). [2025-09-14T18:46:01.375387] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-14T18:46:01.795710] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-14T18:46:01.795843] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-14T18:46:01.796765] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-14T18:46:01.796827] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-14T18:46:01.798142] [DEBUG] [LOCAL ] KODK: Trimmed 47264 records to 32592 (keeping 150 days of data) [2025-09-14T18:46:02.089773] [DEBUG] [LOCAL ] KODK: Primary data saved (32592 records). [2025-09-14T18:46:02.090014] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-14T18:46:02.090137] [INFO ] [MAIN ] Update Progress: 1216/2370 symbols completed. KODK took 35.7s. Estimated remaining: 2h 2m 16s. Rate: 9.4 symbols/min [2025-09-14T18:46:02.168803] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-14T18:46:02.222090] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:46:02.383831] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:02.412698] [DEBUG] [LOCAL ] KRC: Loaded 21320 existing records from primary storage. [2025-09-14T18:46:02.412941] [INFO ] [MAIN ] KRC: Loaded 21320 existing records. [2025-09-14T18:46:02.703152] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:02.703565] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-14T18:46:02.703699] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-14T18:46:02.704621] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-14T18:46:02.704748] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-14T18:46:02.966620] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-14T18:46:03.148851] [INFO ] [REMOTE ] KRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:03.671201] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T18:46:03.758860] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-14T18:46:04.116295] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T18:46:04.134470] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T18:46:04.558832] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-14T18:46:04.987474] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T18:46:04.988295] [INFO ] [REMOTE ] KORE: Full fetch complete (2249 records). [2025-09-14T18:46:04.988379] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-14T18:46:05.354297] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-14T18:46:05.354402] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-14T18:46:05.354511] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-14T18:46:05.354561] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-14T18:46:05.354985] [DEBUG] [LOCAL ] KORE: Trimmed 2249 records to 1563 (keeping 150 days of data) [2025-09-14T18:46:05.364434] [DEBUG] [LOCAL ] KORE: Primary data saved (1563 records). [2025-09-14T18:46:05.362218] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-14T18:46:05.364617] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-14T18:46:05.365446] [INFO ] [MAIN ] Update Progress: 1217/2370 symbols completed. KORE took 10.4s. Estimated remaining: 2h 2m 7s. Rate: 9.4 symbols/min [2025-09-14T18:46:05.542397] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:05.559844] [DEBUG] [LOCAL ] KREF: Loaded 15943 existing records from primary storage. [2025-09-14T18:46:05.560002] [INFO ] [MAIN ] KREF: Loaded 15943 existing records. [2025-09-14T18:46:05.737894] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:05.738198] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-14T18:46:05.738276] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-14T18:46:05.738853] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-14T18:46:05.738931] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-14T18:46:06.090965] [INFO ] [REMOTE ] KREF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:06.158790] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-14T18:46:06.958778] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-14T18:46:07.641267] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T18:46:07.690838] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T18:46:07.758895] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-14T18:46:08.558879] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-14T18:46:08.731148] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T18:46:09.217579] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T18:46:09.358904] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-14T18:46:10.158901] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-14T18:46:10.783724] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T18:46:10.958832] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-14T18:46:11.339854] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:46:11.758835] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-14T18:46:11.820497] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:46:12.558865] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-14T18:46:13.049765] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T18:46:13.358831] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-14T18:46:13.520663] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:46:14.158801] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-14T18:46:14.272170] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:46:14.958871] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-14T18:46:15.283680] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T18:46:15.758792] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-14T18:46:16.271842] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:46:16.558889] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-14T18:46:16.837303] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T18:46:17.192326] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:46:17.358835] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-14T18:46:18.158870] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-14T18:46:18.555888] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T18:46:18.958854] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-14T18:46:19.203263] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:46:19.758934] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-14T18:46:20.142884] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-14T18:46:20.564809] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-14T18:46:20.587379] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:46:21.358869] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-14T18:46:21.649450] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:46:22.093000] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:46:22.158845] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-14T18:46:22.402817] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T18:46:22.958884] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-14T18:46:23.714923] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:46:23.720665] [INFO ] [REMOTE ] KR: Full fetch complete (58358 records). [2025-09-14T18:46:23.720804] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-14T18:46:23.763972] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-14T18:46:24.114319] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-14T18:46:24.114452] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-14T18:46:24.115344] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-14T18:46:24.115421] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-14T18:46:24.117157] [DEBUG] [LOCAL ] KR: Trimmed 58358 records to 40423 (keeping 150 days of data) [2025-09-14T18:46:24.240955] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T18:46:24.426521] [DEBUG] [LOCAL ] KR: Primary data saved (40423 records). [2025-09-14T18:46:24.426895] [INFO ] [MAIN ] KR: Full history saved. [2025-09-14T18:46:24.427001] [INFO ] [MAIN ] Update Progress: 1218/2370 symbols completed. KR took 24.5s. Estimated remaining: 2h 2m 13s. Rate: 9.4 symbols/min [2025-09-14T18:46:24.571799] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-14T18:46:24.603571] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:24.626870] [DEBUG] [LOCAL ] KRG: Loaded 21821 existing records from primary storage. [2025-09-14T18:46:24.627027] [INFO ] [MAIN ] KRG: Loaded 21821 existing records. [2025-09-14T18:46:24.810268] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:24.810542] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-14T18:46:24.810603] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-14T18:46:24.811413] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-14T18:46:24.811477] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-14T18:46:25.184655] [INFO ] [REMOTE ] KRG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:25.358835] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-14T18:46:25.503118] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T18:46:26.158825] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-14T18:46:26.229960] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T18:46:26.235669] [INFO ] [REMOTE ] KOS: Full fetch complete (57717 records). [2025-09-14T18:46:26.235837] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-14T18:46:26.637615] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-14T18:46:26.637767] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-14T18:46:26.638839] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-14T18:46:26.638917] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-14T18:46:26.640418] [DEBUG] [LOCAL ] KOS: Trimmed 57717 records to 39954 (keeping 150 days of data) [2025-09-14T18:46:26.872161] [DEBUG] [LOCAL ] KOS: Primary data saved (39954 records). [2025-09-14T18:46:26.872339] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-14T18:46:26.872450] [INFO ] [MAIN ] Update Progress: 1219/2370 symbols completed. KOS took 28.1s. Estimated remaining: 2h 2m 3s. Rate: 9.4 symbols/min [2025-09-14T18:46:26.963896] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-14T18:46:27.056345] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:27.080455] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:46:27.105257] [DEBUG] [LOCAL ] KRMN: Loaded 21542 existing records from primary storage. [2025-09-14T18:46:27.105418] [INFO ] [MAIN ] KRMN: Loaded 21542 existing records. [2025-09-14T18:46:27.286537] [WARN ] [MAIN ] KRMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:27.286897] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-14T18:46:27.286979] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-14T18:46:27.287732] [DEBUG] [LOCAL ] KRMN: Deleted primary data file. [2025-09-14T18:46:27.287806] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-14T18:46:27.669885] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:27.758836] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-14T18:46:27.961542] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T18:46:28.558866] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-14T18:46:28.644242] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:46:29.180543] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T18:46:29.358817] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-14T18:46:29.766944] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:46:30.158820] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-14T18:46:30.795142] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:46:30.799169] [INFO ] [REMOTE ] KREF: Full fetch complete (39270 records). [2025-09-14T18:46:30.799294] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-14T18:46:30.980689] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-14T18:46:31.200679] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-14T18:46:31.200839] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-14T18:46:31.201617] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-14T18:46:31.201834] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-14T18:46:31.202877] [DEBUG] [LOCAL ] KREF: Trimmed 39270 records to 27613 (keeping 150 days of data) [2025-09-14T18:46:31.337315] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:46:31.410190] [DEBUG] [LOCAL ] KREF: Primary data saved (27613 records). [2025-09-14T18:46:31.410369] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-14T18:46:31.410486] [INFO ] [MAIN ] Update Progress: 1220/2370 symbols completed. KREF took 26.0s. Estimated remaining: 2h 1m 54s. Rate: 9.4 symbols/min [2025-09-14T18:46:31.584181] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:31.596788] [DEBUG] [LOCAL ] KRO: Loaded 11990 existing records from primary storage. [2025-09-14T18:46:31.596952] [INFO ] [MAIN ] KRO: Loaded 11990 existing records. [2025-09-14T18:46:31.773696] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-14T18:46:31.812628] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:31.814068] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-14T18:46:31.815811] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-14T18:46:31.816311] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-14T18:46:31.816393] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-14T18:46:32.183458] [INFO ] [REMOTE ] KRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:32.558850] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-14T18:46:32.735502] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T18:46:33.231684] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:46:33.358788] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-14T18:46:33.651273] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T18:46:34.158836] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-14T18:46:34.958829] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-14T18:46:35.147424] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:46:35.758806] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-14T18:46:35.818679] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:46:36.189880] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T18:46:36.558812] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-14T18:46:37.224597] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:46:37.229916] [INFO ] [REMOTE ] KRC: Full fetch complete (52760 records). [2025-09-14T18:46:37.230065] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-14T18:46:37.360576] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-14T18:46:37.623778] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-14T18:46:37.623925] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-14T18:46:37.624854] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-14T18:46:37.624942] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-14T18:46:37.626483] [DEBUG] [LOCAL ] KRC: Trimmed 52760 records to 36061 (keeping 150 days of data) [2025-09-14T18:46:37.751397] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T18:46:37.905207] [DEBUG] [LOCAL ] KRC: Primary data saved (36061 records). [2025-09-14T18:46:37.905407] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-14T18:46:37.905575] [INFO ] [MAIN ] Update Progress: 1221/2370 symbols completed. KRC took 35.8s. Estimated remaining: 2h 1m 48s. Rate: 9.4 symbols/min [2025-09-14T18:46:38.078211] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:38.095309] [DEBUG] [LOCAL ] KRP: Loaded 15906 existing records from primary storage. [2025-09-14T18:46:38.095474] [INFO ] [MAIN ] KRP: Loaded 15906 existing records. [2025-09-14T18:46:38.163908] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-14T18:46:38.278434] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:38.278715] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-14T18:46:38.278779] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-14T18:46:38.279245] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-14T18:46:38.279312] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-14T18:46:38.633984] [INFO ] [REMOTE ] KRP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:38.893781] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T18:46:38.958851] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-14T18:46:39.758820] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-14T18:46:39.976859] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:46:40.018837] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:46:40.558864] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-14T18:46:41.229395] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:46:41.358814] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-14T18:46:42.164038] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-14T18:46:42.166493] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T18:46:42.959984] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-14T18:46:42.962806] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T18:46:43.758917] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-14T18:46:43.881535] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T18:46:44.558880] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-14T18:46:44.618212] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T18:46:44.978529] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:46:45.358842] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-14T18:46:45.784132] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T18:46:46.025349] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:46:46.030577] [INFO ] [REMOTE ] KRG: Full fetch complete (53458 records). [2025-09-14T18:46:46.030719] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-14T18:46:46.168547] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-14T18:46:46.404096] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-14T18:46:46.404205] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-14T18:46:46.405046] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-14T18:46:46.405104] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-14T18:46:46.406315] [DEBUG] [LOCAL ] KRG: Trimmed 53458 records to 36852 (keeping 150 days of data) [2025-09-14T18:46:46.646720] [DEBUG] [LOCAL ] KRG: Primary data saved (36852 records). [2025-09-14T18:46:46.646958] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-14T18:46:46.647112] [INFO ] [MAIN ] Update Progress: 1222/2370 symbols completed. KRG took 22.2s. Estimated remaining: 2h 1m 44s. Rate: 9.4 symbols/min [2025-09-14T18:46:46.815734] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:46.839116] [DEBUG] [LOCAL ] KSS: Loaded 23997 existing records from primary storage. [2025-09-14T18:46:46.839286] [INFO ] [MAIN ] KSS: Loaded 23997 existing records. [2025-09-14T18:46:46.963932] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-14T18:46:47.015418] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:47.015714] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-14T18:46:47.015786] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-14T18:46:47.016522] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-14T18:46:47.016600] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-14T18:46:47.382384] [INFO ] [REMOTE ] KSS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:47.758868] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-14T18:46:47.899770] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T18:46:48.379213] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:46:48.558846] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-14T18:46:49.358805] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-14T18:46:49.412568] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:46:50.157089] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T18:46:50.166873] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-14T18:46:50.958805] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-14T18:46:51.020297] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T18:46:51.758899] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-14T18:46:51.947449] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T18:46:52.558882] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-14T18:46:53.120698] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T18:46:53.194683] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:46:53.358830] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-14T18:46:54.127160] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:46:54.158886] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-14T18:46:54.958923] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-14T18:46:55.048029] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-14T18:46:55.064628] [INFO ] [REMOTE ] KRMN: Full fetch complete (47013 records). [2025-09-14T18:46:55.065030] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-14T18:46:55.340576] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T18:46:55.341433] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:46:55.341533] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:46:55.341595] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-14T18:46:55.341698] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-14T18:46:55.341774] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-14T18:46:55.341848] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-14T18:46:55.341967] [INFO ] [MAIN ] Update Progress: 1223/2370 symbols completed. KRMN took 28.5s. Estimated remaining: 2h 1m 40s. Rate: 9.4 symbols/min [2025-09-14T18:46:55.538240] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:55.561492] [DEBUG] [LOCAL ] KT: Loaded 20006 existing records from primary storage. [2025-09-14T18:46:55.561702] [INFO ] [MAIN ] KT: Loaded 20006 existing records. [2025-09-14T18:46:55.761655] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-14T18:46:55.768408] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:55.770414] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-14T18:46:55.770502] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-14T18:46:55.771229] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-14T18:46:55.771307] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-14T18:46:56.145450] [INFO ] [REMOTE ] KT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:56.153486] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T18:46:56.156833] [INFO ] [REMOTE ] KRO: Full fetch complete (26933 records). [2025-09-14T18:46:56.156940] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-14T18:46:56.557456] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-14T18:46:56.557625] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-14T18:46:56.570654] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-14T18:46:56.571350] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-14T18:46:56.571993] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-14T18:46:56.572085] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-14T18:46:56.574045] [DEBUG] [LOCAL ] KRO: Trimmed 26933 records to 19761 (keeping 150 days of data) [2025-09-14T18:46:56.696297] [DEBUG] [LOCAL ] KRO: Primary data saved (19761 records). [2025-09-14T18:46:56.696481] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-14T18:46:56.696627] [INFO ] [MAIN ] Update Progress: 1224/2370 symbols completed. KRO took 25.3s. Estimated remaining: 2h 1m 29s. Rate: 9.4 symbols/min [2025-09-14T18:46:56.874995] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:56.893088] [DEBUG] [LOCAL ] KTB: Loaded 18631 existing records from primary storage. [2025-09-14T18:46:56.893275] [INFO ] [MAIN ] KTB: Loaded 18631 existing records. [2025-09-14T18:46:57.072922] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:57.073434] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-14T18:46:57.073505] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-14T18:46:57.074418] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-14T18:46:57.074483] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-14T18:46:57.368348] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-14T18:46:57.424261] [INFO ] [REMOTE ] KTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:57.448392] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:46:58.158827] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-14T18:46:58.331344] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:46:58.958873] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-14T18:46:59.225119] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:46:59.595152] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:46:59.758857] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-14T18:47:00.558838] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-14T18:47:00.688781] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:47:01.358870] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-14T18:47:01.958154] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-14T18:47:02.002831] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T18:47:02.006621] [INFO ] [REMOTE ] KRP: Full fetch complete (41605 records). [2025-09-14T18:47:02.006814] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-14T18:47:02.166673] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-14T18:47:02.396130] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-14T18:47:02.396264] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-14T18:47:02.397124] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-14T18:47:02.397204] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-14T18:47:02.398328] [DEBUG] [LOCAL ] KRP: Trimmed 41605 records to 27131 (keeping 150 days of data) [2025-09-14T18:47:02.569000] [DEBUG] [LOCAL ] KRP: Primary data saved (27131 records). [2025-09-14T18:47:02.569170] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-14T18:47:02.569273] [INFO ] [MAIN ] Update Progress: 1225/2370 symbols completed. KRP took 24.7s. Estimated remaining: 2h 1m 22s. Rate: 9.4 symbols/min [2025-09-14T18:47:02.738905] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:02.747459] [DEBUG] [LOCAL ] KTF: Loaded 5354 existing records from primary storage. [2025-09-14T18:47:02.747658] [INFO ] [MAIN ] KTF: Loaded 5354 existing records. [2025-09-14T18:47:02.939950] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:02.940574] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-14T18:47:02.940716] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-14T18:47:02.941091] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-14T18:47:02.941187] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-14T18:47:02.963987] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-14T18:47:03.346040] [INFO ] [REMOTE ] KTF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:03.351369] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T18:47:03.767457] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-14T18:47:03.794043] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:47:04.558823] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-14T18:47:04.622723] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:47:05.060744] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T18:47:05.358858] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-14T18:47:06.158847] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-14T18:47:06.443322] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:47:06.958863] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-14T18:47:07.115851] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:47:07.758892] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-14T18:47:08.319195] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T18:47:08.468588] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:47:08.558785] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-14T18:47:09.358890] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-14T18:47:09.444027] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:47:09.631991] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:47:10.158799] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-14T18:47:10.484823] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:47:10.958915] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-14T18:47:11.758828] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-14T18:47:11.850317] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:47:12.138990] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:47:12.449307] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:47:12.455131] [INFO ] [REMOTE ] KSS: Full fetch complete (58290 records). [2025-09-14T18:47:12.455276] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-14T18:47:12.563987] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-14T18:47:12.847531] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-14T18:47:12.847654] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-14T18:47:12.848567] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-14T18:47:12.848634] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-14T18:47:12.850300] [DEBUG] [LOCAL ] KSS: Trimmed 58290 records to 40357 (keeping 150 days of data) [2025-09-14T18:47:13.114710] [DEBUG] [LOCAL ] KSS: Primary data saved (40357 records). [2025-09-14T18:47:13.114872] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-14T18:47:13.115015] [INFO ] [MAIN ] Update Progress: 1226/2370 symbols completed. KSS took 26.5s. Estimated remaining: 2h 1m 20s. Rate: 9.4 symbols/min [2025-09-14T18:47:13.284237] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:13.288020] [DEBUG] [LOCAL ] KUKE: Loaded 1459 existing records from primary storage. [2025-09-14T18:47:13.288112] [INFO ] [MAIN ] KUKE: Loaded 1459 existing records. [2025-09-14T18:47:13.363914] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-14T18:47:13.465942] [WARN ] [MAIN ] KUKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:13.466207] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-14T18:47:13.466281] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-14T18:47:13.466575] [DEBUG] [LOCAL ] KUKE: Deleted primary data file. [2025-09-14T18:47:13.466666] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-14T18:47:13.819586] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:14.158829] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-14T18:47:14.375283] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:47:14.958828] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-14T18:47:15.033360] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:47:15.094010] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T18:47:15.758886] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-14T18:47:15.804096] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T18:47:16.558838] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-14T18:47:17.358810] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-14T18:47:17.417485] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:47:17.533798] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T18:47:18.158834] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-14T18:47:18.806621] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:47:18.810951] [INFO ] [REMOTE ] KTB: Full fetch complete (45327 records). [2025-09-14T18:47:18.811081] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-14T18:47:18.968828] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-14T18:47:19.236362] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-14T18:47:19.236605] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-14T18:47:19.237463] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-14T18:47:19.237691] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-14T18:47:19.247706] [DEBUG] [LOCAL ] KTB: Trimmed 45327 records to 30714 (keeping 150 days of data) [2025-09-14T18:47:19.264375] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T18:47:19.469688] [DEBUG] [LOCAL ] KTB: Primary data saved (30714 records). [2025-09-14T18:47:19.469856] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-14T18:47:19.469953] [INFO ] [MAIN ] Update Progress: 1227/2370 symbols completed. KTB took 22.8s. Estimated remaining: 2h 1m 13s. Rate: 9.4 symbols/min [2025-09-14T18:47:19.638267] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:19.661618] [DEBUG] [LOCAL ] KVUE: Loaded 24030 existing records from primary storage. [2025-09-14T18:47:19.661808] [INFO ] [MAIN ] KVUE: Loaded 24030 existing records. [2025-09-14T18:47:19.763464] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-14T18:47:19.840593] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:19.840903] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-14T18:47:19.840964] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-14T18:47:19.841708] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-14T18:47:19.841777] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-14T18:47:20.129134] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:47:20.217040] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:20.558854] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-14T18:47:21.256896] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T18:47:21.262233] [INFO ] [REMOTE ] KT: Full fetch complete (49997 records). [2025-09-14T18:47:21.262370] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-14T18:47:21.360631] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-14T18:47:21.641600] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-14T18:47:21.641792] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-14T18:47:21.642674] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-14T18:47:21.642795] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-14T18:47:21.644367] [DEBUG] [LOCAL ] KT: Trimmed 49997 records to 33903 (keeping 150 days of data) [2025-09-14T18:47:21.871506] [DEBUG] [LOCAL ] KT: Primary data saved (33903 records). [2025-09-14T18:47:21.871695] [INFO ] [MAIN ] KT: Full history saved. [2025-09-14T18:47:21.871811] [INFO ] [MAIN ] Update Progress: 1228/2370 symbols completed. KT took 26.5s. Estimated remaining: 2h 1m 3s. Rate: 9.4 symbols/min [2025-09-14T18:47:22.042074] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:22.064334] [DEBUG] [LOCAL ] KVYO: Loaded 22357 existing records from primary storage. [2025-09-14T18:47:22.064493] [INFO ] [MAIN ] KVYO: Loaded 22357 existing records. [2025-09-14T18:47:22.164741] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-14T18:47:22.244098] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:22.244339] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-14T18:47:22.244401] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-14T18:47:22.245103] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-14T18:47:22.245172] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-14T18:47:22.620230] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:22.630954] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T18:47:22.666359] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T18:47:22.958847] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-14T18:47:23.123582] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:47:23.758837] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-14T18:47:24.211246] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T18:47:24.558829] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-14T18:47:25.016074] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T18:47:25.135200] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-14T18:47:25.358825] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-14T18:47:26.158836] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-14T18:47:26.655023] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-14T18:47:26.958818] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-14T18:47:27.244579] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:47:27.492683] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T18:47:27.758836] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-14T18:47:28.512571] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:47:28.514213] [INFO ] [REMOTE ] KTF: Full fetch complete (14206 records). [2025-09-14T18:47:28.514311] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-14T18:47:28.566296] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-14T18:47:28.870049] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-14T18:47:28.870151] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-14T18:47:28.870504] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-14T18:47:28.870580] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-14T18:47:28.871157] [DEBUG] [LOCAL ] KTF: Trimmed 14206 records to 8981 (keeping 150 days of data) [2025-09-14T18:47:28.926464] [DEBUG] [LOCAL ] KTF: Primary data saved (8981 records). [2025-09-14T18:47:28.926621] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-14T18:47:28.926787] [INFO ] [MAIN ] Update Progress: 1229/2370 symbols completed. KTF took 26.4s. Estimated remaining: 2h 0m 58s. Rate: 9.4 symbols/min [2025-09-14T18:47:29.094274] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:29.113980] [DEBUG] [LOCAL ] KW: Loaded 17575 existing records from primary storage. [2025-09-14T18:47:29.114136] [INFO ] [MAIN ] KW: Loaded 17575 existing records. [2025-09-14T18:47:29.295720] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T18:47:29.299239] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:29.301317] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-14T18:47:29.301380] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-14T18:47:29.302005] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-14T18:47:29.302070] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-14T18:47:29.363873] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-14T18:47:29.658879] [INFO ] [REMOTE ] KW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:30.158812] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-14T18:47:30.757621] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:47:30.758897] [INFO ] [REMOTE ] KUKE: Full fetch complete (4920 records). [2025-09-14T18:47:30.758991] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-14T18:47:30.937690] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T18:47:30.937964] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:47:30.938019] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:47:30.938064] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-14T18:47:30.938141] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-14T18:47:30.938233] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-14T18:47:30.938333] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-14T18:47:30.938431] [INFO ] [MAIN ] Update Progress: 1230/2370 symbols completed. KUKE took 17.8s. Estimated remaining: 2h 0m 47s. Rate: 9.4 symbols/min [2025-09-14T18:47:30.970129] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-14T18:47:31.112763] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:31.125877] [DEBUG] [LOCAL ] KWR: Loaded 7309 existing records from primary storage. [2025-09-14T18:47:31.126050] [INFO ] [MAIN ] KWR: Loaded 7309 existing records. [2025-09-14T18:47:31.305839] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:31.306221] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-14T18:47:31.306326] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-14T18:47:31.306833] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-14T18:47:31.306916] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-14T18:47:31.644621] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T18:47:31.720095] [INFO ] [REMOTE ] KWR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:31.758782] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-14T18:47:32.489006] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T18:47:32.558791] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-14T18:47:33.358808] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-14T18:47:33.682890] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T18:47:34.072915] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:47:34.158798] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-14T18:47:34.958807] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-14T18:47:35.037614] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:47:35.758811] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-14T18:47:35.823092] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:47:36.094682] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:47:36.558847] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-14T18:47:37.344124] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:47:37.358767] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-14T18:47:37.693736] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:47:38.158828] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-14T18:47:38.958914] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-14T18:47:39.135769] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T18:47:39.190524] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T18:47:39.758824] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-14T18:47:40.558799] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-14T18:47:40.676325] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T18:47:40.927931] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T18:47:41.358894] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-14T18:47:42.158841] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-14T18:47:42.427115] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:47:42.567075] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T18:47:42.958832] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-14T18:47:43.758834] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-14T18:47:43.940756] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T18:47:44.470160] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:47:44.558796] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-14T18:47:45.358844] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-14T18:47:45.567482] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T18:47:46.134173] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T18:47:46.158785] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-14T18:47:46.745567] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:47:46.958802] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-14T18:47:47.659781] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T18:47:47.758902] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-14T18:47:48.458677] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:47:48.467822] [INFO ] [REMOTE ] KVUE: Full fetch complete (58347 records). [2025-09-14T18:47:48.468113] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-14T18:47:48.566735] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-14T18:47:48.998656] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-14T18:47:48.999400] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-14T18:47:49.000802] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-14T18:47:49.025621] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-14T18:47:49.031923] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T18:47:49.043434] [DEBUG] [LOCAL ] KVUE: Trimmed 58347 records to 40407 (keeping 150 days of data) [2025-09-14T18:47:49.186434] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T18:47:49.195307] [INFO ] [REMOTE ] KW: Full fetch complete (43647 records). [2025-09-14T18:47:49.195631] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-14T18:47:49.367672] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-14T18:47:49.676664] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-14T18:47:49.677756] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-14T18:47:49.678741] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-14T18:47:49.679082] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-14T18:47:49.681229] [DEBUG] [LOCAL ] KW: Trimmed 43647 records to 30508 (keeping 150 days of data) [2025-09-14T18:47:49.875101] [DEBUG] [LOCAL ] KW: Primary data saved (30508 records). [2025-09-14T18:47:49.876090] [INFO ] [MAIN ] KW: Full history saved. [2025-09-14T18:47:49.876199] [INFO ] [MAIN ] Update Progress: 1231/2370 symbols completed. KW took 20.9s. Estimated remaining: 2h 0m 52s. Rate: 9.4 symbols/min [2025-09-14T18:47:49.975984] [DEBUG] [LOCAL ] KVUE: Primary data saved (40407 records). [2025-09-14T18:47:49.986204] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-14T18:47:49.986416] [INFO ] [MAIN ] Update Progress: 1232/2370 symbols completed. KVUE took 30.5s. Estimated remaining: 2h 0m 40s. Rate: 9.4 symbols/min [2025-09-14T18:47:50.161663] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:50.160308] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-14T18:47:50.248783] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:50.260935] [DEBUG] [LOCAL ] KYN: Loaded 13447 existing records from primary storage. [2025-09-14T18:47:50.261202] [INFO ] [MAIN ] KYN: Loaded 13447 existing records. [2025-09-14T18:47:50.450716] [DEBUG] [LOCAL ] L: Loaded 18981 existing records from primary storage. [2025-09-14T18:47:50.450215] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:50.450955] [INFO ] [MAIN ] L: Loaded 18981 existing records. [2025-09-14T18:47:50.451082] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-14T18:47:50.513003] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-14T18:47:50.540027] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-14T18:47:50.550084] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-14T18:47:50.778787] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:50.875605] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-14T18:47:50.905423] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-14T18:47:50.913560] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-14T18:47:50.934514] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-14T18:47:51.061820] [INFO ] [REMOTE ] KYN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:51.085558] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-14T18:47:51.354330] [INFO ] [REMOTE ] L: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:51.369573] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:47:51.406281] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T18:47:51.758949] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-14T18:47:52.558856] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-14T18:47:52.607576] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T18:47:52.755798] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T18:47:53.358836] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-14T18:47:53.932526] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-14T18:47:53.937859] [INFO ] [REMOTE ] KVYO: Full fetch complete (54023 records). [2025-09-14T18:47:53.937973] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-14T18:47:54.163929] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-14T18:47:54.322177] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-14T18:47:54.322290] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-14T18:47:54.323121] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-14T18:47:54.323180] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-14T18:47:54.324370] [DEBUG] [LOCAL ] KVYO: Trimmed 54023 records to 37922 (keeping 150 days of data) [2025-09-14T18:47:54.546426] [DEBUG] [LOCAL ] KVYO: Primary data saved (37922 records). [2025-09-14T18:47:54.546620] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-14T18:47:54.546761] [INFO ] [MAIN ] Update Progress: 1233/2370 symbols completed. KVYO took 32.7s. Estimated remaining: 2h 0m 32s. Rate: 9.4 symbols/min [2025-09-14T18:47:54.727025] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:54.746819] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:47:54.776015] [DEBUG] [LOCAL ] LAC: Loaded 23609 existing records from primary storage. [2025-09-14T18:47:54.776260] [INFO ] [MAIN ] LAC: Loaded 23609 existing records. [2025-09-14T18:47:54.964280] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-14T18:47:54.970436] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:54.971907] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-14T18:47:54.971988] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-14T18:47:54.972907] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-14T18:47:54.972986] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-14T18:47:55.365236] [INFO ] [REMOTE ] LAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:55.524442] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:47:55.527926] [INFO ] [REMOTE ] KWR: Full fetch complete (18489 records). [2025-09-14T18:47:55.528157] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-14T18:47:55.764145] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-14T18:47:55.928954] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-14T18:47:55.929145] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-14T18:47:55.929804] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-14T18:47:55.930552] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-14T18:47:55.931535] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T18:47:55.941026] [DEBUG] [LOCAL ] KWR: Trimmed 18489 records to 12557 (keeping 150 days of data) [2025-09-14T18:47:56.031948] [DEBUG] [LOCAL ] KWR: Primary data saved (12557 records). [2025-09-14T18:47:56.032161] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-14T18:47:56.032284] [INFO ] [MAIN ] Update Progress: 1234/2370 symbols completed. KWR took 25.1s. Estimated remaining: 2h 0m 21s. Rate: 9.4 symbols/min [2025-09-14T18:47:56.205163] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:56.217933] [DEBUG] [LOCAL ] LAD: Loaded 10217 existing records from primary storage. [2025-09-14T18:47:56.218084] [INFO ] [MAIN ] LAD: Loaded 10217 existing records. [2025-09-14T18:47:56.394379] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:56.394680] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-14T18:47:56.394742] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-14T18:47:56.395179] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-14T18:47:56.395238] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-14T18:47:56.565751] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-14T18:47:56.751066] [INFO ] [REMOTE ] LAD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:57.358827] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-14T18:47:57.791247] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T18:47:58.158848] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-14T18:47:58.271837] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T18:47:58.474165] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T18:47:58.958887] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-14T18:47:59.397615] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:47:59.758874] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-14T18:48:00.282309] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T18:48:00.558841] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-14T18:48:01.358852] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-14T18:48:01.559586] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T18:48:02.129730] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:48:02.158836] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-14T18:48:02.958862] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-14T18:48:03.758833] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-14T18:48:04.412723] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (3.05 seconds). [2025-09-14T18:48:04.558798] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-14T18:48:04.989941] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-14T18:48:05.358839] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-14T18:48:06.085433] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T18:48:06.165921] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-14T18:48:06.182697] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-09-14T18:48:06.211875] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T18:48:06.683933] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T18:48:06.958871] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-14T18:48:07.758795] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-14T18:48:08.050498] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:48:08.053758] [INFO ] [REMOTE ] KYN: Full fetch complete (33127 records). [2025-09-14T18:48:08.053861] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-14T18:48:08.443117] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-14T18:48:08.443299] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-14T18:48:08.444487] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-14T18:48:08.444563] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-14T18:48:08.482584] [DEBUG] [LOCAL ] KYN: Trimmed 33127 records to 22403 (keeping 150 days of data) [2025-09-14T18:48:08.487127] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T18:48:08.566570] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-14T18:48:08.652671] [DEBUG] [LOCAL ] KYN: Primary data saved (22403 records). [2025-09-14T18:48:08.652896] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-14T18:48:08.653028] [INFO ] [MAIN ] Update Progress: 1235/2370 symbols completed. KYN took 18.8s. Estimated remaining: 2h 0m 21s. Rate: 9.4 symbols/min [2025-09-14T18:48:08.841032] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:08.862763] [DEBUG] [LOCAL ] LADR: Loaded 17427 existing records from primary storage. [2025-09-14T18:48:08.863043] [INFO ] [MAIN ] LADR: Loaded 17427 existing records. [2025-09-14T18:48:09.066263] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:09.079830] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-14T18:48:09.080587] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-14T18:48:09.081073] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T18:48:09.085973] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-14T18:48:09.086450] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-14T18:48:09.364117] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-14T18:48:09.470497] [INFO ] [REMOTE ] LADR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:10.158808] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-14T18:48:10.255975] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:48:10.594699] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T18:48:10.958906] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-14T18:48:11.758848] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-14T18:48:12.157246] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T18:48:12.417321] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T18:48:12.558866] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-14T18:48:13.245747] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:48:13.358849] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-14T18:48:13.742565] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:48:14.158890] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-14T18:48:14.958860] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-14T18:48:15.084512] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T18:48:15.758936] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-14T18:48:16.217813] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:48:16.220433] [INFO ] [REMOTE ] LAD: Full fetch complete (26568 records). [2025-09-14T18:48:16.220529] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-14T18:48:16.577334] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-14T18:48:16.587528] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-14T18:48:16.588707] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-14T18:48:16.589398] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-14T18:48:16.589469] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-14T18:48:16.590725] [DEBUG] [LOCAL ] LAD: Trimmed 26568 records to 17159 (keeping 150 days of data) [2025-09-14T18:48:16.743001] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-14T18:48:16.757831] [DEBUG] [LOCAL ] LAD: Primary data saved (17159 records). [2025-09-14T18:48:16.758064] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-14T18:48:16.758698] [INFO ] [MAIN ] Update Progress: 1236/2370 symbols completed. LAD took 20.7s. Estimated remaining: 2h 0m 16s. Rate: 9.4 symbols/min [2025-09-14T18:48:16.936541] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:16.940242] [DEBUG] [LOCAL ] LANV: Loaded 1458 existing records from primary storage. [2025-09-14T18:48:16.940337] [INFO ] [MAIN ] LANV: Loaded 1458 existing records. [2025-09-14T18:48:17.147343] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:17.147686] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-14T18:48:17.147752] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-14T18:48:17.148033] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-14T18:48:17.148096] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-14T18:48:17.369027] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-14T18:48:17.508452] [INFO ] [REMOTE ] LANV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:17.959611] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-14T18:48:18.103586] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:48:18.158838] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-14T18:48:18.958854] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-14T18:48:19.153953] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T18:48:19.693940] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-14T18:48:19.758868] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-14T18:48:20.362850] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T18:48:20.430775] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:48:20.558838] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-14T18:48:21.065485] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T18:48:21.358835] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-14T18:48:22.158849] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-14T18:48:22.730102] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T18:48:22.941816] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T18:48:22.958781] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-14T18:48:23.758828] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-14T18:48:24.267658] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T18:48:24.554236] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T18:48:24.563025] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-14T18:48:25.358837] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-14T18:48:26.158834] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-14T18:48:26.683918] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T18:48:26.763438] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-14T18:48:26.843571] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:48:26.958819] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-14T18:48:27.758877] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-14T18:48:27.992859] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T18:48:28.558866] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-14T18:48:29.266572] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:48:29.271081] [INFO ] [REMOTE ] L: Full fetch complete (44530 records). [2025-09-14T18:48:29.271196] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-14T18:48:29.363974] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-14T18:48:29.653568] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-14T18:48:29.653686] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-14T18:48:29.654432] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-14T18:48:29.654491] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-14T18:48:29.655555] [DEBUG] [LOCAL ] L: Trimmed 44530 records to 30602 (keeping 150 days of data) [2025-09-14T18:48:29.862508] [DEBUG] [LOCAL ] L: Primary data saved (30602 records). [2025-09-14T18:48:29.862714] [INFO ] [MAIN ] L: Full history saved. [2025-09-14T18:48:29.862824] [INFO ] [MAIN ] Update Progress: 1237/2370 symbols completed. L took 39.9s. Estimated remaining: 2h 0m 16s. Rate: 9.4 symbols/min [2025-09-14T18:48:30.158836] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-14T18:48:30.638401] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T18:48:30.639481] [INFO ] [REMOTE ] LANV: Full fetch complete (2799 records). [2025-09-14T18:48:30.639567] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-14T18:48:31.003252] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-14T18:48:31.003632] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-14T18:48:31.009073] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-14T18:48:31.016588] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-14T18:48:31.017852] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-14T18:48:31.018133] [DEBUG] [LOCAL ] LANV: Trimmed 2799 records to 1944 (keeping 150 days of data) [2025-09-14T18:48:31.023542] [INFO ] [REMOTE ] LAC: Full fetch complete (56804 records). [2025-09-14T18:48:31.023852] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-14T18:48:31.097706] [DEBUG] [LOCAL ] LANV: Primary data saved (1944 records). [2025-09-14T18:48:31.135339] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-14T18:48:31.135525] [INFO ] [MAIN ] Update Progress: 1238/2370 symbols completed. LANV took 14.4s. Estimated remaining: 2h 0m 5s. Rate: 9.4 symbols/min [2025-09-14T18:48:31.419486] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T18:48:31.443675] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-14T18:48:31.443969] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-14T18:48:31.444903] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-14T18:48:31.445256] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-14T18:48:31.445321] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-14T18:48:31.447454] [DEBUG] [LOCAL ] LAC: Trimmed 56804 records to 39364 (keeping 150 days of data) [2025-09-14T18:48:31.684603] [DEBUG] [LOCAL ] LAC: Primary data saved (39364 records). [2025-09-14T18:48:31.684785] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-14T18:48:31.684892] [INFO ] [MAIN ] Update Progress: 1239/2370 symbols completed. LAC took 37.1s. Estimated remaining: 1h 59m 53s. Rate: 9.4 symbols/min [2025-09-14T18:48:32.820455] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T18:48:32.824607] [INFO ] [REMOTE ] LADR: Full fetch complete (41409 records). [2025-09-14T18:48:32.824748] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-14T18:48:33.198260] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-14T18:48:33.198406] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-14T18:48:33.199195] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-14T18:48:33.199273] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-14T18:48:33.200420] [DEBUG] [LOCAL ] LADR: Trimmed 41409 records to 28952 (keeping 150 days of data) [2025-09-14T18:48:33.392855] [DEBUG] [LOCAL ] LADR: Primary data saved (28952 records). [2025-09-14T18:48:33.393047] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-14T18:48:33.393226] [INFO ] [MAIN ] Update Progress: 1240/2370 symbols completed. LADR took 24.7s. Estimated remaining: 1h 59m 43s. Rate: 9.4 symbols/min [2025-09-14T18:48:34.051873] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:34.097903] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:34.118152] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:34.101990] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:34.131084] [DEBUG] [LOCAL ] LAW: Loaded 6778 existing records from primary storage. [2025-09-14T18:48:34.131522] [INFO ] [MAIN ] LAW: Loaded 6778 existing records. [2025-09-14T18:48:34.283877] [DEBUG] [LOCAL ] LAZ: Loaded 19970 existing records from primary storage. [2025-09-14T18:48:34.284125] [DEBUG] [LOCAL ] LAR: Loaded 20841 existing records from primary storage. [2025-09-14T18:48:34.277449] [DEBUG] [LOCAL ] LB: Loaded 17429 existing records from primary storage. [2025-09-14T18:48:34.284396] [INFO ] [MAIN ] LAR: Loaded 20841 existing records. [2025-09-14T18:48:34.303294] [INFO ] [MAIN ] LAZ: Loaded 19970 existing records. [2025-09-14T18:48:34.313918] [INFO ] [MAIN ] LB: Loaded 17429 existing records. [2025-09-14T18:48:34.484869] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:34.666207] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-14T18:48:34.838046] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-14T18:48:34.827723] [WARN ] [MAIN ] LAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:34.920486] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:34.925889] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-14T18:48:34.920315] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-14T18:48:34.926001] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-14T18:48:34.904218] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-14T18:48:34.926252] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:34.926473] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-14T18:48:34.926533] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-14T18:48:34.926870] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-14T18:48:34.939369] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-14T18:48:34.939440] [DEBUG] [LOCAL ] LAR: Deleted primary data file. [2025-09-14T18:48:34.966610] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-14T18:48:34.966758] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-14T18:48:34.987739] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-14T18:48:35.017424] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-14T18:48:35.079610] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-14T18:48:35.938714] [INFO ] [REMOTE ] LAW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:36.066950] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-14T18:48:36.331850] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:36.355166] [INFO ] [REMOTE ] LAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:36.396238] [INFO ] [REMOTE ] LB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:36.389553] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-14T18:48:36.397775] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-14T18:48:36.396593] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-14T18:48:37.236276] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T18:48:37.240249] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-14T18:48:37.629741] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:48:37.638611] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-14T18:48:37.966872] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T18:48:37.975157] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-14T18:48:38.075444] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T18:48:38.105407] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-14T18:48:38.106910] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:48:38.158792] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-14T18:48:39.107603] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:48:39.111313] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-14T18:48:39.185127] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:48:39.437281] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T18:48:39.478118] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T18:48:39.758849] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-14T18:48:40.101352] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T18:48:40.558850] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-14T18:48:41.358879] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-14T18:48:41.483890] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T18:48:42.158921] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-14T18:48:42.330182] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:48:42.418789] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T18:48:42.958911] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-14T18:48:43.747393] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:48:43.758769] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-14T18:48:44.261329] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:48:44.558840] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-14T18:48:45.327131] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T18:48:45.358771] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-14T18:48:46.158843] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-14T18:48:46.261874] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:48:46.643126] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T18:48:46.742999] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T18:48:46.958837] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-14T18:48:47.758794] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-14T18:48:48.048720] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T18:48:48.558880] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-14T18:48:49.276899] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:48:49.358891] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-14T18:48:50.108799] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:48:50.110781] [INFO ] [REMOTE ] LAW: Full fetch complete (15395 records). [2025-09-14T18:48:50.110868] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-14T18:48:50.163999] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-14T18:48:50.423897] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T18:48:50.519734] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-14T18:48:50.519854] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-14T18:48:50.520279] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-14T18:48:50.520355] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-14T18:48:50.520999] [DEBUG] [LOCAL ] LAW: Trimmed 15395 records to 10652 (keeping 150 days of data) [2025-09-14T18:48:50.581574] [DEBUG] [LOCAL ] LAW: Primary data saved (10652 records). [2025-09-14T18:48:50.581743] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-14T18:48:50.581905] [INFO ] [MAIN ] Update Progress: 1241/2370 symbols completed. LAW took 17.2s. Estimated remaining: 1h 59m 46s. Rate: 9.4 symbols/min [2025-09-14T18:48:50.752524] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:50.780222] [DEBUG] [LOCAL ] LBRT: Loaded 23697 existing records from primary storage. [2025-09-14T18:48:50.780433] [INFO ] [MAIN ] LBRT: Loaded 23697 existing records. [2025-09-14T18:48:50.955420] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:50.955725] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-14T18:48:50.955797] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-14T18:48:50.956472] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-14T18:48:50.956534] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-14T18:48:50.967509] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-14T18:48:51.311374] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:51.758834] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-14T18:48:52.050683] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:48:52.558819] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-14T18:48:52.789162] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T18:48:53.358892] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-14T18:48:53.663182] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T18:48:53.936482] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T18:48:54.158885] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-14T18:48:54.958849] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-14T18:48:55.012173] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T18:48:55.459231] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T18:48:55.758881] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-14T18:48:55.910139] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T18:48:55.915069] [INFO ] [REMOTE ] LAR: Full fetch complete (48819 records). [2025-09-14T18:48:55.915197] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-14T18:48:56.295105] [DEBUG] [VALIDATOR ] LAR: All expected trading days are present. [2025-09-14T18:48:56.295240] [DEBUG] [VALIDATOR ] LAR: Primary data validation passed. [2025-09-14T18:48:56.296213] [INFO ] [MAIN ] LAR: Fetched primary data is valid. [2025-09-14T18:48:56.296283] [DEBUG] [LOCAL ] LAR: Saving primary data. [2025-09-14T18:48:56.297546] [DEBUG] [LOCAL ] LAR: Trimmed 48819 records to 33941 (keeping 150 days of data) [2025-09-14T18:48:56.500470] [DEBUG] [LOCAL ] LAR: Primary data saved (33941 records). [2025-09-14T18:48:56.500699] [INFO ] [MAIN ] LAR: Full history saved. [2025-09-14T18:48:56.500833] [INFO ] [MAIN ] Update Progress: 1242/2370 symbols completed. LAR took 23.1s. Estimated remaining: 1h 59m 39s. Rate: 9.4 symbols/min [2025-09-14T18:48:56.564907] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-14T18:48:56.674235] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:56.695502] [DEBUG] [LOCAL ] LC: Loaded 21503 existing records from primary storage. [2025-09-14T18:48:56.695729] [INFO ] [MAIN ] LC: Loaded 21503 existing records. [2025-09-14T18:48:56.871467] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:56.871745] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-14T18:48:56.871807] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-14T18:48:56.872477] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-14T18:48:56.872539] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-14T18:48:57.223631] [INFO ] [REMOTE ] LC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:57.358874] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-14T18:48:57.427255] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:48:58.158872] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-14T18:48:58.340815] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T18:48:58.958937] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-14T18:48:59.100528] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T18:48:59.758923] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-14T18:49:00.126664] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T18:49:00.310787] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T18:49:00.315741] [INFO ] [REMOTE ] LAZ: Full fetch complete (49453 records). [2025-09-14T18:49:00.315905] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-14T18:49:00.569696] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-14T18:49:00.697172] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-14T18:49:00.697303] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-14T18:49:00.698128] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-14T18:49:00.698190] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-14T18:49:00.699414] [DEBUG] [LOCAL ] LAZ: Trimmed 49453 records to 33715 (keeping 150 days of data) [2025-09-14T18:49:00.835260] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T18:49:00.845867] [INFO ] [REMOTE ] LB: Full fetch complete (41545 records). [2025-09-14T18:49:00.846553] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-14T18:49:01.316311] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-14T18:49:01.317251] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-14T18:49:01.318015] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-14T18:49:01.318395] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-14T18:49:01.320347] [DEBUG] [LOCAL ] LB: Trimmed 41545 records to 27942 (keeping 150 days of data) [2025-09-14T18:49:01.378953] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-14T18:49:01.433155] [DEBUG] [LOCAL ] LAZ: Primary data saved (33715 records). [2025-09-14T18:49:01.434694] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-14T18:49:01.436253] [INFO ] [MAIN ] Update Progress: 1243/2370 symbols completed. LAZ took 28.0s. Estimated remaining: 1h 59m 32s. Rate: 9.4 symbols/min [2025-09-14T18:49:01.622934] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:01.642915] [DEBUG] [LOCAL ] LCII: Loaded 11886 existing records from primary storage. [2025-09-14T18:49:01.645331] [INFO ] [MAIN ] LCII: Loaded 11886 existing records. [2025-09-14T18:49:01.952271] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:01.953612] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-14T18:49:01.954608] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-14T18:49:01.955061] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-14T18:49:01.955128] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-14T18:49:02.153370] [DEBUG] [LOCAL ] LB: Primary data saved (27942 records). [2025-09-14T18:49:02.227069] [INFO ] [MAIN ] LB: Full history saved. [2025-09-14T18:49:02.257464] [INFO ] [MAIN ] Update Progress: 1244/2370 symbols completed. LB took 28.9s. Estimated remaining: 1h 59m 20s. Rate: 9.4 symbols/min [2025-09-14T18:49:02.470305] [INFO ] [REMOTE ] LCII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:02.506559] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-14T18:49:02.537446] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:02.558378] [DEBUG] [LOCAL ] LDI: Loaded 20298 existing records from primary storage. [2025-09-14T18:49:02.558539] [INFO ] [MAIN ] LDI: Loaded 20298 existing records. [2025-09-14T18:49:02.733120] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:02.733370] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-14T18:49:02.733428] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-14T18:49:02.733932] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-14T18:49:02.733993] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-14T18:49:03.115035] [INFO ] [REMOTE ] LDI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:03.115487] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-14T18:49:03.147205] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-14T18:49:03.190342] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:49:03.758847] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-14T18:49:03.813820] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T18:49:04.340175] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T18:49:04.558855] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-14T18:49:05.358830] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-14T18:49:05.608685] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:49:06.074001] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:49:06.158819] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-14T18:49:06.958862] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-14T18:49:07.146791] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T18:49:07.331442] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:49:07.758836] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-14T18:49:08.558827] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-14T18:49:08.714133] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:49:09.358835] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-14T18:49:09.448138] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:49:10.127721] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T18:49:10.158789] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-14T18:49:10.958886] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-14T18:49:11.257247] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:49:11.758882] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-14T18:49:11.844497] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:49:12.558840] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-14T18:49:12.653222] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:49:13.358879] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-14T18:49:13.467476] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:49:13.782571] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:49:14.158891] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-14T18:49:14.958885] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-14T18:49:15.281037] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T18:49:15.439395] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T18:49:15.758885] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-14T18:49:16.396222] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:49:16.558892] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-14T18:49:17.063167] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T18:49:17.245048] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:49:17.250541] [INFO ] [REMOTE ] LBRT: Full fetch complete (57544 records). [2025-09-14T18:49:17.250685] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-14T18:49:17.364031] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-14T18:49:17.638165] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-14T18:49:17.638269] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-14T18:49:17.639136] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-14T18:49:17.639203] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-14T18:49:17.640494] [DEBUG] [LOCAL ] LBRT: Trimmed 57544 records to 39791 (keeping 150 days of data) [2025-09-14T18:49:17.904968] [DEBUG] [LOCAL ] LBRT: Primary data saved (39791 records). [2025-09-14T18:49:17.905134] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-14T18:49:17.905249] [INFO ] [MAIN ] Update Progress: 1245/2370 symbols completed. LBRT took 27.3s. Estimated remaining: 1h 59m 22s. Rate: 9.4 symbols/min [2025-09-14T18:49:18.073092] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:18.093475] [DEBUG] [LOCAL ] LDOS: Loaded 19358 existing records from primary storage. [2025-09-14T18:49:18.093624] [INFO ] [MAIN ] LDOS: Loaded 19358 existing records. [2025-09-14T18:49:18.170172] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-14T18:49:18.277008] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:18.277249] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-14T18:49:18.277313] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-14T18:49:18.277903] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-14T18:49:18.277989] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-14T18:49:18.624419] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:18.958853] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-14T18:49:18.996564] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:49:19.658678] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:49:19.758835] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-14T18:49:19.903700] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T18:49:20.558889] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-14T18:49:21.291987] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T18:49:21.297452] [INFO ] [REMOTE ] LC: Full fetch complete (52446 records). [2025-09-14T18:49:21.297688] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-14T18:49:21.365964] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-14T18:49:21.719629] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-14T18:49:21.719757] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-14T18:49:21.720758] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-14T18:49:21.720836] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-14T18:49:21.722187] [DEBUG] [LOCAL ] LC: Trimmed 52446 records to 35913 (keeping 150 days of data) [2025-09-14T18:49:21.974415] [DEBUG] [LOCAL ] LC: Primary data saved (35913 records). [2025-09-14T18:49:21.974743] [INFO ] [MAIN ] LC: Full history saved. [2025-09-14T18:49:21.974942] [INFO ] [MAIN ] Update Progress: 1246/2370 symbols completed. LC took 25.5s. Estimated remaining: 1h 59m 14s. Rate: 9.4 symbols/min [2025-09-14T18:49:22.147516] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:22.155711] [DEBUG] [LOCAL ] LDP: Loaded 5747 existing records from primary storage. [2025-09-14T18:49:22.155850] [INFO ] [MAIN ] LDP: Loaded 5747 existing records. [2025-09-14T18:49:22.186760] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-14T18:49:22.348901] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:22.349374] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-14T18:49:22.349485] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-14T18:49:22.349930] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-14T18:49:22.350045] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-14T18:49:22.735998] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T18:49:22.756623] [INFO ] [REMOTE ] LDP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:22.841794] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:49:22.958815] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-14T18:49:23.696099] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:49:23.701476] [INFO ] [REMOTE ] LDI: Full fetch complete (46146 records). [2025-09-14T18:49:23.701634] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-14T18:49:23.764609] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-14T18:49:23.945977] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T18:49:24.094653] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-14T18:49:24.094766] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-14T18:49:24.095927] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-14T18:49:24.095995] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-14T18:49:24.097225] [DEBUG] [LOCAL ] LDI: Trimmed 46146 records to 32413 (keeping 150 days of data) [2025-09-14T18:49:24.287057] [DEBUG] [LOCAL ] LDI: Primary data saved (32413 records). [2025-09-14T18:49:24.287226] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-14T18:49:24.287356] [INFO ] [MAIN ] Update Progress: 1247/2370 symbols completed. LDI took 22.0s. Estimated remaining: 1h 59m 4s. Rate: 9.4 symbols/min [2025-09-14T18:49:24.453941] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:24.474912] [DEBUG] [LOCAL ] LEA: Loaded 18627 existing records from primary storage. [2025-09-14T18:49:24.475084] [INFO ] [MAIN ] LEA: Loaded 18627 existing records. [2025-09-14T18:49:24.564198] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-14T18:49:24.651459] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:24.651680] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-14T18:49:24.651746] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-14T18:49:24.652260] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-14T18:49:24.652322] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-14T18:49:25.016765] [INFO ] [REMOTE ] LEA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:25.163104] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:49:25.166005] [INFO ] [REMOTE ] LCII: Full fetch complete (31095 records). [2025-09-14T18:49:25.166122] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-14T18:49:25.367817] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-14T18:49:25.552171] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-14T18:49:25.552299] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-14T18:49:25.553410] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-14T18:49:25.553482] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-14T18:49:25.554709] [DEBUG] [LOCAL ] LCII: Trimmed 31095 records to 20847 (keeping 150 days of data) [2025-09-14T18:49:25.693752] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:49:25.743902] [DEBUG] [LOCAL ] LCII: Primary data saved (20847 records). [2025-09-14T18:49:25.744071] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-14T18:49:25.744183] [INFO ] [MAIN ] Update Progress: 1248/2370 symbols completed. LCII took 24.3s. Estimated remaining: 1h 58m 53s. Rate: 9.4 symbols/min [2025-09-14T18:49:25.922125] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:25.944326] [DEBUG] [LOCAL ] LEG: Loaded 22489 existing records from primary storage. [2025-09-14T18:49:25.944510] [INFO ] [MAIN ] LEG: Loaded 22489 existing records. [2025-09-14T18:49:26.129219] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:26.129595] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-14T18:49:26.129676] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-14T18:49:26.130381] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-14T18:49:26.130446] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-14T18:49:26.163306] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-14T18:49:26.498275] [INFO ] [REMOTE ] LEG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:26.542497] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:49:26.958827] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-14T18:49:27.758812] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-14T18:49:27.968721] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:49:28.163155] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T18:49:28.558831] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-14T18:49:29.166864] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T18:49:29.358824] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-14T18:49:30.158851] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-14T18:49:30.428901] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T18:49:30.958778] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-14T18:49:31.052340] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:49:31.620240] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:49:31.758778] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-14T18:49:32.558859] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-14T18:49:32.628323] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:49:33.356832] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T18:49:33.367259] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-14T18:49:33.564394] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T18:49:34.158832] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-14T18:49:34.958878] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-14T18:49:35.133051] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:49:35.758970] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-14T18:49:35.836058] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:49:36.283676] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T18:49:36.558902] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-14T18:49:37.358841] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-14T18:49:37.533145] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:49:37.548733] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T18:49:38.158836] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-14T18:49:38.786079] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:49:38.919754] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:49:38.924238] [INFO ] [REMOTE ] LDOS: Full fetch complete (50608 records). [2025-09-14T18:49:38.924354] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-14T18:49:38.964005] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-14T18:49:39.306438] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-14T18:49:39.306561] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-14T18:49:39.307388] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-14T18:49:39.307449] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-14T18:49:39.308899] [DEBUG] [LOCAL ] LDOS: Trimmed 50608 records to 33900 (keeping 150 days of data) [2025-09-14T18:49:39.545697] [DEBUG] [LOCAL ] LDOS: Primary data saved (33900 records). [2025-09-14T18:49:39.545894] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-14T18:49:39.546015] [INFO ] [MAIN ] Update Progress: 1249/2370 symbols completed. LDOS took 21.6s. Estimated remaining: 1h 58m 53s. Rate: 9.4 symbols/min [2025-09-14T18:49:39.714822] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:39.739731] [DEBUG] [LOCAL ] LEN: Loaded 23913 existing records from primary storage. [2025-09-14T18:49:39.739889] [INFO ] [MAIN ] LEN: Loaded 23913 existing records. [2025-09-14T18:49:39.769935] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-14T18:49:39.931045] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:39.931346] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-14T18:49:39.931406] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-14T18:49:39.932112] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-14T18:49:39.932175] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-14T18:49:40.243596] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T18:49:40.299227] [INFO ] [REMOTE ] LEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:40.558855] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-14T18:49:41.358798] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-14T18:49:41.450793] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T18:49:42.158837] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-14T18:49:42.334304] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T18:49:42.371587] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:49:42.958860] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-14T18:49:43.758838] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-14T18:49:43.889266] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T18:49:43.927023] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:49:44.558880] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-14T18:49:45.358869] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-14T18:49:45.515472] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T18:49:45.584503] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T18:49:46.158890] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-14T18:49:46.194256] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T18:49:46.958866] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-14T18:49:47.758923] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-14T18:49:47.818069] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:49:48.058450] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T18:49:48.558846] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-14T18:49:49.331433] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:49:49.344584] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T18:49:49.346370] [INFO ] [REMOTE ] LDP: Full fetch complete (14196 records). [2025-09-14T18:49:49.346458] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-14T18:49:49.367015] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-14T18:49:49.705277] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-14T18:49:49.705380] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-14T18:49:49.705723] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-14T18:49:49.705780] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-14T18:49:49.706293] [DEBUG] [LOCAL ] LDP: Trimmed 14196 records to 9487 (keeping 150 days of data) [2025-09-14T18:49:49.764863] [DEBUG] [LOCAL ] LDP: Primary data saved (9487 records). [2025-09-14T18:49:49.765012] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-14T18:49:49.765104] [INFO ] [MAIN ] Update Progress: 1250/2370 symbols completed. LDP took 27.8s. Estimated remaining: 1h 58m 50s. Rate: 9.4 symbols/min [2025-09-14T18:49:49.970530] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:49.978800] [DEBUG] [LOCAL ] LEO: Loaded 6985 existing records from primary storage. [2025-09-14T18:49:49.978931] [INFO ] [MAIN ] LEO: Loaded 6985 existing records. [2025-09-14T18:49:50.161708] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:50.159029] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-14T18:49:50.162894] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-14T18:49:50.162978] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-14T18:49:50.163430] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-14T18:49:50.163631] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-14T18:49:50.525261] [INFO ] [REMOTE ] LEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:50.564854] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:49:50.565301] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:49:50.580452] [INFO ] [REMOTE ] LEA: Full fetch complete (45363 records). [2025-09-14T18:49:50.580774] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-14T18:49:50.967405] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-14T18:49:50.980572] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-14T18:49:50.980758] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-14T18:49:50.981869] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-14T18:49:50.982036] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-14T18:49:50.983364] [DEBUG] [LOCAL ] LEA: Trimmed 45363 records to 30762 (keeping 150 days of data) [2025-09-14T18:49:51.188331] [DEBUG] [LOCAL ] LEA: Primary data saved (30762 records). [2025-09-14T18:49:51.188506] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-14T18:49:51.188609] [INFO ] [MAIN ] Update Progress: 1251/2370 symbols completed. LEA took 26.9s. Estimated remaining: 1h 58m 40s. Rate: 9.4 symbols/min [2025-09-14T18:49:51.364009] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:51.387351] [DEBUG] [LOCAL ] LEVI: Loaded 23139 existing records from primary storage. [2025-09-14T18:49:51.387519] [INFO ] [MAIN ] LEVI: Loaded 23139 existing records. [2025-09-14T18:49:51.577036] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:51.577435] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-14T18:49:51.577503] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-14T18:49:51.578920] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-14T18:49:51.579210] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-14T18:49:51.766017] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-14T18:49:51.969671] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:52.170098] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T18:49:52.558837] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-14T18:49:52.742450] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T18:49:53.358796] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-14T18:49:53.752377] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T18:49:54.158858] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-14T18:49:54.958865] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-14T18:49:55.042972] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T18:49:55.116236] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:49:55.758894] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-14T18:49:56.063041] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T18:49:56.558850] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-14T18:49:57.358806] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-14T18:49:57.416540] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T18:49:57.658948] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T18:49:58.158842] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-14T18:49:58.958869] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-14T18:49:59.168317] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T18:49:59.627674] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:49:59.633332] [INFO ] [REMOTE ] LEN: Full fetch complete (57810 records). [2025-09-14T18:49:59.633490] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-14T18:49:59.763917] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-14T18:50:00.022341] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-14T18:50:00.022448] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-14T18:50:00.023467] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-14T18:50:00.023544] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-14T18:50:00.024817] [DEBUG] [LOCAL ] LEN: Trimmed 57810 records to 39992 (keeping 150 days of data) [2025-09-14T18:50:00.292388] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T18:50:00.339595] [DEBUG] [LOCAL ] LEN: Primary data saved (39992 records). [2025-09-14T18:50:00.339812] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-14T18:50:00.339974] [INFO ] [MAIN ] Update Progress: 1252/2370 symbols completed. LEN took 20.8s. Estimated remaining: 1h 58m 36s. Rate: 9.4 symbols/min [2025-09-14T18:50:00.527271] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:00.547834] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:50:00.554107] [INFO ] [REMOTE ] LEG: Full fetch complete (54840 records). [2025-09-14T18:50:00.559090] [DEBUG] [LOCAL ] LFT: Loaded 8405 existing records from primary storage. [2025-09-14T18:50:00.559235] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-14T18:50:00.559427] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-14T18:50:00.561092] [INFO ] [MAIN ] LFT: Loaded 8405 existing records. [2025-09-14T18:50:00.934715] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:00.974239] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-14T18:50:01.047156] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-14T18:50:01.075978] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-14T18:50:01.086602] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-14T18:50:01.288219] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-14T18:50:01.309848] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-14T18:50:01.340745] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-14T18:50:01.350394] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-14T18:50:01.366238] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-14T18:50:01.447274] [DEBUG] [LOCAL ] LEG: Trimmed 54840 records to 37656 (keeping 150 days of data) [2025-09-14T18:50:01.651335] [INFO ] [REMOTE ] LFT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:01.791783] [DEBUG] [LOCAL ] LEG: Primary data saved (37656 records). [2025-09-14T18:50:01.792019] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-14T18:50:01.792164] [INFO ] [MAIN ] Update Progress: 1253/2370 symbols completed. LEG took 36.0s. Estimated remaining: 1h 58m 25s. Rate: 9.4 symbols/min [2025-09-14T18:50:02.003041] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:02.011084] [DEBUG] [LOCAL ] LGI: Loaded 4397 existing records from primary storage. [2025-09-14T18:50:02.011811] [INFO ] [MAIN ] LGI: Loaded 4397 existing records. [2025-09-14T18:50:02.167726] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-14T18:50:02.211050] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:02.211369] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-14T18:50:02.211440] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-14T18:50:02.211734] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-14T18:50:02.211804] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-14T18:50:02.581058] [INFO ] [REMOTE ] LGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:02.615170] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:50:02.769228] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T18:50:02.958833] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-14T18:50:03.389418] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T18:50:03.758793] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-14T18:50:04.062411] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:50:04.558818] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-14T18:50:04.863873] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:50:05.358840] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-14T18:50:06.158859] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-14T18:50:06.447412] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T18:50:06.468801] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T18:50:06.801476] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T18:50:06.958839] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-14T18:50:07.697110] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T18:50:07.758891] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-14T18:50:08.558847] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-14T18:50:09.358864] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-14T18:50:09.493008] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:50:09.750163] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T18:50:10.158809] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-14T18:50:10.507179] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T18:50:10.958866] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-14T18:50:11.022223] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:50:11.758884] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-14T18:50:12.558836] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-14T18:50:12.809366] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T18:50:12.859968] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T18:50:13.358847] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-14T18:50:13.446415] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T18:50:14.158875] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-14T18:50:14.223356] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T18:50:14.225732] [INFO ] [REMOTE ] LEO: Full fetch complete (19801 records). [2025-09-14T18:50:14.225834] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-14T18:50:14.591158] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-14T18:50:14.591260] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-14T18:50:14.591666] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-14T18:50:14.591721] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-14T18:50:14.592295] [DEBUG] [LOCAL ] LEO: Trimmed 19801 records to 12504 (keeping 150 days of data) [2025-09-14T18:50:14.669635] [DEBUG] [LOCAL ] LEO: Primary data saved (12504 records). [2025-09-14T18:50:14.669814] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-14T18:50:14.669915] [INFO ] [MAIN ] Update Progress: 1254/2370 symbols completed. LEO took 24.9s. Estimated remaining: 1h 58m 24s. Rate: 9.4 symbols/min [2025-09-14T18:50:14.839064] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:14.856311] [DEBUG] [LOCAL ] LH: Loaded 16243 existing records from primary storage. [2025-09-14T18:50:14.856478] [INFO ] [MAIN ] LH: Loaded 16243 existing records. [2025-09-14T18:50:14.963998] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-14T18:50:15.034857] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:15.035152] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-14T18:50:15.035314] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-14T18:50:15.040741] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:50:15.040779] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-14T18:50:15.042912] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-14T18:50:15.400381] [INFO ] [REMOTE ] LH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:15.758826] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-14T18:50:16.167355] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:50:16.558878] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-14T18:50:16.755191] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T18:50:17.358892] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-14T18:50:18.050254] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:50:18.158957] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-14T18:50:18.958865] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-14T18:50:19.041945] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T18:50:19.047276] [INFO ] [REMOTE ] LEVI: Full fetch complete (55912 records). [2025-09-14T18:50:19.047386] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-14T18:50:19.433845] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-14T18:50:19.434823] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-14T18:50:19.438312] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-14T18:50:19.438469] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-14T18:50:19.437239] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T18:50:19.446209] [DEBUG] [LOCAL ] LEVI: Trimmed 55912 records to 38710 (keeping 150 days of data) [2025-09-14T18:50:19.664437] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:50:19.667002] [INFO ] [REMOTE ] LGI: Full fetch complete (11062 records). [2025-09-14T18:50:19.669524] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-14T18:50:19.763891] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-14T18:50:20.068213] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-14T18:50:20.068834] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-14T18:50:20.069229] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-14T18:50:20.069578] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-14T18:50:20.070856] [DEBUG] [LOCAL ] LGI: Trimmed 11062 records to 7499 (keeping 150 days of data) [2025-09-14T18:50:20.122801] [DEBUG] [LOCAL ] LEVI: Primary data saved (38710 records). [2025-09-14T18:50:20.122996] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-14T18:50:20.123353] [INFO ] [MAIN ] Update Progress: 1255/2370 symbols completed. LEVI took 28.9s. Estimated remaining: 1h 58m 17s. Rate: 9.4 symbols/min [2025-09-14T18:50:20.230944] [DEBUG] [LOCAL ] LGI: Primary data saved (7499 records). [2025-09-14T18:50:20.231179] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-14T18:50:20.236967] [INFO ] [MAIN ] Update Progress: 1256/2370 symbols completed. LGI took 18.4s. Estimated remaining: 1h 58m 5s. Rate: 9.4 symbols/min [2025-09-14T18:50:20.403810] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:20.474470] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:20.493401] [DEBUG] [LOCAL ] LHX: Loaded 21479 existing records from primary storage. [2025-09-14T18:50:20.493587] [INFO ] [MAIN ] LHX: Loaded 21479 existing records. [2025-09-14T18:50:20.561944] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-14T18:50:20.587190] [DEBUG] [LOCAL ] LII: Loaded 11691 existing records from primary storage. [2025-09-14T18:50:20.619573] [INFO ] [MAIN ] LII: Loaded 11691 existing records. [2025-09-14T18:50:20.705666] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:20.774053] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-14T18:50:20.774186] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-14T18:50:20.779952] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-14T18:50:20.800398] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-14T18:50:20.896602] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:20.950875] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-14T18:50:20.990029] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-14T18:50:21.077461] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-14T18:50:21.107324] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T18:50:21.148887] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-14T18:50:21.372223] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-14T18:50:21.393258] [INFO ] [REMOTE ] LHX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:21.672313] [INFO ] [REMOTE ] LII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:22.130259] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T18:50:22.158838] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-14T18:50:22.276494] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:50:22.278351] [INFO ] [REMOTE ] LFT: Full fetch complete (18640 records). [2025-09-14T18:50:22.278450] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-14T18:50:22.639995] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-14T18:50:22.640103] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-14T18:50:22.640565] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-14T18:50:22.640629] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-14T18:50:22.641420] [DEBUG] [LOCAL ] LFT: Trimmed 18640 records to 14281 (keeping 150 days of data) [2025-09-14T18:50:22.737308] [DEBUG] [LOCAL ] LFT: Primary data saved (14281 records). [2025-09-14T18:50:22.737477] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-14T18:50:22.737588] [INFO ] [MAIN ] Update Progress: 1257/2370 symbols completed. LFT took 22.4s. Estimated remaining: 1h 57m 56s. Rate: 9.4 symbols/min [2025-09-14T18:50:22.910224] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:22.931450] [DEBUG] [LOCAL ] LION: Loaded 22207 existing records from primary storage. [2025-09-14T18:50:22.931613] [INFO ] [MAIN ] LION: Loaded 22207 existing records. [2025-09-14T18:50:22.963895] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-14T18:50:23.112821] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:23.113099] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-14T18:50:23.113161] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-14T18:50:23.113839] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-14T18:50:23.113905] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-14T18:50:23.472086] [INFO ] [REMOTE ] LION: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:23.758811] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-14T18:50:23.920048] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:50:24.420144] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:50:24.558786] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-14T18:50:24.584929] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:50:25.358922] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-14T18:50:26.034318] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:50:26.158856] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-14T18:50:26.958829] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-14T18:50:26.992962] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:50:27.260767] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T18:50:27.758853] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-14T18:50:28.371296] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:50:28.558822] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-14T18:50:29.096243] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:50:29.358841] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-14T18:50:29.978503] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T18:50:30.158836] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-14T18:50:30.779946] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T18:50:30.958828] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-14T18:50:31.758855] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-14T18:50:31.913710] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:50:32.195890] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T18:50:32.558856] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-14T18:50:33.340423] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:50:33.358772] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-14T18:50:34.158847] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-14T18:50:34.571481] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T18:50:34.900270] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T18:50:34.958787] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-14T18:50:35.254136] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T18:50:35.758859] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-14T18:50:36.564256] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-14T18:50:36.580536] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T18:50:37.094359] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:50:37.358880] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-14T18:50:37.983562] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:50:38.158926] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-14T18:50:38.958807] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-14T18:50:39.444762] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-14T18:50:39.492199] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T18:50:39.758844] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-14T18:50:40.558890] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-14T18:50:40.780794] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T18:50:40.812191] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T18:50:41.358878] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-14T18:50:42.158796] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-14T18:50:42.649072] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T18:50:42.701110] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T18:50:42.704552] [INFO ] [REMOTE ] LII: Full fetch complete (31469 records). [2025-09-14T18:50:42.704724] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-14T18:50:42.965591] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-14T18:50:43.090667] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-14T18:50:43.090847] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-14T18:50:43.091709] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-14T18:50:43.091809] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-14T18:50:43.092890] [DEBUG] [LOCAL ] LII: Trimmed 31469 records to 20548 (keeping 150 days of data) [2025-09-14T18:50:43.216109] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:50:43.264188] [DEBUG] [LOCAL ] LII: Primary data saved (20548 records). [2025-09-14T18:50:43.264359] [INFO ] [MAIN ] LII: Full history saved. [2025-09-14T18:50:43.264465] [INFO ] [MAIN ] Update Progress: 1258/2370 symbols completed. LII took 23.0s. Estimated remaining: 1h 58m 2s. Rate: 9.4 symbols/min [2025-09-14T18:50:43.431425] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:43.434503] [DEBUG] [LOCAL ] LITB: Loaded 1316 existing records from primary storage. [2025-09-14T18:50:43.434599] [INFO ] [MAIN ] LITB: Loaded 1316 existing records. [2025-09-14T18:50:43.609056] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:43.609329] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-14T18:50:43.609407] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-14T18:50:43.609678] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-14T18:50:43.609743] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-14T18:50:43.764942] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-14T18:50:43.962013] [INFO ] [REMOTE ] LITB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:44.558839] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-14T18:50:44.798016] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:50:45.221224] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:50:45.224762] [INFO ] [REMOTE ] LH: Full fetch complete (42352 records). [2025-09-14T18:50:45.224884] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-14T18:50:45.373438] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-14T18:50:45.556888] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-14T18:50:45.634906] [INFO ] [REMOTE ] LION: Full fetch complete (43849 records). [2025-09-14T18:50:45.645916] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-14T18:50:45.646078] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-14T18:50:45.646272] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-14T18:50:45.647450] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-14T18:50:45.647663] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-14T18:50:45.752417] [DEBUG] [LOCAL ] LH: Trimmed 42352 records to 28629 (keeping 150 days of data) [2025-09-14T18:50:46.167677] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-14T18:50:46.185437] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-14T18:50:46.196872] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-14T18:50:46.248943] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:50:46.252419] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-14T18:50:46.263050] [INFO ] [REMOTE ] LHX: Full fetch complete (53604 records). [2025-09-14T18:50:46.263255] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-14T18:50:46.263782] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-14T18:50:46.332184] [DEBUG] [LOCAL ] LION: Trimmed 43849 records to 35561 (keeping 150 days of data) [2025-09-14T18:50:46.537089] [DEBUG] [LOCAL ] LH: Primary data saved (28629 records). [2025-09-14T18:50:46.553564] [INFO ] [MAIN ] LH: Full history saved. [2025-09-14T18:50:46.561030] [INFO ] [MAIN ] Update Progress: 1259/2370 symbols completed. LH took 31.9s. Estimated remaining: 1h 57m 53s. Rate: 9.4 symbols/min [2025-09-14T18:50:46.799164] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T18:50:46.959621] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-14T18:50:46.956544] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:46.959881] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-14T18:50:46.966411] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-14T18:50:46.968185] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-14T18:50:47.011739] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-14T18:50:47.058712] [DEBUG] [LOCAL ] LHX: Trimmed 53604 records to 36949 (keeping 150 days of data) [2025-09-14T18:50:47.076779] [DEBUG] [LOCAL ] LLY: Loaded 23916 existing records from primary storage. [2025-09-14T18:50:47.158442] [INFO ] [MAIN ] LLY: Loaded 23916 existing records. [2025-09-14T18:50:47.252431] [DEBUG] [LOCAL ] LION: Primary data saved (35561 records). [2025-09-14T18:50:47.292250] [INFO ] [MAIN ] LION: Full history saved. [2025-09-14T18:50:47.292818] [INFO ] [MAIN ] Update Progress: 1260/2370 symbols completed. LION took 24.6s. Estimated remaining: 1h 57m 41s. Rate: 9.4 symbols/min [2025-09-14T18:50:47.731082] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:47.757606] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-14T18:50:47.804904] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-14T18:50:47.815117] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T18:50:47.819972] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-14T18:50:47.835575] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-14T18:50:47.937097] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-14T18:50:47.961511] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:48.241379] [DEBUG] [LOCAL ] LMND: Loaded 23614 existing records from primary storage. [2025-09-14T18:50:48.308762] [INFO ] [MAIN ] LMND: Loaded 23614 existing records. [2025-09-14T18:50:48.624513] [INFO ] [REMOTE ] LLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:48.641961] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-14T18:50:48.701269] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:48.702026] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-14T18:50:48.702103] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-14T18:50:48.703105] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-14T18:50:48.703317] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-14T18:50:49.019677] [DEBUG] [LOCAL ] LHX: Primary data saved (36949 records). [2025-09-14T18:50:49.047593] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-14T18:50:49.075968] [INFO ] [MAIN ] Update Progress: 1261/2370 symbols completed. LHX took 29.0s. Estimated remaining: 1h 57m 31s. Rate: 9.4 symbols/min [2025-09-14T18:50:49.075810] [INFO ] [REMOTE ] LMND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:49.082765] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T18:50:49.259814] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:49.284094] [DEBUG] [LOCAL ] LMT: Loaded 22737 existing records from primary storage. [2025-09-14T18:50:49.284257] [INFO ] [MAIN ] LMT: Loaded 22737 existing records. [2025-09-14T18:50:49.363976] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-14T18:50:49.469449] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:49.469698] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-14T18:50:49.469771] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-14T18:50:49.470463] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-14T18:50:49.470544] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-14T18:50:49.830943] [INFO ] [REMOTE ] LMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:50.158868] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-14T18:50:50.958902] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-14T18:50:51.173634] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-14T18:50:51.475803] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T18:50:51.477440] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T18:50:51.758881] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-14T18:50:51.957860] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T18:50:52.558849] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-14T18:50:53.358853] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-14T18:50:53.622061] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T18:50:53.759906] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-14T18:50:54.158854] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-14T18:50:54.698561] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T18:50:54.908392] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-14T18:50:54.958812] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-14T18:50:55.758839] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-14T18:50:56.558797] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-14T18:50:57.044948] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T18:50:57.358821] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-14T18:50:57.735357] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T18:50:58.071021] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:50:58.158789] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-14T18:50:58.311001] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-14T18:50:58.958833] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-14T18:50:59.611485] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:50:59.612865] [INFO ] [REMOTE ] LITB: Full fetch complete (4430 records). [2025-09-14T18:50:59.612960] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-14T18:50:59.764086] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-14T18:50:59.974534] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-14T18:50:59.974657] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-14T18:50:59.974817] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-14T18:50:59.974876] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-14T18:50:59.975282] [DEBUG] [LOCAL ] LITB: Trimmed 4430 records to 2497 (keeping 150 days of data) [2025-09-14T18:50:59.990134] [DEBUG] [LOCAL ] LITB: Primary data saved (2497 records). [2025-09-14T18:50:59.990226] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-14T18:50:59.990317] [INFO ] [MAIN ] Update Progress: 1262/2370 symbols completed. LITB took 16.7s. Estimated remaining: 1h 57m 29s. Rate: 9.4 symbols/min [2025-09-14T18:51:00.168855] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:00.201123] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T18:51:00.225452] [DEBUG] [LOCAL ] LNC: Loaded 23111 existing records from primary storage. [2025-09-14T18:51:00.225624] [INFO ] [MAIN ] LNC: Loaded 23111 existing records. [2025-09-14T18:51:00.398720] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:00.399014] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-14T18:51:00.399903] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-14T18:51:00.400453] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-14T18:51:00.400513] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-14T18:51:00.570610] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-14T18:51:00.754584] [INFO ] [REMOTE ] LNC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:01.358895] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-14T18:51:02.158842] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-14T18:51:02.511681] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-14T18:51:02.958845] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-14T18:51:03.463127] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-14T18:51:03.758851] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-14T18:51:05.248187] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (3.89 seconds). [2025-09-14T18:51:05.258942] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-14T18:51:05.715049] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-09-14T18:51:05.727985] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-14T18:51:06.356258] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-14T18:51:06.366862] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-14T18:51:06.624947] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:51:06.958888] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-14T18:51:07.214446] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (4.26 seconds). [2025-09-14T18:51:07.758819] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-14T18:51:08.010891] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-14T18:51:08.558908] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-14T18:51:08.661428] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-14T18:51:08.884972] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:51:09.358869] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-14T18:51:10.158869] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-14T18:51:10.342572] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-14T18:51:10.433573] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:51:10.958905] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-14T18:51:11.713722] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-14T18:51:11.758792] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-14T18:51:11.800352] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T18:51:12.558912] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-14T18:51:13.283453] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:51:13.289030] [INFO ] [REMOTE ] LMT: Full fetch complete (54565 records). [2025-09-14T18:51:13.289197] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-14T18:51:13.368413] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-14T18:51:13.683624] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-14T18:51:13.683963] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-14T18:51:13.685612] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-14T18:51:13.686038] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-14T18:51:13.703581] [DEBUG] [LOCAL ] LMT: Trimmed 54565 records to 37406 (keeping 150 days of data) [2025-09-14T18:51:13.703348] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-14T18:51:13.711277] [INFO ] [REMOTE ] LMND: Full fetch complete (56458 records). [2025-09-14T18:51:13.711706] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-14T18:51:13.934920] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-14T18:51:14.162014] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-14T18:51:14.263214] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-14T18:51:14.263988] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-14T18:51:14.265324] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-14T18:51:14.265904] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-14T18:51:14.269705] [DEBUG] [LOCAL ] LMND: Trimmed 56458 records to 39073 (keeping 150 days of data) [2025-09-14T18:51:14.613426] [DEBUG] [LOCAL ] LMND: Primary data saved (39073 records). [2025-09-14T18:51:14.614790] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-14T18:51:14.614922] [INFO ] [MAIN ] Update Progress: 1263/2370 symbols completed. LMND took 27.3s. Estimated remaining: 1h 57m 29s. Rate: 9.4 symbols/min [2025-09-14T18:51:14.795129] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:14.802897] [DEBUG] [LOCAL ] LND: Loaded 2311 existing records from primary storage. [2025-09-14T18:51:14.804664] [INFO ] [MAIN ] LND: Loaded 2311 existing records. [2025-09-14T18:51:14.989096] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:14.990933] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-14T18:51:14.991282] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-14T18:51:14.994669] [DEBUG] [LOCAL ] LMT: Primary data saved (37406 records). [2025-09-14T18:51:14.994900] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-14T18:51:14.995015] [INFO ] [MAIN ] Update Progress: 1264/2370 symbols completed. LMT took 25.9s. Estimated remaining: 1h 57m 18s. Rate: 9.4 symbols/min [2025-09-14T18:51:14.995049] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-14T18:51:14.995197] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-14T18:51:15.377599] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:15.573980] [INFO ] [REMOTE ] LND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:15.574576] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-14T18:51:15.617536] [DEBUG] [LOCAL ] LNG: Loaded 22929 existing records from primary storage. [2025-09-14T18:51:15.619718] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-14T18:51:15.619822] [INFO ] [MAIN ] LNG: Loaded 22929 existing records. [2025-09-14T18:51:15.763865] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-14T18:51:15.819509] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:15.819735] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-14T18:51:15.819808] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-14T18:51:15.820440] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-14T18:51:15.820500] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-14T18:51:16.174713] [INFO ] [REMOTE ] LNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:16.360018] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T18:51:16.558843] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-14T18:51:17.287677] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T18:51:17.358878] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-14T18:51:17.678288] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T18:51:18.068688] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (3.91 seconds). [2025-09-14T18:51:18.069552] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T18:51:18.158774] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-14T18:51:18.837237] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:51:18.843144] [INFO ] [REMOTE ] LLY: Full fetch complete (57941 records). [2025-09-14T18:51:18.843304] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-14T18:51:18.964029] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-14T18:51:19.289328] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-14T18:51:19.289437] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-14T18:51:19.290308] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-14T18:51:19.290368] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-14T18:51:19.291620] [DEBUG] [LOCAL ] LLY: Trimmed 57941 records to 40112 (keeping 150 days of data) [2025-09-14T18:51:19.570832] [DEBUG] [LOCAL ] LLY: Primary data saved (40112 records). [2025-09-14T18:51:19.570996] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-14T18:51:19.571113] [INFO ] [MAIN ] Update Progress: 1265/2370 symbols completed. LLY took 33.0s. Estimated remaining: 1h 57m 10s. Rate: 9.4 symbols/min [2025-09-14T18:51:19.748616] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:19.756834] [DEBUG] [LOCAL ] LNN: Loaded 5446 existing records from primary storage. [2025-09-14T18:51:19.757170] [INFO ] [MAIN ] LNN: Loaded 5446 existing records. [2025-09-14T18:51:19.771975] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-14T18:51:19.782712] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:51:19.945958] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:19.946238] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-14T18:51:19.946299] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-14T18:51:19.946585] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-14T18:51:19.946671] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-14T18:51:20.298064] [INFO ] [REMOTE ] LNN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:20.558854] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-14T18:51:21.358825] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-14T18:51:21.728365] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T18:51:22.162822] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-14T18:51:22.165916] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T18:51:22.270133] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:51:22.770482] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T18:51:22.958838] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-14T18:51:23.758842] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-14T18:51:23.831966] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:51:24.475485] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:51:24.481287] [INFO ] [REMOTE ] LNC: Full fetch complete (56126 records). [2025-09-14T18:51:24.481463] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-14T18:51:24.563988] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-14T18:51:24.898421] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-14T18:51:24.898526] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-14T18:51:24.899824] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-14T18:51:24.899915] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-14T18:51:24.902795] [DEBUG] [LOCAL ] LNC: Trimmed 56126 records to 38705 (keeping 150 days of data) [2025-09-14T18:51:25.155275] [DEBUG] [LOCAL ] LNC: Primary data saved (38705 records). [2025-09-14T18:51:25.155473] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-14T18:51:25.155711] [INFO ] [MAIN ] Update Progress: 1266/2370 symbols completed. LNC took 25.2s. Estimated remaining: 1h 57m 3s. Rate: 9.4 symbols/min [2025-09-14T18:51:25.332743] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:25.338221] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T18:51:25.359020] [DEBUG] [LOCAL ] LOAR: Loaded 18986 existing records from primary storage. [2025-09-14T18:51:25.359088] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-14T18:51:25.359435] [INFO ] [MAIN ] LOAR: Loaded 18986 existing records. [2025-09-14T18:51:25.549928] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:25.550192] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-14T18:51:25.550254] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-14T18:51:25.550965] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-14T18:51:25.551039] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-14T18:51:25.911001] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:26.158822] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-14T18:51:26.442900] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:51:26.958849] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-14T18:51:27.758848] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-14T18:51:27.819882] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:51:28.265123] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:51:28.458418] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T18:51:28.558836] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-14T18:51:29.358835] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-14T18:51:29.488897] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:51:29.939081] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:51:29.940469] [INFO ] [REMOTE ] LND: Full fetch complete (5993 records). [2025-09-14T18:51:29.940581] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-14T18:51:30.164423] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-14T18:51:30.321672] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-14T18:51:30.321778] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-14T18:51:30.321966] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-14T18:51:30.322028] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-14T18:51:30.322434] [DEBUG] [LOCAL ] LND: Trimmed 5993 records to 3677 (keeping 150 days of data) [2025-09-14T18:51:30.343802] [DEBUG] [LOCAL ] LND: Primary data saved (3677 records). [2025-09-14T18:51:30.343894] [INFO ] [MAIN ] LND: Full history saved. [2025-09-14T18:51:30.344024] [INFO ] [MAIN ] Update Progress: 1267/2370 symbols completed. LND took 15.7s. Estimated remaining: 1h 56m 56s. Rate: 9.4 symbols/min [2025-09-14T18:51:30.520086] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:30.535386] [DEBUG] [LOCAL ] LOB: Loaded 11421 existing records from primary storage. [2025-09-14T18:51:30.535563] [INFO ] [MAIN ] LOB: Loaded 11421 existing records. [2025-09-14T18:51:30.724523] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:30.724839] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-14T18:51:30.724908] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-14T18:51:30.725245] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-14T18:51:30.725317] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-14T18:51:30.965139] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-14T18:51:31.097477] [INFO ] [REMOTE ] LOB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:31.758877] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-14T18:51:32.343062] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-14T18:51:32.395692] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:51:32.558864] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-14T18:51:33.032950] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T18:51:33.358867] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-14T18:51:33.634998] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T18:51:34.158902] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-14T18:51:34.566053] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T18:51:34.958928] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-14T18:51:34.974190] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T18:51:35.758940] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-14T18:51:36.487716] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T18:51:36.558775] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-14T18:51:37.358859] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-14T18:51:37.419525] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T18:51:37.779963] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T18:51:37.803797] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T18:51:37.805455] [INFO ] [REMOTE ] LNN: Full fetch complete (11911 records). [2025-09-14T18:51:37.805586] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-14T18:51:38.162396] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-14T18:51:38.169100] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-14T18:51:38.170206] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-14T18:51:38.170521] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-14T18:51:38.170571] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-14T18:51:38.171156] [DEBUG] [LOCAL ] LNN: Trimmed 11911 records to 8309 (keeping 150 days of data) [2025-09-14T18:51:38.229604] [DEBUG] [LOCAL ] LNN: Primary data saved (8309 records). [2025-09-14T18:51:38.229777] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-14T18:51:38.229889] [INFO ] [MAIN ] Update Progress: 1268/2370 symbols completed. LNN took 18.7s. Estimated remaining: 1h 56m 51s. Rate: 9.4 symbols/min [2025-09-14T18:51:38.406593] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:38.410378] [DEBUG] [LOCAL ] LOCL: Loaded 1238 existing records from primary storage. [2025-09-14T18:51:38.410501] [INFO ] [MAIN ] LOCL: Loaded 1238 existing records. [2025-09-14T18:51:38.596373] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:38.596744] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-14T18:51:38.596826] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-14T18:51:38.597099] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-14T18:51:38.597178] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-14T18:51:38.962716] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:38.962817] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-14T18:51:39.397430] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T18:51:39.758962] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-14T18:51:40.517494] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:51:40.558929] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-14T18:51:41.073334] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:51:41.358847] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-14T18:51:42.158928] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-14T18:51:42.497945] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T18:51:42.606989] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:51:42.958878] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-14T18:51:43.535135] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:51:43.758865] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-14T18:51:43.983855] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:51:43.987081] [INFO ] [REMOTE ] LOB: Full fetch complete (29313 records). [2025-09-14T18:51:43.987183] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-14T18:51:44.376261] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-14T18:51:44.376466] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-14T18:51:44.377163] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-14T18:51:44.377229] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-14T18:51:44.378051] [DEBUG] [LOCAL ] LOB: Trimmed 29313 records to 19624 (keeping 150 days of data) [2025-09-14T18:51:44.514546] [DEBUG] [LOCAL ] LOB: Primary data saved (19624 records). [2025-09-14T18:51:44.514746] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-14T18:51:44.514850] [INFO ] [MAIN ] Update Progress: 1269/2370 symbols completed. LOB took 14.2s. Estimated remaining: 1h 56m 44s. Rate: 9.4 symbols/min [2025-09-14T18:51:44.570086] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-14T18:51:44.690330] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:44.704744] [DEBUG] [LOCAL ] LOMA: Loaded 14111 existing records from primary storage. [2025-09-14T18:51:44.704895] [INFO ] [MAIN ] LOMA: Loaded 14111 existing records. [2025-09-14T18:51:44.877061] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:44.877289] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-14T18:51:44.877350] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-14T18:51:44.877881] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-14T18:51:44.877946] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-14T18:51:45.191394] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T18:51:45.227565] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:45.358793] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-14T18:51:45.905270] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-14T18:51:46.158840] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-14T18:51:46.654479] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T18:51:46.958831] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-14T18:51:47.433363] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T18:51:47.758834] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-14T18:51:47.990966] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:51:48.558842] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-14T18:51:49.358852] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-14T18:51:49.577923] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T18:51:49.923238] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T18:51:50.144562] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-14T18:51:50.150626] [INFO ] [REMOTE ] LNG: Full fetch complete (56305 records). [2025-09-14T18:51:50.150781] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-14T18:51:50.164016] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-14T18:51:50.540593] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-14T18:51:50.540719] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-14T18:51:50.541589] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-14T18:51:50.541659] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-14T18:51:50.542911] [DEBUG] [LOCAL ] LNG: Trimmed 56305 records to 38725 (keeping 150 days of data) [2025-09-14T18:51:50.805757] [DEBUG] [LOCAL ] LNG: Primary data saved (38725 records). [2025-09-14T18:51:50.805959] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-14T18:51:50.806082] [INFO ] [MAIN ] Update Progress: 1270/2370 symbols completed. LNG took 35.8s. Estimated remaining: 1h 56m 38s. Rate: 9.4 symbols/min [2025-09-14T18:51:50.958876] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-14T18:51:50.977184] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:51.002095] [DEBUG] [LOCAL ] LOW: Loaded 23760 existing records from primary storage. [2025-09-14T18:51:51.002278] [INFO ] [MAIN ] LOW: Loaded 23760 existing records. [2025-09-14T18:51:51.189308] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:51.189552] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-14T18:51:51.189609] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-14T18:51:51.190334] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-14T18:51:51.190395] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-14T18:51:51.582752] [INFO ] [REMOTE ] LOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:51.583494] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T18:51:51.606152] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:51:51.758879] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-14T18:51:52.558849] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-14T18:51:53.103307] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:51:53.358844] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-14T18:51:53.422613] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:51:53.878176] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T18:51:54.158841] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-14T18:51:54.958831] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-14T18:51:55.758812] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-14T18:51:55.815253] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:51:55.984129] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:51:56.174241] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-14T18:51:56.558830] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-14T18:51:57.358840] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-14T18:51:57.529819] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T18:51:58.158875] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-14T18:51:58.692078] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T18:51:58.812369] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T18:51:58.958784] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-14T18:51:59.495310] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T18:51:59.758801] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-14T18:52:00.558869] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-14T18:52:00.693002] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T18:52:01.172102] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T18:52:01.358835] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-14T18:52:01.899749] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T18:52:01.901695] [INFO ] [REMOTE ] LOCL: Full fetch complete (3304 records). [2025-09-14T18:52:01.902108] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-14T18:52:02.164041] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-14T18:52:02.288879] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-14T18:52:02.288985] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-14T18:52:02.289118] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-14T18:52:02.289168] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-14T18:52:02.289526] [DEBUG] [LOCAL ] LOCL: Trimmed 3304 records to 2141 (keeping 150 days of data) [2025-09-14T18:52:02.302461] [DEBUG] [LOCAL ] LOCL: Primary data saved (2141 records). [2025-09-14T18:52:02.302538] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-14T18:52:02.302622] [INFO ] [MAIN ] Update Progress: 1271/2370 symbols completed. LOCL took 24.1s. Estimated remaining: 1h 56m 36s. Rate: 9.4 symbols/min [2025-09-14T18:52:02.469439] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:02.489851] [DEBUG] [LOCAL ] LPG: Loaded 17710 existing records from primary storage. [2025-09-14T18:52:02.490031] [INFO ] [MAIN ] LPG: Loaded 17710 existing records. [2025-09-14T18:52:02.668668] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:02.668949] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-14T18:52:02.669006] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-14T18:52:02.669542] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-14T18:52:02.669602] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-14T18:52:02.962054] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-14T18:52:03.034686] [INFO ] [REMOTE ] LPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:03.360515] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:52:03.758839] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-14T18:52:04.268522] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:52:04.558874] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-14T18:52:04.979632] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T18:52:05.358812] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-14T18:52:05.491229] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:52:06.158849] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-14T18:52:06.966425] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-14T18:52:06.969444] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:52:07.423970] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T18:52:07.683454] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:52:07.688984] [INFO ] [REMOTE ] LOW: Full fetch complete (57596 records). [2025-09-14T18:52:07.689121] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-14T18:52:07.763919] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-14T18:52:08.086323] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-14T18:52:08.086467] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-14T18:52:08.087865] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-14T18:52:08.087935] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-14T18:52:08.089623] [DEBUG] [LOCAL ] LOW: Trimmed 57596 records to 39883 (keeping 150 days of data) [2025-09-14T18:52:08.379209] [DEBUG] [LOCAL ] LOW: Primary data saved (39883 records). [2025-09-14T18:52:08.379793] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-14T18:52:08.380062] [INFO ] [MAIN ] Update Progress: 1272/2370 symbols completed. LOW took 17.6s. Estimated remaining: 1h 56m 29s. Rate: 9.4 symbols/min [2025-09-14T18:52:08.564524] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-14T18:52:08.567468] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:08.585881] [DEBUG] [LOCAL ] LPL: Loaded 13628 existing records from primary storage. [2025-09-14T18:52:08.586245] [INFO ] [MAIN ] LPL: Loaded 13628 existing records. [2025-09-14T18:52:08.782939] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:08.783287] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-14T18:52:08.783357] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-14T18:52:08.783979] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-14T18:52:08.784048] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-14T18:52:09.209148] [INFO ] [REMOTE ] LPL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:09.273714] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:52:09.278474] [INFO ] [REMOTE ] LOAR: Full fetch complete (44224 records). [2025-09-14T18:52:09.278598] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-14T18:52:09.364032] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-14T18:52:09.654943] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-14T18:52:09.655046] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-14T18:52:09.656023] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-14T18:52:09.656083] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-14T18:52:09.657135] [DEBUG] [LOCAL ] LOAR: Trimmed 44224 records to 32743 (keeping 150 days of data) [2025-09-14T18:52:09.855453] [DEBUG] [LOCAL ] LOAR: Primary data saved (32743 records). [2025-09-14T18:52:09.855659] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-14T18:52:09.855763] [INFO ] [MAIN ] Update Progress: 1273/2370 symbols completed. LOAR took 44.7s. Estimated remaining: 1h 56m 19s. Rate: 9.4 symbols/min [2025-09-14T18:52:10.029946] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:10.042754] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T18:52:10.047691] [INFO ] [REMOTE ] LOMA: Full fetch complete (34165 records). [2025-09-14T18:52:10.047858] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-14T18:52:10.163595] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-14T18:52:10.245850] [DEBUG] [LOCAL ] LPX: Loaded 18158 existing records from primary storage. [2025-09-14T18:52:10.266257] [INFO ] [MAIN ] LPX: Loaded 18158 existing records. [2025-09-14T18:52:10.632464] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:10.634466] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-14T18:52:10.634824] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-14T18:52:10.634671] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-14T18:52:10.634916] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-14T18:52:10.635661] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-14T18:52:10.635843] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-14T18:52:10.636446] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-14T18:52:10.636615] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-14T18:52:10.667972] [DEBUG] [LOCAL ] LOMA: Trimmed 34165 records to 23254 (keeping 150 days of data) [2025-09-14T18:52:11.010310] [DEBUG] [LOCAL ] LOMA: Primary data saved (23254 records). [2025-09-14T18:52:11.041896] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-14T18:52:11.059666] [INFO ] [MAIN ] Update Progress: 1274/2370 symbols completed. LOMA took 26.5s. Estimated remaining: 1h 56m 8s. Rate: 9.4 symbols/min [2025-09-14T18:52:11.189640] [INFO ] [REMOTE ] LPX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:11.212442] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-14T18:52:11.344317] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:11.349496] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:52:11.374502] [DEBUG] [LOCAL ] LRN: Loaded 16426 existing records from primary storage. [2025-09-14T18:52:11.374679] [INFO ] [MAIN ] LRN: Loaded 16426 existing records. [2025-09-14T18:52:11.549482] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:11.549775] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-14T18:52:11.549836] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-14T18:52:11.550428] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-14T18:52:11.550491] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-14T18:52:11.710887] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:52:11.763978] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-14T18:52:11.938458] [INFO ] [REMOTE ] LRN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:12.558832] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-14T18:52:12.859318] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T18:52:12.998009] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T18:52:13.358834] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-14T18:52:13.712388] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T18:52:14.158845] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-14T18:52:14.952177] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:52:14.960350] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-14T18:52:15.758865] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-14T18:52:15.868850] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T18:52:16.186780] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T18:52:16.558840] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-14T18:52:17.283997] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T18:52:17.358837] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-14T18:52:17.582996] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T18:52:18.158834] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-14T18:52:18.850089] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T18:52:18.886063] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T18:52:18.958828] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-14T18:52:19.758847] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-14T18:52:20.505908] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:52:20.558819] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-14T18:52:21.358839] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-14T18:52:21.510412] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:52:22.076720] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T18:52:22.158816] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-14T18:52:22.690835] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T18:52:22.958836] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-14T18:52:23.758879] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-14T18:52:23.798595] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:52:24.558851] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-14T18:52:24.779706] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T18:52:25.358853] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-14T18:52:25.394952] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:52:26.094380] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:52:26.158795] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-14T18:52:26.425427] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:52:26.958902] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-14T18:52:27.759894] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-14T18:52:27.765764] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:52:27.826961] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T18:52:28.558893] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-14T18:52:28.897324] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T18:52:29.283711] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:52:29.287742] [INFO ] [REMOTE ] LRN: Full fetch complete (43297 records). [2025-09-14T18:52:29.287887] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-14T18:52:29.364082] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-14T18:52:29.664210] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-14T18:52:29.664330] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-14T18:52:29.665236] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-14T18:52:29.665304] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-14T18:52:29.666442] [DEBUG] [LOCAL ] LRN: Trimmed 43297 records to 29698 (keeping 150 days of data) [2025-09-14T18:52:29.857272] [DEBUG] [LOCAL ] LRN: Primary data saved (29698 records). [2025-09-14T18:52:29.857455] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-14T18:52:29.857560] [INFO ] [MAIN ] Update Progress: 1275/2370 symbols completed. LRN took 18.8s. Estimated remaining: 1h 56m 12s. Rate: 9.4 symbols/min [2025-09-14T18:52:30.025143] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:30.044411] [DEBUG] [LOCAL ] LSPD: Loaded 18153 existing records from primary storage. [2025-09-14T18:52:30.044583] [INFO ] [MAIN ] LSPD: Loaded 18153 existing records. [2025-09-14T18:52:30.190692] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-14T18:52:30.272011] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:30.272317] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-14T18:52:30.272384] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-14T18:52:30.273064] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-14T18:52:30.273139] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-14T18:52:30.655119] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:30.954303] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:52:30.962883] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-14T18:52:31.735515] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T18:52:31.758774] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-14T18:52:32.559126] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-14T18:52:32.753468] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T18:52:33.149250] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T18:52:33.153752] [INFO ] [REMOTE ] LPL: Full fetch complete (26179 records). [2025-09-14T18:52:33.153934] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-14T18:52:33.367423] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-14T18:52:33.535822] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-14T18:52:33.535931] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-14T18:52:33.536537] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-14T18:52:33.536595] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-14T18:52:33.537472] [DEBUG] [LOCAL ] LPL: Trimmed 26179 records to 19157 (keeping 150 days of data) [2025-09-14T18:52:33.644190] [DEBUG] [LOCAL ] LPL: Primary data saved (19157 records). [2025-09-14T18:52:33.644363] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-14T18:52:33.644468] [INFO ] [MAIN ] Update Progress: 1276/2370 symbols completed. LPL took 25.3s. Estimated remaining: 1h 56m 3s. Rate: 9.4 symbols/min [2025-09-14T18:52:33.823487] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:33.837946] [DEBUG] [LOCAL ] LTC: Loaded 13773 existing records from primary storage. [2025-09-14T18:52:33.838087] [INFO ] [MAIN ] LTC: Loaded 13773 existing records. [2025-09-14T18:52:34.012599] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:34.012857] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-14T18:52:34.012915] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-14T18:52:34.013560] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-14T18:52:34.013621] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-14T18:52:34.165428] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-14T18:52:34.376073] [INFO ] [REMOTE ] LTC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:34.402392] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:52:34.958867] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-14T18:52:35.157945] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T18:52:35.758882] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-14T18:52:35.983724] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:52:36.028295] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:52:36.098370] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T18:52:36.102996] [INFO ] [REMOTE ] LPG: Full fetch complete (44592 records). [2025-09-14T18:52:36.103175] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-14T18:52:36.480572] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-14T18:52:36.480696] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-14T18:52:36.481514] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-14T18:52:36.481594] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-14T18:52:36.482726] [DEBUG] [LOCAL ] LPG: Trimmed 44592 records to 30148 (keeping 150 days of data) [2025-09-14T18:52:36.580568] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-14T18:52:36.689797] [DEBUG] [LOCAL ] LPG: Primary data saved (30148 records). [2025-09-14T18:52:36.689970] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-14T18:52:36.690079] [INFO ] [MAIN ] Update Progress: 1277/2370 symbols completed. LPG took 34.4s. Estimated remaining: 1h 55m 54s. Rate: 9.4 symbols/min [2025-09-14T18:52:37.358875] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-14T18:52:37.935280] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T18:52:38.158843] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-14T18:52:38.914898] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T18:52:38.958776] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-14T18:52:39.484754] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:52:39.758835] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-14T18:52:40.420041] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:52:40.424176] [INFO ] [REMOTE ] LPX: Full fetch complete (43601 records). [2025-09-14T18:52:40.424302] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-14T18:52:40.567286] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-14T18:52:40.823875] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-14T18:52:40.824045] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-14T18:52:40.824841] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-14T18:52:40.824997] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-14T18:52:40.850548] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:52:40.850685] [DEBUG] [LOCAL ] LPX: Trimmed 43601 records to 29818 (keeping 150 days of data) [2025-09-14T18:52:41.044206] [DEBUG] [LOCAL ] LPX: Primary data saved (29818 records). [2025-09-14T18:52:41.044384] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-14T18:52:41.044498] [INFO ] [MAIN ] Update Progress: 1278/2370 symbols completed. LPX took 31.2s. Estimated remaining: 1h 55m 46s. Rate: 9.4 symbols/min [2025-09-14T18:52:41.358899] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-14T18:52:42.062135] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T18:52:42.158853] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-14T18:52:42.542035] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T18:52:42.958839] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-14T18:52:43.199476] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T18:52:43.758886] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-14T18:52:44.127184] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T18:52:44.558914] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-14T18:52:44.973686] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:52:45.358842] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-14T18:52:46.045282] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:52:46.158833] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-14T18:52:46.726610] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:52:46.958906] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-14T18:52:47.381757] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:52:47.386307] [INFO ] [REMOTE ] LTC: Full fetch complete (32505 records). [2025-09-14T18:52:47.386493] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-14T18:52:47.768119] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T18:52:47.801869] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-14T18:52:47.802018] [INFO ] [REMOTE ] LSPD: Full fetch complete (48071 records). [2025-09-14T18:52:47.802290] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-14T18:52:47.802399] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-14T18:52:47.803438] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-14T18:52:47.803789] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-14T18:52:47.912910] [DEBUG] [LOCAL ] LTC: Trimmed 32505 records to 22507 (keeping 150 days of data) [2025-09-14T18:52:48.320892] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-14T18:52:48.322356] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-14T18:52:48.324516] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-14T18:52:48.327841] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-14T18:52:48.348714] [DEBUG] [LOCAL ] LSPD: Trimmed 48071 records to 31705 (keeping 150 days of data) [2025-09-14T18:52:48.352976] [DEBUG] [LOCAL ] LTC: Primary data saved (22507 records). [2025-09-14T18:52:48.353078] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-14T18:52:48.353199] [INFO ] [MAIN ] Update Progress: 1279/2370 symbols completed. LTC took 14.7s. Estimated remaining: 1h 55m 41s. Rate: 9.4 symbols/min [2025-09-14T18:52:48.558746] [DEBUG] [LOCAL ] LSPD: Primary data saved (31705 records). [2025-09-14T18:52:48.558930] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-14T18:52:48.559046] [INFO ] [MAIN ] Update Progress: 1280/2370 symbols completed. LSPD took 18.7s. Estimated remaining: 1h 55m 29s. Rate: 9.4 symbols/min [2025-09-14T18:52:49.234025] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:49.254774] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:49.273994] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:49.255711] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:49.292709] [DEBUG] [LOCAL ] LUCK: Loaded 9996 existing records from primary storage. [2025-09-14T18:52:49.301524] [INFO ] [MAIN ] LUCK: Loaded 9996 existing records. [2025-09-14T18:52:49.427108] [DEBUG] [LOCAL ] LTM: Loaded 18473 existing records from primary storage. [2025-09-14T18:52:49.427617] [DEBUG] [LOCAL ] LU: Loaded 21823 existing records from primary storage. [2025-09-14T18:52:49.431300] [INFO ] [MAIN ] LU: Loaded 21823 existing records. [2025-09-14T18:52:49.485253] [DEBUG] [LOCAL ] LTH: Loaded 23237 existing records from primary storage. [2025-09-14T18:52:49.465720] [INFO ] [MAIN ] LTM: Loaded 18473 existing records. [2025-09-14T18:52:49.506155] [INFO ] [MAIN ] LTH: Loaded 23237 existing records. [2025-09-14T18:52:49.635295] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:49.761176] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-14T18:52:49.816381] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-14T18:52:49.918559] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-09-14T18:52:49.918705] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:49.986322] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-14T18:52:50.024971] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-14T18:52:50.037887] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:50.062617] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-14T18:52:50.067467] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:50.062567] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-14T18:52:50.088178] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-14T18:52:50.097069] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-14T18:52:50.102238] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-14T18:52:50.124327] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-14T18:52:50.124548] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-14T18:52:50.150469] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-14T18:52:50.214552] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-14T18:52:50.242457] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-14T18:52:50.237301] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-14T18:52:51.289290] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:51.355764] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-14T18:52:51.397268] [INFO ] [REMOTE ] LU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:51.488396] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-14T18:52:51.533063] [INFO ] [REMOTE ] LTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:51.545367] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-14T18:52:51.548536] [INFO ] [REMOTE ] LTH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:51.549726] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-14T18:52:52.779326] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T18:52:52.785235] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-14T18:52:52.925236] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T18:52:52.932604] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-14T18:52:53.010348] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T18:52:53.019905] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-14T18:52:53.189601] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T18:52:53.358918] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-14T18:52:53.986879] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T18:52:54.107034] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T18:52:54.158913] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-14T18:52:54.712948] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:52:54.958885] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-14T18:52:55.208988] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:52:55.240847] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:52:55.758882] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-14T18:52:56.513312] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:52:56.558854] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-14T18:52:57.358859] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-14T18:52:57.550766] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T18:52:57.839900] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T18:52:58.158889] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-14T18:52:58.942686] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:52:58.958763] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-14T18:52:59.545697] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T18:52:59.758829] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-14T18:53:00.513058] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:53:00.558797] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-14T18:53:01.286144] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T18:53:01.358854] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-14T18:53:02.023092] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T18:53:02.158870] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-14T18:53:02.958842] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-14T18:53:03.384795] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T18:53:03.446336] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T18:53:03.758874] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-14T18:53:04.558841] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-14T18:53:04.795348] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:53:05.358851] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-14T18:53:05.476411] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:53:05.658466] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:53:06.158856] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-14T18:53:06.958890] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-14T18:53:07.180965] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T18:53:07.668626] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:53:07.673913] [INFO ] [REMOTE ] LU: Full fetch complete (53116 records). [2025-09-14T18:53:07.674048] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-14T18:53:07.765070] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-14T18:53:08.055175] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-14T18:53:08.055298] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-14T18:53:08.056371] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-14T18:53:08.056514] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-14T18:53:08.057957] [DEBUG] [LOCAL ] LU: Trimmed 53116 records to 36936 (keeping 150 days of data) [2025-09-14T18:53:08.277785] [DEBUG] [LOCAL ] LU: Primary data saved (36936 records). [2025-09-14T18:53:08.277964] [INFO ] [MAIN ] LU: Full history saved. [2025-09-14T18:53:08.278126] [INFO ] [MAIN ] Update Progress: 1281/2370 symbols completed. LU took 19.7s. Estimated remaining: 1h 55m 34s. Rate: 9.4 symbols/min [2025-09-14T18:53:08.460987] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:08.483765] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:53:08.513076] [DEBUG] [LOCAL ] LUMN: Loaded 24037 existing records from primary storage. [2025-09-14T18:53:08.513258] [INFO ] [MAIN ] LUMN: Loaded 24037 existing records. [2025-09-14T18:53:08.569901] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-14T18:53:08.699596] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:08.699927] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-14T18:53:08.699996] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-14T18:53:08.700692] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-14T18:53:08.700755] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-14T18:53:09.067260] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:09.358828] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-14T18:53:09.591237] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:53:09.594205] [INFO ] [REMOTE ] LUCK: Full fetch complete (29022 records). [2025-09-14T18:53:09.594309] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-14T18:53:09.793774] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T18:53:10.018426] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-09-14T18:53:10.018533] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-09-14T18:53:10.019166] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-09-14T18:53:10.019223] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-09-14T18:53:10.020000] [DEBUG] [LOCAL ] LUCK: Trimmed 29022 records to 17981 (keeping 150 days of data) [2025-09-14T18:53:10.134386] [DEBUG] [LOCAL ] LUCK: Primary data saved (17981 records). [2025-09-14T18:53:10.134565] [INFO ] [MAIN ] LUCK: Full history saved. [2025-09-14T18:53:10.134699] [INFO ] [MAIN ] Update Progress: 1282/2370 symbols completed. LUCK took 21.6s. Estimated remaining: 1h 55m 24s. Rate: 9.4 symbols/min [2025-09-14T18:53:10.165660] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-14T18:53:10.303305] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:10.326403] [DEBUG] [LOCAL ] LUV: Loaded 24102 existing records from primary storage. [2025-09-14T18:53:10.326566] [INFO ] [MAIN ] LUV: Loaded 24102 existing records. [2025-09-14T18:53:10.513094] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:10.513356] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-14T18:53:10.513417] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-14T18:53:10.514153] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-14T18:53:10.514223] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-14T18:53:10.889048] [INFO ] [REMOTE ] LUV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:10.913727] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:53:10.958788] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-14T18:53:11.758854] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-14T18:53:11.938530] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:53:12.558929] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-14T18:53:12.664578] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:53:13.358857] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-14T18:53:13.468445] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T18:53:14.158835] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-14T18:53:14.215760] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T18:53:14.221061] [INFO ] [REMOTE ] LTH: Full fetch complete (56353 records). [2025-09-14T18:53:14.221193] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-14T18:53:14.619052] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-14T18:53:14.619188] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-14T18:53:14.620410] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-14T18:53:14.620477] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-14T18:53:14.621823] [DEBUG] [LOCAL ] LTH: Trimmed 56353 records to 38977 (keeping 150 days of data) [2025-09-14T18:53:14.859601] [DEBUG] [LOCAL ] LTH: Primary data saved (38977 records). [2025-09-14T18:53:14.859814] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-14T18:53:14.859934] [INFO ] [MAIN ] Update Progress: 1283/2370 symbols completed. LTH took 26.3s. Estimated remaining: 1h 55m 16s. Rate: 9.4 symbols/min [2025-09-14T18:53:14.960465] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-14T18:53:15.037604] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:15.048704] [DEBUG] [LOCAL ] LUXE: Loaded 7772 existing records from primary storage. [2025-09-14T18:53:15.048943] [INFO ] [MAIN ] LUXE: Loaded 7772 existing records. [2025-09-14T18:53:15.247541] [WARN ] [MAIN ] LUXE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:15.247957] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-14T18:53:15.248056] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-14T18:53:15.248433] [DEBUG] [LOCAL ] LUXE: Deleted primary data file. [2025-09-14T18:53:15.248508] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-14T18:53:15.638005] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:15.654159] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T18:53:15.676770] [INFO ] [REMOTE ] LTM: Full fetch complete (37461 records). [2025-09-14T18:53:15.690185] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-14T18:53:15.692669] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T18:53:15.772227] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-14T18:53:16.079548] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-14T18:53:16.079703] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-14T18:53:16.080566] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-14T18:53:16.080625] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-14T18:53:16.082188] [DEBUG] [LOCAL ] LTM: Trimmed 37461 records to 28107 (keeping 150 days of data) [2025-09-14T18:53:16.134701] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:53:16.170876] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-14T18:53:16.256861] [DEBUG] [LOCAL ] LTM: Primary data saved (28107 records). [2025-09-14T18:53:16.257085] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-14T18:53:16.257216] [INFO ] [MAIN ] Update Progress: 1284/2370 symbols completed. LTM took 27.7s. Estimated remaining: 1h 55m 6s. Rate: 9.4 symbols/min [2025-09-14T18:53:16.427925] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:16.451549] [DEBUG] [LOCAL ] LVS: Loaded 23956 existing records from primary storage. [2025-09-14T18:53:16.451740] [INFO ] [MAIN ] LVS: Loaded 23956 existing records. [2025-09-14T18:53:16.564058] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-14T18:53:16.634203] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:16.634470] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-14T18:53:16.634533] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-14T18:53:16.635264] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-14T18:53:16.635329] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-14T18:53:16.988869] [INFO ] [REMOTE ] LVS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:17.032114] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T18:53:17.358834] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-14T18:53:18.158833] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-14T18:53:18.791324] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-14T18:53:18.958855] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-14T18:53:19.150154] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T18:53:19.311381] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:53:19.758915] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-14T18:53:20.558851] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-14T18:53:20.809190] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:53:20.809541] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-14T18:53:20.869995] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:53:21.358812] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-14T18:53:21.819569] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T18:53:22.158832] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-14T18:53:22.228970] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:53:22.958834] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-14T18:53:23.758843] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-14T18:53:24.025242] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:53:24.025669] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-14T18:53:24.186006] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T18:53:24.558793] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-14T18:53:24.636716] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T18:53:25.074740] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T18:53:25.358829] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-14T18:53:26.158833] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-14T18:53:26.333550] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T18:53:26.958825] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-14T18:53:27.758844] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-14T18:53:27.876842] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:53:28.558829] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-14T18:53:28.627731] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:53:29.273743] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-14T18:53:29.358873] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-14T18:53:30.158810] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-14T18:53:30.332477] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T18:53:30.420355] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:53:30.958828] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-14T18:53:31.254397] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T18:53:31.758820] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-14T18:53:31.871623] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T18:53:32.558849] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-14T18:53:33.358840] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-14T18:53:33.796906] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T18:53:34.052350] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:53:34.058420] [INFO ] [REMOTE ] LVS: Full fetch complete (58244 records). [2025-09-14T18:53:34.058616] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-14T18:53:34.161770] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-14T18:53:34.443495] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-14T18:53:34.443628] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-14T18:53:34.444632] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-14T18:53:34.444731] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-14T18:53:34.446479] [DEBUG] [LOCAL ] LVS: Trimmed 58244 records to 40317 (keeping 150 days of data) [2025-09-14T18:53:34.713221] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T18:53:34.771258] [DEBUG] [LOCAL ] LVS: Primary data saved (40317 records). [2025-09-14T18:53:34.771449] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-14T18:53:34.771609] [INFO ] [MAIN ] Update Progress: 1285/2370 symbols completed. LVS took 18.5s. Estimated remaining: 1h 55m 9s. Rate: 9.4 symbols/min [2025-09-14T18:53:34.948282] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:34.963219] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-14T18:53:34.964599] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:53:34.979264] [DEBUG] [LOCAL ] LVWR: Loaded 9105 existing records from primary storage. [2025-09-14T18:53:34.979008] [INFO ] [REMOTE ] LUMN: Full fetch complete (58305 records). [2025-09-14T18:53:34.979557] [INFO ] [MAIN ] LVWR: Loaded 9105 existing records. [2025-09-14T18:53:35.025039] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-14T18:53:35.337357] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:35.418728] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-14T18:53:35.459562] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-14T18:53:35.499249] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-14T18:53:35.541518] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-14T18:53:35.674352] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-14T18:53:35.692191] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-14T18:53:35.701629] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-14T18:53:35.718964] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-14T18:53:35.790841] [DEBUG] [LOCAL ] LUMN: Trimmed 58305 records to 40397 (keeping 150 days of data) [2025-09-14T18:53:35.768608] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-14T18:53:36.115731] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:36.136245] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T18:53:36.146033] [INFO ] [REMOTE ] LUV: Full fetch complete (58368 records). [2025-09-14T18:53:36.147202] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-14T18:53:36.561375] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-14T18:53:36.657363] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-14T18:53:36.658149] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-14T18:53:36.659151] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-14T18:53:36.659528] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-14T18:53:36.672910] [DEBUG] [LOCAL ] LUV: Trimmed 58368 records to 40429 (keeping 150 days of data) [2025-09-14T18:53:36.747308] [DEBUG] [LOCAL ] LUMN: Primary data saved (40397 records). [2025-09-14T18:53:36.756448] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-14T18:53:36.756688] [INFO ] [MAIN ] Update Progress: 1286/2370 symbols completed. LUMN took 28.5s. Estimated remaining: 1h 54m 59s. Rate: 9.4 symbols/min [2025-09-14T18:53:36.964149] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:36.987124] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:53:37.022846] [DEBUG] [LOCAL ] LW: Loaded 22970 existing records from primary storage. [2025-09-14T18:53:37.027728] [INFO ] [MAIN ] LW: Loaded 22970 existing records. [2025-09-14T18:53:37.316514] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:37.317708] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-14T18:53:37.318055] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-14T18:53:37.319573] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-14T18:53:37.320203] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-14T18:53:37.364291] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-14T18:53:37.435146] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T18:53:37.707913] [INFO ] [REMOTE ] LW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:37.728211] [DEBUG] [LOCAL ] LUV: Primary data saved (40429 records). [2025-09-14T18:53:37.728439] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-14T18:53:37.728588] [INFO ] [MAIN ] Update Progress: 1287/2370 symbols completed. LUV took 27.6s. Estimated remaining: 1h 54m 48s. Rate: 9.4 symbols/min [2025-09-14T18:53:37.909427] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:37.919203] [DEBUG] [LOCAL ] LXFR: Loaded 7356 existing records from primary storage. [2025-09-14T18:53:37.919366] [INFO ] [MAIN ] LXFR: Loaded 7356 existing records. [2025-09-14T18:53:38.099177] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:38.099464] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-14T18:53:38.099538] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-14T18:53:38.099865] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-14T18:53:38.099932] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-14T18:53:38.164131] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-14T18:53:38.460283] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:38.481623] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:53:38.890126] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T18:53:38.958854] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-14T18:53:39.758783] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-14T18:53:40.133260] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T18:53:40.353784] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T18:53:40.558872] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-14T18:53:41.358836] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-14T18:53:41.504304] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T18:53:41.506956] [INFO ] [REMOTE ] LUXE: Full fetch complete (11544 records). [2025-09-14T18:53:41.507043] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-14T18:53:41.695836] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 93 unique days, need 150 days [2025-09-14T18:53:41.696143] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:53:41.696200] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:53:41.696245] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-14T18:53:41.696320] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-14T18:53:41.696375] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-14T18:53:41.696433] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-14T18:53:41.696526] [INFO ] [MAIN ] Update Progress: 1288/2370 symbols completed. LUXE took 26.8s. Estimated remaining: 1h 54m 40s. Rate: 9.4 symbols/min [2025-09-14T18:53:41.877856] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:41.906324] [DEBUG] [LOCAL ] LXP: Loaded 22852 existing records from primary storage. [2025-09-14T18:53:41.906509] [INFO ] [MAIN ] LXP: Loaded 22852 existing records. [2025-09-14T18:53:42.080093] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:42.080338] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-14T18:53:42.080404] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-14T18:53:42.081108] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-14T18:53:42.081191] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-14T18:53:42.164104] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-14T18:53:42.444272] [INFO ] [REMOTE ] LXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:42.958841] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-14T18:53:43.090395] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:53:43.287315] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T18:53:43.611658] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T18:53:43.758803] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-14T18:53:44.558848] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-14T18:53:44.992352] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T18:53:45.358906] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-14T18:53:46.158980] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-14T18:53:46.292932] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:53:46.621683] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T18:53:46.958877] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-14T18:53:47.758871] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-14T18:53:47.989020] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:53:48.012260] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T18:53:48.558841] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-14T18:53:49.358886] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-14T18:53:49.531740] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:53:49.586890] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T18:53:50.158836] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-14T18:53:50.958953] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-14T18:53:51.000839] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T18:53:51.237238] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:53:51.758836] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-14T18:53:52.558878] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-14T18:53:52.684987] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T18:53:52.733243] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:53:53.358883] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-14T18:53:54.146403] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:53:54.158782] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-14T18:53:54.175467] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T18:53:54.178059] [INFO ] [REMOTE ] LXFR: Full fetch complete (18900 records). [2025-09-14T18:53:54.178147] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-14T18:53:54.541837] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-14T18:53:54.541947] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-14T18:53:54.542404] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-14T18:53:54.542487] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-14T18:53:54.543141] [DEBUG] [LOCAL ] LXFR: Trimmed 18900 records to 12577 (keeping 150 days of data) [2025-09-14T18:53:54.619677] [DEBUG] [LOCAL ] LXFR: Primary data saved (12577 records). [2025-09-14T18:53:54.619837] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-14T18:53:54.619933] [INFO ] [MAIN ] Update Progress: 1289/2370 symbols completed. LXFR took 16.9s. Estimated remaining: 1h 54m 39s. Rate: 9.4 symbols/min [2025-09-14T18:53:54.787089] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:54.801476] [DEBUG] [LOCAL ] LXU: Loaded 13674 existing records from primary storage. [2025-09-14T18:53:54.801660] [INFO ] [MAIN ] LXU: Loaded 13674 existing records. [2025-09-14T18:53:54.970715] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-14T18:53:54.975166] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:54.976396] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-14T18:53:54.976475] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-14T18:53:54.976977] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-14T18:53:54.977058] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-14T18:53:55.323780] [INFO ] [REMOTE ] LXU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:55.758821] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-14T18:53:55.938485] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T18:53:56.558800] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-14T18:53:56.671413] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:53:56.890441] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T18:53:57.358897] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-14T18:53:58.046684] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T18:53:58.158871] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-14T18:53:58.633040] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T18:53:58.958861] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-14T18:53:59.498592] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:53:59.758924] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-14T18:54:00.456335] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:54:00.558798] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-14T18:54:01.358842] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-14T18:54:01.396828] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:54:02.158853] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-14T18:54:02.463981] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:54:02.958843] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-14T18:54:03.758902] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-14T18:54:05.387270] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (3.23 seconds). [2025-09-14T18:54:05.398992] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-14T18:54:05.421672] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (4.06 seconds). [2025-09-14T18:54:05.427120] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-14T18:54:05.584465] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-14T18:54:05.732295] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:54:05.738431] [INFO ] [REMOTE ] LXP: Full fetch complete (54728 records). [2025-09-14T18:54:05.738589] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-14T18:54:06.120075] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-14T18:54:06.120314] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-14T18:54:06.121469] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-14T18:54:06.121689] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-14T18:54:06.123553] [DEBUG] [LOCAL ] LXP: Trimmed 54728 records to 38192 (keeping 150 days of data) [2025-09-14T18:54:06.190971] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-14T18:54:06.250329] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T18:54:06.391866] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:54:06.429898] [DEBUG] [LOCAL ] LXP: Primary data saved (38192 records). [2025-09-14T18:54:06.430094] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-14T18:54:06.430224] [INFO ] [MAIN ] Update Progress: 1290/2370 symbols completed. LXP took 24.7s. Estimated remaining: 1h 54m 37s. Rate: 9.4 symbols/min [2025-09-14T18:54:06.602957] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:06.625314] [DEBUG] [LOCAL ] LYB: Loaded 24054 existing records from primary storage. [2025-09-14T18:54:06.625493] [INFO ] [MAIN ] LYB: Loaded 24054 existing records. [2025-09-14T18:54:06.801905] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:06.802133] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-14T18:54:06.802192] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-14T18:54:06.802933] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-14T18:54:06.802997] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-14T18:54:06.960211] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-14T18:54:07.159756] [INFO ] [REMOTE ] LYB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:07.733386] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:54:07.758777] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-14T18:54:08.558901] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-14T18:54:08.895810] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T18:54:09.052348] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T18:54:09.358889] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-14T18:54:10.015668] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:54:10.158838] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-14T18:54:10.464929] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T18:54:10.467959] [INFO ] [REMOTE ] LXU: Full fetch complete (34672 records). [2025-09-14T18:54:10.468057] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-14T18:54:10.837703] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-14T18:54:10.837807] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-14T18:54:10.838428] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-14T18:54:10.838482] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-14T18:54:10.839323] [DEBUG] [LOCAL ] LXU: Trimmed 34672 records to 24142 (keeping 150 days of data) [2025-09-14T18:54:10.964457] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-14T18:54:10.978630] [DEBUG] [LOCAL ] LXU: Primary data saved (24142 records). [2025-09-14T18:54:10.978779] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-14T18:54:10.978877] [INFO ] [MAIN ] Update Progress: 1291/2370 symbols completed. LXU took 16.4s. Estimated remaining: 1h 54m 30s. Rate: 9.4 symbols/min [2025-09-14T18:54:11.187741] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:54:11.189820] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:11.192661] [INFO ] [REMOTE ] LVWR: Full fetch complete (17076 records). [2025-09-14T18:54:11.192760] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-14T18:54:11.489604] [DEBUG] [LOCAL ] LYG: Loaded 23561 existing records from primary storage. [2025-09-14T18:54:11.490059] [INFO ] [MAIN ] LYG: Loaded 23561 existing records. [2025-09-14T18:54:11.673630] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-14T18:54:11.689342] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-14T18:54:11.723974] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-14T18:54:11.732544] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-14T18:54:11.752351] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:11.752766] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-14T18:54:11.752860] [DEBUG] [LOCAL ] LVWR: Trimmed 17076 records to 15617 (keeping 150 days of data) [2025-09-14T18:54:11.752917] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-14T18:54:11.753858] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-14T18:54:11.753930] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-14T18:54:11.765348] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-14T18:54:12.211480] [INFO ] [REMOTE ] LYG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:12.226199] [DEBUG] [LOCAL ] LVWR: Primary data saved (15617 records). [2025-09-14T18:54:12.226393] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-14T18:54:12.226529] [INFO ] [MAIN ] Update Progress: 1292/2370 symbols completed. LVWR took 37.5s. Estimated remaining: 1h 54m 19s. Rate: 9.4 symbols/min [2025-09-14T18:54:12.394866] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:12.423216] [DEBUG] [LOCAL ] LYV: Loaded 22677 existing records from primary storage. [2025-09-14T18:54:12.423439] [INFO ] [MAIN ] LYV: Loaded 22677 existing records. [2025-09-14T18:54:12.563895] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-14T18:54:12.603551] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:12.604126] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-14T18:54:12.604218] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-14T18:54:12.610366] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-14T18:54:12.617986] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-14T18:54:12.619163] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T18:54:12.694283] [INFO ] [REMOTE ] LW: Full fetch complete (55902 records). [2025-09-14T18:54:12.716776] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-14T18:54:13.246066] [INFO ] [REMOTE ] LYV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:13.366728] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-14T18:54:13.386463] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-14T18:54:13.418585] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-14T18:54:13.420034] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-14T18:54:13.420290] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-14T18:54:13.421983] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-14T18:54:13.434361] [DEBUG] [LOCAL ] LW: Trimmed 55902 records to 38350 (keeping 150 days of data) [2025-09-14T18:54:13.675181] [DEBUG] [LOCAL ] LW: Primary data saved (38350 records). [2025-09-14T18:54:13.675374] [INFO ] [MAIN ] LW: Full history saved. [2025-09-14T18:54:13.675486] [INFO ] [MAIN ] Update Progress: 1293/2370 symbols completed. LW took 36.9s. Estimated remaining: 1h 54m 8s. Rate: 9.4 symbols/min [2025-09-14T18:54:13.851808] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:13.868617] [DEBUG] [LOCAL ] LZB: Loaded 16243 existing records from primary storage. [2025-09-14T18:54:13.868797] [INFO ] [MAIN ] LZB: Loaded 16243 existing records. [2025-09-14T18:54:14.045759] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:14.046025] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-14T18:54:14.046085] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-14T18:54:14.046607] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-14T18:54:14.046693] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-14T18:54:14.163945] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-14T18:54:14.416337] [INFO ] [REMOTE ] LZB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:14.629999] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T18:54:14.958851] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-14T18:54:15.758909] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-14T18:54:15.852756] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-14T18:54:16.558893] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-14T18:54:17.017024] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T18:54:17.090618] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:54:17.358876] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-14T18:54:17.628463] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (3.46 seconds). [2025-09-14T18:54:18.158859] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-14T18:54:18.676395] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T18:54:18.835110] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:54:18.958847] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-14T18:54:19.758864] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-14T18:54:20.078231] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T18:54:20.558830] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-14T18:54:20.904352] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:54:21.307120] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:54:21.358887] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-14T18:54:22.158894] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-14T18:54:22.443948] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:54:22.887548] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T18:54:22.958869] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-14T18:54:23.758851] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-14T18:54:24.244537] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T18:54:24.392384] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:54:24.558911] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-14T18:54:25.358871] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-14T18:54:25.609357] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:54:26.158847] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-14T18:54:26.314347] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T18:54:26.958833] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-14T18:54:27.456847] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-14T18:54:27.758865] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-14T18:54:28.558951] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-14T18:54:28.666687] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-14T18:54:28.988906] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T18:54:29.358912] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-14T18:54:29.819816] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T18:54:30.071596] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T18:54:30.158849] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-14T18:54:30.958873] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-14T18:54:31.547286] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-14T18:54:31.758922] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-14T18:54:31.868980] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T18:54:32.558873] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-14T18:54:32.751546] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T18:54:32.889279] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:54:32.894473] [INFO ] [REMOTE ] LZB: Full fetch complete (38859 records). [2025-09-14T18:54:32.894771] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-14T18:54:33.334542] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-14T18:54:33.336930] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T18:54:33.337068] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-14T18:54:33.339206] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-14T18:54:33.345372] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-14T18:54:33.346139] [INFO ] [REMOTE ] LYG: Full fetch complete (57496 records). [2025-09-14T18:54:33.347037] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-14T18:54:33.353504] [DEBUG] [LOCAL ] LZB: Trimmed 38859 records to 26397 (keeping 150 days of data) [2025-09-14T18:54:33.363957] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-14T18:54:33.839346] [DEBUG] [LOCAL ] LZB: Primary data saved (26397 records). [2025-09-14T18:54:33.842811] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-14T18:54:33.848935] [INFO ] [MAIN ] Update Progress: 1294/2370 symbols completed. LZB took 20.2s. Estimated remaining: 1h 54m 14s. Rate: 9.4 symbols/min [2025-09-14T18:54:34.061595] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-14T18:54:34.092051] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-14T18:54:34.107822] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-14T18:54:34.124099] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-14T18:54:34.125584] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:34.128312] [DEBUG] [LOCAL ] LYG: Trimmed 57496 records to 39753 (keeping 150 days of data) [2025-09-14T18:54:34.134291] [DEBUG] [LOCAL ] LZM: Loaded 5194 existing records from primary storage. [2025-09-14T18:54:34.186027] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-14T18:54:34.186394] [INFO ] [MAIN ] LZM: Loaded 5194 existing records. [2025-09-14T18:54:34.448324] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:34.449794] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-14T18:54:34.454808] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-14T18:54:34.455235] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-14T18:54:34.455299] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-14T18:54:34.955171] [INFO ] [REMOTE ] LZM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:34.963305] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-14T18:54:34.963397] [DEBUG] [LOCAL ] LYG: Primary data saved (39753 records). [2025-09-14T18:54:34.964508] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-14T18:54:34.964678] [INFO ] [MAIN ] Update Progress: 1295/2370 symbols completed. LYG took 24.0s. Estimated remaining: 1h 54m 3s. Rate: 9.4 symbols/min [2025-09-14T18:54:35.161080] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:35.191892] [DEBUG] [LOCAL ] M: Loaded 23965 existing records from primary storage. [2025-09-14T18:54:35.192139] [INFO ] [MAIN ] M: Loaded 23965 existing records. [2025-09-14T18:54:35.375208] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:35.375574] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-14T18:54:35.375639] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-14T18:54:35.376563] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-14T18:54:35.376639] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-14T18:54:35.787327] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T18:54:35.786288] [INFO ] [REMOTE ] M: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:35.790594] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-14T18:54:35.845450] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:54:35.882097] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-14T18:54:36.558839] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-14T18:54:36.893101] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T18:54:37.248334] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:54:37.253981] [INFO ] [REMOTE ] LYB: Full fetch complete (58189 records). [2025-09-14T18:54:37.254121] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-14T18:54:37.364062] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-14T18:54:37.639331] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-14T18:54:37.639438] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-14T18:54:37.640346] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-14T18:54:37.640427] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-14T18:54:37.641715] [DEBUG] [LOCAL ] LYB: Trimmed 58189 records to 40365 (keeping 150 days of data) [2025-09-14T18:54:37.969586] [DEBUG] [LOCAL ] LYB: Primary data saved (40365 records). [2025-09-14T18:54:37.969829] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-14T18:54:37.970000] [INFO ] [MAIN ] Update Progress: 1296/2370 symbols completed. LYB took 31.5s. Estimated remaining: 1h 53m 54s. Rate: 9.4 symbols/min [2025-09-14T18:54:38.164109] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-14T18:54:38.242138] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:38.281961] [DEBUG] [LOCAL ] MA: Loaded 23507 existing records from primary storage. [2025-09-14T18:54:38.282298] [INFO ] [MAIN ] MA: Loaded 23507 existing records. [2025-09-14T18:54:38.603828] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:38.604330] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-14T18:54:38.604427] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-14T18:54:38.605342] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-14T18:54:38.605442] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-14T18:54:38.967892] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-14T18:54:39.116601] [INFO ] [REMOTE ] MA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:39.339181] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:54:39.423203] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T18:54:39.739926] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:54:39.745526] [INFO ] [REMOTE ] LYV: Full fetch complete (55920 records). [2025-09-14T18:54:39.745754] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-14T18:54:39.766686] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-14T18:54:40.158294] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-14T18:54:40.158437] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-14T18:54:40.159609] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-14T18:54:40.159702] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-14T18:54:40.161502] [DEBUG] [LOCAL ] LYV: Trimmed 55920 records to 38333 (keeping 150 days of data) [2025-09-14T18:54:40.418295] [DEBUG] [LOCAL ] LYV: Primary data saved (38333 records). [2025-09-14T18:54:40.418561] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-14T18:54:40.418738] [INFO ] [MAIN ] Update Progress: 1297/2370 symbols completed. LYV took 28.2s. Estimated remaining: 1h 53m 44s. Rate: 9.4 symbols/min [2025-09-14T18:54:40.572220] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-14T18:54:40.608699] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:40.633452] [DEBUG] [LOCAL ] MAA: Loaded 19600 existing records from primary storage. [2025-09-14T18:54:40.633715] [INFO ] [MAIN ] MAA: Loaded 19600 existing records. [2025-09-14T18:54:40.839059] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:40.840931] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:54:40.841361] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-14T18:54:40.844197] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-14T18:54:40.845472] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-14T18:54:40.845583] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-14T18:54:41.217706] [INFO ] [REMOTE ] MAA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:41.358918] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-14T18:54:41.515346] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T18:54:42.018541] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:54:42.158853] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-14T18:54:42.958849] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-14T18:54:43.197608] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T18:54:43.758837] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-14T18:54:44.558951] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-14T18:54:44.641942] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:54:45.181066] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-14T18:54:45.358876] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-14T18:54:46.139664] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:54:46.158783] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-14T18:54:46.286605] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:54:46.958869] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-14T18:54:47.056936] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T18:54:47.758839] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-14T18:54:48.558836] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-14T18:54:48.701040] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:54:49.054874] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T18:54:49.358856] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-14T18:54:49.438343] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:54:49.440552] [INFO ] [REMOTE ] LZM: Full fetch complete (13975 records). [2025-09-14T18:54:49.440673] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-14T18:54:49.802688] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-14T18:54:49.802804] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-14T18:54:49.803174] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-14T18:54:49.803241] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-14T18:54:49.803851] [DEBUG] [LOCAL ] LZM: Trimmed 13975 records to 9361 (keeping 150 days of data) [2025-09-14T18:54:49.859909] [DEBUG] [LOCAL ] LZM: Primary data saved (9361 records). [2025-09-14T18:54:49.860083] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-14T18:54:49.860184] [INFO ] [MAIN ] Update Progress: 1298/2370 symbols completed. LZM took 16.0s. Estimated remaining: 1h 53m 40s. Rate: 9.4 symbols/min [2025-09-14T18:54:50.047712] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:50.070420] [DEBUG] [LOCAL ] MAC: Loaded 22074 existing records from primary storage. [2025-09-14T18:54:50.070602] [INFO ] [MAIN ] MAC: Loaded 22074 existing records. [2025-09-14T18:54:50.167704] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-14T18:54:50.261661] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:50.261964] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-14T18:54:50.262044] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-14T18:54:50.262849] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-14T18:54:50.262931] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-14T18:54:50.626053] [INFO ] [REMOTE ] MAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:50.958879] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-14T18:54:51.294305] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T18:54:51.558981] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T18:54:51.758907] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-14T18:54:52.370928] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T18:54:52.558806] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-14T18:54:52.680615] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:54:53.358849] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-14T18:54:54.163898] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-14T18:54:54.181635] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:54:54.958850] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-14T18:54:55.205978] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:54:55.634931] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:54:55.640291] [INFO ] [REMOTE ] MA: Full fetch complete (57208 records). [2025-09-14T18:54:55.640424] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-14T18:54:55.767947] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-14T18:54:56.029569] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-14T18:54:56.029720] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-14T18:54:56.030848] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-14T18:54:56.030978] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-14T18:54:56.055050] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T18:54:56.055189] [DEBUG] [LOCAL ] MA: Trimmed 57208 records to 39448 (keeping 150 days of data) [2025-09-14T18:54:56.323204] [DEBUG] [LOCAL ] MA: Primary data saved (39448 records). [2025-09-14T18:54:56.323454] [INFO ] [MAIN ] MA: Full history saved. [2025-09-14T18:54:56.323592] [INFO ] [MAIN ] Update Progress: 1299/2370 symbols completed. MA took 18.4s. Estimated remaining: 1h 53m 34s. Rate: 9.4 symbols/min [2025-09-14T18:54:56.502610] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:56.520278] [DEBUG] [LOCAL ] MAGN: Loaded 15487 existing records from primary storage. [2025-09-14T18:54:56.520472] [INFO ] [MAIN ] MAGN: Loaded 15487 existing records. [2025-09-14T18:54:56.564089] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-14T18:54:56.709543] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:56.709830] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-14T18:54:56.709904] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-14T18:54:56.710434] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-14T18:54:56.710510] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-14T18:54:57.083980] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:57.358842] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-14T18:54:57.482177] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:54:58.158883] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-14T18:54:58.634301] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T18:54:58.958901] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-14T18:54:59.032152] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:54:59.444793] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T18:54:59.758885] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-14T18:55:00.558840] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-14T18:55:00.817179] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:55:01.358890] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-14T18:55:01.652466] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:55:02.158901] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-14T18:55:02.770153] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T18:55:02.869794] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-14T18:55:02.958879] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-14T18:55:03.758854] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-14T18:55:04.011693] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:55:04.535462] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:55:04.558794] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-14T18:55:05.358831] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-14T18:55:05.503812] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:55:06.058318] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:55:06.064006] [INFO ] [REMOTE ] M: Full fetch complete (58189 records). [2025-09-14T18:55:06.064173] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-14T18:55:06.165516] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-14T18:55:06.448960] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-14T18:55:06.449104] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-14T18:55:06.450260] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-14T18:55:06.450458] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-14T18:55:06.452181] [DEBUG] [LOCAL ] M: Trimmed 58189 records to 40298 (keeping 150 days of data) [2025-09-14T18:55:06.567765] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T18:55:06.741228] [DEBUG] [LOCAL ] M: Primary data saved (40298 records). [2025-09-14T18:55:06.741401] [INFO ] [MAIN ] M: Full history saved. [2025-09-14T18:55:06.741521] [INFO ] [MAIN ] Update Progress: 1300/2370 symbols completed. M took 31.8s. Estimated remaining: 1h 53m 31s. Rate: 9.4 symbols/min [2025-09-14T18:55:06.917902] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:06.936430] [DEBUG] [LOCAL ] MAIN: Loaded 18104 existing records from primary storage. [2025-09-14T18:55:06.936593] [INFO ] [MAIN ] MAIN: Loaded 18104 existing records. [2025-09-14T18:55:06.967715] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-14T18:55:07.116810] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:07.117069] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-14T18:55:07.117131] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-14T18:55:07.117922] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-14T18:55:07.117999] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-14T18:55:07.474558] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:07.758839] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-14T18:55:08.074221] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T18:55:08.558901] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-14T18:55:08.828092] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T18:55:09.358841] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-14T18:55:09.665661] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T18:55:10.158871] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-14T18:55:10.399222] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:55:10.835920] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:55:10.958826] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-14T18:55:11.546877] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:55:11.758873] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-14T18:55:12.558938] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-14T18:55:12.790426] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:55:13.236123] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:55:13.358837] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-14T18:55:14.036751] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:55:14.041254] [INFO ] [REMOTE ] MAA: Full fetch complete (46743 records). [2025-09-14T18:55:14.041384] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-14T18:55:14.163916] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-14T18:55:14.429500] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-14T18:55:14.429687] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-14T18:55:14.430665] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-14T18:55:14.430865] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-14T18:55:14.432220] [DEBUG] [LOCAL ] MAA: Trimmed 46743 records to 32420 (keeping 150 days of data) [2025-09-14T18:55:14.582957] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T18:55:14.685001] [DEBUG] [LOCAL ] MAA: Primary data saved (32420 records). [2025-09-14T18:55:14.685199] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-14T18:55:14.685339] [INFO ] [MAIN ] Update Progress: 1301/2370 symbols completed. MAA took 34.3s. Estimated remaining: 1h 53m 26s. Rate: 9.4 symbols/min [2025-09-14T18:55:14.919732] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:14.947502] [DEBUG] [LOCAL ] MAN: Loaded 19941 existing records from primary storage. [2025-09-14T18:55:14.947740] [INFO ] [MAIN ] MAN: Loaded 19941 existing records. [2025-09-14T18:55:14.969271] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-14T18:55:15.151451] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:15.151860] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-14T18:55:15.151926] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-14T18:55:15.152772] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-14T18:55:15.152869] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-14T18:55:15.554147] [INFO ] [REMOTE ] MAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:15.758830] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-14T18:55:15.943424] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:55:16.474994] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:55:16.481003] [INFO ] [REMOTE ] MAC: Full fetch complete (53886 records). [2025-09-14T18:55:16.481119] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-14T18:55:16.563904] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-14T18:55:16.866442] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-14T18:55:16.866556] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-14T18:55:16.867523] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-14T18:55:16.867593] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-14T18:55:16.868784] [DEBUG] [LOCAL ] MAC: Trimmed 53886 records to 37163 (keeping 150 days of data) [2025-09-14T18:55:17.004308] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T18:55:17.177922] [DEBUG] [LOCAL ] MAC: Primary data saved (37163 records). [2025-09-14T18:55:17.178133] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-14T18:55:17.178254] [INFO ] [MAIN ] Update Progress: 1302/2370 symbols completed. MAC took 27.3s. Estimated remaining: 1h 53m 16s. Rate: 9.4 symbols/min [2025-09-14T18:55:17.359190] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-14T18:55:17.360587] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:17.375016] [DEBUG] [LOCAL ] MANU: Loaded 12034 existing records from primary storage. [2025-09-14T18:55:17.375247] [INFO ] [MAIN ] MANU: Loaded 12034 existing records. [2025-09-14T18:55:17.560509] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:17.560766] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-14T18:55:17.560843] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-14T18:55:17.561219] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-14T18:55:17.561281] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-14T18:55:17.928963] [INFO ] [REMOTE ] MANU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:18.023598] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T18:55:18.158825] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-14T18:55:18.558001] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T18:55:18.958777] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-14T18:55:19.305683] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T18:55:19.309435] [INFO ] [REMOTE ] MAGN: Full fetch complete (38423 records). [2025-09-14T18:55:19.309565] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-14T18:55:19.679683] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-14T18:55:19.679806] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-14T18:55:19.680613] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-14T18:55:19.680701] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-14T18:55:19.681752] [DEBUG] [LOCAL ] MAGN: Trimmed 38423 records to 26412 (keeping 150 days of data) [2025-09-14T18:55:19.777955] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-14T18:55:19.852205] [DEBUG] [LOCAL ] MAGN: Primary data saved (26412 records). [2025-09-14T18:55:19.852384] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-14T18:55:19.852576] [INFO ] [MAIN ] Update Progress: 1303/2370 symbols completed. MAGN took 23.5s. Estimated remaining: 1h 53m 7s. Rate: 9.4 symbols/min [2025-09-14T18:55:20.021086] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:20.043042] [DEBUG] [LOCAL ] MAS: Loaded 23410 existing records from primary storage. [2025-09-14T18:55:20.043200] [INFO ] [MAIN ] MAS: Loaded 23410 existing records. [2025-09-14T18:55:20.221454] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:20.221735] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-14T18:55:20.221809] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-14T18:55:20.222483] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-14T18:55:20.222546] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-14T18:55:20.573913] [INFO ] [REMOTE ] MAS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:20.573989] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-14T18:55:20.604239] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:55:20.992397] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:55:21.358827] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-14T18:55:22.158833] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-14T18:55:22.194354] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:55:22.809212] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T18:55:22.958840] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-14T18:55:23.721555] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:55:23.758798] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-14T18:55:24.244474] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T18:55:24.558822] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-14T18:55:25.358849] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-14T18:55:25.608028] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:55:26.158831] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-14T18:55:26.331714] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:55:26.775479] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:55:26.958835] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-14T18:55:27.322837] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:55:27.758812] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-14T18:55:28.558869] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-14T18:55:28.684046] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:55:29.310221] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:55:29.358811] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-14T18:55:30.158940] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-14T18:55:30.515240] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T18:55:30.905493] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:55:30.958895] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-14T18:55:31.759539] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-14T18:55:31.890200] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:55:32.558854] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-14T18:55:32.801295] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:55:33.007847] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:55:33.358862] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-14T18:55:34.077579] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:55:34.158836] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-14T18:55:34.877695] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T18:55:34.882668] [INFO ] [REMOTE ] MAIN: Full fetch complete (44992 records). [2025-09-14T18:55:34.882798] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-14T18:55:34.963911] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-14T18:55:35.264264] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-14T18:55:35.264381] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-14T18:55:35.265195] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-14T18:55:35.265255] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-14T18:55:35.266457] [DEBUG] [LOCAL ] MAIN: Trimmed 44992 records to 30873 (keeping 150 days of data) [2025-09-14T18:55:35.480426] [DEBUG] [LOCAL ] MAIN: Primary data saved (30873 records). [2025-09-14T18:55:35.480682] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-14T18:55:35.480929] [INFO ] [MAIN ] Update Progress: 1304/2370 symbols completed. MAIN took 28.7s. Estimated remaining: 1h 53m 8s. Rate: 9.4 symbols/min [2025-09-14T18:55:35.670751] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:35.689016] [DEBUG] [LOCAL ] MATV: Loaded 16017 existing records from primary storage. [2025-09-14T18:55:35.689220] [INFO ] [MAIN ] MATV: Loaded 16017 existing records. [2025-09-14T18:55:35.768459] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-14T18:55:35.891371] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:35.891816] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-14T18:55:35.891951] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-14T18:55:35.892556] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-14T18:55:35.892733] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-14T18:55:36.176874] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T18:55:36.242287] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T18:55:36.261400] [INFO ] [REMOTE ] MANU: Full fetch complete (29367 records). [2025-09-14T18:55:36.295094] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-14T18:55:36.322265] [INFO ] [REMOTE ] MATV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:36.569775] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-14T18:55:36.693228] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-14T18:55:36.693345] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-14T18:55:36.694048] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-14T18:55:36.694119] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-14T18:55:36.695131] [DEBUG] [LOCAL ] MANU: Trimmed 29367 records to 19444 (keeping 150 days of data) [2025-09-14T18:55:36.813563] [DEBUG] [LOCAL ] MANU: Primary data saved (19444 records). [2025-09-14T18:55:36.813752] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-14T18:55:36.813863] [INFO ] [MAIN ] Update Progress: 1305/2370 symbols completed. MANU took 19.6s. Estimated remaining: 1h 52m 58s. Rate: 9.4 symbols/min [2025-09-14T18:55:36.981398] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:36.996822] [DEBUG] [LOCAL ] MATX: Loaded 13407 existing records from primary storage. [2025-09-14T18:55:36.996976] [INFO ] [MAIN ] MATX: Loaded 13407 existing records. [2025-09-14T18:55:37.173069] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:37.173371] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-14T18:55:37.173443] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-14T18:55:37.174184] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-14T18:55:37.174254] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-14T18:55:37.384884] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-14T18:55:37.530683] [INFO ] [REMOTE ] MATX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:37.689082] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T18:55:38.158892] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-14T18:55:38.273444] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T18:55:38.796798] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T18:55:38.958841] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-14T18:55:39.752334] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:55:39.763255] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-14T18:55:40.558851] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-14T18:55:40.709048] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T18:55:41.358919] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-14T18:55:41.448541] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T18:55:42.045792] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:55:42.158831] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-14T18:55:42.871276] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:55:42.877365] [INFO ] [REMOTE ] MAS: Full fetch complete (56788 records). [2025-09-14T18:55:42.877559] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-14T18:55:42.963142] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-14T18:55:43.299357] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-14T18:55:43.299739] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-14T18:55:43.301246] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-14T18:55:43.302960] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:55:43.315711] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-14T18:55:43.318038] [DEBUG] [LOCAL ] MAS: Trimmed 56788 records to 39365 (keeping 150 days of data) [2025-09-14T18:55:43.578432] [DEBUG] [LOCAL ] MAS: Primary data saved (39365 records). [2025-09-14T18:55:43.578620] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-14T18:55:43.578755] [INFO ] [MAIN ] Update Progress: 1306/2370 symbols completed. MAS took 23.7s. Estimated remaining: 1h 52m 52s. Rate: 9.4 symbols/min [2025-09-14T18:55:43.747978] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:43.762292] [DEBUG] [LOCAL ] MAX: Loaded 13410 existing records from primary storage. [2025-09-14T18:55:43.762534] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-14T18:55:43.763042] [INFO ] [MAIN ] MAX: Loaded 13410 existing records. [2025-09-14T18:55:43.955128] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:55:43.960628] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:43.961094] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-14T18:55:43.965623] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-14T18:55:43.966723] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-14T18:55:43.966839] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-14T18:55:43.966997] [INFO ] [REMOTE ] MAN: Full fetch complete (46987 records). [2025-09-14T18:55:44.034961] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-14T18:55:44.587157] [INFO ] [REMOTE ] MAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:44.577100] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-14T18:55:44.698486] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-14T18:55:44.698581] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-14T18:55:44.699431] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-14T18:55:44.699492] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-14T18:55:44.700614] [DEBUG] [LOCAL ] MAN: Trimmed 46987 records to 33038 (keeping 150 days of data) [2025-09-14T18:55:44.917940] [DEBUG] [LOCAL ] MAN: Primary data saved (33038 records). [2025-09-14T18:55:44.918133] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-14T18:55:44.918247] [INFO ] [MAIN ] Update Progress: 1307/2370 symbols completed. MAN took 30.2s. Estimated remaining: 1h 52m 41s. Rate: 9.4 symbols/min [2025-09-14T18:55:45.091914] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:45.111612] [DEBUG] [LOCAL ] MBC: Loaded 19265 existing records from primary storage. [2025-09-14T18:55:45.111809] [INFO ] [MAIN ] MBC: Loaded 19265 existing records. [2025-09-14T18:55:45.294708] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:45.294994] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-14T18:55:45.295061] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-14T18:55:45.295758] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-14T18:55:45.295829] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-14T18:55:45.363980] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-14T18:55:45.703534] [INFO ] [REMOTE ] MBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:45.706911] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T18:55:46.040117] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T18:55:46.158868] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-14T18:55:46.871858] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:55:46.958898] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-14T18:55:47.603885] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T18:55:47.758877] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-14T18:55:48.558853] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-14T18:55:48.618990] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T18:55:49.225179] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:55:49.358786] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-14T18:55:49.596257] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T18:55:50.158879] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-14T18:55:50.913520] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T18:55:50.958805] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-14T18:55:51.401915] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T18:55:51.758883] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-14T18:55:52.295765] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:55:52.558838] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-14T18:55:53.358848] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-14T18:55:53.384895] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:55:54.025508] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:55:54.158811] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-14T18:55:54.872835] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:55:54.958799] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-14T18:55:55.765892] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-14T18:55:55.783985] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:55:56.504175] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:55:56.558811] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-14T18:55:57.200548] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T18:55:57.358888] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-14T18:55:57.936399] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:55:57.939740] [INFO ] [REMOTE ] MATX: Full fetch complete (34308 records). [2025-09-14T18:55:57.939842] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-14T18:55:58.167927] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-14T18:55:58.342479] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T18:55:58.385046] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-14T18:55:58.385210] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-14T18:55:58.386409] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-14T18:55:58.386484] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-14T18:55:58.387939] [DEBUG] [LOCAL ] MATX: Trimmed 34308 records to 24183 (keeping 150 days of data) [2025-09-14T18:55:58.543920] [DEBUG] [LOCAL ] MATX: Primary data saved (24183 records). [2025-09-14T18:55:58.544089] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-14T18:55:58.544260] [INFO ] [MAIN ] Update Progress: 1308/2370 symbols completed. MATX took 21.7s. Estimated remaining: 1h 52m 41s. Rate: 9.4 symbols/min [2025-09-14T18:55:58.738925] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:58.749908] [DEBUG] [LOCAL ] MBI: Loaded 10850 existing records from primary storage. [2025-09-14T18:55:58.750047] [INFO ] [MAIN ] MBI: Loaded 10850 existing records. [2025-09-14T18:55:58.924197] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:58.924617] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-14T18:55:58.924740] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-14T18:55:58.930372] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-14T18:55:58.934510] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-14T18:55:58.963994] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-14T18:55:58.965810] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:55:59.043555] [INFO ] [REMOTE ] MATV: Full fetch complete (41371 records). [2025-09-14T18:55:59.043902] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-14T18:55:59.664448] [INFO ] [REMOTE ] MBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:59.739984] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-14T18:55:59.740118] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-14T18:55:59.740926] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-14T18:55:59.740993] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-14T18:55:59.742233] [DEBUG] [LOCAL ] MATV: Trimmed 41371 records to 27232 (keeping 150 days of data) [2025-09-14T18:55:59.793813] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-14T18:55:59.916988] [DEBUG] [LOCAL ] MATV: Primary data saved (27232 records). [2025-09-14T18:55:59.917184] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-14T18:55:59.917292] [INFO ] [MAIN ] Update Progress: 1309/2370 symbols completed. MATV took 24.4s. Estimated remaining: 1h 52m 30s. Rate: 9.4 symbols/min [2025-09-14T18:56:00.087448] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:00.106545] [DEBUG] [LOCAL ] MC: Loaded 19164 existing records from primary storage. [2025-09-14T18:56:00.106735] [INFO ] [MAIN ] MC: Loaded 19164 existing records. [2025-09-14T18:56:00.280453] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:00.280719] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-14T18:56:00.280781] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-14T18:56:00.281406] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-14T18:56:00.281475] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-14T18:56:00.563976] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-14T18:56:00.645570] [INFO ] [REMOTE ] MC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:00.671466] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:56:01.098908] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T18:56:01.358840] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-14T18:56:01.931089] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:56:02.158858] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-14T18:56:02.194897] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T18:56:02.958847] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-14T18:56:03.758891] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-14T18:56:03.851001] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:56:03.882969] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:56:04.558829] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-14T18:56:04.739288] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T18:56:05.358815] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-14T18:56:05.409198] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:56:06.158877] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-14T18:56:06.876723] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:56:06.958867] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-14T18:56:07.499056] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T18:56:07.758894] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-14T18:56:08.558846] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-14T18:56:08.592727] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:56:09.045816] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T18:56:09.050050] [INFO ] [REMOTE ] MAX: Full fetch complete (33898 records). [2025-09-14T18:56:09.050157] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-14T18:56:09.374077] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-14T18:56:09.421711] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-14T18:56:09.421854] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-14T18:56:09.422637] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-14T18:56:09.422863] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-14T18:56:09.423943] [DEBUG] [LOCAL ] MAX: Trimmed 33898 records to 22509 (keeping 150 days of data) [2025-09-14T18:56:09.560694] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T18:56:09.601290] [DEBUG] [LOCAL ] MAX: Primary data saved (22509 records). [2025-09-14T18:56:09.601544] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-14T18:56:09.601712] [INFO ] [MAIN ] Update Progress: 1310/2370 symbols completed. MAX took 26.0s. Estimated remaining: 1h 52m 27s. Rate: 9.4 symbols/min [2025-09-14T18:56:09.803581] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:09.811633] [DEBUG] [LOCAL ] MCB: Loaded 4768 existing records from primary storage. [2025-09-14T18:56:09.811891] [INFO ] [MAIN ] MCB: Loaded 4768 existing records. [2025-09-14T18:56:09.999145] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:09.999506] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-14T18:56:09.999567] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-14T18:56:09.999882] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-14T18:56:09.999948] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-14T18:56:10.161262] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-14T18:56:10.362156] [INFO ] [REMOTE ] MCB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:10.958871] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-14T18:56:11.029297] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:56:11.758857] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-14T18:56:11.869452] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:56:11.958519] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T18:56:12.425718] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:56:12.430693] [INFO ] [REMOTE ] MBC: Full fetch complete (46727 records). [2025-09-14T18:56:12.430920] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-14T18:56:12.572240] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-14T18:56:12.813608] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-14T18:56:12.813786] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-14T18:56:12.814559] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-14T18:56:12.814613] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-14T18:56:12.815669] [DEBUG] [LOCAL ] MBC: Trimmed 46727 records to 32070 (keeping 150 days of data) [2025-09-14T18:56:13.017586] [DEBUG] [LOCAL ] MBC: Primary data saved (32070 records). [2025-09-14T18:56:13.017764] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-14T18:56:13.017865] [INFO ] [MAIN ] Update Progress: 1311/2370 symbols completed. MBC took 28.1s. Estimated remaining: 1h 52m 18s. Rate: 9.4 symbols/min [2025-09-14T18:56:13.189027] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:13.213598] [DEBUG] [LOCAL ] MCD: Loaded 24009 existing records from primary storage. [2025-09-14T18:56:13.213820] [INFO ] [MAIN ] MCD: Loaded 24009 existing records. [2025-09-14T18:56:13.364095] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-14T18:56:13.401956] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:13.402467] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-14T18:56:13.402536] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-14T18:56:13.403390] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-14T18:56:13.403458] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-14T18:56:13.761592] [INFO ] [REMOTE ] MCD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:13.788210] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T18:56:14.158861] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-14T18:56:14.432958] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:56:14.958792] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-14T18:56:15.127038] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T18:56:15.758838] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-14T18:56:15.949164] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T18:56:16.558832] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-14T18:56:16.594226] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:56:17.358834] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-14T18:56:17.529689] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T18:56:18.158794] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-14T18:56:18.471391] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:56:18.958841] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-14T18:56:19.020274] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T18:56:19.758809] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-14T18:56:19.836591] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T18:56:20.558847] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-14T18:56:21.146658] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:56:21.150694] [INFO ] [REMOTE ] MC: Full fetch complete (48381 records). [2025-09-14T18:56:21.150838] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-14T18:56:21.365743] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-14T18:56:21.557255] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:56:21.557428] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-14T18:56:21.563858] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-14T18:56:21.565065] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-14T18:56:21.565137] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-14T18:56:21.566467] [DEBUG] [LOCAL ] MC: Trimmed 48381 records to 33022 (keeping 150 days of data) [2025-09-14T18:56:21.767608] [DEBUG] [LOCAL ] MC: Primary data saved (33022 records). [2025-09-14T18:56:21.767788] [INFO ] [MAIN ] MC: Full history saved. [2025-09-14T18:56:21.767888] [INFO ] [MAIN ] Update Progress: 1312/2370 symbols completed. MC took 21.9s. Estimated remaining: 1h 52m 14s. Rate: 9.4 symbols/min [2025-09-14T18:56:21.935939] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:21.940466] [DEBUG] [LOCAL ] MCI: Loaded 2406 existing records from primary storage. [2025-09-14T18:56:21.940575] [INFO ] [MAIN ] MCI: Loaded 2406 existing records. [2025-09-14T18:56:22.148908] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:22.150545] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-14T18:56:22.150626] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-14T18:56:22.151821] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-14T18:56:22.151893] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-14T18:56:22.164230] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-14T18:56:22.523177] [INFO ] [REMOTE ] MCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:22.532415] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:56:22.958836] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-14T18:56:23.229373] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:56:23.758843] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-14T18:56:23.998274] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T18:56:24.487217] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T18:56:24.558870] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-14T18:56:25.358819] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-14T18:56:25.653845] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:56:25.656605] [INFO ] [REMOTE ] MBI: Full fetch complete (27267 records). [2025-09-14T18:56:25.656713] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-14T18:56:26.035181] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-14T18:56:26.035360] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-14T18:56:26.036124] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-14T18:56:26.036251] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-14T18:56:26.044081] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T18:56:26.047044] [DEBUG] [LOCAL ] MBI: Trimmed 27267 records to 17956 (keeping 150 days of data) [2025-09-14T18:56:26.147974] [DEBUG] [LOCAL ] MBI: Primary data saved (17956 records). [2025-09-14T18:56:26.148170] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-14T18:56:26.148309] [INFO ] [MAIN ] Update Progress: 1313/2370 symbols completed. MBI took 27.6s. Estimated remaining: 1h 52m 6s. Rate: 9.4 symbols/min [2025-09-14T18:56:26.168989] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-14T18:56:26.319726] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:26.336340] [DEBUG] [LOCAL ] MCK: Loaded 16306 existing records from primary storage. [2025-09-14T18:56:26.336516] [INFO ] [MAIN ] MCK: Loaded 16306 existing records. [2025-09-14T18:56:26.532115] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:26.532414] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-14T18:56:26.532475] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-14T18:56:26.533109] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-14T18:56:26.533172] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-14T18:56:26.900690] [INFO ] [REMOTE ] MCK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:26.958770] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-14T18:56:27.077863] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T18:56:27.758889] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-14T18:56:28.558836] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-14T18:56:28.615691] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T18:56:28.754799] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:56:29.358838] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-14T18:56:29.372405] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T18:56:30.158865] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-14T18:56:30.196838] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:56:30.849338] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T18:56:30.958849] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-14T18:56:31.758874] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-14T18:56:31.814542] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:56:32.558825] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-14T18:56:32.696074] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T18:56:33.358856] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-14T18:56:34.158801] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-14T18:56:34.282333] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:56:34.329313] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:56:34.743586] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T18:56:34.958892] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-14T18:56:35.694429] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:56:35.696062] [INFO ] [REMOTE ] MCB: Full fetch complete (12503 records). [2025-09-14T18:56:35.696149] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-14T18:56:35.764157] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-14T18:56:36.057679] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-14T18:56:36.057827] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-14T18:56:36.058258] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-14T18:56:36.058331] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-14T18:56:36.058911] [DEBUG] [LOCAL ] MCB: Trimmed 12503 records to 8245 (keeping 150 days of data) [2025-09-14T18:56:36.109481] [DEBUG] [LOCAL ] MCB: Primary data saved (8245 records). [2025-09-14T18:56:36.109684] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-14T18:56:36.109811] [INFO ] [MAIN ] Update Progress: 1314/2370 symbols completed. MCB took 26.5s. Estimated remaining: 1h 52m 2s. Rate: 9.4 symbols/min [2025-09-14T18:56:36.279617] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:36.284994] [DEBUG] [LOCAL ] MCN: Loaded 3513 existing records from primary storage. [2025-09-14T18:56:36.285181] [INFO ] [MAIN ] MCN: Loaded 3513 existing records. [2025-09-14T18:56:36.460597] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:36.460917] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-14T18:56:36.460989] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-14T18:56:36.461298] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-14T18:56:36.461377] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-14T18:56:36.562872] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-14T18:56:36.827804] [INFO ] [REMOTE ] MCN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:36.842150] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T18:56:36.847922] [INFO ] [REMOTE ] MCD: Full fetch complete (58137 records). [2025-09-14T18:56:36.848066] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-14T18:56:37.236598] [DEBUG] [VALIDATOR ] MCD: All expected trading days are present. [2025-09-14T18:56:37.236755] [DEBUG] [VALIDATOR ] MCD: Primary data validation passed. [2025-09-14T18:56:37.237763] [INFO ] [MAIN ] MCD: Fetched primary data is valid. [2025-09-14T18:56:37.237824] [DEBUG] [LOCAL ] MCD: Saving primary data. [2025-09-14T18:56:37.239358] [DEBUG] [LOCAL ] MCD: Trimmed 58137 records to 40241 (keeping 150 days of data) [2025-09-14T18:56:37.361880] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-14T18:56:37.483480] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T18:56:37.535089] [DEBUG] [LOCAL ] MCD: Primary data saved (40241 records). [2025-09-14T18:56:37.535282] [INFO ] [MAIN ] MCD: Full history saved. [2025-09-14T18:56:37.535384] [INFO ] [MAIN ] Update Progress: 1315/2370 symbols completed. MCD took 24.5s. Estimated remaining: 1h 51m 52s. Rate: 9.4 symbols/min [2025-09-14T18:56:37.707048] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:37.724304] [DEBUG] [LOCAL ] MCO: Loaded 16749 existing records from primary storage. [2025-09-14T18:56:37.724466] [INFO ] [MAIN ] MCO: Loaded 16749 existing records. [2025-09-14T18:56:37.899231] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:37.899510] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-14T18:56:37.899582] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-14T18:56:37.900147] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-14T18:56:37.900210] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-14T18:56:38.166481] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-14T18:56:38.253054] [INFO ] [REMOTE ] MCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:38.347952] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T18:56:38.888016] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T18:56:38.958788] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-14T18:56:39.599331] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T18:56:39.758849] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-14T18:56:40.360408] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:56:40.361964] [INFO ] [REMOTE ] MCI: Full fetch complete (7519 records). [2025-09-14T18:56:40.362056] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-14T18:56:40.566476] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-14T18:56:40.747512] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-14T18:56:40.747667] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-14T18:56:40.747968] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-14T18:56:40.748028] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-14T18:56:40.748696] [DEBUG] [LOCAL ] MCI: Trimmed 7519 records to 4648 (keeping 150 days of data) [2025-09-14T18:56:40.778618] [DEBUG] [LOCAL ] MCI: Primary data saved (4648 records). [2025-09-14T18:56:40.778808] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-14T18:56:40.778938] [INFO ] [MAIN ] Update Progress: 1316/2370 symbols completed. MCI took 19.0s. Estimated remaining: 1h 51m 43s. Rate: 9.4 symbols/min [2025-09-14T18:56:40.948454] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:40.954512] [DEBUG] [LOCAL ] MCR: Loaded 4125 existing records from primary storage. [2025-09-14T18:56:40.954691] [INFO ] [MAIN ] MCR: Loaded 4125 existing records. [2025-09-14T18:56:41.129481] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:41.129792] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-14T18:56:41.129854] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-14T18:56:41.130225] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-14T18:56:41.130285] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-14T18:56:41.367908] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-14T18:56:41.488722] [INFO ] [REMOTE ] MCR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:42.158934] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-14T18:56:42.329221] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:56:42.958862] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-14T18:56:42.991336] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:56:43.077748] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:56:43.758885] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-14T18:56:44.558872] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-14T18:56:44.820626] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T18:56:45.362186] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-14T18:56:45.364739] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T18:56:45.571234] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:56:46.158859] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-14T18:56:46.167312] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T18:56:46.958901] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-14T18:56:47.685121] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T18:56:47.758843] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-14T18:56:47.854623] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T18:56:48.558833] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-14T18:56:49.358924] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-14T18:56:49.708690] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:56:50.080115] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T18:56:50.158788] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-14T18:56:50.220971] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:56:50.958918] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-14T18:56:51.758867] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-14T18:56:51.795032] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:56:51.915013] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T18:56:52.558861] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-14T18:56:53.232803] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:56:53.241142] [INFO ] [REMOTE ] MCK: Full fetch complete (43211 records). [2025-09-14T18:56:53.241397] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-14T18:56:53.359940] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-14T18:56:53.620765] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-14T18:56:53.620981] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-14T18:56:53.621877] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-14T18:56:53.622024] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-14T18:56:53.643255] [DEBUG] [LOCAL ] MCK: Trimmed 43211 records to 28906 (keeping 150 days of data) [2025-09-14T18:56:53.644141] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:56:53.852220] [DEBUG] [LOCAL ] MCK: Primary data saved (28906 records). [2025-09-14T18:56:53.852408] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-14T18:56:53.852565] [INFO ] [MAIN ] Update Progress: 1317/2370 symbols completed. MCK took 27.7s. Estimated remaining: 1h 51m 42s. Rate: 9.4 symbols/min [2025-09-14T18:56:54.158842] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-14T18:56:54.252232] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T18:56:54.958879] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-14T18:56:55.014339] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:56:55.724238] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T18:56:55.758769] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-14T18:56:56.519704] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T18:56:56.558783] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-14T18:56:57.160922] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:56:57.162134] [INFO ] [REMOTE ] MCN: Full fetch complete (8900 records). [2025-09-14T18:56:57.162218] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-14T18:56:57.371035] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-14T18:56:57.517822] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-14T18:56:57.517921] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-14T18:56:57.518149] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-14T18:56:57.518201] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-14T18:56:57.518691] [DEBUG] [LOCAL ] MCN: Trimmed 8900 records to 6090 (keeping 150 days of data) [2025-09-14T18:56:57.554121] [DEBUG] [LOCAL ] MCN: Primary data saved (6090 records). [2025-09-14T18:56:57.554215] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-14T18:56:57.554315] [INFO ] [MAIN ] Update Progress: 1318/2370 symbols completed. MCN took 21.4s. Estimated remaining: 1h 51m 33s. Rate: 9.4 symbols/min [2025-09-14T18:56:58.158874] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-14T18:56:58.984125] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:56:58.986871] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-14T18:56:59.008302] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:56:59.758824] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-14T18:56:59.825595] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T18:57:00.558830] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-14T18:57:01.648590] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:57:01.657752] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-14T18:57:02.001787] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:57:02.158881] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-14T18:57:04.149567] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-14T18:57:04.150948] [INFO ] [REMOTE ] MCR: Full fetch complete (9830 records). [2025-09-14T18:57:04.151044] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-14T18:57:04.522935] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-14T18:57:04.523152] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-14T18:57:04.523504] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-14T18:57:04.523587] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-14T18:57:04.524198] [DEBUG] [LOCAL ] MCR: Trimmed 9830 records to 6717 (keeping 150 days of data) [2025-09-14T18:57:04.582631] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-14T18:57:04.584670] [DEBUG] [LOCAL ] MCR: Primary data saved (6717 records). [2025-09-14T18:57:04.592143] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-14T18:57:04.592521] [INFO ] [MAIN ] Update Progress: 1319/2370 symbols completed. MCR took 23.8s. Estimated remaining: 1h 51m 28s. Rate: 9.4 symbols/min [2025-09-14T18:57:04.593159] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-14T18:57:06.227029] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T18:57:06.231175] [INFO ] [REMOTE ] MCO: Full fetch complete (43682 records). [2025-09-14T18:57:06.231283] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-14T18:57:06.602606] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-14T18:57:06.602734] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-14T18:57:06.603497] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-14T18:57:06.603552] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-14T18:57:06.604619] [DEBUG] [LOCAL ] MCO: Trimmed 43682 records to 28401 (keeping 150 days of data) [2025-09-14T18:57:06.801262] [DEBUG] [LOCAL ] MCO: Primary data saved (28401 records). [2025-09-14T18:57:06.801454] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-14T18:57:06.801592] [INFO ] [MAIN ] Update Progress: 1320/2370 symbols completed. MCO took 29.3s. Estimated remaining: 1h 51m 18s. Rate: 9.4 symbols/min [2025-09-14T18:57:07.451939] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:07.483914] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:07.453676] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:07.534886] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:07.542975] [DEBUG] [LOCAL ] MDST: Loaded 2815 existing records from primary storage. [2025-09-14T18:57:07.546108] [INFO ] [MAIN ] MDST: Loaded 2815 existing records. [2025-09-14T18:57:07.641293] [DEBUG] [LOCAL ] MCS: Loaded 9960 existing records from primary storage. [2025-09-14T18:57:07.657044] [DEBUG] [LOCAL ] MCY: Loaded 10095 existing records from primary storage. [2025-09-14T18:57:07.669286] [INFO ] [MAIN ] MCS: Loaded 9960 existing records. [2025-09-14T18:57:07.657745] [DEBUG] [LOCAL ] MD: Loaded 17246 existing records from primary storage. [2025-09-14T18:57:07.683532] [INFO ] [MAIN ] MCY: Loaded 10095 existing records. [2025-09-14T18:57:07.740817] [INFO ] [MAIN ] MD: Loaded 17246 existing records. [2025-09-14T18:57:07.952882] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:08.056622] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-14T18:57:08.101709] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-14T18:57:08.117222] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-14T18:57:08.172578] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-14T18:57:08.276226] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:08.348961] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-14T18:57:08.349224] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-14T18:57:08.328006] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:08.349137] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:08.408342] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-14T18:57:08.407755] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-14T18:57:08.408152] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-14T18:57:08.408816] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-14T18:57:08.408933] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-14T18:57:08.419448] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-14T18:57:08.484180] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-14T18:57:08.525949] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-14T18:57:08.531234] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-14T18:57:08.668901] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-14T18:57:09.180146] [INFO ] [REMOTE ] MDST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:09.212087] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-14T18:57:09.493003] [INFO ] [REMOTE ] MCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:09.553782] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-14T18:57:09.731590] [INFO ] [REMOTE ] MD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:09.769573] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-14T18:57:09.797510] [INFO ] [REMOTE ] MCY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:09.797938] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-14T18:57:10.442565] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T18:57:10.444561] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-14T18:57:10.789004] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:57:10.793497] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-14T18:57:10.996056] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T18:57:10.998369] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-14T18:57:11.311446] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:57:11.319591] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-14T18:57:11.347978] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:57:11.355464] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-14T18:57:11.514767] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T18:57:11.516588] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-14T18:57:11.677670] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:57:11.758809] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-14T18:57:12.155230] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T18:57:12.558860] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-14T18:57:12.828580] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:57:12.850074] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:57:12.996123] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T18:57:13.011665] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T18:57:13.358847] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-14T18:57:14.158858] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-14T18:57:14.958854] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-14T18:57:15.389125] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T18:57:15.758875] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-14T18:57:16.209440] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T18:57:16.557564] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-14T18:57:16.561923] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-14T18:57:17.358881] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-14T18:57:17.470871] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:57:17.976335] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:57:18.158872] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-14T18:57:18.753015] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:57:18.892447] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T18:57:18.958841] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-14T18:57:19.555829] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:57:19.557095] [INFO ] [REMOTE ] MDST: Full fetch complete (5950 records). [2025-09-14T18:57:19.557180] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-14T18:57:19.768962] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-14T18:57:19.925198] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-14T18:57:19.925319] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-14T18:57:19.925513] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-14T18:57:19.925621] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-14T18:57:19.926135] [DEBUG] [LOCAL ] MDST: Trimmed 5950 records to 4014 (keeping 150 days of data) [2025-09-14T18:57:19.953146] [DEBUG] [LOCAL ] MDST: Primary data saved (4014 records). [2025-09-14T18:57:19.953305] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-14T18:57:19.953441] [INFO ] [MAIN ] Update Progress: 1321/2370 symbols completed. MDST took 13.2s. Estimated remaining: 1h 51m 17s. Rate: 9.4 symbols/min [2025-09-14T18:57:20.134116] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:20.157548] [DEBUG] [LOCAL ] MDT: Loaded 24089 existing records from primary storage. [2025-09-14T18:57:20.157750] [INFO ] [MAIN ] MDT: Loaded 24089 existing records. [2025-09-14T18:57:20.344952] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:20.345256] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-14T18:57:20.345319] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-14T18:57:20.346117] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-14T18:57:20.346193] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-14T18:57:20.564134] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-14T18:57:20.710096] [INFO ] [REMOTE ] MDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:21.115971] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:57:21.358831] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-14T18:57:21.631974] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:57:22.158864] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-14T18:57:22.897333] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T18:57:22.958794] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-14T18:57:23.698221] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:57:23.758835] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-14T18:57:23.957617] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T18:57:23.960285] [INFO ] [REMOTE ] MCS: Full fetch complete (23293 records). [2025-09-14T18:57:23.960402] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-14T18:57:24.336610] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-14T18:57:24.336742] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-14T18:57:24.337280] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-14T18:57:24.337339] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-14T18:57:24.338046] [DEBUG] [LOCAL ] MCS: Trimmed 23293 records to 15625 (keeping 150 days of data) [2025-09-14T18:57:24.452220] [DEBUG] [LOCAL ] MCS: Primary data saved (15625 records). [2025-09-14T18:57:24.452610] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-14T18:57:24.452840] [INFO ] [MAIN ] Update Progress: 1322/2370 symbols completed. MCS took 17.7s. Estimated remaining: 1h 51m 9s. Rate: 9.4 symbols/min [2025-09-14T18:57:24.560004] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-14T18:57:24.660455] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:24.684892] [DEBUG] [LOCAL ] MDU: Loaded 21338 existing records from primary storage. [2025-09-14T18:57:24.685181] [INFO ] [MAIN ] MDU: Loaded 21338 existing records. [2025-09-14T18:57:24.877745] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:24.878103] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-14T18:57:24.878171] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-14T18:57:24.878881] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-14T18:57:24.878954] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-14T18:57:25.255956] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T18:57:25.283303] [INFO ] [REMOTE ] MDU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:25.358810] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-14T18:57:25.915167] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:57:25.917677] [INFO ] [REMOTE ] MCY: Full fetch complete (29779 records). [2025-09-14T18:57:25.917786] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-14T18:57:26.167340] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-14T18:57:26.321833] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-14T18:57:26.322018] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-14T18:57:26.323471] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-14T18:57:26.323617] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-14T18:57:26.353349] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:57:26.353539] [DEBUG] [LOCAL ] MCY: Trimmed 29779 records to 17957 (keeping 150 days of data) [2025-09-14T18:57:26.494408] [DEBUG] [LOCAL ] MCY: Primary data saved (17957 records). [2025-09-14T18:57:26.494770] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-14T18:57:26.494991] [INFO ] [MAIN ] Update Progress: 1323/2370 symbols completed. MCY took 19.7s. Estimated remaining: 1h 50m 59s. Rate: 9.4 symbols/min [2025-09-14T18:57:26.679522] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:26.687738] [DEBUG] [LOCAL ] MDV: Loaded 3815 existing records from primary storage. [2025-09-14T18:57:26.687949] [INFO ] [MAIN ] MDV: Loaded 3815 existing records. [2025-09-14T18:57:26.877765] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:26.878135] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-14T18:57:26.878207] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-14T18:57:26.878546] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-14T18:57:26.878617] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-14T18:57:26.964016] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-14T18:57:27.246783] [INFO ] [REMOTE ] MDV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:27.758832] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-14T18:57:28.286600] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-14T18:57:28.513808] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T18:57:28.558821] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-14T18:57:28.862448] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T18:57:29.247449] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T18:57:29.358888] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-14T18:57:30.158900] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-14T18:57:30.297449] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T18:57:30.958878] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-14T18:57:31.740336] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T18:57:31.758769] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-14T18:57:32.558805] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-14T18:57:33.064743] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:57:33.360149] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-14T18:57:33.377171] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:57:33.378778] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T18:57:34.158859] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-14T18:57:34.958912] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-14T18:57:35.028620] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:57:35.579994] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T18:57:35.758935] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-14T18:57:36.558890] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-14T18:57:36.626253] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:57:37.358879] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-14T18:57:37.940197] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T18:57:38.158908] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-14T18:57:38.188075] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:57:38.232570] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T18:57:38.958869] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-14T18:57:39.665988] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:57:39.670265] [INFO ] [REMOTE ] MD: Full fetch complete (42105 records). [2025-09-14T18:57:39.670406] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-14T18:57:39.762959] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-14T18:57:40.060531] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-14T18:57:40.060742] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-14T18:57:40.061801] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-14T18:57:40.061880] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-14T18:57:40.091160] [DEBUG] [LOCAL ] MD: Trimmed 42105 records to 29282 (keeping 150 days of data) [2025-09-14T18:57:40.092311] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-14T18:57:40.286093] [DEBUG] [LOCAL ] MD: Primary data saved (29282 records). [2025-09-14T18:57:40.286273] [INFO ] [MAIN ] MD: Full history saved. [2025-09-14T18:57:40.286443] [INFO ] [MAIN ] Update Progress: 1324/2370 symbols completed. MD took 33.5s. Estimated remaining: 1h 50m 59s. Rate: 9.4 symbols/min [2025-09-14T18:57:40.471681] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:40.481242] [DEBUG] [LOCAL ] MEC: Loaded 7311 existing records from primary storage. [2025-09-14T18:57:40.481407] [INFO ] [MAIN ] MEC: Loaded 7311 existing records. [2025-09-14T18:57:40.564112] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-14T18:57:40.671467] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:40.672040] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-14T18:57:40.678780] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-14T18:57:40.679050] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:57:40.681364] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-14T18:57:40.682100] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-14T18:57:41.051600] [INFO ] [REMOTE ] MEC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:41.358898] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-14T18:57:42.158856] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-14T18:57:42.212287] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T18:57:42.501939] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T18:57:42.748264] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:57:42.750676] [INFO ] [REMOTE ] MDV: Full fetch complete (9362 records). [2025-09-14T18:57:42.750941] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-14T18:57:42.964029] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-14T18:57:43.121297] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-14T18:57:43.121444] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-14T18:57:43.121873] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-14T18:57:43.121952] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-14T18:57:43.122570] [DEBUG] [LOCAL ] MDV: Trimmed 9362 records to 6596 (keeping 150 days of data) [2025-09-14T18:57:43.163806] [DEBUG] [LOCAL ] MDV: Primary data saved (6596 records). [2025-09-14T18:57:43.163986] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-14T18:57:43.164147] [INFO ] [MAIN ] Update Progress: 1325/2370 symbols completed. MDV took 16.7s. Estimated remaining: 1h 50m 50s. Rate: 9.4 symbols/min [2025-09-14T18:57:43.332035] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:43.342995] [DEBUG] [LOCAL ] MED: Loaded 9439 existing records from primary storage. [2025-09-14T18:57:43.343155] [INFO ] [MAIN ] MED: Loaded 9439 existing records. [2025-09-14T18:57:43.517634] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:43.517956] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-14T18:57:43.518053] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-14T18:57:43.518535] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-14T18:57:43.518610] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-14T18:57:43.767144] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-14T18:57:43.903968] [INFO ] [REMOTE ] MED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:44.558810] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-14T18:57:44.866491] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T18:57:45.162743] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-14T18:57:45.358836] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-14T18:57:45.701314] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:57:46.058914] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:57:46.064407] [INFO ] [REMOTE ] MDT: Full fetch complete (58357 records). [2025-09-14T18:57:46.064619] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-14T18:57:46.166573] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-14T18:57:46.451003] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-14T18:57:46.451151] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-14T18:57:46.452139] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-14T18:57:46.452199] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-14T18:57:46.453666] [DEBUG] [LOCAL ] MDT: Trimmed 58357 records to 40418 (keeping 150 days of data) [2025-09-14T18:57:46.737941] [DEBUG] [LOCAL ] MDT: Primary data saved (40418 records). [2025-09-14T18:57:46.738093] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-14T18:57:46.738211] [INFO ] [MAIN ] Update Progress: 1326/2370 symbols completed. MDT took 26.8s. Estimated remaining: 1h 50m 41s. Rate: 9.4 symbols/min [2025-09-14T18:57:46.905841] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:46.920952] [DEBUG] [LOCAL ] MEG: Loaded 13436 existing records from primary storage. [2025-09-14T18:57:46.921110] [INFO ] [MAIN ] MEG: Loaded 13436 existing records. [2025-09-14T18:57:46.967543] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-14T18:57:47.110748] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:47.111052] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-14T18:57:47.111118] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-14T18:57:47.111619] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-14T18:57:47.111713] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-14T18:57:47.459500] [INFO ] [REMOTE ] MEG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:47.758868] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-14T18:57:47.836999] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:57:47.897681] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T18:57:48.558854] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-14T18:57:49.245695] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:57:49.358862] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-14T18:57:49.536479] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T18:57:50.158901] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-14T18:57:50.635616] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T18:57:50.958834] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-14T18:57:51.758878] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-14T18:57:51.913940] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T18:57:51.976386] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T18:57:52.558834] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-14T18:57:53.274918] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:57:53.358833] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-14T18:57:53.990032] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T18:57:54.158820] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-14T18:57:54.868778] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:57:54.888141] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:57:54.958860] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-14T18:57:55.758823] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-14T18:57:56.068092] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T18:57:56.558852] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-14T18:57:56.794022] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T18:57:57.358867] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-14T18:57:57.611490] [DEBUG] [REMOTE ] MEG: Error fetching primary data for 2025-05: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-09-14T18:57:57.611713] [WARN ] [REMOTE ] MEG: No data returned for month 2025-05 [2025-09-14T18:57:58.158855] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-14T18:57:58.670699] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:57:58.958882] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-14T18:57:59.758916] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-14T18:57:59.970193] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:58:00.021313] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:58:00.558893] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-14T18:58:01.053258] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:58:01.358798] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-14T18:58:02.158858] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-14T18:58:02.172755] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:58:02.941090] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T18:58:02.958832] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-14T18:58:03.014961] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:58:03.758851] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-14T18:58:04.558845] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-14T18:58:04.730586] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T18:58:04.734089] [INFO ] [REMOTE ] MED: Full fetch complete (24545 records). [2025-09-14T18:58:04.734236] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-14T18:58:05.116556] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-14T18:58:05.116789] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-14T18:58:05.117350] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-14T18:58:05.117420] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-14T18:58:05.118471] [DEBUG] [LOCAL ] MED: Trimmed 24545 records to 16010 (keeping 150 days of data) [2025-09-14T18:58:05.228433] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-14T18:58:05.266361] [DEBUG] [LOCAL ] MED: Primary data saved (16010 records). [2025-09-14T18:58:05.266574] [INFO ] [MAIN ] MED: Full history saved. [2025-09-14T18:58:05.266715] [INFO ] [MAIN ] Update Progress: 1327/2370 symbols completed. MED took 22.1s. Estimated remaining: 1h 50m 44s. Rate: 9.4 symbols/min [2025-09-14T18:58:05.364168] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-14T18:58:05.438824] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:05.450827] [DEBUG] [LOCAL ] MEGI: Loaded 9860 existing records from primary storage. [2025-09-14T18:58:05.450998] [INFO ] [MAIN ] MEGI: Loaded 9860 existing records. [2025-09-14T18:58:05.584504] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:58:05.636930] [INFO ] [REMOTE ] MEC: Full fetch complete (17378 records). [2025-09-14T18:58:05.640540] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:05.640826] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-14T18:58:05.641491] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-14T18:58:05.641579] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-14T18:58:05.642076] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-14T18:58:05.675397] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-14T18:58:06.168914] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-14T18:58:06.422323] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-14T18:58:06.425615] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:06.426131] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-14T18:58:06.427111] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-14T18:58:06.427182] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-14T18:58:06.428472] [DEBUG] [LOCAL ] MEC: Trimmed 17378 records to 12468 (keeping 150 days of data) [2025-09-14T18:58:06.506622] [DEBUG] [LOCAL ] MEC: Primary data saved (12468 records). [2025-09-14T18:58:06.506855] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-14T18:58:06.506973] [INFO ] [MAIN ] Update Progress: 1328/2370 symbols completed. MEC took 26.2s. Estimated remaining: 1h 50m 34s. Rate: 9.4 symbols/min [2025-09-14T18:58:06.682119] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:06.698628] [DEBUG] [LOCAL ] MEI: Loaded 15302 existing records from primary storage. [2025-09-14T18:58:06.698860] [INFO ] [MAIN ] MEI: Loaded 15302 existing records. [2025-09-14T18:58:06.880669] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:06.880956] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-14T18:58:06.881019] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-14T18:58:06.881592] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-14T18:58:06.881682] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-14T18:58:06.961899] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-14T18:58:07.189135] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:58:07.265367] [INFO ] [REMOTE ] MDU: Full fetch complete (52289 records). [2025-09-14T18:58:07.269543] [INFO ] [REMOTE ] MEI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:07.279671] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-14T18:58:07.363533] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T18:58:07.710389] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-14T18:58:07.710551] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-14T18:58:07.712154] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-14T18:58:07.712233] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-14T18:58:07.714131] [DEBUG] [LOCAL ] MDU: Trimmed 52289 records to 35398 (keeping 150 days of data) [2025-09-14T18:58:07.778706] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-14T18:58:07.967065] [DEBUG] [LOCAL ] MDU: Primary data saved (35398 records). [2025-09-14T18:58:07.967260] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-14T18:58:07.967371] [INFO ] [MAIN ] Update Progress: 1329/2370 symbols completed. MDU took 43.5s. Estimated remaining: 1h 50m 24s. Rate: 9.4 symbols/min [2025-09-14T18:58:08.141091] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:08.156200] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T18:58:08.182448] [DEBUG] [LOCAL ] MET: Loaded 23940 existing records from primary storage. [2025-09-14T18:58:08.182686] [INFO ] [MAIN ] MET: Loaded 23940 existing records. [2025-09-14T18:58:08.363658] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:08.363980] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-14T18:58:08.364044] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-14T18:58:08.364819] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-14T18:58:08.364888] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-14T18:58:08.564025] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-14T18:58:08.741500] [INFO ] [REMOTE ] MET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:09.040445] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:58:09.045766] [INFO ] [REMOTE ] MEG: Full fetch complete (30134 records). [2025-09-14T18:58:09.045920] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-14T18:58:09.228195] [WARN ] [VALIDATOR ] MEG: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T18:58:09.228652] [FATAL] [MAIN ] MEG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:58:09.228709] [WARN ] [MAIN ] MEG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:58:09.228751] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-14T18:58:09.228819] [DEBUG] [LOCAL ] MEG: No primary data file found to delete. [2025-09-14T18:58:09.228907] [INFO ] [LOCAL ] MEG: Starting deletion of derivative data. [2025-09-14T18:58:09.228978] [DEBUG] [LOCAL ] MEG: No derivative data file found to delete. [2025-09-14T18:58:09.229080] [INFO ] [MAIN ] Update Progress: 1330/2370 symbols completed. MEG took 22.5s. Estimated remaining: 1h 50m 13s. Rate: 9.4 symbols/min [2025-09-14T18:58:09.369725] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-14T18:58:09.401183] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:09.423918] [DEBUG] [LOCAL ] MFA: Loaded 20210 existing records from primary storage. [2025-09-14T18:58:09.424096] [INFO ] [MAIN ] MFA: Loaded 20210 existing records. [2025-09-14T18:58:09.599631] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:09.599942] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-14T18:58:09.600003] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-14T18:58:09.600634] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-14T18:58:09.600747] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-14T18:58:09.958139] [INFO ] [REMOTE ] MFA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:10.104205] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T18:58:10.158774] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-14T18:58:10.488447] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T18:58:10.958885] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-14T18:58:11.681011] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:58:11.745857] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T18:58:11.758788] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-14T18:58:12.558793] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-14T18:58:12.879342] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:58:13.358845] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-14T18:58:14.158874] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-14T18:58:14.318957] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:58:14.748751] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T18:58:14.958858] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-14T18:58:15.173983] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T18:58:15.758885] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-14T18:58:16.558865] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-14T18:58:16.673712] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:58:17.358846] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-14T18:58:17.647188] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:58:18.158849] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-14T18:58:18.524597] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:58:18.670759] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:58:18.958880] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-14T18:58:19.494506] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T18:58:19.758825] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-14T18:58:20.558851] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-14T18:58:20.941961] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:58:20.971274] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:58:21.358874] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-14T18:58:21.782250] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T18:58:22.158896] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-14T18:58:22.958845] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-14T18:58:23.348323] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-14T18:58:23.758825] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-14T18:58:23.930260] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:58:24.558827] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-14T18:58:24.895207] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T18:58:25.358837] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-14T18:58:25.651268] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:58:25.653533] [INFO ] [REMOTE ] MEGI: Full fetch complete (21961 records). [2025-09-14T18:58:25.653770] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-14T18:58:25.781466] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T18:58:26.069018] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-14T18:58:26.069138] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-14T18:58:26.069688] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-14T18:58:26.069817] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-14T18:58:26.070463] [DEBUG] [LOCAL ] MEGI: Trimmed 21961 records to 14929 (keeping 150 days of data) [2025-09-14T18:58:26.159103] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-14T18:58:26.167711] [DEBUG] [LOCAL ] MEGI: Primary data saved (14929 records). [2025-09-14T18:58:26.167828] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-14T18:58:26.167924] [INFO ] [MAIN ] Update Progress: 1331/2370 symbols completed. MEGI took 20.9s. Estimated remaining: 1h 50m 15s. Rate: 9.4 symbols/min [2025-09-14T18:58:26.338734] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:26.342350] [DEBUG] [LOCAL ] MFAN: Loaded 1790 existing records from primary storage. [2025-09-14T18:58:26.342460] [INFO ] [MAIN ] MFAN: Loaded 1790 existing records. [2025-09-14T18:58:26.516025] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:26.516298] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-14T18:58:26.516355] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-14T18:58:26.516591] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-14T18:58:26.516677] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-14T18:58:26.866631] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:26.885187] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T18:58:26.958823] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-14T18:58:27.758803] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-14T18:58:28.230634] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T18:58:28.269584] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T18:58:28.276452] [INFO ] [REMOTE ] MEI: Full fetch complete (34519 records). [2025-09-14T18:58:28.276770] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-14T18:58:28.431708] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T18:58:28.564010] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-14T18:58:28.805010] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-14T18:58:28.805191] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-14T18:58:28.806376] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-14T18:58:28.806453] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-14T18:58:28.807887] [DEBUG] [LOCAL ] MEI: Trimmed 34519 records to 23507 (keeping 150 days of data) [2025-09-14T18:58:29.027432] [DEBUG] [LOCAL ] MEI: Primary data saved (23507 records). [2025-09-14T18:58:29.027689] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-14T18:58:29.027826] [INFO ] [MAIN ] Update Progress: 1332/2370 symbols completed. MEI took 22.5s. Estimated remaining: 1h 50m 6s. Rate: 9.4 symbols/min [2025-09-14T18:58:29.282492] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:29.287707] [DEBUG] [LOCAL ] MFAO: Loaded 1563 existing records from primary storage. [2025-09-14T18:58:29.287903] [INFO ] [MAIN ] MFAO: Loaded 1563 existing records. [2025-09-14T18:58:29.364083] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-14T18:58:29.551347] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:29.551658] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-14T18:58:29.551766] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-14T18:58:29.551996] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-14T18:58:29.552054] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-14T18:58:29.926361] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:30.076801] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T18:58:30.158797] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-14T18:58:30.572851] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T18:58:30.958817] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-14T18:58:31.504295] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T18:58:31.758795] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-14T18:58:32.558896] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-14T18:58:32.869130] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T18:58:33.358896] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-14T18:58:33.385411] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:58:33.425735] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:58:34.037421] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:58:34.043120] [INFO ] [REMOTE ] MET: Full fetch complete (57951 records). [2025-09-14T18:58:34.043293] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-14T18:58:34.164025] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-14T18:58:34.429767] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-14T18:58:34.429882] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-14T18:58:34.430882] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-14T18:58:34.430955] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-14T18:58:34.432172] [DEBUG] [LOCAL ] MET: Trimmed 57951 records to 40097 (keeping 150 days of data) [2025-09-14T18:58:34.696286] [DEBUG] [LOCAL ] MET: Primary data saved (40097 records). [2025-09-14T18:58:34.696445] [INFO ] [MAIN ] MET: Full history saved. [2025-09-14T18:58:34.696547] [INFO ] [MAIN ] Update Progress: 1333/2370 symbols completed. MET took 26.7s. Estimated remaining: 1h 49m 59s. Rate: 9.4 symbols/min [2025-09-14T18:58:34.804938] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T18:58:34.876065] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:34.900078] [DEBUG] [LOCAL ] MFC: Loaded 22909 existing records from primary storage. [2025-09-14T18:58:34.900251] [INFO ] [MAIN ] MFC: Loaded 22909 existing records. [2025-09-14T18:58:34.964098] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-14T18:58:35.086123] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:35.086435] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-14T18:58:35.086496] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-14T18:58:35.087178] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-14T18:58:35.087252] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-14T18:58:35.471913] [INFO ] [REMOTE ] MFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:35.710276] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T18:58:35.758835] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-14T18:58:36.558912] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-14T18:58:37.288403] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T18:58:37.324012] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:58:37.358835] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-14T18:58:38.158861] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-14T18:58:38.795165] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T18:58:38.799932] [INFO ] [REMOTE ] MFA: Full fetch complete (48924 records). [2025-09-14T18:58:38.800055] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-14T18:58:38.961143] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-14T18:58:39.183090] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-14T18:58:39.183251] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-14T18:58:39.184069] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-14T18:58:39.184185] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-14T18:58:39.185686] [DEBUG] [LOCAL ] MFA: Trimmed 48924 records to 33621 (keeping 150 days of data) [2025-09-14T18:58:39.301077] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:58:39.437581] [DEBUG] [LOCAL ] MFA: Primary data saved (33621 records). [2025-09-14T18:58:39.437745] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-14T18:58:39.437843] [INFO ] [MAIN ] Update Progress: 1334/2370 symbols completed. MFA took 30.2s. Estimated remaining: 1h 49m 52s. Rate: 9.4 symbols/min [2025-09-14T18:58:39.612717] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:39.633449] [DEBUG] [LOCAL ] MFG: Loaded 22163 existing records from primary storage. [2025-09-14T18:58:39.633630] [INFO ] [MAIN ] MFG: Loaded 22163 existing records. [2025-09-14T18:58:39.783014] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:58:39.759733] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-14T18:58:39.817433] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:39.818318] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-14T18:58:39.818387] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-14T18:58:39.819144] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-14T18:58:39.819206] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-14T18:58:40.166467] [INFO ] [REMOTE ] MFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:40.550589] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:58:40.558765] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-14T18:58:41.121693] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-14T18:58:41.358849] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-14T18:58:41.987837] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T18:58:42.158865] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-14T18:58:42.958807] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-14T18:58:43.043437] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:58:43.591956] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T18:58:43.758824] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-14T18:58:44.372338] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T18:58:44.558869] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-14T18:58:45.358816] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-14T18:58:45.428374] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T18:58:46.051883] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T18:58:46.158831] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-14T18:58:46.958837] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-14T18:58:47.229887] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:58:47.758827] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-14T18:58:48.277223] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T18:58:48.295935] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T18:58:48.296988] [INFO ] [REMOTE ] MFAN: Full fetch complete (4536 records). [2025-09-14T18:58:48.297087] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-14T18:58:48.565307] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-14T18:58:48.655776] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-14T18:58:48.655915] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-14T18:58:48.656132] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-14T18:58:48.656213] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-14T18:58:48.656689] [DEBUG] [LOCAL ] MFAN: Trimmed 4536 records to 3076 (keeping 150 days of data) [2025-09-14T18:58:48.675529] [DEBUG] [LOCAL ] MFAN: Primary data saved (3076 records). [2025-09-14T18:58:48.675661] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-14T18:58:48.675824] [INFO ] [MAIN ] Update Progress: 1335/2370 symbols completed. MFAN took 22.5s. Estimated remaining: 1h 49m 48s. Rate: 9.4 symbols/min [2025-09-14T18:58:48.842680] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:48.850187] [DEBUG] [LOCAL ] MFM: Loaded 5657 existing records from primary storage. [2025-09-14T18:58:48.850325] [INFO ] [MAIN ] MFM: Loaded 5657 existing records. [2025-09-14T18:58:49.028900] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:49.029224] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-14T18:58:49.029300] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-14T18:58:49.029743] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-14T18:58:49.029821] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-14T18:58:49.323906] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T18:58:49.364512] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-14T18:58:49.402453] [INFO ] [REMOTE ] MFM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:50.158860] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-14T18:58:50.237223] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:58:50.682963] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:58:50.684008] [INFO ] [REMOTE ] MFAO: Full fetch complete (4192 records). [2025-09-14T18:58:50.684099] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-14T18:58:50.960367] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-14T18:58:51.037476] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-14T18:58:51.037589] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-14T18:58:51.037839] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-14T18:58:51.037897] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-14T18:58:51.038293] [DEBUG] [LOCAL ] MFAO: Trimmed 4192 records to 2960 (keeping 150 days of data) [2025-09-14T18:58:51.056889] [DEBUG] [LOCAL ] MFAO: Primary data saved (2960 records). [2025-09-14T18:58:51.056999] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-14T18:58:51.057093] [INFO ] [MAIN ] Update Progress: 1336/2370 symbols completed. MFAO took 22.0s. Estimated remaining: 1h 49m 38s. Rate: 9.4 symbols/min [2025-09-14T18:58:51.230962] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:51.234746] [DEBUG] [LOCAL ] MFSB: Loaded 895 existing records from primary storage. [2025-09-14T18:58:51.234849] [INFO ] [MAIN ] MFSB: Loaded 895 existing records. [2025-09-14T18:58:51.413927] [WARN ] [MAIN ] MFSB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:51.414278] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-14T18:58:51.414347] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-14T18:58:51.414763] [DEBUG] [LOCAL ] MFSB: Deleted primary data file. [2025-09-14T18:58:51.414830] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-14T18:58:51.768147] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-14T18:58:51.791385] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:52.558901] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-14T18:58:52.646027] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:58:52.663597] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T18:58:52.849612] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-14T18:58:53.358848] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-14T18:58:54.158802] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-14T18:58:54.271214] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T18:58:54.958848] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-14T18:58:55.047967] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:58:55.343503] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-14T18:58:55.758835] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-14T18:58:56.113868] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-14T18:58:56.558841] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-14T18:58:56.919061] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-14T18:58:57.358882] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-14T18:58:58.158891] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-14T18:58:58.529180] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-14T18:58:58.958982] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:58:58.959057] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-14T18:58:59.403110] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T18:58:59.758818] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-14T18:59:00.291219] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T18:59:00.558835] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-14T18:59:01.358883] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-14T18:59:01.874756] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:59:01.875921] [INFO ] [REMOTE ] MFSB: Full fetch complete (1089 records). [2025-09-14T18:59:01.876018] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-14T18:59:02.087690] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 132 unique days, need 150 days [2025-09-14T18:59:02.087913] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:59:02.087965] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:59:02.088022] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-14T18:59:02.088126] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-14T18:59:02.088176] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-14T18:59:02.088250] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-14T18:59:02.088354] [INFO ] [MAIN ] Update Progress: 1337/2370 symbols completed. MFSB took 11.0s. Estimated remaining: 1h 49m 35s. Rate: 9.4 symbols/min [2025-09-14T18:59:02.164012] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-14T18:59:02.260283] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:02.264900] [DEBUG] [LOCAL ] MFSG: Loaded 2707 existing records from primary storage. [2025-09-14T18:59:02.265014] [INFO ] [MAIN ] MFSG: Loaded 2707 existing records. [2025-09-14T18:59:02.453087] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:02.453388] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-14T18:59:02.453451] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-14T18:59:02.453727] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-14T18:59:02.453789] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-14T18:59:02.809105] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:02.846659] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-14T18:59:02.958876] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-14T18:59:03.473582] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T18:59:03.506962] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T18:59:03.758843] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-14T18:59:04.558856] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-14T18:59:05.043978] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T18:59:05.358850] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-14T18:59:05.548503] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T18:59:06.158881] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-14T18:59:06.294519] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T18:59:06.902170] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T18:59:06.958840] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-14T18:59:07.758830] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-14T18:59:08.558867] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-14T18:59:08.805238] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T18:59:08.914267] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T18:59:09.201313] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T18:59:09.358869] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-14T18:59:10.013679] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T18:59:10.158887] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-14T18:59:10.819391] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:59:10.958810] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-14T18:59:11.614504] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T18:59:11.758837] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-14T18:59:12.493130] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:59:12.498399] [INFO ] [REMOTE ] MFC: Full fetch complete (55980 records). [2025-09-14T18:59:12.498540] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-14T18:59:12.564063] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-14T18:59:12.885143] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-14T18:59:12.885265] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-14T18:59:12.886216] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-14T18:59:12.886283] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-14T18:59:12.887502] [DEBUG] [LOCAL ] MFC: Trimmed 55980 records to 38397 (keeping 150 days of data) [2025-09-14T18:59:13.137013] [DEBUG] [LOCAL ] MFC: Primary data saved (38397 records). [2025-09-14T18:59:13.137206] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-14T18:59:13.137359] [INFO ] [MAIN ] Update Progress: 1338/2370 symbols completed. MFC took 38.4s. Estimated remaining: 1h 49m 33s. Rate: 9.4 symbols/min [2025-09-14T18:59:13.310152] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:13.318343] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T18:59:13.327947] [DEBUG] [LOCAL ] MFSI: Loaded 6353 existing records from primary storage. [2025-09-14T18:59:13.328170] [INFO ] [MAIN ] MFSI: Loaded 6353 existing records. [2025-09-14T18:59:13.364053] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-14T18:59:13.519707] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:13.520040] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-14T18:59:13.520115] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-14T18:59:13.520494] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-14T18:59:13.520558] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-14T18:59:13.893632] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:14.158823] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-14T18:59:14.555400] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T18:59:14.866418] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T18:59:14.958839] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-14T18:59:15.758867] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-14T18:59:15.859224] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T18:59:16.558828] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-14T18:59:17.358853] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-14T18:59:17.479210] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T18:59:17.480558] [INFO ] [REMOTE ] MFSG: Full fetch complete (4842 records). [2025-09-14T18:59:17.480678] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-14T18:59:17.894446] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-14T18:59:17.895557] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T18:59:17.896736] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-14T18:59:17.900667] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-14T18:59:17.913564] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-14T18:59:17.913778] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-14T18:59:17.914606] [DEBUG] [LOCAL ] MFSG: Trimmed 4842 records to 3948 (keeping 150 days of data) [2025-09-14T18:59:17.943549] [DEBUG] [LOCAL ] MFSG: Primary data saved (3948 records). [2025-09-14T18:59:17.943717] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-14T18:59:17.943845] [INFO ] [MAIN ] Update Progress: 1339/2370 symbols completed. MFSG took 15.9s. Estimated remaining: 1h 49m 25s. Rate: 9.4 symbols/min [2025-09-14T18:59:18.116662] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:18.120619] [DEBUG] [LOCAL ] MFSV: Loaded 1220 existing records from primary storage. [2025-09-14T18:59:18.120814] [INFO ] [MAIN ] MFSV: Loaded 1220 existing records. [2025-09-14T18:59:18.164020] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-14T18:59:18.313743] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:18.314087] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-14T18:59:18.314154] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-14T18:59:18.314390] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-14T18:59:18.314452] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-14T18:59:18.676060] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:18.754697] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T18:59:18.958825] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-14T18:59:19.758175] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T18:59:19.760324] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-14T18:59:20.369181] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T18:59:20.558838] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-14T18:59:20.973870] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T18:59:21.358910] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-14T18:59:22.158885] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-14T18:59:22.299086] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:59:22.958860] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-14T18:59:23.438085] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T18:59:23.641229] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T18:59:23.647840] [INFO ] [REMOTE ] MFG: Full fetch complete (52755 records). [2025-09-14T18:59:23.648101] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-14T18:59:23.763998] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-14T18:59:24.070590] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-14T18:59:24.070754] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-14T18:59:24.072346] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-14T18:59:24.072416] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-14T18:59:24.074019] [DEBUG] [LOCAL ] MFG: Trimmed 52755 records to 37293 (keeping 150 days of data) [2025-09-14T18:59:24.283402] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T18:59:24.323552] [DEBUG] [LOCAL ] MFG: Primary data saved (37293 records). [2025-09-14T18:59:24.323799] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-14T18:59:24.323940] [INFO ] [MAIN ] Update Progress: 1340/2370 symbols completed. MFG took 44.9s. Estimated remaining: 1h 49m 19s. Rate: 9.4 symbols/min [2025-09-14T18:59:24.502047] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:24.511476] [DEBUG] [LOCAL ] MG: Loaded 6432 existing records from primary storage. [2025-09-14T18:59:24.511732] [INFO ] [MAIN ] MG: Loaded 6432 existing records. [2025-09-14T18:59:24.569274] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-14T18:59:24.716164] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:24.716548] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-14T18:59:24.716635] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-14T18:59:24.717052] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-14T18:59:24.717120] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-14T18:59:25.079595] [INFO ] [REMOTE ] MG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:25.358810] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-14T18:59:25.661675] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T18:59:25.842360] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-14T18:59:26.158857] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-14T18:59:26.916210] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:59:26.918221] [INFO ] [REMOTE ] MFM: Full fetch complete (15256 records). [2025-09-14T18:59:26.918318] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-14T18:59:26.963961] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-14T18:59:27.304395] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-14T18:59:27.304572] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-14T18:59:27.305501] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-14T18:59:27.305615] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-14T18:59:27.306437] [DEBUG] [LOCAL ] MFM: Trimmed 15256 records to 10158 (keeping 150 days of data) [2025-09-14T18:59:27.374619] [DEBUG] [LOCAL ] MFM: Primary data saved (10158 records). [2025-09-14T18:59:27.374883] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-14T18:59:27.375032] [INFO ] [MAIN ] Update Progress: 1341/2370 symbols completed. MFM took 38.7s. Estimated remaining: 1h 49m 10s. Rate: 9.4 symbols/min [2025-09-14T18:59:27.554114] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:27.578812] [DEBUG] [LOCAL ] MGA: Loaded 22210 existing records from primary storage. [2025-09-14T18:59:27.579065] [INFO ] [MAIN ] MGA: Loaded 22210 existing records. [2025-09-14T18:59:27.763680] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-14T18:59:27.764013] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:27.764816] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-14T18:59:27.765927] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-14T18:59:27.766834] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-14T18:59:27.766908] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-14T18:59:28.023273] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T18:59:28.155879] [INFO ] [REMOTE ] MGA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:28.512302] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T18:59:28.558858] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-14T18:59:29.333327] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:59:29.335465] [INFO ] [REMOTE ] MFSI: Full fetch complete (10815 records). [2025-09-14T18:59:29.335715] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-14T18:59:29.364630] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-14T18:59:29.708260] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-14T18:59:29.708387] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-14T18:59:29.708744] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-14T18:59:29.708820] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-14T18:59:29.709389] [DEBUG] [LOCAL ] MFSI: Trimmed 10815 records to 8941 (keeping 150 days of data) [2025-09-14T18:59:29.767137] [DEBUG] [LOCAL ] MFSI: Primary data saved (8941 records). [2025-09-14T18:59:29.767325] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-14T18:59:29.767489] [INFO ] [MAIN ] Update Progress: 1342/2370 symbols completed. MFSI took 16.6s. Estimated remaining: 1h 49m 0s. Rate: 9.4 symbols/min [2025-09-14T18:59:29.948772] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:29.953086] [DEBUG] [LOCAL ] MGF: Loaded 2039 existing records from primary storage. [2025-09-14T18:59:29.953209] [INFO ] [MAIN ] MGF: Loaded 2039 existing records. [2025-09-14T18:59:30.144775] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:30.145063] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-14T18:59:30.145168] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-14T18:59:30.145445] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-14T18:59:30.145516] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-14T18:59:30.167012] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-14T18:59:30.565553] [INFO ] [REMOTE ] MGF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:30.583383] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T18:59:30.958822] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-14T18:59:31.712683] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T18:59:31.758778] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-14T18:59:32.038167] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T18:59:32.164567] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-14T18:59:32.558851] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-14T18:59:33.243262] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T18:59:33.358844] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-14T18:59:34.158832] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-14T18:59:34.421204] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T18:59:34.680077] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T18:59:34.958894] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-14T18:59:35.758901] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-14T18:59:35.980357] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T18:59:36.436252] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T18:59:36.558881] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-14T18:59:37.184165] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T18:59:37.358845] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-14T18:59:38.158850] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-14T18:59:38.958859] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-14T18:59:39.078780] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:59:39.092589] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T18:59:39.619183] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T18:59:39.758820] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-14T18:59:40.391123] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T18:59:40.558959] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-14T18:59:41.064899] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T18:59:41.066001] [INFO ] [REMOTE ] MFSV: Full fetch complete (2337 records). [2025-09-14T18:59:41.066089] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-14T18:59:41.364044] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-14T18:59:41.424319] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-14T18:59:41.424440] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-14T18:59:41.424576] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-14T18:59:41.424634] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-14T18:59:41.425045] [DEBUG] [LOCAL ] MFSV: Trimmed 2337 records to 1655 (keeping 150 days of data) [2025-09-14T18:59:41.436285] [DEBUG] [LOCAL ] MFSV: Primary data saved (1655 records). [2025-09-14T18:59:41.436376] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-14T18:59:41.436470] [INFO ] [MAIN ] Update Progress: 1343/2370 symbols completed. MFSV took 23.5s. Estimated remaining: 1h 48m 58s. Rate: 9.4 symbols/min [2025-09-14T18:59:41.615450] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:41.640932] [DEBUG] [LOCAL ] MGM: Loaded 23997 existing records from primary storage. [2025-09-14T18:59:41.641112] [INFO ] [MAIN ] MGM: Loaded 23997 existing records. [2025-09-14T18:59:41.823367] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:41.823732] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-14T18:59:41.823822] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-14T18:59:41.824575] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-14T18:59:41.824694] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-14T18:59:42.097809] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:59:42.115581] [INFO ] [REMOTE ] MGF: Full fetch complete (4461 records). [2025-09-14T18:59:42.136302] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-14T18:59:42.167662] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-14T18:59:42.187857] [INFO ] [REMOTE ] MGM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:42.548697] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-14T18:59:42.548821] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-14T18:59:42.549007] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-14T18:59:42.549059] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-14T18:59:42.549519] [DEBUG] [LOCAL ] MGF: Trimmed 4461 records to 3212 (keeping 150 days of data) [2025-09-14T18:59:42.572397] [DEBUG] [LOCAL ] MGF: Primary data saved (3212 records). [2025-09-14T18:59:42.572594] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-14T18:59:42.572742] [INFO ] [MAIN ] Update Progress: 1344/2370 symbols completed. MGF took 12.8s. Estimated remaining: 1h 48m 48s. Rate: 9.4 symbols/min [2025-09-14T18:59:42.756201] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:42.760711] [DEBUG] [LOCAL ] MGR: Loaded 2770 existing records from primary storage. [2025-09-14T18:59:42.760818] [INFO ] [MAIN ] MGR: Loaded 2770 existing records. [2025-09-14T18:59:42.938973] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:42.939243] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-14T18:59:42.939304] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-14T18:59:42.939584] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-14T18:59:42.939678] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-14T18:59:42.970829] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-14T18:59:43.299078] [INFO ] [REMOTE ] MGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:43.758883] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-14T18:59:44.005406] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:59:44.206571] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T18:59:44.558870] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-14T18:59:44.587134] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:59:45.358869] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-14T18:59:46.158988] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-14T18:59:46.335598] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T18:59:46.465800] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T18:59:46.958888] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-14T18:59:47.506774] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T18:59:47.758811] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-14T18:59:47.892076] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:59:48.558869] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-14T18:59:49.273123] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:59:49.275295] [INFO ] [REMOTE ] MG: Full fetch complete (18051 records). [2025-09-14T18:59:49.275411] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-14T18:59:49.363993] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-14T18:59:49.706452] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-14T18:59:49.706706] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-14T18:59:49.707502] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-14T18:59:49.708281] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-14T18:59:49.709381] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T18:59:49.721220] [DEBUG] [LOCAL ] MG: Trimmed 18051 records to 11650 (keeping 150 days of data) [2025-09-14T18:59:49.803143] [DEBUG] [LOCAL ] MG: Primary data saved (11650 records). [2025-09-14T18:59:49.803369] [INFO ] [MAIN ] MG: Full history saved. [2025-09-14T18:59:49.803502] [INFO ] [MAIN ] Update Progress: 1345/2370 symbols completed. MG took 25.5s. Estimated remaining: 1h 48m 42s. Rate: 9.4 symbols/min [2025-09-14T18:59:49.980385] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:49.984302] [DEBUG] [LOCAL ] MGRB: Loaded 1591 existing records from primary storage. [2025-09-14T18:59:49.984401] [INFO ] [MAIN ] MGRB: Loaded 1591 existing records. [2025-09-14T18:59:50.161498] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T18:59:50.161079] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-14T18:59:50.165664] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:50.169726] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-14T18:59:50.170769] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-14T18:59:50.171179] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-14T18:59:50.171309] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-14T18:59:50.523138] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:50.958891] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-14T18:59:51.654813] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T18:59:51.758805] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-14T18:59:51.851332] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:59:52.238311] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T18:59:52.558836] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-14T18:59:53.358845] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-14T18:59:54.158833] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-14T18:59:54.629181] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T18:59:54.790306] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:59:54.958885] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-14T18:59:55.222289] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:59:55.567291] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T18:59:55.758892] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-14T18:59:56.419481] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:59:56.558917] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-14T18:59:57.358872] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-14T18:59:58.154964] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T18:59:58.158764] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-14T18:59:58.492848] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:59:58.833043] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T18:59:58.958809] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-14T18:59:59.570241] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:59:59.571456] [INFO ] [REMOTE ] MGR: Full fetch complete (5985 records). [2025-09-14T18:59:59.571553] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-14T18:59:59.763952] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-14T18:59:59.954406] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-14T18:59:59.954537] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-14T18:59:59.954772] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-14T18:59:59.954836] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-14T18:59:59.955267] [DEBUG] [LOCAL ] MGR: Trimmed 5985 records to 4180 (keeping 150 days of data) [2025-09-14T18:59:59.981460] [DEBUG] [LOCAL ] MGR: Primary data saved (4180 records). [2025-09-14T18:59:59.981570] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-14T18:59:59.981710] [INFO ] [MAIN ] Update Progress: 1346/2370 symbols completed. MGR took 17.4s. Estimated remaining: 1h 48m 39s. Rate: 9.4 symbols/min [2025-09-14T19:00:00.159118] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:00.162543] [DEBUG] [LOCAL ] MGRD: Loaded 963 existing records from primary storage. [2025-09-14T19:00:00.162659] [INFO ] [MAIN ] MGRD: Loaded 963 existing records. [2025-09-14T19:00:00.360006] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:00.360354] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-14T19:00:00.360421] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-14T19:00:00.360726] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-14T19:00:00.360793] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-14T19:00:00.568192] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-14T19:00:00.724442] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:01.355981] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-14T19:00:01.360788] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-14T19:00:01.362928] [INFO ] [REMOTE ] MGA: Full fetch complete (55097 records). [2025-09-14T19:00:01.363026] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-14T19:00:01.765863] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-14T19:00:01.766039] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-14T19:00:01.767230] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-14T19:00:01.767331] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-14T19:00:01.769218] [DEBUG] [LOCAL ] MGA: Trimmed 55097 records to 37796 (keeping 150 days of data) [2025-09-14T19:00:02.044200] [DEBUG] [LOCAL ] MGA: Primary data saved (37796 records). [2025-09-14T19:00:02.044423] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-14T19:00:02.044550] [INFO ] [MAIN ] Update Progress: 1347/2370 symbols completed. MGA took 34.7s. Estimated remaining: 1h 48m 29s. Rate: 9.4 symbols/min [2025-09-14T19:00:02.158808] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-14T19:00:02.248746] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:02.249261] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T19:00:02.261599] [DEBUG] [LOCAL ] MGRE: Loaded 3141 existing records from primary storage. [2025-09-14T19:00:02.261923] [INFO ] [MAIN ] MGRE: Loaded 3141 existing records. [2025-09-14T19:00:02.494460] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:02.494844] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-14T19:00:02.494970] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-14T19:00:02.495355] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-14T19:00:02.495431] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-14T19:00:02.892665] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:02.958879] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-14T19:00:03.044825] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T19:00:03.758843] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-14T19:00:04.558917] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-14T19:00:06.751257] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (4.59 seconds). [2025-09-14T19:00:06.764431] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-14T19:00:06.869040] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-09-14T19:00:06.871500] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-14T19:00:07.043493] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (4.08 seconds). [2025-09-14T19:00:07.045525] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-14T19:00:07.534672] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-09-14T19:00:07.758815] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-14T19:00:10.147029] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-14T19:00:10.148480] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-14T19:00:10.415050] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (3.37 seconds). [2025-09-14T19:00:10.417073] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-14T19:00:10.733625] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (3.86 seconds). [2025-09-14T19:00:10.735577] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-14T19:00:10.843859] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (4.08 seconds). [2025-09-14T19:00:10.958892] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-14T19:00:11.179691] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T19:00:11.268986] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T19:00:11.536051] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T19:00:11.758868] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-14T19:00:12.374427] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T19:00:12.558828] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-14T19:00:13.228984] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-14T19:00:13.358854] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-14T19:00:14.120275] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T19:00:14.158952] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-14T19:00:14.280551] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T19:00:14.958911] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-14T19:00:15.486055] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T19:00:15.758833] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-14T19:00:16.291508] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T19:00:16.558928] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-14T19:00:17.245386] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-09-14T19:00:17.358842] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-14T19:00:17.393800] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T19:00:18.158838] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-14T19:00:18.699728] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T19:00:18.701000] [INFO ] [REMOTE ] MGRB: Full fetch complete (4553 records). [2025-09-14T19:00:18.701114] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-14T19:00:18.963990] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-14T19:00:19.074257] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-14T19:00:19.074391] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-14T19:00:19.074544] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-14T19:00:19.074596] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-14T19:00:19.075093] [DEBUG] [LOCAL ] MGRB: Trimmed 4553 records to 3220 (keeping 150 days of data) [2025-09-14T19:00:19.098972] [DEBUG] [LOCAL ] MGRB: Primary data saved (3220 records). [2025-09-14T19:00:19.099168] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-14T19:00:19.099277] [INFO ] [MAIN ] Update Progress: 1348/2370 symbols completed. MGRB took 29.3s. Estimated remaining: 1h 48m 31s. Rate: 9.4 symbols/min [2025-09-14T19:00:19.319968] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:19.345718] [DEBUG] [LOCAL ] MGY: Loaded 23464 existing records from primary storage. [2025-09-14T19:00:19.345918] [INFO ] [MAIN ] MGY: Loaded 23464 existing records. [2025-09-14T19:00:19.524472] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:19.524793] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-14T19:00:19.524859] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-14T19:00:19.525579] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-14T19:00:19.525681] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-14T19:00:19.750735] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-14T19:00:19.771010] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-14T19:00:19.784730] [INFO ] [REMOTE ] MGRD: Full fetch complete (2525 records). [2025-09-14T19:00:19.813709] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-14T19:00:20.004073] [INFO ] [REMOTE ] MGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:20.297252] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-14T19:00:20.297415] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-14T19:00:20.297724] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-14T19:00:20.297863] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-14T19:00:20.298425] [DEBUG] [LOCAL ] MGRD: Trimmed 2525 records to 1695 (keeping 150 days of data) [2025-09-14T19:00:20.319104] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T19:00:20.329303] [INFO ] [REMOTE ] MGM: Full fetch complete (58280 records). [2025-09-14T19:00:20.330027] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-14T19:00:20.331264] [DEBUG] [LOCAL ] MGRD: Primary data saved (1695 records). [2025-09-14T19:00:20.408523] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-14T19:00:20.432016] [INFO ] [MAIN ] Update Progress: 1349/2370 symbols completed. MGRD took 20.5s. Estimated remaining: 1h 48m 20s. Rate: 9.4 symbols/min [2025-09-14T19:00:20.582313] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-14T19:00:20.770843] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T19:00:20.866833] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:20.923300] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-14T19:00:20.923478] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-14T19:00:20.924434] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-14T19:00:20.924561] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-14T19:00:20.929853] [DEBUG] [LOCAL ] MH: Loaded 10298 existing records from primary storage. [2025-09-14T19:00:20.930205] [INFO ] [MAIN ] MH: Loaded 10298 existing records. [2025-09-14T19:00:21.004058] [DEBUG] [LOCAL ] MGM: Trimmed 58280 records to 40354 (keeping 150 days of data) [2025-09-14T19:00:21.286870] [WARN ] [MAIN ] MH: Insufficient historical data. Have data from 2025-07-24, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:21.296390] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-14T19:00:21.321961] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-14T19:00:21.329333] [DEBUG] [LOCAL ] MH: Deleted primary data file. [2025-09-14T19:00:21.331296] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-14T19:00:21.363887] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-14T19:00:21.722798] [INFO ] [REMOTE ] MH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:21.741096] [DEBUG] [LOCAL ] MGM: Primary data saved (40354 records). [2025-09-14T19:00:21.741261] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-14T19:00:21.741379] [INFO ] [MAIN ] Update Progress: 1350/2370 symbols completed. MGM took 40.3s. Estimated remaining: 1h 48m 10s. Rate: 9.4 symbols/min [2025-09-14T19:00:21.913895] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:21.922008] [DEBUG] [LOCAL ] MHD: Loaded 5132 existing records from primary storage. [2025-09-14T19:00:21.922180] [INFO ] [MAIN ] MHD: Loaded 5132 existing records. [2025-09-14T19:00:22.105689] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:22.106011] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-14T19:00:22.106102] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-14T19:00:22.106495] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-14T19:00:22.106573] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-14T19:00:22.171565] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-14T19:00:22.483970] [INFO ] [REMOTE ] MHD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:22.492068] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T19:00:22.527159] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-14T19:00:22.650139] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:22.650548] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-14T19:00:22.958823] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-14T19:00:23.758799] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-14T19:00:23.975586] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:00:24.558842] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-14T19:00:25.088149] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T19:00:25.089495] [INFO ] [REMOTE ] MGRE: Full fetch complete (7089 records). [2025-09-14T19:00:25.089603] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-14T19:00:25.365831] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-14T19:00:25.481874] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-14T19:00:25.481999] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-14T19:00:25.482213] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-14T19:00:25.482269] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-14T19:00:25.482771] [DEBUG] [LOCAL ] MGRE: Trimmed 7089 records to 4935 (keeping 150 days of data) [2025-09-14T19:00:25.513609] [DEBUG] [LOCAL ] MGRE: Primary data saved (4935 records). [2025-09-14T19:00:25.513826] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-14T19:00:25.513951] [INFO ] [MAIN ] Update Progress: 1351/2370 symbols completed. MGRE took 23.5s. Estimated remaining: 1h 48m 2s. Rate: 9.4 symbols/min [2025-09-14T19:00:25.692078] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:25.699020] [DEBUG] [LOCAL ] MHF: Loaded 4526 existing records from primary storage. [2025-09-14T19:00:25.699237] [INFO ] [MAIN ] MHF: Loaded 4526 existing records. [2025-09-14T19:00:25.845256] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T19:00:25.930806] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:25.931101] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-14T19:00:25.931165] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-14T19:00:25.931450] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-14T19:00:25.931509] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-14T19:00:26.123825] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T19:00:26.164179] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-14T19:00:26.364311] [INFO ] [REMOTE ] MHF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:26.469549] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:26.469989] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-14T19:00:26.958882] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-14T19:00:27.758816] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-14T19:00:27.785731] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T19:00:28.558833] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-14T19:00:29.358836] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-14T19:00:29.459243] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T19:00:29.461004] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T19:00:30.158822] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-14T19:00:30.401229] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T19:00:30.958864] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-14T19:00:31.367445] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:31.367879] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-14T19:00:31.758825] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-14T19:00:32.114337] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T19:00:32.558891] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-14T19:00:33.358892] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-14T19:00:33.365969] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:33.366251] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-14T19:00:33.912162] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T19:00:34.158859] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-14T19:00:34.297620] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T19:00:34.958879] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-14T19:00:35.223343] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:35.223718] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-14T19:00:35.758870] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-14T19:00:36.014891] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T19:00:36.431730] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T19:00:36.558882] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-14T19:00:37.358875] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-14T19:00:37.466110] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T19:00:38.158914] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-14T19:00:38.718153] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T19:00:38.958854] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-14T19:00:39.230348] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T19:00:39.758847] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-14T19:00:39.784051] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T19:00:40.558877] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-14T19:00:40.666327] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T19:00:41.358879] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-14T19:00:42.031221] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T19:00:42.158856] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-14T19:00:42.228099] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T19:00:42.958927] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-14T19:00:43.434690] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T19:00:43.440303] [INFO ] [REMOTE ] MH: Full fetch complete (10273 records). [2025-09-14T19:00:43.440541] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-14T19:00:43.634730] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 36 unique days, need 150 days [2025-09-14T19:00:43.642778] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:00:43.643608] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:00:43.643979] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T19:00:43.644072] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-14T19:00:43.647266] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-14T19:00:43.647669] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-14T19:00:43.647749] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-14T19:00:43.647898] [INFO ] [MAIN ] Update Progress: 1352/2370 symbols completed. MH took 23.2s. Estimated remaining: 1h 48m 4s. Rate: 9.4 symbols/min [2025-09-14T19:00:43.763999] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-14T19:00:43.819633] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:43.842404] [DEBUG] [LOCAL ] MHK: Loaded 19251 existing records from primary storage. [2025-09-14T19:00:43.842579] [INFO ] [MAIN ] MHK: Loaded 19251 existing records. [2025-09-14T19:00:44.030532] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:44.031123] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-14T19:00:44.031198] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-14T19:00:44.032111] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-14T19:00:44.032192] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-14T19:00:44.412556] [INFO ] [REMOTE ] MHK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:44.558894] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-14T19:00:44.635188] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:00:45.358864] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-14T19:00:46.158896] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-14T19:00:46.203854] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T19:00:46.205500] [INFO ] [REMOTE ] MHF: Full fetch complete (9324 records). [2025-09-14T19:00:46.205601] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-14T19:00:46.569543] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-14T19:00:46.569753] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-14T19:00:46.570078] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-14T19:00:46.570133] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-14T19:00:46.570665] [DEBUG] [LOCAL ] MHF: Trimmed 9324 records to 6860 (keeping 150 days of data) [2025-09-14T19:00:46.640016] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T19:00:46.652165] [DEBUG] [LOCAL ] MHF: Primary data saved (6860 records). [2025-09-14T19:00:46.652419] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-14T19:00:46.652815] [INFO ] [MAIN ] Update Progress: 1353/2370 symbols completed. MHF took 21.1s. Estimated remaining: 1h 47m 56s. Rate: 9.4 symbols/min [2025-09-14T19:00:46.779842] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T19:00:46.828805] [INFO ] [REMOTE ] MHD: Full fetch complete (13266 records). [2025-09-14T19:00:46.831288] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:46.831775] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-14T19:00:46.832009] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-14T19:00:46.832562] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-14T19:00:46.832751] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-14T19:00:46.866300] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-14T19:00:46.899096] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-14T19:00:46.915839] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-14T19:00:46.967793] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-14T19:00:47.516434] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-14T19:00:47.545403] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-14T19:00:47.574119] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-14T19:00:47.579893] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:47.580055] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-14T19:00:47.581083] [DEBUG] [LOCAL ] MHD: Trimmed 13266 records to 8816 (keeping 150 days of data) [2025-09-14T19:00:47.636257] [DEBUG] [LOCAL ] MHD: Primary data saved (8816 records). [2025-09-14T19:00:47.636413] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-14T19:00:47.636532] [INFO ] [MAIN ] Update Progress: 1354/2370 symbols completed. MHD took 25.9s. Estimated remaining: 1h 47m 45s. Rate: 9.4 symbols/min [2025-09-14T19:00:47.764002] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-14T19:00:47.807609] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:47.813229] [DEBUG] [LOCAL ] MHN: Loaded 3438 existing records from primary storage. [2025-09-14T19:00:47.813338] [INFO ] [MAIN ] MHN: Loaded 3438 existing records. [2025-09-14T19:00:47.988405] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:47.988710] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-14T19:00:47.988768] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-14T19:00:47.989041] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-14T19:00:47.989097] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-14T19:00:48.359418] [INFO ] [REMOTE ] MHN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:48.555325] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T19:00:48.560815] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-14T19:00:48.562779] [INFO ] [REMOTE ] MGY: Full fetch complete (56968 records). [2025-09-14T19:00:48.562898] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-14T19:00:48.815244] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-14T19:00:48.979132] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T19:00:49.001823] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-14T19:00:49.002508] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-14T19:00:49.003709] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-14T19:00:49.003771] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-14T19:00:49.006378] [DEBUG] [LOCAL ] MGY: Trimmed 56968 records to 39371 (keeping 150 days of data) [2025-09-14T19:00:49.290505] [DEBUG] [LOCAL ] MGY: Primary data saved (39371 records). [2025-09-14T19:00:49.290790] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-14T19:00:49.290933] [INFO ] [MAIN ] Update Progress: 1355/2370 symbols completed. MGY took 30.2s. Estimated remaining: 1h 47m 35s. Rate: 9.4 symbols/min [2025-09-14T19:00:49.364021] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-14T19:00:49.472826] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:49.485720] [DEBUG] [LOCAL ] MHO: Loaded 11553 existing records from primary storage. [2025-09-14T19:00:49.485886] [INFO ] [MAIN ] MHO: Loaded 11553 existing records. [2025-09-14T19:00:49.659905] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:49.660238] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-14T19:00:49.660303] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-14T19:00:49.660976] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-14T19:00:49.661044] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-14T19:00:49.762270] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T19:00:50.018319] [INFO ] [REMOTE ] MHO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:50.158847] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-14T19:00:50.958893] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-14T19:00:51.758851] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-14T19:00:51.892297] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T19:00:51.919382] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T19:00:52.558841] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-14T19:00:52.782107] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-14T19:00:53.182294] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T19:00:53.358910] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-14T19:00:54.158874] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-14T19:00:54.958961] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-14T19:00:55.084212] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:00:55.444855] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T19:00:55.758839] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-14T19:00:55.811920] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T19:00:56.558897] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-14T19:00:57.025069] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T19:00:57.358844] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-14T19:00:57.410825] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T19:00:57.625377] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-14T19:00:58.158895] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-14T19:00:58.958850] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-14T19:00:59.758853] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-14T19:00:59.820185] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T19:00:59.863484] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T19:01:00.558891] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-14T19:01:01.057309] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T19:01:01.358880] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-14T19:01:01.638515] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T19:01:02.158891] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-14T19:01:02.808180] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T19:01:02.829245] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T19:01:02.958957] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-14T19:01:03.758902] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-14T19:01:04.046150] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-14T19:01:04.197576] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T19:01:04.558866] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-14T19:01:04.806693] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T19:01:04.807429] [INFO ] [REMOTE ] MHLA: Full fetch complete (1149 records). [2025-09-14T19:01:04.807515] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-14T19:01:04.807976] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T19:01:04.808053] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:01:04.808101] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:01:04.808150] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-14T19:01:04.808220] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-14T19:01:04.808267] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-14T19:01:04.808318] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-14T19:01:04.808385] [INFO ] [MAIN ] Update Progress: 1356/2370 symbols completed. MHLA took 18.2s. Estimated remaining: 1h 47m 36s. Rate: 9.4 symbols/min [2025-09-14T19:01:04.989615] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:04.998462] [DEBUG] [LOCAL ] MIAX: Loaded 6719 existing records from primary storage. [2025-09-14T19:01:04.998681] [INFO ] [MAIN ] MIAX: Loaded 6719 existing records. [2025-09-14T19:01:05.189634] [WARN ] [MAIN ] MIAX: Insufficient historical data. Have data from 2025-08-14, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:05.189980] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-14T19:01:05.190045] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-14T19:01:05.190387] [DEBUG] [LOCAL ] MIAX: Deleted primary data file. [2025-09-14T19:01:05.190447] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-14T19:01:05.372482] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-14T19:01:05.561572] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:06.158935] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-14T19:01:06.161634] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T19:01:06.475771] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:06.476157] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-14T19:01:06.958831] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-14T19:01:07.235083] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:07.235445] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-14T19:01:07.758836] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-14T19:01:08.558868] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-14T19:01:08.847322] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:08.847772] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-14T19:01:09.015419] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T19:01:09.358846] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-14T19:01:10.158875] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-14T19:01:10.911472] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T19:01:10.958778] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-14T19:01:11.046067] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T19:01:11.758841] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-14T19:01:12.558904] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-14T19:01:12.685717] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:01:12.991446] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T19:01:13.306218] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T19:01:13.358845] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-14T19:01:14.023683] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:01:14.025144] [INFO ] [REMOTE ] MHN: Full fetch complete (8308 records). [2025-09-14T19:01:14.025228] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-14T19:01:14.174089] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-14T19:01:14.394684] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-14T19:01:14.394797] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-14T19:01:14.395049] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-14T19:01:14.395102] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-14T19:01:14.395561] [DEBUG] [LOCAL ] MHN: Trimmed 8308 records to 5568 (keeping 150 days of data) [2025-09-14T19:01:14.429028] [DEBUG] [LOCAL ] MHN: Primary data saved (5568 records). [2025-09-14T19:01:14.429136] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-14T19:01:14.429255] [INFO ] [MAIN ] Update Progress: 1357/2370 symbols completed. MHN took 26.8s. Estimated remaining: 1h 47m 32s. Rate: 9.4 symbols/min [2025-09-14T19:01:14.945382] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:01:14.949797] [INFO ] [REMOTE ] MHK: Full fetch complete (46283 records). [2025-09-14T19:01:14.949925] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-14T19:01:14.963976] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-14T19:01:15.346335] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-14T19:01:15.343916] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:15.346716] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-14T19:01:15.346619] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-14T19:01:15.347994] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-14T19:01:15.348062] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-14T19:01:15.349127] [DEBUG] [LOCAL ] MHK: Trimmed 46283 records to 31851 (keeping 150 days of data) [2025-09-14T19:01:15.545733] [DEBUG] [LOCAL ] MHK: Primary data saved (31851 records). [2025-09-14T19:01:15.545899] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-14T19:01:15.546042] [INFO ] [MAIN ] Update Progress: 1358/2370 symbols completed. MHK took 31.9s. Estimated remaining: 1h 47m 22s. Rate: 9.4 symbols/min [2025-09-14T19:01:15.758828] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-14T19:01:16.389073] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T19:01:16.391871] [INFO ] [REMOTE ] MHO: Full fetch complete (27059 records). [2025-09-14T19:01:16.391971] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-14T19:01:16.564228] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-14T19:01:16.763053] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-14T19:01:16.763180] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-14T19:01:16.763782] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-14T19:01:16.763846] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-14T19:01:16.764586] [DEBUG] [LOCAL ] MHO: Trimmed 27059 records to 17950 (keeping 150 days of data) [2025-09-14T19:01:16.879161] [DEBUG] [LOCAL ] MHO: Primary data saved (17950 records). [2025-09-14T19:01:16.879338] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-14T19:01:16.879440] [INFO ] [MAIN ] Update Progress: 1359/2370 symbols completed. MHO took 27.6s. Estimated remaining: 1h 47m 11s. Rate: 9.4 symbols/min [2025-09-14T19:01:16.977226] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:16.977622] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-14T19:01:17.358831] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-14T19:01:17.614908] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:17.615242] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-14T19:01:18.158826] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-14T19:01:19.466270] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T19:01:19.472303] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-14T19:01:20.723032] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T19:01:20.727151] [INFO ] [REMOTE ] MIAX: Full fetch complete (6709 records). [2025-09-14T19:01:20.727240] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-14T19:01:20.908760] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 21 unique days, need 150 days [2025-09-14T19:01:20.909005] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:01:20.909057] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:01:20.909128] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-14T19:01:20.909201] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-14T19:01:20.909244] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-14T19:01:20.909295] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-14T19:01:20.909382] [INFO ] [MAIN ] Update Progress: 1360/2370 symbols completed. MIAX took 16.1s. Estimated remaining: 1h 47m 3s. Rate: 9.4 symbols/min [2025-09-14T19:01:21.569776] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:21.656174] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:21.657558] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:21.659737] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:21.668507] [DEBUG] [LOCAL ] MITP: Loaded 702 existing records from primary storage. [2025-09-14T19:01:21.666667] [DEBUG] [LOCAL ] MITN: Loaded 434 existing records from primary storage. [2025-09-14T19:01:21.668866] [INFO ] [MAIN ] MITP: Loaded 702 existing records. [2025-09-14T19:01:21.674842] [INFO ] [MAIN ] MITN: Loaded 434 existing records. [2025-09-14T19:01:21.831096] [DEBUG] [LOCAL ] MIN: Loaded 7358 existing records from primary storage. [2025-09-14T19:01:21.888023] [INFO ] [MAIN ] MIN: Loaded 7358 existing records. [2025-09-14T19:01:21.875577] [DEBUG] [LOCAL ] MIR: Loaded 23136 existing records from primary storage. [2025-09-14T19:01:21.963874] [INFO ] [MAIN ] MIR: Loaded 23136 existing records. [2025-09-14T19:01:22.074889] [WARN ] [MAIN ] MITN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:22.215713] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-14T19:01:22.267951] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:22.362804] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-14T19:01:22.331492] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-14T19:01:22.368107] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:22.371800] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-14T19:01:22.372277] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-14T19:01:22.372214] [DEBUG] [LOCAL ] MITN: Deleted primary data file. [2025-09-14T19:01:22.383052] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-14T19:01:22.377801] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-14T19:01:22.377868] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-14T19:01:22.412615] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-14T19:01:22.459455] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-14T19:01:22.490962] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:22.510435] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-14T19:01:22.613332] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-14T19:01:22.684428] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-14T19:01:22.860165] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-14T19:01:22.944198] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-14T19:01:23.713776] [INFO ] [REMOTE ] MITN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:23.914694] [INFO ] [REMOTE ] MITP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:23.834237] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-14T19:01:23.988883] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-14T19:01:23.992987] [INFO ] [REMOTE ] MIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:24.009470] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-14T19:01:24.094555] [INFO ] [REMOTE ] MIR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:24.095148] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-14T19:01:24.573829] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T19:01:24.575177] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-14T19:01:24.587335] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T19:01:24.588725] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-14T19:01:24.874457] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T19:01:24.876921] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-14T19:01:25.008044] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T19:01:25.112324] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T19:01:25.358907] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-14T19:01:25.682199] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:01:25.723937] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T19:01:26.001860] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T19:01:26.158869] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-14T19:01:26.958975] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-14T19:01:27.034828] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T19:01:27.506088] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-14T19:01:27.758895] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-14T19:01:28.211432] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T19:01:28.558868] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-14T19:01:28.983179] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T19:01:29.358929] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-14T19:01:30.158924] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-14T19:01:30.249718] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T19:01:30.958869] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-14T19:01:31.758878] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-14T19:01:31.880034] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T19:01:31.961335] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T19:01:32.379708] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T19:01:32.558882] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-14T19:01:33.023423] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T19:01:33.358884] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-14T19:01:34.158872] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-14T19:01:34.591741] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T19:01:34.601150] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T19:01:34.958931] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-14T19:01:35.758941] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-14T19:01:36.263943] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T19:01:36.558874] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-14T19:01:36.700309] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T19:01:37.358875] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-14T19:01:37.591973] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T19:01:37.688996] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-14T19:01:38.158851] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-14T19:01:38.493380] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T19:01:38.494150] [INFO ] [REMOTE ] MITN: Full fetch complete (1941 records). [2025-09-14T19:01:38.494231] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-14T19:01:38.667867] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:01:38.668046] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:01:38.668098] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:01:38.668143] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-14T19:01:38.668209] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-14T19:01:38.668253] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-14T19:01:38.668301] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-14T19:01:38.668398] [INFO ] [MAIN ] Update Progress: 1361/2370 symbols completed. MITN took 17.8s. Estimated remaining: 1h 47m 5s. Rate: 9.4 symbols/min [2025-09-14T19:01:38.835330] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:38.846343] [DEBUG] [LOCAL ] MITT: Loaded 9179 existing records from primary storage. [2025-09-14T19:01:38.846487] [INFO ] [MAIN ] MITT: Loaded 9179 existing records. [2025-09-14T19:01:38.963971] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-14T19:01:39.023191] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:39.023364] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-14T19:01:39.023420] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-14T19:01:39.023865] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-14T19:01:39.023924] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-14T19:01:39.372178] [INFO ] [REMOTE ] MITT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:39.758865] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-14T19:01:40.558886] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-14T19:01:40.803662] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T19:01:40.886611] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:01:40.942733] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T19:01:41.358884] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-14T19:01:42.158875] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-14T19:01:42.601189] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T19:01:42.958872] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-14T19:01:43.010809] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T19:01:43.012599] [INFO ] [REMOTE ] MIN: Full fetch complete (13913 records). [2025-09-14T19:01:43.012707] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-14T19:01:43.384854] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:01:43.394353] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-14T19:01:43.395934] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-14T19:01:43.395849] [INFO ] [REMOTE ] MITP: Full fetch complete (2550 records). [2025-09-14T19:01:43.396517] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-14T19:01:43.396659] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-14T19:01:43.396836] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-14T19:01:43.496950] [DEBUG] [LOCAL ] MIN: Trimmed 13913 records to 10736 (keeping 150 days of data) [2025-09-14T19:01:43.761513] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-14T19:01:43.837871] [DEBUG] [LOCAL ] MIN: Primary data saved (10736 records). [2025-09-14T19:01:43.838394] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-14T19:01:43.838571] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-14T19:01:43.838869] [INFO ] [MAIN ] Update Progress: 1362/2370 symbols completed. MIN took 22.9s. Estimated remaining: 1h 46m 58s. Rate: 9.4 symbols/min [2025-09-14T19:01:43.838931] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-14T19:01:43.884404] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-14T19:01:43.918665] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-14T19:01:43.948166] [DEBUG] [LOCAL ] MITP: Trimmed 2550 records to 1677 (keeping 150 days of data) [2025-09-14T19:01:44.032448] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:44.035549] [DEBUG] [LOCAL ] MITP: Primary data saved (1677 records). [2025-09-14T19:01:44.035919] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-14T19:01:44.036066] [INFO ] [MAIN ] Update Progress: 1363/2370 symbols completed. MITP took 23.1s. Estimated remaining: 1h 46m 47s. Rate: 9.4 symbols/min [2025-09-14T19:01:44.135953] [DEBUG] [LOCAL ] MIY: Loaded 2852 existing records from primary storage. [2025-09-14T19:01:44.147480] [INFO ] [MAIN ] MIY: Loaded 2852 existing records. [2025-09-14T19:01:44.360286] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:44.420758] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:44.421417] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-14T19:01:44.421486] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-14T19:01:44.421915] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-14T19:01:44.421987] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-14T19:01:44.559358] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-14T19:01:44.698844] [DEBUG] [LOCAL ] MKC: Loaded 23573 existing records from primary storage. [2025-09-14T19:01:44.730408] [INFO ] [MAIN ] MKC: Loaded 23573 existing records. [2025-09-14T19:01:44.934290] [INFO ] [REMOTE ] MIY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:45.019762] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:45.020119] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-14T19:01:45.020210] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-14T19:01:45.021099] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-14T19:01:45.021185] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-14T19:01:45.365278] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-14T19:01:45.404213] [INFO ] [REMOTE ] MKC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:45.780338] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T19:01:45.816448] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-14T19:01:46.158801] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-14T19:01:46.159686] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T19:01:46.958838] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-14T19:01:47.758836] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-14T19:01:47.989305] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T19:01:48.558805] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-14T19:01:48.720084] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T19:01:48.947224] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T19:01:49.358864] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-14T19:01:50.110127] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T19:01:50.158856] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-14T19:01:50.313002] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T19:01:50.938433] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T19:01:50.958805] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-14T19:01:51.633779] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:01:51.758875] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-14T19:01:52.558857] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-14T19:01:53.110738] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T19:01:53.358869] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-14T19:01:54.081765] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T19:01:54.087583] [INFO ] [REMOTE ] MIR: Full fetch complete (55100 records). [2025-09-14T19:01:54.087833] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-14T19:01:54.164799] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-14T19:01:54.495906] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-14T19:01:54.496054] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-14T19:01:54.497046] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-14T19:01:54.497121] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-14T19:01:54.498441] [DEBUG] [LOCAL ] MIR: Trimmed 55100 records to 38381 (keeping 150 days of data) [2025-09-14T19:01:54.751043] [DEBUG] [LOCAL ] MIR: Primary data saved (38381 records). [2025-09-14T19:01:54.751251] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-14T19:01:54.751382] [INFO ] [MAIN ] Update Progress: 1364/2370 symbols completed. MIR took 33.8s. Estimated remaining: 1h 46m 44s. Rate: 9.4 symbols/min [2025-09-14T19:01:54.934308] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:54.951916] [DEBUG] [LOCAL ] MKL: Loaded 14573 existing records from primary storage. [2025-09-14T19:01:54.952106] [INFO ] [MAIN ] MKL: Loaded 14573 existing records. [2025-09-14T19:01:54.983691] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-14T19:01:55.139402] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:55.140276] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:01:55.142696] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-14T19:01:55.142765] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-14T19:01:55.143221] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-14T19:01:55.143286] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-14T19:01:55.492133] [INFO ] [REMOTE ] MKL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:55.528015] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-14T19:01:55.758828] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-14T19:01:56.169434] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T19:01:56.558812] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-14T19:01:57.289961] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T19:01:57.358824] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-14T19:01:58.158860] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-14T19:01:58.653210] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T19:01:58.884941] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T19:01:58.958864] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-14T19:01:59.758851] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-14T19:02:00.005825] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T19:02:00.182035] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T19:02:00.558929] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-14T19:02:01.358852] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-14T19:02:01.616458] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T19:02:01.951296] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T19:02:01.952595] [INFO ] [REMOTE ] MIY: Full fetch complete (6339 records). [2025-09-14T19:02:01.952727] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-14T19:02:02.164708] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-14T19:02:02.316717] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-14T19:02:02.316845] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-14T19:02:02.317107] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-14T19:02:02.317161] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-14T19:02:02.317687] [DEBUG] [LOCAL ] MIY: Trimmed 6339 records to 4348 (keeping 150 days of data) [2025-09-14T19:02:02.347452] [DEBUG] [LOCAL ] MIY: Primary data saved (4348 records). [2025-09-14T19:02:02.347623] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-14T19:02:02.347817] [INFO ] [MAIN ] Update Progress: 1365/2370 symbols completed. MIY took 18.5s. Estimated remaining: 1h 46m 39s. Rate: 9.4 symbols/min [2025-09-14T19:02:02.519201] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:02.541418] [DEBUG] [LOCAL ] MLI: Loaded 19640 existing records from primary storage. [2025-09-14T19:02:02.541630] [INFO ] [MAIN ] MLI: Loaded 19640 existing records. [2025-09-14T19:02:02.724108] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:02.724370] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-14T19:02:02.724431] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-14T19:02:02.725018] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-14T19:02:02.725087] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-14T19:02:02.966249] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-14T19:02:02.996039] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T19:02:03.038022] [INFO ] [REMOTE ] MITT: Full fetch complete (25088 records). [2025-09-14T19:02:03.075418] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-14T19:02:03.105396] [INFO ] [REMOTE ] MLI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:03.461314] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-14T19:02:03.461446] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-14T19:02:03.461872] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-14T19:02:03.461930] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-14T19:02:03.463512] [DEBUG] [LOCAL ] MITT: Trimmed 25088 records to 16045 (keeping 150 days of data) [2025-09-14T19:02:03.563978] [DEBUG] [LOCAL ] MITT: Primary data saved (16045 records). [2025-09-14T19:02:03.564140] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-14T19:02:03.564321] [INFO ] [MAIN ] Update Progress: 1366/2370 symbols completed. MITT took 24.9s. Estimated remaining: 1h 46m 28s. Rate: 9.4 symbols/min [2025-09-14T19:02:03.731806] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:03.752339] [DEBUG] [LOCAL ] MLM: Loaded 12656 existing records from primary storage. [2025-09-14T19:02:03.752518] [INFO ] [MAIN ] MLM: Loaded 12656 existing records. [2025-09-14T19:02:03.783950] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-14T19:02:03.934791] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:03.935136] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-14T19:02:03.935200] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-14T19:02:03.935803] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-14T19:02:03.935867] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-14T19:02:04.289148] [INFO ] [REMOTE ] MLM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:04.510600] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T19:02:04.558775] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-14T19:02:04.726211] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T19:02:05.358820] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-14T19:02:05.454784] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T19:02:06.158788] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-14T19:02:06.587072] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T19:02:06.824194] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T19:02:06.958813] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-14T19:02:07.706938] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T19:02:07.758858] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-14T19:02:08.372989] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T19:02:08.558821] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-14T19:02:09.358866] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-14T19:02:09.545340] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T19:02:09.614966] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T19:02:10.158877] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-14T19:02:10.958829] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-14T19:02:10.989312] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T19:02:11.758846] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-14T19:02:11.894755] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T19:02:12.558822] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-14T19:02:12.810220] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T19:02:13.358801] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-14T19:02:13.434778] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T19:02:14.045687] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T19:02:14.158822] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-14T19:02:14.958792] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-14T19:02:14.987015] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T19:02:15.279116] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T19:02:15.282797] [INFO ] [REMOTE ] MKL: Full fetch complete (37784 records). [2025-09-14T19:02:15.282914] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-14T19:02:15.659247] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-14T19:02:15.659383] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-14T19:02:15.660232] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-14T19:02:15.660313] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-14T19:02:15.661416] [DEBUG] [LOCAL ] MKL: Trimmed 37784 records to 25665 (keeping 150 days of data) [2025-09-14T19:02:15.758977] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-14T19:02:15.827128] [DEBUG] [LOCAL ] MKL: Primary data saved (25665 records). [2025-09-14T19:02:15.827286] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-14T19:02:15.827416] [INFO ] [MAIN ] Update Progress: 1367/2370 symbols completed. MKL took 21.1s. Estimated remaining: 1h 46m 26s. Rate: 9.4 symbols/min [2025-09-14T19:02:15.996227] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:16.009235] [DEBUG] [LOCAL ] MLNK: Loaded 11865 existing records from primary storage. [2025-09-14T19:02:16.009414] [INFO ] [MAIN ] MLNK: Loaded 11865 existing records. [2025-09-14T19:02:16.186602] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:16.186891] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-14T19:02:16.186951] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-14T19:02:16.187402] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-14T19:02:16.187465] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-14T19:02:16.545929] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:16.560386] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-14T19:02:16.565916] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T19:02:17.358848] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-14T19:02:17.509220] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T19:02:18.158797] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-14T19:02:18.317227] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T19:02:18.748883] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T19:02:18.958855] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-14T19:02:19.679337] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T19:02:19.758873] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-14T19:02:20.563976] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-14T19:02:20.577548] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:02:21.358783] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-14T19:02:21.425101] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:02:21.638506] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T19:02:22.158896] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-14T19:02:22.456417] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T19:02:22.842388] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:02:22.847323] [INFO ] [REMOTE ] MLI: Full fetch complete (47764 records). [2025-09-14T19:02:22.847502] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-14T19:02:22.963936] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-14T19:02:23.237828] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-14T19:02:23.237942] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-14T19:02:23.238746] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-14T19:02:23.238803] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-14T19:02:23.241187] [DEBUG] [LOCAL ] MLI: Trimmed 47764 records to 32624 (keeping 150 days of data) [2025-09-14T19:02:23.467958] [DEBUG] [LOCAL ] MLI: Primary data saved (32624 records). [2025-09-14T19:02:23.468126] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-14T19:02:23.468239] [INFO ] [MAIN ] Update Progress: 1368/2370 symbols completed. MLI took 21.1s. Estimated remaining: 1h 46m 21s. Rate: 9.4 symbols/min [2025-09-14T19:02:23.637528] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:23.640942] [DEBUG] [LOCAL ] MLP: Loaded 1222 existing records from primary storage. [2025-09-14T19:02:23.641041] [INFO ] [MAIN ] MLP: Loaded 1222 existing records. [2025-09-14T19:02:23.762213] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-14T19:02:23.827439] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:23.827997] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-14T19:02:23.828142] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-14T19:02:23.833623] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-14T19:02:23.842249] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-14T19:02:23.848713] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T19:02:23.941382] [INFO ] [REMOTE ] MKC: Full fetch complete (56983 records). [2025-09-14T19:02:23.952888] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-14T19:02:24.502574] [INFO ] [REMOTE ] MLP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:24.561137] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-14T19:02:24.597159] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-14T19:02:24.597286] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-14T19:02:24.598258] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-14T19:02:24.598335] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-14T19:02:24.600013] [DEBUG] [LOCAL ] MKC: Trimmed 56983 records to 39477 (keeping 150 days of data) [2025-09-14T19:02:24.866430] [DEBUG] [LOCAL ] MKC: Primary data saved (39477 records). [2025-09-14T19:02:24.866634] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-14T19:02:24.866794] [INFO ] [MAIN ] Update Progress: 1369/2370 symbols completed. MKC took 40.8s. Estimated remaining: 1h 46m 11s. Rate: 9.4 symbols/min [2025-09-14T19:02:25.037731] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:25.054413] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T19:02:25.062711] [DEBUG] [LOCAL ] MLR: Loaded 5552 existing records from primary storage. [2025-09-14T19:02:25.063036] [INFO ] [MAIN ] MLR: Loaded 5552 existing records. [2025-09-14T19:02:25.241075] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:25.241418] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-14T19:02:25.241486] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-14T19:02:25.241924] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-14T19:02:25.249283] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-14T19:02:25.249509] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:02:25.322208] [INFO ] [REMOTE ] MLM: Full fetch complete (35400 records). [2025-09-14T19:02:25.344163] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-14T19:02:25.376268] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-14T19:02:25.821492] [INFO ] [REMOTE ] MLR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:26.017849] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-14T19:02:26.017961] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-14T19:02:26.018606] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-14T19:02:26.018674] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-14T19:02:26.019560] [DEBUG] [LOCAL ] MLM: Trimmed 35400 records to 21830 (keeping 150 days of data) [2025-09-14T19:02:26.116966] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T19:02:26.158800] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-14T19:02:26.178778] [DEBUG] [LOCAL ] MLM: Primary data saved (21830 records). [2025-09-14T19:02:26.178917] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-14T19:02:26.179014] [INFO ] [MAIN ] Update Progress: 1370/2370 symbols completed. MLM took 22.6s. Estimated remaining: 1h 46m 1s. Rate: 9.4 symbols/min [2025-09-14T19:02:26.349471] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:26.372382] [DEBUG] [LOCAL ] MMC: Loaded 23327 existing records from primary storage. [2025-09-14T19:02:26.372600] [INFO ] [MAIN ] MMC: Loaded 23327 existing records. [2025-09-14T19:02:26.548799] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:26.549070] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-14T19:02:26.549155] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-14T19:02:26.550047] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-14T19:02:26.550127] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-14T19:02:26.736499] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T19:02:26.909333] [INFO ] [REMOTE ] MMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:26.958785] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-14T19:02:27.758838] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-14T19:02:27.850619] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T19:02:28.558884] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-14T19:02:28.678937] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T19:02:29.167271] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T19:02:29.358864] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-14T19:02:30.015213] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T19:02:30.158840] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-14T19:02:30.958814] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-14T19:02:31.034175] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T19:02:31.758871] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-14T19:02:32.121957] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T19:02:32.558907] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-14T19:02:32.804813] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T19:02:33.306796] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T19:02:33.358787] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-14T19:02:34.158828] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-14T19:02:34.231090] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:02:34.819708] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T19:02:34.958855] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-14T19:02:35.758844] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-14T19:02:35.782911] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T19:02:36.201028] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T19:02:36.558908] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-14T19:02:37.000178] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-14T19:02:37.358881] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-14T19:02:38.158829] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-14T19:02:38.280252] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T19:02:38.751200] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T19:02:38.752256] [INFO ] [REMOTE ] MLP: Full fetch complete (3198 records). [2025-09-14T19:02:38.752343] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-14T19:02:38.964325] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-14T19:02:39.153666] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-14T19:02:39.153788] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-14T19:02:39.153961] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-14T19:02:39.154027] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-14T19:02:39.154430] [DEBUG] [LOCAL ] MLP: Trimmed 3198 records to 2297 (keeping 150 days of data) [2025-09-14T19:02:39.168192] [DEBUG] [LOCAL ] MLP: Primary data saved (2297 records). [2025-09-14T19:02:39.168281] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-14T19:02:39.168396] [INFO ] [MAIN ] Update Progress: 1371/2370 symbols completed. MLP took 15.7s. Estimated remaining: 1h 45m 59s. Rate: 9.4 symbols/min [2025-09-14T19:02:39.340794] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:39.347554] [DEBUG] [LOCAL ] MMD: Loaded 4639 existing records from primary storage. [2025-09-14T19:02:39.347740] [INFO ] [MAIN ] MMD: Loaded 4639 existing records. [2025-09-14T19:02:39.523967] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:39.524222] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-14T19:02:39.524282] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-14T19:02:39.524620] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-14T19:02:39.524728] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-14T19:02:39.765830] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-14T19:02:39.885028] [INFO ] [REMOTE ] MMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:40.341536] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T19:02:40.459227] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T19:02:40.558911] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-14T19:02:41.358873] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-14T19:02:41.445784] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T19:02:42.158819] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-14T19:02:42.457507] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T19:02:42.958882] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-14T19:02:43.187807] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T19:02:43.758853] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-14T19:02:44.251463] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T19:02:44.441747] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T19:02:44.558844] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-14T19:02:45.252378] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T19:02:45.358828] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-14T19:02:46.158857] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-14T19:02:46.259622] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T19:02:46.958883] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-14T19:02:47.260165] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T19:02:47.758864] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-14T19:02:47.890747] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T19:02:48.558845] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-14T19:02:48.649875] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:02:48.651920] [INFO ] [REMOTE ] MLR: Full fetch complete (14383 records). [2025-09-14T19:02:48.652008] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-14T19:02:49.023051] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-14T19:02:49.023233] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-14T19:02:49.023843] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-14T19:02:49.023904] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-14T19:02:49.025011] [DEBUG] [LOCAL ] MLR: Trimmed 14383 records to 8560 (keeping 150 days of data) [2025-09-14T19:02:49.082956] [DEBUG] [LOCAL ] MLR: Primary data saved (8560 records). [2025-09-14T19:02:49.083136] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-14T19:02:49.083245] [INFO ] [MAIN ] Update Progress: 1372/2370 symbols completed. MLR took 24.2s. Estimated remaining: 1h 45m 56s. Rate: 9.4 symbols/min [2025-09-14T19:02:49.255985] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:49.264273] [DEBUG] [LOCAL ] MMI: Loaded 6339 existing records from primary storage. [2025-09-14T19:02:49.264440] [INFO ] [MAIN ] MMI: Loaded 6339 existing records. [2025-09-14T19:02:49.364732] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-14T19:02:49.445197] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:49.445566] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-14T19:02:49.445658] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-14T19:02:49.446001] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-14T19:02:49.446063] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-14T19:02:49.812932] [INFO ] [REMOTE ] MMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:49.946678] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T19:02:50.158855] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-14T19:02:50.219807] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T19:02:50.828343] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T19:02:50.958884] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-14T19:02:51.758844] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-14T19:02:52.091862] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:02:52.558866] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-14T19:02:52.591442] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T19:02:53.306538] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:02:53.313438] [INFO ] [REMOTE ] MMC: Full fetch complete (56266 records). [2025-09-14T19:02:53.313707] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-14T19:02:53.363916] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-14T19:02:53.724509] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-14T19:02:53.724673] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-14T19:02:53.725761] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-14T19:02:53.725866] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-14T19:02:53.727358] [DEBUG] [LOCAL ] MMC: Trimmed 56266 records to 38946 (keeping 150 days of data) [2025-09-14T19:02:53.993521] [DEBUG] [LOCAL ] MMC: Primary data saved (38946 records). [2025-09-14T19:02:53.993721] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-14T19:02:53.993826] [INFO ] [MAIN ] Update Progress: 1373/2370 symbols completed. MMC took 27.8s. Estimated remaining: 1h 45m 48s. Rate: 9.4 symbols/min [2025-09-14T19:02:54.129751] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T19:02:54.161591] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-14T19:02:54.182721] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:54.185180] [DEBUG] [LOCAL ] MMKT: Loaded 540 existing records from primary storage. [2025-09-14T19:02:54.185456] [INFO ] [MAIN ] MMKT: Loaded 540 existing records. [2025-09-14T19:02:54.364375] [WARN ] [MAIN ] MMKT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:54.364674] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-14T19:02:54.364738] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-14T19:02:54.364987] [DEBUG] [LOCAL ] MMKT: Deleted primary data file. [2025-09-14T19:02:54.365047] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-14T19:02:54.734330] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:54.958820] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-14T19:02:55.233418] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:02:55.385703] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T19:02:55.758850] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-14T19:02:56.258605] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T19:02:56.558822] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-14T19:02:57.358842] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-14T19:02:57.513398] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T19:02:58.158883] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-14T19:02:58.363249] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:02:58.366601] [INFO ] [REMOTE ] MLNK: Full fetch complete (26925 records). [2025-09-14T19:02:58.366714] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-14T19:02:58.736829] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-14T19:02:58.737005] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-14T19:02:58.737561] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-14T19:02:58.737617] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-14T19:02:58.738327] [DEBUG] [LOCAL ] MLNK: Trimmed 26925 records to 19044 (keeping 150 days of data) [2025-09-14T19:02:58.861506] [DEBUG] [LOCAL ] MLNK: Primary data saved (19044 records). [2025-09-14T19:02:58.861729] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-14T19:02:58.861839] [INFO ] [MAIN ] Update Progress: 1374/2370 symbols completed. MLNK took 43.0s. Estimated remaining: 1h 45m 41s. Rate: 9.4 symbols/min [2025-09-14T19:02:58.961136] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-14T19:02:58.981369] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T19:02:59.042159] [INFO ] [REMOTE ] MMD: Full fetch complete (12325 records). [2025-09-14T19:02:59.044975] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-14T19:02:59.044791] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:59.315096] [DEBUG] [LOCAL ] MMM: Loaded 23725 existing records from primary storage. [2025-09-14T19:02:59.341308] [INFO ] [MAIN ] MMM: Loaded 23725 existing records. [2025-09-14T19:02:59.513270] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-14T19:02:59.531947] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-14T19:02:59.561918] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-14T19:02:59.576951] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-14T19:02:59.599037] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-14T19:02:59.599148] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:59.599749] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-14T19:02:59.599806] [DEBUG] [LOCAL ] MMD: Trimmed 12325 records to 7956 (keeping 150 days of data) [2025-09-14T19:02:59.599911] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-14T19:02:59.620926] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-14T19:02:59.635204] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-14T19:02:59.760205] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-14T19:02:59.869799] [DEBUG] [LOCAL ] MMD: Primary data saved (7956 records). [2025-09-14T19:02:59.931132] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-14T19:02:59.941480] [INFO ] [MAIN ] Update Progress: 1375/2370 symbols completed. MMD took 20.8s. Estimated remaining: 1h 45m 31s. Rate: 9.4 symbols/min [2025-09-14T19:03:00.125078] [INFO ] [REMOTE ] MMM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:00.220613] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:00.238728] [DEBUG] [LOCAL ] MMS: Loaded 15098 existing records from primary storage. [2025-09-14T19:03:00.238972] [INFO ] [MAIN ] MMS: Loaded 15098 existing records. [2025-09-14T19:03:00.435608] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:00.436024] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-14T19:03:00.436097] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-14T19:03:00.436685] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-14T19:03:00.436755] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-14T19:03:00.536372] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T19:03:00.563962] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-14T19:03:00.817702] [INFO ] [REMOTE ] MMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:01.358908] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-14T19:03:02.025673] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T19:03:02.158938] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-14T19:03:02.731884] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T19:03:02.958874] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-14T19:03:03.758899] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-14T19:03:04.397510] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T19:03:04.558867] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-14T19:03:04.576540] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-14T19:03:05.119847] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T19:03:05.358834] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-14T19:03:06.158828] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-14T19:03:06.591199] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:03:06.592037] [INFO ] [REMOTE ] MMKT: Full fetch complete (1533 records). [2025-09-14T19:03:06.592134] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-14T19:03:06.786250] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T19:03:06.786866] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:03:06.787022] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:03:06.787176] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-14T19:03:06.787411] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-14T19:03:06.787511] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-14T19:03:06.788231] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-14T19:03:06.788450] [INFO ] [MAIN ] Update Progress: 1376/2370 symbols completed. MMKT took 12.8s. Estimated remaining: 1h 45m 25s. Rate: 9.4 symbols/min [2025-09-14T19:03:06.961697] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-14T19:03:06.961616] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:07.014561] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (3.26 seconds). [2025-09-14T19:03:07.029023] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T19:03:07.037297] [DEBUG] [LOCAL ] MMT: Loaded 4970 existing records from primary storage. [2025-09-14T19:03:07.037837] [INFO ] [MAIN ] MMT: Loaded 4970 existing records. [2025-09-14T19:03:07.217443] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:07.217786] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-14T19:03:07.217853] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-14T19:03:07.218387] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-14T19:03:07.218708] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-14T19:03:07.569746] [INFO ] [REMOTE ] MMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:07.758803] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-14T19:03:08.025082] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T19:03:08.558862] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-14T19:03:09.358825] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-14T19:03:09.477164] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T19:03:10.015770] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T19:03:10.158845] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-14T19:03:10.196712] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T19:03:10.958892] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-14T19:03:11.511900] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T19:03:11.758895] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-14T19:03:12.558922] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-14T19:03:13.293444] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T19:03:13.342633] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T19:03:13.358771] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-14T19:03:13.758446] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T19:03:14.158868] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-14T19:03:14.654817] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T19:03:14.656783] [INFO ] [REMOTE ] MMI: Full fetch complete (16820 records). [2025-09-14T19:03:14.656911] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-14T19:03:14.961106] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-14T19:03:15.041336] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-14T19:03:15.041465] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-14T19:03:15.041945] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-14T19:03:15.052357] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-14T19:03:15.059846] [DEBUG] [LOCAL ] MMI: Trimmed 16820 records to 11093 (keeping 150 days of data) [2025-09-14T19:03:15.060888] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T19:03:15.134690] [DEBUG] [LOCAL ] MMI: Primary data saved (11093 records). [2025-09-14T19:03:15.134884] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-14T19:03:15.134990] [INFO ] [MAIN ] Update Progress: 1377/2370 symbols completed. MMI took 26.1s. Estimated remaining: 1h 45m 20s. Rate: 9.4 symbols/min [2025-09-14T19:03:15.307576] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:15.317339] [DEBUG] [LOCAL ] MMU: Loaded 7800 existing records from primary storage. [2025-09-14T19:03:15.317516] [INFO ] [MAIN ] MMU: Loaded 7800 existing records. [2025-09-14T19:03:15.494705] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:15.495001] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-14T19:03:15.495062] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-14T19:03:15.495864] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-14T19:03:15.495932] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-14T19:03:15.768926] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-14T19:03:15.861744] [INFO ] [REMOTE ] MMU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:16.558843] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-14T19:03:17.358897] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-14T19:03:17.666458] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-14T19:03:18.158885] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-14T19:03:18.671782] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-09-14T19:03:18.792972] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-14T19:03:18.930022] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T19:03:18.958768] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-14T19:03:19.758843] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-14T19:03:19.963744] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T19:03:20.062760] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T19:03:20.558886] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-14T19:03:20.666244] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T19:03:21.358826] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-14T19:03:21.754029] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T19:03:22.158880] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-14T19:03:22.190091] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T19:03:22.958838] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-14T19:03:23.568832] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T19:03:23.758874] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-14T19:03:24.558890] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-14T19:03:24.794848] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T19:03:25.096376] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-14T19:03:25.358846] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-14T19:03:25.775341] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T19:03:26.158842] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-14T19:03:26.471019] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T19:03:26.958889] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-14T19:03:27.596794] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T19:03:27.601117] [INFO ] [REMOTE ] MMS: Full fetch complete (37797 records). [2025-09-14T19:03:27.601271] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-14T19:03:27.764352] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-14T19:03:27.989529] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-14T19:03:27.989723] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-14T19:03:27.990752] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-14T19:03:27.990852] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-14T19:03:27.992153] [DEBUG] [LOCAL ] MMS: Trimmed 37797 records to 24667 (keeping 150 days of data) [2025-09-14T19:03:28.163230] [DEBUG] [LOCAL ] MMS: Primary data saved (24667 records). [2025-09-14T19:03:28.163400] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-14T19:03:28.163519] [INFO ] [MAIN ] Update Progress: 1378/2370 symbols completed. MMS took 28.2s. Estimated remaining: 1h 45m 18s. Rate: 9.4 symbols/min [2025-09-14T19:03:28.335431] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:28.348120] [DEBUG] [LOCAL ] MNR: Loaded 11268 existing records from primary storage. [2025-09-14T19:03:28.348308] [INFO ] [MAIN ] MNR: Loaded 11268 existing records. [2025-09-14T19:03:28.526463] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:28.526737] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-14T19:03:28.526806] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-14T19:03:28.527263] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-14T19:03:28.527321] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-14T19:03:28.563913] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-14T19:03:28.849781] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-14T19:03:28.941521] [INFO ] [REMOTE ] MNR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:28.950549] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T19:03:29.197379] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T19:03:29.358843] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-14T19:03:30.158834] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-14T19:03:30.679079] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T19:03:30.958832] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-14T19:03:31.026501] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T19:03:31.031956] [INFO ] [REMOTE ] MMM: Full fetch complete (57928 records). [2025-09-14T19:03:31.032076] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-14T19:03:31.427955] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-14T19:03:31.428086] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-14T19:03:31.428980] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-14T19:03:31.429036] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-14T19:03:31.430203] [DEBUG] [LOCAL ] MMM: Trimmed 57928 records to 40041 (keeping 150 days of data) [2025-09-14T19:03:31.705416] [DEBUG] [LOCAL ] MMM: Primary data saved (40041 records). [2025-09-14T19:03:31.705593] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-14T19:03:31.705706] [INFO ] [MAIN ] Update Progress: 1379/2370 symbols completed. MMM took 32.8s. Estimated remaining: 1h 45m 10s. Rate: 9.4 symbols/min [2025-09-14T19:03:31.768223] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-14T19:03:31.879104] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:31.897703] [DEBUG] [LOCAL ] MNSO: Loaded 18541 existing records from primary storage. [2025-09-14T19:03:31.898092] [INFO ] [MAIN ] MNSO: Loaded 18541 existing records. [2025-09-14T19:03:32.140587] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:32.152567] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T19:03:32.152902] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-14T19:03:32.157388] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-14T19:03:32.158475] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-14T19:03:32.158573] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-14T19:03:32.555727] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:32.558800] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-14T19:03:32.742468] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T19:03:32.745001] [INFO ] [REMOTE ] MMU: Full fetch complete (18850 records). [2025-09-14T19:03:32.745099] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-14T19:03:33.113300] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-14T19:03:33.113426] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-14T19:03:33.113877] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-14T19:03:33.113947] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-14T19:03:33.114548] [DEBUG] [LOCAL ] MMU: Trimmed 18850 records to 12504 (keeping 150 days of data) [2025-09-14T19:03:33.189252] [DEBUG] [LOCAL ] MMU: Primary data saved (12504 records). [2025-09-14T19:03:33.189430] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-14T19:03:33.189556] [INFO ] [MAIN ] Update Progress: 1380/2370 symbols completed. MMU took 18.1s. Estimated remaining: 1h 44m 60s. Rate: 9.4 symbols/min [2025-09-14T19:03:33.360515] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-14T19:03:33.363888] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:33.386374] [DEBUG] [LOCAL ] MNTN: Loaded 18549 existing records from primary storage. [2025-09-14T19:03:33.386566] [INFO ] [MAIN ] MNTN: Loaded 18549 existing records. [2025-09-14T19:03:33.561543] [WARN ] [MAIN ] MNTN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:33.561867] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-14T19:03:33.561932] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-14T19:03:33.562535] [DEBUG] [LOCAL ] MNTN: Deleted primary data file. [2025-09-14T19:03:33.562600] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-14T19:03:33.916495] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:34.158910] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-14T19:03:34.410844] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:03:34.411238] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-14T19:03:34.714121] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T19:03:34.958911] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-14T19:03:35.758856] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-14T19:03:36.117420] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T19:03:36.558844] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-14T19:03:36.595403] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T19:03:37.358791] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-14T19:03:37.619807] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:03:37.620154] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-14T19:03:37.713274] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T19:03:38.158840] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-14T19:03:38.958833] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-14T19:03:39.313362] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (6.75 seconds). [2025-09-14T19:03:39.366460] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T19:03:39.436742] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T19:03:39.438015] [INFO ] [REMOTE ] MMT: Full fetch complete (12378 records). [2025-09-14T19:03:39.438111] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-14T19:03:39.771554] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-14T19:03:39.811594] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-14T19:03:39.811706] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-14T19:03:39.812238] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-14T19:03:39.812374] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-14T19:03:39.812905] [DEBUG] [LOCAL ] MMT: Trimmed 12378 records to 7827 (keeping 150 days of data) [2025-09-14T19:03:39.858276] [DEBUG] [LOCAL ] MMT: Primary data saved (7827 records). [2025-09-14T19:03:39.858441] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-14T19:03:39.858553] [INFO ] [MAIN ] Update Progress: 1381/2370 symbols completed. MMT took 33.1s. Estimated remaining: 1h 44m 54s. Rate: 9.4 symbols/min [2025-09-14T19:03:40.046478] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:40.070522] [DEBUG] [LOCAL ] MO: Loaded 24116 existing records from primary storage. [2025-09-14T19:03:40.070709] [INFO ] [MAIN ] MO: Loaded 24116 existing records. [2025-09-14T19:03:40.249985] [WARN ] [MAIN ] MO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:40.250267] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-14T19:03:40.250338] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-14T19:03:40.251146] [DEBUG] [LOCAL ] MO: Deleted primary data file. [2025-09-14T19:03:40.251213] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-14T19:03:40.572236] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-14T19:03:40.610779] [INFO ] [REMOTE ] MO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:40.871486] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:03:40.871880] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-14T19:03:41.028237] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T19:03:41.358848] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-14T19:03:42.158864] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-14T19:03:42.958875] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-14T19:03:43.645193] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-14T19:03:43.758769] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-14T19:03:43.863555] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:03:44.558929] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-14T19:03:45.358962] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-14T19:03:46.138404] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-14T19:03:46.158783] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-14T19:03:48.318703] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-14T19:03:48.330156] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-14T19:03:48.911893] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (5.95 seconds). [2025-09-14T19:03:48.921834] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-14T19:03:50.185594] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T19:03:50.191297] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-14T19:03:50.721316] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-14T19:03:50.738558] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-14T19:03:50.893149] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (6.33 seconds). [2025-09-14T19:03:50.896181] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-14T19:03:51.156119] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T19:03:51.158746] [INFO ] [REMOTE ] MNR: Full fetch complete (28196 records). [2025-09-14T19:03:51.158852] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-14T19:03:51.537811] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-14T19:03:51.537917] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-14T19:03:51.538578] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-14T19:03:51.538632] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-14T19:03:51.539344] [DEBUG] [LOCAL ] MNR: Trimmed 28196 records to 18817 (keeping 150 days of data) [2025-09-14T19:03:51.655430] [DEBUG] [LOCAL ] MNR: Primary data saved (18817 records). [2025-09-14T19:03:51.655623] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-14T19:03:51.655753] [INFO ] [MAIN ] Update Progress: 1382/2370 symbols completed. MNR took 23.5s. Estimated remaining: 1h 44m 51s. Rate: 9.4 symbols/min [2025-09-14T19:03:51.825062] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:51.845072] [DEBUG] [LOCAL ] MOD: Loaded 19552 existing records from primary storage. [2025-09-14T19:03:51.845259] [INFO ] [MAIN ] MOD: Loaded 19552 existing records. [2025-09-14T19:03:52.026891] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:52.027170] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-14T19:03:52.027235] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-14T19:03:52.027953] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-14T19:03:52.028019] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-14T19:03:52.377377] [INFO ] [REMOTE ] MOD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:52.377803] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-14T19:03:52.444883] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:03:52.452928] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-14T19:03:52.878799] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-14T19:03:52.890006] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-14T19:03:54.458792] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-14T19:03:54.473887] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-14T19:03:55.421450] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-14T19:03:55.433622] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-14T19:03:55.944917] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:03:55.956258] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-14T19:03:57.128597] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (11.77 seconds). [2025-09-14T19:03:57.139875] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-14T19:03:57.854271] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T19:03:57.866102] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-14T19:03:58.763710] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T19:03:58.774193] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-14T19:04:00.311319] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T19:04:00.320422] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-14T19:04:02.095250] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:04:02.105261] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-14T19:04:02.956414] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (10.50 seconds). [2025-09-14T19:04:02.966134] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-14T19:04:04.600192] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T19:04:04.614837] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-14T19:04:06.587816] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-14T19:04:06.592204] [INFO ] [REMOTE ] MNTN: Full fetch complete (22640 records). [2025-09-14T19:04:06.592309] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-14T19:04:06.772086] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 78 unique days, need 150 days [2025-09-14T19:04:06.772470] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:04:06.772526] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:04:06.772575] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-14T19:04:06.772659] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-14T19:04:06.772710] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-14T19:04:06.772806] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-14T19:04:06.772892] [INFO ] [MAIN ] Update Progress: 1383/2370 symbols completed. MNTN took 33.6s. Estimated remaining: 1h 44m 51s. Rate: 9.4 symbols/min [2025-09-14T19:04:06.941820] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:06.964187] [DEBUG] [LOCAL ] MODG: Loaded 23213 existing records from primary storage. [2025-09-14T19:04:06.964367] [INFO ] [MAIN ] MODG: Loaded 23213 existing records. [2025-09-14T19:04:07.154332] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:07.154631] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-14T19:04:07.154711] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-14T19:04:07.155329] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-14T19:04:07.155414] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-14T19:04:07.508101] [INFO ] [REMOTE ] MODG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:07.508456] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-14T19:04:09.171266] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:04:09.181448] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-14T19:04:10.894261] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (15.46 seconds). [2025-09-14T19:04:10.906219] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-14T19:04:11.111134] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T19:04:11.122718] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-14T19:04:11.644873] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:04:11.650546] [INFO ] [REMOTE ] MO: Full fetch complete (58433 records). [2025-09-14T19:04:11.650748] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-14T19:04:12.051819] [DEBUG] [VALIDATOR ] MO: All expected trading days are present. [2025-09-14T19:04:12.052002] [DEBUG] [VALIDATOR ] MO: Primary data validation passed. [2025-09-14T19:04:12.053699] [INFO ] [MAIN ] MO: Fetched primary data is valid. [2025-09-14T19:04:12.053790] [DEBUG] [LOCAL ] MO: Saving primary data. [2025-09-14T19:04:12.055712] [DEBUG] [LOCAL ] MO: Trimmed 58433 records to 40494 (keeping 150 days of data) [2025-09-14T19:04:12.332707] [DEBUG] [LOCAL ] MO: Primary data saved (40494 records). [2025-09-14T19:04:12.332917] [INFO ] [MAIN ] MO: Full history saved. [2025-09-14T19:04:12.333052] [INFO ] [MAIN ] Update Progress: 1384/2370 symbols completed. MO took 32.5s. Estimated remaining: 1h 44m 44s. Rate: 9.4 symbols/min [2025-09-14T19:04:12.529912] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:12.553447] [DEBUG] [LOCAL ] MOH: Loaded 21101 existing records from primary storage. [2025-09-14T19:04:12.553710] [INFO ] [MAIN ] MOH: Loaded 21101 existing records. [2025-09-14T19:04:12.738002] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:12.738327] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-14T19:04:12.738392] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-14T19:04:12.739061] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-14T19:04:12.739129] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-14T19:04:13.107820] [INFO ] [REMOTE ] MOH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:13.108392] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-14T19:04:13.149355] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T19:04:13.161561] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-14T19:04:14.965457] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T19:04:14.982110] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-14T19:04:16.543069] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (18.68 seconds). [2025-09-14T19:04:16.553502] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-14T19:04:16.922749] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T19:04:16.934676] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-14T19:04:18.014667] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T19:04:18.024230] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-14T19:04:18.510303] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:04:18.522499] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-14T19:04:19.781437] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T19:04:19.792330] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-14T19:04:20.240827] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T19:04:20.252509] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-14T19:04:20.961672] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:04:20.967800] [INFO ] [REMOTE ] MODG: Full fetch complete (56152 records). [2025-09-14T19:04:20.967970] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-14T19:04:21.377120] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-14T19:04:21.377306] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-14T19:04:21.378402] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-14T19:04:21.378488] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-14T19:04:21.389522] [DEBUG] [LOCAL ] MODG: Trimmed 56152 records to 38900 (keeping 150 days of data) [2025-09-14T19:04:21.408299] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:04:21.504246] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-14T19:04:21.541071] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (19.44 seconds). [2025-09-14T19:04:21.556673] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-14T19:04:21.714622] [DEBUG] [LOCAL ] MODG: Primary data saved (38900 records). [2025-09-14T19:04:21.714841] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-14T19:04:21.714971] [INFO ] [MAIN ] Update Progress: 1385/2370 symbols completed. MODG took 14.9s. Estimated remaining: 1h 44m 40s. Rate: 9.4 symbols/min [2025-09-14T19:04:21.896095] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:21.921808] [DEBUG] [LOCAL ] MOS: Loaded 23937 existing records from primary storage. [2025-09-14T19:04:21.922014] [INFO ] [MAIN ] MOS: Loaded 23937 existing records. [2025-09-14T19:04:22.104685] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:22.104987] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-14T19:04:22.105059] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-14T19:04:22.105829] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-14T19:04:22.105905] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-14T19:04:22.478762] [INFO ] [REMOTE ] MOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:22.479149] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-14T19:04:24.340616] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T19:04:24.352857] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-14T19:04:25.780175] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (12.67 seconds). [2025-09-14T19:04:25.789022] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-14T19:04:26.213424] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T19:04:26.230036] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-14T19:04:27.285884] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T19:04:27.295002] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-14T19:04:27.311540] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (5.81 seconds). [2025-09-14T19:04:27.318566] [INFO ] [REMOTE ] MOD: Full fetch complete (50411 records). [2025-09-14T19:04:27.318765] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-14T19:04:27.744994] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-14T19:04:27.745134] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-14T19:04:27.746439] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-14T19:04:27.746520] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-14T19:04:27.748468] [DEBUG] [LOCAL ] MOD: Trimmed 50411 records to 33695 (keeping 150 days of data) [2025-09-14T19:04:27.984058] [DEBUG] [LOCAL ] MOD: Primary data saved (33695 records). [2025-09-14T19:04:27.984327] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-14T19:04:27.984506] [INFO ] [MAIN ] Update Progress: 1386/2370 symbols completed. MOD took 36.3s. Estimated remaining: 1h 44m 33s. Rate: 9.4 symbols/min [2025-09-14T19:04:28.182467] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:28.195219] [DEBUG] [LOCAL ] MOV: Loaded 8311 existing records from primary storage. [2025-09-14T19:04:28.195512] [INFO ] [MAIN ] MOV: Loaded 8311 existing records. [2025-09-14T19:04:28.397244] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:28.418081] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T19:04:28.418319] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-14T19:04:28.429498] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-14T19:04:28.430557] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-14T19:04:28.430615] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-14T19:04:28.431833] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-14T19:04:28.808204] [INFO ] [REMOTE ] MOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:28.808709] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-14T19:04:28.980637] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (7.42 seconds). [2025-09-14T19:04:28.985504] [INFO ] [REMOTE ] MNSO: Full fetch complete (48460 records). [2025-09-14T19:04:28.985727] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-14T19:04:29.339272] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T19:04:29.434316] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-14T19:04:29.434530] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-14T19:04:29.435482] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-14T19:04:29.436703] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-14T19:04:29.436940] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-14T19:04:29.438002] [DEBUG] [LOCAL ] MNSO: Trimmed 48460 records to 32461 (keeping 150 days of data) [2025-09-14T19:04:29.585978] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T19:04:29.629422] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-14T19:04:29.680702] [DEBUG] [LOCAL ] MNSO: Primary data saved (32461 records). [2025-09-14T19:04:29.680910] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-14T19:04:29.681040] [INFO ] [MAIN ] Update Progress: 1387/2370 symbols completed. MNSO took 58.0s. Estimated remaining: 1h 44m 24s. Rate: 9.4 symbols/min [2025-09-14T19:04:29.849529] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:29.873560] [DEBUG] [LOCAL ] MP: Loaded 24126 existing records from primary storage. [2025-09-14T19:04:29.873757] [INFO ] [MAIN ] MP: Loaded 24126 existing records. [2025-09-14T19:04:30.088816] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:30.089107] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-14T19:04:30.089171] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-14T19:04:30.089946] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-14T19:04:30.090011] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-14T19:04:30.454576] [INFO ] [REMOTE ] MP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:30.455120] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-14T19:04:30.506561] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T19:04:30.521289] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-14T19:04:30.565971] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T19:04:30.571853] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-14T19:04:31.006457] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T19:04:31.014625] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-14T19:04:31.647809] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T19:04:31.654827] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-14T19:04:32.409277] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T19:04:32.420603] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-14T19:04:32.514997] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T19:04:32.525724] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-14T19:04:32.577964] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T19:04:32.585389] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-14T19:04:32.933809] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T19:04:32.939402] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-14T19:04:34.026028] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T19:04:34.031542] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-14T19:04:34.496873] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T19:04:34.508465] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-14T19:04:34.582513] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T19:04:34.594335] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-14T19:04:35.127606] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T19:04:35.132069] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-14T19:04:36.308758] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:04:36.313316] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-14T19:04:36.829524] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-14T19:04:36.840911] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-14T19:04:36.862860] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T19:04:36.865702] [INFO ] [REMOTE ] MOV: Full fetch complete (24100 records). [2025-09-14T19:04:36.865813] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-14T19:04:37.246254] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-14T19:04:37.246384] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-14T19:04:37.247124] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-14T19:04:37.247188] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-14T19:04:37.248003] [DEBUG] [LOCAL ] MOV: Trimmed 24100 records to 15954 (keeping 150 days of data) [2025-09-14T19:04:37.352256] [DEBUG] [LOCAL ] MOV: Primary data saved (15954 records). [2025-09-14T19:04:37.352449] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-14T19:04:37.352561] [INFO ] [MAIN ] Update Progress: 1388/2370 symbols completed. MOV took 9.4s. Estimated remaining: 1h 44m 18s. Rate: 9.4 symbols/min [2025-09-14T19:04:37.522727] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:37.526835] [DEBUG] [LOCAL ] MPA: Loaded 2071 existing records from primary storage. [2025-09-14T19:04:37.526943] [INFO ] [MAIN ] MPA: Loaded 2071 existing records. [2025-09-14T19:04:37.700052] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:37.700286] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-14T19:04:37.700350] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-14T19:04:37.700605] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-14T19:04:37.700690] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-14T19:04:38.086911] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (5.67 seconds). [2025-09-14T19:04:38.085024] [INFO ] [REMOTE ] MPA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:38.098412] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-14T19:04:38.100243] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-14T19:04:39.159742] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-14T19:04:39.171365] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-14T19:04:41.905314] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (7.40 seconds). [2025-09-14T19:04:41.918632] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-14T19:04:42.204513] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (4.11 seconds). [2025-09-14T19:04:42.206370] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-14T19:04:42.583175] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:04:42.588396] [INFO ] [REMOTE ] MOH: Full fetch complete (45376 records). [2025-09-14T19:04:42.588537] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-14T19:04:42.697836] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T19:04:42.720036] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-14T19:04:42.969002] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-14T19:04:42.969133] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-14T19:04:42.969981] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-14T19:04:42.970045] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-14T19:04:42.971234] [DEBUG] [LOCAL ] MOH: Trimmed 45376 records to 32109 (keeping 150 days of data) [2025-09-14T19:04:43.174706] [DEBUG] [LOCAL ] MOH: Primary data saved (32109 records). [2025-09-14T19:04:43.174881] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-14T19:04:43.174981] [INFO ] [MAIN ] Update Progress: 1389/2370 symbols completed. MOH took 30.8s. Estimated remaining: 1h 44m 11s. Rate: 9.4 symbols/min [2025-09-14T19:04:43.362341] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:43.387310] [DEBUG] [LOCAL ] MPC: Loaded 23106 existing records from primary storage. [2025-09-14T19:04:43.387496] [INFO ] [MAIN ] MPC: Loaded 23106 existing records. [2025-09-14T19:04:43.567366] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:43.567667] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-14T19:04:43.567726] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-14T19:04:43.568634] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-14T19:04:43.568730] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-14T19:04:43.701167] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T19:04:43.755829] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-14T19:04:43.938833] [INFO ] [REMOTE ] MPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:43.939203] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-14T19:04:44.621354] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:04:44.623894] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-14T19:04:45.282294] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T19:04:45.284351] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-14T19:04:45.755002] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T19:04:45.765334] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-14T19:04:46.030032] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T19:04:46.032108] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-14T19:04:46.410381] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (8.31 seconds). [2025-09-14T19:04:46.423122] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-14T19:04:46.649421] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T19:04:46.651082] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-14T19:04:46.925735] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T19:04:46.931358] [INFO ] [REMOTE ] MOS: Full fetch complete (58191 records). [2025-09-14T19:04:46.931514] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-14T19:04:47.292742] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T19:04:47.311018] [INFO ] [REMOTE ] MPA: Full fetch complete (5702 records). [2025-09-14T19:04:47.329502] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-14T19:04:47.329664] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-14T19:04:47.330281] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-14T19:04:47.363168] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-14T19:04:47.405984] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-14T19:04:47.517747] [DEBUG] [LOCAL ] MOS: Trimmed 58191 records to 40283 (keeping 150 days of data) [2025-09-14T19:04:47.799734] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-14T19:04:47.800698] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-14T19:04:47.801975] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-14T19:04:47.803163] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-14T19:04:47.806506] [DEBUG] [LOCAL ] MPA: Trimmed 5702 records to 4029 (keeping 150 days of data) [2025-09-14T19:04:47.873097] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T19:04:47.885735] [DEBUG] [LOCAL ] MPA: Primary data saved (4029 records). [2025-09-14T19:04:47.886931] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-14T19:04:47.888150] [INFO ] [MAIN ] Update Progress: 1390/2370 symbols completed. MPA took 10.5s. Estimated remaining: 1h 44m 4s. Rate: 9.4 symbols/min [2025-09-14T19:04:47.889680] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-14T19:04:48.073739] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:48.192812] [DEBUG] [LOCAL ] MPLX: Loaded 22476 existing records from primary storage. [2025-09-14T19:04:48.193511] [INFO ] [MAIN ] MPLX: Loaded 22476 existing records. [2025-09-14T19:04:48.383194] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:48.383674] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-14T19:04:48.384482] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-14T19:04:48.386023] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-14T19:04:48.386413] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-14T19:04:48.824183] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:48.825478] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-14T19:04:48.834188] [DEBUG] [LOCAL ] MOS: Primary data saved (40283 records). [2025-09-14T19:04:48.834382] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-14T19:04:48.834504] [INFO ] [MAIN ] Update Progress: 1391/2370 symbols completed. MOS took 27.1s. Estimated remaining: 1h 43m 54s. Rate: 9.4 symbols/min [2025-09-14T19:04:49.007304] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:49.011082] [DEBUG] [LOCAL ] MPV: Loaded 1770 existing records from primary storage. [2025-09-14T19:04:49.011187] [INFO ] [MAIN ] MPV: Loaded 1770 existing records. [2025-09-14T19:04:49.188569] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:49.188858] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-14T19:04:49.188916] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-14T19:04:49.189174] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-14T19:04:49.189232] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-14T19:04:49.545666] [INFO ] [REMOTE ] MPV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:49.546027] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-14T19:04:50.012139] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T19:04:50.025276] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-14T19:04:50.049348] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T19:04:50.051484] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-14T19:04:50.942059] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T19:04:50.944532] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-14T19:04:51.669783] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T19:04:51.671815] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-14T19:04:52.256433] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (13.09 seconds). [2025-09-14T19:04:52.269563] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-14T19:04:52.329967] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T19:04:52.331909] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-14T19:04:53.026779] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T19:04:53.028763] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-14T19:04:53.740609] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T19:04:53.742366] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-14T19:04:55.151549] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-14T19:04:55.163827] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-14T19:04:57.613057] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-14T19:04:57.626532] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-14T19:04:58.387751] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:04:58.393343] [INFO ] [REMOTE ] MP: Full fetch complete (58246 records). [2025-09-14T19:04:58.393488] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-14T19:04:58.775745] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-14T19:04:58.775869] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-14T19:04:58.776831] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-14T19:04:58.776911] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-14T19:04:58.778221] [DEBUG] [LOCAL ] MP: Trimmed 58246 records to 40484 (keeping 150 days of data) [2025-09-14T19:04:59.034367] [DEBUG] [LOCAL ] MP: Primary data saved (40484 records). [2025-09-14T19:04:59.034519] [INFO ] [MAIN ] MP: Full history saved. [2025-09-14T19:04:59.034617] [INFO ] [MAIN ] Update Progress: 1392/2370 symbols completed. MP took 29.4s. Estimated remaining: 1h 43m 50s. Rate: 9.4 symbols/min [2025-09-14T19:04:59.205493] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:59.227466] [DEBUG] [LOCAL ] MPW: Loaded 23996 existing records from primary storage. [2025-09-14T19:04:59.227628] [INFO ] [MAIN ] MPW: Loaded 23996 existing records. [2025-09-14T19:04:59.403182] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:59.403460] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-14T19:04:59.403520] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-14T19:04:59.404257] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-14T19:04:59.404319] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-14T19:04:59.754579] [INFO ] [REMOTE ] MPW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:59.754956] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-14T19:05:00.092538] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (11.27 seconds). [2025-09-14T19:05:00.103107] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-14T19:05:01.589000] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T19:05:01.599525] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-14T19:05:01.852429] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T19:05:01.869148] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-14T19:05:03.879187] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-14T19:05:03.891468] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-14T19:05:04.000929] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T19:05:04.012858] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-14T19:05:05.480372] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (15.46 seconds). [2025-09-14T19:05:05.492080] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-14T19:05:05.806541] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T19:05:05.821924] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-14T19:05:06.213915] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (12.47 seconds). [2025-09-14T19:05:06.215914] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-14T19:05:06.504806] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-14T19:05:06.516430] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-14T19:05:06.799242] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T19:05:06.800472] [INFO ] [REMOTE ] MPV: Full fetch complete (5856 records). [2025-09-14T19:05:06.800565] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-14T19:05:07.157405] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-14T19:05:07.157516] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-14T19:05:07.157747] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-14T19:05:07.157807] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-14T19:05:07.158267] [DEBUG] [LOCAL ] MPV: Trimmed 5856 records to 3390 (keeping 150 days of data) [2025-09-14T19:05:07.179950] [DEBUG] [LOCAL ] MPV: Primary data saved (3390 records). [2025-09-14T19:05:07.180061] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-14T19:05:07.180163] [INFO ] [MAIN ] Update Progress: 1393/2370 symbols completed. MPV took 18.3s. Estimated remaining: 1h 43m 45s. Rate: 9.4 symbols/min [2025-09-14T19:05:07.349599] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:07.353076] [DEBUG] [LOCAL ] MPX: Loaded 1680 existing records from primary storage. [2025-09-14T19:05:07.353181] [INFO ] [MAIN ] MPX: Loaded 1680 existing records. [2025-09-14T19:05:07.565337] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:07.566289] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-14T19:05:07.566381] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-14T19:05:07.566813] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-14T19:05:07.566888] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-14T19:05:07.941216] [INFO ] [REMOTE ] MPX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:07.941787] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-14T19:05:08.274856] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T19:05:08.286298] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-14T19:05:13.273800] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (7.78 seconds). [2025-09-14T19:05:13.284569] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-14T19:05:15.322991] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T19:05:15.334588] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-14T19:05:22.222256] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (16.40 seconds). [2025-09-14T19:05:22.233761] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-14T19:05:23.260715] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (15.32 seconds). [2025-09-14T19:05:23.262802] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-14T19:05:24.010401] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T19:05:24.012425] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-14T19:05:24.206286] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T19:05:24.217778] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-14T19:05:24.751241] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T19:05:24.753253] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-14T19:05:25.400765] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T19:05:25.402473] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-14T19:05:26.032033] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T19:05:26.033685] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-14T19:05:26.203549] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T19:05:26.215341] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-14T19:05:26.703072] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T19:05:26.705264] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-14T19:05:27.289813] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T19:05:27.291407] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-14T19:05:27.495020] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (19.21 seconds). [2025-09-14T19:05:27.505779] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-14T19:05:27.850819] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:05:27.852034] [INFO ] [REMOTE ] MPX: Full fetch complete (4902 records). [2025-09-14T19:05:27.852132] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-14T19:05:28.218140] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-14T19:05:28.218249] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-14T19:05:28.218423] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-14T19:05:28.218474] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-14T19:05:28.218899] [DEBUG] [LOCAL ] MPX: Trimmed 4902 records to 2890 (keeping 150 days of data) [2025-09-14T19:05:28.236889] [DEBUG] [LOCAL ] MPX: Primary data saved (2890 records). [2025-09-14T19:05:28.236963] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-14T19:05:28.237049] [INFO ] [MAIN ] Update Progress: 1394/2370 symbols completed. MPX took 21.1s. Estimated remaining: 1h 43m 49s. Rate: 9.4 symbols/min [2025-09-14T19:05:28.405277] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:28.410669] [DEBUG] [LOCAL ] MQT: Loaded 3345 existing records from primary storage. [2025-09-14T19:05:28.410777] [INFO ] [MAIN ] MQT: Loaded 3345 existing records. [2025-09-14T19:05:28.585340] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:28.585608] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-14T19:05:28.585685] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-14T19:05:28.585983] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-14T19:05:28.586041] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-14T19:05:28.938000] [INFO ] [REMOTE ] MQT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:28.938664] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-14T19:05:29.229161] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T19:05:29.240222] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-14T19:05:29.756873] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T19:05:29.759722] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-14T19:05:30.580315] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T19:05:30.583072] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-14T19:05:30.742265] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T19:05:30.747614] [INFO ] [REMOTE ] MPLX: Full fetch complete (55399 records). [2025-09-14T19:05:30.747861] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-14T19:05:31.152744] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-14T19:05:31.152907] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-14T19:05:31.154326] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-14T19:05:31.154407] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-14T19:05:31.156318] [DEBUG] [LOCAL ] MPLX: Trimmed 55399 records to 37896 (keeping 150 days of data) [2025-09-14T19:05:31.421808] [DEBUG] [LOCAL ] MPLX: Primary data saved (37896 records). [2025-09-14T19:05:31.422031] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-14T19:05:31.422161] [INFO ] [MAIN ] Update Progress: 1395/2370 symbols completed. MPLX took 43.5s. Estimated remaining: 1h 43m 40s. Rate: 9.4 symbols/min [2025-09-14T19:05:31.625591] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T19:05:31.624851] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:31.630091] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-14T19:05:31.640059] [DEBUG] [LOCAL ] MQY: Loaded 7188 existing records from primary storage. [2025-09-14T19:05:31.640211] [INFO ] [MAIN ] MQY: Loaded 7188 existing records. [2025-09-14T19:05:31.818413] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:31.818744] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-14T19:05:31.818810] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-14T19:05:31.819210] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-14T19:05:31.819271] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-14T19:05:32.159763] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (16.83 seconds). [2025-09-14T19:05:32.220925] [INFO ] [REMOTE ] MQY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:32.221676] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-14T19:05:32.222740] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-14T19:05:32.301831] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:05:32.303824] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-14T19:05:32.891608] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T19:05:32.897121] [INFO ] [REMOTE ] MPC: Full fetch complete (56795 records). [2025-09-14T19:05:32.897292] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-14T19:05:33.178797] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T19:05:33.219572] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-14T19:05:33.294864] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-14T19:05:33.295023] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-14T19:05:33.296101] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-14T19:05:33.296218] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-14T19:05:33.308826] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:05:33.312910] [DEBUG] [LOCAL ] MPC: Trimmed 56795 records to 39139 (keeping 150 days of data) [2025-09-14T19:05:33.313446] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-14T19:05:33.599139] [DEBUG] [LOCAL ] MPC: Primary data saved (39139 records). [2025-09-14T19:05:33.599385] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-14T19:05:33.599526] [INFO ] [MAIN ] Update Progress: 1396/2370 symbols completed. MPC took 50.4s. Estimated remaining: 1h 43m 31s. Rate: 9.4 symbols/min [2025-09-14T19:05:33.787567] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:33.804671] [DEBUG] [LOCAL ] MRC: Loaded 16300 existing records from primary storage. [2025-09-14T19:05:33.804843] [INFO ] [MAIN ] MRC: Loaded 16300 existing records. [2025-09-14T19:05:33.996744] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:33.997008] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-14T19:05:33.997066] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-14T19:05:33.997602] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-14T19:05:33.997687] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-14T19:05:34.391083] [INFO ] [REMOTE ] MRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:34.391486] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-14T19:05:34.454836] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T19:05:34.459378] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-14T19:05:35.195898] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (8.98 seconds). [2025-09-14T19:05:35.207497] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-14T19:05:35.508051] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-14T19:05:35.510923] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-14T19:05:35.524729] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T19:05:35.529914] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-14T19:05:35.880741] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T19:05:35.889542] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-14T19:05:35.904780] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:05:35.910741] [INFO ] [REMOTE ] MPW: Full fetch complete (58153 records). [2025-09-14T19:05:35.910941] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-14T19:05:36.034601] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T19:05:36.076403] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-14T19:05:36.315377] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-14T19:05:36.315577] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-14T19:05:36.316490] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-14T19:05:36.316658] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-14T19:05:36.326329] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T19:05:36.330183] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-14T19:05:36.331186] [DEBUG] [LOCAL ] MPW: Trimmed 58153 records to 40288 (keeping 150 days of data) [2025-09-14T19:05:36.609922] [DEBUG] [LOCAL ] MPW: Primary data saved (40288 records). [2025-09-14T19:05:36.610086] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-14T19:05:36.610186] [INFO ] [MAIN ] Update Progress: 1397/2370 symbols completed. MPW took 37.6s. Estimated remaining: 1h 43m 22s. Rate: 9.4 symbols/min [2025-09-14T19:05:36.676246] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T19:05:36.678069] [INFO ] [REMOTE ] MQT: Full fetch complete (9466 records). [2025-09-14T19:05:36.678200] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-14T19:05:37.050233] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-14T19:05:37.050345] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-14T19:05:37.050593] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-14T19:05:37.050664] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-14T19:05:37.051123] [DEBUG] [LOCAL ] MQT: Trimmed 9466 records to 5655 (keeping 150 days of data) [2025-09-14T19:05:37.086470] [DEBUG] [LOCAL ] MQT: Primary data saved (5655 records). [2025-09-14T19:05:37.086678] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-14T19:05:37.086838] [INFO ] [MAIN ] Update Progress: 1398/2370 symbols completed. MQT took 8.8s. Estimated remaining: 1h 43m 12s. Rate: 9.4 symbols/min [2025-09-14T19:05:37.217141] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T19:05:37.225829] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-14T19:05:37.375164] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T19:05:37.379065] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-14T19:05:38.586477] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T19:05:38.590524] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-14T19:05:38.919315] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T19:05:38.928085] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-14T19:05:39.262693] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T19:05:39.267822] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-14T19:05:40.186842] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T19:05:40.189578] [INFO ] [REMOTE ] MQY: Full fetch complete (18419 records). [2025-09-14T19:05:40.189721] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-14T19:05:40.560964] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-14T19:05:40.561097] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-14T19:05:40.561576] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-14T19:05:40.561657] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-14T19:05:40.562498] [DEBUG] [LOCAL ] MQY: Trimmed 18419 records to 11827 (keeping 150 days of data) [2025-09-14T19:05:40.637912] [DEBUG] [LOCAL ] MQY: Primary data saved (11827 records). [2025-09-14T19:05:40.638104] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-14T19:05:40.638241] [INFO ] [MAIN ] Update Progress: 1399/2370 symbols completed. MQY took 9.2s. Estimated remaining: 1h 43m 3s. Rate: 9.4 symbols/min [2025-09-14T19:05:41.530047] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-14T19:05:41.537934] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-14T19:05:43.007397] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T19:05:43.014959] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-14T19:05:44.631576] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T19:05:44.641572] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-14T19:05:46.232130] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T19:05:46.239968] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-14T19:05:47.318264] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T19:05:47.321711] [INFO ] [REMOTE ] MRC: Full fetch complete (41119 records). [2025-09-14T19:05:47.321827] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-14T19:05:47.694172] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-14T19:05:47.694319] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-14T19:05:47.695083] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-14T19:05:47.695149] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-14T19:05:47.696181] [DEBUG] [LOCAL ] MRC: Trimmed 41119 records to 27384 (keeping 150 days of data) [2025-09-14T19:05:47.874269] [DEBUG] [LOCAL ] MRC: Primary data saved (27384 records). [2025-09-14T19:05:47.874456] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-14T19:05:47.874590] [INFO ] [MAIN ] Update Progress: 1400/2370 symbols completed. MRC took 14.3s. Estimated remaining: 1h 42m 58s. Rate: 9.4 symbols/min [2025-09-14T19:05:48.516802] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:48.579885] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:48.627794] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:48.660748] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:48.673687] [DEBUG] [LOCAL ] MSA: Loaded 8101 existing records from primary storage. [2025-09-14T19:05:48.684406] [INFO ] [MAIN ] MSA: Loaded 8101 existing records. [2025-09-14T19:05:48.802467] [DEBUG] [LOCAL ] MRK: Loaded 24152 existing records from primary storage. [2025-09-14T19:05:48.812986] [DEBUG] [LOCAL ] MRP: Loaded 21045 existing records from primary storage. [2025-09-14T19:05:48.831367] [INFO ] [MAIN ] MRP: Loaded 21045 existing records. [2025-09-14T19:05:48.831036] [INFO ] [MAIN ] MRK: Loaded 24152 existing records. [2025-09-14T19:05:48.858086] [DEBUG] [LOCAL ] MS: Loaded 24065 existing records from primary storage. [2025-09-14T19:05:48.904818] [INFO ] [MAIN ] MS: Loaded 24065 existing records. [2025-09-14T19:05:49.022248] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:49.177149] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-14T19:05:49.241699] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-14T19:05:49.399708] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-14T19:05:49.408132] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:49.432566] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-14T19:05:49.458905] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-14T19:05:49.452501] [WARN ] [MAIN ] MRP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:49.509981] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-14T19:05:49.510066] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-14T19:05:49.587515] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-14T19:05:49.582260] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:49.606749] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-14T19:05:49.612221] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-14T19:05:49.624570] [DEBUG] [LOCAL ] MRP: Deleted primary data file. [2025-09-14T19:05:49.619148] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-14T19:05:49.645420] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-14T19:05:49.645487] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-14T19:05:49.743551] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-14T19:05:49.837458] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-14T19:05:50.782658] [INFO ] [REMOTE ] MSA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:50.884771] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-14T19:05:50.904401] [INFO ] [REMOTE ] MRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:50.979145] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-14T19:05:51.014114] [INFO ] [REMOTE ] MRP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:51.039464] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-14T19:05:51.044145] [INFO ] [REMOTE ] MS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:51.045272] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-14T19:05:52.002120] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T19:05:52.012590] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-14T19:05:52.367496] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T19:05:52.371165] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-14T19:05:52.705132] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T19:05:52.713354] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-14T19:05:52.823917] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:05:52.835142] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-14T19:05:53.734816] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-14T19:05:53.745296] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-14T19:05:53.810528] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T19:05:53.822048] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-14T19:05:53.947461] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T19:05:53.951397] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-14T19:05:54.650403] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T19:05:54.661140] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-14T19:05:54.790247] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T19:05:54.802082] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-14T19:05:55.277778] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T19:05:55.283431] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-14T19:05:55.394363] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T19:05:55.405873] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-14T19:05:55.804956] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T19:05:55.816304] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-14T19:05:55.864744] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T19:05:55.875170] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-14T19:05:56.071374] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:05:56.075951] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-14T19:05:56.625251] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T19:05:56.638634] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-14T19:05:56.912422] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T19:05:56.916939] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-14T19:05:57.146874] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T19:05:57.157722] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-14T19:05:57.586793] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T19:05:57.598978] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-14T19:05:57.622468] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T19:05:57.626858] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-14T19:05:58.157677] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T19:05:58.169228] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-14T19:05:58.342358] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:05:58.348111] [INFO ] [REMOTE ] MS: Full fetch complete (58373 records). [2025-09-14T19:05:58.348314] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-14T19:05:58.743610] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-14T19:05:58.743850] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-14T19:05:58.744922] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-14T19:05:58.745098] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-14T19:05:58.746799] [DEBUG] [LOCAL ] MS: Trimmed 58373 records to 40437 (keeping 150 days of data) [2025-09-14T19:05:58.867527] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T19:05:58.885560] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-14T19:05:58.913421] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T19:05:58.920994] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-14T19:05:59.069261] [DEBUG] [LOCAL ] MS: Primary data saved (40437 records). [2025-09-14T19:05:59.069454] [INFO ] [MAIN ] MS: Full history saved. [2025-09-14T19:05:59.069576] [INFO ] [MAIN ] Update Progress: 1401/2370 symbols completed. MS took 11.2s. Estimated remaining: 1h 42m 55s. Rate: 9.4 symbols/min [2025-09-14T19:05:59.238190] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:59.243857] [DEBUG] [LOCAL ] MSB: Loaded 3850 existing records from primary storage. [2025-09-14T19:05:59.243997] [INFO ] [MAIN ] MSB: Loaded 3850 existing records. [2025-09-14T19:05:59.426755] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:59.427688] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T19:05:59.427976] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-14T19:05:59.430241] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-14T19:05:59.430347] [INFO ] [REMOTE ] MSA: Full fetch complete (20209 records). [2025-09-14T19:05:59.430597] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-14T19:05:59.430835] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-14T19:05:59.500852] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-14T19:06:00.122612] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-14T19:06:00.133443] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-14T19:06:00.149729] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-14T19:06:00.179702] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-14T19:06:00.202377] [INFO ] [REMOTE ] MSB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:00.202832] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-14T19:06:00.204316] [DEBUG] [LOCAL ] MSA: Trimmed 20209 records to 14092 (keeping 150 days of data) [2025-09-14T19:06:00.305582] [DEBUG] [LOCAL ] MSA: Primary data saved (14092 records). [2025-09-14T19:06:00.305926] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-14T19:06:00.306146] [INFO ] [MAIN ] Update Progress: 1402/2370 symbols completed. MSA took 12.4s. Estimated remaining: 1h 42m 45s. Rate: 9.4 symbols/min [2025-09-14T19:06:00.482321] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:00.486100] [DEBUG] [LOCAL ] MSC: Loaded 882 existing records from primary storage. [2025-09-14T19:06:00.486218] [INFO ] [MAIN ] MSC: Loaded 882 existing records. [2025-09-14T19:06:00.709349] [WARN ] [MAIN ] MSC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:00.712931] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-14T19:06:00.713442] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-14T19:06:00.725391] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-14T19:06:00.726157] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-14T19:06:00.726301] [DEBUG] [LOCAL ] MSC: Deleted primary data file. [2025-09-14T19:06:00.726440] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-14T19:06:01.036939] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-14T19:06:01.092258] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-14T19:06:01.154599] [INFO ] [REMOTE ] MSC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:01.155071] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-14T19:06:01.687550] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T19:06:01.690567] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-14T19:06:03.618886] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-14T19:06:03.630067] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-14T19:06:04.477254] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (3.32 seconds). [2025-09-14T19:06:04.478881] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-14T19:06:04.601963] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (3.51 seconds). [2025-09-14T19:06:04.612903] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-14T19:06:05.001874] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-09-14T19:06:05.004338] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-14T19:06:05.166062] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T19:06:05.171139] [INFO ] [REMOTE ] MRP: Full fetch complete (51838 records). [2025-09-14T19:06:05.171306] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-14T19:06:05.557488] [DEBUG] [VALIDATOR ] MRP: All expected trading days are present. [2025-09-14T19:06:05.557599] [DEBUG] [VALIDATOR ] MRP: Primary data validation passed. [2025-09-14T19:06:05.558496] [INFO ] [MAIN ] MRP: Fetched primary data is valid. [2025-09-14T19:06:05.558555] [DEBUG] [LOCAL ] MRP: Saving primary data. [2025-09-14T19:06:05.561118] [DEBUG] [LOCAL ] MRP: Trimmed 51838 records to 34842 (keeping 150 days of data) [2025-09-14T19:06:05.791266] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T19:06:05.793366] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-14T19:06:05.799441] [DEBUG] [LOCAL ] MRP: Primary data saved (34842 records). [2025-09-14T19:06:05.799586] [INFO ] [MAIN ] MRP: Full history saved. [2025-09-14T19:06:05.800990] [INFO ] [MAIN ] Update Progress: 1403/2370 symbols completed. MRP took 17.9s. Estimated remaining: 1h 42m 38s. Rate: 9.4 symbols/min [2025-09-14T19:06:05.931451] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T19:06:05.965350] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-14T19:06:05.984257] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:06.003585] [DEBUG] [LOCAL ] MSCI: Loaded 16641 existing records from primary storage. [2025-09-14T19:06:06.003809] [INFO ] [MAIN ] MSCI: Loaded 16641 existing records. [2025-09-14T19:06:06.186805] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:06.187107] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-14T19:06:06.187275] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-14T19:06:06.187932] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-14T19:06:06.187993] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-14T19:06:06.250217] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T19:06:06.277011] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-14T19:06:06.597285] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:06.599677] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-14T19:06:06.599968] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-14T19:06:06.709446] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-14T19:06:06.715593] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T19:06:06.958829] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-14T19:06:07.386962] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-14T19:06:07.758820] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-14T19:06:08.119948] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T19:06:08.558840] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-14T19:06:08.735284] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:06:09.006621] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T19:06:09.358897] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-14T19:06:10.158933] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-14T19:06:10.621531] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-14T19:06:10.958844] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-14T19:06:11.758833] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-14T19:06:11.806070] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-14T19:06:11.849253] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T19:06:12.126979] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T19:06:12.128072] [INFO ] [REMOTE ] MSC: Full fetch complete (1871 records). [2025-09-14T19:06:12.128155] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-14T19:06:12.313009] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T19:06:12.313218] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:06:12.313287] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:06:12.313376] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-14T19:06:12.313467] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-14T19:06:12.313533] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-14T19:06:12.313627] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-14T19:06:12.313751] [INFO ] [MAIN ] Update Progress: 1404/2370 symbols completed. MSC took 12.0s. Estimated remaining: 1h 42m 31s. Rate: 9.4 symbols/min [2025-09-14T19:06:12.528292] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:12.542159] [DEBUG] [LOCAL ] MSD: Loaded 8141 existing records from primary storage. [2025-09-14T19:06:12.542320] [INFO ] [MAIN ] MSD: Loaded 8141 existing records. [2025-09-14T19:06:12.563887] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-14T19:06:12.725156] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:12.725424] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-14T19:06:12.725485] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-14T19:06:12.725918] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-14T19:06:12.725988] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-14T19:06:13.084051] [INFO ] [REMOTE ] MSD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:13.358837] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-14T19:06:14.158852] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-14T19:06:14.227422] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:06:14.620120] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T19:06:14.958856] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-14T19:06:15.758876] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-14T19:06:16.202662] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-14T19:06:16.209270] [INFO ] [REMOTE ] MRK: Full fetch complete (58469 records). [2025-09-14T19:06:16.209468] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-14T19:06:16.565448] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-14T19:06:16.623709] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-14T19:06:16.623833] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-14T19:06:16.625062] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-14T19:06:16.625131] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-14T19:06:16.627042] [DEBUG] [LOCAL ] MRK: Trimmed 58469 records to 40530 (keeping 150 days of data) [2025-09-14T19:06:16.702817] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T19:06:16.731826] [INFO ] [REMOTE ] MSB: Full fetch complete (9232 records). [2025-09-14T19:06:16.734962] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-14T19:06:17.129283] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-14T19:06:17.133094] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-14T19:06:17.134004] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-14T19:06:17.135381] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-14T19:06:17.150211] [DEBUG] [LOCAL ] MSB: Trimmed 9232 records to 6124 (keeping 150 days of data) [2025-09-14T19:06:17.300839] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T19:06:17.347703] [DEBUG] [LOCAL ] MSB: Primary data saved (6124 records). [2025-09-14T19:06:17.349459] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-14T19:06:17.350411] [INFO ] [MAIN ] Update Progress: 1405/2370 symbols completed. MSB took 18.3s. Estimated remaining: 1h 42m 24s. Rate: 9.4 symbols/min [2025-09-14T19:06:17.367559] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-14T19:06:17.400559] [DEBUG] [LOCAL ] MRK: Primary data saved (40530 records). [2025-09-14T19:06:17.441497] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-14T19:06:17.462728] [INFO ] [MAIN ] Update Progress: 1406/2370 symbols completed. MRK took 29.6s. Estimated remaining: 1h 42m 14s. Rate: 9.4 symbols/min [2025-09-14T19:06:17.647790] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:17.721072] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:17.740460] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T19:06:17.754517] [DEBUG] [LOCAL ] MSDL: Loaded 17394 existing records from primary storage. [2025-09-14T19:06:17.758937] [DEBUG] [LOCAL ] MSGE: Loaded 11998 existing records from primary storage. [2025-09-14T19:06:17.759010] [INFO ] [MAIN ] MSDL: Loaded 17394 existing records. [2025-09-14T19:06:17.790449] [INFO ] [MAIN ] MSGE: Loaded 11998 existing records. [2025-09-14T19:06:18.122388] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:18.144781] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:18.139021] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-14T19:06:18.145177] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-14T19:06:18.145226] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-14T19:06:18.145341] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-14T19:06:18.145993] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-14T19:06:18.146065] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-14T19:06:18.146097] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-14T19:06:18.168239] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-14T19:06:18.184876] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-14T19:06:18.780434] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:18.871453] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:18.888815] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T19:06:18.958831] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-14T19:06:19.242162] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:06:19.758846] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-14T19:06:20.471680] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T19:06:20.558773] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-14T19:06:20.749608] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T19:06:21.358839] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-14T19:06:21.999506] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T19:06:22.036023] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T19:06:22.158837] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-14T19:06:22.958861] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-14T19:06:23.275629] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T19:06:23.758887] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-14T19:06:24.204373] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T19:06:24.558824] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-14T19:06:25.013911] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T19:06:25.358901] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-14T19:06:25.854679] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T19:06:26.158914] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-14T19:06:26.771250] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T19:06:26.958912] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-14T19:06:27.563202] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T19:06:27.758919] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-14T19:06:28.321759] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T19:06:28.558944] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-14T19:06:28.902256] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T19:06:29.358882] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-14T19:06:29.441205] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T19:06:30.158871] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-14T19:06:30.821151] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T19:06:30.958870] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-14T19:06:31.382721] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T19:06:31.758872] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-14T19:06:32.443952] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T19:06:32.558850] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-14T19:06:32.738611] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T19:06:33.358862] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-14T19:06:34.134053] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:06:34.158778] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-14T19:06:34.521482] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T19:06:34.958881] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-14T19:06:35.703872] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T19:06:35.758842] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-14T19:06:36.156013] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T19:06:36.558911] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-14T19:06:36.913396] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T19:06:36.918199] [INFO ] [REMOTE ] MSDL: Full fetch complete (41535 records). [2025-09-14T19:06:36.918317] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-14T19:06:37.319327] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-14T19:06:37.319454] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-14T19:06:37.320296] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-14T19:06:37.320359] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-14T19:06:37.321529] [DEBUG] [LOCAL ] MSDL: Trimmed 41535 records to 27502 (keeping 150 days of data) [2025-09-14T19:06:37.377818] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-14T19:06:37.521628] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T19:06:37.533058] [DEBUG] [LOCAL ] MSDL: Primary data saved (27502 records). [2025-09-14T19:06:37.533272] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-14T19:06:37.533411] [INFO ] [MAIN ] Update Progress: 1407/2370 symbols completed. MSDL took 20.2s. Estimated remaining: 1h 42m 17s. Rate: 9.4 symbols/min [2025-09-14T19:06:37.711370] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:37.722041] [DEBUG] [LOCAL ] MSGS: Loaded 8288 existing records from primary storage. [2025-09-14T19:06:37.722243] [INFO ] [MAIN ] MSGS: Loaded 8288 existing records. [2025-09-14T19:06:37.906371] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:37.906671] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-14T19:06:37.906730] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-14T19:06:37.907113] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-14T19:06:37.907173] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-14T19:06:38.159299] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-14T19:06:38.267475] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:38.394412] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T19:06:38.396934] [INFO ] [REMOTE ] MSD: Full fetch complete (16782 records). [2025-09-14T19:06:38.397021] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-14T19:06:38.798377] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-14T19:06:38.798512] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-14T19:06:38.799014] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-14T19:06:38.799094] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-14T19:06:38.799831] [DEBUG] [LOCAL ] MSD: Trimmed 16782 records to 12044 (keeping 150 days of data) [2025-09-14T19:06:38.884813] [DEBUG] [LOCAL ] MSD: Primary data saved (12044 records). [2025-09-14T19:06:38.885178] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-14T19:06:38.885378] [INFO ] [MAIN ] Update Progress: 1408/2370 symbols completed. MSD took 26.6s. Estimated remaining: 1h 42m 7s. Rate: 9.4 symbols/min [2025-09-14T19:06:38.960320] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-14T19:06:39.003106] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T19:06:39.025678] [INFO ] [REMOTE ] MSCI: Full fetch complete (37934 records). [2025-09-14T19:06:39.065364] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-14T19:06:39.118773] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:39.389383] [DEBUG] [LOCAL ] MSI: Loaded 17771 existing records from primary storage. [2025-09-14T19:06:39.392280] [INFO ] [MAIN ] MSI: Loaded 17771 existing records. [2025-09-14T19:06:39.605877] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-14T19:06:39.616248] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-14T19:06:39.627504] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-14T19:06:39.627619] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-14T19:06:39.693467] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:39.694078] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-14T19:06:39.694204] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-14T19:06:39.694615] [DEBUG] [LOCAL ] MSCI: Trimmed 37934 records to 25461 (keeping 150 days of data) [2025-09-14T19:06:39.695680] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-14T19:06:39.695807] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-14T19:06:39.786728] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-14T19:06:40.185896] [INFO ] [REMOTE ] MSI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:40.213182] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T19:06:40.255735] [DEBUG] [LOCAL ] MSCI: Primary data saved (25461 records). [2025-09-14T19:06:40.255966] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-14T19:06:40.256110] [INFO ] [MAIN ] Update Progress: 1409/2370 symbols completed. MSCI took 34.5s. Estimated remaining: 1h 41m 57s. Rate: 9.4 symbols/min [2025-09-14T19:06:40.430579] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:40.441710] [DEBUG] [LOCAL ] MSIF: Loaded 8040 existing records from primary storage. [2025-09-14T19:06:40.441922] [INFO ] [MAIN ] MSIF: Loaded 8040 existing records. [2025-09-14T19:06:40.564011] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-14T19:06:40.626320] [WARN ] [MAIN ] MSIF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:40.626663] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-14T19:06:40.626733] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-14T19:06:40.627138] [DEBUG] [LOCAL ] MSIF: Deleted primary data file. [2025-09-14T19:06:40.627204] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-14T19:06:41.036317] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:41.037748] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T19:06:41.041979] [INFO ] [REMOTE ] MSGE: Full fetch complete (29356 records). [2025-09-14T19:06:41.042112] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-14T19:06:41.364103] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-14T19:06:41.451891] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-14T19:06:41.452055] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-14T19:06:41.453779] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-14T19:06:41.453868] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-14T19:06:41.455246] [DEBUG] [LOCAL ] MSGE: Trimmed 29356 records to 19384 (keeping 150 days of data) [2025-09-14T19:06:41.590091] [DEBUG] [LOCAL ] MSGE: Primary data saved (19384 records). [2025-09-14T19:06:41.590346] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-14T19:06:41.590493] [INFO ] [MAIN ] Update Progress: 1410/2370 symbols completed. MSGE took 24.1s. Estimated remaining: 1h 41m 47s. Rate: 9.4 symbols/min [2025-09-14T19:06:41.776538] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:41.790521] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T19:06:41.813193] [DEBUG] [LOCAL ] MSM: Loaded 16024 existing records from primary storage. [2025-09-14T19:06:41.813421] [INFO ] [MAIN ] MSM: Loaded 16024 existing records. [2025-09-14T19:06:42.014536] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:42.014917] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-14T19:06:42.015030] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-14T19:06:42.015670] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-14T19:06:42.015738] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-14T19:06:42.163997] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-14T19:06:42.365676] [INFO ] [REMOTE ] MSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:42.445349] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T19:06:42.958808] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-14T19:06:43.256011] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T19:06:43.765576] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-14T19:06:43.767176] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T19:06:44.558852] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-14T19:06:44.654872] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T19:06:45.358798] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-14T19:06:45.464122] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T19:06:46.117529] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T19:06:46.158805] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-14T19:06:46.805897] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T19:06:46.958891] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-14T19:06:47.758824] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-14T19:06:48.023235] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T19:06:48.558839] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-14T19:06:48.820940] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T19:06:49.358851] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-14T19:06:49.404230] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T19:06:50.158888] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-14T19:06:50.792850] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T19:06:50.958848] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-14T19:06:50.998561] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T19:06:51.758886] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-14T19:06:52.424987] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:06:52.558927] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-14T19:06:52.906047] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T19:06:53.358881] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-14T19:06:53.408776] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T19:06:54.158845] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-14T19:06:54.404810] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T19:06:54.958834] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-14T19:06:55.398028] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T19:06:55.589800] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T19:06:55.758836] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-14T19:06:56.558860] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-14T19:06:56.855329] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T19:06:57.358809] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-14T19:06:57.733128] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T19:06:57.893882] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T19:06:57.896593] [INFO ] [REMOTE ] MSGS: Full fetch complete (17758 records). [2025-09-14T19:06:57.896754] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-14T19:06:58.163912] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-14T19:06:58.269751] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-14T19:06:58.269896] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-14T19:06:58.270470] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-14T19:06:58.270551] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-14T19:06:58.271382] [DEBUG] [LOCAL ] MSGS: Trimmed 17758 records to 12313 (keeping 150 days of data) [2025-09-14T19:06:58.360965] [DEBUG] [LOCAL ] MSGS: Primary data saved (12313 records). [2025-09-14T19:06:58.361192] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-14T19:06:58.361344] [INFO ] [MAIN ] Update Progress: 1411/2370 symbols completed. MSGS took 20.8s. Estimated remaining: 1h 41m 48s. Rate: 9.4 symbols/min [2025-09-14T19:06:58.536098] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:58.559865] [DEBUG] [LOCAL ] MT: Loaded 22650 existing records from primary storage. [2025-09-14T19:06:58.560110] [INFO ] [MAIN ] MT: Loaded 22650 existing records. [2025-09-14T19:06:58.785013] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:58.785394] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-14T19:06:58.785477] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-14T19:06:58.786268] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-14T19:06:58.786350] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-14T19:06:58.965604] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-14T19:06:59.154774] [INFO ] [REMOTE ] MT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:59.191921] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T19:06:59.195115] [INFO ] [REMOTE ] MSIF: Full fetch complete (14231 records). [2025-09-14T19:06:59.195252] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-14T19:06:59.603453] [DEBUG] [VALIDATOR ] MSIF: All expected trading days are present. [2025-09-14T19:06:59.603587] [DEBUG] [VALIDATOR ] MSIF: Primary data validation passed. [2025-09-14T19:06:59.604316] [INFO ] [MAIN ] MSIF: Fetched primary data is valid. [2025-09-14T19:06:59.604393] [DEBUG] [LOCAL ] MSIF: Saving primary data. [2025-09-14T19:06:59.605044] [DEBUG] [LOCAL ] MSIF: Trimmed 14231 records to 10482 (keeping 150 days of data) [2025-09-14T19:06:59.677323] [DEBUG] [LOCAL ] MSIF: Primary data saved (10482 records). [2025-09-14T19:06:59.677582] [INFO ] [MAIN ] MSIF: Full history saved. [2025-09-14T19:06:59.677730] [INFO ] [MAIN ] Update Progress: 1412/2370 symbols completed. MSIF took 19.4s. Estimated remaining: 1h 41m 38s. Rate: 9.4 symbols/min [2025-09-14T19:06:59.764065] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-14T19:06:59.864759] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:59.885764] [DEBUG] [LOCAL ] MTAL: Loaded 17696 existing records from primary storage. [2025-09-14T19:06:59.886081] [INFO ] [MAIN ] MTAL: Loaded 17696 existing records. [2025-09-14T19:07:00.067026] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:00.067357] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-14T19:07:00.067512] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-14T19:07:00.075795] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-14T19:07:00.089771] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-14T19:07:00.167202] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T19:07:00.459213] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:00.558843] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-14T19:07:01.358796] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-14T19:07:01.445562] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T19:07:01.994589] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T19:07:02.158854] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-14T19:07:02.817844] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-14T19:07:02.958903] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-14T19:07:03.193354] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T19:07:03.684080] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:07:03.688711] [INFO ] [REMOTE ] MSI: Full fetch complete (44516 records). [2025-09-14T19:07:03.688910] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-14T19:07:03.764050] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-14T19:07:04.121097] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-14T19:07:04.121239] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-14T19:07:04.122062] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-14T19:07:04.122139] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-14T19:07:04.123510] [DEBUG] [LOCAL ] MSI: Trimmed 44516 records to 30154 (keeping 150 days of data) [2025-09-14T19:07:04.327142] [DEBUG] [LOCAL ] MSI: Primary data saved (30154 records). [2025-09-14T19:07:04.327350] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-14T19:07:04.327495] [INFO ] [MAIN ] Update Progress: 1413/2370 symbols completed. MSI took 25.4s. Estimated remaining: 1h 41m 31s. Rate: 9.4 symbols/min [2025-09-14T19:07:04.507210] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:04.529202] [DEBUG] [LOCAL ] MTB: Loaded 20709 existing records from primary storage. [2025-09-14T19:07:04.529408] [INFO ] [MAIN ] MTB: Loaded 20709 existing records. [2025-09-14T19:07:04.563918] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-14T19:07:04.711544] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:04.711898] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-14T19:07:04.711979] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-14T19:07:04.712835] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-14T19:07:04.712914] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-14T19:07:05.067444] [INFO ] [REMOTE ] MTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:05.358778] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-14T19:07:05.844622] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-14T19:07:06.070197] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T19:07:06.158866] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-14T19:07:06.958835] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-14T19:07:07.001914] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T19:07:07.758826] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-14T19:07:08.229921] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-14T19:07:08.511143] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T19:07:08.558858] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-14T19:07:09.358843] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-14T19:07:09.666862] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T19:07:10.158828] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-14T19:07:10.336094] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T19:07:10.958827] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-14T19:07:10.995938] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T19:07:11.603244] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T19:07:11.758841] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-14T19:07:12.558861] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-14T19:07:13.073072] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T19:07:13.256490] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T19:07:13.358834] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-14T19:07:14.163940] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-14T19:07:14.177459] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T19:07:14.958833] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-14T19:07:15.335823] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T19:07:15.758833] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-14T19:07:15.993170] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T19:07:16.558832] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-14T19:07:16.783074] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T19:07:17.358846] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-14T19:07:17.663463] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T19:07:17.806595] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T19:07:17.812576] [INFO ] [REMOTE ] MSM: Full fetch complete (38168 records). [2025-09-14T19:07:17.812899] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-14T19:07:18.160733] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-14T19:07:18.196495] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-14T19:07:18.196627] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-14T19:07:18.197489] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-14T19:07:18.197687] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-14T19:07:18.198591] [DEBUG] [LOCAL ] MSM: Trimmed 38168 records to 25777 (keeping 150 days of data) [2025-09-14T19:07:18.359782] [DEBUG] [LOCAL ] MSM: Primary data saved (25777 records). [2025-09-14T19:07:18.360008] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-14T19:07:18.360137] [INFO ] [MAIN ] Update Progress: 1414/2370 symbols completed. MSM took 36.8s. Estimated remaining: 1h 41m 29s. Rate: 9.4 symbols/min [2025-09-14T19:07:18.532957] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:18.541852] [DEBUG] [LOCAL ] MTD: Loaded 5898 existing records from primary storage. [2025-09-14T19:07:18.542200] [INFO ] [MAIN ] MTD: Loaded 5898 existing records. [2025-09-14T19:07:18.745358] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:18.769336] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-14T19:07:18.769514] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-14T19:07:18.770058] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-14T19:07:18.770567] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-14T19:07:18.773185] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T19:07:18.967171] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-14T19:07:19.169319] [INFO ] [REMOTE ] MTD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:19.764055] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-14T19:07:19.776968] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:07:20.558850] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-14T19:07:20.834451] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T19:07:20.968117] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T19:07:21.358935] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-14T19:07:22.158865] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-14T19:07:22.302996] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T19:07:22.349897] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T19:07:22.958853] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-14T19:07:23.516895] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T19:07:23.521476] [INFO ] [REMOTE ] MTAL: Full fetch complete (37975 records). [2025-09-14T19:07:23.521616] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-14T19:07:23.764218] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-14T19:07:23.908160] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-14T19:07:23.908277] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-14T19:07:23.909119] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-14T19:07:23.909181] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-14T19:07:23.910168] [DEBUG] [LOCAL ] MTAL: Trimmed 37975 records to 27726 (keeping 150 days of data) [2025-09-14T19:07:24.076948] [DEBUG] [LOCAL ] MTAL: Primary data saved (27726 records). [2025-09-14T19:07:24.077154] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-14T19:07:24.077296] [INFO ] [MAIN ] Update Progress: 1415/2370 symbols completed. MTAL took 24.4s. Estimated remaining: 1h 41m 23s. Rate: 9.4 symbols/min [2025-09-14T19:07:24.248229] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:24.271812] [DEBUG] [LOCAL ] MTDR: Loaded 22974 existing records from primary storage. [2025-09-14T19:07:24.271996] [INFO ] [MAIN ] MTDR: Loaded 22974 existing records. [2025-09-14T19:07:24.457044] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:24.457351] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-14T19:07:24.457561] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-14T19:07:24.464072] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-14T19:07:24.472186] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-14T19:07:24.478521] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T19:07:24.555052] [INFO ] [REMOTE ] MT: Full fetch complete (55453 records). [2025-09-14T19:07:24.560301] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-14T19:07:24.582999] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-14T19:07:25.137184] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:25.277549] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-14T19:07:25.279036] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-14T19:07:25.278927] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T19:07:25.280134] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-14T19:07:25.285098] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-14T19:07:25.287420] [DEBUG] [LOCAL ] MT: Trimmed 55453 records to 37882 (keeping 150 days of data) [2025-09-14T19:07:25.382202] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-14T19:07:25.545951] [DEBUG] [LOCAL ] MT: Primary data saved (37882 records). [2025-09-14T19:07:25.546197] [INFO ] [MAIN ] MT: Full history saved. [2025-09-14T19:07:25.546339] [INFO ] [MAIN ] Update Progress: 1416/2370 symbols completed. MT took 27.2s. Estimated remaining: 1h 41m 13s. Rate: 9.4 symbols/min [2025-09-14T19:07:25.733109] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:25.757883] [DEBUG] [LOCAL ] MTG: Loaded 22867 existing records from primary storage. [2025-09-14T19:07:25.758111] [INFO ] [MAIN ] MTG: Loaded 22867 existing records. [2025-09-14T19:07:25.953084] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:25.953417] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-14T19:07:25.953486] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-14T19:07:25.954506] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-14T19:07:25.954586] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-14T19:07:26.163989] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-14T19:07:26.347620] [INFO ] [REMOTE ] MTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:26.618795] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T19:07:26.655022] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T19:07:26.958848] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-14T19:07:27.758850] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-14T19:07:28.035076] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T19:07:28.076180] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T19:07:28.558856] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-14T19:07:29.366401] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-14T19:07:29.368579] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T19:07:30.158909] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-14T19:07:30.297130] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T19:07:30.318973] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T19:07:30.686952] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T19:07:30.691675] [INFO ] [REMOTE ] MTB: Full fetch complete (51245 records). [2025-09-14T19:07:30.691817] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-14T19:07:30.963924] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-14T19:07:31.085326] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-14T19:07:31.085466] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-14T19:07:31.086486] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-14T19:07:31.086552] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-14T19:07:31.088840] [DEBUG] [LOCAL ] MTB: Trimmed 51245 records to 35024 (keeping 150 days of data) [2025-09-14T19:07:31.328153] [DEBUG] [LOCAL ] MTB: Primary data saved (35024 records). [2025-09-14T19:07:31.328372] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-14T19:07:31.328504] [INFO ] [MAIN ] Update Progress: 1417/2370 symbols completed. MTB took 27.0s. Estimated remaining: 1h 41m 6s. Rate: 9.4 symbols/min [2025-09-14T19:07:31.524722] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:31.544064] [DEBUG] [LOCAL ] MTH: Loaded 19603 existing records from primary storage. [2025-09-14T19:07:31.544233] [INFO ] [MAIN ] MTH: Loaded 19603 existing records. [2025-09-14T19:07:31.720093] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:31.720393] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-14T19:07:31.720465] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-14T19:07:31.721066] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-14T19:07:31.721131] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-14T19:07:31.763996] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-14T19:07:32.004853] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T19:07:32.094044] [INFO ] [REMOTE ] MTH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:32.558849] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-14T19:07:33.082389] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T19:07:33.084269] [INFO ] [REMOTE ] MTD: Full fetch complete (16962 records). [2025-09-14T19:07:33.084360] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-14T19:07:33.364057] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-14T19:07:33.451491] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-14T19:07:33.451624] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-14T19:07:33.452095] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-14T19:07:33.452150] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-14T19:07:33.452844] [DEBUG] [LOCAL ] MTD: Trimmed 16962 records to 11405 (keeping 150 days of data) [2025-09-14T19:07:33.536051] [DEBUG] [LOCAL ] MTD: Primary data saved (11405 records). [2025-09-14T19:07:33.536269] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-14T19:07:33.536404] [INFO ] [MAIN ] Update Progress: 1418/2370 symbols completed. MTD took 15.2s. Estimated remaining: 1h 40m 57s. Rate: 9.4 symbols/min [2025-09-14T19:07:33.715019] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T19:07:33.747485] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:33.766225] [DEBUG] [LOCAL ] MTN: Loaded 17157 existing records from primary storage. [2025-09-14T19:07:33.766417] [INFO ] [MAIN ] MTN: Loaded 17157 existing records. [2025-09-14T19:07:33.944784] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:33.945081] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-14T19:07:33.945142] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-14T19:07:33.945698] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-14T19:07:33.945759] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-14T19:07:34.167904] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-14T19:07:34.304891] [INFO ] [REMOTE ] MTN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:34.958822] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-14T19:07:35.103961] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T19:07:35.758897] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-14T19:07:35.977845] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T19:07:36.472415] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T19:07:36.558846] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-14T19:07:37.358866] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-14T19:07:37.552396] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:07:37.902763] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T19:07:38.158900] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-14T19:07:38.692559] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T19:07:38.958840] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-14T19:07:39.758869] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-14T19:07:40.169885] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T19:07:40.558868] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-14T19:07:40.734335] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T19:07:41.111005] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T19:07:41.358920] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-14T19:07:42.158840] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-14T19:07:42.193668] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T19:07:42.958858] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-14T19:07:43.127336] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T19:07:43.758824] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-14T19:07:43.872606] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T19:07:44.558869] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-14T19:07:44.670180] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T19:07:45.309290] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:07:45.358772] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-14T19:07:46.158819] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-14T19:07:46.275772] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T19:07:46.649036] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T19:07:46.958831] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-14T19:07:47.758865] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-14T19:07:47.847211] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T19:07:48.558901] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-14T19:07:48.728311] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T19:07:48.875185] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T19:07:49.358899] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-14T19:07:49.782945] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T19:07:49.788166] [INFO ] [REMOTE ] MTDR: Full fetch complete (55876 records). [2025-09-14T19:07:49.788345] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-14T19:07:50.162868] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-14T19:07:50.182837] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-14T19:07:50.182948] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-14T19:07:50.184070] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-14T19:07:50.184188] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-14T19:07:50.185981] [DEBUG] [LOCAL ] MTDR: Trimmed 55876 records to 38772 (keeping 150 days of data) [2025-09-14T19:07:50.332414] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:07:50.518979] [DEBUG] [LOCAL ] MTDR: Primary data saved (38772 records). [2025-09-14T19:07:50.519233] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-14T19:07:50.519398] [INFO ] [MAIN ] Update Progress: 1419/2370 symbols completed. MTDR took 26.4s. Estimated remaining: 1h 40m 58s. Rate: 9.4 symbols/min [2025-09-14T19:07:50.694745] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:50.697833] [DEBUG] [LOCAL ] MTR: Loaded 1194 existing records from primary storage. [2025-09-14T19:07:50.697926] [INFO ] [MAIN ] MTR: Loaded 1194 existing records. [2025-09-14T19:07:50.882563] [WARN ] [MAIN ] MTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:50.882866] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-14T19:07:50.882939] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-14T19:07:50.883167] [DEBUG] [LOCAL ] MTR: Deleted primary data file. [2025-09-14T19:07:50.883227] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-14T19:07:50.963991] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-14T19:07:51.260280] [INFO ] [REMOTE ] MTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:51.758867] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-14T19:07:51.897459] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T19:07:52.100705] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-14T19:07:52.558885] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-14T19:07:52.825621] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T19:07:53.358866] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-14T19:07:54.011715] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:07:54.018356] [INFO ] [REMOTE ] MTG: Full fetch complete (55856 records). [2025-09-14T19:07:54.018825] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-14T19:07:54.162145] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-14T19:07:54.359680] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T19:07:54.465393] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-14T19:07:54.465923] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-14T19:07:54.467309] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-14T19:07:54.467404] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-14T19:07:54.469289] [DEBUG] [LOCAL ] MTG: Trimmed 55856 records to 38305 (keeping 150 days of data) [2025-09-14T19:07:54.723611] [DEBUG] [LOCAL ] MTG: Primary data saved (38305 records). [2025-09-14T19:07:54.723876] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-14T19:07:54.724024] [INFO ] [MAIN ] Update Progress: 1420/2370 symbols completed. MTG took 29.2s. Estimated remaining: 1h 40m 50s. Rate: 9.4 symbols/min [2025-09-14T19:07:54.895417] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:54.912561] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:07:54.920222] [INFO ] [REMOTE ] MTN: Full fetch complete (42249 records). [2025-09-14T19:07:54.924468] [DEBUG] [LOCAL ] MTRN: Loaded 8223 existing records from primary storage. [2025-09-14T19:07:54.924682] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-14T19:07:54.924979] [INFO ] [MAIN ] MTRN: Loaded 8223 existing records. [2025-09-14T19:07:54.969446] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-14T19:07:55.286829] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:55.288392] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-14T19:07:55.288475] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-14T19:07:55.309696] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-14T19:07:55.363012] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-14T19:07:55.547917] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T19:07:55.717266] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-14T19:07:55.768051] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-14T19:07:55.773365] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-14T19:07:55.804223] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-14T19:07:55.809535] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-14T19:07:55.849738] [DEBUG] [LOCAL ] MTN: Trimmed 42249 records to 29044 (keeping 150 days of data) [2025-09-14T19:07:55.927133] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:56.185432] [DEBUG] [LOCAL ] MTN: Primary data saved (29044 records). [2025-09-14T19:07:56.185714] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-14T19:07:56.185839] [INFO ] [MAIN ] Update Progress: 1421/2370 symbols completed. MTN took 22.6s. Estimated remaining: 1h 40m 40s. Rate: 9.4 symbols/min [2025-09-14T19:07:56.437755] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:56.457899] [DEBUG] [LOCAL ] MTUS: Loaded 11943 existing records from primary storage. [2025-09-14T19:07:56.458176] [INFO ] [MAIN ] MTUS: Loaded 11943 existing records. [2025-09-14T19:07:56.561201] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-14T19:07:56.772702] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:56.773100] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-14T19:07:56.773172] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-14T19:07:56.773737] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-14T19:07:56.773801] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-14T19:07:57.077228] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T19:07:57.245707] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:57.344750] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:07:57.358811] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-14T19:07:58.158794] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-14T19:07:58.547866] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T19:07:58.621170] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T19:07:58.958898] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-14T19:07:59.758850] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-14T19:07:59.773855] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T19:08:00.558863] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-14T19:08:00.721690] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T19:08:01.358881] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-14T19:08:02.158914] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-14T19:08:02.407362] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T19:08:02.705964] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T19:08:02.958806] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-14T19:08:03.496146] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T19:08:03.758893] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-14T19:08:04.020116] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T19:08:04.343734] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T19:08:04.558834] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-14T19:08:05.072095] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T19:08:05.358881] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-14T19:08:06.025707] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T19:08:06.030200] [INFO ] [REMOTE ] MTH: Full fetch complete (47974 records). [2025-09-14T19:08:06.030303] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-14T19:08:06.173432] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-14T19:08:06.441413] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-14T19:08:06.441572] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-14T19:08:06.442921] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-14T19:08:06.443016] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-14T19:08:06.444453] [DEBUG] [LOCAL ] MTH: Trimmed 47974 records to 32732 (keeping 150 days of data) [2025-09-14T19:08:06.660036] [DEBUG] [LOCAL ] MTH: Primary data saved (32732 records). [2025-09-14T19:08:06.660270] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-14T19:08:06.660406] [INFO ] [MAIN ] Update Progress: 1422/2370 symbols completed. MTH took 35.3s. Estimated remaining: 1h 40m 37s. Rate: 9.4 symbols/min [2025-09-14T19:08:06.843488] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:06.858604] [DEBUG] [LOCAL ] MTW: Loaded 11799 existing records from primary storage. [2025-09-14T19:08:06.858887] [INFO ] [MAIN ] MTW: Loaded 11799 existing records. [2025-09-14T19:08:06.964065] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-14T19:08:07.060963] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:07.061427] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-14T19:08:07.061500] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-14T19:08:07.061957] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-14T19:08:07.062050] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-14T19:08:07.438939] [INFO ] [REMOTE ] MTW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:07.534186] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T19:08:07.556928] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T19:08:07.557923] [INFO ] [REMOTE ] MTR: Full fetch complete (1927 records). [2025-09-14T19:08:07.558026] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-14T19:08:07.766364] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-14T19:08:07.925672] [DEBUG] [VALIDATOR ] MTR: All expected trading days are present. [2025-09-14T19:08:07.925793] [DEBUG] [VALIDATOR ] MTR: Primary data validation passed. [2025-09-14T19:08:07.925903] [INFO ] [MAIN ] MTR: Fetched primary data is valid. [2025-09-14T19:08:07.925958] [DEBUG] [LOCAL ] MTR: Saving primary data. [2025-09-14T19:08:07.926316] [DEBUG] [LOCAL ] MTR: Trimmed 1927 records to 1606 (keeping 150 days of data) [2025-09-14T19:08:07.936232] [DEBUG] [LOCAL ] MTR: Primary data saved (1606 records). [2025-09-14T19:08:07.936313] [INFO ] [MAIN ] MTR: Full history saved. [2025-09-14T19:08:07.936404] [INFO ] [MAIN ] Update Progress: 1423/2370 symbols completed. MTR took 17.4s. Estimated remaining: 1h 40m 27s. Rate: 9.4 symbols/min [2025-09-14T19:08:08.106174] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:08.118870] [DEBUG] [LOCAL ] MTX: Loaded 10604 existing records from primary storage. [2025-09-14T19:08:08.119044] [INFO ] [MAIN ] MTX: Loaded 10604 existing records. [2025-09-14T19:08:08.300870] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:08.301187] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-14T19:08:08.301253] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-14T19:08:08.301786] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-14T19:08:08.301853] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-14T19:08:08.569159] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-14T19:08:08.663308] [INFO ] [REMOTE ] MTX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:09.226584] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T19:08:09.358864] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-14T19:08:09.957388] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T19:08:10.158897] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-14T19:08:10.958946] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-14T19:08:10.964095] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T19:08:11.192334] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T19:08:11.758935] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-14T19:08:11.991385] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T19:08:12.558862] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-14T19:08:12.993800] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T19:08:13.358888] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-14T19:08:13.509332] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T19:08:14.158872] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-14T19:08:14.872588] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T19:08:14.958863] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-14T19:08:15.303602] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T19:08:15.758888] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-14T19:08:16.087260] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:08:16.171822] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T19:08:16.174263] [INFO ] [REMOTE ] MTRN: Full fetch complete (18815 records). [2025-09-14T19:08:16.174352] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-14T19:08:16.536359] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-14T19:08:16.536468] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-14T19:08:16.536909] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-14T19:08:16.536964] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-14T19:08:16.537713] [DEBUG] [LOCAL ] MTRN: Trimmed 18815 records to 13788 (keeping 150 days of data) [2025-09-14T19:08:16.576381] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-14T19:08:16.628077] [DEBUG] [LOCAL ] MTRN: Primary data saved (13788 records). [2025-09-14T19:08:16.628244] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-14T19:08:16.628362] [INFO ] [MAIN ] Update Progress: 1424/2370 symbols completed. MTRN took 21.9s. Estimated remaining: 1h 40m 22s. Rate: 9.4 symbols/min [2025-09-14T19:08:16.805296] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:16.826826] [DEBUG] [LOCAL ] MTZ: Loaded 19166 existing records from primary storage. [2025-09-14T19:08:16.827017] [INFO ] [MAIN ] MTZ: Loaded 19166 existing records. [2025-09-14T19:08:17.005427] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:17.005767] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-14T19:08:17.005841] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-14T19:08:17.006532] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-14T19:08:17.006604] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-14T19:08:17.366387] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-14T19:08:17.371515] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:18.158890] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-14T19:08:18.221391] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T19:08:18.632170] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T19:08:18.958885] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-14T19:08:19.758873] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-14T19:08:19.802076] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T19:08:20.263058] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T19:08:20.558877] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-14T19:08:21.117065] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T19:08:21.358920] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-14T19:08:22.158882] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-14T19:08:22.254571] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:08:22.280756] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T19:08:22.958799] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-14T19:08:23.340389] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T19:08:23.758800] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-14T19:08:24.156783] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T19:08:24.558888] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-14T19:08:25.358849] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-14T19:08:25.551111] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T19:08:25.617763] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T19:08:26.158864] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-14T19:08:26.742666] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T19:08:26.958833] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-14T19:08:27.134954] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T19:08:27.758884] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-14T19:08:28.558855] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-14T19:08:28.752311] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:08:28.805249] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T19:08:29.115119] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:08:29.117913] [INFO ] [REMOTE ] MTX: Full fetch complete (25065 records). [2025-09-14T19:08:29.118054] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-14T19:08:29.368562] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-14T19:08:29.503573] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-14T19:08:29.503702] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-14T19:08:29.504227] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-14T19:08:29.504297] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-14T19:08:29.505007] [DEBUG] [LOCAL ] MTX: Trimmed 25065 records to 17744 (keeping 150 days of data) [2025-09-14T19:08:29.628447] [DEBUG] [LOCAL ] MTX: Primary data saved (17744 records). [2025-09-14T19:08:29.628633] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-14T19:08:29.628793] [INFO ] [MAIN ] Update Progress: 1425/2370 symbols completed. MTX took 21.7s. Estimated remaining: 1h 40m 20s. Rate: 9.4 symbols/min [2025-09-14T19:08:29.796667] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:29.803605] [DEBUG] [LOCAL ] MUA: Loaded 5091 existing records from primary storage. [2025-09-14T19:08:29.803765] [INFO ] [MAIN ] MUA: Loaded 5091 existing records. [2025-09-14T19:08:29.982682] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:29.983080] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-14T19:08:29.983221] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-14T19:08:29.990885] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-14T19:08:29.991582] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-14T19:08:29.991876] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T19:08:30.073780] [INFO ] [REMOTE ] MTUS: Full fetch complete (31864 records). [2025-09-14T19:08:30.094194] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-14T19:08:30.163968] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-14T19:08:30.664037] [INFO ] [REMOTE ] MUA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:30.748972] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-14T19:08:30.749095] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-14T19:08:30.749794] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-14T19:08:30.749851] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-14T19:08:30.750633] [DEBUG] [LOCAL ] MTUS: Trimmed 31864 records to 21091 (keeping 150 days of data) [2025-09-14T19:08:30.877327] [DEBUG] [LOCAL ] MTUS: Primary data saved (21091 records). [2025-09-14T19:08:30.877504] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-14T19:08:30.877628] [INFO ] [MAIN ] Update Progress: 1426/2370 symbols completed. MTUS took 34.7s. Estimated remaining: 1h 40m 10s. Rate: 9.4 symbols/min [2025-09-14T19:08:30.964040] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-14T19:08:31.050943] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:31.062926] [DEBUG] [LOCAL ] MUC: Loaded 9560 existing records from primary storage. [2025-09-14T19:08:31.063094] [INFO ] [MAIN ] MUC: Loaded 9560 existing records. [2025-09-14T19:08:31.240339] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:31.240660] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-14T19:08:31.240727] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-14T19:08:31.241206] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-14T19:08:31.241270] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-14T19:08:31.591968] [INFO ] [REMOTE ] MUC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:31.758838] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-14T19:08:31.844981] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T19:08:32.085008] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T19:08:32.558856] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-14T19:08:32.754828] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T19:08:33.358853] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-14T19:08:34.158875] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-14T19:08:34.264390] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T19:08:34.311408] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T19:08:34.958891] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-14T19:08:34.978599] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T19:08:35.758914] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-14T19:08:36.069259] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T19:08:36.558884] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-14T19:08:37.358867] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-14T19:08:37.518193] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T19:08:37.593548] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T19:08:38.158866] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-14T19:08:38.399403] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T19:08:38.402140] [INFO ] [REMOTE ] MTW: Full fetch complete (29452 records). [2025-09-14T19:08:38.402239] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-14T19:08:38.771612] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-14T19:08:38.771764] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-14T19:08:38.772404] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-14T19:08:38.772457] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-14T19:08:38.773248] [DEBUG] [LOCAL ] MTW: Trimmed 29452 records to 20093 (keeping 150 days of data) [2025-09-14T19:08:38.899796] [DEBUG] [LOCAL ] MTW: Primary data saved (20093 records). [2025-09-14T19:08:38.899957] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-14T19:08:38.900131] [INFO ] [MAIN ] Update Progress: 1427/2370 symbols completed. MTW took 32.2s. Estimated remaining: 1h 40m 5s. Rate: 9.4 symbols/min [2025-09-14T19:08:38.964095] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-14T19:08:39.079620] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:39.087776] [DEBUG] [LOCAL ] MUE: Loaded 5608 existing records from primary storage. [2025-09-14T19:08:39.087928] [INFO ] [MAIN ] MUE: Loaded 5608 existing records. [2025-09-14T19:08:39.266663] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T19:08:39.286955] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:39.291615] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-14T19:08:39.291709] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-14T19:08:39.292110] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-14T19:08:39.292176] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-14T19:08:39.663018] [INFO ] [REMOTE ] MUE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:39.690785] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:08:39.695887] [INFO ] [REMOTE ] MTZ: Full fetch complete (47558 records). [2025-09-14T19:08:39.696001] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-14T19:08:39.763996] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-14T19:08:40.077746] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-14T19:08:40.077865] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-14T19:08:40.078798] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-14T19:08:40.078858] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-14T19:08:40.079963] [DEBUG] [LOCAL ] MTZ: Trimmed 47558 records to 32078 (keeping 150 days of data) [2025-09-14T19:08:40.297930] [DEBUG] [LOCAL ] MTZ: Primary data saved (32078 records). [2025-09-14T19:08:40.298114] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-14T19:08:40.298236] [INFO ] [MAIN ] Update Progress: 1428/2370 symbols completed. MTZ took 23.7s. Estimated remaining: 1h 39m 55s. Rate: 9.4 symbols/min [2025-09-14T19:08:40.468041] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:40.492433] [DEBUG] [LOCAL ] MUFG: Loaded 23443 existing records from primary storage. [2025-09-14T19:08:40.492605] [INFO ] [MAIN ] MUFG: Loaded 23443 existing records. [2025-09-14T19:08:40.565853] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-14T19:08:40.670794] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:40.675773] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T19:08:40.675870] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-14T19:08:40.677910] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-14T19:08:40.678683] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-14T19:08:40.678748] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-14T19:08:41.038214] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:41.358822] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-14T19:08:41.649440] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T19:08:42.158854] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-14T19:08:42.303285] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T19:08:42.958872] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-14T19:08:43.301240] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T19:08:43.758896] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-14T19:08:43.775217] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T19:08:44.558853] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-14T19:08:44.955257] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T19:08:45.358849] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-14T19:08:45.542987] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:08:46.158859] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-14T19:08:46.958915] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-14T19:08:47.059896] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T19:08:47.062440] [INFO ] [REMOTE ] MUC: Full fetch complete (21397 records). [2025-09-14T19:08:47.062537] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-14T19:08:47.468113] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-14T19:08:47.468277] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-14T19:08:47.468786] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-14T19:08:47.468893] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-14T19:08:47.481300] [DEBUG] [LOCAL ] MUC: Trimmed 21397 records to 14665 (keeping 150 days of data) [2025-09-14T19:08:47.539967] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T19:08:47.603442] [DEBUG] [LOCAL ] MUC: Primary data saved (14665 records). [2025-09-14T19:08:47.603633] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-14T19:08:47.603777] [INFO ] [MAIN ] Update Progress: 1429/2370 symbols completed. MUC took 16.7s. Estimated remaining: 1h 39m 50s. Rate: 9.4 symbols/min [2025-09-14T19:08:47.771764] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-14T19:08:47.774339] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:47.784494] [DEBUG] [LOCAL ] MUJ: Loaded 6955 existing records from primary storage. [2025-09-14T19:08:47.784675] [INFO ] [MAIN ] MUJ: Loaded 6955 existing records. [2025-09-14T19:08:47.919724] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T19:08:47.976194] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:47.976506] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-14T19:08:47.976586] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-14T19:08:47.977005] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-14T19:08:47.977083] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-14T19:08:48.325402] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:48.558828] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-14T19:08:49.358850] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-14T19:08:49.455194] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T19:08:49.747782] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T19:08:50.158895] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-14T19:08:50.220766] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T19:08:50.958838] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-14T19:08:51.758883] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-14T19:08:51.851346] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T19:08:52.264259] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T19:08:52.558859] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-14T19:08:52.572015] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:08:53.358837] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-14T19:08:53.422459] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:08:54.158881] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-14T19:08:54.180772] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T19:08:54.958871] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-14T19:08:55.036654] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T19:08:55.758850] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-14T19:08:56.518534] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:08:56.520403] [INFO ] [REMOTE ] MUA: Full fetch complete (13671 records). [2025-09-14T19:08:56.520526] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-14T19:08:56.564337] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-14T19:08:56.887742] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-14T19:08:56.887906] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-14T19:08:56.888380] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-14T19:08:56.888606] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-14T19:08:56.889364] [DEBUG] [LOCAL ] MUA: Trimmed 13671 records to 8490 (keeping 150 days of data) [2025-09-14T19:08:56.943795] [DEBUG] [LOCAL ] MUA: Primary data saved (8490 records). [2025-09-14T19:08:56.943999] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-14T19:08:56.944334] [INFO ] [MAIN ] Update Progress: 1430/2370 symbols completed. MUA took 27.3s. Estimated remaining: 1h 39m 45s. Rate: 9.4 symbols/min [2025-09-14T19:08:57.095904] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-14T19:08:57.179406] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:57.203011] [DEBUG] [LOCAL ] MUR: Loaded 23573 existing records from primary storage. [2025-09-14T19:08:57.203225] [INFO ] [MAIN ] MUR: Loaded 23573 existing records. [2025-09-14T19:08:57.356200] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:08:57.364202] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-14T19:08:57.400551] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:57.400927] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-14T19:08:57.401005] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-14T19:08:57.401705] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-14T19:08:57.401778] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-14T19:08:57.748816] [INFO ] [REMOTE ] MUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:58.158877] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-14T19:08:58.958855] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-14T19:08:59.202823] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T19:08:59.316244] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T19:08:59.758868] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-14T19:09:00.558884] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-14T19:09:00.605110] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T19:09:00.720092] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T19:09:01.358841] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-14T19:09:02.158902] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-14T19:09:02.958924] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-14T19:09:03.021768] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-14T19:09:03.758868] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-14T19:09:04.002324] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-14T19:09:04.558845] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-14T19:09:05.236739] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-09-14T19:09:05.358843] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-14T19:09:05.620556] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T19:09:05.822911] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-14T19:09:05.920251] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T19:09:06.158884] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-14T19:09:06.191299] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T19:09:06.193593] [INFO ] [REMOTE ] MUE: Full fetch complete (12506 records). [2025-09-14T19:09:06.193708] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-14T19:09:06.582691] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-14T19:09:06.582841] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-14T19:09:06.583297] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-14T19:09:06.583355] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-14T19:09:06.584297] [DEBUG] [LOCAL ] MUE: Trimmed 12506 records to 9473 (keeping 150 days of data) [2025-09-14T19:09:06.647728] [DEBUG] [LOCAL ] MUE: Primary data saved (9473 records). [2025-09-14T19:09:06.647966] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-14T19:09:06.648098] [INFO ] [MAIN ] Update Progress: 1431/2370 symbols completed. MUE took 27.7s. Estimated remaining: 1h 39m 41s. Rate: 9.4 symbols/min [2025-09-14T19:09:06.821084] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:06.836150] [DEBUG] [LOCAL ] MUSA: Loaded 11173 existing records from primary storage. [2025-09-14T19:09:06.836426] [INFO ] [MAIN ] MUSA: Loaded 11173 existing records. [2025-09-14T19:09:06.963912] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-14T19:09:07.027574] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:07.027905] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-14T19:09:07.027987] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-14T19:09:07.028528] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-14T19:09:07.028594] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-14T19:09:07.407397] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:07.419045] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T19:09:07.758860] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-14T19:09:08.558902] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-14T19:09:08.755260] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:09:08.758524] [INFO ] [REMOTE ] MUJ: Full fetch complete (13929 records). [2025-09-14T19:09:08.760160] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-14T19:09:09.367205] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-14T19:09:09.373833] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-14T19:09:09.381889] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-14T19:09:09.384233] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-14T19:09:09.385099] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-14T19:09:09.396201] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-14T19:09:09.398135] [DEBUG] [LOCAL ] MUJ: Trimmed 13929 records to 10212 (keeping 150 days of data) [2025-09-14T19:09:09.472384] [DEBUG] [LOCAL ] MUJ: Primary data saved (10212 records). [2025-09-14T19:09:09.472587] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-14T19:09:09.472733] [INFO ] [MAIN ] Update Progress: 1432/2370 symbols completed. MUJ took 21.9s. Estimated remaining: 1h 39m 32s. Rate: 9.4 symbols/min [2025-09-14T19:09:09.656443] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:09.656852] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-14T19:09:09.656913] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-14T19:09:09.657041] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-14T19:09:09.657094] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-14T19:09:09.657147] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-14T19:09:09.657195] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-14T19:09:10.050710] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:10.052880] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T19:09:10.158783] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-14T19:09:10.958861] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-14T19:09:11.083583] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-14T19:09:11.088995] [INFO ] [REMOTE ] MUFG: Full fetch complete (57154 records). [2025-09-14T19:09:11.089139] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-14T19:09:11.468776] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-14T19:09:11.468920] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-14T19:09:11.469896] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-14T19:09:11.469958] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-14T19:09:11.471297] [DEBUG] [LOCAL ] MUFG: Trimmed 57154 records to 39562 (keeping 150 days of data) [2025-09-14T19:09:11.718599] [DEBUG] [LOCAL ] MUFG: Primary data saved (39562 records). [2025-09-14T19:09:11.718809] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-14T19:09:11.718918] [INFO ] [MAIN ] Update Progress: 1433/2370 symbols completed. MUFG took 31.4s. Estimated remaining: 1h 39m 23s. Rate: 9.4 symbols/min [2025-09-14T19:09:11.766729] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-14T19:09:11.900809] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:11.921446] [DEBUG] [LOCAL ] MUX: Loaded 19613 existing records from primary storage. [2025-09-14T19:09:11.921633] [INFO ] [MAIN ] MUX: Loaded 19613 existing records. [2025-09-14T19:09:12.069153] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:09:12.101980] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-14T19:09:12.108767] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:12.109270] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-14T19:09:12.109381] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-14T19:09:12.110061] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-14T19:09:12.110179] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-14T19:09:12.442834] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T19:09:12.512420] [INFO ] [REMOTE ] MUX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:12.529040] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T19:09:12.558791] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-14T19:09:13.358862] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-14T19:09:14.158874] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-14T19:09:14.206349] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T19:09:14.958855] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-14T19:09:15.627157] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-14T19:09:15.692353] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T19:09:15.758843] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-14T19:09:16.558902] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-14T19:09:17.358960] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-14T19:09:17.576517] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-14T19:09:17.578523] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-14T19:09:18.158884] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-14T19:09:18.247312] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-14T19:09:18.904998] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T19:09:18.958806] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-14T19:09:19.655360] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T19:09:19.758905] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-14T19:09:20.558873] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-14T19:09:20.814739] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T19:09:20.987344] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T19:09:21.358915] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-14T19:09:21.853771] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T19:09:22.158904] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-14T19:09:22.961787] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-14T19:09:22.968113] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T19:09:23.197619] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-14T19:09:23.471435] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T19:09:23.758933] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-14T19:09:24.123205] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T19:09:24.126525] [INFO ] [REMOTE ] MUSA: Full fetch complete (27611 records). [2025-09-14T19:09:24.126664] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-14T19:09:24.564743] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-14T19:09:24.586349] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-14T19:09:24.586517] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-14T19:09:24.587495] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-14T19:09:24.587679] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-14T19:09:24.589158] [DEBUG] [LOCAL ] MUSA: Trimmed 27611 records to 18803 (keeping 150 days of data) [2025-09-14T19:09:24.724423] [DEBUG] [LOCAL ] MUSA: Primary data saved (18803 records). [2025-09-14T19:09:24.724695] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-14T19:09:24.724834] [INFO ] [MAIN ] Update Progress: 1434/2370 symbols completed. MUSA took 18.1s. Estimated remaining: 1h 39m 21s. Rate: 9.4 symbols/min [2025-09-14T19:09:24.899862] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:24.909237] [DEBUG] [LOCAL ] MVF: Loaded 5457 existing records from primary storage. [2025-09-14T19:09:24.909431] [INFO ] [MAIN ] MVF: Loaded 5457 existing records. [2025-09-14T19:09:25.093708] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:25.094069] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-14T19:09:25.094137] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-14T19:09:25.094607] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-14T19:09:25.094708] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-14T19:09:25.368865] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-14T19:09:25.493864] [INFO ] [REMOTE ] MVF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:25.660295] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-14T19:09:26.158894] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-14T19:09:26.429986] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T19:09:26.861093] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:09:26.867049] [INFO ] [REMOTE ] MUR: Full fetch complete (57591 records). [2025-09-14T19:09:26.867248] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-14T19:09:26.967302] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-14T19:09:27.273722] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-14T19:09:27.273995] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-14T19:09:27.275040] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-14T19:09:27.275103] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-14T19:09:27.276722] [DEBUG] [LOCAL ] MUR: Trimmed 57591 records to 39754 (keeping 150 days of data) [2025-09-14T19:09:27.534426] [DEBUG] [LOCAL ] MUR: Primary data saved (39754 records). [2025-09-14T19:09:27.534612] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-14T19:09:27.534749] [INFO ] [MAIN ] Update Progress: 1435/2370 symbols completed. MUR took 30.6s. Estimated remaining: 1h 39m 13s. Rate: 9.4 symbols/min [2025-09-14T19:09:27.703940] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:27.709927] [DEBUG] [LOCAL ] MVO: Loaded 4061 existing records from primary storage. [2025-09-14T19:09:27.710055] [INFO ] [MAIN ] MVO: Loaded 4061 existing records. [2025-09-14T19:09:27.764158] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-14T19:09:27.897202] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:27.897572] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-14T19:09:27.897663] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-14T19:09:27.898298] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-14T19:09:27.898367] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-14T19:09:28.288977] [INFO ] [REMOTE ] MVO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:28.558857] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-14T19:09:28.785108] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-14T19:09:28.832618] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T19:09:29.085098] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-14T19:09:29.358902] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-14T19:09:30.158847] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-14T19:09:30.349202] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T19:09:30.958882] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-14T19:09:31.158856] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-14T19:09:31.758885] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-14T19:09:31.941731] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T19:09:32.020265] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-14T19:09:32.558870] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-14T19:09:33.358865] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-14T19:09:33.706103] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T19:09:34.158827] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-14T19:09:34.293165] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T19:09:34.367758] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:09:34.368112] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-14T19:09:34.368202] [INFO ] [REMOTE ] MUSE: Full fetch complete (95 records). [2025-09-14T19:09:34.368288] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-14T19:09:34.368982] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T19:09:34.369098] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:09:34.369161] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:09:34.369222] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-14T19:09:34.369325] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-14T19:09:34.369375] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-14T19:09:34.369457] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-14T19:09:34.369564] [INFO ] [MAIN ] Update Progress: 1436/2370 symbols completed. MUSE took 24.9s. Estimated remaining: 1h 39m 7s. Rate: 9.4 symbols/min [2025-09-14T19:09:34.546672] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:34.553772] [DEBUG] [LOCAL ] MVT: Loaded 4116 existing records from primary storage. [2025-09-14T19:09:34.553937] [INFO ] [MAIN ] MVT: Loaded 4116 existing records. [2025-09-14T19:09:34.735285] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:34.735669] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-14T19:09:34.735740] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-14T19:09:34.736080] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-14T19:09:34.736144] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-14T19:09:34.968850] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-14T19:09:35.104215] [INFO ] [REMOTE ] MVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:35.758875] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-14T19:09:35.922379] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T19:09:36.465415] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T19:09:36.558823] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-14T19:09:37.358869] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-14T19:09:37.433596] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T19:09:38.158931] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-14T19:09:38.810474] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T19:09:38.815726] [INFO ] [REMOTE ] MUX: Full fetch complete (45670 records). [2025-09-14T19:09:38.815866] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-14T19:09:38.965923] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-14T19:09:39.203291] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-14T19:09:39.203130] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T19:09:39.203629] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-14T19:09:39.207963] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-14T19:09:39.209098] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-14T19:09:39.210460] [DEBUG] [LOCAL ] MUX: Trimmed 45670 records to 31410 (keeping 150 days of data) [2025-09-14T19:09:39.414319] [DEBUG] [LOCAL ] MUX: Primary data saved (31410 records). [2025-09-14T19:09:39.414588] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-14T19:09:39.414763] [INFO ] [MAIN ] Update Progress: 1437/2370 symbols completed. MUX took 27.7s. Estimated remaining: 1h 38m 59s. Rate: 9.4 symbols/min [2025-09-14T19:09:39.758917] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-14T19:09:39.989779] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T19:09:40.558855] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-14T19:09:40.660633] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T19:09:41.207050] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T19:09:41.358868] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-14T19:09:42.158845] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-14T19:09:42.312614] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T19:09:42.959619] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-14T19:09:42.960498] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T19:09:43.758876] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-14T19:09:43.856994] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T19:09:44.548415] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T19:09:44.558835] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-14T19:09:45.358861] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-14T19:09:45.419951] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T19:09:45.962457] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T19:09:46.158852] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-14T19:09:46.958887] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-14T19:09:47.001363] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T19:09:47.758858] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-14T19:09:47.811109] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T19:09:48.558842] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-14T19:09:48.755712] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T19:09:49.169889] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T19:09:49.171243] [INFO ] [REMOTE ] MVO: Full fetch complete (10077 records). [2025-09-14T19:09:49.171329] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-14T19:09:49.391465] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-14T19:09:49.581981] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-14T19:09:49.582113] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-14T19:09:49.582584] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-14T19:09:49.582689] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-14T19:09:49.583358] [DEBUG] [LOCAL ] MVO: Trimmed 10077 records to 6506 (keeping 150 days of data) [2025-09-14T19:09:49.624114] [DEBUG] [LOCAL ] MVO: Primary data saved (6506 records). [2025-09-14T19:09:49.624335] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-14T19:09:49.624488] [INFO ] [MAIN ] Update Progress: 1438/2370 symbols completed. MVO took 22.1s. Estimated remaining: 1h 38m 55s. Rate: 9.4 symbols/min [2025-09-14T19:09:50.158911] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-14T19:09:50.268305] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T19:09:50.270089] [INFO ] [REMOTE ] MVT: Full fetch complete (10440 records). [2025-09-14T19:09:50.270177] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-14T19:09:50.629509] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-14T19:09:50.629675] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-14T19:09:50.629998] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-14T19:09:50.630093] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-14T19:09:50.630974] [DEBUG] [LOCAL ] MVT: Trimmed 10440 records to 7495 (keeping 150 days of data) [2025-09-14T19:09:50.678594] [DEBUG] [LOCAL ] MVT: Primary data saved (7495 records). [2025-09-14T19:09:50.678777] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-14T19:09:50.678891] [INFO ] [MAIN ] Update Progress: 1439/2370 symbols completed. MVT took 16.3s. Estimated remaining: 1h 38m 46s. Rate: 9.4 symbols/min [2025-09-14T19:09:51.063539] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T19:09:51.066872] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-14T19:09:51.882518] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T19:09:51.884518] [INFO ] [REMOTE ] MVF: Full fetch complete (13675 records). [2025-09-14T19:09:51.884602] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-14T19:09:52.241149] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-14T19:09:52.241255] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-14T19:09:52.241562] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-14T19:09:52.241613] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-14T19:09:52.242123] [DEBUG] [LOCAL ] MVF: Trimmed 13675 records to 9100 (keeping 150 days of data) [2025-09-14T19:09:52.302283] [DEBUG] [LOCAL ] MVF: Primary data saved (9100 records). [2025-09-14T19:09:52.302494] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-14T19:09:52.302611] [INFO ] [MAIN ] Update Progress: 1440/2370 symbols completed. MVF took 27.6s. Estimated remaining: 1h 38m 36s. Rate: 9.4 symbols/min [2025-09-14T19:09:53.023239] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:52.948542] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:53.045738] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:53.063382] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:09:53.070597] [DEBUG] [LOCAL ] MXE: Loaded 928 existing records from primary storage. [2025-09-14T19:09:53.070863] [INFO ] [MAIN ] MXE: Loaded 928 existing records. [2025-09-14T19:09:53.100938] [DEBUG] [LOCAL ] MXF: Loaded 1665 existing records from primary storage. [2025-09-14T19:09:53.101236] [INFO ] [MAIN ] MXF: Loaded 1665 existing records. [2025-09-14T19:09:53.191123] [DEBUG] [LOCAL ] MX: Loaded 10181 existing records from primary storage. [2025-09-14T19:09:53.244929] [INFO ] [MAIN ] MX: Loaded 10181 existing records. [2025-09-14T19:09:53.371473] [DEBUG] [LOCAL ] MWA: Loaded 20067 existing records from primary storage. [2025-09-14T19:09:53.421063] [INFO ] [MAIN ] MWA: Loaded 20067 existing records. [2025-09-14T19:09:53.581297] [WARN ] [MAIN ] MXE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:53.655423] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:53.719455] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-14T19:09:53.763281] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-14T19:09:53.763608] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-14T19:09:53.796786] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-14T19:09:53.816924] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:53.817407] [DEBUG] [LOCAL ] MXE: Deleted primary data file. [2025-09-14T19:09:53.818136] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-14T19:09:53.818349] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-14T19:09:53.839194] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-14T19:09:53.867370] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-14T19:09:53.867208] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-14T19:09:53.973425] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-14T19:09:54.024188] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:09:54.052970] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-14T19:09:54.126985] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-14T19:09:54.175108] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-14T19:09:54.233377] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-14T19:09:54.325424] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-14T19:09:55.332961] [INFO ] [REMOTE ] MXF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:55.296774] [INFO ] [REMOTE ] MXE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:55.372443] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-14T19:09:55.392534] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-14T19:09:55.516709] [INFO ] [REMOTE ] MX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:55.532381] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-14T19:09:55.553365] [INFO ] [REMOTE ] MWA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:09:55.553928] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-14T19:09:56.006542] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T19:09:56.007835] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-14T19:09:56.323276] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T19:09:56.326053] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-14T19:09:56.337815] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-14T19:09:56.558858] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-14T19:09:56.713701] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T19:09:56.974431] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-14T19:09:57.061039] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T19:09:57.100343] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T19:09:57.358859] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-14T19:09:57.869080] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T19:09:58.158904] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-14T19:09:58.652764] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T19:09:58.958896] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-14T19:09:59.758845] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-14T19:10:00.558936] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-14T19:10:00.658451] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T19:10:00.947196] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T19:10:01.358899] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-14T19:10:01.712497] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T19:10:02.115251] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T19:10:02.158849] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-14T19:10:02.958852] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-14T19:10:03.070873] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T19:10:03.758840] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-14T19:10:04.043955] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T19:10:04.137172] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T19:10:04.558824] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-14T19:10:05.309457] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-14T19:10:05.358845] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-14T19:10:06.129663] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T19:10:06.158777] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-14T19:10:06.958842] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-14T19:10:07.440391] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T19:10:07.758832] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-14T19:10:08.213733] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T19:10:08.214685] [INFO ] [REMOTE ] MXE: Full fetch complete (1779 records). [2025-09-14T19:10:08.214770] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-14T19:10:08.391130] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T19:10:08.391356] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:10:08.391409] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:10:08.391475] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-14T19:10:08.391549] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-14T19:10:08.391599] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-14T19:10:08.391671] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-14T19:10:08.391766] [INFO ] [MAIN ] Update Progress: 1441/2370 symbols completed. MXE took 16.1s. Estimated remaining: 1h 38m 36s. Rate: 9.4 symbols/min [2025-09-14T19:10:08.567894] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-14T19:10:08.573738] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:08.584091] [DEBUG] [LOCAL ] MYD: Loaded 5094 existing records from primary storage. [2025-09-14T19:10:08.584281] [INFO ] [MAIN ] MYD: Loaded 5094 existing records. [2025-09-14T19:10:08.774943] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:08.775545] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-14T19:10:08.775659] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-14T19:10:08.776067] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-14T19:10:08.805168] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-14T19:10:08.882215] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T19:10:09.201868] [INFO ] [REMOTE ] MYD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:09.358870] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-14T19:10:09.943564] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T19:10:10.158849] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-14T19:10:10.741879] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T19:10:10.958826] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-14T19:10:11.157461] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T19:10:11.758786] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-14T19:10:11.846254] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T19:10:12.558844] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-14T19:10:12.921589] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T19:10:13.358852] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-14T19:10:13.833696] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T19:10:13.834872] [INFO ] [REMOTE ] MXF: Full fetch complete (7025 records). [2025-09-14T19:10:13.834967] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-14T19:10:14.163081] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-14T19:10:14.218311] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-14T19:10:14.218434] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-14T19:10:14.218704] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-14T19:10:14.218847] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-14T19:10:14.219588] [DEBUG] [LOCAL ] MXF: Trimmed 7025 records to 4251 (keeping 150 days of data) [2025-09-14T19:10:14.277584] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T19:10:14.293031] [DEBUG] [LOCAL ] MXF: Primary data saved (4251 records). [2025-09-14T19:10:14.293593] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-14T19:10:14.293719] [INFO ] [MAIN ] Update Progress: 1442/2370 symbols completed. MXF took 22.0s. Estimated remaining: 1h 38m 29s. Rate: 9.4 symbols/min [2025-09-14T19:10:14.465317] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:14.476424] [DEBUG] [LOCAL ] MYE: Loaded 10010 existing records from primary storage. [2025-09-14T19:10:14.476571] [INFO ] [MAIN ] MYE: Loaded 10010 existing records. [2025-09-14T19:10:14.660087] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:14.660373] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-14T19:10:14.660439] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-14T19:10:14.660897] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-14T19:10:14.660969] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-14T19:10:14.963988] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-14T19:10:15.023277] [INFO ] [REMOTE ] MYE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:15.343628] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T19:10:15.758888] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-14T19:10:16.484206] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T19:10:16.558805] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-14T19:10:16.941849] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T19:10:17.358905] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-14T19:10:17.660125] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T19:10:17.662679] [INFO ] [REMOTE ] MX: Full fetch complete (24718 records). [2025-09-14T19:10:17.662777] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-14T19:10:18.026320] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-14T19:10:18.026425] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-14T19:10:18.026951] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-14T19:10:18.027006] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-14T19:10:18.027636] [DEBUG] [LOCAL ] MX: Trimmed 24718 records to 16829 (keeping 150 days of data) [2025-09-14T19:10:18.127007] [DEBUG] [LOCAL ] MX: Primary data saved (16829 records). [2025-09-14T19:10:18.127222] [INFO ] [MAIN ] MX: Full history saved. [2025-09-14T19:10:18.127346] [INFO ] [MAIN ] Update Progress: 1443/2370 symbols completed. MX took 25.8s. Estimated remaining: 1h 38m 21s. Rate: 9.4 symbols/min [2025-09-14T19:10:18.164078] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-14T19:10:18.310317] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:18.322158] [DEBUG] [LOCAL ] MYI: Loaded 8573 existing records from primary storage. [2025-09-14T19:10:18.322401] [INFO ] [MAIN ] MYI: Loaded 8573 existing records. [2025-09-14T19:10:18.508884] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:18.509305] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-14T19:10:18.509376] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-14T19:10:18.509791] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-14T19:10:18.509864] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-14T19:10:18.879381] [INFO ] [REMOTE ] MYI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:18.931223] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T19:10:18.958784] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-14T19:10:19.758895] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-14T19:10:20.008143] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T19:10:20.332352] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T19:10:20.558844] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-14T19:10:20.880950] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T19:10:21.358873] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-14T19:10:21.854172] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T19:10:22.158825] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-14T19:10:22.404961] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T19:10:22.958856] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-14T19:10:23.758884] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-14T19:10:23.809997] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T19:10:23.849817] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T19:10:24.558875] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-14T19:10:24.986675] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T19:10:25.358860] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-14T19:10:25.490023] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T19:10:26.158845] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-14T19:10:26.382793] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T19:10:26.958855] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-14T19:10:27.023472] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T19:10:27.758855] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-14T19:10:28.167576] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T19:10:28.380907] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T19:10:28.385231] [INFO ] [REMOTE ] MWA: Full fetch complete (51581 records). [2025-09-14T19:10:28.385358] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-14T19:10:28.565224] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-14T19:10:28.775320] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-14T19:10:28.775439] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-14T19:10:28.777153] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-14T19:10:28.777220] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-14T19:10:28.778724] [DEBUG] [LOCAL ] MWA: Trimmed 51581 records to 34538 (keeping 150 days of data) [2025-09-14T19:10:28.998263] [DEBUG] [LOCAL ] MWA: Primary data saved (34538 records). [2025-09-14T19:10:28.998449] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-14T19:10:28.998563] [INFO ] [MAIN ] Update Progress: 1444/2370 symbols completed. MWA took 36.7s. Estimated remaining: 1h 38m 18s. Rate: 9.4 symbols/min [2025-09-14T19:10:29.166592] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:29.173837] [DEBUG] [LOCAL ] MYN: Loaded 4821 existing records from primary storage. [2025-09-14T19:10:29.173966] [INFO ] [MAIN ] MYN: Loaded 4821 existing records. [2025-09-14T19:10:29.348928] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:29.349193] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-14T19:10:29.349256] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-14T19:10:29.349602] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-14T19:10:29.349696] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-14T19:10:29.363964] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-14T19:10:29.706602] [INFO ] [REMOTE ] MYN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:29.895621] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T19:10:30.158839] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-14T19:10:30.610753] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T19:10:30.958789] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-14T19:10:31.273576] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T19:10:31.501696] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T19:10:31.758851] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-14T19:10:32.334383] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T19:10:32.336907] [INFO ] [REMOTE ] MYE: Full fetch complete (27635 records). [2025-09-14T19:10:32.337001] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-14T19:10:32.563991] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-14T19:10:32.713804] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-14T19:10:32.713915] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-14T19:10:32.714602] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-14T19:10:32.714683] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-14T19:10:32.717098] [DEBUG] [LOCAL ] MYE: Trimmed 27635 records to 17877 (keeping 150 days of data) [2025-09-14T19:10:32.842497] [DEBUG] [LOCAL ] MYE: Primary data saved (17877 records). [2025-09-14T19:10:32.842718] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-14T19:10:32.842931] [INFO ] [MAIN ] Update Progress: 1445/2370 symbols completed. MYE took 18.5s. Estimated remaining: 1h 38m 10s. Rate: 9.4 symbols/min [2025-09-14T19:10:33.012538] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:33.029563] [DEBUG] [LOCAL ] NABL: Loaded 16845 existing records from primary storage. [2025-09-14T19:10:33.029758] [INFO ] [MAIN ] NABL: Loaded 16845 existing records. [2025-09-14T19:10:33.206009] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:33.206337] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-14T19:10:33.206412] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-14T19:10:33.207017] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-14T19:10:33.207092] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-14T19:10:33.364291] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-14T19:10:33.495304] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T19:10:33.517992] [INFO ] [REMOTE ] MYD: Full fetch complete (15112 records). [2025-09-14T19:10:33.546577] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-14T19:10:33.574910] [INFO ] [REMOTE ] NABL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:33.936984] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-14T19:10:33.937091] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-14T19:10:33.937468] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-14T19:10:33.937521] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-14T19:10:33.938064] [DEBUG] [LOCAL ] MYD: Trimmed 15112 records to 9439 (keeping 150 days of data) [2025-09-14T19:10:33.996190] [DEBUG] [LOCAL ] MYD: Primary data saved (9439 records). [2025-09-14T19:10:33.996368] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-14T19:10:33.996475] [INFO ] [MAIN ] Update Progress: 1446/2370 symbols completed. MYD took 25.6s. Estimated remaining: 1h 38m 0s. Rate: 9.4 symbols/min [2025-09-14T19:10:34.170053] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-14T19:10:34.207291] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:34.220962] [DEBUG] [LOCAL ] NAC: Loaded 10636 existing records from primary storage. [2025-09-14T19:10:34.221118] [INFO ] [MAIN ] NAC: Loaded 10636 existing records. [2025-09-14T19:10:34.396231] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:34.396495] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-14T19:10:34.396560] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-14T19:10:34.397000] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-14T19:10:34.397085] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-14T19:10:34.673398] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T19:10:34.763908] [INFO ] [REMOTE ] NAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:34.958829] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-14T19:10:35.432224] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T19:10:35.758854] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-14T19:10:36.047012] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:10:36.400112] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T19:10:36.558854] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-14T19:10:37.358887] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-14T19:10:37.483319] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T19:10:38.158837] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-14T19:10:38.951120] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T19:10:38.960419] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-14T19:10:39.571903] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T19:10:39.758812] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-14T19:10:39.769578] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T19:10:40.558860] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-14T19:10:41.155393] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T19:10:41.358795] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-14T19:10:42.017006] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T19:10:42.158845] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-14T19:10:42.425998] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T19:10:42.958839] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-14T19:10:43.661516] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T19:10:43.758791] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-14T19:10:43.900133] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T19:10:44.558828] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-14T19:10:45.182758] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T19:10:45.358809] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-14T19:10:45.485865] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T19:10:46.158834] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-14T19:10:46.414025] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T19:10:46.958827] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-14T19:10:47.303006] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T19:10:47.758864] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-14T19:10:47.825257] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:10:48.558904] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-14T19:10:48.748718] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T19:10:49.358826] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-14T19:10:49.738190] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:10:50.158841] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-14T19:10:50.790534] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T19:10:50.958856] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-14T19:10:51.002797] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T19:10:51.758870] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-14T19:10:52.481134] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T19:10:52.558810] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-14T19:10:52.590187] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T19:10:53.299427] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:10:53.301277] [INFO ] [REMOTE ] MYN: Full fetch complete (10993 records). [2025-09-14T19:10:53.301372] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-14T19:10:53.363937] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-14T19:10:53.664861] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-14T19:10:53.664977] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-14T19:10:53.665281] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-14T19:10:53.665344] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-14T19:10:53.665886] [DEBUG] [LOCAL ] MYN: Trimmed 10993 records to 7456 (keeping 150 days of data) [2025-09-14T19:10:53.713565] [DEBUG] [LOCAL ] MYN: Primary data saved (7456 records). [2025-09-14T19:10:53.713731] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-14T19:10:53.713874] [INFO ] [MAIN ] Update Progress: 1447/2370 symbols completed. MYN took 24.7s. Estimated remaining: 1h 38m 2s. Rate: 9.4 symbols/min [2025-09-14T19:10:53.884056] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:53.903665] [DEBUG] [LOCAL ] NAD: Loaded 15301 existing records from primary storage. [2025-09-14T19:10:53.903834] [INFO ] [MAIN ] NAD: Loaded 15301 existing records. [2025-09-14T19:10:54.095186] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:54.095704] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-14T19:10:54.095779] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-14T19:10:54.096478] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-14T19:10:54.096548] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-14T19:10:54.164068] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-14T19:10:54.447048] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T19:10:54.475000] [INFO ] [REMOTE ] NAD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:54.475413] [INFO ] [REMOTE ] MYI: Full fetch complete (21386 records). [2025-09-14T19:10:54.475872] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-14T19:10:54.913122] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-14T19:10:54.913302] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-14T19:10:54.914237] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-14T19:10:54.914339] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-14T19:10:54.915434] [DEBUG] [LOCAL ] MYI: Trimmed 21386 records to 13687 (keeping 150 days of data) [2025-09-14T19:10:54.964129] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-14T19:10:55.039360] [DEBUG] [LOCAL ] MYI: Primary data saved (13687 records). [2025-09-14T19:10:55.039732] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-14T19:10:55.039905] [INFO ] [MAIN ] Update Progress: 1448/2370 symbols completed. MYI took 36.9s. Estimated remaining: 1h 37m 53s. Rate: 9.4 symbols/min [2025-09-14T19:10:55.334925] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:55.344849] [DEBUG] [LOCAL ] NAN: Loaded 3925 existing records from primary storage. [2025-09-14T19:10:55.345361] [INFO ] [MAIN ] NAN: Loaded 3925 existing records. [2025-09-14T19:10:55.416964] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T19:10:55.449454] [INFO ] [REMOTE ] NAC: Full fetch complete (26559 records). [2025-09-14T19:10:55.459171] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-14T19:10:55.767933] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-14T19:10:55.790024] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:55.872512] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-14T19:10:55.943527] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-14T19:10:55.998981] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-14T19:10:56.001330] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-14T19:10:56.205196] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-14T19:10:56.250747] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-14T19:10:56.301110] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-14T19:10:56.350968] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-14T19:10:56.400142] [DEBUG] [LOCAL ] NAC: Trimmed 26559 records to 17941 (keeping 150 days of data) [2025-09-14T19:10:56.523937] [INFO ] [REMOTE ] NAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:56.562389] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-14T19:10:56.575025] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T19:10:56.593856] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T19:10:56.593981] [INFO ] [REMOTE ] NABL: Full fetch complete (43885 records). [2025-09-14T19:10:56.601904] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-14T19:10:56.995967] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-14T19:10:56.996948] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-14T19:10:56.998711] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-14T19:10:56.999028] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-14T19:10:57.002387] [DEBUG] [LOCAL ] NABL: Trimmed 43885 records to 29693 (keeping 150 days of data) [2025-09-14T19:10:57.065532] [DEBUG] [LOCAL ] NAC: Primary data saved (17941 records). [2025-09-14T19:10:57.065801] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-14T19:10:57.092002] [INFO ] [MAIN ] Update Progress: 1449/2370 symbols completed. NAC took 23.1s. Estimated remaining: 1h 37m 44s. Rate: 9.4 symbols/min [2025-09-14T19:10:57.280514] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:57.322737] [DEBUG] [LOCAL ] NAT: Loaded 21551 existing records from primary storage. [2025-09-14T19:10:57.322956] [INFO ] [MAIN ] NAT: Loaded 21551 existing records. [2025-09-14T19:10:57.376845] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-14T19:10:57.566920] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:57.579222] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:10:57.569381] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-14T19:10:57.586337] [DEBUG] [LOCAL ] NABL: Primary data saved (29693 records). [2025-09-14T19:10:57.586427] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-14T19:10:57.586566] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-14T19:10:57.586786] [INFO ] [MAIN ] Update Progress: 1450/2370 symbols completed. NABL took 24.7s. Estimated remaining: 1h 37m 34s. Rate: 9.4 symbols/min [2025-09-14T19:10:57.619074] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-14T19:10:57.662170] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-14T19:10:57.873697] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:10:58.102863] [DEBUG] [LOCAL ] NATL: Loaded 15932 existing records from primary storage. [2025-09-14T19:10:58.123060] [INFO ] [REMOTE ] NAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:58.123418] [INFO ] [MAIN ] NATL: Loaded 15932 existing records. [2025-09-14T19:10:58.165202] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-14T19:10:58.302325] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:10:58.302619] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-14T19:10:58.302713] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-14T19:10:58.303249] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-14T19:10:58.303313] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-14T19:10:58.662685] [INFO ] [REMOTE ] NATL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:10:58.842675] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:10:58.958879] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-14T19:10:59.758841] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-14T19:11:00.090720] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T19:11:00.164867] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T19:11:00.558855] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-14T19:11:00.625962] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T19:11:01.358933] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-14T19:11:02.158882] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-14T19:11:02.205617] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T19:11:02.352173] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T19:11:02.958864] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-14T19:11:03.758838] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-14T19:11:03.801469] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T19:11:04.138360] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T19:11:04.558863] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-14T19:11:05.125001] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T19:11:05.358855] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-14T19:11:06.158871] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-14T19:11:06.433511] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T19:11:06.893617] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T19:11:06.958780] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-14T19:11:07.290428] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T19:11:07.758852] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-14T19:11:07.898832] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T19:11:08.203881] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T19:11:08.558835] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-14T19:11:09.257769] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T19:11:09.358872] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-14T19:11:10.158863] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-14T19:11:10.958800] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-14T19:11:11.218478] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T19:11:11.440557] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T19:11:11.758860] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-14T19:11:11.837484] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T19:11:12.558868] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-14T19:11:13.368208] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-14T19:11:13.372661] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T19:11:13.970194] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T19:11:14.158858] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-14T19:11:14.798409] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T19:11:14.958828] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-14T19:11:15.761135] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-14T19:11:15.768811] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T19:11:15.783519] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T19:11:15.785500] [INFO ] [REMOTE ] NAN: Full fetch complete (9921 records). [2025-09-14T19:11:15.785629] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-14T19:11:16.161095] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-14T19:11:16.161223] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-14T19:11:16.161490] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-14T19:11:16.161544] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-14T19:11:16.162005] [DEBUG] [LOCAL ] NAN: Trimmed 9921 records to 6288 (keeping 150 days of data) [2025-09-14T19:11:16.200817] [DEBUG] [LOCAL ] NAN: Primary data saved (6288 records). [2025-09-14T19:11:16.200999] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-14T19:11:16.201111] [INFO ] [MAIN ] Update Progress: 1451/2370 symbols completed. NAN took 21.2s. Estimated remaining: 1h 37m 35s. Rate: 9.4 symbols/min [2025-09-14T19:11:16.373315] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:16.376603] [DEBUG] [LOCAL ] NAZ: Loaded 1387 existing records from primary storage. [2025-09-14T19:11:16.376724] [INFO ] [MAIN ] NAZ: Loaded 1387 existing records. [2025-09-14T19:11:16.555699] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:16.555978] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-14T19:11:16.556040] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-14T19:11:16.556293] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-14T19:11:16.556352] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-14T19:11:16.567615] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-14T19:11:16.916355] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:11:17.367541] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-14T19:11:17.374557] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T19:11:18.006411] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T19:11:18.010771] [INFO ] [REMOTE ] NATL: Full fetch complete (34878 records). [2025-09-14T19:11:18.010897] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-14T19:11:18.164847] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-14T19:11:18.408825] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-14T19:11:18.408957] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-14T19:11:18.410195] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-14T19:11:18.410284] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-14T19:11:18.411501] [DEBUG] [LOCAL ] NATL: Trimmed 34878 records to 24453 (keeping 150 days of data) [2025-09-14T19:11:18.554825] [DEBUG] [LOCAL ] NATL: Primary data saved (24453 records). [2025-09-14T19:11:18.555008] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-14T19:11:18.555119] [INFO ] [MAIN ] Update Progress: 1452/2370 symbols completed. NATL took 21.0s. Estimated remaining: 1h 37m 26s. Rate: 9.4 symbols/min [2025-09-14T19:11:18.734357] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:18.774486] [DEBUG] [LOCAL ] NBB: Loaded 4095 existing records from primary storage. [2025-09-14T19:11:18.774199] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T19:11:18.774697] [INFO ] [MAIN ] NBB: Loaded 4095 existing records. [2025-09-14T19:11:18.972231] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-14T19:11:18.977313] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:18.978907] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-14T19:11:18.978983] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-14T19:11:18.979334] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-14T19:11:18.979396] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-14T19:11:19.348521] [INFO ] [REMOTE ] NBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:11:19.619883] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T19:11:19.758862] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-14T19:11:20.372903] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T19:11:20.558889] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-14T19:11:20.898769] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T19:11:21.358852] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-14T19:11:21.835906] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T19:11:21.842186] [INFO ] [REMOTE ] NAD: Full fetch complete (36775 records). [2025-09-14T19:11:21.842416] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-14T19:11:22.158879] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-14T19:11:22.245820] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T19:11:22.259985] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-14T19:11:22.262484] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-14T19:11:22.263487] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-14T19:11:22.263547] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-14T19:11:22.264480] [DEBUG] [LOCAL ] NAD: Trimmed 36775 records to 25561 (keeping 150 days of data) [2025-09-14T19:11:22.447076] [DEBUG] [LOCAL ] NAD: Primary data saved (25561 records). [2025-09-14T19:11:22.447344] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-14T19:11:22.447494] [INFO ] [MAIN ] Update Progress: 1453/2370 symbols completed. NAD took 28.7s. Estimated remaining: 1h 37m 18s. Rate: 9.4 symbols/min [2025-09-14T19:11:22.653699] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:22.667661] [DEBUG] [LOCAL ] NBHC: Loaded 10422 existing records from primary storage. [2025-09-14T19:11:22.667887] [INFO ] [MAIN ] NBHC: Loaded 10422 existing records. [2025-09-14T19:11:22.839376] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T19:11:22.859935] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:22.862348] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-14T19:11:22.862421] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-14T19:11:22.862906] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-14T19:11:22.862973] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-14T19:11:22.964154] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-14T19:11:23.239702] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:11:23.758708] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T19:11:23.758867] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-14T19:11:24.558902] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-14T19:11:25.326749] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T19:11:25.331991] [INFO ] [REMOTE ] NAT: Full fetch complete (53565 records). [2025-09-14T19:11:25.332124] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-14T19:11:25.363901] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-14T19:11:25.502604] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T19:11:25.730725] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-14T19:11:25.730906] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-14T19:11:25.732307] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-14T19:11:25.732401] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-14T19:11:25.734453] [DEBUG] [LOCAL ] NAT: Trimmed 53565 records to 36541 (keeping 150 days of data) [2025-09-14T19:11:25.981569] [DEBUG] [LOCAL ] NAT: Primary data saved (36541 records). [2025-09-14T19:11:25.981802] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-14T19:11:25.981915] [INFO ] [MAIN ] Update Progress: 1454/2370 symbols completed. NAT took 28.9s. Estimated remaining: 1h 37m 10s. Rate: 9.4 symbols/min [2025-09-14T19:11:26.093305] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T19:11:26.163965] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-14T19:11:26.166407] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:26.185175] [DEBUG] [LOCAL ] NBR: Loaded 16038 existing records from primary storage. [2025-09-14T19:11:26.185356] [INFO ] [MAIN ] NBR: Loaded 16038 existing records. [2025-09-14T19:11:26.388215] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:26.388492] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-14T19:11:26.388555] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-14T19:11:26.389080] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-14T19:11:26.389158] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-14T19:11:26.766840] [INFO ] [REMOTE ] NBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:11:26.949815] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:11:26.958775] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-14T19:11:27.576369] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T19:11:27.758818] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-14T19:11:28.558805] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-14T19:11:28.922237] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T19:11:29.338365] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T19:11:29.358797] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-14T19:11:30.158854] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-14T19:11:30.189385] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T19:11:30.703728] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T19:11:30.958828] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-14T19:11:31.758847] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-14T19:11:31.879808] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T19:11:32.558862] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-14T19:11:32.819989] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T19:11:33.186631] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T19:11:33.358887] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-14T19:11:33.931544] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T19:11:34.158905] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-14T19:11:34.958910] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-14T19:11:35.616872] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:11:35.618044] [INFO ] [REMOTE ] NAZ: Full fetch complete (3022 records). [2025-09-14T19:11:35.618218] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-14T19:11:35.746003] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T19:11:35.761830] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-14T19:11:36.034178] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-14T19:11:36.034325] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-14T19:11:36.034546] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-14T19:11:36.034608] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-14T19:11:36.035048] [DEBUG] [LOCAL ] NAZ: Trimmed 3022 records to 1977 (keeping 150 days of data) [2025-09-14T19:11:36.049886] [DEBUG] [LOCAL ] NAZ: Primary data saved (1977 records). [2025-09-14T19:11:36.049977] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-14T19:11:36.050093] [INFO ] [MAIN ] Update Progress: 1455/2370 symbols completed. NAZ took 19.8s. Estimated remaining: 1h 37m 6s. Rate: 9.4 symbols/min [2025-09-14T19:11:36.230110] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:36.244118] [DEBUG] [LOCAL ] NBXG: Loaded 9728 existing records from primary storage. [2025-09-14T19:11:36.244343] [INFO ] [MAIN ] NBXG: Loaded 9728 existing records. [2025-09-14T19:11:36.436799] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:36.437701] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-14T19:11:36.437785] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-14T19:11:36.438364] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-14T19:11:36.438451] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-14T19:11:36.563964] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-14T19:11:36.773447] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T19:11:36.811546] [INFO ] [REMOTE ] NBB: Full fetch complete (9593 records). [2025-09-14T19:11:36.831770] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-14T19:11:36.859557] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:11:37.224080] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-14T19:11:37.224192] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-14T19:11:37.224467] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-14T19:11:37.224518] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-14T19:11:37.224989] [DEBUG] [LOCAL ] NBB: Trimmed 9593 records to 6533 (keeping 150 days of data) [2025-09-14T19:11:37.265096] [DEBUG] [LOCAL ] NBB: Primary data saved (6533 records). [2025-09-14T19:11:37.265236] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-14T19:11:37.265350] [INFO ] [MAIN ] Update Progress: 1456/2370 symbols completed. NBB took 18.7s. Estimated remaining: 1h 36m 56s. Rate: 9.4 symbols/min [2025-09-14T19:11:37.363994] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-14T19:11:37.444846] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:37.447428] [DEBUG] [LOCAL ] NC: Loaded 655 existing records from primary storage. [2025-09-14T19:11:37.447529] [INFO ] [MAIN ] NC: Loaded 655 existing records. [2025-09-14T19:11:37.627848] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:37.628106] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-14T19:11:37.628165] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-14T19:11:37.628404] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-14T19:11:37.628462] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-14T19:11:37.988898] [INFO ] [REMOTE ] NC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:11:38.046264] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T19:11:38.158839] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-14T19:11:38.557679] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T19:11:38.699267] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T19:11:38.958858] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-14T19:11:39.758832] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-14T19:11:40.218767] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T19:11:40.558852] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-14T19:11:41.249044] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T19:11:41.358859] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-14T19:11:41.471475] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T19:11:41.893493] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T19:11:42.158858] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-14T19:11:42.958857] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-14T19:11:43.472587] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T19:11:43.758857] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-14T19:11:44.079310] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T19:11:44.559411] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-14T19:11:44.563410] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T19:11:45.358901] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-14T19:11:46.037132] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T19:11:46.158822] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-14T19:11:46.443888] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T19:11:46.958853] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-14T19:11:47.244569] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T19:11:47.401430] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-14T19:11:47.758883] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-14T19:11:48.558921] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-14T19:11:48.949571] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T19:11:49.096065] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T19:11:49.358877] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-14T19:11:50.158875] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-14T19:11:50.707559] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-14T19:11:50.937042] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:11:50.958807] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-14T19:11:51.758881] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-14T19:11:52.259091] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-14T19:11:52.333498] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T19:11:52.558883] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-14T19:11:53.057445] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T19:11:53.358858] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-14T19:11:53.788215] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:11:53.789155] [INFO ] [REMOTE ] NC: Full fetch complete (2051 records). [2025-09-14T19:11:53.789243] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-14T19:11:54.171048] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-14T19:11:54.180282] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-14T19:11:54.180409] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-14T19:11:54.180563] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-14T19:11:54.180638] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-14T19:11:54.181141] [DEBUG] [LOCAL ] NC: Trimmed 2051 records to 1225 (keeping 150 days of data) [2025-09-14T19:11:54.190964] [DEBUG] [LOCAL ] NC: Primary data saved (1225 records). [2025-09-14T19:11:54.191094] [INFO ] [MAIN ] NC: Full history saved. [2025-09-14T19:11:54.191198] [INFO ] [MAIN ] Update Progress: 1457/2370 symbols completed. NC took 16.9s. Estimated remaining: 1h 36m 57s. Rate: 9.4 symbols/min [2025-09-14T19:11:54.381053] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:54.388728] [DEBUG] [LOCAL ] NCA: Loaded 3845 existing records from primary storage. [2025-09-14T19:11:54.388927] [INFO ] [MAIN ] NCA: Loaded 3845 existing records. [2025-09-14T19:11:54.574869] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:54.575207] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-14T19:11:54.575273] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-14T19:11:54.575680] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-14T19:11:54.575740] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-14T19:11:54.949987] [INFO ] [REMOTE ] NCA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:11:54.958835] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-14T19:11:55.350475] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:11:55.737773] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T19:11:55.758778] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-14T19:11:56.558824] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-14T19:11:57.004096] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T19:11:57.358854] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-14T19:11:57.539939] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T19:11:57.542520] [INFO ] [REMOTE ] NBXG: Full fetch complete (24965 records). [2025-09-14T19:11:57.542629] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-14T19:11:57.955052] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-14T19:11:57.955167] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-14T19:11:57.955735] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-14T19:11:57.955791] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-14T19:11:57.956445] [DEBUG] [LOCAL ] NBXG: Trimmed 24965 records to 16249 (keeping 150 days of data) [2025-09-14T19:11:58.065124] [DEBUG] [LOCAL ] NBXG: Primary data saved (16249 records). [2025-09-14T19:11:58.065313] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-14T19:11:58.065421] [INFO ] [MAIN ] Update Progress: 1458/2370 symbols completed. NBXG took 22.0s. Estimated remaining: 1h 36m 49s. Rate: 9.4 symbols/min [2025-09-14T19:11:58.161772] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-14T19:11:58.235365] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:58.245225] [DEBUG] [LOCAL ] NCDL: Loaded 8500 existing records from primary storage. [2025-09-14T19:11:58.245383] [INFO ] [MAIN ] NCDL: Loaded 8500 existing records. [2025-09-14T19:11:58.421042] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:58.421399] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-14T19:11:58.421540] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-14T19:11:58.421990] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-14T19:11:58.422093] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-14T19:11:58.509154] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T19:11:58.734129] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:11:58.748601] [INFO ] [REMOTE ] NBR: Full fetch complete (38084 records). [2025-09-14T19:11:58.764586] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-14T19:11:58.885610] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:11:58.975419] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-14T19:11:59.214600] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-14T19:11:59.214729] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-14T19:11:59.215728] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-14T19:11:59.215804] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-14T19:11:59.216773] [DEBUG] [LOCAL ] NBR: Trimmed 38084 records to 26348 (keeping 150 days of data) [2025-09-14T19:11:59.380866] [DEBUG] [LOCAL ] NBR: Primary data saved (26348 records). [2025-09-14T19:11:59.381047] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-14T19:11:59.381201] [INFO ] [MAIN ] Update Progress: 1459/2370 symbols completed. NBR took 33.4s. Estimated remaining: 1h 36m 39s. Rate: 9.4 symbols/min [2025-09-14T19:11:59.556963] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:11:59.581560] [DEBUG] [LOCAL ] NCLH: Loaded 24113 existing records from primary storage. [2025-09-14T19:11:59.581776] [INFO ] [MAIN ] NCLH: Loaded 24113 existing records. [2025-09-14T19:11:59.764191] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-14T19:11:59.770119] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:11:59.770308] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-14T19:11:59.770380] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-14T19:11:59.771254] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-14T19:11:59.771344] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-14T19:11:59.944913] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T19:12:00.153981] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:00.369157] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T19:12:00.371896] [INFO ] [REMOTE ] NBHC: Full fetch complete (24238 records). [2025-09-14T19:12:00.371987] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-14T19:12:00.563903] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-14T19:12:00.748661] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-14T19:12:00.748772] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-14T19:12:00.749314] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-14T19:12:00.749374] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-14T19:12:00.750135] [DEBUG] [LOCAL ] NBHC: Trimmed 24238 records to 16605 (keeping 150 days of data) [2025-09-14T19:12:00.853396] [DEBUG] [LOCAL ] NBHC: Primary data saved (16605 records). [2025-09-14T19:12:00.853581] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-14T19:12:00.853700] [INFO ] [MAIN ] Update Progress: 1460/2370 symbols completed. NBHC took 38.4s. Estimated remaining: 1h 36m 30s. Rate: 9.4 symbols/min [2025-09-14T19:12:01.022841] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:01.030875] [DEBUG] [LOCAL ] NCV: Loaded 6087 existing records from primary storage. [2025-09-14T19:12:01.031018] [INFO ] [MAIN ] NCV: Loaded 6087 existing records. [2025-09-14T19:12:01.211083] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:01.211372] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-14T19:12:01.211446] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-14T19:12:01.211830] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-14T19:12:01.211892] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-14T19:12:01.381021] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-14T19:12:01.567962] [INFO ] [REMOTE ] NCV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:02.101879] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T19:12:02.158796] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-14T19:12:02.958887] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-14T19:12:03.758846] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-14T19:12:04.747500] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-14T19:12:04.751612] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-14T19:12:05.324599] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (3.94 seconds). [2025-09-14T19:12:05.358832] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-14T19:12:05.536924] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-14T19:12:05.810344] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-14T19:12:05.887213] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T19:12:06.158860] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-14T19:12:06.222721] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:12:06.958873] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-14T19:12:07.758897] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-14T19:12:07.988011] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T19:12:08.562482] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-14T19:12:08.570882] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-14T19:12:09.087187] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T19:12:09.358821] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-14T19:12:09.446518] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T19:12:10.158872] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-14T19:12:10.958844] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-14T19:12:11.069221] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T19:12:11.769208] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-14T19:12:11.779103] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-14T19:12:11.954358] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T19:12:12.558857] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-14T19:12:12.931919] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T19:12:13.358881] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-14T19:12:13.503607] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T19:12:14.158951] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-14T19:12:14.958877] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-14T19:12:15.174802] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T19:12:15.758912] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-14T19:12:15.996758] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-14T19:12:16.364129] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T19:12:16.558948] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-14T19:12:17.358856] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-14T19:12:17.870879] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-14T19:12:17.923778] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T19:12:17.925535] [INFO ] [REMOTE ] NCA: Full fetch complete (10968 records). [2025-09-14T19:12:17.925712] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-14T19:12:18.163970] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-14T19:12:18.330517] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-14T19:12:18.330727] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-14T19:12:18.331345] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-14T19:12:18.331417] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-14T19:12:18.332186] [DEBUG] [LOCAL ] NCA: Trimmed 10968 records to 7389 (keeping 150 days of data) [2025-09-14T19:12:18.380654] [DEBUG] [LOCAL ] NCA: Primary data saved (7389 records). [2025-09-14T19:12:18.380872] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-14T19:12:18.381058] [INFO ] [MAIN ] Update Progress: 1461/2370 symbols completed. NCA took 24.2s. Estimated remaining: 1h 36m 30s. Rate: 9.4 symbols/min [2025-09-14T19:12:18.568942] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:18.582715] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T19:12:18.594012] [DEBUG] [LOCAL ] NCZ: Loaded 5060 existing records from primary storage. [2025-09-14T19:12:18.594212] [INFO ] [MAIN ] NCZ: Loaded 5060 existing records. [2025-09-14T19:12:18.780823] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:18.781194] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-14T19:12:18.781355] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-14T19:12:18.781796] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-14T19:12:18.781863] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-14T19:12:18.966321] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-14T19:12:19.176753] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:19.519578] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T19:12:19.758927] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-14T19:12:20.420167] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T19:12:20.558874] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-14T19:12:21.015370] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-14T19:12:21.358865] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-14T19:12:21.568460] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T19:12:22.158906] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-14T19:12:22.354266] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T19:12:22.958814] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-14T19:12:23.037503] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T19:12:23.039392] [INFO ] [REMOTE ] NCV: Full fetch complete (15108 records). [2025-09-14T19:12:23.039482] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-14T19:12:23.423172] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-14T19:12:23.423373] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-14T19:12:23.423956] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-14T19:12:23.424018] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-14T19:12:23.424958] [DEBUG] [LOCAL ] NCV: Trimmed 15108 records to 9633 (keeping 150 days of data) [2025-09-14T19:12:23.492979] [DEBUG] [LOCAL ] NCV: Primary data saved (9633 records). [2025-09-14T19:12:23.493237] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-14T19:12:23.493371] [INFO ] [MAIN ] Update Progress: 1462/2370 symbols completed. NCV took 22.6s. Estimated remaining: 1h 36m 23s. Rate: 9.4 symbols/min [2025-09-14T19:12:23.687595] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:23.698686] [DEBUG] [LOCAL ] NDMO: Loaded 7978 existing records from primary storage. [2025-09-14T19:12:23.698898] [INFO ] [MAIN ] NDMO: Loaded 7978 existing records. [2025-09-14T19:12:23.773230] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-14T19:12:23.914584] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:23.915002] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-14T19:12:23.915072] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-14T19:12:23.915469] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-14T19:12:23.915567] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-14T19:12:24.195881] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T19:12:24.338174] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:24.558912] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-14T19:12:25.358907] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-14T19:12:25.551325] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T19:12:25.553622] [INFO ] [REMOTE ] NCDL: Full fetch complete (23828 records). [2025-09-14T19:12:25.553758] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-14T19:12:25.922060] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-14T19:12:25.922178] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-14T19:12:25.922735] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-14T19:12:25.922793] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-14T19:12:25.923506] [DEBUG] [LOCAL ] NCDL: Trimmed 23828 records to 15159 (keeping 150 days of data) [2025-09-14T19:12:26.024481] [DEBUG] [LOCAL ] NCDL: Primary data saved (15159 records). [2025-09-14T19:12:26.024689] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-14T19:12:26.024799] [INFO ] [MAIN ] Update Progress: 1463/2370 symbols completed. NCDL took 28.0s. Estimated remaining: 1h 36m 15s. Rate: 9.4 symbols/min [2025-09-14T19:12:26.168311] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-14T19:12:26.205459] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:26.221227] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T19:12:26.271102] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-14T19:12:26.295221] [DEBUG] [LOCAL ] NE: Loaded 23390 existing records from primary storage. [2025-09-14T19:12:26.295464] [INFO ] [MAIN ] NE: Loaded 23390 existing records. [2025-09-14T19:12:26.486900] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:26.487290] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-14T19:12:26.487454] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-14T19:12:26.488143] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-14T19:12:26.488213] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-14T19:12:26.868487] [INFO ] [REMOTE ] NE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:26.958787] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-14T19:12:27.219459] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T19:12:27.758886] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-14T19:12:28.558887] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-14T19:12:28.617636] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T19:12:28.719945] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T19:12:29.358857] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-14T19:12:30.158888] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-14T19:12:30.256297] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T19:12:30.851689] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T19:12:30.961107] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-14T19:12:30.967586] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-14T19:12:31.758859] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-14T19:12:32.413631] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:12:32.419450] [INFO ] [REMOTE ] NCLH: Full fetch complete (58433 records). [2025-09-14T19:12:32.419600] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-14T19:12:32.564009] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-14T19:12:32.811738] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-14T19:12:32.811996] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-14T19:12:32.813297] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-14T19:12:32.813394] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-14T19:12:32.814957] [DEBUG] [LOCAL ] NCLH: Trimmed 58433 records to 40493 (keeping 150 days of data) [2025-09-14T19:12:32.951570] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T19:12:33.120824] [DEBUG] [LOCAL ] NCLH: Primary data saved (40493 records). [2025-09-14T19:12:33.121021] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-14T19:12:33.121174] [INFO ] [MAIN ] Update Progress: 1464/2370 symbols completed. NCLH took 33.7s. Estimated remaining: 1h 36m 9s. Rate: 9.4 symbols/min [2025-09-14T19:12:33.295783] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:33.314477] [DEBUG] [LOCAL ] NEA: Loaded 15590 existing records from primary storage. [2025-09-14T19:12:33.314725] [INFO ] [MAIN ] NEA: Loaded 15590 existing records. [2025-09-14T19:12:33.379688] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-14T19:12:33.499930] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:33.500229] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-14T19:12:33.500311] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-14T19:12:33.500962] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-14T19:12:33.501049] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-14T19:12:33.872978] [INFO ] [REMOTE ] NEA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:33.887460] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T19:12:34.158818] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-14T19:12:34.199892] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T19:12:34.958866] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-14T19:12:35.156204] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T19:12:35.680547] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T19:12:35.758912] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-14T19:12:36.558853] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-14T19:12:37.313946] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:12:37.358778] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-14T19:12:38.158898] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-14T19:12:38.453487] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T19:12:38.592353] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T19:12:38.828740] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T19:12:38.958877] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-14T19:12:39.471162] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T19:12:39.472892] [INFO ] [REMOTE ] NCZ: Full fetch complete (13348 records). [2025-09-14T19:12:39.473031] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-14T19:12:39.763979] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-14T19:12:39.849001] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-14T19:12:39.849108] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-14T19:12:39.849483] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-14T19:12:39.849538] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-14T19:12:39.850171] [DEBUG] [LOCAL ] NCZ: Trimmed 13348 records to 8192 (keeping 150 days of data) [2025-09-14T19:12:39.905141] [DEBUG] [LOCAL ] NCZ: Primary data saved (8192 records). [2025-09-14T19:12:39.905337] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-14T19:12:39.905542] [INFO ] [MAIN ] Update Progress: 1465/2370 symbols completed. NCZ took 21.5s. Estimated remaining: 1h 36m 2s. Rate: 9.4 symbols/min [2025-09-14T19:12:40.084002] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:40.110922] [DEBUG] [LOCAL ] NEE: Loaded 24067 existing records from primary storage. [2025-09-14T19:12:40.111131] [INFO ] [MAIN ] NEE: Loaded 24067 existing records. [2025-09-14T19:12:40.297520] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:40.297815] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-14T19:12:40.297877] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-14T19:12:40.298586] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-14T19:12:40.298677] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-14T19:12:40.564439] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-14T19:12:40.688046] [INFO ] [REMOTE ] NEE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:41.358973] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-14T19:12:41.620785] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T19:12:41.823942] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T19:12:42.158853] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-14T19:12:42.958905] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-14T19:12:43.410523] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-14T19:12:43.763952] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-14T19:12:43.776823] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T19:12:44.105267] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T19:12:44.558850] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-14T19:12:45.358803] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-14T19:12:45.514615] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T19:12:45.517185] [INFO ] [REMOTE ] NDMO: Full fetch complete (17467 records). [2025-09-14T19:12:45.517288] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-14T19:12:45.880329] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-14T19:12:45.880525] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-14T19:12:45.881008] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-14T19:12:45.881150] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-14T19:12:45.881955] [DEBUG] [LOCAL ] NDMO: Trimmed 17467 records to 12663 (keeping 150 days of data) [2025-09-14T19:12:45.975571] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-14T19:12:46.006361] [DEBUG] [LOCAL ] NDMO: Primary data saved (12663 records). [2025-09-14T19:12:46.006551] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-14T19:12:46.006715] [INFO ] [MAIN ] Update Progress: 1466/2370 symbols completed. NDMO took 22.5s. Estimated remaining: 1h 35m 56s. Rate: 9.4 symbols/min [2025-09-14T19:12:46.172057] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-14T19:12:46.174993] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:46.200795] [DEBUG] [LOCAL ] NEM: Loaded 24119 existing records from primary storage. [2025-09-14T19:12:46.200960] [INFO ] [MAIN ] NEM: Loaded 24119 existing records. [2025-09-14T19:12:46.388958] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:46.389319] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-14T19:12:46.389428] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-14T19:12:46.390264] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-14T19:12:46.390358] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-14T19:12:46.786621] [INFO ] [REMOTE ] NEM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:46.920046] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T19:12:46.958796] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-14T19:12:47.758834] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-14T19:12:48.412575] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-14T19:12:48.510500] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:12:48.558807] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-14T19:12:49.358892] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-14T19:12:49.718610] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T19:12:50.078242] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T19:12:50.158830] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-14T19:12:50.958903] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-14T19:12:51.294121] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T19:12:51.697977] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T19:12:51.758876] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-14T19:12:52.558853] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-14T19:12:53.287987] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T19:12:53.358877] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-14T19:12:53.671851] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T19:12:54.158832] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-14T19:12:54.736775] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T19:12:54.740930] [INFO ] [REMOTE ] NEA: Full fetch complete (38419 records). [2025-09-14T19:12:54.741031] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-14T19:12:54.960553] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-14T19:12:55.153834] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-14T19:12:55.164438] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-14T19:12:55.165359] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-14T19:12:55.165450] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-14T19:12:55.171333] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-14T19:12:55.182689] [DEBUG] [LOCAL ] NEA: Trimmed 38419 records to 26449 (keeping 150 days of data) [2025-09-14T19:12:55.361230] [DEBUG] [LOCAL ] NEA: Primary data saved (26449 records). [2025-09-14T19:12:55.361399] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-14T19:12:55.361512] [INFO ] [MAIN ] Update Progress: 1467/2370 symbols completed. NEA took 22.2s. Estimated remaining: 1h 35m 51s. Rate: 9.4 symbols/min [2025-09-14T19:12:55.530126] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:55.553576] [DEBUG] [LOCAL ] NET: Loaded 23663 existing records from primary storage. [2025-09-14T19:12:55.553757] [INFO ] [MAIN ] NET: Loaded 23663 existing records. [2025-09-14T19:12:55.726624] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:55.726969] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-14T19:12:55.727028] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-14T19:12:55.727861] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-14T19:12:55.727923] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-14T19:12:55.770445] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-14T19:12:56.088914] [INFO ] [REMOTE ] NET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:56.500825] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T19:12:56.550425] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-14T19:12:56.556962] [INFO ] [REMOTE ] NE: Full fetch complete (56953 records). [2025-09-14T19:12:56.557095] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-14T19:12:56.569053] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-14T19:12:56.936737] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-14T19:12:56.936851] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-14T19:12:56.937762] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-14T19:12:56.937844] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-14T19:12:56.939087] [DEBUG] [LOCAL ] NE: Trimmed 56953 records to 39328 (keeping 150 days of data) [2025-09-14T19:12:57.209062] [DEBUG] [LOCAL ] NE: Primary data saved (39328 records). [2025-09-14T19:12:57.209243] [INFO ] [MAIN ] NE: Full history saved. [2025-09-14T19:12:57.209359] [INFO ] [MAIN ] Update Progress: 1468/2370 symbols completed. NE took 31.2s. Estimated remaining: 1h 35m 42s. Rate: 9.4 symbols/min [2025-09-14T19:12:57.365794] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-14T19:12:57.383957] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:12:57.392220] [DEBUG] [LOCAL ] NEU: Loaded 4675 existing records from primary storage. [2025-09-14T19:12:57.392363] [INFO ] [MAIN ] NEU: Loaded 4675 existing records. [2025-09-14T19:12:57.611524] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:12:57.611802] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-14T19:12:57.611864] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-14T19:12:57.612250] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-14T19:12:57.612310] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-14T19:12:57.964154] [INFO ] [REMOTE ] NEU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:12:58.127586] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-14T19:12:58.158875] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-14T19:12:58.280217] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T19:12:58.761523] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-14T19:12:58.900551] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T19:12:58.958777] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-14T19:12:59.661552] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T19:12:59.758838] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-14T19:13:00.558831] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-14T19:13:00.584340] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T19:13:01.358838] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-14T19:13:02.158858] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-14T19:13:02.965078] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-14T19:13:03.002093] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-14T19:13:03.002756] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T19:13:03.339405] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-14T19:13:03.758837] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-14T19:13:03.888264] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T19:13:04.558807] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-14T19:13:04.776032] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T19:13:05.358836] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-14T19:13:06.158802] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-14T19:13:06.320610] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T19:13:06.910077] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T19:13:06.958808] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-14T19:13:07.758830] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-14T19:13:07.860255] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T19:13:08.143997] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T19:13:08.558924] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-14T19:13:09.358876] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-14T19:13:09.511813] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T19:13:10.158862] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-14T19:13:10.257738] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-14T19:13:10.958882] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-14T19:13:11.103737] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T19:13:11.487058] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-14T19:13:11.564179] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T19:13:11.758868] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-14T19:13:12.558875] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-14T19:13:12.745428] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T19:13:13.114757] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T19:13:13.358902] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-14T19:13:14.126930] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:13:14.132410] [INFO ] [REMOTE ] NEE: Full fetch complete (58387 records). [2025-09-14T19:13:14.132552] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-14T19:13:14.164091] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-14T19:13:14.542190] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-14T19:13:14.542357] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-14T19:13:14.544047] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-14T19:13:14.544150] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-14T19:13:14.546240] [DEBUG] [LOCAL ] NEE: Trimmed 58387 records to 40447 (keeping 150 days of data) [2025-09-14T19:13:14.842955] [DEBUG] [LOCAL ] NEE: Primary data saved (40447 records). [2025-09-14T19:13:14.843134] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-14T19:13:14.843236] [INFO ] [MAIN ] Update Progress: 1469/2370 symbols completed. NEE took 34.9s. Estimated remaining: 1h 35m 43s. Rate: 9.4 symbols/min [2025-09-14T19:13:14.966372] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-14T19:13:15.021450] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:13:15.024535] [DEBUG] [LOCAL ] NEUE: Loaded 791 existing records from primary storage. [2025-09-14T19:13:15.038670] [INFO ] [MAIN ] NEUE: Loaded 791 existing records. [2025-09-14T19:13:15.040002] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T19:13:15.124966] [INFO ] [REMOTE ] NEM: Full fetch complete (58388 records). [2025-09-14T19:13:15.146167] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-14T19:13:15.328456] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:13:15.387758] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-14T19:13:15.409567] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-14T19:13:15.489686] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-14T19:13:15.524284] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-14T19:13:15.766515] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-14T19:13:15.779470] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-14T19:13:15.789377] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-14T19:13:15.840736] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-14T19:13:15.904692] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-14T19:13:16.001802] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:13:16.002776] [DEBUG] [LOCAL ] NEM: Trimmed 58388 records to 40448 (keeping 150 days of data) [2025-09-14T19:13:16.019420] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T19:13:16.079758] [INFO ] [REMOTE ] NET: Full fetch complete (57771 records). [2025-09-14T19:13:16.079964] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-14T19:13:16.462370] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:13:16.521764] [INFO ] [REMOTE ] NEU: Full fetch complete (8606 records). [2025-09-14T19:13:16.540382] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-14T19:13:16.564962] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-14T19:13:16.565129] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-14T19:13:16.593635] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-14T19:13:16.621759] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-14T19:13:16.627991] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-14T19:13:16.683970] [DEBUG] [LOCAL ] NET: Trimmed 57771 records to 39881 (keeping 150 days of data) [2025-09-14T19:13:17.074199] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-14T19:13:17.077407] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-14T19:13:17.078187] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-14T19:13:17.078794] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-14T19:13:17.082819] [DEBUG] [LOCAL ] NEU: Trimmed 8606 records to 6817 (keeping 150 days of data) [2025-09-14T19:13:17.207554] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-14T19:13:17.360343] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-14T19:13:17.362017] [DEBUG] [LOCAL ] NEU: Primary data saved (6817 records). [2025-09-14T19:13:17.365228] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-14T19:13:17.366392] [INFO ] [MAIN ] Update Progress: 1470/2370 symbols completed. NEU took 20.2s. Estimated remaining: 1h 35m 34s. Rate: 9.4 symbols/min [2025-09-14T19:13:17.582618] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:13:17.594697] [DEBUG] [LOCAL ] NEXA: Loaded 1842 existing records from primary storage. [2025-09-14T19:13:17.596351] [INFO ] [MAIN ] NEXA: Loaded 1842 existing records. [2025-09-14T19:13:17.788574] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:13:17.790939] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-14T19:13:17.791546] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-14T19:13:17.793156] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-14T19:13:17.793769] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-14T19:13:17.908825] [DEBUG] [LOCAL ] NEM: Primary data saved (40448 records). [2025-09-14T19:13:17.914882] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-14T19:13:17.922900] [DEBUG] [LOCAL ] NET: Primary data saved (39881 records). [2025-09-14T19:13:17.933454] [INFO ] [MAIN ] Update Progress: 1471/2370 symbols completed. NEM took 31.9s. Estimated remaining: 1h 35m 24s. Rate: 9.4 symbols/min [2025-09-14T19:13:17.938754] [INFO ] [MAIN ] NET: Full history saved. [2025-09-14T19:13:17.991764] [INFO ] [MAIN ] Update Progress: 1472/2370 symbols completed. NET took 22.6s. Estimated remaining: 1h 35m 14s. Rate: 9.4 symbols/min [2025-09-14T19:13:18.388340] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T19:13:18.508290] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:13:18.522858] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-14T19:13:18.562391] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:13:18.583971] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:13:18.606553] [DEBUG] [LOCAL ] NFJ: Loaded 8977 existing records from primary storage. [2025-09-14T19:13:18.608249] [INFO ] [MAIN ] NFJ: Loaded 8977 existing records. [2025-09-14T19:13:18.608580] [DEBUG] [LOCAL ] NFG: Loaded 17409 existing records from primary storage. [2025-09-14T19:13:18.674159] [INFO ] [MAIN ] NFG: Loaded 17409 existing records. [2025-09-14T19:13:18.981168] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:13:18.986039] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:13:18.959515] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-14T19:13:18.986397] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-14T19:13:18.986751] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-14T19:13:18.988055] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-14T19:13:18.988286] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-14T19:13:18.988665] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-14T19:13:18.988773] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-14T19:13:18.994106] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-14T19:13:19.045399] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-14T19:13:19.187229] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T19:13:19.672040] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:13:19.732673] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T19:13:19.752818] [INFO ] [REMOTE ] NFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:13:19.758769] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-14T19:13:20.558848] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-14T19:13:21.080491] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T19:13:21.334712] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T19:13:21.358783] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-14T19:13:22.158842] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-14T19:13:22.711476] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-14T19:13:22.912095] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T19:13:22.958870] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-14T19:13:23.606152] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T19:13:23.758883] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-14T19:13:24.401473] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T19:13:24.558882] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-14T19:13:25.358846] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-14T19:13:26.059845] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T19:13:26.158858] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-14T19:13:26.290971] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:13:26.958823] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-14T19:13:27.254134] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T19:13:27.758833] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-14T19:13:28.272050] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T19:13:28.568539] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-14T19:13:28.572992] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T19:13:29.358816] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-14T19:13:29.680749] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T19:13:30.158855] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-14T19:13:30.714990] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:13:30.716485] [INFO ] [REMOTE ] NEXA: Full fetch complete (4211 records). [2025-09-14T19:13:30.716603] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-14T19:13:30.895194] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T19:13:30.964706] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-14T19:13:31.119541] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-14T19:13:31.119685] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-14T19:13:31.119903] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-14T19:13:31.119981] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-14T19:13:31.120432] [DEBUG] [LOCAL ] NEXA: Trimmed 4211 records to 2867 (keeping 150 days of data) [2025-09-14T19:13:31.137734] [DEBUG] [LOCAL ] NEXA: Primary data saved (2867 records). [2025-09-14T19:13:31.137926] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-14T19:13:31.138061] [INFO ] [MAIN ] Update Progress: 1473/2370 symbols completed. NEXA took 13.8s. Estimated remaining: 1h 35m 12s. Rate: 9.4 symbols/min [2025-09-14T19:13:31.321566] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:13:31.344934] [DEBUG] [LOCAL ] NGG: Loaded 20471 existing records from primary storage. [2025-09-14T19:13:31.345149] [INFO ] [MAIN ] NGG: Loaded 20471 existing records. [2025-09-14T19:13:31.528289] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:13:31.530877] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T19:13:31.531068] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-14T19:13:31.532192] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-14T19:13:31.533236] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-14T19:13:31.533310] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-14T19:13:31.765302] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-14T19:13:31.898083] [INFO ] [REMOTE ] NGG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:13:32.558838] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-14T19:13:33.045986] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T19:13:33.358879] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-14T19:13:33.868859] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T19:13:34.141894] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T19:13:34.158765] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-14T19:13:34.958845] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-14T19:13:35.349888] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-14T19:13:35.758788] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-14T19:13:35.859267] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:13:36.558850] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-14T19:13:37.358866] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-14T19:13:37.602220] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T19:13:37.737306] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T19:13:37.879539] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T19:13:38.158894] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-14T19:13:38.958781] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-14T19:13:39.347717] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T19:13:39.758829] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-14T19:13:40.432227] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T19:13:40.558802] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-14T19:13:40.918884] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T19:13:40.995090] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T19:13:40.999122] [INFO ] [REMOTE ] NFG: Full fetch complete (42609 records). [2025-09-14T19:13:40.999230] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-14T19:13:41.363957] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-14T19:13:41.379232] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-14T19:13:41.379311] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-14T19:13:41.380136] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-14T19:13:41.380509] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-14T19:13:41.382590] [DEBUG] [LOCAL ] NFG: Trimmed 42609 records to 28591 (keeping 150 days of data) [2025-09-14T19:13:41.562238] [DEBUG] [LOCAL ] NFG: Primary data saved (28591 records). [2025-09-14T19:13:41.562441] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-14T19:13:41.562602] [INFO ] [MAIN ] Update Progress: 1474/2370 symbols completed. NFG took 23.6s. Estimated remaining: 1h 35m 8s. Rate: 9.4 symbols/min [2025-09-14T19:13:41.733597] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:13:41.749697] [DEBUG] [LOCAL ] NGL: Loaded 15474 existing records from primary storage. [2025-09-14T19:13:41.749901] [INFO ] [MAIN ] NGL: Loaded 15474 existing records. [2025-09-14T19:13:41.939293] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:13:41.939531] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-14T19:13:41.939590] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-14T19:13:41.940055] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-14T19:13:41.940143] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-14T19:13:42.164001] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-14T19:13:42.298147] [INFO ] [REMOTE ] NGL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:13:42.958831] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-14T19:13:43.294053] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T19:13:43.330245] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T19:13:43.387079] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:13:43.388063] [INFO ] [REMOTE ] NEUE: Full fetch complete (2413 records). [2025-09-14T19:13:43.388153] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-14T19:13:43.764456] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-14T19:13:43.769121] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-14T19:13:43.770824] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-14T19:13:43.771066] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-14T19:13:43.771141] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-14T19:13:43.771621] [DEBUG] [LOCAL ] NEUE: Trimmed 2413 records to 1229 (keeping 150 days of data) [2025-09-14T19:13:43.780393] [DEBUG] [LOCAL ] NEUE: Primary data saved (1229 records). [2025-09-14T19:13:43.780521] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-14T19:13:43.780667] [INFO ] [MAIN ] Update Progress: 1475/2370 symbols completed. NEUE took 28.9s. Estimated remaining: 1h 34m 59s. Rate: 9.4 symbols/min [2025-09-14T19:13:43.955436] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:13:43.962199] [DEBUG] [LOCAL ] NGS: Loaded 4686 existing records from primary storage. [2025-09-14T19:13:43.962342] [INFO ] [MAIN ] NGS: Loaded 4686 existing records. [2025-09-14T19:13:44.138034] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:13:44.138308] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-14T19:13:44.138394] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-14T19:13:44.138815] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-14T19:13:44.138880] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-14T19:13:44.522491] [INFO ] [REMOTE ] NGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:13:44.558790] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-14T19:13:44.787547] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T19:13:44.789823] [INFO ] [REMOTE ] NFJ: Full fetch complete (21894 records). [2025-09-14T19:13:44.789915] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-14T19:13:45.154013] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-14T19:13:45.154124] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-14T19:13:45.154678] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-14T19:13:45.154737] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-14T19:13:45.155369] [DEBUG] [LOCAL ] NFJ: Trimmed 21894 records to 14566 (keeping 150 days of data) [2025-09-14T19:13:45.244912] [DEBUG] [LOCAL ] NFJ: Primary data saved (14566 records). [2025-09-14T19:13:45.245094] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-14T19:13:45.245217] [INFO ] [MAIN ] Update Progress: 1476/2370 symbols completed. NFJ took 27.2s. Estimated remaining: 1h 34m 50s. Rate: 9.4 symbols/min [2025-09-14T19:13:45.363975] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-14T19:13:45.417124] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:13:45.425584] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T19:13:45.437160] [DEBUG] [LOCAL ] NGVC: Loaded 10860 existing records from primary storage. [2025-09-14T19:13:45.437317] [INFO ] [MAIN ] NGVC: Loaded 10860 existing records. [2025-09-14T19:13:45.614387] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:13:45.614704] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-14T19:13:45.614793] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-14T19:13:45.615293] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-14T19:13:45.615370] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-14T19:13:46.002071] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:13:46.158856] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-14T19:13:46.806875] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T19:13:46.958872] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-14T19:13:47.305074] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T19:13:47.758864] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-14T19:13:48.558843] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-14T19:13:48.880993] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T19:13:48.937003] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T19:13:49.358943] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-14T19:13:49.405024] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T19:13:50.059745] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T19:13:50.158824] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-14T19:13:50.958855] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-14T19:13:51.270556] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T19:13:51.758879] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-14T19:13:52.558816] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-14T19:13:52.652237] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T19:13:53.011548] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T19:13:53.358871] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-14T19:13:53.586092] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T19:13:54.158850] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-14T19:13:54.958862] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-14T19:13:55.104223] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T19:13:55.197335] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T19:13:55.758915] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-14T19:13:55.849159] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T19:13:56.558900] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-14T19:13:56.967842] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T19:13:57.358865] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-14T19:13:57.470176] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T19:13:58.158874] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-14T19:13:58.958843] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-14T19:13:59.097355] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T19:13:59.676359] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T19:13:59.758820] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-14T19:13:59.969425] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T19:14:00.558861] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-14T19:14:01.191407] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T19:14:01.358840] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-14T19:14:01.971597] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T19:14:02.158841] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-14T19:14:02.628809] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T19:14:02.958829] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-14T19:14:03.479310] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T19:14:03.484003] [INFO ] [REMOTE ] NGG: Full fetch complete (50080 records). [2025-09-14T19:14:03.484123] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-14T19:14:03.763919] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-14T19:14:03.884169] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-14T19:14:03.884293] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-14T19:14:03.885328] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-14T19:14:03.885392] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-14T19:14:03.886698] [DEBUG] [LOCAL ] NGG: Trimmed 50080 records to 35319 (keeping 150 days of data) [2025-09-14T19:14:04.116326] [DEBUG] [LOCAL ] NGG: Primary data saved (35319 records). [2025-09-14T19:14:04.116515] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-14T19:14:04.116657] [INFO ] [MAIN ] Update Progress: 1477/2370 symbols completed. NGG took 33.0s. Estimated remaining: 1h 34m 51s. Rate: 9.4 symbols/min [2025-09-14T19:14:04.448960] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T19:14:04.558851] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-14T19:14:05.217752] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T19:14:05.358843] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-14T19:14:05.613454] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T19:14:05.616208] [INFO ] [REMOTE ] NGVC: Full fetch complete (24310 records). [2025-09-14T19:14:05.616311] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-14T19:14:05.977184] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-14T19:14:05.977309] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-14T19:14:05.977903] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-14T19:14:05.977983] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-14T19:14:05.978893] [DEBUG] [LOCAL ] NGVC: Trimmed 24310 records to 17464 (keeping 150 days of data) [2025-09-14T19:14:06.096560] [DEBUG] [LOCAL ] NGVC: Primary data saved (17464 records). [2025-09-14T19:14:06.096808] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-14T19:14:06.096958] [INFO ] [MAIN ] Update Progress: 1478/2370 symbols completed. NGVC took 20.9s. Estimated remaining: 1h 34m 42s. Rate: 9.4 symbols/min [2025-09-14T19:14:06.158912] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-14T19:14:06.689468] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T19:14:06.693632] [INFO ] [REMOTE ] NGL: Full fetch complete (32512 records). [2025-09-14T19:14:06.693802] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-14T19:14:07.092015] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-14T19:14:07.092133] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-14T19:14:07.092836] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-14T19:14:07.092892] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-14T19:14:07.093782] [DEBUG] [LOCAL ] NGL: Trimmed 32512 records to 23004 (keeping 150 days of data) [2025-09-14T19:14:07.184841] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T19:14:07.189204] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-14T19:14:07.243679] [DEBUG] [LOCAL ] NGL: Primary data saved (23004 records). [2025-09-14T19:14:07.243868] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-14T19:14:07.243988] [INFO ] [MAIN ] Update Progress: 1479/2370 symbols completed. NGL took 25.7s. Estimated remaining: 1h 34m 32s. Rate: 9.4 symbols/min [2025-09-14T19:14:07.986774] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T19:14:07.988350] [INFO ] [REMOTE ] NGS: Full fetch complete (12638 records). [2025-09-14T19:14:07.988439] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-14T19:14:08.393079] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-14T19:14:08.393194] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-14T19:14:08.393514] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-14T19:14:08.393569] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-14T19:14:08.394094] [DEBUG] [LOCAL ] NGS: Trimmed 12638 records to 8254 (keeping 150 days of data) [2025-09-14T19:14:08.445685] [DEBUG] [LOCAL ] NGS: Primary data saved (8254 records). [2025-09-14T19:14:08.445837] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-14T19:14:08.445937] [INFO ] [MAIN ] Update Progress: 1480/2370 symbols completed. NGS took 24.7s. Estimated remaining: 1h 34m 23s. Rate: 9.4 symbols/min [2025-09-14T19:14:09.029490] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:09.115743] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:09.160819] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:09.165379] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:09.179325] [DEBUG] [LOCAL ] NIC: Loaded 4207 existing records from primary storage. [2025-09-14T19:14:09.179670] [DEBUG] [LOCAL ] NGVT: Loaded 10476 existing records from primary storage. [2025-09-14T19:14:09.181722] [INFO ] [MAIN ] NIC: Loaded 4207 existing records. [2025-09-14T19:14:09.181820] [INFO ] [MAIN ] NGVT: Loaded 10476 existing records. [2025-09-14T19:14:09.307272] [DEBUG] [LOCAL ] NHI: Loaded 9873 existing records from primary storage. [2025-09-14T19:14:09.350236] [INFO ] [MAIN ] NHI: Loaded 9873 existing records. [2025-09-14T19:14:09.518184] [DEBUG] [LOCAL ] NI: Loaded 23879 existing records from primary storage. [2025-09-14T19:14:09.601676] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:09.612048] [INFO ] [MAIN ] NI: Loaded 23879 existing records. [2025-09-14T19:14:09.689581] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:09.690288] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-14T19:14:09.659735] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-14T19:14:09.724026] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-14T19:14:09.739661] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-14T19:14:09.791744] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-14T19:14:09.826416] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:09.826527] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-14T19:14:09.863041] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-14T19:14:09.868796] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-14T19:14:09.906147] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-14T19:14:09.961013] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-14T19:14:10.008171] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-14T19:14:10.111665] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-14T19:14:10.269094] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:10.404714] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-14T19:14:10.461434] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-14T19:14:10.587813] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-09-14T19:14:10.665319] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-14T19:14:10.894807] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:10.995868] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-14T19:14:11.080966] [INFO ] [REMOTE ] NIC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:11.151086] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-14T19:14:11.342801] [INFO ] [REMOTE ] NHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:11.362256] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-14T19:14:11.443369] [INFO ] [REMOTE ] NI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:11.443755] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-14T19:14:12.167359] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:14:12.169488] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-14T19:14:12.356381] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T19:14:12.360750] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-14T19:14:12.465054] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T19:14:12.558900] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-14T19:14:12.737156] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T19:14:13.262293] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T19:14:13.358814] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-14T19:14:13.419880] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T19:14:13.586965] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T19:14:14.158864] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-14T19:14:14.958830] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-14T19:14:15.347933] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T19:14:15.758848] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-14T19:14:15.806277] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T19:14:15.868516] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T19:14:16.558867] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-14T19:14:17.358950] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-14T19:14:17.692425] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T19:14:17.893738] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T19:14:18.158860] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-14T19:14:18.770066] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T19:14:18.958838] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-14T19:14:19.758907] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-14T19:14:19.830537] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:14:20.094504] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T19:14:20.558842] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-14T19:14:20.772711] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T19:14:21.358857] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-14T19:14:21.428728] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T19:14:22.158898] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-14T19:14:22.660688] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T19:14:22.958794] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-14T19:14:23.349951] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T19:14:23.758838] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-14T19:14:23.983439] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T19:14:24.558894] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-14T19:14:25.162684] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T19:14:25.358885] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-14T19:14:26.158948] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-14T19:14:26.173217] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T19:14:26.394760] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T19:14:26.958808] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-14T19:14:27.299262] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T19:14:27.561525] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T19:14:27.562858] [INFO ] [REMOTE ] NIC: Full fetch complete (9652 records). [2025-09-14T19:14:27.562955] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-14T19:14:27.767166] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-14T19:14:27.929039] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-14T19:14:27.929145] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-14T19:14:27.929416] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-14T19:14:27.929479] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-14T19:14:27.930034] [DEBUG] [LOCAL ] NIC: Trimmed 9652 records to 6573 (keeping 150 days of data) [2025-09-14T19:14:27.975880] [DEBUG] [LOCAL ] NIC: Primary data saved (6573 records). [2025-09-14T19:14:27.976075] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-14T19:14:27.976181] [INFO ] [MAIN ] Update Progress: 1481/2370 symbols completed. NIC took 19.5s. Estimated remaining: 1h 34m 24s. Rate: 9.4 symbols/min [2025-09-14T19:14:28.143732] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:28.151384] [DEBUG] [LOCAL ] NIE: Loaded 5257 existing records from primary storage. [2025-09-14T19:14:28.151538] [INFO ] [MAIN ] NIE: Loaded 5257 existing records. [2025-09-14T19:14:28.334811] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:28.335119] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-14T19:14:28.335184] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-14T19:14:28.335593] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-14T19:14:28.335695] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-14T19:14:28.564092] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-14T19:14:28.704479] [INFO ] [REMOTE ] NIE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:29.358889] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-14T19:14:29.596859] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T19:14:29.600256] [INFO ] [REMOTE ] NHI: Full fetch complete (24038 records). [2025-09-14T19:14:29.600371] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-14T19:14:29.926173] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T19:14:30.002934] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-14T19:14:30.003199] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-14T19:14:30.004055] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-14T19:14:30.004310] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-14T19:14:30.005165] [DEBUG] [LOCAL ] NHI: Trimmed 24038 records to 16738 (keeping 150 days of data) [2025-09-14T19:14:30.132734] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-14T19:14:30.158930] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-14T19:14:30.176362] [DEBUG] [LOCAL ] NHI: Primary data saved (16738 records). [2025-09-14T19:14:30.176575] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-14T19:14:30.176803] [INFO ] [MAIN ] Update Progress: 1482/2370 symbols completed. NHI took 21.7s. Estimated remaining: 1h 34m 15s. Rate: 9.4 symbols/min [2025-09-14T19:14:30.350211] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:30.353884] [DEBUG] [LOCAL ] NIM: Loaded 1423 existing records from primary storage. [2025-09-14T19:14:30.354002] [INFO ] [MAIN ] NIM: Loaded 1423 existing records. [2025-09-14T19:14:30.535987] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:30.536337] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-14T19:14:30.536421] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-14T19:14:30.536786] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-14T19:14:30.536851] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-14T19:14:30.927195] [INFO ] [REMOTE ] NIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:30.958827] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-14T19:14:31.758920] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-14T19:14:32.096767] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T19:14:32.125961] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T19:14:32.237696] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T19:14:32.558877] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-14T19:14:33.358902] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-14T19:14:33.921444] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T19:14:34.158897] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-14T19:14:34.170104] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:14:34.958884] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-14T19:14:35.156445] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T19:14:35.518957] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:14:35.522054] [INFO ] [REMOTE ] NGVT: Full fetch complete (26882 records). [2025-09-14T19:14:35.522183] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-14T19:14:35.767450] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-14T19:14:35.904991] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-14T19:14:35.905105] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-14T19:14:35.906263] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-14T19:14:35.906686] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-14T19:14:35.908296] [DEBUG] [LOCAL ] NGVT: Trimmed 26882 records to 18193 (keeping 150 days of data) [2025-09-14T19:14:36.037853] [DEBUG] [LOCAL ] NGVT: Primary data saved (18193 records). [2025-09-14T19:14:36.038109] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-14T19:14:36.038378] [INFO ] [MAIN ] Update Progress: 1483/2370 symbols completed. NGVT took 27.6s. Estimated remaining: 1h 34m 9s. Rate: 9.4 symbols/min [2025-09-14T19:14:36.239214] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:36.255551] [DEBUG] [LOCAL ] NINE: Loaded 13111 existing records from primary storage. [2025-09-14T19:14:36.255832] [INFO ] [MAIN ] NINE: Loaded 13111 existing records. [2025-09-14T19:14:36.438011] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:36.438307] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-14T19:14:36.438370] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-14T19:14:36.438961] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-14T19:14:36.439024] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-14T19:14:36.564021] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-14T19:14:36.807428] [INFO ] [REMOTE ] NINE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:36.817909] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T19:14:37.358848] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-14T19:14:37.447572] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T19:14:38.158845] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-14T19:14:38.276753] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T19:14:38.958843] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-14T19:14:39.525552] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T19:14:39.626764] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:14:39.758875] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-14T19:14:40.452574] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:14:40.459249] [INFO ] [REMOTE ] NI: Full fetch complete (58089 records). [2025-09-14T19:14:40.459481] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-14T19:14:40.564042] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-14T19:14:40.926991] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-09-14T19:14:40.927160] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-09-14T19:14:40.928992] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-09-14T19:14:40.929077] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-09-14T19:14:40.931194] [DEBUG] [LOCAL ] NI: Trimmed 58089 records to 40187 (keeping 150 days of data) [2025-09-14T19:14:41.222068] [DEBUG] [LOCAL ] NI: Primary data saved (40187 records). [2025-09-14T19:14:41.222276] [INFO ] [MAIN ] NI: Full history saved. [2025-09-14T19:14:41.222560] [INFO ] [MAIN ] Update Progress: 1484/2370 symbols completed. NI took 32.8s. Estimated remaining: 1h 34m 2s. Rate: 9.4 symbols/min [2025-09-14T19:14:41.372805] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-14T19:14:41.408418] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:41.434999] [DEBUG] [LOCAL ] NIO: Loaded 24162 existing records from primary storage. [2025-09-14T19:14:41.435239] [INFO ] [MAIN ] NIO: Loaded 24162 existing records. [2025-09-14T19:14:41.620719] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T19:14:41.641217] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:41.644364] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-14T19:14:41.644433] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-14T19:14:41.645328] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-14T19:14:41.645394] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-14T19:14:42.003694] [INFO ] [REMOTE ] NIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:42.158860] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-14T19:14:42.169065] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T19:14:42.958845] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-14T19:14:43.758831] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-14T19:14:44.361565] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T19:14:44.558887] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-14T19:14:44.676936] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-14T19:14:44.787993] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T19:14:45.212808] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T19:14:45.358889] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-14T19:14:45.938812] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T19:14:46.158859] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-14T19:14:46.958852] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-14T19:14:47.087073] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T19:14:47.366993] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T19:14:47.368262] [INFO ] [REMOTE ] NIM: Full fetch complete (4700 records). [2025-09-14T19:14:47.368378] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-14T19:14:47.756721] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-14T19:14:47.756856] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-14T19:14:47.757066] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-14T19:14:47.757120] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-14T19:14:47.757585] [DEBUG] [LOCAL ] NIM: Trimmed 4700 records to 2843 (keeping 150 days of data) [2025-09-14T19:14:47.765690] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-14T19:14:47.784270] [DEBUG] [LOCAL ] NIM: Primary data saved (2843 records). [2025-09-14T19:14:47.784524] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-14T19:14:47.784712] [INFO ] [MAIN ] Update Progress: 1485/2370 symbols completed. NIM took 17.6s. Estimated remaining: 1h 33m 55s. Rate: 9.4 symbols/min [2025-09-14T19:14:48.042542] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:48.063836] [DEBUG] [LOCAL ] NIQ: Loaded 12713 existing records from primary storage. [2025-09-14T19:14:48.064061] [INFO ] [MAIN ] NIQ: Loaded 12713 existing records. [2025-09-14T19:14:48.304943] [WARN ] [MAIN ] NIQ: Insufficient historical data. Have data from 2025-07-23, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:48.305327] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-14T19:14:48.305400] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-14T19:14:48.305987] [DEBUG] [LOCAL ] NIQ: Deleted primary data file. [2025-09-14T19:14:48.306066] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-14T19:14:48.569172] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-14T19:14:48.852018] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:49.217109] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T19:14:49.358844] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-14T19:14:49.608989] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:14:49.609387] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-14T19:14:50.158894] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-14T19:14:50.931549] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:14:50.933396] [INFO ] [REMOTE ] NIE: Full fetch complete (12432 records). [2025-09-14T19:14:50.933480] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-14T19:14:50.964666] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-14T19:14:51.296041] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:14:51.308486] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-14T19:14:51.309118] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-14T19:14:51.309170] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-14T19:14:51.310459] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-14T19:14:51.310660] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-14T19:14:51.311793] [DEBUG] [LOCAL ] NIE: Trimmed 12432 records to 8228 (keeping 150 days of data) [2025-09-14T19:14:51.402889] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-14T19:14:51.421290] [DEBUG] [LOCAL ] NIE: Primary data saved (8228 records). [2025-09-14T19:14:51.422265] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-14T19:14:51.422436] [INFO ] [MAIN ] Update Progress: 1486/2370 symbols completed. NIE took 23.4s. Estimated remaining: 1h 33m 47s. Rate: 9.4 symbols/min [2025-09-14T19:14:51.598022] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:14:51.618462] [DEBUG] [LOCAL ] NJR: Loaded 17006 existing records from primary storage. [2025-09-14T19:14:51.618624] [INFO ] [MAIN ] NJR: Loaded 17006 existing records. [2025-09-14T19:14:51.763994] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-14T19:14:51.809159] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:14:51.809475] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-14T19:14:51.809544] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-14T19:14:51.810199] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-14T19:14:51.810272] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-14T19:14:52.163583] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:14:52.185900] [INFO ] [REMOTE ] NJR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:14:52.186486] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-14T19:14:52.558843] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-14T19:14:52.859409] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:14:52.859797] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-14T19:14:53.358859] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-14T19:14:54.158850] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-14T19:14:54.798435] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T19:14:54.958818] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-14T19:14:55.235227] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:14:55.235752] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-14T19:14:55.758828] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-14T19:14:56.295892] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-14T19:14:56.378158] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T19:14:56.558831] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-14T19:14:57.358847] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-14T19:14:58.158884] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-14T19:14:58.387504] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T19:14:58.958885] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-14T19:14:59.627205] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T19:14:59.758846] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-14T19:14:59.977592] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-14T19:15:00.469619] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T19:15:00.474079] [INFO ] [REMOTE ] NIQ: Full fetch complete (12713 records). [2025-09-14T19:15:00.474193] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-14T19:15:00.565303] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-14T19:15:00.660093] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 37 unique days, need 150 days [2025-09-14T19:15:00.660378] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:15:00.660430] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:15:00.660478] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-14T19:15:00.660564] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-14T19:15:00.660691] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-14T19:15:00.660779] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-14T19:15:00.660872] [INFO ] [MAIN ] Update Progress: 1487/2370 symbols completed. NIQ took 12.9s. Estimated remaining: 1h 33m 43s. Rate: 9.4 symbols/min [2025-09-14T19:15:00.832582] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:00.856143] [DEBUG] [LOCAL ] NKE: Loaded 23837 existing records from primary storage. [2025-09-14T19:15:00.856331] [INFO ] [MAIN ] NKE: Loaded 23837 existing records. [2025-09-14T19:15:01.033008] [WARN ] [MAIN ] NKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:01.033304] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-14T19:15:01.033367] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-14T19:15:01.034052] [DEBUG] [LOCAL ] NKE: Deleted primary data file. [2025-09-14T19:15:01.034591] [DEBUG] [LOCAL ] NKE: Removed from QA tracker. [2025-09-14T19:15:01.034673] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-14T19:15:01.369408] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-14T19:15:01.413423] [INFO ] [REMOTE ] NKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:01.927787] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-14T19:15:02.158849] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-14T19:15:02.603312] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T19:15:02.958819] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-14T19:15:03.758857] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-14T19:15:05.305755] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (3.15 seconds). [2025-09-14T19:15:05.316439] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-14T19:15:05.709351] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T19:15:05.716348] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-14T19:15:05.915974] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-14T19:15:06.123603] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:15:06.158798] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-14T19:15:06.823377] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T19:15:06.901213] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (5.53 seconds). [2025-09-14T19:15:06.958785] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-14T19:15:07.758861] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-14T19:15:07.839338] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-14T19:15:08.558900] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-14T19:15:09.358853] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-14T19:15:09.445024] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T19:15:09.489602] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T19:15:09.982293] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-14T19:15:10.113962] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:15:10.116570] [INFO ] [REMOTE ] NINE: Full fetch complete (31763 records). [2025-09-14T19:15:10.116695] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-14T19:15:10.163941] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-14T19:15:10.502402] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-14T19:15:10.502579] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-14T19:15:10.503518] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-14T19:15:10.503579] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-14T19:15:10.504923] [DEBUG] [LOCAL ] NINE: Trimmed 31763 records to 22068 (keeping 150 days of data) [2025-09-14T19:15:10.643305] [DEBUG] [LOCAL ] NINE: Primary data saved (22068 records). [2025-09-14T19:15:10.643514] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-14T19:15:10.643633] [INFO ] [MAIN ] Update Progress: 1488/2370 symbols completed. NINE took 34.6s. Estimated remaining: 1h 33m 39s. Rate: 9.4 symbols/min [2025-09-14T19:15:10.825724] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:10.835426] [DEBUG] [LOCAL ] NKX: Loaded 6419 existing records from primary storage. [2025-09-14T19:15:10.835614] [INFO ] [MAIN ] NKX: Loaded 6419 existing records. [2025-09-14T19:15:10.964063] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-14T19:15:11.026438] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:11.026779] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-14T19:15:11.026850] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-14T19:15:11.027288] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-14T19:15:11.027371] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-14T19:15:11.398677] [INFO ] [REMOTE ] NKX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:11.428793] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T19:15:11.758852] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-14T19:15:12.558861] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-14T19:15:12.694583] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T19:15:13.358815] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-14T19:15:13.580131] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T19:15:13.865889] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-14T19:15:14.158852] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-14T19:15:14.631563] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T19:15:14.958851] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-14T19:15:15.174852] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T19:15:15.758864] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-14T19:15:16.558902] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-14T19:15:17.358916] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-14T19:15:17.641920] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-14T19:15:17.647554] [INFO ] [REMOTE ] NIO: Full fetch complete (58482 records). [2025-09-14T19:15:17.647729] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-14T19:15:18.044292] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-14T19:15:18.063603] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-14T19:15:18.063854] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-14T19:15:18.065028] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-14T19:15:18.065232] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-14T19:15:18.067129] [DEBUG] [LOCAL ] NIO: Trimmed 58482 records to 40542 (keeping 150 days of data) [2025-09-14T19:15:18.160136] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-14T19:15:18.200810] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T19:15:18.361336] [DEBUG] [LOCAL ] NIO: Primary data saved (40542 records). [2025-09-14T19:15:18.361518] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-14T19:15:18.361627] [INFO ] [MAIN ] Update Progress: 1489/2370 symbols completed. NIO took 37.1s. Estimated remaining: 1h 33m 33s. Rate: 9.4 symbols/min [2025-09-14T19:15:18.540264] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:18.544925] [DEBUG] [LOCAL ] NL: Loaded 2363 existing records from primary storage. [2025-09-14T19:15:18.545071] [INFO ] [MAIN ] NL: Loaded 2363 existing records. [2025-09-14T19:15:18.727663] [WARN ] [MAIN ] NL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:18.727940] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-14T19:15:18.728006] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-14T19:15:18.728388] [DEBUG] [LOCAL ] NL: Deleted primary data file. [2025-09-14T19:15:18.728957] [DEBUG] [LOCAL ] NL: Removed from QA tracker. [2025-09-14T19:15:18.729019] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-14T19:15:18.961836] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-14T19:15:19.103453] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T19:15:19.130696] [INFO ] [REMOTE ] NL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:19.158947] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-14T19:15:19.758843] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-14T19:15:19.908412] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T19:15:19.913916] [INFO ] [REMOTE ] NKE: Full fetch complete (57717 records). [2025-09-14T19:15:19.914086] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-14T19:15:20.114602] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T19:15:20.115378] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:15:20.115451] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:15:20.115524] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-14T19:15:20.115618] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-14T19:15:20.115725] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-14T19:15:20.115790] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-14T19:15:20.115916] [INFO ] [MAIN ] Update Progress: 1490/2370 symbols completed. NKE took 19.5s. Estimated remaining: 1h 33m 24s. Rate: 9.4 symbols/min [2025-09-14T19:15:20.295845] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:20.304589] [DEBUG] [LOCAL ] NLOP: Loaded 5207 existing records from primary storage. [2025-09-14T19:15:20.304841] [INFO ] [MAIN ] NLOP: Loaded 5207 existing records. [2025-09-14T19:15:20.494736] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:20.495088] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-14T19:15:20.495155] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-14T19:15:20.495625] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-14T19:15:20.495725] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-14T19:15:20.564119] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-14T19:15:20.891325] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:21.340204] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T19:15:21.358808] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-14T19:15:21.835257] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T19:15:22.070481] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:15:22.074808] [INFO ] [REMOTE ] NJR: Full fetch complete (40862 records). [2025-09-14T19:15:22.074948] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-14T19:15:22.164052] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-14T19:15:22.475420] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-14T19:15:22.480560] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-14T19:15:22.481981] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-14T19:15:22.482057] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-14T19:15:22.483934] [DEBUG] [LOCAL ] NJR: Trimmed 40862 records to 28259 (keeping 150 days of data) [2025-09-14T19:15:22.685015] [DEBUG] [LOCAL ] NJR: Primary data saved (28259 records). [2025-09-14T19:15:22.685239] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-14T19:15:22.685365] [INFO ] [MAIN ] Update Progress: 1491/2370 symbols completed. NJR took 31.3s. Estimated remaining: 1h 33m 15s. Rate: 9.4 symbols/min [2025-09-14T19:15:22.873971] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:22.901232] [DEBUG] [LOCAL ] NLY: Loaded 23982 existing records from primary storage. [2025-09-14T19:15:22.901462] [INFO ] [MAIN ] NLY: Loaded 23982 existing records. [2025-09-14T19:15:22.970248] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-14T19:15:23.096494] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:23.096833] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-14T19:15:23.096929] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-14T19:15:23.097769] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-14T19:15:23.097838] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-14T19:15:23.336866] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T19:15:23.494071] [INFO ] [REMOTE ] NLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:23.758855] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-14T19:15:24.026790] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T19:15:24.558867] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-14T19:15:25.373577] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-14T19:15:25.400382] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T19:15:25.474453] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T19:15:26.158900] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-14T19:15:26.342188] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T19:15:26.777187] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T19:15:26.958865] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-14T19:15:27.758839] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-14T19:15:27.818119] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T19:15:28.558846] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-14T19:15:29.358845] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-14T19:15:29.518459] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T19:15:29.520735] [INFO ] [REMOTE ] NKX: Full fetch complete (14638 records). [2025-09-14T19:15:29.520867] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-14T19:15:29.909291] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-14T19:15:29.909565] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-14T19:15:29.910152] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-14T19:15:29.910323] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-14T19:15:29.911327] [DEBUG] [LOCAL ] NKX: Trimmed 14638 records to 10334 (keeping 150 days of data) [2025-09-14T19:15:30.010868] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-14T19:15:30.011028] [DEBUG] [LOCAL ] NKX: Primary data saved (10334 records). [2025-09-14T19:15:30.023111] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-14T19:15:30.023367] [INFO ] [MAIN ] Update Progress: 1492/2370 symbols completed. NKX took 19.4s. Estimated remaining: 1h 33m 10s. Rate: 9.4 symbols/min [2025-09-14T19:15:30.103288] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T19:15:30.163927] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-14T19:15:30.224133] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:30.232796] [DEBUG] [LOCAL ] NMAI: Loaded 6119 existing records from primary storage. [2025-09-14T19:15:30.232956] [INFO ] [MAIN ] NMAI: Loaded 6119 existing records. [2025-09-14T19:15:30.412638] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:30.412925] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-14T19:15:30.413004] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-14T19:15:30.413385] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-14T19:15:30.413449] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-14T19:15:30.783521] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:30.958823] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-14T19:15:31.758850] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-14T19:15:31.823355] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T19:15:32.364891] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-14T19:15:32.558853] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-14T19:15:33.358857] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-14T19:15:33.908484] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T19:15:33.928949] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T19:15:34.158811] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-14T19:15:34.523757] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T19:15:34.958834] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-14T19:15:35.687600] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-14T19:15:35.758878] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-14T19:15:36.132957] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T19:15:36.545102] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T19:15:36.558772] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-14T19:15:37.358873] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-14T19:15:38.158797] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-14T19:15:38.274832] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T19:15:38.566403] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-14T19:15:38.679408] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T19:15:38.958811] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-14T19:15:39.505109] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T19:15:39.506420] [INFO ] [REMOTE ] NL: Full fetch complete (5199 records). [2025-09-14T19:15:39.506545] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-14T19:15:39.684611] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:15:39.684860] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:15:39.684913] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:15:39.684958] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-14T19:15:39.685025] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-14T19:15:39.685078] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-14T19:15:39.685129] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-14T19:15:39.685205] [INFO ] [MAIN ] Update Progress: 1493/2370 symbols completed. NL took 21.3s. Estimated remaining: 1h 33m 5s. Rate: 9.4 symbols/min [2025-09-14T19:15:39.764005] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-14T19:15:39.859421] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:39.880358] [DEBUG] [LOCAL ] NMAX: Loaded 19315 existing records from primary storage. [2025-09-14T19:15:39.880517] [INFO ] [MAIN ] NMAX: Loaded 19315 existing records. [2025-09-14T19:15:40.054858] [WARN ] [MAIN ] NMAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:40.055116] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-14T19:15:40.055184] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-14T19:15:40.055707] [DEBUG] [LOCAL ] NMAX: Deleted primary data file. [2025-09-14T19:15:40.055771] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-14T19:15:40.479931] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:40.558914] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-14T19:15:41.358909] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-14T19:15:41.586196] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T19:15:41.936840] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T19:15:42.158850] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-14T19:15:42.173272] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T19:15:42.958852] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-14T19:15:42.989242] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T19:15:43.692341] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T19:15:43.758835] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-14T19:15:44.558855] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-14T19:15:44.732638] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T19:15:45.358873] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-14T19:15:45.606263] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T19:15:45.653159] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:15:45.653707] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-14T19:15:46.158903] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-14T19:15:46.958839] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-14T19:15:47.758908] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-14T19:15:47.858465] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T19:15:47.861424] [INFO ] [REMOTE ] NLOP: Full fetch complete (12842 records). [2025-09-14T19:15:47.861713] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-14T19:15:48.230760] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-14T19:15:48.234623] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-14T19:15:48.234947] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-14T19:15:48.236847] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-14T19:15:48.236953] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-14T19:15:48.237758] [DEBUG] [LOCAL ] NLOP: Trimmed 12842 records to 8503 (keeping 150 days of data) [2025-09-14T19:15:48.321727] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T19:15:48.345284] [DEBUG] [LOCAL ] NLOP: Primary data saved (8503 records). [2025-09-14T19:15:48.345540] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-14T19:15:48.345718] [INFO ] [MAIN ] Update Progress: 1494/2370 symbols completed. NLOP took 28.2s. Estimated remaining: 1h 33m 0s. Rate: 9.4 symbols/min [2025-09-14T19:15:48.519679] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:48.529594] [DEBUG] [LOCAL ] NMCO: Loaded 7674 existing records from primary storage. [2025-09-14T19:15:48.529815] [INFO ] [MAIN ] NMCO: Loaded 7674 existing records. [2025-09-14T19:15:48.564039] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-14T19:15:48.716288] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:48.716632] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-14T19:15:48.716723] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-14T19:15:48.717148] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-14T19:15:48.717213] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-14T19:15:49.158618] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:49.358829] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-14T19:15:49.465148] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T19:15:49.471409] [INFO ] [REMOTE ] NLY: Full fetch complete (58248 records). [2025-09-14T19:15:49.471554] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-14T19:15:49.868103] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-14T19:15:49.868253] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-14T19:15:49.869268] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-14T19:15:49.869348] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-14T19:15:49.870787] [DEBUG] [LOCAL ] NLY: Trimmed 58248 records to 40330 (keeping 150 days of data) [2025-09-14T19:15:50.148261] [DEBUG] [LOCAL ] NLY: Primary data saved (40330 records). [2025-09-14T19:15:50.148462] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-14T19:15:50.148638] [INFO ] [MAIN ] Update Progress: 1495/2370 symbols completed. NLY took 27.5s. Estimated remaining: 1h 32m 51s. Rate: 9.4 symbols/min [2025-09-14T19:15:50.163937] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-14T19:15:50.333957] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:50.339672] [DEBUG] [LOCAL ] NMG: Loaded 3767 existing records from primary storage. [2025-09-14T19:15:50.339795] [INFO ] [MAIN ] NMG: Loaded 3767 existing records. [2025-09-14T19:15:50.498562] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T19:15:50.533339] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:50.537433] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-14T19:15:50.537503] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-14T19:15:50.537824] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-14T19:15:50.537891] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-14T19:15:50.903000] [INFO ] [REMOTE ] NMG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:50.958828] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-14T19:15:51.134472] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T19:15:51.527205] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T19:15:51.758889] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-14T19:15:52.558902] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-14T19:15:53.326499] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T19:15:53.358854] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-14T19:15:54.102421] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T19:15:54.158808] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-14T19:15:54.304529] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T19:15:54.306615] [INFO ] [REMOTE ] NMAI: Full fetch complete (14343 records). [2025-09-14T19:15:54.306742] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-14T19:15:54.667292] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-14T19:15:54.667412] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-14T19:15:54.667820] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-14T19:15:54.667903] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-14T19:15:54.668433] [DEBUG] [LOCAL ] NMAI: Trimmed 14343 records to 9356 (keeping 150 days of data) [2025-09-14T19:15:54.733601] [DEBUG] [LOCAL ] NMAI: Primary data saved (9356 records). [2025-09-14T19:15:54.734087] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-14T19:15:54.734225] [INFO ] [MAIN ] Update Progress: 1496/2370 symbols completed. NMAI took 24.7s. Estimated remaining: 1h 32m 44s. Rate: 9.4 symbols/min [2025-09-14T19:15:54.905595] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:15:54.909761] [DEBUG] [LOCAL ] NMI: Loaded 2270 existing records from primary storage. [2025-09-14T19:15:54.909875] [INFO ] [MAIN ] NMI: Loaded 2270 existing records. [2025-09-14T19:15:54.964399] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-14T19:15:55.088862] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:15:55.089132] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-14T19:15:55.089272] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-14T19:15:55.089504] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-14T19:15:55.089573] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-14T19:15:55.446482] [INFO ] [REMOTE ] NMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:15:55.758826] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-14T19:15:55.983774] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T19:15:56.457969] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T19:15:56.536799] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-14T19:15:56.558804] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-14T19:15:57.220798] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T19:15:57.358837] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-14T19:15:58.158897] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-14T19:15:58.741146] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T19:15:58.804460] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T19:15:58.958829] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-14T19:15:59.758877] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-14T19:16:00.558817] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-14T19:16:00.922283] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T19:16:01.284616] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-14T19:16:01.358809] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-14T19:16:01.578946] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T19:16:02.032391] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:16:02.158845] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-14T19:16:02.758304] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-14T19:16:02.958819] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-14T19:16:03.758885] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-14T19:16:04.467042] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T19:16:04.558856] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-14T19:16:04.760910] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T19:16:05.358880] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-14T19:16:05.588299] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T19:16:05.904109] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-14T19:16:06.158850] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-14T19:16:06.807149] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:16:06.808338] [INFO ] [REMOTE ] NMI: Full fetch complete (4435 records). [2025-09-14T19:16:06.808425] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-14T19:16:06.982119] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-14T19:16:07.176996] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-14T19:16:07.177113] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-14T19:16:07.177296] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-14T19:16:07.177366] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-14T19:16:07.177824] [DEBUG] [LOCAL ] NMI: Trimmed 4435 records to 3384 (keeping 150 days of data) [2025-09-14T19:16:07.198052] [DEBUG] [LOCAL ] NMI: Primary data saved (3384 records). [2025-09-14T19:16:07.198135] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-14T19:16:07.198241] [INFO ] [MAIN ] Update Progress: 1497/2370 symbols completed. NMI took 12.5s. Estimated remaining: 1h 32m 41s. Rate: 9.4 symbols/min [2025-09-14T19:16:07.372892] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:07.380877] [DEBUG] [LOCAL ] NMM: Loaded 6040 existing records from primary storage. [2025-09-14T19:16:07.381033] [INFO ] [MAIN ] NMM: Loaded 6040 existing records. [2025-09-14T19:16:07.566200] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:07.566522] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-14T19:16:07.566596] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-14T19:16:07.567039] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-14T19:16:07.567115] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-14T19:16:07.769305] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-14T19:16:07.940954] [INFO ] [REMOTE ] NMM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:07.949712] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T19:16:08.558889] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-14T19:16:08.858906] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T19:16:09.358822] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-14T19:16:09.742617] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T19:16:10.158862] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-14T19:16:10.442506] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T19:16:10.958827] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-14T19:16:11.752775] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:16:11.758781] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-14T19:16:11.961890] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T19:16:12.424985] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T19:16:12.558843] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-14T19:16:13.350809] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T19:16:13.358826] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-14T19:16:14.158845] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-14T19:16:14.782131] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T19:16:14.958826] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-14T19:16:15.758852] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-14T19:16:15.834145] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T19:16:15.839280] [INFO ] [REMOTE ] NMAX: Full fetch complete (37934 records). [2025-09-14T19:16:15.839431] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-14T19:16:16.042042] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 115 unique days, need 150 days [2025-09-14T19:16:16.052157] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:16:16.052697] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T19:16:16.052836] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:16:16.056064] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-14T19:16:16.056423] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-14T19:16:16.056510] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-14T19:16:16.056572] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-14T19:16:16.056691] [INFO ] [MAIN ] Update Progress: 1498/2370 symbols completed. NMAX took 36.4s. Estimated remaining: 1h 32m 36s. Rate: 9.4 symbols/min [2025-09-14T19:16:16.240615] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:16.257182] [DEBUG] [LOCAL ] NMR: Loaded 14926 existing records from primary storage. [2025-09-14T19:16:16.257348] [INFO ] [MAIN ] NMR: Loaded 14926 existing records. [2025-09-14T19:16:16.444216] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:16.444506] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-14T19:16:16.444569] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-14T19:16:16.445011] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-14T19:16:16.445074] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-14T19:16:16.562750] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-14T19:16:16.628586] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T19:16:16.833935] [INFO ] [REMOTE ] NMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:17.358836] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-14T19:16:17.605456] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T19:16:18.076300] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T19:16:18.158835] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-14T19:16:18.958836] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-14T19:16:19.128385] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T19:16:19.130960] [INFO ] [REMOTE ] NMCO: Full fetch complete (17394 records). [2025-09-14T19:16:19.131102] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-14T19:16:19.520828] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-14T19:16:19.520946] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-14T19:16:19.521394] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-14T19:16:19.521457] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-14T19:16:19.522070] [DEBUG] [LOCAL ] NMCO: Trimmed 17394 records to 12649 (keeping 150 days of data) [2025-09-14T19:16:19.601267] [DEBUG] [LOCAL ] NMCO: Primary data saved (12649 records). [2025-09-14T19:16:19.601444] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-14T19:16:19.601561] [INFO ] [MAIN ] Update Progress: 1499/2370 symbols completed. NMCO took 31.3s. Estimated remaining: 1h 32m 28s. Rate: 9.4 symbols/min [2025-09-14T19:16:19.772039] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-14T19:16:19.774672] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:19.779218] [DEBUG] [LOCAL ] NMS: Loaded 1275 existing records from primary storage. [2025-09-14T19:16:19.779534] [INFO ] [MAIN ] NMS: Loaded 1275 existing records. [2025-09-14T19:16:19.963011] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:19.963412] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-14T19:16:19.963560] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-14T19:16:19.969023] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-14T19:16:19.974251] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-14T19:16:20.020546] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T19:16:20.344862] [INFO ] [REMOTE ] NMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:20.558841] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-14T19:16:21.179461] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T19:16:21.201582] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T19:16:21.358856] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-14T19:16:21.832750] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T19:16:22.158845] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-14T19:16:22.958848] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-14T19:16:23.241590] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T19:16:23.640467] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T19:16:23.758859] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-14T19:16:24.475694] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T19:16:24.558850] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-14T19:16:25.141075] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-14T19:16:25.358836] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-14T19:16:26.158867] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-14T19:16:26.845410] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:16:26.846784] [INFO ] [REMOTE ] NMG: Full fetch complete (8020 records). [2025-09-14T19:16:26.846871] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-14T19:16:26.959603] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-14T19:16:27.229012] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T19:16:27.235740] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-14T19:16:27.243134] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-14T19:16:27.244168] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-14T19:16:27.244233] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-14T19:16:27.244807] [DEBUG] [LOCAL ] NMG: Trimmed 8020 records to 5919 (keeping 150 days of data) [2025-09-14T19:16:27.279895] [DEBUG] [LOCAL ] NMG: Primary data saved (5919 records). [2025-09-14T19:16:27.280111] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-14T19:16:27.280238] [INFO ] [MAIN ] Update Progress: 1500/2370 symbols completed. NMG took 37.1s. Estimated remaining: 1h 32m 22s. Rate: 9.4 symbols/min [2025-09-14T19:16:27.462383] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:27.465811] [DEBUG] [LOCAL ] NMT: Loaded 1310 existing records from primary storage. [2025-09-14T19:16:27.465916] [INFO ] [MAIN ] NMT: Loaded 1310 existing records. [2025-09-14T19:16:27.645075] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:27.645357] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-14T19:16:27.645416] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-14T19:16:27.645701] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-14T19:16:27.645768] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-14T19:16:27.764049] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-14T19:16:27.944571] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T19:16:27.990629] [INFO ] [REMOTE ] NMM: Full fetch complete (15820 records). [2025-09-14T19:16:28.017587] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-14T19:16:28.017479] [INFO ] [REMOTE ] NMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:28.396133] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-14T19:16:28.396289] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-14T19:16:28.396841] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-14T19:16:28.396924] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-14T19:16:28.398590] [DEBUG] [LOCAL ] NMM: Trimmed 15820 records to 10048 (keeping 150 days of data) [2025-09-14T19:16:28.471892] [DEBUG] [LOCAL ] NMM: Primary data saved (10048 records). [2025-09-14T19:16:28.472074] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-14T19:16:28.472309] [INFO ] [MAIN ] Update Progress: 1501/2370 symbols completed. NMM took 21.3s. Estimated remaining: 1h 32m 13s. Rate: 9.4 symbols/min [2025-09-14T19:16:28.564848] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-14T19:16:28.649404] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:28.662783] [DEBUG] [LOCAL ] NMZ: Loaded 9426 existing records from primary storage. [2025-09-14T19:16:28.662932] [INFO ] [MAIN ] NMZ: Loaded 9426 existing records. [2025-09-14T19:16:28.836081] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:28.836363] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-14T19:16:28.836432] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-14T19:16:28.836951] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-14T19:16:28.837014] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-14T19:16:29.161316] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-14T19:16:29.195862] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:29.358912] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-14T19:16:29.459021] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T19:16:30.158897] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-14T19:16:30.607826] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T19:16:30.702694] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T19:16:30.958822] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-14T19:16:31.531299] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T19:16:31.758840] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-14T19:16:32.377523] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T19:16:32.558863] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-14T19:16:33.252048] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T19:16:33.358839] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-14T19:16:33.926240] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:16:33.927312] [INFO ] [REMOTE ] NMS: Full fetch complete (3151 records). [2025-09-14T19:16:33.927421] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-14T19:16:34.163997] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-14T19:16:34.316529] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-14T19:16:34.316713] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-14T19:16:34.316892] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-14T19:16:34.316945] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-14T19:16:34.317351] [DEBUG] [LOCAL ] NMS: Trimmed 3151 records to 2290 (keeping 150 days of data) [2025-09-14T19:16:34.331902] [DEBUG] [LOCAL ] NMS: Primary data saved (2290 records). [2025-09-14T19:16:34.332004] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-14T19:16:34.332129] [INFO ] [MAIN ] Update Progress: 1502/2370 symbols completed. NMS took 14.7s. Estimated remaining: 1h 32m 6s. Rate: 9.4 symbols/min [2025-09-14T19:16:34.534974] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:34.545156] [DEBUG] [LOCAL ] NNI: Loaded 4968 existing records from primary storage. [2025-09-14T19:16:34.545328] [INFO ] [MAIN ] NNI: Loaded 4968 existing records. [2025-09-14T19:16:34.721692] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:34.721962] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-14T19:16:34.722022] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-14T19:16:34.722315] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-14T19:16:34.722374] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-14T19:16:34.967908] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-14T19:16:35.076804] [INFO ] [REMOTE ] NNI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:35.653932] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T19:16:35.727844] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T19:16:35.758844] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-14T19:16:36.558866] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-14T19:16:37.127291] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T19:16:37.358833] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-14T19:16:37.712209] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T19:16:38.158855] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-14T19:16:38.862748] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T19:16:38.919337] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T19:16:38.958827] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-14T19:16:39.752773] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T19:16:39.758764] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-14T19:16:40.558849] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-14T19:16:40.636295] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T19:16:41.358837] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-14T19:16:41.862788] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T19:16:42.158834] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-14T19:16:42.473847] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T19:16:42.950047] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:16:42.958774] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-14T19:16:43.758847] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-14T19:16:44.323456] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T19:16:44.327768] [INFO ] [REMOTE ] NMR: Full fetch complete (38044 records). [2025-09-14T19:16:44.327893] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-14T19:16:44.560111] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-14T19:16:44.659082] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T19:16:44.721187] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-14T19:16:44.721297] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-14T19:16:44.722212] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-14T19:16:44.722309] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-14T19:16:44.723278] [DEBUG] [LOCAL ] NMR: Trimmed 38044 records to 25901 (keeping 150 days of data) [2025-09-14T19:16:44.880494] [DEBUG] [LOCAL ] NMR: Primary data saved (25901 records). [2025-09-14T19:16:44.880709] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-14T19:16:44.880895] [INFO ] [MAIN ] Update Progress: 1503/2370 symbols completed. NMR took 28.8s. Estimated remaining: 1h 32m 2s. Rate: 9.4 symbols/min [2025-09-14T19:16:45.086774] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:45.107839] [DEBUG] [LOCAL ] NNN: Loaded 21809 existing records from primary storage. [2025-09-14T19:16:45.108023] [INFO ] [MAIN ] NNN: Loaded 21809 existing records. [2025-09-14T19:16:45.286269] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:45.286536] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-14T19:16:45.286595] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-14T19:16:45.287215] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-14T19:16:45.287276] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-14T19:16:45.363903] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-14T19:16:45.640213] [INFO ] [REMOTE ] NNN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:45.715174] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T19:16:46.158835] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-14T19:16:46.270541] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T19:16:46.539908] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T19:16:46.958869] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-14T19:16:47.560518] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T19:16:47.758843] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-14T19:16:48.558833] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-14T19:16:48.696277] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T19:16:49.358812] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-14T19:16:49.653021] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T19:16:50.158837] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-14T19:16:50.248586] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T19:16:50.958802] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-14T19:16:51.248198] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T19:16:51.471373] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T19:16:51.473250] [INFO ] [REMOTE ] NNI: Full fetch complete (10081 records). [2025-09-14T19:16:51.473349] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-14T19:16:51.759902] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-14T19:16:51.862570] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-14T19:16:51.862698] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-14T19:16:51.862988] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-14T19:16:51.863039] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-14T19:16:51.863607] [DEBUG] [LOCAL ] NNI: Trimmed 10081 records to 7915 (keeping 150 days of data) [2025-09-14T19:16:51.918166] [DEBUG] [LOCAL ] NNI: Primary data saved (7915 records). [2025-09-14T19:16:51.918362] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-14T19:16:51.918480] [INFO ] [MAIN ] Update Progress: 1504/2370 symbols completed. NNI took 17.6s. Estimated remaining: 1h 31m 56s. Rate: 9.4 symbols/min [2025-09-14T19:16:52.094926] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:52.100442] [DEBUG] [LOCAL ] NNY: Loaded 2638 existing records from primary storage. [2025-09-14T19:16:52.100658] [INFO ] [MAIN ] NNY: Loaded 2638 existing records. [2025-09-14T19:16:52.280862] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:52.281144] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-14T19:16:52.281227] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-14T19:16:52.281575] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-14T19:16:52.281681] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-14T19:16:52.444735] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T19:16:52.568283] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-14T19:16:52.654972] [INFO ] [REMOTE ] NNY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:53.358906] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-14T19:16:53.570915] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:16:53.575764] [INFO ] [REMOTE ] NMZ: Full fetch complete (23299 records). [2025-09-14T19:16:53.576002] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-14T19:16:53.890951] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T19:16:53.946147] [INFO ] [REMOTE ] NMT: Full fetch complete (3015 records). [2025-09-14T19:16:53.996457] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-14T19:16:54.159112] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-14T19:16:54.348142] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-14T19:16:54.363758] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-14T19:16:54.392947] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-14T19:16:54.403618] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-14T19:16:54.525154] [DEBUG] [LOCAL ] NMZ: Trimmed 23299 records to 15769 (keeping 150 days of data) [2025-09-14T19:16:54.702014] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-14T19:16:54.702902] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-14T19:16:54.703527] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-14T19:16:54.703824] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-14T19:16:54.705299] [DEBUG] [LOCAL ] NMT: Trimmed 3015 records to 2165 (keeping 150 days of data) [2025-09-14T19:16:54.724113] [DEBUG] [LOCAL ] NMT: Primary data saved (2165 records). [2025-09-14T19:16:54.724420] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-14T19:16:54.725042] [INFO ] [MAIN ] Update Progress: 1505/2370 symbols completed. NMT took 27.4s. Estimated remaining: 1h 31m 48s. Rate: 9.4 symbols/min [2025-09-14T19:16:54.901605] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:54.914399] [DEBUG] [LOCAL ] NMZ: Primary data saved (15769 records). [2025-09-14T19:16:54.914597] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-14T19:16:54.914718] [INFO ] [MAIN ] Update Progress: 1506/2370 symbols completed. NMZ took 26.4s. Estimated remaining: 1h 31m 38s. Rate: 9.4 symbols/min [2025-09-14T19:16:54.981111] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-14T19:16:54.986775] [DEBUG] [LOCAL ] NOA: Loaded 7271 existing records from primary storage. [2025-09-14T19:16:54.999292] [INFO ] [MAIN ] NOA: Loaded 7271 existing records. [2025-09-14T19:16:55.188757] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:16:55.274466] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:55.278159] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-14T19:16:55.277983] [DEBUG] [LOCAL ] NOAH: Loaded 8620 existing records from primary storage. [2025-09-14T19:16:55.278331] [INFO ] [MAIN ] NOAH: Loaded 8620 existing records. [2025-09-14T19:16:55.278263] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-14T19:16:55.348244] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-14T19:16:55.370406] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-14T19:16:55.587175] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:16:55.608017] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-14T19:16:55.632384] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-14T19:16:55.645380] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-14T19:16:55.670140] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-14T19:16:56.026024] [INFO ] [REMOTE ] NOA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:56.065051] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T19:16:56.109323] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-14T19:16:56.236579] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:16:56.263920] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T19:16:56.558831] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-14T19:16:57.208626] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T19:16:57.358826] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-14T19:16:58.158860] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-14T19:16:58.530453] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T19:16:58.676976] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T19:16:58.802213] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T19:16:58.958793] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-14T19:16:59.758838] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-14T19:16:59.970948] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T19:17:00.558819] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-14T19:17:01.358882] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-14T19:17:01.642030] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T19:17:01.871171] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T19:17:02.158861] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-14T19:17:02.254663] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:17:02.958822] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-14T19:17:03.741908] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T19:17:03.758773] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-14T19:17:03.882115] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T19:17:04.558873] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-14T19:17:04.779323] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T19:17:05.358843] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-14T19:17:05.755215] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T19:17:06.158878] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-14T19:17:06.300200] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T19:17:06.958838] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-14T19:17:07.707043] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:17:07.742796] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T19:17:07.758777] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-14T19:17:08.457151] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T19:17:08.558844] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-14T19:17:09.308092] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T19:17:09.358820] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-14T19:17:10.074946] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T19:17:10.158828] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-14T19:17:10.958833] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-14T19:17:11.095134] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T19:17:11.758876] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-14T19:17:11.911727] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T19:17:12.558839] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-14T19:17:12.982089] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T19:17:13.358837] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-14T19:17:14.058208] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:17:14.059457] [INFO ] [REMOTE ] NNY: Full fetch complete (6009 records). [2025-09-14T19:17:14.059553] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-14T19:17:14.163496] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-14T19:17:14.439269] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-14T19:17:14.439450] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-14T19:17:14.439750] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-14T19:17:14.439867] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-14T19:17:14.440421] [DEBUG] [LOCAL ] NNY: Trimmed 6009 records to 4138 (keeping 150 days of data) [2025-09-14T19:17:14.496838] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T19:17:14.509341] [DEBUG] [LOCAL ] NNY: Primary data saved (4138 records). [2025-09-14T19:17:14.509758] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-14T19:17:14.509944] [INFO ] [MAIN ] Update Progress: 1507/2370 symbols completed. NNY took 22.6s. Estimated remaining: 1h 31m 39s. Rate: 9.4 symbols/min [2025-09-14T19:17:14.683668] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:14.704480] [DEBUG] [LOCAL ] NOC: Loaded 17710 existing records from primary storage. [2025-09-14T19:17:14.704676] [INFO ] [MAIN ] NOC: Loaded 17710 existing records. [2025-09-14T19:17:14.882619] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:14.882905] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-14T19:17:14.882963] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-14T19:17:14.883689] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-14T19:17:14.883752] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-14T19:17:14.963885] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-14T19:17:15.231700] [INFO ] [REMOTE ] NOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:17:15.481950] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T19:17:15.758797] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-14T19:17:15.857708] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:17:15.860000] [INFO ] [REMOTE ] NOA: Full fetch complete (17646 records). [2025-09-14T19:17:15.860087] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-14T19:17:16.231044] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-14T19:17:16.231156] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-14T19:17:16.231612] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-14T19:17:16.231683] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-14T19:17:16.232308] [DEBUG] [LOCAL ] NOA: Trimmed 17646 records to 11606 (keeping 150 days of data) [2025-09-14T19:17:16.308109] [DEBUG] [LOCAL ] NOA: Primary data saved (11606 records). [2025-09-14T19:17:16.308277] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-14T19:17:16.308375] [INFO ] [MAIN ] Update Progress: 1508/2370 symbols completed. NOA took 21.6s. Estimated remaining: 1h 31m 30s. Rate: 9.4 symbols/min [2025-09-14T19:17:16.484600] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:16.506218] [DEBUG] [LOCAL ] NOG: Loaded 22802 existing records from primary storage. [2025-09-14T19:17:16.506407] [INFO ] [MAIN ] NOG: Loaded 22802 existing records. [2025-09-14T19:17:16.566475] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-14T19:17:16.692449] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:16.692704] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-14T19:17:16.692768] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-14T19:17:16.693444] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-14T19:17:16.693505] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-14T19:17:17.048168] [INFO ] [REMOTE ] NOG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:17:17.358816] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-14T19:17:17.739821] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-14T19:17:18.158848] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-14T19:17:18.303412] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T19:17:18.958840] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-14T19:17:19.019265] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:17:19.142954] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T19:17:19.651023] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:17:19.656152] [INFO ] [REMOTE ] NNN: Full fetch complete (52836 records). [2025-09-14T19:17:19.656320] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-14T19:17:19.763954] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-14T19:17:20.057806] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-14T19:17:20.057927] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-14T19:17:20.058879] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-14T19:17:20.058935] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-14T19:17:20.060085] [DEBUG] [LOCAL ] NNN: Trimmed 52836 records to 36174 (keeping 150 days of data) [2025-09-14T19:17:20.290183] [DEBUG] [LOCAL ] NNN: Primary data saved (36174 records). [2025-09-14T19:17:20.290363] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-14T19:17:20.290465] [INFO ] [MAIN ] Update Progress: 1509/2370 symbols completed. NNN took 35.4s. Estimated remaining: 1h 31m 22s. Rate: 9.4 symbols/min [2025-09-14T19:17:20.457722] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:20.480019] [DEBUG] [LOCAL ] NOK: Loaded 24041 existing records from primary storage. [2025-09-14T19:17:20.480195] [INFO ] [MAIN ] NOK: Loaded 24041 existing records. [2025-09-14T19:17:20.564103] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-14T19:17:20.660989] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:20.661220] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-14T19:17:20.661279] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-14T19:17:20.662025] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-14T19:17:20.662088] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-14T19:17:21.031934] [INFO ] [REMOTE ] NOK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:17:21.032344] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T19:17:21.358863] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-14T19:17:22.158838] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-14T19:17:22.473286] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T19:17:22.958811] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-14T19:17:23.191335] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T19:17:23.194548] [INFO ] [REMOTE ] NOAH: Full fetch complete (21406 records). [2025-09-14T19:17:23.194696] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-14T19:17:23.582102] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-14T19:17:23.582358] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-14T19:17:23.582925] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-14T19:17:23.583071] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-14T19:17:23.616816] [DEBUG] [LOCAL ] NOAH: Trimmed 21406 records to 14703 (keeping 150 days of data) [2025-09-14T19:17:23.619402] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T19:17:23.719226] [DEBUG] [LOCAL ] NOAH: Primary data saved (14703 records). [2025-09-14T19:17:23.719406] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-14T19:17:23.719512] [INFO ] [MAIN ] Update Progress: 1510/2370 symbols completed. NOAH took 28.8s. Estimated remaining: 1h 31m 14s. Rate: 9.4 symbols/min [2025-09-14T19:17:23.763916] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-14T19:17:23.891733] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:23.894158] [DEBUG] [LOCAL ] NOM: Loaded 648 existing records from primary storage. [2025-09-14T19:17:23.894244] [INFO ] [MAIN ] NOM: Loaded 648 existing records. [2025-09-14T19:17:24.081861] [WARN ] [MAIN ] NOM: Insufficient historical data. Have data from 2025-06-17, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:24.082145] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-14T19:17:24.082226] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-14T19:17:24.082544] [DEBUG] [LOCAL ] NOM: Deleted primary data file. [2025-09-14T19:17:24.082631] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-14T19:17:24.432011] [INFO ] [REMOTE ] NOM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:17:24.558787] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-14T19:17:24.959132] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T19:17:24.972323] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-14T19:17:25.358853] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-14T19:17:25.725486] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T19:17:26.158904] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-14T19:17:26.590871] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-14T19:17:26.958860] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-14T19:17:27.388877] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T19:17:27.532675] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-14T19:17:27.758843] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-14T19:17:28.188337] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-14T19:17:28.558897] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-14T19:17:29.358860] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-14T19:17:30.158905] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-14T19:17:30.471057] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T19:17:30.958857] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-14T19:17:31.311968] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T19:17:31.758880] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-14T19:17:32.474776] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T19:17:32.567039] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-14T19:17:32.581174] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-14T19:17:32.991862] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T19:17:33.358821] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-14T19:17:33.395581] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T19:17:33.901347] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T19:17:34.158929] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-14T19:17:34.655634] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T19:17:34.958922] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-14T19:17:35.758997] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-14T19:17:36.558869] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-14T19:17:36.992314] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:17:36.993856] [INFO ] [REMOTE ] NOM: Full fetch complete (1238 records). [2025-09-14T19:17:36.993973] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-14T19:17:37.190209] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T19:17:37.190738] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:17:37.190810] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:17:37.190867] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-14T19:17:37.191096] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-14T19:17:37.191171] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-14T19:17:37.191371] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-14T19:17:37.191470] [INFO ] [MAIN ] Update Progress: 1511/2370 symbols completed. NOM took 13.5s. Estimated remaining: 1h 31m 12s. Rate: 9.4 symbols/min [2025-09-14T19:17:37.372628] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-14T19:17:37.392405] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-14T19:17:37.414564] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:37.470122] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T19:17:37.497002] [DEBUG] [LOCAL ] NOMD: Loaded 18188 existing records from primary storage. [2025-09-14T19:17:37.497203] [INFO ] [MAIN ] NOMD: Loaded 18188 existing records. [2025-09-14T19:17:37.674380] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:37.674631] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-14T19:17:37.674715] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-14T19:17:37.675421] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-14T19:17:37.675511] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-14T19:17:38.054845] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:17:38.158861] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-14T19:17:38.958900] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-14T19:17:39.412106] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T19:17:39.758887] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-14T19:17:40.002167] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T19:17:40.458393] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T19:17:40.558877] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-14T19:17:41.302460] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:17:41.309846] [INFO ] [REMOTE ] NOG: Full fetch complete (55596 records). [2025-09-14T19:17:41.310159] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-14T19:17:41.361757] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-14T19:17:41.416828] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T19:17:41.759426] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-14T19:17:41.759576] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-14T19:17:41.760819] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-14T19:17:41.760884] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-14T19:17:41.762580] [DEBUG] [LOCAL ] NOG: Trimmed 55596 records to 38382 (keeping 150 days of data) [2025-09-14T19:17:42.035931] [DEBUG] [LOCAL ] NOG: Primary data saved (38382 records). [2025-09-14T19:17:42.036169] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-14T19:17:42.036373] [INFO ] [MAIN ] Update Progress: 1512/2370 symbols completed. NOG took 25.7s. Estimated remaining: 1h 31m 5s. Rate: 9.4 symbols/min [2025-09-14T19:17:42.163907] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-14T19:17:42.218479] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:42.240134] [DEBUG] [LOCAL ] NOTE: Loaded 19258 existing records from primary storage. [2025-09-14T19:17:42.240394] [INFO ] [MAIN ] NOTE: Loaded 19258 existing records. [2025-09-14T19:17:42.428708] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:42.429057] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-14T19:17:42.429123] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-14T19:17:42.429862] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-14T19:17:42.429931] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-14T19:17:42.800280] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:17:42.958866] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-14T19:17:43.689474] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-14T19:17:43.713447] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:17:43.719993] [INFO ] [REMOTE ] NOC: Full fetch complete (47190 records). [2025-09-14T19:17:43.720227] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-14T19:17:43.769159] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-14T19:17:43.920202] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T19:17:44.217140] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-14T19:17:44.217324] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-14T19:17:44.218526] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-14T19:17:44.218599] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-14T19:17:44.220241] [DEBUG] [LOCAL ] NOC: Trimmed 47190 records to 31770 (keeping 150 days of data) [2025-09-14T19:17:44.500463] [DEBUG] [LOCAL ] NOC: Primary data saved (31770 records). [2025-09-14T19:17:44.500764] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-14T19:17:44.500916] [INFO ] [MAIN ] Update Progress: 1513/2370 symbols completed. NOC took 30.0s. Estimated remaining: 1h 30m 56s. Rate: 9.4 symbols/min [2025-09-14T19:17:44.564010] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-14T19:17:44.710365] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:44.738067] [DEBUG] [LOCAL ] NOV: Loaded 23827 existing records from primary storage. [2025-09-14T19:17:44.738291] [INFO ] [MAIN ] NOV: Loaded 23827 existing records. [2025-09-14T19:17:44.926427] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:44.926809] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-14T19:17:44.926890] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-14T19:17:44.927705] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-14T19:17:44.927784] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-14T19:17:45.305602] [INFO ] [REMOTE ] NOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:17:45.358801] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-14T19:17:45.893370] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T19:17:46.158833] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-14T19:17:46.280909] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T19:17:46.841897] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T19:17:46.958951] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-14T19:17:47.721704] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:17:47.758872] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-14T19:17:48.558900] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-14T19:17:49.307538] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T19:17:49.358915] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T19:17:49.359063] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-14T19:17:50.158855] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-14T19:17:50.312550] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T19:17:50.958876] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-14T19:17:51.416722] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T19:17:51.733679] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T19:17:51.758870] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-14T19:17:52.558884] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-14T19:17:52.640524] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T19:17:53.358896] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-14T19:17:53.729054] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-14T19:17:53.735098] [INFO ] [REMOTE ] NOK: Full fetch complete (58297 records). [2025-09-14T19:17:53.735276] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-14T19:17:54.154384] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-14T19:17:54.154564] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-14T19:17:54.156479] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-14T19:17:54.156557] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-14T19:17:54.158566] [DEBUG] [LOCAL ] NOK: Trimmed 58297 records to 40362 (keeping 150 days of data) [2025-09-14T19:17:54.158812] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-14T19:17:54.450378] [DEBUG] [LOCAL ] NOK: Primary data saved (40362 records). [2025-09-14T19:17:54.450582] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-14T19:17:54.450716] [INFO ] [MAIN ] Update Progress: 1514/2370 symbols completed. NOK took 34.2s. Estimated remaining: 1h 30m 52s. Rate: 9.4 symbols/min [2025-09-14T19:17:54.683874] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:54.688450] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T19:17:54.724352] [DEBUG] [LOCAL ] NOW: Loaded 21608 existing records from primary storage. [2025-09-14T19:17:54.724557] [INFO ] [MAIN ] NOW: Loaded 21608 existing records. [2025-09-14T19:17:54.908364] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:54.908744] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-14T19:17:54.908916] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-14T19:17:54.909891] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-09-14T19:17:54.909980] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-14T19:17:54.967604] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-14T19:17:55.300010] [INFO ] [REMOTE ] NOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:17:55.328748] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T19:17:55.758911] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-14T19:17:56.037835] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T19:17:56.558858] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-14T19:17:57.081323] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T19:17:57.329579] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T19:17:57.358800] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-14T19:17:58.048868] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T19:17:58.158822] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-14T19:17:58.709805] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T19:17:58.714627] [INFO ] [REMOTE ] NOMD: Full fetch complete (44568 records). [2025-09-14T19:17:58.714804] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-14T19:17:58.964054] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-14T19:17:59.101784] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-14T19:17:59.101908] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-14T19:17:59.103033] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-14T19:17:59.103124] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-14T19:17:59.104310] [DEBUG] [LOCAL ] NOMD: Trimmed 44568 records to 31505 (keeping 150 days of data) [2025-09-14T19:17:59.320374] [DEBUG] [LOCAL ] NOMD: Primary data saved (31505 records). [2025-09-14T19:17:59.320576] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-14T19:17:59.320715] [INFO ] [MAIN ] Update Progress: 1515/2370 symbols completed. NOMD took 22.1s. Estimated remaining: 1h 30m 45s. Rate: 9.4 symbols/min [2025-09-14T19:17:59.492679] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:17:59.506229] [DEBUG] [LOCAL ] NPB: Loaded 7418 existing records from primary storage. [2025-09-14T19:17:59.506415] [INFO ] [MAIN ] NPB: Loaded 7418 existing records. [2025-09-14T19:17:59.685550] [WARN ] [MAIN ] NPB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:17:59.685859] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-14T19:17:59.685966] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-14T19:17:59.686349] [DEBUG] [LOCAL ] NPB: Deleted primary data file. [2025-09-14T19:17:59.686421] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-14T19:17:59.764023] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-14T19:18:00.052433] [INFO ] [REMOTE ] NPB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:00.113380] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T19:18:00.558851] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-14T19:18:00.721486] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T19:18:00.888797] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T19:18:01.358838] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-14T19:18:02.158841] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-14T19:18:02.958908] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-14T19:18:03.136902] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-14T19:18:03.758932] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-14T19:18:04.686255] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-14T19:18:04.688927] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-14T19:18:05.730903] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-14T19:18:05.741977] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-14T19:18:05.805471] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (4.45 seconds). [2025-09-14T19:18:06.158665] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:18:06.158895] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-14T19:18:06.173090] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-14T19:18:06.177082] [INFO ] [REMOTE ] NOTE: Full fetch complete (48446 records). [2025-09-14T19:18:06.177221] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-14T19:18:06.573024] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-14T19:18:06.573248] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-14T19:18:06.574333] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-14T19:18:06.574466] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-14T19:18:06.575867] [DEBUG] [LOCAL ] NOTE: Trimmed 48446 records to 33164 (keeping 150 days of data) [2025-09-14T19:18:06.697867] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T19:18:06.820778] [DEBUG] [LOCAL ] NOTE: Primary data saved (33164 records). [2025-09-14T19:18:06.821000] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-14T19:18:06.821157] [INFO ] [MAIN ] Update Progress: 1516/2370 symbols completed. NOTE took 24.8s. Estimated remaining: 1h 30m 39s. Rate: 9.4 symbols/min [2025-09-14T19:18:06.967723] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-14T19:18:07.001136] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:18:07.010872] [DEBUG] [LOCAL ] NPCT: Loaded 7458 existing records from primary storage. [2025-09-14T19:18:07.011423] [INFO ] [MAIN ] NPCT: Loaded 7458 existing records. [2025-09-14T19:18:07.189228] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:18:07.189511] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-14T19:18:07.189573] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-14T19:18:07.189992] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-14T19:18:07.190054] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-14T19:18:07.540619] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:07.758829] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-14T19:18:08.101418] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T19:18:08.121189] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T19:18:08.558831] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-14T19:18:08.741697] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T19:18:09.358855] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-14T19:18:10.158820] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-14T19:18:10.330214] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T19:18:10.562620] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T19:18:10.958853] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-14T19:18:11.156161] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T19:18:11.476607] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T19:18:11.758843] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-14T19:18:12.517160] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:18:12.522914] [INFO ] [REMOTE ] NOV: Full fetch complete (57854 records). [2025-09-14T19:18:12.523124] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-14T19:18:12.564109] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-14T19:18:12.919742] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-14T19:18:12.919888] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-14T19:18:12.920955] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-14T19:18:12.921028] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-14T19:18:12.922382] [DEBUG] [LOCAL ] NOV: Trimmed 57854 records to 39981 (keeping 150 days of data) [2025-09-14T19:18:13.180310] [DEBUG] [LOCAL ] NOV: Primary data saved (39981 records). [2025-09-14T19:18:13.180491] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-14T19:18:13.180608] [INFO ] [MAIN ] Update Progress: 1517/2370 symbols completed. NOV took 28.7s. Estimated remaining: 1h 30m 33s. Rate: 9.4 symbols/min [2025-09-14T19:18:13.358797] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-14T19:18:13.641278] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T19:18:14.033922] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T19:18:14.158862] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-14T19:18:14.958881] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-14T19:18:15.332238] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T19:18:15.758831] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-14T19:18:16.064922] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T19:18:16.558856] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-14T19:18:16.893253] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T19:18:17.358842] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-14T19:18:17.644126] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T19:18:18.158875] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-14T19:18:18.264973] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T19:18:18.958949] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-14T19:18:19.254496] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T19:18:19.692607] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T19:18:19.758838] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-14T19:18:20.558852] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-14T19:18:20.897477] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T19:18:21.358901] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-14T19:18:21.717201] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T19:18:22.158841] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-14T19:18:22.836314] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T19:18:22.838479] [INFO ] [REMOTE ] NPB: Full fetch complete (15141 records). [2025-09-14T19:18:22.838591] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-14T19:18:22.963977] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-14T19:18:23.022443] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 145 unique days, need 150 days [2025-09-14T19:18:23.022889] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:18:23.022945] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:18:23.022995] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-14T19:18:23.023077] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-14T19:18:23.023132] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-14T19:18:23.023185] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-14T19:18:23.023274] [INFO ] [MAIN ] Update Progress: 1518/2370 symbols completed. NPB took 23.7s. Estimated remaining: 1h 30m 28s. Rate: 9.4 symbols/min [2025-09-14T19:18:23.778120] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T19:18:23.783530] [INFO ] [REMOTE ] NOW: Full fetch complete (53473 records). [2025-09-14T19:18:23.783725] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-14T19:18:23.955185] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-14T19:18:24.039513] [INFO ] [REMOTE ] NPCT: Full fetch complete (18274 records). [2025-09-14T19:18:24.063350] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-14T19:18:24.430279] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-09-14T19:18:24.511988] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-09-14T19:18:24.539635] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-09-14T19:18:24.539844] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-09-14T19:18:24.591841] [DEBUG] [LOCAL ] NOW: Trimmed 53473 records to 36186 (keeping 150 days of data) [2025-09-14T19:18:24.625689] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-14T19:18:24.627064] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-14T19:18:24.627364] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-14T19:18:24.627955] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-14T19:18:24.628825] [DEBUG] [LOCAL ] NPCT: Trimmed 18274 records to 12879 (keeping 150 days of data) [2025-09-14T19:18:24.825621] [DEBUG] [LOCAL ] NPCT: Primary data saved (12879 records). [2025-09-14T19:18:24.826886] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-14T19:18:24.828094] [INFO ] [MAIN ] Update Progress: 1519/2370 symbols completed. NPCT took 18.0s. Estimated remaining: 1h 30m 19s. Rate: 9.4 symbols/min [2025-09-14T19:18:24.955195] [DEBUG] [LOCAL ] NOW: Primary data saved (36186 records). [2025-09-14T19:18:24.955474] [INFO ] [MAIN ] NOW: Full history saved. [2025-09-14T19:18:24.955675] [INFO ] [MAIN ] Update Progress: 1520/2370 symbols completed. NOW took 30.5s. Estimated remaining: 1h 30m 9s. Rate: 9.4 symbols/min [2025-09-14T19:18:25.684700] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:18:25.709955] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:18:25.810422] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:18:25.793963] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:18:25.820515] [DEBUG] [LOCAL ] NPK: Loaded 4618 existing records from primary storage. [2025-09-14T19:18:25.820990] [INFO ] [MAIN ] NPK: Loaded 4618 existing records. [2025-09-14T19:18:25.824183] [DEBUG] [LOCAL ] NPO: Loaded 5313 existing records from primary storage. [2025-09-14T19:18:25.830492] [INFO ] [MAIN ] NPO: Loaded 5313 existing records. [2025-09-14T19:18:25.845022] [DEBUG] [LOCAL ] NPFD: Loaded 4536 existing records from primary storage. [2025-09-14T19:18:25.955042] [INFO ] [MAIN ] NPFD: Loaded 4536 existing records. [2025-09-14T19:18:26.144609] [DEBUG] [LOCAL ] NPKI: Loaded 18137 existing records from primary storage. [2025-09-14T19:18:26.276054] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:18:26.276132] [INFO ] [MAIN ] NPKI: Loaded 18137 existing records. [2025-09-14T19:18:26.318176] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:18:26.334940] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-14T19:18:26.407352] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-14T19:18:26.504540] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-14T19:18:26.504409] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:18:26.504771] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-14T19:18:26.504821] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-14T19:18:26.515934] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-14T19:18:26.521121] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-14T19:18:26.521218] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-14T19:18:26.586369] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-14T19:18:26.597394] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-14T19:18:26.586528] [WARN ] [MAIN ] NPKI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:18:26.688851] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-14T19:18:26.669417] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-14T19:18:26.732455] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-14T19:18:26.732382] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-14T19:18:26.799853] [DEBUG] [LOCAL ] NPKI: Deleted primary data file. [2025-09-14T19:18:26.855691] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-14T19:18:27.851232] [INFO ] [REMOTE ] NPK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:27.779351] [INFO ] [REMOTE ] NPO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:27.882764] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-14T19:18:27.872268] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-14T19:18:28.115292] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:28.180190] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-14T19:18:28.184780] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:28.186058] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-14T19:18:28.637732] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T19:18:28.639480] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-14T19:18:28.901735] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:18:28.904730] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-14T19:18:28.986880] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T19:18:28.989526] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-14T19:18:29.504313] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T19:18:29.506729] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-14T19:18:29.543935] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-14T19:18:29.692488] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T19:18:29.771857] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T19:18:30.051230] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T19:18:30.158828] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-14T19:18:30.817539] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T19:18:30.958859] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-14T19:18:31.757164] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T19:18:31.760556] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-14T19:18:32.558851] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-14T19:18:32.866502] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T19:18:33.358807] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-14T19:18:33.697767] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T19:18:34.158862] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-14T19:18:34.213871] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:18:34.958921] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-14T19:18:35.580138] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T19:18:35.633844] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:18:35.758876] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-14T19:18:36.558894] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-14T19:18:36.636723] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T19:18:37.358847] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-14T19:18:37.382168] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T19:18:38.158851] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-14T19:18:38.958934] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-14T19:18:39.020053] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T19:18:39.133726] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T19:18:39.224326] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T19:18:39.228727] [INFO ] [REMOTE ] NPK: Full fetch complete (8696 records). [2025-09-14T19:18:39.228994] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-14T19:18:39.738476] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-14T19:18:39.738633] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-14T19:18:39.739064] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-14T19:18:39.739159] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-14T19:18:39.739969] [DEBUG] [LOCAL ] NPK: Trimmed 8696 records to 6405 (keeping 150 days of data) [2025-09-14T19:18:39.760129] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-14T19:18:39.795756] [DEBUG] [LOCAL ] NPK: Primary data saved (6405 records). [2025-09-14T19:18:39.796773] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-14T19:18:39.797229] [INFO ] [MAIN ] Update Progress: 1521/2370 symbols completed. NPK took 14.8s. Estimated remaining: 1h 30m 8s. Rate: 9.4 symbols/min [2025-09-14T19:18:40.002194] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:18:40.008399] [DEBUG] [LOCAL ] NPV: Loaded 2512 existing records from primary storage. [2025-09-14T19:18:40.008675] [INFO ] [MAIN ] NPV: Loaded 2512 existing records. [2025-09-14T19:18:40.208976] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:18:40.209418] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-14T19:18:40.209520] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-14T19:18:40.209931] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-14T19:18:40.210030] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-14T19:18:40.564133] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-14T19:18:40.627824] [INFO ] [REMOTE ] NPV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:41.223691] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T19:18:41.358798] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-14T19:18:41.504247] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T19:18:42.158895] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-14T19:18:42.605888] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T19:18:42.958881] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-14T19:18:43.408349] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T19:18:43.758838] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-14T19:18:44.558841] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-14T19:18:45.119796] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T19:18:45.358914] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-14T19:18:45.986775] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T19:18:46.158877] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-14T19:18:46.226975] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:18:46.606144] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T19:18:46.607789] [INFO ] [REMOTE ] NPO: Full fetch complete (14066 records). [2025-09-14T19:18:46.607958] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-14T19:18:46.960535] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-14T19:18:46.971691] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-14T19:18:46.972055] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-14T19:18:46.973881] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-14T19:18:46.973954] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-14T19:18:46.975035] [DEBUG] [LOCAL ] NPO: Trimmed 14066 records to 9549 (keeping 150 days of data) [2025-09-14T19:18:47.041485] [DEBUG] [LOCAL ] NPO: Primary data saved (9549 records). [2025-09-14T19:18:47.041670] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-14T19:18:47.041799] [INFO ] [MAIN ] Update Progress: 1522/2370 symbols completed. NPO took 22.1s. Estimated remaining: 1h 30m 2s. Rate: 9.4 symbols/min [2025-09-14T19:18:47.219705] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:18:47.244406] [DEBUG] [LOCAL ] NPWR: Loaded 19275 existing records from primary storage. [2025-09-14T19:18:47.244677] [INFO ] [MAIN ] NPWR: Loaded 19275 existing records. [2025-09-14T19:18:47.445901] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:18:47.446225] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-14T19:18:47.446295] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-14T19:18:47.447100] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-14T19:18:47.447167] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-14T19:18:47.700521] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T19:18:47.763971] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-14T19:18:47.852581] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:48.504048] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:18:48.505815] [INFO ] [REMOTE ] NPFD: Full fetch complete (10714 records). [2025-09-14T19:18:48.505903] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-14T19:18:48.568739] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-14T19:18:48.869245] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-14T19:18:48.869354] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-14T19:18:48.869731] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-14T19:18:48.869785] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-14T19:18:48.870243] [DEBUG] [LOCAL ] NPFD: Trimmed 10714 records to 7027 (keeping 150 days of data) [2025-09-14T19:18:48.914393] [DEBUG] [LOCAL ] NPFD: Primary data saved (7027 records). [2025-09-14T19:18:48.914565] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-14T19:18:48.914680] [INFO ] [MAIN ] Update Progress: 1523/2370 symbols completed. NPFD took 24.0s. Estimated remaining: 1h 29m 53s. Rate: 9.4 symbols/min [2025-09-14T19:18:49.092964] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:18:49.102181] [DEBUG] [LOCAL ] NQP: Loaded 4220 existing records from primary storage. [2025-09-14T19:18:49.102427] [INFO ] [MAIN ] NQP: Loaded 4220 existing records. [2025-09-14T19:18:49.278687] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:18:49.279074] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-14T19:18:49.279153] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-14T19:18:49.279583] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-14T19:18:49.279672] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-14T19:18:49.370691] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-14T19:18:49.640025] [INFO ] [REMOTE ] NQP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:18:49.913562] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T19:18:50.158863] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-14T19:18:50.180496] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:18:50.958841] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-14T19:18:51.758915] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-14T19:18:51.821882] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:18:51.859138] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:18:52.558843] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-14T19:18:53.358835] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-14T19:18:54.246593] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T19:18:54.248471] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-14T19:18:54.278408] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T19:18:54.958831] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-14T19:19:01.114010] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (6.16 seconds). [2025-09-14T19:19:01.123301] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-14T19:19:03.371440] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-14T19:19:03.381335] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-14T19:19:05.172423] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T19:19:05.182766] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-14T19:19:07.015096] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T19:19:07.025296] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-14T19:19:08.378284] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T19:19:08.382281] [INFO ] [REMOTE ] NPWR: Full fetch complete (45842 records). [2025-09-14T19:19:08.382408] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-14T19:19:08.757562] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-14T19:19:08.757727] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-14T19:19:08.758759] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-14T19:19:08.758841] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-14T19:19:08.760103] [DEBUG] [LOCAL ] NPWR: Trimmed 45842 records to 32423 (keeping 150 days of data) [2025-09-14T19:19:08.949354] [DEBUG] [LOCAL ] NPWR: Primary data saved (32423 records). [2025-09-14T19:19:08.949550] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-14T19:19:08.949689] [INFO ] [MAIN ] Update Progress: 1524/2370 symbols completed. NPWR took 21.9s. Estimated remaining: 1h 29m 54s. Rate: 9.4 symbols/min [2025-09-14T19:19:09.121349] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:09.136011] [DEBUG] [LOCAL ] NRDY: Loaded 13852 existing records from primary storage. [2025-09-14T19:19:09.136177] [INFO ] [MAIN ] NRDY: Loaded 13852 existing records. [2025-09-14T19:19:09.314299] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:09.314597] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-14T19:19:09.314680] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-14T19:19:09.315183] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-14T19:19:09.315247] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-14T19:19:09.670531] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:09.670925] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-14T19:19:11.136079] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T19:19:11.144190] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-14T19:19:12.587140] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T19:19:12.596165] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-14T19:19:13.991504] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T19:19:13.998829] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-14T19:19:17.434125] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-09-14T19:19:17.442375] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-14T19:19:18.851451] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T19:19:18.860382] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-14T19:19:20.345200] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T19:19:20.352712] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-14T19:19:23.181635] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-14T19:19:23.188656] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-14T19:19:24.294459] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T19:19:24.298282] [INFO ] [REMOTE ] NRDY: Full fetch complete (37092 records). [2025-09-14T19:19:24.298398] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-14T19:19:24.678371] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-14T19:19:24.678516] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-14T19:19:24.679395] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-14T19:19:24.679456] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-14T19:19:24.680715] [DEBUG] [LOCAL ] NRDY: Trimmed 37092 records to 24286 (keeping 150 days of data) [2025-09-14T19:19:24.819505] [DEBUG] [LOCAL ] NRDY: Primary data saved (24286 records). [2025-09-14T19:19:24.819700] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-14T19:19:24.819813] [INFO ] [MAIN ] Update Progress: 1525/2370 symbols completed. NRDY took 15.9s. Estimated remaining: 1h 29m 53s. Rate: 9.4 symbols/min [2025-09-14T19:19:24.997819] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:25.003271] [DEBUG] [LOCAL ] NREF: Loaded 3762 existing records from primary storage. [2025-09-14T19:19:25.003392] [INFO ] [MAIN ] NREF: Loaded 3762 existing records. [2025-09-14T19:19:25.189389] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:25.190107] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-14T19:19:25.190281] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-14T19:19:25.190560] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-14T19:19:25.190620] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-14T19:19:25.538221] [INFO ] [REMOTE ] NREF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:25.538602] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-14T19:19:26.226112] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-14T19:19:26.228430] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-14T19:19:27.007549] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T19:19:27.009978] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-14T19:19:27.771895] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T19:19:27.774322] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-14T19:19:28.407126] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T19:19:28.409005] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-14T19:19:29.228002] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T19:19:29.231013] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-14T19:19:30.244414] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T19:19:30.248311] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-14T19:19:31.000555] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T19:19:31.002722] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-14T19:19:31.709792] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:19:31.712155] [INFO ] [REMOTE ] NREF: Full fetch complete (8172 records). [2025-09-14T19:19:31.712321] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-14T19:19:31.939694] [DEBUG] [REMOTE ] NPKI: Error fetching primary data for 2025-07: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-09-14T19:19:31.990944] [WARN ] [REMOTE ] NPKI: No data returned for month 2025-07 [2025-09-14T19:19:31.965468] [DEBUG] [REMOTE ] NPV: Error fetching primary data for 2025-06: Server request status code is 520. [2025-09-14T19:19:32.014084] [WARN ] [REMOTE ] NPV: No data returned for month 2025-06 [2025-09-14T19:19:32.020317] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-14T19:19:32.047517] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-14T19:19:32.255331] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-14T19:19:32.255536] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-14T19:19:32.256118] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-14T19:19:32.256221] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-14T19:19:32.257233] [DEBUG] [LOCAL ] NREF: Trimmed 8172 records to 5581 (keeping 150 days of data) [2025-09-14T19:19:32.314758] [DEBUG] [LOCAL ] NREF: Primary data saved (5581 records). [2025-09-14T19:19:32.316543] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-14T19:19:32.316796] [INFO ] [MAIN ] Update Progress: 1526/2370 symbols completed. NREF took 7.5s. Estimated remaining: 1h 29m 47s. Rate: 9.4 symbols/min [2025-09-14T19:19:32.595142] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:32.626187] [DEBUG] [LOCAL ] NRG: Loaded 23579 existing records from primary storage. [2025-09-14T19:19:32.626504] [INFO ] [MAIN ] NRG: Loaded 23579 existing records. [2025-09-14T19:19:32.810505] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T19:19:32.868239] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-14T19:19:32.926113] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:32.928531] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-14T19:19:32.937386] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-14T19:19:32.939184] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (41.18 seconds). [2025-09-14T19:19:32.943359] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-14T19:19:32.943833] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-09-14T19:19:32.945325] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-14T19:19:33.357669] [INFO ] [REMOTE ] NRG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:33.358039] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-14T19:19:33.708172] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T19:19:33.718075] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-14T19:19:33.780685] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T19:19:33.783533] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-14T19:19:33.871309] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T19:19:33.873803] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-14T19:19:34.555733] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:19:34.557235] [INFO ] [REMOTE ] NPV: Full fetch complete (4688 records). [2025-09-14T19:19:34.557329] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-14T19:19:34.750931] [WARN ] [VALIDATOR ] NPV: Validation failed - insufficient historical data. Have 130 unique days, need 150 days [2025-09-14T19:19:34.751288] [FATAL] [MAIN ] NPV: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:19:34.751345] [WARN ] [MAIN ] NPV: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:19:34.751398] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-14T19:19:34.751501] [DEBUG] [LOCAL ] NPV: No primary data file found to delete. [2025-09-14T19:19:34.751556] [INFO ] [LOCAL ] NPV: Starting deletion of derivative data. [2025-09-14T19:19:34.751622] [DEBUG] [LOCAL ] NPV: No derivative data file found to delete. [2025-09-14T19:19:34.751745] [INFO ] [MAIN ] Update Progress: 1527/2370 symbols completed. NPV took 55.0s. Estimated remaining: 1h 29m 39s. Rate: 9.4 symbols/min [2025-09-14T19:19:34.959909] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:34.970465] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T19:19:34.974437] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-14T19:19:34.994316] [DEBUG] [LOCAL ] NRGV: Loaded 18656 existing records from primary storage. [2025-09-14T19:19:34.994565] [INFO ] [MAIN ] NRGV: Loaded 18656 existing records. [2025-09-14T19:19:35.189059] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:35.190717] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T19:19:35.195389] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-14T19:19:35.196146] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-14T19:19:35.196883] [INFO ] [REMOTE ] NPKI: Full fetch complete (37070 records). [2025-09-14T19:19:35.197117] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-14T19:19:35.197609] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-14T19:19:35.251977] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-14T19:19:35.512424] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-14T19:19:35.525859] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:19:35.537356] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:19:35.622739] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-14T19:19:35.716091] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-14T19:19:35.730056] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-14T19:19:35.731866] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-14T19:19:35.732076] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-14T19:19:35.742074] [INFO ] [MAIN ] Update Progress: 1528/2370 symbols completed. NPKI took 1m 11s. Estimated remaining: 1h 29m 29s. Rate: 9.4 symbols/min [2025-09-14T19:19:35.758906] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-14T19:19:35.866054] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:35.907901] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-14T19:19:35.934625] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T19:19:35.941073] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-14T19:19:36.015862] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:36.028944] [DEBUG] [LOCAL ] NRK: Loaded 9818 existing records from primary storage. [2025-09-14T19:19:36.029133] [INFO ] [MAIN ] NRK: Loaded 9818 existing records. [2025-09-14T19:19:36.212175] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:36.212677] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-14T19:19:36.212758] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-14T19:19:36.213197] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-14T19:19:36.213261] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-14T19:19:36.571518] [INFO ] [REMOTE ] NRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:36.579365] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-14T19:19:36.581480] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T19:19:36.584513] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-14T19:19:37.363633] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T19:19:37.371021] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-14T19:19:37.378627] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T19:19:37.381636] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-14T19:19:37.695332] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T19:19:37.700421] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-14T19:19:37.791208] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T19:19:37.802666] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-14T19:19:37.980996] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T19:19:37.983775] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-14T19:19:38.308424] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T19:19:38.312846] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-14T19:19:38.767071] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T19:19:38.768700] [INFO ] [REMOTE ] NQP: Full fetch complete (9801 records). [2025-09-14T19:19:38.768800] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-14T19:19:39.132259] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-14T19:19:39.132391] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-14T19:19:39.132744] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-14T19:19:39.132820] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-14T19:19:39.133336] [DEBUG] [LOCAL ] NQP: Trimmed 9801 records to 6844 (keeping 150 days of data) [2025-09-14T19:19:39.175982] [DEBUG] [LOCAL ] NQP: Primary data saved (6844 records). [2025-09-14T19:19:39.176181] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-14T19:19:39.176304] [INFO ] [MAIN ] Update Progress: 1529/2370 symbols completed. NQP took 50.3s. Estimated remaining: 1h 29m 21s. Rate: 9.4 symbols/min [2025-09-14T19:19:39.347925] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:39.352033] [DEBUG] [LOCAL ] NRP: Loaded 1705 existing records from primary storage. [2025-09-14T19:19:39.352153] [INFO ] [MAIN ] NRP: Loaded 1705 existing records. [2025-09-14T19:19:39.530340] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:39.541733] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-14T19:19:39.543062] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T19:19:39.542584] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-14T19:19:39.548129] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-14T19:19:39.549227] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-14T19:19:39.549452] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-14T19:19:39.918403] [INFO ] [REMOTE ] NRP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:39.935948] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-14T19:19:39.955459] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T19:19:39.967252] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-14T19:19:40.582585] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-09-14T19:19:40.591905] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-14T19:19:40.626084] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-14T19:19:40.627743] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-14T19:19:40.687897] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T19:19:40.692422] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-14T19:19:41.275359] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T19:19:41.277141] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-14T19:19:41.624188] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T19:19:41.628320] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-14T19:19:41.718524] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-14T19:19:41.720573] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-14T19:19:42.308138] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T19:19:42.318379] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-14T19:19:42.398166] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T19:19:42.399850] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-14T19:19:42.798564] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T19:19:42.803974] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-14T19:19:44.226343] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (4.26 seconds). [2025-09-14T19:19:44.237729] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-14T19:19:44.386719] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T19:19:44.388618] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-14T19:19:46.057944] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T19:19:46.070338] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-14T19:19:46.435060] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (4.12 seconds). [2025-09-14T19:19:46.444255] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-14T19:19:47.698163] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (4.89 seconds). [2025-09-14T19:19:47.705055] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-14T19:19:47.916094] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (3.53 seconds). [2025-09-14T19:19:47.918228] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-14T19:19:48.162945] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T19:19:48.172222] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-14T19:19:48.323745] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-14T19:19:48.325091] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-14T19:19:48.745935] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T19:19:48.749392] [INFO ] [REMOTE ] NRK: Full fetch complete (20497 records). [2025-09-14T19:19:48.749606] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-14T19:19:49.148449] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-14T19:19:49.148675] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-14T19:19:49.149342] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-14T19:19:49.149424] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-14T19:19:49.150627] [DEBUG] [LOCAL ] NRK: Trimmed 20497 records to 15230 (keeping 150 days of data) [2025-09-14T19:19:49.256561] [DEBUG] [LOCAL ] NRK: Primary data saved (15230 records). [2025-09-14T19:19:49.256859] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-14T19:19:49.257053] [INFO ] [MAIN ] Update Progress: 1530/2370 symbols completed. NRK took 13.5s. Estimated remaining: 1h 29m 17s. Rate: 9.4 symbols/min [2025-09-14T19:19:49.435187] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:49.462828] [DEBUG] [LOCAL ] NRT: Loaded 2284 existing records from primary storage. [2025-09-14T19:19:49.464152] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T19:19:49.464502] [INFO ] [MAIN ] NRT: Loaded 2284 existing records. [2025-09-14T19:19:49.550437] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-14T19:19:49.656549] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:49.656837] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-14T19:19:49.656982] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-14T19:19:49.657317] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-14T19:19:49.657380] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-14T19:19:50.017035] [INFO ] [REMOTE ] NRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:50.017485] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-14T19:19:50.655317] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (4.58 seconds). [2025-09-14T19:19:50.669680] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-14T19:19:50.670580] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-14T19:19:50.672349] [INFO ] [REMOTE ] NRP: Full fetch complete (4560 records). [2025-09-14T19:19:50.672631] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-14T19:19:50.789576] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T19:19:50.802463] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-14T19:19:51.074600] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-14T19:19:51.074862] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-14T19:19:51.075089] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-14T19:19:51.075164] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-14T19:19:51.075911] [DEBUG] [LOCAL ] NRP: Trimmed 4560 records to 2786 (keeping 150 days of data) [2025-09-14T19:19:51.120825] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T19:19:51.122178] [DEBUG] [LOCAL ] NRP: Primary data saved (2786 records). [2025-09-14T19:19:51.131483] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-14T19:19:51.131999] [INFO ] [MAIN ] Update Progress: 1531/2370 symbols completed. NRP took 12.0s. Estimated remaining: 1h 29m 8s. Rate: 9.4 symbols/min [2025-09-14T19:19:51.165896] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-14T19:19:51.316921] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:51.320602] [DEBUG] [LOCAL ] NRUC: Loaded 1226 existing records from primary storage. [2025-09-14T19:19:51.320726] [INFO ] [MAIN ] NRUC: Loaded 1226 existing records. [2025-09-14T19:19:51.498333] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:51.498684] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-14T19:19:51.498795] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-14T19:19:51.499059] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-14T19:19:51.499121] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-14T19:19:51.775448] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T19:19:51.803131] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-14T19:19:51.887289] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:51.887738] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-14T19:19:52.549405] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T19:19:52.551197] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-14T19:19:52.689492] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T19:19:52.691555] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-14T19:19:52.723744] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-14T19:19:52.735767] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-14T19:19:52.812708] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-14T19:19:52.817750] [INFO ] [REMOTE ] NRGV: Full fetch complete (45513 records). [2025-09-14T19:19:52.817882] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-14T19:19:53.206512] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-14T19:19:53.206780] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-14T19:19:53.208221] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-14T19:19:53.208506] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-14T19:19:53.214850] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T19:19:53.220562] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-14T19:19:53.223227] [DEBUG] [LOCAL ] NRGV: Trimmed 45513 records to 31505 (keeping 150 days of data) [2025-09-14T19:19:53.224477] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T19:19:53.227223] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-14T19:19:53.431179] [DEBUG] [LOCAL ] NRGV: Primary data saved (31505 records). [2025-09-14T19:19:53.431379] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-14T19:19:53.431507] [INFO ] [MAIN ] Update Progress: 1532/2370 symbols completed. NRGV took 18.7s. Estimated remaining: 1h 28m 60s. Rate: 9.4 symbols/min [2025-09-14T19:19:53.607106] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:53.622782] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:19:53.628795] [INFO ] [REMOTE ] NRG: Full fetch complete (57603 records). [2025-09-14T19:19:53.629006] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-14T19:19:53.835127] [DEBUG] [LOCAL ] NSA: Loaded 20603 existing records from primary storage. [2025-09-14T19:19:53.882136] [INFO ] [MAIN ] NSA: Loaded 20603 existing records. [2025-09-14T19:19:54.010107] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T19:19:54.054791] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-14T19:19:54.201554] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:19:54.300539] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-09-14T19:19:54.301317] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:54.301902] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-14T19:19:54.301960] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-09-14T19:19:54.302239] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-14T19:19:54.302422] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-14T19:19:54.304629] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-09-14T19:19:54.305238] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-09-14T19:19:54.305738] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-14T19:19:54.305846] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-14T19:19:54.416481] [DEBUG] [LOCAL ] NRG: Trimmed 57603 records to 39817 (keeping 150 days of data) [2025-09-14T19:19:54.812226] [INFO ] [REMOTE ] NSA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:54.915966] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T19:19:54.958987] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-14T19:19:54.969856] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T19:19:55.000284] [DEBUG] [LOCAL ] NRG: Primary data saved (39817 records). [2025-09-14T19:19:55.000547] [INFO ] [MAIN ] NRG: Full history saved. [2025-09-14T19:19:55.000767] [INFO ] [MAIN ] Update Progress: 1533/2370 symbols completed. NRG took 22.7s. Estimated remaining: 1h 28m 51s. Rate: 9.4 symbols/min [2025-09-14T19:19:55.182252] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:19:55.204248] [DEBUG] [LOCAL ] NSC: Loaded 22217 existing records from primary storage. [2025-09-14T19:19:55.204444] [INFO ] [MAIN ] NSC: Loaded 22217 existing records. [2025-09-14T19:19:55.382888] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:19:55.383165] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-14T19:19:55.383233] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-14T19:19:55.384454] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-09-14T19:19:55.384530] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-14T19:19:55.748601] [INFO ] [REMOTE ] NSC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:19:55.758833] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-14T19:19:56.282475] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T19:19:56.558834] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-14T19:19:56.610621] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T19:19:57.358870] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-14T19:19:57.918995] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-14T19:19:58.158887] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-14T19:19:58.958873] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-14T19:19:59.489555] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T19:19:59.727745] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T19:19:59.758783] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-14T19:20:00.189079] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (3.63 seconds). [2025-09-14T19:20:00.558901] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-14T19:20:01.358905] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-14T19:20:01.468356] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T19:20:01.469545] [INFO ] [REMOTE ] NRT: Full fetch complete (5429 records). [2025-09-14T19:20:01.469668] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-14T19:20:01.893054] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-14T19:20:01.915829] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-14T19:20:01.916489] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-14T19:20:01.917018] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-14T19:20:01.917918] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-14T19:20:01.928299] [DEBUG] [LOCAL ] NRT: Trimmed 5429 records to 3685 (keeping 150 days of data) [2025-09-14T19:20:01.953796] [DEBUG] [LOCAL ] NRT: Primary data saved (3685 records). [2025-09-14T19:20:01.954031] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-14T19:20:01.954177] [INFO ] [MAIN ] Update Progress: 1534/2370 symbols completed. NRT took 12.7s. Estimated remaining: 1h 28m 45s. Rate: 9.4 symbols/min [2025-09-14T19:20:02.154258] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:02.158816] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-14T19:20:02.171843] [DEBUG] [LOCAL ] NSP: Loaded 15988 existing records from primary storage. [2025-09-14T19:20:02.172017] [INFO ] [MAIN ] NSP: Loaded 15988 existing records. [2025-09-14T19:20:02.353420] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T19:20:02.357708] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:02.359793] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-14T19:20:02.359881] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-14T19:20:02.360319] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-14T19:20:02.360379] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-14T19:20:02.720923] [INFO ] [REMOTE ] NSP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:02.958880] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-14T19:20:03.758876] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-14T19:20:04.445296] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-14T19:20:04.558833] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-14T19:20:04.934430] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T19:20:05.002898] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T19:20:05.221519] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:20:05.222880] [INFO ] [REMOTE ] NRUC: Full fetch complete (3749 records). [2025-09-14T19:20:05.222986] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-14T19:20:05.371827] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-14T19:20:05.591202] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-14T19:20:05.591320] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-14T19:20:05.591505] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-14T19:20:05.591567] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-14T19:20:05.591995] [DEBUG] [LOCAL ] NRUC: Trimmed 3749 records to 2274 (keeping 150 days of data) [2025-09-14T19:20:05.608485] [DEBUG] [LOCAL ] NRUC: Primary data saved (2274 records). [2025-09-14T19:20:05.608716] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-14T19:20:05.608889] [INFO ] [MAIN ] Update Progress: 1535/2370 symbols completed. NRUC took 14.5s. Estimated remaining: 1h 28m 37s. Rate: 9.4 symbols/min [2025-09-14T19:20:05.777715] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:05.788466] [DEBUG] [LOCAL ] NTB: Loaded 8669 existing records from primary storage. [2025-09-14T19:20:05.788634] [INFO ] [MAIN ] NTB: Loaded 8669 existing records. [2025-09-14T19:20:05.964878] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:05.965153] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-14T19:20:05.965212] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-14T19:20:05.965703] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-14T19:20:05.965771] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-14T19:20:06.166801] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-14T19:20:06.324279] [INFO ] [REMOTE ] NTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:06.958895] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-14T19:20:07.647190] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-14T19:20:07.758890] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-14T19:20:07.898930] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T19:20:08.097120] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T19:20:08.558869] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-14T19:20:08.993964] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T19:20:09.358861] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-14T19:20:10.158848] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-14T19:20:10.824949] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T19:20:10.958820] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-14T19:20:11.758861] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-14T19:20:12.040790] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (3.48 seconds). [2025-09-14T19:20:12.073053] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T19:20:12.108668] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T19:20:12.558867] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-14T19:20:13.358874] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-14T19:20:14.158832] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-14T19:20:15.539813] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T19:20:15.545421] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-14T19:20:15.898045] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (4.14 seconds). [2025-09-14T19:20:15.907815] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-14T19:20:17.581492] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:20:17.597048] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-14T19:20:17.622596] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (5.06 seconds). [2025-09-14T19:20:17.630267] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-14T19:20:18.314070] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:20:18.320703] [INFO ] [REMOTE ] NSA: Full fetch complete (47754 records). [2025-09-14T19:20:18.320883] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-14T19:20:18.711321] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-14T19:20:18.711492] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-14T19:20:18.712481] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-14T19:20:18.712567] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-14T19:20:18.713939] [DEBUG] [LOCAL ] NSA: Trimmed 47754 records to 33958 (keeping 150 days of data) [2025-09-14T19:20:18.938824] [DEBUG] [LOCAL ] NSA: Primary data saved (33958 records). [2025-09-14T19:20:18.939069] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-14T19:20:18.939275] [INFO ] [MAIN ] Update Progress: 1536/2370 symbols completed. NSA took 25.5s. Estimated remaining: 1h 28m 34s. Rate: 9.4 symbols/min [2025-09-14T19:20:19.116760] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:19.119964] [DEBUG] [LOCAL ] NTEST: Loaded 426 existing records from primary storage. [2025-09-14T19:20:19.120066] [INFO ] [MAIN ] NTEST: Loaded 426 existing records. [2025-09-14T19:20:19.318730] [WARN ] [MAIN ] NTEST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:19.318995] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-14T19:20:19.319059] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-14T19:20:19.319365] [DEBUG] [LOCAL ] NTEST: Deleted primary data file. [2025-09-14T19:20:19.319435] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-14T19:20:19.710622] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:19.711094] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-14T19:20:21.778740] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (8.42 seconds). [2025-09-14T19:20:21.789964] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-14T19:20:23.890675] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (8.35 seconds). [2025-09-14T19:20:23.895877] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-14T19:20:24.987601] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T19:20:24.994189] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-14T19:20:26.025595] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T19:20:26.030387] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-14T19:20:27.141547] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (9.51 seconds). [2025-09-14T19:20:27.151515] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-14T19:20:27.175325] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (7.46 seconds). [2025-09-14T19:20:27.177032] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-14T19:20:27.684025] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T19:20:27.684928] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-14T19:20:28.155471] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-14T19:20:28.156452] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-14T19:20:30.733250] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (8.94 seconds). [2025-09-14T19:20:30.744263] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-14T19:20:31.908093] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (5.88 seconds). [2025-09-14T19:20:31.916041] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-14T19:20:32.580019] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T19:20:32.592957] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-14T19:20:32.801089] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:20:32.803298] [INFO ] [REMOTE ] NTB: Full fetch complete (22944 records). [2025-09-14T19:20:32.803398] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-14T19:20:33.177795] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-14T19:20:33.177937] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-14T19:20:33.178535] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-14T19:20:33.178590] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-14T19:20:33.179300] [DEBUG] [LOCAL ] NTB: Trimmed 22944 records to 14874 (keeping 150 days of data) [2025-09-14T19:20:33.276174] [DEBUG] [LOCAL ] NTB: Primary data saved (14874 records). [2025-09-14T19:20:33.276379] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-14T19:20:33.276613] [INFO ] [MAIN ] Update Progress: 1537/2370 symbols completed. NTB took 27.7s. Estimated remaining: 1h 28m 32s. Rate: 9.4 symbols/min [2025-09-14T19:20:33.367051] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:20:33.409739] [INFO ] [REMOTE ] NSC: Full fetch complete (53508 records). [2025-09-14T19:20:33.425428] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-14T19:20:33.502677] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:33.748155] [DEBUG] [LOCAL ] NTR: Loaded 23509 existing records from primary storage. [2025-09-14T19:20:33.792959] [INFO ] [MAIN ] NTR: Loaded 23509 existing records. [2025-09-14T19:20:33.969579] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (6.82 seconds). [2025-09-14T19:20:34.001033] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-09-14T19:20:34.032324] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-09-14T19:20:34.033615] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-09-14T19:20:34.050451] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-09-14T19:20:34.096525] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-14T19:20:34.120738] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:34.127838] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (5.97 seconds). [2025-09-14T19:20:34.128117] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-14T19:20:34.129937] [DEBUG] [LOCAL ] NSC: Trimmed 53508 records to 36869 (keeping 150 days of data) [2025-09-14T19:20:34.130674] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-14T19:20:34.130526] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-14T19:20:34.132100] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-14T19:20:34.132247] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-14T19:20:34.642678] [INFO ] [REMOTE ] NTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:34.647917] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-14T19:20:34.775813] [DEBUG] [LOCAL ] NSC: Primary data saved (36869 records). [2025-09-14T19:20:34.776005] [INFO ] [MAIN ] NSC: Full history saved. [2025-09-14T19:20:34.776158] [INFO ] [MAIN ] Update Progress: 1538/2370 symbols completed. NSC took 39.8s. Estimated remaining: 1h 28m 23s. Rate: 9.4 symbols/min [2025-09-14T19:20:34.961941] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:34.960345] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T19:20:34.970909] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-14T19:20:34.974215] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T19:20:34.978938] [INFO ] [REMOTE ] NSP: Full fetch complete (37958 records). [2025-09-14T19:20:34.979092] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-14T19:20:35.150694] [DEBUG] [LOCAL ] NTST: Loaded 20117 existing records from primary storage. [2025-09-14T19:20:35.171028] [INFO ] [MAIN ] NTST: Loaded 20117 existing records. [2025-09-14T19:20:35.515846] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:35.545832] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-14T19:20:35.545964] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-14T19:20:35.545882] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-14T19:20:35.546879] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-14T19:20:35.546808] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-14T19:20:35.546994] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-14T19:20:35.547602] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-14T19:20:35.547748] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-14T19:20:35.569676] [DEBUG] [LOCAL ] NSP: Trimmed 37958 records to 26649 (keeping 150 days of data) [2025-09-14T19:20:35.803150] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T19:20:35.831195] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-14T19:20:36.030939] [INFO ] [REMOTE ] NTST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:36.031919] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-14T19:20:36.125148] [DEBUG] [LOCAL ] NSP: Primary data saved (26649 records). [2025-09-14T19:20:36.125340] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-14T19:20:36.125549] [INFO ] [MAIN ] Update Progress: 1539/2370 symbols completed. NSP took 34.2s. Estimated remaining: 1h 28m 14s. Rate: 9.4 symbols/min [2025-09-14T19:20:36.299321] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:36.327822] [DEBUG] [LOCAL ] NU: Loaded 24157 existing records from primary storage. [2025-09-14T19:20:36.328021] [INFO ] [MAIN ] NU: Loaded 24157 existing records. [2025-09-14T19:20:36.476009] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T19:20:36.512009] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-14T19:20:36.515669] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:36.516955] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-14T19:20:36.517021] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-14T19:20:36.517751] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-14T19:20:36.517819] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-14T19:20:36.823287] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T19:20:36.856281] [INFO ] [REMOTE ] NTEST: Full fetch complete (1668 records). [2025-09-14T19:20:36.876346] [INFO ] [REMOTE ] NU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:36.876564] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-14T19:20:36.882827] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-14T19:20:37.082388] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 133 unique days, need 150 days [2025-09-14T19:20:37.082762] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:20:37.082843] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:20:37.082997] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-14T19:20:37.083116] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-14T19:20:37.083228] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-14T19:20:37.083311] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-14T19:20:37.083436] [INFO ] [MAIN ] Update Progress: 1540/2370 symbols completed. NTEST took 18.1s. Estimated remaining: 1h 28m 5s. Rate: 9.4 symbols/min [2025-09-14T19:20:37.253778] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:37.281097] [DEBUG] [LOCAL ] NUE: Loaded 22653 existing records from primary storage. [2025-09-14T19:20:37.281279] [INFO ] [MAIN ] NUE: Loaded 22653 existing records. [2025-09-14T19:20:37.456349] [WARN ] [MAIN ] NUE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:37.456630] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-14T19:20:37.456710] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-14T19:20:37.457488] [DEBUG] [LOCAL ] NUE: Deleted primary data file. [2025-09-14T19:20:37.457569] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-14T19:20:37.846621] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T19:20:37.844469] [INFO ] [REMOTE ] NUE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:37.854344] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-14T19:20:37.854705] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-14T19:20:37.887594] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T19:20:37.897820] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-14T19:20:37.998503] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (3.35 seconds). [2025-09-14T19:20:38.008561] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-14T19:20:38.815202] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T19:20:38.826612] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-14T19:20:39.500666] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T19:20:39.509541] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-14T19:20:39.793424] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T19:20:39.804817] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-14T19:20:39.891387] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T19:20:39.903191] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-14T19:20:39.936572] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-14T19:20:40.558910] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-14T19:20:41.092219] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T19:20:41.347437] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T19:20:41.359081] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-14T19:20:42.158880] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-14T19:20:42.262780] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-14T19:20:42.689179] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T19:20:42.958877] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-14T19:20:43.320440] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T19:20:43.564617] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T19:20:43.740424] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T19:20:43.758836] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-14T19:20:44.558899] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-14T19:20:45.358844] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-14T19:20:45.594686] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T19:20:46.158870] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-14T19:20:46.588078] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T19:20:46.958837] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-14T19:20:47.758834] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-14T19:20:47.984051] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T19:20:48.035020] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-14T19:20:48.273745] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T19:20:48.558883] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-14T19:20:49.020313] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T19:20:49.358891] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-14T19:20:50.158859] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-14T19:20:50.311260] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T19:20:50.958841] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-14T19:20:51.059987] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T19:20:51.109059] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T19:20:51.758872] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-14T19:20:52.558835] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-14T19:20:52.725029] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T19:20:53.358829] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-14T19:20:53.855867] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T19:20:53.881318] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T19:20:53.887093] [INFO ] [REMOTE ] NU: Full fetch complete (58426 records). [2025-09-14T19:20:53.887243] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-14T19:20:54.168150] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-14T19:20:54.270974] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-14T19:20:54.271092] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-14T19:20:54.272183] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-14T19:20:54.272244] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-14T19:20:54.273566] [DEBUG] [LOCAL ] NU: Trimmed 58426 records to 40486 (keeping 150 days of data) [2025-09-14T19:20:54.539967] [DEBUG] [LOCAL ] NU: Primary data saved (40486 records). [2025-09-14T19:20:54.540136] [INFO ] [MAIN ] NU: Full history saved. [2025-09-14T19:20:54.540233] [INFO ] [MAIN ] Update Progress: 1541/2370 symbols completed. NU took 18.4s. Estimated remaining: 1h 28m 4s. Rate: 9.4 symbols/min [2025-09-14T19:20:54.710884] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:54.727603] [DEBUG] [LOCAL ] NUS: Loaded 15933 existing records from primary storage. [2025-09-14T19:20:54.727811] [INFO ] [MAIN ] NUS: Loaded 15933 existing records. [2025-09-14T19:20:54.903080] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:54.903331] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-14T19:20:54.903388] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-14T19:20:54.903982] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-14T19:20:54.904045] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-14T19:20:54.966262] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-14T19:20:55.274719] [INFO ] [REMOTE ] NUS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:55.308401] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T19:20:55.758808] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-14T19:20:56.129123] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T19:20:56.431531] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T19:20:56.436468] [INFO ] [REMOTE ] NTST: Full fetch complete (46398 records). [2025-09-14T19:20:56.436607] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-14T19:20:56.563909] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-14T19:20:56.820315] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-14T19:20:56.820445] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-14T19:20:56.821661] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-14T19:20:56.821740] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-14T19:20:56.822960] [DEBUG] [LOCAL ] NTST: Trimmed 46398 records to 32619 (keeping 150 days of data) [2025-09-14T19:20:57.035405] [DEBUG] [LOCAL ] NTST: Primary data saved (32619 records). [2025-09-14T19:20:57.035604] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-14T19:20:57.035759] [INFO ] [MAIN ] Update Progress: 1542/2370 symbols completed. NTST took 22.3s. Estimated remaining: 1h 27m 56s. Rate: 9.4 symbols/min [2025-09-14T19:20:57.213683] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:57.225322] [DEBUG] [LOCAL ] NUV: Loaded 10065 existing records from primary storage. [2025-09-14T19:20:57.225517] [INFO ] [MAIN ] NUV: Loaded 10065 existing records. [2025-09-14T19:20:57.371629] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-14T19:20:57.411532] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:57.411758] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-14T19:20:57.411814] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-14T19:20:57.412257] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-14T19:20:57.412461] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-14T19:20:57.542749] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T19:20:57.637558] [INFO ] [REMOTE ] NUE: Full fetch complete (55971 records). [2025-09-14T19:20:57.665751] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-14T19:20:57.921081] [INFO ] [REMOTE ] NUV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:58.047615] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:20:58.050272] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-14T19:20:58.051033] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:20:58.062760] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:20:58.062870] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-14T19:20:58.062985] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-14T19:20:58.063054] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-14T19:20:58.063138] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-14T19:20:58.063260] [INFO ] [MAIN ] Update Progress: 1543/2370 symbols completed. NUE took 21.0s. Estimated remaining: 1h 27m 47s. Rate: 9.4 symbols/min [2025-09-14T19:20:58.164336] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-14T19:20:58.242267] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:58.266934] [DEBUG] [LOCAL ] NUVB: Loaded 23568 existing records from primary storage. [2025-09-14T19:20:58.267150] [INFO ] [MAIN ] NUVB: Loaded 23568 existing records. [2025-09-14T19:20:58.459078] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:20:58.459356] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-14T19:20:58.459416] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-14T19:20:58.460043] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-14T19:20:58.460105] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-14T19:20:58.820778] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:20:58.958884] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-14T19:20:59.066350] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-14T19:20:59.071852] [INFO ] [REMOTE ] NTR: Full fetch complete (57262 records). [2025-09-14T19:20:59.072009] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-14T19:20:59.466867] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-14T19:20:59.466978] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-14T19:20:59.467957] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-14T19:20:59.468018] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-14T19:20:59.469213] [DEBUG] [LOCAL ] NTR: Trimmed 57262 records to 39519 (keeping 150 days of data) [2025-09-14T19:20:59.734745] [DEBUG] [LOCAL ] NTR: Primary data saved (39519 records). [2025-09-14T19:20:59.734935] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-14T19:20:59.735078] [INFO ] [MAIN ] Update Progress: 1544/2370 symbols completed. NTR took 26.5s. Estimated remaining: 1h 27m 38s. Rate: 9.4 symbols/min [2025-09-14T19:20:59.768631] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-14T19:20:59.918139] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:20:59.923982] [DEBUG] [LOCAL ] NUW: Loaded 2539 existing records from primary storage. [2025-09-14T19:20:59.924133] [INFO ] [MAIN ] NUW: Loaded 2539 existing records. [2025-09-14T19:21:00.107067] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:21:00.107339] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-14T19:21:00.107403] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-14T19:21:00.107745] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-14T19:21:00.107810] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-14T19:21:00.491003] [INFO ] [REMOTE ] NUW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:21:00.520075] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:21:00.559592] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-14T19:21:00.563438] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-14T19:21:01.358897] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-14T19:21:01.378537] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T19:21:01.837054] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T19:21:02.158891] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-14T19:21:02.958851] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-14T19:21:03.758884] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-14T19:21:04.479770] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T19:21:04.558825] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-14T19:21:05.203419] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-14T19:21:05.358845] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-14T19:21:05.409084] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T19:21:05.890417] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (4.53 seconds). [2025-09-14T19:21:06.158832] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-14T19:21:06.508506] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-14T19:21:06.958876] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-14T19:21:06.985699] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T19:21:07.118045] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T19:21:07.758834] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-14T19:21:08.548449] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T19:21:08.558764] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-14T19:21:09.289923] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T19:21:09.358836] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-14T19:21:09.584591] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-14T19:21:10.158894] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-14T19:21:10.865528] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T19:21:10.958804] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-14T19:21:11.241433] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T19:21:11.758900] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-14T19:21:12.558856] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-14T19:21:12.782829] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T19:21:13.178525] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T19:21:13.179748] [INFO ] [REMOTE ] NUW: Full fetch complete (8114 records). [2025-09-14T19:21:13.179833] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-14T19:21:13.361689] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-14T19:21:13.558608] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-14T19:21:13.558747] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-14T19:21:13.559016] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-14T19:21:13.559098] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-14T19:21:13.559672] [DEBUG] [LOCAL ] NUW: Trimmed 8114 records to 5128 (keeping 150 days of data) [2025-09-14T19:21:13.592715] [DEBUG] [LOCAL ] NUW: Primary data saved (5128 records). [2025-09-14T19:21:13.592919] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-14T19:21:13.593056] [INFO ] [MAIN ] Update Progress: 1545/2370 symbols completed. NUW took 13.9s. Estimated remaining: 1h 27m 35s. Rate: 9.4 symbols/min [2025-09-14T19:21:13.766098] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:21:13.813299] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-14T19:21:13.818340] [DEBUG] [LOCAL ] NVG: Loaded 12375 existing records from primary storage. [2025-09-14T19:21:13.818779] [INFO ] [MAIN ] NVG: Loaded 12375 existing records. [2025-09-14T19:21:14.007481] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:21:14.007770] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-14T19:21:14.007834] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-14T19:21:14.008302] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-14T19:21:14.008366] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-14T19:21:14.164996] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-14T19:21:14.372666] [INFO ] [REMOTE ] NVG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:21:14.958892] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-14T19:21:15.026273] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T19:21:15.481143] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T19:21:15.758864] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-14T19:21:16.165511] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T19:21:16.558893] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-14T19:21:17.342523] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:21:17.358788] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-14T19:21:18.158857] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-14T19:21:18.499754] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T19:21:18.534967] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:21:18.958860] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-14T19:21:19.540338] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T19:21:19.660448] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:21:19.665900] [INFO ] [REMOTE ] NUS: Full fetch complete (40494 records). [2025-09-14T19:21:19.666064] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-14T19:21:19.763985] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-14T19:21:20.074061] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-14T19:21:20.074307] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-14T19:21:20.075219] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-14T19:21:20.075302] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-14T19:21:20.076348] [DEBUG] [LOCAL ] NUS: Trimmed 40494 records to 27086 (keeping 150 days of data) [2025-09-14T19:21:20.250507] [DEBUG] [LOCAL ] NUS: Primary data saved (27086 records). [2025-09-14T19:21:20.250714] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-14T19:21:20.250853] [INFO ] [MAIN ] Update Progress: 1546/2370 symbols completed. NUS took 25.7s. Estimated remaining: 1h 27m 29s. Rate: 9.4 symbols/min [2025-09-14T19:21:20.419777] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:21:20.435406] [DEBUG] [LOCAL ] NVGS: Loaded 14468 existing records from primary storage. [2025-09-14T19:21:20.435599] [INFO ] [MAIN ] NVGS: Loaded 14468 existing records. [2025-09-14T19:21:20.563926] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-14T19:21:20.624337] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:21:20.624764] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-14T19:21:20.624848] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-14T19:21:20.625454] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-14T19:21:20.625547] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-14T19:21:21.006051] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:21:21.124503] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T19:21:21.358846] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-14T19:21:21.596020] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T19:21:22.158867] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-14T19:21:22.449129] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:21:22.958893] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-14T19:21:23.223322] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T19:21:23.758883] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-14T19:21:24.558842] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-14T19:21:24.710420] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T19:21:25.358843] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-14T19:21:26.158882] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-14T19:21:26.411278] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-14T19:21:26.413905] [INFO ] [REMOTE ] NUV: Full fetch complete (24936 records). [2025-09-14T19:21:26.414009] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-14T19:21:26.790498] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-14T19:21:26.790611] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-14T19:21:26.791223] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-14T19:21:26.791283] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-14T19:21:26.792109] [DEBUG] [LOCAL ] NUV: Trimmed 24936 records to 16682 (keeping 150 days of data) [2025-09-14T19:21:26.896663] [DEBUG] [LOCAL ] NUV: Primary data saved (16682 records). [2025-09-14T19:21:26.896876] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-14T19:21:26.896989] [INFO ] [MAIN ] Update Progress: 1547/2370 symbols completed. NUV took 29.9s. Estimated remaining: 1h 27m 23s. Rate: 9.4 symbols/min [2025-09-14T19:21:27.067548] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:21:27.092142] [DEBUG] [LOCAL ] NVO: Loaded 24144 existing records from primary storage. [2025-09-14T19:21:27.107055] [INFO ] [MAIN ] NVO: Loaded 24144 existing records. [2025-09-14T19:21:27.157247] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T19:21:27.222852] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-14T19:21:27.302709] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:21:27.302973] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-14T19:21:27.303037] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-14T19:21:27.303772] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-14T19:21:27.303833] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-14T19:21:27.658437] [INFO ] [REMOTE ] NVO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:21:27.758836] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-14T19:21:29.427930] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (5.67 seconds). [2025-09-14T19:21:29.439819] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-14T19:21:30.474701] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-14T19:21:30.484945] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-14T19:21:30.658087] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (4.50 seconds). [2025-09-14T19:21:30.663744] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-14T19:21:31.231686] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T19:21:31.242993] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-14T19:21:31.869517] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T19:21:31.875248] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-14T19:21:32.491946] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (5.27 seconds). [2025-09-14T19:21:32.558777] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-14T19:21:33.018523] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-14T19:21:33.045974] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T19:21:33.064725] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-14T19:21:33.070257] [INFO ] [REMOTE ] NUVB: Full fetch complete (54942 records). [2025-09-14T19:21:33.070384] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-14T19:21:33.360301] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-14T19:21:33.451720] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-14T19:21:33.451829] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-14T19:21:33.452833] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-14T19:21:33.452916] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-14T19:21:33.454135] [DEBUG] [LOCAL ] NUVB: Trimmed 54942 records to 38758 (keeping 150 days of data) [2025-09-14T19:21:33.695176] [DEBUG] [LOCAL ] NUVB: Primary data saved (38758 records). [2025-09-14T19:21:33.695381] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-14T19:21:33.695531] [INFO ] [MAIN ] Update Progress: 1548/2370 symbols completed. NUVB took 35.6s. Estimated remaining: 1h 27m 17s. Rate: 9.4 symbols/min [2025-09-14T19:21:33.866591] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:21:33.891164] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T19:21:33.901948] [DEBUG] [LOCAL ] NVR: Loaded 7794 existing records from primary storage. [2025-09-14T19:21:33.902307] [INFO ] [MAIN ] NVR: Loaded 7794 existing records. [2025-09-14T19:21:34.081327] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:21:34.081610] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-14T19:21:34.081685] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-14T19:21:34.082080] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-14T19:21:34.082141] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-14T19:21:34.163910] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-14T19:21:34.443179] [INFO ] [REMOTE ] NVR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:21:34.958844] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-14T19:21:35.758850] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-14T19:21:36.002156] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-14T19:21:36.485835] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T19:21:36.542146] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T19:21:36.558816] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-14T19:21:36.661590] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-14T19:21:37.358847] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-14T19:21:37.942806] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T19:21:38.158875] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-14T19:21:38.958913] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-14T19:21:39.758827] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-14T19:21:39.897528] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-14T19:21:39.940382] [INFO ] [REMOTE ] NVGS: Full fetch complete (33507 records). [2025-09-14T19:21:39.941807] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-14T19:21:39.943949] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-14T19:21:40.005965] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T19:21:40.094115] [INFO ] [REMOTE ] NVG: Full fetch complete (29426 records). [2025-09-14T19:21:40.106278] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-14T19:21:40.582398] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-14T19:21:40.673504] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-14T19:21:40.709593] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-14T19:21:40.714426] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-14T19:21:40.720238] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-14T19:21:40.801565] [DEBUG] [LOCAL ] NVGS: Trimmed 33507 records to 23625 (keeping 150 days of data) [2025-09-14T19:21:40.803412] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-14T19:21:40.804103] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-14T19:21:40.804505] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-14T19:21:40.804569] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-14T19:21:40.805719] [DEBUG] [LOCAL ] NVG: Trimmed 29426 records to 20268 (keeping 150 days of data) [2025-09-14T19:21:41.033028] [DEBUG] [LOCAL ] NVG: Primary data saved (20268 records). [2025-09-14T19:21:41.037067] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-14T19:21:41.037190] [INFO ] [MAIN ] Update Progress: 1549/2370 symbols completed. NVG took 27.4s. Estimated remaining: 1h 27m 11s. Rate: 9.4 symbols/min [2025-09-14T19:21:41.219451] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:21:41.249955] [DEBUG] [LOCAL ] NVRI: Loaded 17240 existing records from primary storage. [2025-09-14T19:21:41.254522] [INFO ] [MAIN ] NVRI: Loaded 17240 existing records. [2025-09-14T19:21:41.469716] [DEBUG] [LOCAL ] NVGS: Primary data saved (23625 records). [2025-09-14T19:21:41.469629] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:21:41.469893] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-14T19:21:41.470120] [INFO ] [MAIN ] Update Progress: 1550/2370 symbols completed. NVGS took 21.2s. Estimated remaining: 1h 27m 1s. Rate: 9.4 symbols/min [2025-09-14T19:21:41.470225] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-14T19:21:41.538696] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-14T19:21:41.577207] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-14T19:21:41.611584] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-14T19:21:41.703185] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:21:41.986103] [DEBUG] [LOCAL ] NVS: Loaded 22921 existing records from primary storage. [2025-09-14T19:21:42.012418] [INFO ] [MAIN ] NVS: Loaded 22921 existing records. [2025-09-14T19:21:42.082152] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:21:42.082678] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-14T19:21:42.253440] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:21:42.253746] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-14T19:21:42.253928] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-14T19:21:42.254593] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-14T19:21:42.254680] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-14T19:21:42.602431] [INFO ] [REMOTE ] NVS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:21:42.602826] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-14T19:21:42.738826] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-09-14T19:21:42.958890] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-14T19:21:43.395085] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-14T19:21:43.473684] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T19:21:43.655162] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T19:21:43.758858] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-14T19:21:44.346632] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T19:21:44.558840] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-14T19:21:45.358907] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-14T19:21:45.460579] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:21:46.158861] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-14T19:21:46.530843] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T19:21:46.958839] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-14T19:21:47.758908] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-14T19:21:48.689635] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-14T19:21:48.702598] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-14T19:21:51.373528] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (6.01 seconds). [2025-09-14T19:21:51.385614] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-14T19:21:52.346449] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (4.59 seconds). [2025-09-14T19:21:52.351262] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-14T19:21:54.326363] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-09-14T19:21:54.338309] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-14T19:21:55.819308] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (8.86 seconds). [2025-09-14T19:21:55.831622] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-14T19:21:56.925823] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-14T19:21:56.933677] [INFO ] [REMOTE ] NVO: Full fetch complete (58464 records). [2025-09-14T19:21:56.933852] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-14T19:21:57.325975] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-14T19:21:57.326517] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-14T19:21:57.328338] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-14T19:21:57.328578] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-14T19:21:57.330631] [DEBUG] [LOCAL ] NVO: Trimmed 58464 records to 40524 (keeping 150 days of data) [2025-09-14T19:21:57.486301] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T19:21:57.539748] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (8.84 seconds). [2025-09-14T19:21:57.562215] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-14T19:21:57.579969] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-14T19:21:57.711460] [DEBUG] [LOCAL ] NVO: Primary data saved (40524 records). [2025-09-14T19:21:57.711672] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-14T19:21:57.711798] [INFO ] [MAIN ] Update Progress: 1551/2370 symbols completed. NVO took 30.8s. Estimated remaining: 1h 27m 0s. Rate: 9.4 symbols/min [2025-09-14T19:21:57.882141] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:21:57.904245] [DEBUG] [LOCAL ] NVST: Loaded 22764 existing records from primary storage. [2025-09-14T19:21:57.904425] [INFO ] [MAIN ] NVST: Loaded 22764 existing records. [2025-09-14T19:21:58.083088] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:21:58.083402] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-14T19:21:58.083471] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-14T19:21:58.084242] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-14T19:21:58.084306] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-14T19:21:58.442515] [INFO ] [REMOTE ] NVST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:21:58.443139] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-14T19:21:58.481209] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (6.13 seconds). [2025-09-14T19:21:58.486189] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-14T19:21:59.132799] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:21:59.144281] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-14T19:21:59.178820] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T19:21:59.183801] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-14T19:21:59.341107] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T19:21:59.351591] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-14T19:21:59.721140] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T19:21:59.732181] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-14T19:22:00.041250] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T19:22:00.049877] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-14T19:22:00.095174] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T19:22:00.099098] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-14T19:22:00.672239] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:22:00.675598] [INFO ] [REMOTE ] NVR: Full fetch complete (21540 records). [2025-09-14T19:22:00.675734] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-14T19:22:01.086495] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-14T19:22:01.086665] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-14T19:22:01.087809] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-14T19:22:01.087893] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-14T19:22:01.088668] [DEBUG] [LOCAL ] NVR: Trimmed 21540 records to 13330 (keeping 150 days of data) [2025-09-14T19:22:01.190985] [DEBUG] [LOCAL ] NVR: Primary data saved (13330 records). [2025-09-14T19:22:01.191237] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-14T19:22:01.191395] [INFO ] [MAIN ] Update Progress: 1552/2370 symbols completed. NVR took 27.5s. Estimated remaining: 1h 26m 52s. Rate: 9.4 symbols/min [2025-09-14T19:22:01.392481] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:01.420739] [DEBUG] [LOCAL ] NVT: Loaded 22946 existing records from primary storage. [2025-09-14T19:22:01.421137] [INFO ] [MAIN ] NVT: Loaded 22946 existing records. [2025-09-14T19:22:01.652567] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:01.653164] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-14T19:22:01.653250] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-14T19:22:01.665610] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-14T19:22:01.683740] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-14T19:22:01.746010] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-14T19:22:01.807803] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-14T19:22:02.096743] [INFO ] [REMOTE ] NVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:02.097318] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-14T19:22:03.142172] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (3.41 seconds). [2025-09-14T19:22:03.157144] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-14T19:22:04.147186] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-14T19:22:04.157574] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-14T19:22:06.154044] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T19:22:06.166259] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-14T19:22:06.554936] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (6.51 seconds). [2025-09-14T19:22:06.564522] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-14T19:22:08.084470] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T19:22:08.097324] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-14T19:22:09.959711] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T19:22:09.971838] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-14T19:22:11.776336] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (9.97 seconds). [2025-09-14T19:22:11.787609] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-14T19:22:13.336007] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T19:22:13.341196] [INFO ] [REMOTE ] NVS: Full fetch complete (56345 records). [2025-09-14T19:22:13.341331] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-14T19:22:13.723759] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-14T19:22:13.723896] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-14T19:22:13.724967] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-14T19:22:13.725190] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-14T19:22:13.727461] [DEBUG] [LOCAL ] NVS: Trimmed 56345 records to 38688 (keeping 150 days of data) [2025-09-14T19:22:13.979208] [DEBUG] [LOCAL ] NVS: Primary data saved (38688 records). [2025-09-14T19:22:13.979407] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-14T19:22:13.979530] [INFO ] [MAIN ] Update Progress: 1553/2370 symbols completed. NVS took 32.5s. Estimated remaining: 1h 26m 49s. Rate: 9.4 symbols/min [2025-09-14T19:22:14.150446] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:14.172860] [DEBUG] [LOCAL ] NWG: Loaded 23035 existing records from primary storage. [2025-09-14T19:22:14.173050] [INFO ] [MAIN ] NWG: Loaded 23035 existing records. [2025-09-14T19:22:14.351817] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:14.352125] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-14T19:22:14.352186] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-14T19:22:14.352822] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-14T19:22:14.352891] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-14T19:22:14.707438] [INFO ] [REMOTE ] NWG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:14.707861] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-14T19:22:15.856173] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (12.70 seconds). [2025-09-14T19:22:15.868170] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-14T19:22:16.371074] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:22:16.380417] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-14T19:22:16.917880] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (10.35 seconds). [2025-09-14T19:22:16.922316] [INFO ] [REMOTE ] NVRI: Full fetch complete (42004 records). [2025-09-14T19:22:16.922433] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-14T19:22:17.304423] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-14T19:22:17.304547] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-14T19:22:17.305550] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-14T19:22:17.305627] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-14T19:22:17.308348] [DEBUG] [LOCAL ] NVRI: Trimmed 42004 records to 28503 (keeping 150 days of data) [2025-09-14T19:22:17.483160] [DEBUG] [LOCAL ] NVRI: Primary data saved (28503 records). [2025-09-14T19:22:17.483332] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-14T19:22:17.483564] [INFO ] [MAIN ] Update Progress: 1554/2370 symbols completed. NVRI took 36.4s. Estimated remaining: 1h 26m 41s. Rate: 9.4 symbols/min [2025-09-14T19:22:17.654251] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:17.703243] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T19:22:17.721718] [DEBUG] [LOCAL ] NWN: Loaded 12181 existing records from primary storage. [2025-09-14T19:22:17.722125] [INFO ] [MAIN ] NWN: Loaded 12181 existing records. [2025-09-14T19:22:17.728035] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-14T19:22:17.921368] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:17.921788] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-14T19:22:17.921888] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-14T19:22:17.922564] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-14T19:22:17.922686] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-14T19:22:18.334459] [INFO ] [REMOTE ] NWN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:18.335109] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-14T19:22:19.096216] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (9.12 seconds). [2025-09-14T19:22:19.108139] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-14T19:22:19.357624] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T19:22:19.368334] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-14T19:22:19.421137] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:22:19.426863] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-14T19:22:20.569477] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T19:22:20.576310] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-14T19:22:20.669316] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T19:22:20.680532] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-14T19:22:20.746182] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T19:22:20.757726] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-14T19:22:20.881861] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (4.50 seconds). [2025-09-14T19:22:20.893223] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-14T19:22:22.430848] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:22:22.443041] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-14T19:22:22.507117] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T19:22:22.545000] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-14T19:22:22.549842] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T19:22:22.557798] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-14T19:22:22.594190] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T19:22:22.605663] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-14T19:22:23.133107] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:22:23.138295] [INFO ] [REMOTE ] NVST: Full fetch complete (56050 records). [2025-09-14T19:22:23.138424] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-14T19:22:23.543470] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:22:23.548370] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-14T19:22:23.548879] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-14T19:22:23.550903] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-14T19:22:23.551081] [INFO ] [REMOTE ] NVT: Full fetch complete (56195 records). [2025-09-14T19:22:23.551191] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-14T19:22:23.550996] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-14T19:22:23.660518] [DEBUG] [LOCAL ] NVST: Trimmed 56050 records to 38634 (keeping 150 days of data) [2025-09-14T19:22:24.058460] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-14T19:22:24.059420] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-14T19:22:24.061366] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-14T19:22:24.062560] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-14T19:22:24.084795] [DEBUG] [LOCAL ] NVT: Trimmed 56195 records to 38635 (keeping 150 days of data) [2025-09-14T19:22:24.086827] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T19:22:24.098242] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-14T19:22:24.459730] [DEBUG] [LOCAL ] NVST: Primary data saved (38634 records). [2025-09-14T19:22:24.460208] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-14T19:22:24.460758] [INFO ] [MAIN ] Update Progress: 1555/2370 symbols completed. NVST took 26.7s. Estimated remaining: 1h 26m 35s. Rate: 9.4 symbols/min [2025-09-14T19:22:24.560349] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T19:22:24.616683] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-14T19:22:24.682634] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:24.692614] [DEBUG] [LOCAL ] NVT: Primary data saved (38635 records). [2025-09-14T19:22:24.693260] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-14T19:22:24.693435] [INFO ] [MAIN ] Update Progress: 1556/2370 symbols completed. NVT took 23.5s. Estimated remaining: 1h 26m 26s. Rate: 9.4 symbols/min [2025-09-14T19:22:24.803088] [DEBUG] [LOCAL ] NX: Loaded 14584 existing records from primary storage. [2025-09-14T19:22:24.808739] [INFO ] [MAIN ] NX: Loaded 14584 existing records. [2025-09-14T19:22:25.001034] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:25.070833] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:25.072679] [DEBUG] [LOCAL ] NXC: Loaded 1592 existing records from primary storage. [2025-09-14T19:22:25.072840] [INFO ] [MAIN ] NXC: Loaded 1592 existing records. [2025-09-14T19:22:25.103959] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-14T19:22:25.153746] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-14T19:22:25.180852] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-14T19:22:25.196300] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-14T19:22:25.338403] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:25.364582] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-14T19:22:25.364757] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-14T19:22:25.370494] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-14T19:22:25.391387] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-14T19:22:25.804464] [INFO ] [REMOTE ] NX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:25.820389] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-14T19:22:26.005070] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T19:22:26.048384] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-14T19:22:26.116233] [INFO ] [REMOTE ] NXC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:26.116576] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-14T19:22:26.504778] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T19:22:26.515813] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-14T19:22:26.784532] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T19:22:26.786229] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-14T19:22:27.407473] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T19:22:27.414618] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-14T19:22:27.423431] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T19:22:27.425132] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-14T19:22:27.573386] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T19:22:27.758825] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-14T19:22:28.151067] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T19:22:28.558843] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-14T19:22:28.855879] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T19:22:28.992845] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-14T19:22:29.181817] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T19:22:29.358846] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-14T19:22:29.509803] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T19:22:29.988596] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T19:22:30.158910] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-14T19:22:30.729310] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:22:30.733094] [INFO ] [REMOTE ] NWN: Full fetch complete (28805 records). [2025-09-14T19:22:30.733328] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-14T19:22:30.965436] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-14T19:22:31.280766] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-14T19:22:31.280970] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-14T19:22:31.282115] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-14T19:22:31.282225] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-14T19:22:31.283588] [DEBUG] [LOCAL ] NWN: Trimmed 28805 records to 20525 (keeping 150 days of data) [2025-09-14T19:22:31.430748] [DEBUG] [LOCAL ] NWN: Primary data saved (20525 records). [2025-09-14T19:22:31.430911] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-14T19:22:31.431012] [INFO ] [MAIN ] Update Progress: 1557/2370 symbols completed. NWN took 13.9s. Estimated remaining: 1h 26m 20s. Rate: 9.4 symbols/min [2025-09-14T19:22:31.758892] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-14T19:22:32.481911] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T19:22:32.558789] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-14T19:22:33.358917] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-14T19:22:33.740945] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T19:22:33.990583] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T19:22:34.106236] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T19:22:34.158809] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-14T19:22:34.958859] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-14T19:22:35.481046] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T19:22:35.730962] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T19:22:35.758807] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-14T19:22:36.558865] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-14T19:22:37.097931] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T19:22:37.358868] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-14T19:22:38.109284] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T19:22:38.114764] [INFO ] [REMOTE ] NWG: Full fetch complete (55984 records). [2025-09-14T19:22:38.114929] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-14T19:22:38.172490] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-14T19:22:38.524758] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-14T19:22:38.524984] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-14T19:22:38.526384] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-14T19:22:38.526571] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-14T19:22:38.548007] [DEBUG] [LOCAL ] NWG: Trimmed 55984 records to 38809 (keeping 150 days of data) [2025-09-14T19:22:38.549026] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T19:22:38.787564] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T19:22:38.789836] [INFO ] [REMOTE ] NXC: Full fetch complete (4428 records). [2025-09-14T19:22:38.790473] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-14T19:22:38.970358] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-14T19:22:39.212727] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-14T19:22:39.213415] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-14T19:22:39.213623] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-14T19:22:39.213716] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-14T19:22:39.215370] [DEBUG] [LOCAL ] NXC: Trimmed 4428 records to 3040 (keeping 150 days of data) [2025-09-14T19:22:39.245141] [DEBUG] [LOCAL ] NXC: Primary data saved (3040 records). [2025-09-14T19:22:39.245231] [DEBUG] [LOCAL ] NWG: Primary data saved (38809 records). [2025-09-14T19:22:39.245456] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-14T19:22:39.245705] [INFO ] [MAIN ] Update Progress: 1558/2370 symbols completed. NWG took 25.3s. Estimated remaining: 1h 26m 14s. Rate: 9.4 symbols/min [2025-09-14T19:22:39.245781] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-14T19:22:39.246059] [INFO ] [MAIN ] Update Progress: 1559/2370 symbols completed. NXC took 14.6s. Estimated remaining: 1h 26m 4s. Rate: 9.4 symbols/min [2025-09-14T19:22:39.772247] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T19:22:39.776952] [INFO ] [REMOTE ] NX: Full fetch complete (36167 records). [2025-09-14T19:22:39.777119] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-14T19:22:40.181100] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-14T19:22:40.181231] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-14T19:22:40.182210] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-14T19:22:40.182288] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-14T19:22:40.183345] [DEBUG] [LOCAL ] NX: Trimmed 36167 records to 24369 (keeping 150 days of data) [2025-09-14T19:22:40.341195] [DEBUG] [LOCAL ] NX: Primary data saved (24369 records). [2025-09-14T19:22:40.341369] [INFO ] [MAIN ] NX: Full history saved. [2025-09-14T19:22:40.341482] [INFO ] [MAIN ] Update Progress: 1560/2370 symbols completed. NX took 15.9s. Estimated remaining: 1h 25m 55s. Rate: 9.4 symbols/min [2025-09-14T19:22:40.809874] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:41.008637] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:41.119765] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:41.116001] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:22:41.131544] [DEBUG] [LOCAL ] NXDT: Loaded 6405 existing records from primary storage. [2025-09-14T19:22:41.133083] [INFO ] [MAIN ] NXDT: Loaded 6405 existing records. [2025-09-14T19:22:41.183758] [DEBUG] [LOCAL ] NXG: Loaded 5109 existing records from primary storage. [2025-09-14T19:22:41.220830] [INFO ] [MAIN ] NXG: Loaded 5109 existing records. [2025-09-14T19:22:41.243745] [DEBUG] [LOCAL ] NXE: Loaded 23721 existing records from primary storage. [2025-09-14T19:22:41.338729] [DEBUG] [LOCAL ] NXDR: Loaded 14114 existing records from primary storage. [2025-09-14T19:22:41.332353] [INFO ] [MAIN ] NXE: Loaded 23721 existing records. [2025-09-14T19:22:41.375395] [INFO ] [MAIN ] NXDR: Loaded 14114 existing records. [2025-09-14T19:22:41.575703] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:41.681055] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-14T19:22:41.791479] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:41.844835] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:41.822348] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-14T19:22:41.845171] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-14T19:22:41.861130] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-14T19:22:41.866327] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-14T19:22:41.845608] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-14T19:22:41.855989] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-14T19:22:41.906807] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-14T19:22:41.931561] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-14T19:22:41.926420] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-14T19:22:41.956780] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-14T19:22:41.968817] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-14T19:22:42.063584] [WARN ] [MAIN ] NXDR: Insufficient historical data. Have data from 2025-07-21, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:22:42.231413] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-14T19:22:42.306423] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-14T19:22:42.472803] [DEBUG] [LOCAL ] NXDR: Deleted primary data file. [2025-09-14T19:22:42.563382] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-14T19:22:43.033028] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:43.056533] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-14T19:22:43.124499] [INFO ] [REMOTE ] NXE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:43.245790] [INFO ] [REMOTE ] NXG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:43.193209] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-14T19:22:43.290947] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-14T19:22:43.458829] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:22:43.459294] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-14T19:22:43.747773] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:22:43.748133] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-14T19:22:43.748578] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-14T19:22:44.026842] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:22:44.027269] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-14T19:22:44.027765] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-14T19:22:44.049573] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-14T19:22:44.162355] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T19:22:44.321393] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:22:44.321698] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-14T19:22:44.558838] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-14T19:22:44.892535] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T19:22:45.358831] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-14T19:22:45.535023] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T19:22:45.615159] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:22:45.615607] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-14T19:22:46.158848] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-14T19:22:46.958851] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-14T19:22:47.326163] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:22:47.326528] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-14T19:22:47.758833] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-14T19:22:48.014578] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T19:22:48.558840] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-14T19:22:48.965757] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T19:22:49.358855] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-14T19:22:49.419303] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:22:50.158843] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-14T19:22:50.958839] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-14T19:22:51.067120] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T19:22:51.315076] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T19:22:51.752834] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T19:22:51.758772] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-14T19:22:52.558832] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-14T19:22:53.093103] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-14T19:22:53.358892] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-14T19:22:53.971699] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-14T19:22:54.158814] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-14T19:22:54.409804] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T19:22:54.958880] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-14T19:22:55.758857] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-14T19:22:55.935555] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T19:22:55.954397] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T19:22:56.558850] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-14T19:22:56.941174] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T19:22:57.358843] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-14T19:22:58.158879] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-14T19:22:58.414823] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T19:22:58.958832] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-14T19:22:59.758886] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-14T19:23:04.326915] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (6.97 seconds). [2025-09-14T19:23:04.333337] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-14T19:23:04.538066] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (6.38 seconds). [2025-09-14T19:23:04.539791] [INFO ] [REMOTE ] NXG: Full fetch complete (11141 records). [2025-09-14T19:23:04.539875] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-14T19:23:04.909438] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-14T19:23:04.909576] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-14T19:23:04.909915] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-14T19:23:04.909971] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-14T19:23:04.910504] [DEBUG] [LOCAL ] NXG: Trimmed 11141 records to 7526 (keeping 150 days of data) [2025-09-14T19:23:04.972489] [DEBUG] [LOCAL ] NXG: Primary data saved (7526 records). [2025-09-14T19:23:04.973065] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-14T19:23:04.973549] [INFO ] [MAIN ] Update Progress: 1561/2370 symbols completed. NXG took 24.6s. Estimated remaining: 1h 25m 58s. Rate: 9.4 symbols/min [2025-09-14T19:23:04.974936] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (5.22 seconds). [2025-09-14T19:23:04.980437] [INFO ] [REMOTE ] NXDR: Full fetch complete (14086 records). [2025-09-14T19:23:05.051179] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-14T19:23:05.268210] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:05.362240] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 39 unique days, need 150 days [2025-09-14T19:23:05.362859] [DEBUG] [LOCAL ] NXJ: Loaded 7551 existing records from primary storage. [2025-09-14T19:23:05.363186] [INFO ] [MAIN ] NXJ: Loaded 7551 existing records. [2025-09-14T19:23:05.363373] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:23:05.363580] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:23:05.410633] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-14T19:23:05.454696] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-14T19:23:05.472384] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-14T19:23:05.553835] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-14T19:23:05.560858] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T19:23:05.559661] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:05.561095] [INFO ] [MAIN ] Update Progress: 1562/2370 symbols completed. NXDR took 25.2s. Estimated remaining: 1h 25m 49s. Rate: 9.4 symbols/min [2025-09-14T19:23:05.564335] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-14T19:23:05.564662] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-14T19:23:05.565985] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-14T19:23:05.634219] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-14T19:23:05.673923] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-14T19:23:05.817126] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:05.940824] [DEBUG] [LOCAL ] NXN: Loaded 1045 existing records from primary storage. [2025-09-14T19:23:05.975829] [INFO ] [MAIN ] NXN: Loaded 1045 existing records. [2025-09-14T19:23:06.196835] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (7.24 seconds). [2025-09-14T19:23:06.319176] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:06.355452] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:06.355770] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-14T19:23:06.356289] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-14T19:23:06.356245] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-14T19:23:06.357263] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-14T19:23:06.357963] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-14T19:23:06.358112] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-14T19:23:06.709289] [INFO ] [REMOTE ] NXN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:06.718396] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-14T19:23:06.718730] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T19:23:06.723354] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-14T19:23:07.179029] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-14T19:23:07.180342] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-14T19:23:07.365262] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T19:23:07.368427] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-14T19:23:07.480057] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T19:23:07.484555] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-14T19:23:07.683994] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T19:23:07.758901] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-14T19:23:08.284038] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T19:23:08.288346] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T19:23:08.293234] [INFO ] [REMOTE ] NXDT: Full fetch complete (18364 records). [2025-09-14T19:23:08.293460] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-14T19:23:08.567206] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-14T19:23:08.617339] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T19:23:08.752371] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-14T19:23:08.789260] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-14T19:23:08.790369] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-14T19:23:08.790704] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-14T19:23:08.793369] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-14T19:23:08.807058] [DEBUG] [LOCAL ] NXDT: Trimmed 18364 records to 11045 (keeping 150 days of data) [2025-09-14T19:23:08.885848] [DEBUG] [LOCAL ] NXDT: Primary data saved (11045 records). [2025-09-14T19:23:08.886261] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-14T19:23:08.886394] [INFO ] [MAIN ] Update Progress: 1563/2370 symbols completed. NXDT took 28.5s. Estimated remaining: 1h 25m 41s. Rate: 9.4 symbols/min [2025-09-14T19:23:09.056207] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:09.064045] [DEBUG] [LOCAL ] NXP: Loaded 5722 existing records from primary storage. [2025-09-14T19:23:09.064198] [INFO ] [MAIN ] NXP: Loaded 5722 existing records. [2025-09-14T19:23:09.166887] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T19:23:09.243545] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:09.243842] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-14T19:23:09.243920] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-14T19:23:09.244463] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-14T19:23:09.244528] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-14T19:23:09.363911] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-14T19:23:09.606464] [INFO ] [REMOTE ] NXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:10.139318] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T19:23:10.158797] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-14T19:23:10.709576] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T19:23:10.958890] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-14T19:23:11.509080] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-14T19:23:11.758889] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-14T19:23:12.176379] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T19:23:12.177236] [INFO ] [REMOTE ] NXN: Full fetch complete (2549 records). [2025-09-14T19:23:12.177320] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-14T19:23:12.539921] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-14T19:23:12.540051] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-14T19:23:12.540190] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-14T19:23:12.540261] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-14T19:23:12.540711] [DEBUG] [LOCAL ] NXN: Trimmed 2549 records to 1753 (keeping 150 days of data) [2025-09-14T19:23:12.553200] [DEBUG] [LOCAL ] NXN: Primary data saved (1753 records). [2025-09-14T19:23:12.553315] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-14T19:23:12.553445] [INFO ] [MAIN ] Update Progress: 1564/2370 symbols completed. NXN took 7.0s. Estimated remaining: 1h 25m 33s. Rate: 9.4 symbols/min [2025-09-14T19:23:12.564733] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-14T19:23:12.730064] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:12.739853] [DEBUG] [LOCAL ] NXRT: Loaded 8318 existing records from primary storage. [2025-09-14T19:23:12.740014] [INFO ] [MAIN ] NXRT: Loaded 8318 existing records. [2025-09-14T19:23:12.915767] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:12.916046] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-14T19:23:12.916104] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-14T19:23:12.916495] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-14T19:23:12.916553] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-14T19:23:13.285471] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:13.358819] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-14T19:23:13.479573] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T19:23:14.158887] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-14T19:23:14.381296] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:23:14.922457] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T19:23:14.958859] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-14T19:23:15.758893] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-14T19:23:15.887863] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T19:23:16.558809] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-14T19:23:16.866818] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T19:23:17.358883] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-14T19:23:17.520977] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T19:23:18.158881] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-14T19:23:18.210718] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T19:23:18.958893] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-14T19:23:19.290917] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T19:23:19.758910] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-14T19:23:20.020672] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T19:23:20.558796] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-14T19:23:20.940293] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T19:23:21.249040] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T19:23:21.358846] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-14T19:23:22.158877] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-14T19:23:22.958890] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-14T19:23:23.098719] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-14T19:23:23.106553] [INFO ] [REMOTE ] NXE: Full fetch complete (57583 records). [2025-09-14T19:23:23.106936] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-14T19:23:23.404149] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T19:23:23.705203] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-14T19:23:23.705442] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-14T19:23:23.707953] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-14T19:23:23.708142] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-14T19:23:23.710573] [DEBUG] [LOCAL ] NXE: Trimmed 57583 records to 39838 (keeping 150 days of data) [2025-09-14T19:23:23.778609] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-14T19:23:23.993286] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T19:23:24.090797] [DEBUG] [LOCAL ] NXE: Primary data saved (39838 records). [2025-09-14T19:23:24.091073] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-14T19:23:24.091261] [INFO ] [MAIN ] Update Progress: 1565/2370 symbols completed. NXE took 43.7s. Estimated remaining: 1h 25m 30s. Rate: 9.4 symbols/min [2025-09-14T19:23:24.378977] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:24.382332] [DEBUG] [LOCAL ] NYC: Loaded 468 existing records from primary storage. [2025-09-14T19:23:24.382456] [INFO ] [MAIN ] NYC: Loaded 468 existing records. [2025-09-14T19:23:24.581859] [WARN ] [MAIN ] NYC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:24.573961] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-14T19:23:24.583408] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-14T19:23:24.583507] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-14T19:23:24.583898] [DEBUG] [LOCAL ] NYC: Deleted primary data file. [2025-09-14T19:23:24.583989] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-14T19:23:24.915527] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T19:23:24.981533] [INFO ] [REMOTE ] NYC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:25.358906] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-14T19:23:25.772989] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T19:23:26.087388] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:23:26.089702] [INFO ] [REMOTE ] NXJ: Full fetch complete (15648 records). [2025-09-14T19:23:26.089834] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-14T19:23:26.163951] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-14T19:23:26.473013] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-14T19:23:26.473149] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-14T19:23:26.473771] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-14T19:23:26.473830] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-14T19:23:26.474559] [DEBUG] [LOCAL ] NXJ: Trimmed 15648 records to 11754 (keeping 150 days of data) [2025-09-14T19:23:26.552460] [DEBUG] [LOCAL ] NXJ: Primary data saved (11754 records). [2025-09-14T19:23:26.552706] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-14T19:23:26.552881] [INFO ] [MAIN ] Update Progress: 1566/2370 symbols completed. NXJ took 21.6s. Estimated remaining: 1h 25m 21s. Rate: 9.4 symbols/min [2025-09-14T19:23:26.736147] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:26.742009] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T19:23:26.768051] [DEBUG] [LOCAL ] NYT: Loaded 22492 existing records from primary storage. [2025-09-14T19:23:26.768300] [INFO ] [MAIN ] NYT: Loaded 22492 existing records. [2025-09-14T19:23:26.958836] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-14T19:23:26.958777] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:26.960264] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-14T19:23:26.960358] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-14T19:23:26.961128] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-14T19:23:26.961200] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-14T19:23:27.353850] [INFO ] [REMOTE ] NYT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:27.758924] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-14T19:23:28.106629] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T19:23:28.558910] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-14T19:23:29.073263] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T19:23:29.358865] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-14T19:23:29.466855] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T19:23:30.158898] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-14T19:23:30.350859] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T19:23:30.643798] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T19:23:30.958890] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-14T19:23:31.329849] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T19:23:31.758875] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-14T19:23:32.558924] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-14T19:23:32.717433] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T19:23:33.358889] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-14T19:23:34.134666] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T19:23:34.158793] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-14T19:23:34.169945] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T19:23:34.646196] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T19:23:34.958884] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-14T19:23:35.758872] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-14T19:23:36.558836] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-14T19:23:36.763736] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:23:36.768850] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T19:23:36.769005] [INFO ] [REMOTE ] NXP: Full fetch complete (12863 records). [2025-09-14T19:23:36.779263] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-14T19:23:37.072183] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T19:23:37.157200] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-14T19:23:37.157316] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-14T19:23:37.157843] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-14T19:23:37.157909] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-14T19:23:37.158560] [DEBUG] [LOCAL ] NXP: Trimmed 12863 records to 9211 (keeping 150 days of data) [2025-09-14T19:23:37.218388] [DEBUG] [LOCAL ] NXP: Primary data saved (9211 records). [2025-09-14T19:23:37.218576] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-14T19:23:37.218755] [INFO ] [MAIN ] Update Progress: 1567/2370 symbols completed. NXP took 28.3s. Estimated remaining: 1h 25m 17s. Rate: 9.4 symbols/min [2025-09-14T19:23:37.365878] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-14T19:23:37.389741] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:37.406703] [DEBUG] [LOCAL ] NZF: Loaded 13358 existing records from primary storage. [2025-09-14T19:23:37.406870] [INFO ] [MAIN ] NZF: Loaded 13358 existing records. [2025-09-14T19:23:37.580056] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:37.580330] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-14T19:23:37.580403] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-14T19:23:37.580930] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-14T19:23:37.580994] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-14T19:23:37.931865] [INFO ] [REMOTE ] NZF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:37.937624] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:23:37.939889] [INFO ] [REMOTE ] NXRT: Full fetch complete (20148 records). [2025-09-14T19:23:37.940058] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-14T19:23:38.164025] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-14T19:23:38.307199] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-14T19:23:38.307325] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-14T19:23:38.308158] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-14T19:23:38.308249] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-14T19:23:38.309514] [DEBUG] [LOCAL ] NXRT: Trimmed 20148 records to 13774 (keeping 150 days of data) [2025-09-14T19:23:38.406852] [DEBUG] [LOCAL ] NXRT: Primary data saved (13774 records). [2025-09-14T19:23:38.407074] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-14T19:23:38.407196] [INFO ] [MAIN ] Update Progress: 1568/2370 symbols completed. NXRT took 25.9s. Estimated remaining: 1h 25m 8s. Rate: 9.4 symbols/min [2025-09-14T19:23:38.579548] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:38.588441] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-14T19:23:38.606311] [DEBUG] [LOCAL ] O: Loaded 24148 existing records from primary storage. [2025-09-14T19:23:38.606489] [INFO ] [MAIN ] O: Loaded 24148 existing records. [2025-09-14T19:23:38.786915] [WARN ] [MAIN ] O: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:38.787242] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-14T19:23:38.787307] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-14T19:23:38.787938] [DEBUG] [LOCAL ] O: Deleted primary data file. [2025-09-14T19:23:38.788001] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-14T19:23:38.960481] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-14T19:23:39.159737] [INFO ] [REMOTE ] O: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:39.758844] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-14T19:23:40.558835] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-14T19:23:40.813564] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T19:23:40.932765] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T19:23:40.933726] [INFO ] [REMOTE ] NYC: Full fetch complete (1357 records). [2025-09-14T19:23:40.933813] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-14T19:23:41.118572] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T19:23:41.118825] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:23:41.118877] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:23:41.118923] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-14T19:23:41.118995] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-14T19:23:41.119043] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-14T19:23:41.119091] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-14T19:23:41.119197] [INFO ] [MAIN ] Update Progress: 1569/2370 symbols completed. NYC took 17.0s. Estimated remaining: 1h 24m 60s. Rate: 9.4 symbols/min [2025-09-14T19:23:41.292114] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:41.314951] [DEBUG] [LOCAL ] OBDC: Loaded 22896 existing records from primary storage. [2025-09-14T19:23:41.315118] [INFO ] [MAIN ] OBDC: Loaded 22896 existing records. [2025-09-14T19:23:41.370400] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-14T19:23:41.497745] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:41.498054] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-14T19:23:41.498133] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-14T19:23:41.498943] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-14T19:23:41.499022] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-14T19:23:41.858849] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:42.132146] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-14T19:23:42.158767] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-14T19:23:42.958871] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-14T19:23:43.162717] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T19:23:43.758867] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-14T19:23:44.425977] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T19:23:44.558858] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-14T19:23:44.862311] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-14T19:23:45.358875] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-14T19:23:45.630149] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T19:23:46.158887] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-14T19:23:46.453748] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T19:23:46.600369] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T19:23:46.958869] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-14T19:23:47.758839] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-14T19:23:47.894757] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T19:23:48.558867] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-14T19:23:48.936962] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T19:23:49.358940] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-14T19:23:49.949422] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T19:23:50.158950] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-14T19:23:50.480693] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-14T19:23:50.898779] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T19:23:50.958807] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-14T19:23:51.338991] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T19:23:51.758849] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-14T19:23:52.506870] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:23:52.512008] [INFO ] [REMOTE ] NYT: Full fetch complete (54709 records). [2025-09-14T19:23:52.512123] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-14T19:23:52.567439] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-14T19:23:52.899482] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-14T19:23:52.899708] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-14T19:23:52.900735] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-14T19:23:52.900823] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-14T19:23:52.902206] [DEBUG] [LOCAL ] NYT: Trimmed 54709 records to 37498 (keeping 150 days of data) [2025-09-14T19:23:52.929429] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T19:23:53.183206] [DEBUG] [LOCAL ] NYT: Primary data saved (37498 records). [2025-09-14T19:23:53.183410] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-14T19:23:53.183549] [INFO ] [MAIN ] Update Progress: 1570/2370 symbols completed. NYT took 26.6s. Estimated remaining: 1h 24m 56s. Rate: 9.4 symbols/min [2025-09-14T19:23:53.354435] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:23:53.359474] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-14T19:23:53.364442] [DEBUG] [LOCAL ] OBK: Loaded 7061 existing records from primary storage. [2025-09-14T19:23:53.364633] [INFO ] [MAIN ] OBK: Loaded 7061 existing records. [2025-09-14T19:23:53.557045] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:23:53.557363] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-14T19:23:53.557450] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-14T19:23:53.557856] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-14T19:23:53.557935] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-14T19:23:53.923022] [INFO ] [REMOTE ] OBK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:23:54.158770] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-14T19:23:54.553629] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T19:23:54.958846] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-14T19:23:55.178298] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:23:55.271600] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-14T19:23:55.758818] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-14T19:23:56.073058] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T19:23:56.558894] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-14T19:23:56.814994] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T19:23:57.358837] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-14T19:23:58.158909] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-14T19:23:58.521423] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T19:23:58.958841] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-14T19:23:59.309678] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T19:23:59.758847] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-14T19:23:59.820620] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-14T19:24:00.527385] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T19:24:00.558769] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-14T19:24:00.844876] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T19:24:01.358868] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-14T19:24:01.801429] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T19:24:02.158856] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-14T19:24:02.958866] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-14T19:24:03.758885] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-14T19:24:04.895876] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T19:24:04.900406] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-14T19:24:05.049925] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T19:24:05.358859] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-14T19:24:05.728503] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (3.57 seconds). [2025-09-14T19:24:05.733730] [INFO ] [REMOTE ] OBDC: Full fetch complete (56174 records). [2025-09-14T19:24:05.733922] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-14T19:24:05.959476] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T19:24:06.147895] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-14T19:24:06.148133] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-14T19:24:06.149321] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-14T19:24:06.149478] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-14T19:24:06.151179] [DEBUG] [LOCAL ] OBDC: Trimmed 56174 records to 38542 (keeping 150 days of data) [2025-09-14T19:24:06.223899] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-14T19:24:06.287320] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (4.93 seconds). [2025-09-14T19:24:06.437352] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T19:24:06.483073] [DEBUG] [LOCAL ] OBDC: Primary data saved (38542 records). [2025-09-14T19:24:06.483250] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-14T19:24:06.483351] [INFO ] [MAIN ] Update Progress: 1571/2370 symbols completed. OBDC took 25.4s. Estimated remaining: 1h 24m 53s. Rate: 9.4 symbols/min [2025-09-14T19:24:06.655515] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:06.675384] [DEBUG] [LOCAL ] OC: Loaded 19197 existing records from primary storage. [2025-09-14T19:24:06.675580] [INFO ] [MAIN ] OC: Loaded 19197 existing records. [2025-09-14T19:24:06.859694] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:06.859935] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-14T19:24:06.859995] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-14T19:24:06.860709] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-14T19:24:06.860778] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-14T19:24:06.967243] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-14T19:24:07.225049] [INFO ] [REMOTE ] OC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:07.234810] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T19:24:07.237751] [INFO ] [REMOTE ] OBK: Full fetch complete (17506 records). [2025-09-14T19:24:07.238068] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-14T19:24:07.624491] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-14T19:24:07.624616] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-14T19:24:07.625266] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-14T19:24:07.625323] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-14T19:24:07.626105] [DEBUG] [LOCAL ] OBK: Trimmed 17506 records to 11930 (keeping 150 days of data) [2025-09-14T19:24:07.706807] [DEBUG] [LOCAL ] OBK: Primary data saved (11930 records). [2025-09-14T19:24:07.707001] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-14T19:24:07.707121] [INFO ] [MAIN ] Update Progress: 1572/2370 symbols completed. OBK took 14.5s. Estimated remaining: 1h 24m 44s. Rate: 9.4 symbols/min [2025-09-14T19:24:07.763997] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-14T19:24:07.889566] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:07.896002] [DEBUG] [LOCAL ] OCFT: Loaded 3415 existing records from primary storage. [2025-09-14T19:24:07.896173] [INFO ] [MAIN ] OCFT: Loaded 3415 existing records. [2025-09-14T19:24:08.076823] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:08.077129] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-14T19:24:08.077234] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-14T19:24:08.077468] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-14T19:24:08.077531] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-14T19:24:08.317299] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T19:24:08.387449] [INFO ] [REMOTE ] NZF: Full fetch complete (31836 records). [2025-09-14T19:24:08.390678] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-14T19:24:08.566539] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:08.566598] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-14T19:24:08.846117] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-14T19:24:08.846238] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-14T19:24:08.846988] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-14T19:24:08.847049] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-14T19:24:08.847942] [DEBUG] [LOCAL ] NZF: Trimmed 31836 records to 21505 (keeping 150 days of data) [2025-09-14T19:24:08.984983] [DEBUG] [LOCAL ] NZF: Primary data saved (21505 records). [2025-09-14T19:24:08.985150] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-14T19:24:08.985251] [INFO ] [MAIN ] Update Progress: 1573/2370 symbols completed. NZF took 31.8s. Estimated remaining: 1h 24m 36s. Rate: 9.4 symbols/min [2025-09-14T19:24:09.158970] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:09.165637] [DEBUG] [LOCAL ] ODC: Loaded 4312 existing records from primary storage. [2025-09-14T19:24:09.165789] [INFO ] [MAIN ] ODC: Loaded 4312 existing records. [2025-09-14T19:24:09.343231] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:09.343495] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-14T19:24:09.343557] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-14T19:24:09.343885] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-14T19:24:09.343957] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-14T19:24:09.374717] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-14T19:24:09.696270] [INFO ] [REMOTE ] ODC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:10.158878] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-14T19:24:10.293974] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T19:24:10.333826] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T19:24:10.431551] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-14T19:24:10.696610] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T19:24:10.958876] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-14T19:24:11.758921] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-14T19:24:12.036049] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T19:24:12.558922] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-14T19:24:13.277823] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:24:13.282918] [INFO ] [REMOTE ] O: Full fetch complete (58075 records). [2025-09-14T19:24:13.283061] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-14T19:24:13.364134] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-14T19:24:13.484476] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:24:13.485263] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:24:13.485336] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:24:13.485390] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-14T19:24:13.485466] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-14T19:24:13.485704] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-14T19:24:13.485772] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-14T19:24:13.485900] [INFO ] [MAIN ] Update Progress: 1574/2370 symbols completed. O took 35.1s. Estimated remaining: 1h 24m 28s. Rate: 9.4 symbols/min [2025-09-14T19:24:13.665362] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:13.708317] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T19:24:13.724199] [DEBUG] [LOCAL ] ODV: Loaded 13627 existing records from primary storage. [2025-09-14T19:24:13.724940] [INFO ] [MAIN ] ODV: Loaded 13627 existing records. [2025-09-14T19:24:13.912286] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:13.912613] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-14T19:24:13.912697] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-14T19:24:13.913187] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-14T19:24:13.913268] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-14T19:24:14.164596] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-14T19:24:14.301432] [INFO ] [REMOTE ] ODV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:14.310494] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T19:24:14.958834] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-14T19:24:15.758865] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-14T19:24:15.774807] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T19:24:16.113143] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T19:24:16.558907] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-14T19:24:16.658140] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T19:24:17.358846] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-14T19:24:18.158828] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-14T19:24:18.958885] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-14T19:24:19.368885] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-14T19:24:19.400433] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T19:24:19.693508] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T19:24:19.758897] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-14T19:24:19.806861] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T19:24:20.558839] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-14T19:24:20.846055] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T19:24:21.358855] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-14T19:24:21.437257] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T19:24:22.158851] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-14T19:24:22.180758] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T19:24:22.958862] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-14T19:24:23.758873] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-14T19:24:23.824893] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T19:24:23.835169] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T19:24:24.558847] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-14T19:24:24.785231] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T19:24:25.329580] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T19:24:25.358783] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-14T19:24:26.158904] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-14T19:24:26.184941] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T19:24:26.958872] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-14T19:24:27.032395] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T19:24:27.609852] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T19:24:27.758832] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-14T19:24:28.558863] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-14T19:24:28.596378] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T19:24:29.358840] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-14T19:24:29.904403] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T19:24:29.920847] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:24:29.921922] [INFO ] [REMOTE ] OCFT: Full fetch complete (10360 records). [2025-09-14T19:24:29.922012] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-14T19:24:30.163970] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-14T19:24:30.338826] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-14T19:24:30.338939] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-14T19:24:30.339226] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-14T19:24:30.339289] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-14T19:24:30.339809] [DEBUG] [LOCAL ] OCFT: Trimmed 10360 records to 5798 (keeping 150 days of data) [2025-09-14T19:24:30.377481] [DEBUG] [LOCAL ] OCFT: Primary data saved (5798 records). [2025-09-14T19:24:30.377681] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-14T19:24:30.377869] [INFO ] [MAIN ] Update Progress: 1575/2370 symbols completed. OCFT took 22.7s. Estimated remaining: 1h 24m 27s. Rate: 9.4 symbols/min [2025-09-14T19:24:30.559136] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:30.578520] [DEBUG] [LOCAL ] OEC: Loaded 16145 existing records from primary storage. [2025-09-14T19:24:30.578703] [INFO ] [MAIN ] OEC: Loaded 16145 existing records. [2025-09-14T19:24:30.767979] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:30.768323] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-14T19:24:30.768388] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-14T19:24:30.768947] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-14T19:24:30.769016] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-14T19:24:30.968314] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-14T19:24:31.059621] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T19:24:31.093160] [INFO ] [REMOTE ] ODC: Full fetch complete (8773 records). [2025-09-14T19:24:31.114383] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-14T19:24:31.218031] [INFO ] [REMOTE ] OEC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:31.545281] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-14T19:24:31.545393] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-14T19:24:31.545673] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-14T19:24:31.545730] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-14T19:24:31.546172] [DEBUG] [LOCAL ] ODC: Trimmed 8773 records to 6453 (keeping 150 days of data) [2025-09-14T19:24:31.588771] [DEBUG] [LOCAL ] ODC: Primary data saved (6453 records). [2025-09-14T19:24:31.588945] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-14T19:24:31.589074] [INFO ] [MAIN ] Update Progress: 1576/2370 symbols completed. ODC took 22.6s. Estimated remaining: 1h 24m 18s. Rate: 9.4 symbols/min [2025-09-14T19:24:31.758600] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:31.758846] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-14T19:24:31.774090] [DEBUG] [LOCAL ] OFG: Loaded 8757 existing records from primary storage. [2025-09-14T19:24:31.774244] [INFO ] [MAIN ] OFG: Loaded 8757 existing records. [2025-09-14T19:24:31.948414] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:31.948709] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-14T19:24:31.948770] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-14T19:24:31.949219] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-14T19:24:31.949281] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-14T19:24:32.299667] [INFO ] [REMOTE ] OFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:32.558803] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-14T19:24:32.688920] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T19:24:33.096512] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T19:24:33.358859] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-14T19:24:33.491413] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T19:24:34.158840] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-14T19:24:34.881728] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T19:24:34.958828] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-14T19:24:35.440483] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T19:24:35.758933] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-14T19:24:36.462220] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T19:24:36.558883] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-14T19:24:37.006378] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T19:24:37.011844] [INFO ] [REMOTE ] OC: Full fetch complete (48816 records). [2025-09-14T19:24:37.011973] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-14T19:24:37.364618] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-14T19:24:37.399670] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-14T19:24:37.400016] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-14T19:24:37.401034] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-14T19:24:37.401194] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-14T19:24:37.411282] [DEBUG] [LOCAL ] OC: Trimmed 48816 records to 33188 (keeping 150 days of data) [2025-09-14T19:24:37.426382] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:24:37.659401] [DEBUG] [LOCAL ] OC: Primary data saved (33188 records). [2025-09-14T19:24:37.659600] [INFO ] [MAIN ] OC: Full history saved. [2025-09-14T19:24:37.659743] [INFO ] [MAIN ] Update Progress: 1577/2370 symbols completed. OC took 31.2s. Estimated remaining: 1h 24m 12s. Rate: 9.4 symbols/min [2025-09-14T19:24:37.826836] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:37.847470] [DEBUG] [LOCAL ] OGE: Loaded 20746 existing records from primary storage. [2025-09-14T19:24:37.847668] [INFO ] [MAIN ] OGE: Loaded 20746 existing records. [2025-09-14T19:24:38.020599] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:38.020928] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-14T19:24:38.020991] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-14T19:24:38.021712] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-14T19:24:38.021776] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-14T19:24:38.168011] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-14T19:24:38.370688] [INFO ] [REMOTE ] OGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:38.958845] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-14T19:24:39.012921] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T19:24:39.585008] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T19:24:39.758846] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-14T19:24:39.961532] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:24:39.965949] [INFO ] [REMOTE ] ODV: Full fetch complete (25402 records). [2025-09-14T19:24:39.966041] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-14T19:24:40.363333] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-14T19:24:40.363472] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-14T19:24:40.364417] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-14T19:24:40.364478] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-14T19:24:40.365330] [DEBUG] [LOCAL ] ODV: Trimmed 25402 records to 20014 (keeping 150 days of data) [2025-09-14T19:24:40.496760] [DEBUG] [LOCAL ] ODV: Primary data saved (20014 records). [2025-09-14T19:24:40.496999] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-14T19:24:40.497125] [INFO ] [MAIN ] Update Progress: 1578/2370 symbols completed. ODV took 27.0s. Estimated remaining: 1h 24m 4s. Rate: 9.4 symbols/min [2025-09-14T19:24:40.564143] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-14T19:24:40.680181] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:40.707278] [DEBUG] [LOCAL ] OGN: Loaded 23696 existing records from primary storage. [2025-09-14T19:24:40.707559] [INFO ] [MAIN ] OGN: Loaded 23696 existing records. [2025-09-14T19:24:40.893493] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:40.893883] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-14T19:24:40.893953] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-14T19:24:40.894755] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-14T19:24:40.894823] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-14T19:24:41.266760] [INFO ] [REMOTE ] OGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:41.297666] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T19:24:41.358819] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-14T19:24:41.436200] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:24:42.158841] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-14T19:24:42.958884] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-14T19:24:43.185282] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T19:24:43.300946] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T19:24:43.758840] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-14T19:24:44.558901] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-14T19:24:44.833399] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T19:24:45.308011] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T19:24:45.358816] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-14T19:24:45.675494] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T19:24:46.158827] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-14T19:24:46.519175] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T19:24:46.958863] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-14T19:24:47.306868] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T19:24:47.758892] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-14T19:24:48.558939] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-14T19:24:48.678716] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T19:24:49.214955] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T19:24:49.358840] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-14T19:24:50.158899] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-14T19:24:50.452526] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T19:24:50.686373] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T19:24:50.688623] [INFO ] [REMOTE ] OFG: Full fetch complete (25219 records). [2025-09-14T19:24:50.688772] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-14T19:24:50.963935] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-14T19:24:51.065803] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-14T19:24:51.088447] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-14T19:24:51.089459] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-14T19:24:51.089882] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-14T19:24:51.091132] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:24:51.100231] [DEBUG] [LOCAL ] OFG: Trimmed 25219 records to 15623 (keeping 150 days of data) [2025-09-14T19:24:51.198616] [DEBUG] [LOCAL ] OFG: Primary data saved (15623 records). [2025-09-14T19:24:51.198833] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-14T19:24:51.198947] [INFO ] [MAIN ] Update Progress: 1579/2370 symbols completed. OFG took 19.6s. Estimated remaining: 1h 23m 59s. Rate: 9.4 symbols/min [2025-09-14T19:24:51.383246] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:51.402552] [DEBUG] [LOCAL ] OGS: Loaded 14987 existing records from primary storage. [2025-09-14T19:24:51.402881] [INFO ] [MAIN ] OGS: Loaded 14987 existing records. [2025-09-14T19:24:51.599307] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:51.599617] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-14T19:24:51.599702] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-14T19:24:51.600376] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-14T19:24:51.600452] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-14T19:24:51.770373] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-14T19:24:51.968057] [INFO ] [REMOTE ] OGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:52.558880] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-14T19:24:52.756491] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:24:53.230603] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-14T19:24:53.234573] [INFO ] [REMOTE ] OEC: Full fetch complete (40575 records). [2025-09-14T19:24:53.234804] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-14T19:24:53.363901] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-14T19:24:53.629387] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-14T19:24:53.629521] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-14T19:24:53.630506] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-14T19:24:53.630572] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-14T19:24:53.631591] [DEBUG] [LOCAL ] OEC: Trimmed 40575 records to 27729 (keeping 150 days of data) [2025-09-14T19:24:53.822192] [DEBUG] [LOCAL ] OEC: Primary data saved (27729 records). [2025-09-14T19:24:53.822369] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-14T19:24:53.822486] [INFO ] [MAIN ] Update Progress: 1580/2370 symbols completed. OEC took 23.4s. Estimated remaining: 1h 23m 51s. Rate: 9.4 symbols/min [2025-09-14T19:24:53.993771] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:24:54.012211] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T19:24:54.038143] [DEBUG] [LOCAL ] OHI: Loaded 23234 existing records from primary storage. [2025-09-14T19:24:54.038328] [INFO ] [MAIN ] OHI: Loaded 23234 existing records. [2025-09-14T19:24:54.163918] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-14T19:24:54.228360] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:24:54.228722] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-14T19:24:54.228791] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-14T19:24:54.229713] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-14T19:24:54.229784] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-14T19:24:54.595396] [INFO ] [REMOTE ] OHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:24:54.958879] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-14T19:24:55.137359] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T19:24:55.758953] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-14T19:24:55.981561] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T19:24:56.056752] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T19:24:56.558921] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-14T19:24:57.358823] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-14T19:24:57.762912] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T19:24:58.094565] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T19:24:58.158916] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-14T19:24:58.958836] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-14T19:24:59.160519] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T19:24:59.758802] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-14T19:24:59.832662] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T19:25:00.205623] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T19:25:00.558872] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-14T19:25:01.358828] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-14T19:25:01.614966] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T19:25:02.123100] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T19:25:02.158784] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-14T19:25:02.958882] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-14T19:25:03.120675] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T19:25:03.758919] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-14T19:25:03.925039] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T19:25:04.313486] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T19:25:04.470541] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:25:04.476148] [INFO ] [REMOTE ] OGE: Full fetch complete (50669 records). [2025-09-14T19:25:04.476408] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-14T19:25:04.563989] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-14T19:25:04.878942] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-14T19:25:04.879062] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-14T19:25:04.879995] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-14T19:25:04.880057] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-14T19:25:04.881212] [DEBUG] [LOCAL ] OGE: Trimmed 50669 records to 34641 (keeping 150 days of data) [2025-09-14T19:25:05.110822] [DEBUG] [LOCAL ] OGE: Primary data saved (34641 records). [2025-09-14T19:25:05.111010] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-14T19:25:05.111118] [INFO ] [MAIN ] Update Progress: 1581/2370 symbols completed. OGE took 27.5s. Estimated remaining: 1h 23m 47s. Rate: 9.4 symbols/min [2025-09-14T19:25:05.279387] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:05.300844] [DEBUG] [LOCAL ] OI: Loaded 21339 existing records from primary storage. [2025-09-14T19:25:05.301030] [INFO ] [MAIN ] OI: Loaded 21339 existing records. [2025-09-14T19:25:05.366676] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-14T19:25:05.492459] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:05.492824] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-14T19:25:05.492893] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-14T19:25:05.493572] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-14T19:25:05.493675] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-14T19:25:05.876968] [INFO ] [REMOTE ] OI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:06.158891] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-14T19:25:06.478406] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T19:25:06.958853] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-14T19:25:07.372191] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T19:25:07.719069] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T19:25:07.758793] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-14T19:25:08.350770] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T19:25:08.354149] [INFO ] [REMOTE ] OGS: Full fetch complete (37038 records). [2025-09-14T19:25:08.354252] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-14T19:25:08.566543] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-14T19:25:08.740089] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-14T19:25:08.740316] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-14T19:25:08.741238] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-14T19:25:08.741389] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-14T19:25:08.743175] [DEBUG] [LOCAL ] OGS: Trimmed 37038 records to 26261 (keeping 150 days of data) [2025-09-14T19:25:08.775404] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T19:25:08.950487] [DEBUG] [LOCAL ] OGS: Primary data saved (26261 records). [2025-09-14T19:25:08.950671] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-14T19:25:08.950782] [INFO ] [MAIN ] Update Progress: 1582/2370 symbols completed. OGS took 17.8s. Estimated remaining: 1h 23m 40s. Rate: 9.4 symbols/min [2025-09-14T19:25:09.137975] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:09.147625] [DEBUG] [LOCAL ] OIA: Loaded 6392 existing records from primary storage. [2025-09-14T19:25:09.147825] [INFO ] [MAIN ] OIA: Loaded 6392 existing records. [2025-09-14T19:25:09.328984] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:09.329309] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-14T19:25:09.329375] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-14T19:25:09.329803] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-14T19:25:09.329871] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-14T19:25:09.364244] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-14T19:25:09.715251] [INFO ] [REMOTE ] OIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:10.158883] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-14T19:25:10.261475] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T19:25:10.958827] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-14T19:25:11.209897] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T19:25:11.288365] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T19:25:11.758881] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-14T19:25:12.558855] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-14T19:25:12.753841] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T19:25:12.773151] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T19:25:13.358882] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-14T19:25:14.059035] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:25:14.064665] [INFO ] [REMOTE ] OGN: Full fetch complete (57757 records). [2025-09-14T19:25:14.064834] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-14T19:25:14.164093] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-14T19:25:14.461593] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-14T19:25:14.461738] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-14T19:25:14.462727] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-14T19:25:14.462851] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-14T19:25:14.464310] [DEBUG] [LOCAL ] OGN: Trimmed 57757 records to 39992 (keeping 150 days of data) [2025-09-14T19:25:14.508270] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T19:25:14.774492] [DEBUG] [LOCAL ] OGN: Primary data saved (39992 records). [2025-09-14T19:25:14.774702] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-14T19:25:14.774845] [INFO ] [MAIN ] Update Progress: 1583/2370 symbols completed. OGN took 34.3s. Estimated remaining: 1h 23m 33s. Rate: 9.4 symbols/min [2025-09-14T19:25:14.946513] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:14.958844] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-14T19:25:14.967115] [DEBUG] [LOCAL ] OII: Loaded 19239 existing records from primary storage. [2025-09-14T19:25:14.967242] [INFO ] [MAIN ] OII: Loaded 19239 existing records. [2025-09-14T19:25:15.142532] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:15.142826] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-14T19:25:15.142894] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-14T19:25:15.143485] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-14T19:25:15.143546] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-14T19:25:15.497266] [INFO ] [REMOTE ] OII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:15.758827] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-14T19:25:15.971826] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T19:25:16.014465] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T19:25:16.558858] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-14T19:25:17.322664] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:25:17.358789] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-14T19:25:17.392618] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T19:25:18.158824] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-14T19:25:18.958833] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-14T19:25:19.041377] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T19:25:19.311607] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T19:25:19.758830] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-14T19:25:20.418346] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T19:25:20.558859] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-14T19:25:20.632000] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T19:25:21.358827] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-14T19:25:22.158809] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-14T19:25:22.349124] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T19:25:22.395098] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T19:25:22.958872] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-14T19:25:23.683869] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T19:25:23.758795] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-14T19:25:24.429983] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T19:25:24.437180] [INFO ] [REMOTE ] OHI: Full fetch complete (56716 records). [2025-09-14T19:25:24.437370] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-14T19:25:24.560835] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-14T19:25:24.875228] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T19:25:24.898085] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-14T19:25:24.898356] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-14T19:25:24.899955] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-14T19:25:24.900374] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-14T19:25:24.901627] [DEBUG] [LOCAL ] OHI: Trimmed 56716 records to 39212 (keeping 150 days of data) [2025-09-14T19:25:25.154995] [DEBUG] [LOCAL ] OHI: Primary data saved (39212 records). [2025-09-14T19:25:25.155207] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-14T19:25:25.155318] [INFO ] [MAIN ] Update Progress: 1584/2370 symbols completed. OHI took 31.3s. Estimated remaining: 1h 23m 29s. Rate: 9.4 symbols/min [2025-09-14T19:25:25.326420] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:25.343782] [DEBUG] [LOCAL ] OIS: Loaded 17690 existing records from primary storage. [2025-09-14T19:25:25.343935] [INFO ] [MAIN ] OIS: Loaded 17690 existing records. [2025-09-14T19:25:25.364360] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-14T19:25:25.521588] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:25.521844] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-14T19:25:25.521915] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-14T19:25:25.522421] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-14T19:25:25.522481] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-14T19:25:25.640751] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T19:25:25.705590] [INFO ] [REMOTE ] OIA: Full fetch complete (15187 records). [2025-09-14T19:25:25.772384] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-14T19:25:26.021736] [INFO ] [REMOTE ] OIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:26.164062] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-14T19:25:26.301659] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-14T19:25:26.301774] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-14T19:25:26.302138] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-14T19:25:26.302190] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-14T19:25:26.302777] [DEBUG] [LOCAL ] OIA: Trimmed 15187 records to 9906 (keeping 150 days of data) [2025-09-14T19:25:26.364274] [DEBUG] [LOCAL ] OIA: Primary data saved (9906 records). [2025-09-14T19:25:26.364448] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-14T19:25:26.364561] [INFO ] [MAIN ] Update Progress: 1585/2370 symbols completed. OIA took 17.4s. Estimated remaining: 1h 23m 20s. Rate: 9.4 symbols/min [2025-09-14T19:25:26.540132] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:26.563250] [DEBUG] [LOCAL ] OKE: Loaded 24036 existing records from primary storage. [2025-09-14T19:25:26.563424] [INFO ] [MAIN ] OKE: Loaded 24036 existing records. [2025-09-14T19:25:26.742036] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:26.742300] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-14T19:25:26.742361] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-14T19:25:26.742969] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-14T19:25:26.743030] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-14T19:25:26.964061] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-14T19:25:27.122271] [INFO ] [REMOTE ] OKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:27.155231] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T19:25:27.604791] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T19:25:27.758857] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-14T19:25:28.558911] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-14T19:25:28.772745] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T19:25:29.358899] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-14T19:25:29.521904] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T19:25:30.040612] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T19:25:30.158808] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-14T19:25:30.455433] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T19:25:30.594742] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T19:25:30.599787] [INFO ] [REMOTE ] OI: Full fetch complete (51390 records). [2025-09-14T19:25:30.599920] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-14T19:25:30.963131] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-14T19:25:30.997035] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-14T19:25:30.997141] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-14T19:25:30.998091] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-14T19:25:30.998157] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-14T19:25:30.999299] [DEBUG] [LOCAL ] OI: Trimmed 51390 records to 35376 (keeping 150 days of data) [2025-09-14T19:25:31.214349] [DEBUG] [LOCAL ] OI: Primary data saved (35376 records). [2025-09-14T19:25:31.214519] [INFO ] [MAIN ] OI: Full history saved. [2025-09-14T19:25:31.214620] [INFO ] [MAIN ] Update Progress: 1586/2370 symbols completed. OI took 26.1s. Estimated remaining: 1h 23m 12s. Rate: 9.4 symbols/min [2025-09-14T19:25:31.383666] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:31.409872] [DEBUG] [LOCAL ] OKLO: Loaded 24230 existing records from primary storage. [2025-09-14T19:25:31.410072] [INFO ] [MAIN ] OKLO: Loaded 24230 existing records. [2025-09-14T19:25:31.589925] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:31.590195] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-14T19:25:31.590256] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-14T19:25:31.591007] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-09-14T19:25:31.591070] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-14T19:25:31.769562] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-14T19:25:31.966065] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:32.558833] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-14T19:25:32.637615] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T19:25:33.358839] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-14T19:25:33.753050] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-14T19:25:34.111409] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:25:34.158782] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-14T19:25:34.958835] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-14T19:25:35.758804] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-14T19:25:35.796854] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T19:25:35.836754] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-14T19:25:36.531274] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T19:25:36.558788] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-14T19:25:37.358819] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-14T19:25:37.788740] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T19:25:38.156510] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T19:25:38.165200] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-14T19:25:38.958855] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-14T19:25:39.758867] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-14T19:25:39.867089] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-14T19:25:39.955452] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T19:25:40.501205] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T19:25:40.558785] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-14T19:25:41.358798] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-14T19:25:41.458748] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T19:25:42.158867] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-14T19:25:42.581988] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T19:25:42.958880] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-14T19:25:43.715322] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T19:25:43.758793] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-14T19:25:44.084773] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-14T19:25:44.558883] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-14T19:25:44.986853] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T19:25:44.993571] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T19:25:45.016023] [INFO ] [REMOTE ] OIS: Full fetch complete (44449 records). [2025-09-14T19:25:45.016239] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-14T19:25:45.369095] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-14T19:25:45.411202] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-14T19:25:45.411340] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-14T19:25:45.412844] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-14T19:25:45.413200] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-14T19:25:45.414614] [DEBUG] [LOCAL ] OIS: Trimmed 44449 records to 30281 (keeping 150 days of data) [2025-09-14T19:25:45.608185] [DEBUG] [LOCAL ] OIS: Primary data saved (30281 records). [2025-09-14T19:25:45.608415] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-14T19:25:45.608548] [INFO ] [MAIN ] Update Progress: 1587/2370 symbols completed. OIS took 20.5s. Estimated remaining: 1h 23m 10s. Rate: 9.4 symbols/min [2025-09-14T19:25:45.793892] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:45.819449] [DEBUG] [LOCAL ] OLN: Loaded 23362 existing records from primary storage. [2025-09-14T19:25:45.819720] [INFO ] [MAIN ] OLN: Loaded 23362 existing records. [2025-09-14T19:25:46.006546] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:46.006953] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-14T19:25:46.007028] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-14T19:25:46.007813] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-14T19:25:46.007879] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-14T19:25:46.164156] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-14T19:25:46.413682] [INFO ] [REMOTE ] OLN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:46.933169] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:25:46.938517] [INFO ] [REMOTE ] OII: Full fetch complete (47069 records). [2025-09-14T19:25:46.938700] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-14T19:25:46.964135] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-14T19:25:47.349293] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-14T19:25:47.349599] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-14T19:25:47.351043] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-14T19:25:47.351384] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-14T19:25:47.353698] [DEBUG] [LOCAL ] OII: Trimmed 47069 records to 31748 (keeping 150 days of data) [2025-09-14T19:25:47.482753] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-09-14T19:25:47.641210] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-14T19:25:47.679489] [DEBUG] [LOCAL ] OII: Primary data saved (31748 records). [2025-09-14T19:25:47.679747] [INFO ] [MAIN ] OII: Full history saved. [2025-09-14T19:25:47.679882] [INFO ] [MAIN ] Update Progress: 1588/2370 symbols completed. OII took 32.9s. Estimated remaining: 1h 23m 2s. Rate: 9.4 symbols/min [2025-09-14T19:25:47.764330] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-14T19:25:47.866976] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:47.874581] [DEBUG] [LOCAL ] OLP: Loaded 4554 existing records from primary storage. [2025-09-14T19:25:47.874773] [INFO ] [MAIN ] OLP: Loaded 4554 existing records. [2025-09-14T19:25:48.062858] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:48.063229] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-14T19:25:48.063306] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-14T19:25:48.063862] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-14T19:25:48.063937] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-14T19:25:48.433549] [INFO ] [REMOTE ] OLP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:48.471490] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T19:25:48.558796] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-14T19:25:49.358809] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-14T19:25:49.369491] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T19:25:49.802974] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T19:25:50.158821] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-14T19:25:50.877115] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:25:50.882853] [INFO ] [REMOTE ] OKE: Full fetch complete (58216 records). [2025-09-14T19:25:50.883033] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-14T19:25:50.964036] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-14T19:25:51.284911] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-14T19:25:51.285135] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-14T19:25:51.286768] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-14T19:25:51.286895] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-14T19:25:51.288704] [DEBUG] [LOCAL ] OKE: Trimmed 58216 records to 40329 (keeping 150 days of data) [2025-09-14T19:25:51.427056] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T19:25:51.609606] [DEBUG] [LOCAL ] OKE: Primary data saved (40329 records). [2025-09-14T19:25:51.609799] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-14T19:25:51.609911] [INFO ] [MAIN ] Update Progress: 1589/2370 symbols completed. OKE took 25.2s. Estimated remaining: 1h 22m 54s. Rate: 9.4 symbols/min [2025-09-14T19:25:51.762818] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-14T19:25:51.781790] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:25:51.807193] [DEBUG] [LOCAL ] OMC: Loaded 23948 existing records from primary storage. [2025-09-14T19:25:51.807387] [INFO ] [MAIN ] OMC: Loaded 23948 existing records. [2025-09-14T19:25:51.988658] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:25:51.988991] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-14T19:25:51.989079] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-14T19:25:51.989765] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-14T19:25:51.989835] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-14T19:25:52.344888] [INFO ] [REMOTE ] OMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:25:52.558848] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-14T19:25:53.358877] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-14T19:25:53.669905] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T19:25:53.737440] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-09-14T19:25:54.158879] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-14T19:25:54.324409] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T19:25:54.359333] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T19:25:54.958830] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-14T19:25:55.758823] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-14T19:25:55.879714] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T19:25:56.558789] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-14T19:25:57.111267] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-14T19:25:57.358834] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-14T19:25:57.470833] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T19:25:58.158826] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-14T19:25:58.958861] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-14T19:25:58.998328] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T19:25:59.256353] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T19:25:59.758867] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-14T19:26:00.558905] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-14T19:26:01.176226] [DEBUG] [REMOTE ] OLN: Error fetching primary data for 2025-05: Server request status code is 503. [2025-09-14T19:26:01.176767] [WARN ] [REMOTE ] OLN: No data returned for month 2025-05 [2025-09-14T19:26:01.358880] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-14T19:26:01.514005] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T19:26:01.780408] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T19:26:01.829822] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-14T19:26:02.158841] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-14T19:26:02.856990] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T19:26:02.958868] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-14T19:26:03.758841] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-14T19:26:04.054984] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T19:26:04.558871] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-14T19:26:04.628063] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:26:05.355890] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-14T19:26:05.360849] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-14T19:26:05.363417] [INFO ] [REMOTE ] OKLO: Full fetch complete (58499 records). [2025-09-14T19:26:05.363673] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-14T19:26:05.751580] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-09-14T19:26:05.751729] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-09-14T19:26:05.752774] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-09-14T19:26:05.752856] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-09-14T19:26:05.754170] [DEBUG] [LOCAL ] OKLO: Trimmed 58499 records to 40559 (keeping 150 days of data) [2025-09-14T19:26:06.030866] [DEBUG] [LOCAL ] OKLO: Primary data saved (40559 records). [2025-09-14T19:26:06.031091] [INFO ] [MAIN ] OKLO: Full history saved. [2025-09-14T19:26:06.031332] [INFO ] [MAIN ] Update Progress: 1590/2370 symbols completed. OKLO took 34.8s. Estimated remaining: 1h 22m 52s. Rate: 9.4 symbols/min [2025-09-14T19:26:06.171905] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-14T19:26:06.202571] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:06.225707] [DEBUG] [LOCAL ] OMF: Loaded 20064 existing records from primary storage. [2025-09-14T19:26:06.225883] [INFO ] [MAIN ] OMF: Loaded 20064 existing records. [2025-09-14T19:26:06.402762] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:06.403097] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-14T19:26:06.403248] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-14T19:26:06.404042] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-14T19:26:06.404156] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-14T19:26:06.757694] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-14T19:26:06.829560] [INFO ] [REMOTE ] OMF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:26:06.958543] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T19:26:06.958723] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-14T19:26:06.961255] [INFO ] [REMOTE ] OLP: Full fetch complete (10268 records). [2025-09-14T19:26:06.961358] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-14T19:26:07.328668] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-14T19:26:07.328785] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-14T19:26:07.329055] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-14T19:26:07.329347] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-14T19:26:07.330115] [DEBUG] [LOCAL ] OLP: Trimmed 10268 records to 6945 (keeping 150 days of data) [2025-09-14T19:26:07.402124] [DEBUG] [LOCAL ] OLP: Primary data saved (6945 records). [2025-09-14T19:26:07.402435] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-14T19:26:07.402727] [INFO ] [MAIN ] Update Progress: 1591/2370 symbols completed. OLP took 19.7s. Estimated remaining: 1h 22m 43s. Rate: 9.4 symbols/min [2025-09-14T19:26:07.404708] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T19:26:07.586688] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:07.608267] [DEBUG] [LOCAL ] OMI: Loaded 20224 existing records from primary storage. [2025-09-14T19:26:07.608431] [INFO ] [MAIN ] OMI: Loaded 20224 existing records. [2025-09-14T19:26:07.763938] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-14T19:26:07.832020] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:07.832235] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-14T19:26:07.832302] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-14T19:26:07.832920] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-14T19:26:07.832983] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-14T19:26:08.180743] [INFO ] [REMOTE ] OMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:26:08.344181] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T19:26:08.558848] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-14T19:26:09.358852] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-14T19:26:09.763434] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T19:26:10.158895] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-14T19:26:10.315417] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T19:26:10.958867] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-14T19:26:11.090710] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T19:26:11.758864] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-14T19:26:12.107000] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T19:26:12.558882] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-14T19:26:12.755815] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T19:26:12.893576] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T19:26:12.899186] [INFO ] [REMOTE ] OMC: Full fetch complete (57925 records). [2025-09-14T19:26:12.899379] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-14T19:26:13.287347] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-14T19:26:13.287551] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-14T19:26:13.288798] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-14T19:26:13.288903] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-14T19:26:13.290731] [DEBUG] [LOCAL ] OMC: Trimmed 57925 records to 40064 (keeping 150 days of data) [2025-09-14T19:26:13.364750] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-14T19:26:13.426214] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T19:26:13.608587] [DEBUG] [LOCAL ] OMC: Primary data saved (40064 records). [2025-09-14T19:26:13.608778] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-14T19:26:13.608904] [INFO ] [MAIN ] Update Progress: 1592/2370 symbols completed. OMC took 22.0s. Estimated remaining: 1h 22m 36s. Rate: 9.4 symbols/min [2025-09-14T19:26:13.778081] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:13.783300] [DEBUG] [LOCAL ] ONIT: Loaded 3631 existing records from primary storage. [2025-09-14T19:26:13.783403] [INFO ] [MAIN ] ONIT: Loaded 3631 existing records. [2025-09-14T19:26:13.960601] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:13.960874] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-14T19:26:13.960934] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-14T19:26:13.961174] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-14T19:26:13.961231] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-14T19:26:14.164084] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-14T19:26:14.340363] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:26:14.958894] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-14T19:26:15.237573] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T19:26:15.763906] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-14T19:26:15.772504] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T19:26:15.779251] [INFO ] [REMOTE ] OLN: Full fetch complete (48205 records). [2025-09-14T19:26:15.779417] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-14T19:26:15.975706] [WARN ] [VALIDATOR ] OLN: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T19:26:15.976510] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:26:15.976633] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:26:15.976775] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-14T19:26:15.976916] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-09-14T19:26:15.977099] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-09-14T19:26:15.977242] [DEBUG] [LOCAL ] OLN: No derivative data file found to delete. [2025-09-14T19:26:15.977368] [INFO ] [MAIN ] Update Progress: 1593/2370 symbols completed. OLN took 30.4s. Estimated remaining: 1h 22m 28s. Rate: 9.4 symbols/min [2025-09-14T19:26:16.167138] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:16.181115] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T19:26:16.204108] [DEBUG] [LOCAL ] ONL: Loaded 12679 existing records from primary storage. [2025-09-14T19:26:16.204259] [INFO ] [MAIN ] ONL: Loaded 12679 existing records. [2025-09-14T19:26:16.381536] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:16.381855] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-14T19:26:16.381919] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-14T19:26:16.382381] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-14T19:26:16.382449] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-14T19:26:16.566217] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-14T19:26:16.740370] [INFO ] [REMOTE ] ONL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:26:17.358911] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-14T19:26:17.435238] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T19:26:17.624262] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T19:26:18.158899] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-14T19:26:18.385189] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T19:26:18.958906] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-14T19:26:19.758825] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-14T19:26:19.811288] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T19:26:20.216816] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T19:26:20.318510] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-14T19:26:20.558933] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-14T19:26:21.358924] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-14T19:26:21.976182] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T19:26:22.158911] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-14T19:26:22.234706] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T19:26:22.958860] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-14T19:26:23.673630] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T19:26:23.758808] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-14T19:26:24.506054] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T19:26:24.547942] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:26:24.558763] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-14T19:26:25.257436] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T19:26:25.358854] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-14T19:26:26.158831] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-14T19:26:26.812617] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T19:26:26.958819] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-14T19:26:27.758858] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-14T19:26:27.946141] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T19:26:28.267016] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T19:26:28.558862] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-14T19:26:28.608325] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T19:26:29.358878] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-14T19:26:29.784634] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T19:26:30.158846] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-14T19:26:30.838142] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T19:26:30.958832] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-14T19:26:31.054805] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T19:26:31.758876] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-14T19:26:32.365383] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T19:26:32.480288] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:26:32.483289] [INFO ] [REMOTE ] ONL: Full fetch complete (34035 records). [2025-09-14T19:26:32.483401] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-14T19:26:32.563945] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-14T19:26:32.854505] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-14T19:26:32.854670] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-14T19:26:32.855459] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-14T19:26:32.855559] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-14T19:26:32.856539] [DEBUG] [LOCAL ] ONL: Trimmed 34035 records to 22844 (keeping 150 days of data) [2025-09-14T19:26:33.005778] [DEBUG] [LOCAL ] ONL: Primary data saved (22844 records). [2025-09-14T19:26:33.005960] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-14T19:26:33.006070] [INFO ] [MAIN ] Update Progress: 1594/2370 symbols completed. ONL took 17.0s. Estimated remaining: 1h 22m 27s. Rate: 9.4 symbols/min [2025-09-14T19:26:33.179377] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:33.203153] [DEBUG] [LOCAL ] ONON: Loaded 24022 existing records from primary storage. [2025-09-14T19:26:33.203334] [INFO ] [MAIN ] ONON: Loaded 24022 existing records. [2025-09-14T19:26:33.359302] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-14T19:26:33.386957] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:33.388262] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-14T19:26:33.388357] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-14T19:26:33.389114] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-14T19:26:33.389220] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-14T19:26:33.758282] [INFO ] [REMOTE ] ONON: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:26:34.094750] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T19:26:34.101400] [INFO ] [REMOTE ] OMF: Full fetch complete (50225 records). [2025-09-14T19:26:34.101630] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-14T19:26:34.170296] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-14T19:26:34.512382] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-14T19:26:34.512552] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-14T19:26:34.514200] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-14T19:26:34.514300] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-14T19:26:34.516206] [DEBUG] [LOCAL ] OMF: Trimmed 50225 records to 34325 (keeping 150 days of data) [2025-09-14T19:26:34.765493] [DEBUG] [LOCAL ] OMF: Primary data saved (34325 records). [2025-09-14T19:26:34.765834] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-14T19:26:34.765973] [INFO ] [MAIN ] Update Progress: 1595/2370 symbols completed. OMF took 28.7s. Estimated remaining: 1h 22m 18s. Rate: 9.4 symbols/min [2025-09-14T19:26:34.955621] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:34.958900] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-14T19:26:34.970098] [DEBUG] [LOCAL ] ONTF: Loaded 11002 existing records from primary storage. [2025-09-14T19:26:34.970329] [INFO ] [MAIN ] ONTF: Loaded 11002 existing records. [2025-09-14T19:26:35.179882] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:35.180510] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-14T19:26:35.180659] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-14T19:26:35.181234] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-14T19:26:35.205411] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-14T19:26:35.213011] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T19:26:35.603303] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:26:35.715039] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:26:35.716567] [INFO ] [REMOTE ] ONIT: Full fetch complete (8557 records). [2025-09-14T19:26:35.716689] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-14T19:26:35.771071] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-14T19:26:36.100826] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-14T19:26:36.100997] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-14T19:26:36.101353] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-14T19:26:36.101427] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-14T19:26:36.102129] [DEBUG] [LOCAL ] ONIT: Trimmed 8557 records to 5818 (keeping 150 days of data) [2025-09-14T19:26:36.137741] [DEBUG] [LOCAL ] ONIT: Primary data saved (5818 records). [2025-09-14T19:26:36.137935] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-14T19:26:36.138071] [INFO ] [MAIN ] Update Progress: 1596/2370 symbols completed. ONIT took 22.5s. Estimated remaining: 1h 22m 9s. Rate: 9.4 symbols/min [2025-09-14T19:26:36.308466] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:36.338831] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-14T19:26:36.364122] [DEBUG] [LOCAL ] ONTO: Loaded 21010 existing records from primary storage. [2025-09-14T19:26:36.364291] [INFO ] [MAIN ] ONTO: Loaded 21010 existing records. [2025-09-14T19:26:36.548927] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:36.549211] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-14T19:26:36.549277] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-14T19:26:36.549854] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-14T19:26:36.549917] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-14T19:26:36.564055] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-14T19:26:36.920819] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:26:36.933484] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T19:26:37.358865] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-14T19:26:38.158893] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-14T19:26:38.269619] [DEBUG] [REMOTE ] ONTF: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-14T19:26:38.270098] [WARN ] [REMOTE ] ONTF: No data returned for month 2025-03 [2025-09-14T19:26:38.869090] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-14T19:26:38.957457] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T19:26:38.966254] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-14T19:26:39.758868] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-14T19:26:40.260877] [DEBUG] [REMOTE ] ONON: Error fetching primary data for 2025-04: Server request status code is 503. [2025-09-14T19:26:40.261384] [WARN ] [REMOTE ] ONON: No data returned for month 2025-04 [2025-09-14T19:26:40.558902] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-14T19:26:40.599176] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T19:26:41.358860] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-14T19:26:42.089855] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:26:42.095490] [INFO ] [REMOTE ] OMI: Full fetch complete (50065 records). [2025-09-14T19:26:42.095711] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-14T19:26:42.163984] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-14T19:26:42.500145] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-14T19:26:42.500307] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-14T19:26:42.501537] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-14T19:26:42.501601] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-14T19:26:42.503313] [DEBUG] [LOCAL ] OMI: Trimmed 50065 records to 34185 (keeping 150 days of data) [2025-09-14T19:26:42.720495] [DEBUG] [LOCAL ] OMI: Primary data saved (34185 records). [2025-09-14T19:26:42.720913] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-14T19:26:42.721067] [INFO ] [MAIN ] Update Progress: 1597/2370 symbols completed. OMI took 35.3s. Estimated remaining: 1h 22m 3s. Rate: 9.4 symbols/min [2025-09-14T19:26:42.781506] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-14T19:26:42.958835] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-14T19:26:43.268927] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T19:26:43.758853] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-14T19:26:44.558907] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-14T19:26:44.758772] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T19:26:44.891157] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T19:26:45.358881] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-14T19:26:46.158877] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-14T19:26:46.405201] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T19:26:46.778185] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T19:26:46.958922] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-14T19:26:47.758941] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-14T19:26:47.950847] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T19:26:48.558835] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-14T19:26:49.024300] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T19:26:49.056870] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T19:26:49.358874] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-14T19:26:50.158968] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-14T19:26:50.493278] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T19:26:50.571836] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T19:26:50.958907] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-14T19:26:51.758877] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-14T19:26:51.920377] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T19:26:51.923824] [INFO ] [REMOTE ] ONTF: Full fetch complete (20916 records). [2025-09-14T19:26:51.923949] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-14T19:26:52.111713] [WARN ] [VALIDATOR ] ONTF: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T19:26:52.112094] [FATAL] [MAIN ] ONTF: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:26:52.112150] [WARN ] [MAIN ] ONTF: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:26:52.112196] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-14T19:26:52.112576] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-09-14T19:26:52.112952] [INFO ] [LOCAL ] ONTF: Starting deletion of derivative data. [2025-09-14T19:26:52.113040] [DEBUG] [LOCAL ] ONTF: No derivative data file found to delete. [2025-09-14T19:26:52.113230] [INFO ] [MAIN ] Update Progress: 1598/2370 symbols completed. ONTF took 17.3s. Estimated remaining: 1h 21m 58s. Rate: 9.4 symbols/min [2025-09-14T19:26:52.387237] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-14T19:26:52.558866] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-14T19:26:53.181068] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T19:26:53.358911] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-14T19:26:54.407283] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-14T19:26:54.413168] [INFO ] [REMOTE ] ONON: Full fetch complete (50108 records). [2025-09-14T19:26:54.413357] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-14T19:26:54.640201] [WARN ] [VALIDATOR ] ONON: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T19:26:54.641023] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:26:54.641099] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:26:54.641156] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-14T19:26:54.641246] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-09-14T19:26:54.641298] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-09-14T19:26:54.641349] [DEBUG] [LOCAL ] ONON: No derivative data file found to delete. [2025-09-14T19:26:54.641470] [INFO ] [MAIN ] Update Progress: 1599/2370 symbols completed. ONON took 21.6s. Estimated remaining: 1h 21m 50s. Rate: 9.4 symbols/min [2025-09-14T19:26:54.793322] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T19:26:54.805107] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-14T19:26:56.650418] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T19:26:56.661626] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-14T19:26:57.402571] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:26:57.407778] [INFO ] [REMOTE ] ONTO: Full fetch complete (50428 records). [2025-09-14T19:26:57.407942] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-14T19:26:57.804537] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-14T19:26:57.804688] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-14T19:26:57.805684] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-14T19:26:57.805768] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-14T19:26:57.806873] [DEBUG] [LOCAL ] ONTO: Trimmed 50428 records to 35192 (keeping 150 days of data) [2025-09-14T19:26:58.048044] [DEBUG] [LOCAL ] ONTO: Primary data saved (35192 records). [2025-09-14T19:26:58.048378] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-14T19:26:58.048489] [INFO ] [MAIN ] Update Progress: 1600/2370 symbols completed. ONTO took 21.9s. Estimated remaining: 1h 21m 42s. Rate: 9.4 symbols/min [2025-09-14T19:26:58.724250] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:58.749751] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:58.823993] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:58.820965] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:26:58.834984] [DEBUG] [LOCAL ] OPP: Loaded 5014 existing records from primary storage. [2025-09-14T19:26:58.835526] [INFO ] [MAIN ] OPP: Loaded 5014 existing records. [2025-09-14T19:26:58.946584] [DEBUG] [LOCAL ] OOMA: Loaded 8824 existing records from primary storage. [2025-09-14T19:26:58.969880] [INFO ] [MAIN ] OOMA: Loaded 8824 existing records. [2025-09-14T19:26:58.970415] [DEBUG] [LOCAL ] OPAD: Loaded 14309 existing records from primary storage. [2025-09-14T19:26:58.987230] [INFO ] [MAIN ] OPAD: Loaded 14309 existing records. [2025-09-14T19:26:59.197937] [DEBUG] [LOCAL ] OPFI: Loaded 20972 existing records from primary storage. [2025-09-14T19:26:59.185030] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:59.282063] [INFO ] [MAIN ] OPFI: Loaded 20972 existing records. [2025-09-14T19:26:59.325372] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-14T19:26:59.355265] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-14T19:26:59.522679] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-14T19:26:59.667111] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:59.675391] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:59.675715] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-14T19:26:59.675882] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-14T19:26:59.686840] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-14T19:26:59.708882] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-14T19:26:59.714182] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-14T19:26:59.719533] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-14T19:26:59.807536] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:26:59.801260] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-14T19:26:59.801093] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-14T19:26:59.868125] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-14T19:26:59.890244] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-14T19:26:59.946835] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-14T19:26:59.999385] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-14T19:27:00.128580] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-14T19:27:01.286176] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:01.328944] [INFO ] [REMOTE ] OPP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:01.340700] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-14T19:27:01.338927] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-14T19:27:01.494632] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:01.519529] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:01.520107] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-14T19:27:01.521685] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-14T19:27:02.743373] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T19:27:02.745221] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-14T19:27:04.847246] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (3.51 seconds). [2025-09-14T19:27:04.850125] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-14T19:27:04.894879] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (3.37 seconds). [2025-09-14T19:27:04.898455] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-14T19:27:05.002092] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T19:27:05.004184] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-14T19:27:05.506131] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T19:27:05.509587] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-14T19:27:05.546725] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T19:27:05.550367] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-14T19:27:06.009007] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T19:27:06.012188] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T19:27:06.022718] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-14T19:27:06.024666] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-14T19:27:06.166907] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (4.65 seconds). [2025-09-14T19:27:06.177192] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-14T19:27:06.439737] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T19:27:06.443359] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-14T19:27:06.674777] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T19:27:06.768725] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T19:27:06.958923] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-14T19:27:07.436561] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T19:27:07.758871] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-14T19:27:08.119144] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T19:27:08.330608] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T19:27:08.558902] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-14T19:27:08.694283] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T19:27:09.358852] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-14T19:27:10.158808] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-14T19:27:10.460005] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T19:27:10.629692] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-14T19:27:10.958870] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-14T19:27:11.017090] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T19:27:11.758892] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-14T19:27:12.558880] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-14T19:27:12.749976] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-14T19:27:12.755293] [INFO ] [REMOTE ] OPAD: Full fetch complete (18207 records). [2025-09-14T19:27:12.755439] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-14T19:27:13.186406] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-14T19:27:13.189290] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T19:27:13.189417] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-14T19:27:13.195716] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-14T19:27:13.196772] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-14T19:27:13.197807] [DEBUG] [LOCAL ] OPAD: Trimmed 18207 records to 16216 (keeping 150 days of data) [2025-09-14T19:27:13.358991] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-14T19:27:13.365363] [DEBUG] [LOCAL ] OPAD: Primary data saved (16216 records). [2025-09-14T19:27:13.367247] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-14T19:27:13.367458] [INFO ] [MAIN ] Update Progress: 1601/2370 symbols completed. OPAD took 15.3s. Estimated remaining: 1h 21m 40s. Rate: 9.4 symbols/min [2025-09-14T19:27:13.638705] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T19:27:13.679849] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:27:13.689705] [DEBUG] [LOCAL ] OPY: Loaded 4080 existing records from primary storage. [2025-09-14T19:27:13.691605] [INFO ] [MAIN ] OPY: Loaded 4080 existing records. [2025-09-14T19:27:14.004633] [WARN ] [MAIN ] OPY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:27:14.007033] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-14T19:27:14.007167] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-14T19:27:14.008167] [DEBUG] [LOCAL ] OPY: Deleted primary data file. [2025-09-14T19:27:14.009342] [DEBUG] [LOCAL ] OPY: Removed from QA tracker. [2025-09-14T19:27:14.009434] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-14T19:27:14.164052] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-14T19:27:14.501488] [INFO ] [REMOTE ] OPY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:14.958891] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-14T19:27:15.361022] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T19:27:15.498278] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-14T19:27:15.758823] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-14T19:27:16.309188] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T19:27:16.558827] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-14T19:27:17.358852] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-14T19:27:17.629354] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T19:27:17.631791] [INFO ] [REMOTE ] OOMA: Full fetch complete (20362 records). [2025-09-14T19:27:17.631877] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-14T19:27:18.021272] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-14T19:27:18.021408] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-14T19:27:18.022004] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-14T19:27:18.022719] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-14T19:27:18.023515] [DEBUG] [LOCAL ] OOMA: Trimmed 20362 records to 13939 (keeping 150 days of data) [2025-09-14T19:27:18.119879] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-14T19:27:18.149325] [DEBUG] [LOCAL ] OOMA: Primary data saved (13939 records). [2025-09-14T19:27:18.149620] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-14T19:27:18.149756] [INFO ] [MAIN ] Update Progress: 1602/2370 symbols completed. OOMA took 20.1s. Estimated remaining: 1h 21m 33s. Rate: 9.4 symbols/min [2025-09-14T19:27:18.163880] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-14T19:27:18.321405] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:27:18.343657] [DEBUG] [LOCAL ] OR: Loaded 20404 existing records from primary storage. [2025-09-14T19:27:18.343833] [INFO ] [MAIN ] OR: Loaded 20404 existing records. [2025-09-14T19:27:18.523008] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:27:18.531878] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T19:27:18.535412] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-14T19:27:18.535815] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-14T19:27:18.536526] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-14T19:27:18.536590] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-14T19:27:18.890267] [INFO ] [REMOTE ] OR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:18.895349] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T19:27:18.958792] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-14T19:27:19.758882] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-14T19:27:19.825968] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T19:27:20.558892] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-14T19:27:21.048032] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T19:27:21.358868] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-14T19:27:21.376027] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T19:27:22.041452] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:27:22.043327] [INFO ] [REMOTE ] OPP: Full fetch complete (12804 records). [2025-09-14T19:27:22.043444] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-14T19:27:22.163899] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-14T19:27:22.417958] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-14T19:27:22.418067] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-14T19:27:22.418459] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-14T19:27:22.418511] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-14T19:27:22.419025] [DEBUG] [LOCAL ] OPP: Trimmed 12804 records to 8746 (keeping 150 days of data) [2025-09-14T19:27:22.472238] [DEBUG] [LOCAL ] OPP: Primary data saved (8746 records). [2025-09-14T19:27:22.472406] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-14T19:27:22.472505] [INFO ] [MAIN ] Update Progress: 1603/2370 symbols completed. OPP took 24.4s. Estimated remaining: 1h 21m 26s. Rate: 9.4 symbols/min [2025-09-14T19:27:22.638746] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:27:22.654177] [DEBUG] [LOCAL ] ORA: Loaded 15077 existing records from primary storage. [2025-09-14T19:27:22.654334] [INFO ] [MAIN ] ORA: Loaded 15077 existing records. [2025-09-14T19:27:22.832003] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:27:22.832245] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-14T19:27:22.832327] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-14T19:27:22.832835] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-14T19:27:22.832899] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-14T19:27:22.971397] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-14T19:27:23.185694] [INFO ] [REMOTE ] ORA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:23.758871] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-14T19:27:23.949995] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T19:27:24.558888] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-14T19:27:24.609517] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T19:27:24.825093] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T19:27:25.358839] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-14T19:27:26.047425] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T19:27:26.158857] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-14T19:27:26.884618] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T19:27:26.958818] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-14T19:27:27.691158] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T19:27:27.758853] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-14T19:27:28.558851] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-14T19:27:28.604840] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T19:27:29.358870] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-14T19:27:29.477295] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T19:27:30.158820] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-14T19:27:30.183113] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T19:27:30.513140] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T19:27:30.958856] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-14T19:27:31.736322] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T19:27:31.758804] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-14T19:27:32.170961] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T19:27:32.558849] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-14T19:27:33.001778] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T19:27:33.294365] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:27:33.296278] [INFO ] [REMOTE ] OPY: Full fetch complete (8174 records). [2025-09-14T19:27:33.296368] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-14T19:27:33.363998] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-14T19:27:33.481374] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:27:33.481675] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:27:33.481733] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:27:33.481784] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-14T19:27:33.481864] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-14T19:27:33.481915] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-14T19:27:33.481966] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-14T19:27:33.482061] [INFO ] [MAIN ] Update Progress: 1604/2370 symbols completed. OPY took 20.1s. Estimated remaining: 1h 21m 21s. Rate: 9.4 symbols/min [2025-09-14T19:27:33.648872] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:27:33.671373] [DEBUG] [LOCAL ] ORC: Loaded 23536 existing records from primary storage. [2025-09-14T19:27:33.671573] [INFO ] [MAIN ] ORC: Loaded 23536 existing records. [2025-09-14T19:27:33.845330] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:27:33.845679] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-14T19:27:33.845750] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-14T19:27:33.846457] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-14T19:27:33.846526] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-14T19:27:34.164069] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-14T19:27:34.202554] [INFO ] [REMOTE ] ORC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:34.958875] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-14T19:27:35.080737] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T19:27:35.681369] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T19:27:35.758780] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-14T19:27:36.529627] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T19:27:36.558786] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-14T19:27:36.799626] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T19:27:37.358852] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-14T19:27:38.163352] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-14T19:27:38.167228] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T19:27:38.811565] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T19:27:38.816214] [INFO ] [REMOTE ] OPFI: Full fetch complete (51366 records). [2025-09-14T19:27:38.816324] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-14T19:27:38.964443] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-14T19:27:39.237790] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-14T19:27:39.237979] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-14T19:27:39.239341] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-14T19:27:39.239436] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-14T19:27:39.240971] [DEBUG] [LOCAL ] OPFI: Trimmed 51366 records to 34815 (keeping 150 days of data) [2025-09-14T19:27:39.469192] [DEBUG] [LOCAL ] OPFI: Primary data saved (34815 records). [2025-09-14T19:27:39.469413] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-14T19:27:39.469562] [INFO ] [MAIN ] Update Progress: 1605/2370 symbols completed. OPFI took 41.4s. Estimated remaining: 1h 21m 15s. Rate: 9.4 symbols/min [2025-09-14T19:27:39.648579] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:27:39.674472] [DEBUG] [LOCAL ] ORCL: Loaded 24175 existing records from primary storage. [2025-09-14T19:27:39.674794] [INFO ] [MAIN ] ORCL: Loaded 24175 existing records. [2025-09-14T19:27:39.762040] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-14T19:27:39.869381] [WARN ] [MAIN ] ORCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:27:39.869774] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-14T19:27:39.869889] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-14T19:27:39.877949] [DEBUG] [LOCAL ] ORCL: Deleted primary data file. [2025-09-14T19:27:39.891201] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-14T19:27:39.927050] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T19:27:40.270065] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:40.558827] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-14T19:27:40.808635] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T19:27:41.230849] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T19:27:41.235964] [INFO ] [REMOTE ] OR: Full fetch complete (49705 records). [2025-09-14T19:27:41.236135] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-14T19:27:41.363563] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-14T19:27:41.622238] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-14T19:27:41.622411] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-14T19:27:41.623390] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-14T19:27:41.623475] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-14T19:27:41.624968] [DEBUG] [LOCAL ] OR: Trimmed 49705 records to 34207 (keeping 150 days of data) [2025-09-14T19:27:41.750467] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T19:27:41.888925] [DEBUG] [LOCAL ] OR: Primary data saved (34207 records). [2025-09-14T19:27:41.889121] [INFO ] [MAIN ] OR: Full history saved. [2025-09-14T19:27:41.889263] [INFO ] [MAIN ] Update Progress: 1606/2370 symbols completed. OR took 23.7s. Estimated remaining: 1h 21m 7s. Rate: 9.4 symbols/min [2025-09-14T19:27:42.063327] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:27:42.084478] [DEBUG] [LOCAL ] ORI: Loaded 21738 existing records from primary storage. [2025-09-14T19:27:42.084719] [INFO ] [MAIN ] ORI: Loaded 21738 existing records. [2025-09-14T19:27:42.163999] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-14T19:27:42.263783] [WARN ] [MAIN ] ORI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:27:42.264054] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-14T19:27:42.264137] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-14T19:27:42.264762] [DEBUG] [LOCAL ] ORI: Deleted primary data file. [2025-09-14T19:27:42.265285] [DEBUG] [LOCAL ] ORI: Removed from QA tracker. [2025-09-14T19:27:42.265343] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-14T19:27:42.622921] [INFO ] [REMOTE ] ORI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:42.930819] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T19:27:42.958780] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-14T19:27:43.233149] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:27:43.558327] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T19:27:43.561730] [INFO ] [REMOTE ] ORA: Full fetch complete (35706 records). [2025-09-14T19:27:43.561865] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-14T19:27:43.763925] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-14T19:27:43.939213] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-14T19:27:43.939324] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-14T19:27:43.940114] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-14T19:27:43.940177] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-14T19:27:43.941253] [DEBUG] [LOCAL ] ORA: Trimmed 35706 records to 24057 (keeping 150 days of data) [2025-09-14T19:27:44.102143] [DEBUG] [LOCAL ] ORA: Primary data saved (24057 records). [2025-09-14T19:27:44.102324] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-14T19:27:44.102444] [INFO ] [MAIN ] Update Progress: 1607/2370 symbols completed. ORA took 21.6s. Estimated remaining: 1h 20m 58s. Rate: 9.4 symbols/min [2025-09-14T19:27:44.278286] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:27:44.295540] [DEBUG] [LOCAL ] ORN: Loaded 13663 existing records from primary storage. [2025-09-14T19:27:44.295769] [INFO ] [MAIN ] ORN: Loaded 13663 existing records. [2025-09-14T19:27:44.470574] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:27:44.470855] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-14T19:27:44.470919] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-14T19:27:44.471294] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-14T19:27:44.471354] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-14T19:27:44.566319] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-14T19:27:44.827144] [INFO ] [REMOTE ] ORN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:45.358855] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-14T19:27:45.543168] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T19:27:46.061594] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-14T19:27:46.158834] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-14T19:27:46.317073] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T19:27:46.958906] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-14T19:27:47.035940] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T19:27:47.758871] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-14T19:27:48.558835] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-14T19:27:48.625827] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T19:27:49.208062] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-14T19:27:49.358864] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-14T19:27:50.141698] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T19:27:50.158783] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-14T19:27:50.958873] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-14T19:27:51.591715] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-14T19:27:51.758897] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-14T19:27:51.927123] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T19:27:52.038319] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T19:27:52.558925] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-14T19:27:53.358875] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-14T19:27:53.957927] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-14T19:27:54.158807] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-14T19:27:54.240256] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T19:27:54.778703] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T19:27:54.958850] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-14T19:27:55.758872] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-14T19:27:56.211854] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-14T19:27:56.245819] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T19:27:56.417134] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T19:27:56.558852] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-14T19:27:57.246569] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:27:57.251557] [INFO ] [REMOTE ] ORCL: Full fetch complete (58103 records). [2025-09-14T19:27:57.251698] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-14T19:27:57.363984] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-14T19:27:57.446628] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:27:57.447328] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:27:57.447387] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:27:57.447448] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-14T19:27:57.447523] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-14T19:27:57.447582] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-14T19:27:57.447658] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-14T19:27:57.447765] [INFO ] [MAIN ] Update Progress: 1608/2370 symbols completed. ORCL took 18.0s. Estimated remaining: 1h 20m 55s. Rate: 9.4 symbols/min [2025-09-14T19:27:57.621620] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:27:57.645976] [DEBUG] [LOCAL ] OSCR: Loaded 24179 existing records from primary storage. [2025-09-14T19:27:57.646157] [INFO ] [MAIN ] OSCR: Loaded 24179 existing records. [2025-09-14T19:27:57.827434] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:27:57.827744] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-14T19:27:57.827805] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-14T19:27:57.828467] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-14T19:27:57.828526] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-14T19:27:58.163995] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-14T19:27:58.186425] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:27:58.760049] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T19:27:58.958871] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-14T19:27:59.758812] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-14T19:28:00.040669] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-14T19:28:00.047563] [INFO ] [REMOTE ] ORC: Full fetch complete (56765 records). [2025-09-14T19:28:00.047716] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-14T19:28:00.469366] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-14T19:28:00.469524] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-14T19:28:00.470787] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-14T19:28:00.485749] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-14T19:28:00.487428] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T19:28:00.495156] [DEBUG] [LOCAL ] ORC: Trimmed 56765 records to 39449 (keeping 150 days of data) [2025-09-14T19:28:00.569701] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-14T19:28:00.763431] [DEBUG] [LOCAL ] ORC: Primary data saved (39449 records). [2025-09-14T19:28:00.763696] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-14T19:28:00.763883] [INFO ] [MAIN ] Update Progress: 1609/2370 symbols completed. ORC took 27.3s. Estimated remaining: 1h 20m 47s. Rate: 9.4 symbols/min [2025-09-14T19:28:00.938978] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:00.960994] [DEBUG] [LOCAL ] OSK: Loaded 18747 existing records from primary storage. [2025-09-14T19:28:00.961198] [INFO ] [MAIN ] OSK: Loaded 18747 existing records. [2025-09-14T19:28:01.140924] [WARN ] [MAIN ] OSK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:01.141204] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-14T19:28:01.141266] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-14T19:28:01.141913] [DEBUG] [LOCAL ] OSK: Deleted primary data file. [2025-09-14T19:28:01.142302] [DEBUG] [LOCAL ] OSK: Removed from QA tracker. [2025-09-14T19:28:01.142370] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-14T19:28:01.359089] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-14T19:28:01.515826] [INFO ] [REMOTE ] OSK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:01.740624] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T19:28:02.024132] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T19:28:02.158852] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-14T19:28:02.958893] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-14T19:28:03.506752] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-14T19:28:03.582079] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T19:28:03.758849] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-14T19:28:04.558838] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-14T19:28:04.827579] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T19:28:05.358870] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-14T19:28:05.903983] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T19:28:05.961945] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T19:28:06.158854] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-14T19:28:06.958862] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-14T19:28:07.362758] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T19:28:07.486205] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T19:28:07.744911] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T19:28:07.748279] [INFO ] [REMOTE ] ORN: Full fetch complete (34323 records). [2025-09-14T19:28:07.748440] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-14T19:28:07.763910] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-14T19:28:08.147038] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-14T19:28:08.147172] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-14T19:28:08.148307] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-14T19:28:08.148373] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-14T19:28:08.149500] [DEBUG] [LOCAL ] ORN: Trimmed 34323 records to 23351 (keeping 150 days of data) [2025-09-14T19:28:08.301990] [DEBUG] [LOCAL ] ORN: Primary data saved (23351 records). [2025-09-14T19:28:08.302380] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-14T19:28:08.302610] [INFO ] [MAIN ] Update Progress: 1610/2370 symbols completed. ORN took 24.2s. Estimated remaining: 1h 20m 42s. Rate: 9.4 symbols/min [2025-09-14T19:28:08.481056] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:08.491907] [DEBUG] [LOCAL ] OTF: Loaded 5568 existing records from primary storage. [2025-09-14T19:28:08.492119] [INFO ] [MAIN ] OTF: Loaded 5568 existing records. [2025-09-14T19:28:08.564085] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-14T19:28:08.681571] [WARN ] [MAIN ] OTF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:08.681915] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-14T19:28:08.681985] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-14T19:28:08.682266] [DEBUG] [LOCAL ] OTF: Deleted primary data file. [2025-09-14T19:28:08.682327] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-14T19:28:09.043430] [INFO ] [REMOTE ] OTF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:09.358973] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-14T19:28:09.896665] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T19:28:10.069343] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T19:28:10.158862] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-14T19:28:10.889329] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:28:10.894756] [INFO ] [REMOTE ] ORI: Full fetch complete (52885 records). [2025-09-14T19:28:10.894906] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-14T19:28:10.964167] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-14T19:28:11.092722] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:28:11.093468] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:28:11.093548] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:28:11.093609] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-14T19:28:11.093728] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-14T19:28:11.093795] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-14T19:28:11.093884] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-14T19:28:11.093995] [INFO ] [MAIN ] Update Progress: 1611/2370 symbols completed. ORI took 29.2s. Estimated remaining: 1h 20m 34s. Rate: 9.4 symbols/min [2025-09-14T19:28:11.265817] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:11.293853] [DEBUG] [LOCAL ] OTIS: Loaded 23745 existing records from primary storage. [2025-09-14T19:28:11.294060] [INFO ] [MAIN ] OTIS: Loaded 23745 existing records. [2025-09-14T19:28:11.474555] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:11.474986] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-14T19:28:11.475135] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-14T19:28:11.485251] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-14T19:28:11.502718] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-14T19:28:11.510402] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T19:28:11.763946] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-14T19:28:11.889090] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:12.558832] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-14T19:28:12.859237] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:28:12.859606] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-14T19:28:13.358853] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-14T19:28:13.668184] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-14T19:28:13.729164] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:28:13.729536] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-14T19:28:13.764188] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T19:28:14.158861] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-14T19:28:14.958869] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-14T19:28:15.758854] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-14T19:28:16.558878] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-14T19:28:16.761333] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T19:28:16.813721] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:28:16.814130] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-14T19:28:16.858386] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-14T19:28:17.286326] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T19:28:17.358846] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-14T19:28:18.158844] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-14T19:28:18.403504] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:28:18.403919] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-14T19:28:18.958841] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-14T19:28:19.672536] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T19:28:19.758786] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-14T19:28:20.084241] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-14T19:28:20.558879] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-14T19:28:21.321074] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T19:28:21.358793] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-14T19:28:22.158922] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-14T19:28:22.958897] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-14T19:28:23.195516] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-14T19:28:23.318309] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T19:28:23.521667] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T19:28:23.743403] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-14T19:28:23.758761] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-14T19:28:24.558866] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-14T19:28:24.610287] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T19:28:25.358931] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-14T19:28:26.158910] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-14T19:28:26.357287] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:28:26.361575] [INFO ] [REMOTE ] OTF: Full fetch complete (5844 records). [2025-09-14T19:28:26.361993] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-14T19:28:26.599497] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 64 unique days, need 150 days [2025-09-14T19:28:26.599767] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:28:26.599822] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:28:26.599874] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-14T19:28:26.599942] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-14T19:28:26.599999] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-14T19:28:26.600058] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-14T19:28:26.600350] [INFO ] [MAIN ] Update Progress: 1612/2370 symbols completed. OTF took 18.3s. Estimated remaining: 1h 20m 32s. Rate: 9.4 symbols/min [2025-09-14T19:28:26.774323] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:26.796217] [DEBUG] [LOCAL ] OUT: Loaded 21607 existing records from primary storage. [2025-09-14T19:28:26.796390] [INFO ] [MAIN ] OUT: Loaded 21607 existing records. [2025-09-14T19:28:26.960083] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-14T19:28:26.981806] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:26.983481] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-14T19:28:26.983580] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-14T19:28:26.984388] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-14T19:28:26.984519] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-14T19:28:27.076906] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-14T19:28:27.109352] [INFO ] [REMOTE ] OSCR: Full fetch complete (58358 records). [2025-09-14T19:28:27.135450] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-14T19:28:27.581311] [INFO ] [REMOTE ] OUT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:27.759265] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-14T19:28:27.793986] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-14T19:28:27.794087] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-14T19:28:27.795096] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-14T19:28:27.795154] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-14T19:28:27.796757] [DEBUG] [LOCAL ] OSCR: Trimmed 58358 records to 40515 (keeping 150 days of data) [2025-09-14T19:28:28.066983] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T19:28:28.102272] [DEBUG] [LOCAL ] OSCR: Primary data saved (40515 records). [2025-09-14T19:28:28.102435] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-14T19:28:28.102553] [INFO ] [MAIN ] Update Progress: 1613/2370 symbols completed. OSCR took 30.7s. Estimated remaining: 1h 20m 23s. Rate: 9.4 symbols/min [2025-09-14T19:28:28.284847] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:28.310039] [DEBUG] [LOCAL ] OVV: Loaded 23928 existing records from primary storage. [2025-09-14T19:28:28.310232] [INFO ] [MAIN ] OVV: Loaded 23928 existing records. [2025-09-14T19:28:28.491390] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:28.491702] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-14T19:28:28.491767] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-14T19:28:28.492547] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-14T19:28:28.492622] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-14T19:28:28.566721] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-14T19:28:28.861376] [INFO ] [REMOTE ] OVV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:28.886886] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T19:28:29.358862] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-14T19:28:29.490517] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T19:28:29.735176] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T19:28:29.740312] [INFO ] [REMOTE ] OSK: Full fetch complete (45886 records). [2025-09-14T19:28:29.740443] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-14T19:28:29.927690] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:28:29.928242] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:28:29.928297] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:28:29.928345] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-14T19:28:29.928429] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-14T19:28:29.928481] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-14T19:28:29.928530] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-14T19:28:29.928626] [INFO ] [MAIN ] Update Progress: 1614/2370 symbols completed. OSK took 29.2s. Estimated remaining: 1h 20m 14s. Rate: 9.4 symbols/min [2025-09-14T19:28:30.096309] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:30.122488] [DEBUG] [LOCAL ] OWL: Loaded 23945 existing records from primary storage. [2025-09-14T19:28:30.122758] [INFO ] [MAIN ] OWL: Loaded 23945 existing records. [2025-09-14T19:28:30.168222] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-14T19:28:30.322005] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:30.322495] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-14T19:28:30.322604] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-14T19:28:30.323474] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-14T19:28:30.323548] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-14T19:28:30.709514] [INFO ] [REMOTE ] OWL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:30.712936] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-14T19:28:30.958841] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-14T19:28:31.758893] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-14T19:28:31.841209] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T19:28:32.558846] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-14T19:28:32.758609] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T19:28:33.358858] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-14T19:28:33.823377] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T19:28:34.158822] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-14T19:28:34.361431] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T19:28:34.751375] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T19:28:34.958889] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-14T19:28:35.758864] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-14T19:28:36.125078] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T19:28:36.558835] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-14T19:28:36.953859] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T19:28:37.207235] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:28:37.212801] [INFO ] [REMOTE ] OTIS: Full fetch complete (57308 records). [2025-09-14T19:28:37.212957] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-14T19:28:37.368222] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-14T19:28:37.606338] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-14T19:28:37.606580] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-14T19:28:37.607770] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-14T19:28:37.607938] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-14T19:28:37.609417] [DEBUG] [LOCAL ] OTIS: Trimmed 57308 records to 39660 (keeping 150 days of data) [2025-09-14T19:28:37.739504] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T19:28:37.907483] [DEBUG] [LOCAL ] OTIS: Primary data saved (39660 records). [2025-09-14T19:28:37.907691] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-14T19:28:37.907797] [INFO ] [MAIN ] Update Progress: 1615/2370 symbols completed. OTIS took 26.8s. Estimated remaining: 1h 20m 9s. Rate: 9.4 symbols/min [2025-09-14T19:28:38.076374] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:38.082968] [DEBUG] [LOCAL ] OWLT: Loaded 4817 existing records from primary storage. [2025-09-14T19:28:38.083097] [INFO ] [MAIN ] OWLT: Loaded 4817 existing records. [2025-09-14T19:28:38.164099] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-14T19:28:38.261687] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:38.262005] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-14T19:28:38.262066] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-14T19:28:38.262360] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-14T19:28:38.262418] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-14T19:28:38.637287] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:38.958840] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-14T19:28:39.433854] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-14T19:28:39.758881] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-14T19:28:40.027015] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T19:28:40.558826] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-14T19:28:40.765267] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T19:28:41.358900] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-14T19:28:41.759224] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T19:28:41.948187] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T19:28:42.098694] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T19:28:42.158873] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-14T19:28:42.958865] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-14T19:28:43.758859] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-14T19:28:43.994271] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T19:28:44.558822] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-14T19:28:44.587475] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T19:28:45.358837] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-14T19:28:45.544542] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T19:28:46.166666] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-14T19:28:46.172227] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T19:28:46.721230] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T19:28:46.756980] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T19:28:46.958851] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-14T19:28:47.758851] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-14T19:28:48.407170] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T19:28:48.558874] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-14T19:28:48.742222] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T19:28:49.358829] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-14T19:28:50.158876] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-14T19:28:50.326189] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T19:28:50.900813] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T19:28:50.909143] [INFO ] [REMOTE ] OWL: Full fetch complete (58225 records). [2025-09-14T19:28:50.909508] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-14T19:28:50.969131] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-14T19:28:51.030421] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:28:51.385603] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-14T19:28:51.385785] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-14T19:28:51.387829] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-14T19:28:51.387904] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-14T19:28:51.389725] [DEBUG] [LOCAL ] OWL: Trimmed 58225 records to 40303 (keeping 150 days of data) [2025-09-14T19:28:51.654652] [DEBUG] [LOCAL ] OWL: Primary data saved (40303 records). [2025-09-14T19:28:51.654819] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-14T19:28:51.654926] [INFO ] [MAIN ] Update Progress: 1616/2370 symbols completed. OWL took 21.7s. Estimated remaining: 1h 20m 6s. Rate: 9.4 symbols/min [2025-09-14T19:28:51.764026] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-14T19:28:51.828242] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:51.843705] [DEBUG] [LOCAL ] OXM: Loaded 14865 existing records from primary storage. [2025-09-14T19:28:51.843865] [INFO ] [MAIN ] OXM: Loaded 14865 existing records. [2025-09-14T19:28:52.025804] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:52.026112] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-14T19:28:52.026190] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-14T19:28:52.026864] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-14T19:28:52.026940] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-14T19:28:52.400972] [INFO ] [REMOTE ] OXM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:52.558868] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-14T19:28:52.685780] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T19:28:52.756226] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T19:28:53.358850] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-14T19:28:53.900001] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T19:28:54.158876] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-14T19:28:54.958896] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-14T19:28:55.234133] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T19:28:55.253605] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T19:28:55.758861] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-14T19:28:56.482472] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T19:28:56.497592] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T19:28:56.558851] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-14T19:28:57.269528] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:28:57.275302] [INFO ] [REMOTE ] OVV: Full fetch complete (58143 records). [2025-09-14T19:28:57.275591] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-14T19:28:57.363962] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-14T19:28:57.671711] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-14T19:28:57.671830] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-14T19:28:57.672891] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-14T19:28:57.673006] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-14T19:28:57.674338] [DEBUG] [LOCAL ] OVV: Trimmed 58143 records to 40277 (keeping 150 days of data) [2025-09-14T19:28:57.943239] [DEBUG] [LOCAL ] OVV: Primary data saved (40277 records). [2025-09-14T19:28:57.943417] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-14T19:28:57.943522] [INFO ] [MAIN ] Update Progress: 1617/2370 symbols completed. OVV took 29.8s. Estimated remaining: 1h 19m 59s. Rate: 9.4 symbols/min [2025-09-14T19:28:58.110985] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:58.134093] [DEBUG] [LOCAL ] OXY: Loaded 24207 existing records from primary storage. [2025-09-14T19:28:58.134270] [INFO ] [MAIN ] OXY: Loaded 24207 existing records. [2025-09-14T19:28:58.167710] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-14T19:28:58.315183] [WARN ] [MAIN ] OXY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:58.315458] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-14T19:28:58.315538] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-14T19:28:58.316401] [DEBUG] [LOCAL ] OXY: Deleted primary data file. [2025-09-14T19:28:58.316466] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-14T19:28:58.671486] [INFO ] [REMOTE ] OXY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:28:58.706767] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T19:28:58.903988] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:28:58.909157] [INFO ] [REMOTE ] OUT: Full fetch complete (52342 records). [2025-09-14T19:28:58.909360] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-14T19:28:58.963940] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-14T19:28:59.324571] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-14T19:28:59.324704] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-14T19:28:59.328809] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-14T19:28:59.328905] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-14T19:28:59.330230] [DEBUG] [LOCAL ] OUT: Trimmed 52342 records to 36209 (keeping 150 days of data) [2025-09-14T19:28:59.567472] [DEBUG] [LOCAL ] OUT: Primary data saved (36209 records). [2025-09-14T19:28:59.567674] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-14T19:28:59.567793] [INFO ] [MAIN ] Update Progress: 1618/2370 symbols completed. OUT took 33.0s. Estimated remaining: 1h 19m 51s. Rate: 9.4 symbols/min [2025-09-14T19:28:59.736954] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:28:59.759502] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-14T19:28:59.760091] [DEBUG] [LOCAL ] PAAS: Loaded 24064 existing records from primary storage. [2025-09-14T19:28:59.761097] [INFO ] [MAIN ] PAAS: Loaded 24064 existing records. [2025-09-14T19:28:59.943450] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:28:59.943783] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-14T19:28:59.943867] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-14T19:28:59.944763] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-14T19:28:59.944842] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-14T19:29:00.306033] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:00.558840] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-14T19:29:00.619760] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T19:29:00.621214] [INFO ] [REMOTE ] OWLT: Full fetch complete (9096 records). [2025-09-14T19:29:00.621308] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-14T19:29:01.001124] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-14T19:29:01.001337] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-14T19:29:01.001636] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-14T19:29:01.001746] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-14T19:29:01.002310] [DEBUG] [LOCAL ] OWLT: Trimmed 9096 records to 6949 (keeping 150 days of data) [2025-09-14T19:29:01.043501] [DEBUG] [LOCAL ] OWLT: Primary data saved (6949 records). [2025-09-14T19:29:01.043736] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-14T19:29:01.043875] [INFO ] [MAIN ] Update Progress: 1619/2370 symbols completed. OWLT took 23.1s. Estimated remaining: 1h 19m 42s. Rate: 9.4 symbols/min [2025-09-14T19:29:01.220747] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:01.227909] [DEBUG] [LOCAL ] PAC: Loaded 5021 existing records from primary storage. [2025-09-14T19:29:01.228093] [INFO ] [MAIN ] PAC: Loaded 5021 existing records. [2025-09-14T19:29:01.373895] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-14T19:29:01.423846] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:01.424264] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-14T19:29:01.424363] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-14T19:29:01.424720] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-14T19:29:01.424781] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-14T19:29:01.785625] [INFO ] [REMOTE ] PAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:01.817532] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-09-14T19:29:02.158861] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-14T19:29:02.759294] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T19:29:02.882519] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-14T19:29:02.958779] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-14T19:29:03.758871] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-14T19:29:04.558832] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-14T19:29:04.734234] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-14T19:29:04.760148] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T19:29:05.033299] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T19:29:05.358854] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-14T19:29:06.125366] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T19:29:06.141048] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T19:29:06.158769] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-14T19:29:06.958871] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-14T19:29:07.316846] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-14T19:29:07.758845] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-14T19:29:08.424129] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T19:29:08.558814] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-14T19:29:09.358884] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-14T19:29:10.158816] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-14T19:29:10.310780] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T19:29:10.440143] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-14T19:29:10.726146] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T19:29:10.958818] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-14T19:29:11.587628] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T19:29:11.758845] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-14T19:29:12.558904] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-14T19:29:13.083059] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-14T19:29:13.125055] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:29:13.129129] [INFO ] [REMOTE ] OXM: Full fetch complete (35655 records). [2025-09-14T19:29:13.129265] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-14T19:29:13.364054] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-14T19:29:13.525176] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-14T19:29:13.525347] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-14T19:29:13.527018] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-14T19:29:13.527128] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-14T19:29:13.529120] [DEBUG] [LOCAL ] OXM: Trimmed 35655 records to 24739 (keeping 150 days of data) [2025-09-14T19:29:13.704747] [DEBUG] [LOCAL ] OXM: Primary data saved (24739 records). [2025-09-14T19:29:13.704994] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-14T19:29:13.705135] [INFO ] [MAIN ] Update Progress: 1620/2370 symbols completed. OXM took 22.1s. Estimated remaining: 1h 19m 39s. Rate: 9.4 symbols/min [2025-09-14T19:29:13.885667] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:13.902235] [DEBUG] [LOCAL ] PACK: Loaded 13755 existing records from primary storage. [2025-09-14T19:29:13.902452] [INFO ] [MAIN ] PACK: Loaded 13755 existing records. [2025-09-14T19:29:14.105703] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:14.106571] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-14T19:29:14.106639] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-14T19:29:14.107433] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-14T19:29:14.107506] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-14T19:29:14.167181] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-14T19:29:14.485488] [INFO ] [REMOTE ] PACK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:14.554628] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-14T19:29:14.953718] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T19:29:14.958769] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-14T19:29:15.611914] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-14T19:29:15.758837] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-14T19:29:15.942345] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T19:29:16.558890] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-14T19:29:17.358898] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-14T19:29:17.424230] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:29:18.158954] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-14T19:29:18.419859] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-14T19:29:18.881034] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:29:18.895436] [INFO ] [REMOTE ] PAC: Full fetch complete (12862 records). [2025-09-14T19:29:18.895875] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-14T19:29:18.972401] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-14T19:29:19.344279] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-14T19:29:19.344421] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-14T19:29:19.345513] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-14T19:29:19.345628] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-14T19:29:19.347181] [DEBUG] [LOCAL ] PAC: Trimmed 12862 records to 8602 (keeping 150 days of data) [2025-09-14T19:29:19.434361] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T19:29:19.461086] [DEBUG] [LOCAL ] PAC: Primary data saved (8602 records). [2025-09-14T19:29:19.461333] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-14T19:29:19.461469] [INFO ] [MAIN ] Update Progress: 1621/2370 symbols completed. PAC took 18.4s. Estimated remaining: 1h 19m 32s. Rate: 9.4 symbols/min [2025-09-14T19:29:19.638195] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:19.656464] [DEBUG] [LOCAL ] PACS: Loaded 15712 existing records from primary storage. [2025-09-14T19:29:19.656709] [INFO ] [MAIN ] PACS: Loaded 15712 existing records. [2025-09-14T19:29:19.759182] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-14T19:29:19.843818] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:19.844166] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-14T19:29:19.844229] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-14T19:29:19.844902] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-14T19:29:19.844969] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-14T19:29:20.155975] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T19:29:20.246007] [INFO ] [REMOTE ] PACS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:20.558862] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-14T19:29:21.358944] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-14T19:29:21.920922] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T19:29:22.033255] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:29:22.158836] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-14T19:29:22.958905] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-14T19:29:23.758870] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-14T19:29:23.834123] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-14T19:29:23.870220] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T19:29:24.067536] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-14T19:29:24.072936] [INFO ] [REMOTE ] PAAS: Full fetch complete (58248 records). [2025-09-14T19:29:24.073052] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-14T19:29:24.486957] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-14T19:29:24.487168] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-14T19:29:24.489357] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-14T19:29:24.489474] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-14T19:29:24.491470] [DEBUG] [LOCAL ] PAAS: Trimmed 58248 records to 40365 (keeping 150 days of data) [2025-09-14T19:29:24.560421] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-14T19:29:24.758146] [DEBUG] [LOCAL ] PAAS: Primary data saved (40365 records). [2025-09-14T19:29:24.758373] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-14T19:29:24.758514] [INFO ] [MAIN ] Update Progress: 1622/2370 symbols completed. PAAS took 25.2s. Estimated remaining: 1h 19m 25s. Rate: 9.4 symbols/min [2025-09-14T19:29:24.933247] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:24.957979] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T19:29:24.972160] [DEBUG] [LOCAL ] PAG: Loaded 9287 existing records from primary storage. [2025-09-14T19:29:24.972307] [INFO ] [MAIN ] PAG: Loaded 9287 existing records. [2025-09-14T19:29:25.154028] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:25.154414] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-14T19:29:25.154483] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-14T19:29:25.154911] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-14T19:29:25.155002] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-14T19:29:25.364003] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-14T19:29:25.512406] [INFO ] [REMOTE ] PAG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:25.913026] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T19:29:26.158830] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-14T19:29:26.958848] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-14T19:29:27.698939] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T19:29:27.758808] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-14T19:29:27.990178] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-14T19:29:28.095183] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T19:29:28.558882] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-14T19:29:29.151165] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T19:29:29.358817] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-14T19:29:29.583415] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T19:29:30.158834] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-14T19:29:30.912600] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:29:30.958786] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-14T19:29:31.342065] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T19:29:31.758895] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-14T19:29:32.164189] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T19:29:32.558856] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-14T19:29:33.017075] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T19:29:33.358830] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-14T19:29:33.562355] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T19:29:34.158809] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-14T19:29:34.686539] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T19:29:34.958823] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-14T19:29:35.591164] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T19:29:35.758832] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-14T19:29:36.174183] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T19:29:36.178353] [INFO ] [REMOTE ] PACS: Full fetch complete (36599 records). [2025-09-14T19:29:36.178453] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-14T19:29:36.568846] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-14T19:29:36.583530] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-14T19:29:36.583681] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-14T19:29:36.584527] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-14T19:29:36.584724] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-14T19:29:36.585598] [DEBUG] [LOCAL ] PACS: Trimmed 36599 records to 25091 (keeping 150 days of data) [2025-09-14T19:29:36.738914] [DEBUG] [LOCAL ] PACS: Primary data saved (25091 records). [2025-09-14T19:29:36.739094] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-14T19:29:36.739201] [INFO ] [MAIN ] Update Progress: 1623/2370 symbols completed. PACS took 17.3s. Estimated remaining: 1h 19m 21s. Rate: 9.4 symbols/min [2025-09-14T19:29:36.918627] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:36.931852] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T19:29:36.958596] [DEBUG] [LOCAL ] PAGS: Loaded 23532 existing records from primary storage. [2025-09-14T19:29:36.958814] [INFO ] [MAIN ] PAGS: Loaded 23532 existing records. [2025-09-14T19:29:37.149189] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:37.149441] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-14T19:29:37.149502] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-14T19:29:37.150254] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-14T19:29:37.150328] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-14T19:29:37.364064] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-14T19:29:37.509083] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:38.087482] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:29:38.092869] [INFO ] [REMOTE ] OXY: Full fetch complete (58086 records). [2025-09-14T19:29:38.093064] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-14T19:29:38.170106] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-14T19:29:38.318314] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:29:38.319789] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:29:38.319930] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:29:38.319990] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-14T19:29:38.320216] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-14T19:29:38.320311] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-14T19:29:38.320524] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-14T19:29:38.327831] [INFO ] [MAIN ] Update Progress: 1624/2370 symbols completed. OXY took 40.4s. Estimated remaining: 1h 19m 13s. Rate: 9.4 symbols/min [2025-09-14T19:29:38.375181] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T19:29:38.531929] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:38.535529] [DEBUG] [LOCAL ] PAI: Loaded 1334 existing records from primary storage. [2025-09-14T19:29:38.535661] [INFO ] [MAIN ] PAI: Loaded 1334 existing records. [2025-09-14T19:29:38.713169] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:38.713479] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-14T19:29:38.713543] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-14T19:29:38.713782] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-14T19:29:38.713854] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-14T19:29:38.963999] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-14T19:29:39.078466] [INFO ] [REMOTE ] PAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:39.469563] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T19:29:39.758849] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-14T19:29:40.558847] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-14T19:29:40.711019] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T19:29:40.957095] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T19:29:40.961110] [INFO ] [REMOTE ] PACK: Full fetch complete (34446 records). [2025-09-14T19:29:40.961244] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-14T19:29:41.339593] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-14T19:29:41.339812] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-14T19:29:41.340724] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-14T19:29:41.340817] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-14T19:29:41.341801] [DEBUG] [LOCAL ] PACK: Trimmed 34446 records to 23281 (keeping 150 days of data) [2025-09-14T19:29:41.387717] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-14T19:29:41.477534] [DEBUG] [LOCAL ] PACK: Primary data saved (23281 records). [2025-09-14T19:29:41.477703] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-14T19:29:41.477804] [INFO ] [MAIN ] Update Progress: 1625/2370 symbols completed. PACK took 27.8s. Estimated remaining: 1h 19m 5s. Rate: 9.4 symbols/min [2025-09-14T19:29:41.648917] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:41.650918] [DEBUG] [LOCAL ] PAII: Loaded 22 existing records from primary storage. [2025-09-14T19:29:41.651008] [INFO ] [MAIN ] PAII: Loaded 22 existing records. [2025-09-14T19:29:41.829849] [WARN ] [MAIN ] PAII: Insufficient historical data. Have data from 2025-09-10, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:41.830238] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-14T19:29:41.830331] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-14T19:29:41.830751] [DEBUG] [LOCAL ] PAII: Deleted primary data file. [2025-09-14T19:29:41.830855] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-14T19:29:41.992100] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-14T19:29:42.134714] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:29:42.163807] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-14T19:29:42.222327] [INFO ] [REMOTE ] PAII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:42.843869] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T19:29:42.958810] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-14T19:29:43.201579] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:29:43.201978] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-14T19:29:43.758860] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-14T19:29:44.558876] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-14T19:29:44.802487] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:29:44.802878] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-14T19:29:45.358864] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-14T19:29:45.574479] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T19:29:46.158834] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-14T19:29:46.190402] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T19:29:46.514130] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-14T19:29:46.958892] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-14T19:29:47.492690] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T19:29:47.494886] [INFO ] [REMOTE ] PAG: Full fetch complete (24231 records). [2025-09-14T19:29:47.494976] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-14T19:29:47.764080] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-14T19:29:47.870754] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-14T19:29:47.870891] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-14T19:29:47.871464] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-14T19:29:47.871522] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-14T19:29:47.872487] [DEBUG] [LOCAL ] PAG: Trimmed 24231 records to 15705 (keeping 150 days of data) [2025-09-14T19:29:47.971936] [DEBUG] [LOCAL ] PAG: Primary data saved (15705 records). [2025-09-14T19:29:47.972112] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-14T19:29:47.972223] [INFO ] [MAIN ] Update Progress: 1626/2370 symbols completed. PAG took 23.2s. Estimated remaining: 1h 18m 59s. Rate: 9.4 symbols/min [2025-09-14T19:29:48.142333] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:48.155067] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T19:29:48.162044] [DEBUG] [LOCAL ] PAM: Loaded 12752 existing records from primary storage. [2025-09-14T19:29:48.162201] [INFO ] [MAIN ] PAM: Loaded 12752 existing records. [2025-09-14T19:29:48.339682] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:48.340013] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-14T19:29:48.340099] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-14T19:29:48.340775] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-14T19:29:48.340862] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-14T19:29:48.564011] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-14T19:29:48.710341] [INFO ] [REMOTE ] PAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:49.212125] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T19:29:49.358807] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-14T19:29:49.876384] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T19:29:50.158822] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-14T19:29:50.774779] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T19:29:50.958951] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-14T19:29:51.214117] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:29:51.214490] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-14T19:29:51.758856] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-14T19:29:52.558860] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-14T19:29:53.358899] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-14T19:29:53.626619] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T19:29:53.663504] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T19:29:53.982322] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T19:29:53.983677] [INFO ] [REMOTE ] PAI: Full fetch complete (2922 records). [2025-09-14T19:29:53.983763] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-14T19:29:54.164061] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-14T19:29:54.348369] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-14T19:29:54.348496] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-14T19:29:54.348657] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-14T19:29:54.348717] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-14T19:29:54.349120] [DEBUG] [LOCAL ] PAI: Trimmed 2922 records to 1976 (keeping 150 days of data) [2025-09-14T19:29:54.361944] [DEBUG] [LOCAL ] PAI: Primary data saved (1976 records). [2025-09-14T19:29:54.362026] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-14T19:29:54.362129] [INFO ] [MAIN ] Update Progress: 1627/2370 symbols completed. PAI took 16.0s. Estimated remaining: 1h 18m 52s. Rate: 9.4 symbols/min [2025-09-14T19:29:54.535208] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:29:54.535482] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:29:54.536160] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-14T19:29:54.551323] [DEBUG] [LOCAL ] PAR: Loaded 15105 existing records from primary storage. [2025-09-14T19:29:54.551467] [INFO ] [MAIN ] PAR: Loaded 15105 existing records. [2025-09-14T19:29:54.735095] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:29:54.735573] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-14T19:29:54.735673] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-14T19:29:54.736198] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-14T19:29:54.736274] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-14T19:29:54.964106] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-14T19:29:55.102974] [INFO ] [REMOTE ] PAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:29:55.758899] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-14T19:29:56.558844] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-14T19:29:56.702564] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T19:29:57.169054] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T19:29:57.358850] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-14T19:29:57.866244] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T19:29:58.158859] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-14T19:29:58.751859] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:29:58.752262] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-14T19:29:58.776134] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T19:29:58.958893] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-14T19:29:59.758854] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-14T19:30:00.387854] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T19:30:00.558881] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-14T19:30:00.862284] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:30:00.862678] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-14T19:30:01.358869] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-14T19:30:01.737180] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-14T19:30:02.158921] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-14T19:30:02.958826] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-14T19:30:03.758846] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-14T19:30:04.831500] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:30:04.831878] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-14T19:30:04.832333] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-14T19:30:04.849435] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (3.49 seconds). [2025-09-14T19:30:05.151564] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T19:30:05.152269] [INFO ] [REMOTE ] PAII: Full fetch complete (22 records). [2025-09-14T19:30:05.152358] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-14T19:30:05.327957] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 3 unique days, need 150 days [2025-09-14T19:30:05.328158] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:30:05.328212] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:30:05.328253] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-14T19:30:05.328320] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-14T19:30:05.328368] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-14T19:30:05.328415] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-14T19:30:05.328488] [INFO ] [MAIN ] Update Progress: 1628/2370 symbols completed. PAII took 23.9s. Estimated remaining: 1h 18m 48s. Rate: 9.4 symbols/min [2025-09-14T19:30:05.371362] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-14T19:30:05.508630] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:05.531992] [DEBUG] [LOCAL ] PARR: Loaded 21929 existing records from primary storage. [2025-09-14T19:30:05.532186] [INFO ] [MAIN ] PARR: Loaded 21929 existing records. [2025-09-14T19:30:05.715026] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:05.715305] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-14T19:30:05.715377] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-14T19:30:05.715977] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-14T19:30:05.716041] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-14T19:30:06.071559] [INFO ] [REMOTE ] PARR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:06.158797] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-14T19:30:06.283550] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-14T19:30:06.380186] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (3.42 seconds). [2025-09-14T19:30:06.910589] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T19:30:06.958791] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-14T19:30:07.607562] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T19:30:07.758875] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-14T19:30:08.558864] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-14T19:30:08.607791] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T19:30:09.359179] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T19:30:09.359259] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-14T19:30:10.004594] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T19:30:10.158823] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-14T19:30:10.633065] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T19:30:10.958970] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-14T19:30:11.532387] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T19:30:11.758897] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-14T19:30:12.558904] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-14T19:30:12.691754] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:30:13.358822] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-14T19:30:13.836577] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T19:30:13.866468] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T19:30:14.158886] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-14T19:30:14.319116] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T19:30:14.323678] [INFO ] [REMOTE ] PAM: Full fetch complete (30131 records). [2025-09-14T19:30:14.323974] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-14T19:30:14.710997] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-14T19:30:14.711124] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-14T19:30:14.712007] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-14T19:30:14.712068] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-14T19:30:14.713326] [DEBUG] [LOCAL ] PAM: Trimmed 30131 records to 20366 (keeping 150 days of data) [2025-09-14T19:30:14.843047] [DEBUG] [LOCAL ] PAM: Primary data saved (20366 records). [2025-09-14T19:30:14.843219] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-14T19:30:14.843330] [INFO ] [MAIN ] Update Progress: 1629/2370 symbols completed. PAM took 26.9s. Estimated remaining: 1h 18m 43s. Rate: 9.4 symbols/min [2025-09-14T19:30:14.964028] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-14T19:30:15.021626] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:15.047389] [DEBUG] [LOCAL ] PATH: Loaded 24114 existing records from primary storage. [2025-09-14T19:30:15.047567] [INFO ] [MAIN ] PATH: Loaded 24114 existing records. [2025-09-14T19:30:15.229488] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:15.229775] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-14T19:30:15.229840] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-14T19:30:15.230562] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-14T19:30:15.230633] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-14T19:30:15.600662] [INFO ] [REMOTE ] PATH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:15.758798] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-14T19:30:15.790128] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T19:30:15.798027] [INFO ] [REMOTE ] PAGS: Full fetch complete (57233 records). [2025-09-14T19:30:15.798303] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-14T19:30:16.190682] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-14T19:30:16.190796] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-14T19:30:16.191807] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-14T19:30:16.191865] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-14T19:30:16.193020] [DEBUG] [LOCAL ] PAGS: Trimmed 57233 records to 39690 (keeping 150 days of data) [2025-09-14T19:30:16.447156] [DEBUG] [LOCAL ] PAGS: Primary data saved (39690 records). [2025-09-14T19:30:16.447337] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-14T19:30:16.447456] [INFO ] [MAIN ] Update Progress: 1630/2370 symbols completed. PAGS took 39.7s. Estimated remaining: 1h 18m 35s. Rate: 9.4 symbols/min [2025-09-14T19:30:16.564110] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-14T19:30:16.624595] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:16.636232] [DEBUG] [LOCAL ] PAXS: Loaded 9522 existing records from primary storage. [2025-09-14T19:30:16.636507] [INFO ] [MAIN ] PAXS: Loaded 9522 existing records. [2025-09-14T19:30:16.812889] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:16.813162] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-14T19:30:16.813228] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-14T19:30:16.813556] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-14T19:30:16.813612] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-14T19:30:17.161749] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:17.358844] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-14T19:30:17.778951] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-14T19:30:18.158884] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-14T19:30:18.365635] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T19:30:18.403276] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T19:30:18.878762] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (3.12 seconds). [2025-09-14T19:30:18.958807] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-14T19:30:19.155059] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:30:19.160720] [INFO ] [REMOTE ] PAR: Full fetch complete (35121 records). [2025-09-14T19:30:19.160886] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-14T19:30:19.536078] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-14T19:30:19.536213] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-14T19:30:19.537076] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-14T19:30:19.537208] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-14T19:30:19.538585] [DEBUG] [LOCAL ] PAR: Trimmed 35121 records to 24234 (keeping 150 days of data) [2025-09-14T19:30:19.696809] [DEBUG] [LOCAL ] PAR: Primary data saved (24234 records). [2025-09-14T19:30:19.697042] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-14T19:30:19.697218] [INFO ] [MAIN ] Update Progress: 1631/2370 symbols completed. PAR took 25.3s. Estimated remaining: 1h 18m 27s. Rate: 9.4 symbols/min [2025-09-14T19:30:19.764053] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-14T19:30:19.872734] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:19.891139] [DEBUG] [LOCAL ] PAY: Loaded 17524 existing records from primary storage. [2025-09-14T19:30:19.891341] [INFO ] [MAIN ] PAY: Loaded 17524 existing records. [2025-09-14T19:30:20.111659] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:20.111949] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-14T19:30:20.112025] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-14T19:30:20.112577] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-14T19:30:20.112688] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-14T19:30:20.474104] [INFO ] [REMOTE ] PAY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:20.558855] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-14T19:30:21.358872] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-14T19:30:21.557846] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-14T19:30:21.603360] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T19:30:21.626376] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:30:22.158821] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-14T19:30:22.661558] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T19:30:22.958826] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-14T19:30:23.100548] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T19:30:23.758829] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-14T19:30:24.558837] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-14T19:30:24.654754] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T19:30:25.296971] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T19:30:25.358808] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-14T19:30:25.415275] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T19:30:26.158865] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-14T19:30:26.858566] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T19:30:26.939100] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T19:30:26.958804] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-14T19:30:27.758857] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-14T19:30:28.170593] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T19:30:28.558832] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-14T19:30:28.884817] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T19:30:29.358835] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-14T19:30:30.158856] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-14T19:30:30.430844] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T19:30:30.639809] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-14T19:30:30.958904] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-14T19:30:31.509439] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T19:30:31.758895] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-14T19:30:32.113851] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T19:30:32.116564] [INFO ] [REMOTE ] PAXS: Full fetch complete (22376 records). [2025-09-14T19:30:32.116733] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-14T19:30:32.513281] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-14T19:30:32.513435] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-14T19:30:32.514211] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-14T19:30:32.514319] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-14T19:30:32.515432] [DEBUG] [LOCAL ] PAXS: Trimmed 22376 records to 15963 (keeping 150 days of data) [2025-09-14T19:30:32.559703] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-14T19:30:32.628055] [DEBUG] [LOCAL ] PAXS: Primary data saved (15963 records). [2025-09-14T19:30:32.628340] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-14T19:30:32.628495] [INFO ] [MAIN ] Update Progress: 1632/2370 symbols completed. PAXS took 16.2s. Estimated remaining: 1h 18m 23s. Rate: 9.4 symbols/min [2025-09-14T19:30:32.812926] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:32.833133] [DEBUG] [LOCAL ] PAYC: Loaded 15755 existing records from primary storage. [2025-09-14T19:30:32.833321] [INFO ] [MAIN ] PAYC: Loaded 15755 existing records. [2025-09-14T19:30:33.015284] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:33.015591] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-14T19:30:33.015677] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-14T19:30:33.016326] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-14T19:30:33.016405] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-14T19:30:33.361965] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-14T19:30:33.389159] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:34.113374] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T19:30:34.150716] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T19:30:34.158796] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-14T19:30:34.958856] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-14T19:30:35.088630] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:30:35.758828] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-14T19:30:36.094136] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T19:30:36.510221] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:30:36.517531] [INFO ] [REMOTE ] PARR: Full fetch complete (52564 records). [2025-09-14T19:30:36.517783] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-14T19:30:36.563988] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-14T19:30:36.833726] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T19:30:36.966716] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-14T19:30:36.966846] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-14T19:30:36.967857] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-14T19:30:36.967916] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-14T19:30:36.969171] [DEBUG] [LOCAL ] PARR: Trimmed 52564 records to 36297 (keeping 150 days of data) [2025-09-14T19:30:37.196008] [DEBUG] [LOCAL ] PARR: Primary data saved (36297 records). [2025-09-14T19:30:37.196194] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-14T19:30:37.196315] [INFO ] [MAIN ] Update Progress: 1633/2370 symbols completed. PARR took 31.9s. Estimated remaining: 1h 18m 16s. Rate: 9.4 symbols/min [2025-09-14T19:30:37.365712] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-14T19:30:37.368789] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:37.390303] [DEBUG] [LOCAL ] PB: Loaded 19322 existing records from primary storage. [2025-09-14T19:30:37.390495] [INFO ] [MAIN ] PB: Loaded 19322 existing records. [2025-09-14T19:30:37.575146] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:37.575420] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-14T19:30:37.575517] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-14T19:30:37.576138] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-14T19:30:37.576205] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-14T19:30:37.934802] [INFO ] [REMOTE ] PB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:38.158830] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-14T19:30:38.220983] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:30:38.958851] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-14T19:30:39.520430] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-14T19:30:39.636962] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-14T19:30:39.758793] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-14T19:30:40.564578] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-14T19:30:40.571439] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T19:30:41.358882] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-14T19:30:41.837691] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T19:30:41.842754] [INFO ] [REMOTE ] PAY: Full fetch complete (40693 records). [2025-09-14T19:30:41.842929] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-14T19:30:42.160968] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-14T19:30:42.231856] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-14T19:30:42.232065] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-14T19:30:42.233103] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-14T19:30:42.233197] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-14T19:30:42.234978] [DEBUG] [LOCAL ] PAY: Trimmed 40693 records to 28848 (keeping 150 days of data) [2025-09-14T19:30:42.269628] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-14T19:30:42.453524] [DEBUG] [LOCAL ] PAY: Primary data saved (28848 records). [2025-09-14T19:30:42.453726] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-14T19:30:42.453833] [INFO ] [MAIN ] Update Progress: 1634/2370 symbols completed. PAY took 22.8s. Estimated remaining: 1h 18m 9s. Rate: 9.4 symbols/min [2025-09-14T19:30:42.628107] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:42.650536] [DEBUG] [LOCAL ] PBA: Loaded 22175 existing records from primary storage. [2025-09-14T19:30:42.650739] [INFO ] [MAIN ] PBA: Loaded 22175 existing records. [2025-09-14T19:30:42.834338] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:42.834927] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-14T19:30:42.835169] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-14T19:30:42.836170] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-14T19:30:42.836458] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-14T19:30:42.963591] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-14T19:30:43.184589] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T19:30:43.281701] [INFO ] [REMOTE ] PBA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:43.758936] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-14T19:30:43.872952] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T19:30:44.558948] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-14T19:30:45.117394] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-14T19:30:45.122896] [INFO ] [REMOTE ] PATH: Full fetch complete (58358 records). [2025-09-14T19:30:45.123055] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-14T19:30:45.359470] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-14T19:30:45.514363] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-14T19:30:45.514486] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-14T19:30:45.515679] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-14T19:30:45.515865] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-14T19:30:45.543851] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T19:30:45.543971] [DEBUG] [LOCAL ] PATH: Trimmed 58358 records to 40422 (keeping 150 days of data) [2025-09-14T19:30:45.825885] [DEBUG] [LOCAL ] PATH: Primary data saved (40422 records). [2025-09-14T19:30:45.826048] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-14T19:30:45.826156] [INFO ] [MAIN ] Update Progress: 1635/2370 symbols completed. PATH took 31.0s. Estimated remaining: 1h 18m 2s. Rate: 9.4 symbols/min [2025-09-14T19:30:45.996938] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:46.020505] [DEBUG] [LOCAL ] PBF: Loaded 23813 existing records from primary storage. [2025-09-14T19:30:46.020717] [INFO ] [MAIN ] PBF: Loaded 23813 existing records. [2025-09-14T19:30:46.163524] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-14T19:30:46.200893] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:46.202633] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-14T19:30:46.202730] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-14T19:30:46.203525] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-14T19:30:46.203658] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-14T19:30:46.383280] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T19:30:46.603635] [INFO ] [REMOTE ] PBF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:46.813395] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T19:30:46.958902] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-14T19:30:47.758787] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-14T19:30:47.796955] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T19:30:48.558873] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-14T19:30:48.779152] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T19:30:49.357275] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T19:30:49.365298] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-14T19:30:50.158862] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-14T19:30:50.226506] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T19:30:50.867609] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T19:30:50.958834] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-14T19:30:51.191143] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T19:30:51.758842] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-14T19:30:52.189189] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T19:30:52.558857] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-14T19:30:53.358895] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-14T19:30:53.502116] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T19:30:54.158873] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-14T19:30:54.224275] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T19:30:54.844063] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T19:30:54.958863] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-14T19:30:55.758921] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-14T19:30:55.946263] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T19:30:56.540054] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T19:30:56.558769] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-14T19:30:57.238967] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:30:57.243773] [INFO ] [REMOTE ] PB: Full fetch complete (44264 records). [2025-09-14T19:30:57.243953] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-14T19:30:57.365402] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-14T19:30:57.616783] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-14T19:30:57.626858] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-14T19:30:57.641959] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-14T19:30:57.645121] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-14T19:30:57.647555] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T19:30:57.658516] [DEBUG] [LOCAL ] PB: Trimmed 44264 records to 31174 (keeping 150 days of data) [2025-09-14T19:30:57.850669] [DEBUG] [LOCAL ] PB: Primary data saved (31174 records). [2025-09-14T19:30:57.850842] [INFO ] [MAIN ] PB: Full history saved. [2025-09-14T19:30:57.850952] [INFO ] [MAIN ] Update Progress: 1636/2370 symbols completed. PB took 20.7s. Estimated remaining: 1h 17m 58s. Rate: 9.4 symbols/min [2025-09-14T19:30:58.017617] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:30:58.032551] [DEBUG] [LOCAL ] PBH: Loaded 15090 existing records from primary storage. [2025-09-14T19:30:58.032717] [INFO ] [MAIN ] PBH: Loaded 15090 existing records. [2025-09-14T19:30:58.170889] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-14T19:30:58.208172] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:30:58.208365] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-14T19:30:58.208426] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-14T19:30:58.208945] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-14T19:30:58.209006] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-14T19:30:58.593692] [INFO ] [REMOTE ] PBH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:30:58.958807] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-14T19:30:59.039257] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:30:59.564613] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T19:30:59.758827] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-14T19:31:00.558875] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-14T19:31:01.137704] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-14T19:31:01.327812] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:31:01.332393] [INFO ] [REMOTE ] PAYC: Full fetch complete (39902 records). [2025-09-14T19:31:01.332503] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-14T19:31:01.363952] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-14T19:31:01.730959] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-14T19:31:01.731594] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-14T19:31:01.732742] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-14T19:31:01.732815] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-14T19:31:01.734184] [DEBUG] [LOCAL ] PAYC: Trimmed 39902 records to 26500 (keeping 150 days of data) [2025-09-14T19:31:01.873701] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-14T19:31:01.966912] [DEBUG] [LOCAL ] PAYC: Primary data saved (26500 records). [2025-09-14T19:31:01.967099] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-14T19:31:01.967206] [INFO ] [MAIN ] Update Progress: 1637/2370 symbols completed. PAYC took 29.3s. Estimated remaining: 1h 17m 50s. Rate: 9.4 symbols/min [2025-09-14T19:31:02.158853] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-14T19:31:02.958884] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-14T19:31:03.129469] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T19:31:03.417847] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T19:31:03.758910] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-14T19:31:04.558954] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-14T19:31:04.830107] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:31:05.053921] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T19:31:05.358906] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-14T19:31:05.790429] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T19:31:05.795784] [INFO ] [REMOTE ] PBA: Full fetch complete (53557 records). [2025-09-14T19:31:05.795904] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-14T19:31:06.163534] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-14T19:31:06.188258] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-14T19:31:06.188390] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-14T19:31:06.189457] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-14T19:31:06.189527] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-14T19:31:06.191152] [DEBUG] [LOCAL ] PBA: Trimmed 53557 records to 36908 (keeping 150 days of data) [2025-09-14T19:31:06.425716] [DEBUG] [LOCAL ] PBA: Primary data saved (36908 records). [2025-09-14T19:31:06.425921] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-14T19:31:06.426026] [INFO ] [MAIN ] Update Progress: 1638/2370 symbols completed. PBA took 24.0s. Estimated remaining: 1h 17m 43s. Rate: 9.4 symbols/min [2025-09-14T19:31:06.820072] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T19:31:06.958809] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-14T19:31:08.209950] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-14T19:31:08.221839] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-14T19:31:08.396188] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T19:31:08.564073] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-14T19:31:08.567998] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T19:31:08.573980] [INFO ] [REMOTE ] PBF: Full fetch complete (57674 records). [2025-09-14T19:31:08.574173] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-14T19:31:08.981418] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-14T19:31:08.981542] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-14T19:31:08.982611] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-14T19:31:08.982700] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-14T19:31:08.983947] [DEBUG] [LOCAL ] PBF: Trimmed 57674 records to 40016 (keeping 150 days of data) [2025-09-14T19:31:09.254253] [DEBUG] [LOCAL ] PBF: Primary data saved (40016 records). [2025-09-14T19:31:09.254465] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-14T19:31:09.254601] [INFO ] [MAIN ] Update Progress: 1639/2370 symbols completed. PBF took 23.4s. Estimated remaining: 1h 17m 35s. Rate: 9.4 symbols/min [2025-09-14T19:31:09.985297] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T19:31:09.991721] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-14T19:31:11.480096] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T19:31:11.487824] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-14T19:31:13.357725] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T19:31:13.366221] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-14T19:31:14.101882] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:31:14.106783] [INFO ] [REMOTE ] PBH: Full fetch complete (33513 records). [2025-09-14T19:31:14.107394] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-14T19:31:14.483835] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-14T19:31:14.484024] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-14T19:31:14.484803] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-14T19:31:14.484865] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-14T19:31:14.485902] [DEBUG] [LOCAL ] PBH: Trimmed 33513 records to 23964 (keeping 150 days of data) [2025-09-14T19:31:14.658306] [DEBUG] [LOCAL ] PBH: Primary data saved (23964 records). [2025-09-14T19:31:14.658484] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-14T19:31:14.658592] [INFO ] [MAIN ] Update Progress: 1640/2370 symbols completed. PBH took 16.8s. Estimated remaining: 1h 17m 28s. Rate: 9.4 symbols/min [2025-09-14T19:31:15.351460] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:15.366511] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:15.371493] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:15.347986] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:15.388184] [DEBUG] [LOCAL ] PBT: Loaded 8723 existing records from primary storage. [2025-09-14T19:31:15.388779] [INFO ] [MAIN ] PBT: Loaded 8723 existing records. [2025-09-14T19:31:15.427369] [DEBUG] [LOCAL ] PCF: Loaded 4366 existing records from primary storage. [2025-09-14T19:31:15.453752] [INFO ] [MAIN ] PCF: Loaded 4366 existing records. [2025-09-14T19:31:15.652733] [DEBUG] [LOCAL ] PBI: Loaded 22765 existing records from primary storage. [2025-09-14T19:31:15.663906] [DEBUG] [LOCAL ] PBR: Loaded 24134 existing records from primary storage. [2025-09-14T19:31:15.722697] [INFO ] [MAIN ] PBI: Loaded 22765 existing records. [2025-09-14T19:31:15.717323] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:15.722591] [INFO ] [MAIN ] PBR: Loaded 24134 existing records. [2025-09-14T19:31:15.756955] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-14T19:31:15.794992] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-14T19:31:15.878095] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:15.908900] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-14T19:31:15.996535] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-14T19:31:16.002355] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-14T19:31:16.103124] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-14T19:31:16.144541] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:16.186264] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-14T19:31:16.212967] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-14T19:31:16.213202] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-14T19:31:16.305266] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-14T19:31:16.398461] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-14T19:31:16.393250] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:16.445445] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-14T19:31:16.429718] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-14T19:31:16.506304] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-14T19:31:16.643473] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-14T19:31:16.693856] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-14T19:31:17.186663] [INFO ] [REMOTE ] PBT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:17.341363] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-14T19:31:17.620025] [INFO ] [REMOTE ] PCF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:17.678320] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-14T19:31:17.693854] [INFO ] [REMOTE ] PBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:17.735341] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-14T19:31:17.757138] [INFO ] [REMOTE ] PBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:17.758411] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-14T19:31:18.646799] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T19:31:18.650626] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-14T19:31:18.765383] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:31:18.768571] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-14T19:31:19.577990] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:31:19.580588] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-14T19:31:19.646630] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T19:31:19.657371] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-14T19:31:19.837215] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-14T19:31:19.847974] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-14T19:31:20.003100] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T19:31:20.008159] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-14T19:31:20.176999] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-14T19:31:20.179909] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-14T19:31:20.797759] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T19:31:20.802162] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-14T19:31:20.962629] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T19:31:21.228216] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T19:31:21.358927] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-14T19:31:21.878046] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T19:31:22.062912] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T19:31:22.158815] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-14T19:31:22.922294] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T19:31:22.958832] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-14T19:31:23.758852] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-14T19:31:24.336695] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-14T19:31:24.558829] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-14T19:31:24.573594] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T19:31:24.683082] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T19:31:25.358834] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-14T19:31:26.158824] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-14T19:31:26.944153] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-14T19:31:26.958765] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-14T19:31:27.002712] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T19:31:27.100106] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T19:31:27.758848] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-14T19:31:28.267384] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T19:31:28.558831] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-14T19:31:29.141251] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-14T19:31:29.358809] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-14T19:31:29.709855] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T19:31:30.158825] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-14T19:31:30.958838] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-14T19:31:31.351091] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T19:31:31.758848] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-14T19:31:32.049023] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T19:31:32.350960] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-14T19:31:32.558825] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-14T19:31:33.195127] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T19:31:33.358883] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-14T19:31:33.366431] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T19:31:34.158835] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-14T19:31:34.308027] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T19:31:34.310042] [INFO ] [REMOTE ] PCF: Full fetch complete (10034 records). [2025-09-14T19:31:34.310137] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-14T19:31:34.676381] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-14T19:31:34.676516] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-14T19:31:34.676882] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-14T19:31:34.676941] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-14T19:31:34.677417] [DEBUG] [LOCAL ] PCF: Trimmed 10034 records to 6661 (keeping 150 days of data) [2025-09-14T19:31:34.720105] [DEBUG] [LOCAL ] PCF: Primary data saved (6661 records). [2025-09-14T19:31:34.720278] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-14T19:31:34.720386] [INFO ] [MAIN ] Update Progress: 1641/2370 symbols completed. PCF took 20.1s. Estimated remaining: 1h 17m 28s. Rate: 9.4 symbols/min [2025-09-14T19:31:34.903579] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:34.932087] [DEBUG] [LOCAL ] PCG: Loaded 24080 existing records from primary storage. [2025-09-14T19:31:34.932271] [INFO ] [MAIN ] PCG: Loaded 24080 existing records. [2025-09-14T19:31:34.958824] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-14T19:31:35.124549] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:35.124852] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-14T19:31:35.124971] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-14T19:31:35.125943] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-09-14T19:31:35.126014] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-14T19:31:35.502544] [INFO ] [REMOTE ] PCG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:35.758807] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-14T19:31:35.966027] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T19:31:35.969894] [INFO ] [REMOTE ] PBT: Full fetch complete (18876 records). [2025-09-14T19:31:35.970052] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-14T19:31:36.353149] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-14T19:31:36.353285] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-14T19:31:36.353891] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-14T19:31:36.354002] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-14T19:31:36.354795] [DEBUG] [LOCAL ] PBT: Trimmed 18876 records to 13455 (keeping 150 days of data) [2025-09-14T19:31:36.450320] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-14T19:31:36.480902] [DEBUG] [LOCAL ] PBT: Primary data saved (13455 records). [2025-09-14T19:31:36.481057] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-14T19:31:36.481167] [INFO ] [MAIN ] Update Progress: 1642/2370 symbols completed. PBT took 21.8s. Estimated remaining: 1h 17m 20s. Rate: 9.4 symbols/min [2025-09-14T19:31:36.563909] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-14T19:31:36.650128] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:36.654605] [DEBUG] [LOCAL ] PCM: Loaded 2974 existing records from primary storage. [2025-09-14T19:31:36.654728] [INFO ] [MAIN ] PCM: Loaded 2974 existing records. [2025-09-14T19:31:36.831676] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:36.831960] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-14T19:31:36.832037] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-14T19:31:36.832372] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-14T19:31:36.832436] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-14T19:31:37.186226] [INFO ] [REMOTE ] PCM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:37.279505] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:31:37.284822] [INFO ] [REMOTE ] PBI: Full fetch complete (54763 records). [2025-09-14T19:31:37.284940] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-14T19:31:37.363886] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-14T19:31:37.663673] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-14T19:31:37.663866] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-14T19:31:37.665093] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-14T19:31:37.665185] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-14T19:31:37.666659] [DEBUG] [LOCAL ] PBI: Trimmed 54763 records to 37490 (keeping 150 days of data) [2025-09-14T19:31:37.795868] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T19:31:37.954749] [DEBUG] [LOCAL ] PBI: Primary data saved (37490 records). [2025-09-14T19:31:37.954973] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-14T19:31:37.955119] [INFO ] [MAIN ] Update Progress: 1643/2370 symbols completed. PBI took 23.3s. Estimated remaining: 1h 17m 11s. Rate: 9.4 symbols/min [2025-09-14T19:31:38.136859] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:38.143724] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T19:31:38.156413] [DEBUG] [LOCAL ] PCN: Loaded 11161 existing records from primary storage. [2025-09-14T19:31:38.156602] [INFO ] [MAIN ] PCN: Loaded 11161 existing records. [2025-09-14T19:31:38.167837] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-14T19:31:38.343291] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:38.343595] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-14T19:31:38.343677] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-14T19:31:38.344104] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-14T19:31:38.344162] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-14T19:31:38.735796] [INFO ] [REMOTE ] PCN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:38.958890] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-14T19:31:38.978508] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:31:39.758912] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-14T19:31:40.023261] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T19:31:40.558856] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-14T19:31:41.300178] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T19:31:41.358808] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-14T19:31:41.746924] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T19:31:42.158826] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-14T19:31:42.717866] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T19:31:42.958819] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-14T19:31:42.985050] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T19:31:42.990606] [INFO ] [REMOTE ] PBR: Full fetch complete (58398 records). [2025-09-14T19:31:42.990768] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-14T19:31:43.378381] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-14T19:31:43.378508] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-14T19:31:43.379801] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-14T19:31:43.379888] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-14T19:31:43.381331] [DEBUG] [LOCAL ] PBR: Trimmed 58398 records to 40462 (keeping 150 days of data) [2025-09-14T19:31:43.653813] [DEBUG] [LOCAL ] PBR: Primary data saved (40462 records). [2025-09-14T19:31:43.654008] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-14T19:31:43.654179] [INFO ] [MAIN ] Update Progress: 1644/2370 symbols completed. PBR took 29.0s. Estimated remaining: 1h 17m 4s. Rate: 9.4 symbols/min [2025-09-14T19:31:43.764034] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-14T19:31:43.827811] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:43.848770] [DEBUG] [LOCAL ] PCOR: Loaded 21684 existing records from primary storage. [2025-09-14T19:31:43.848949] [INFO ] [MAIN ] PCOR: Loaded 21684 existing records. [2025-09-14T19:31:44.026062] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:44.026362] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-14T19:31:44.026744] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-14T19:31:44.027308] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-14T19:31:44.027383] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-14T19:31:44.391205] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:44.407734] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T19:31:44.554189] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:31:44.558778] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-14T19:31:45.358884] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-14T19:31:46.130775] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T19:31:46.158791] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-14T19:31:46.958851] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-14T19:31:47.252652] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T19:31:47.284568] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T19:31:47.758869] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-14T19:31:48.558893] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-14T19:31:48.685574] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T19:31:49.358918] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-14T19:31:49.417253] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T19:31:49.521313] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T19:31:50.158881] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-14T19:31:50.714230] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T19:31:50.958850] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-14T19:31:51.373814] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T19:31:51.712979] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T19:31:51.758805] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-14T19:31:52.526008] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T19:31:52.558873] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-14T19:31:53.358840] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-14T19:31:53.996049] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T19:31:53.997878] [INFO ] [REMOTE ] PCM: Full fetch complete (7276 records). [2025-09-14T19:31:53.997971] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-14T19:31:54.171721] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-14T19:31:54.375005] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-14T19:31:54.375131] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-14T19:31:54.375525] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-14T19:31:54.375616] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-14T19:31:54.376141] [DEBUG] [LOCAL ] PCM: Trimmed 7276 records to 4859 (keeping 150 days of data) [2025-09-14T19:31:54.407309] [DEBUG] [LOCAL ] PCM: Primary data saved (4859 records). [2025-09-14T19:31:54.407514] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-14T19:31:54.407718] [INFO ] [MAIN ] Update Progress: 1645/2370 symbols completed. PCM took 17.9s. Estimated remaining: 1h 17m 0s. Rate: 9.4 symbols/min [2025-09-14T19:31:54.589839] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:31:54.627444] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T19:31:54.631237] [DEBUG] [LOCAL ] PCQ: Loaded 5398 existing records from primary storage. [2025-09-14T19:31:54.642403] [INFO ] [MAIN ] PCQ: Loaded 5398 existing records. [2025-09-14T19:31:54.868522] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:31:54.868852] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-14T19:31:54.868916] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-14T19:31:54.869277] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-14T19:31:54.869339] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-14T19:31:54.968376] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-14T19:31:55.225053] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:31:55.758848] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-14T19:31:56.010926] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T19:31:56.558881] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-14T19:31:56.585692] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T19:31:56.949361] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T19:31:57.358875] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-14T19:31:57.722037] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T19:31:58.158855] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-14T19:31:58.958865] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-14T19:31:59.217564] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T19:31:59.759146] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-14T19:31:59.769628] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T19:31:59.934318] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T19:32:00.558853] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-14T19:32:01.098679] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T19:32:01.358895] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-14T19:32:01.690492] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T19:32:02.158885] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-14T19:32:02.958947] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-14T19:32:03.068260] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T19:32:03.105418] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T19:32:03.109174] [INFO ] [REMOTE ] PCN: Full fetch complete (25865 records). [2025-09-14T19:32:03.109285] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-14T19:32:03.492416] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-14T19:32:03.492571] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-14T19:32:03.493246] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-14T19:32:03.493309] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-14T19:32:03.494012] [DEBUG] [LOCAL ] PCN: Trimmed 25865 records to 18310 (keeping 150 days of data) [2025-09-14T19:32:03.608309] [DEBUG] [LOCAL ] PCN: Primary data saved (18310 records). [2025-09-14T19:32:03.608495] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-14T19:32:03.608611] [INFO ] [MAIN ] Update Progress: 1646/2370 symbols completed. PCN took 25.7s. Estimated remaining: 1h 16m 55s. Rate: 9.4 symbols/min [2025-09-14T19:32:03.763809] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-14T19:32:03.782840] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:03.793176] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T19:32:03.817008] [DEBUG] [LOCAL ] PD: Loaded 21986 existing records from primary storage. [2025-09-14T19:32:03.817199] [INFO ] [MAIN ] PD: Loaded 21986 existing records. [2025-09-14T19:32:03.997865] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:03.998173] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-14T19:32:03.998242] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-14T19:32:03.998954] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-14T19:32:03.999024] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-14T19:32:04.356142] [INFO ] [REMOTE ] PD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:04.558863] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-14T19:32:05.358897] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-14T19:32:05.595857] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T19:32:06.048668] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T19:32:06.158830] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-14T19:32:06.173492] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T19:32:06.958877] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-14T19:32:07.669747] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T19:32:07.702537] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T19:32:07.758863] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-14T19:32:08.436789] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:32:08.443220] [INFO ] [REMOTE ] PCG: Full fetch complete (58398 records). [2025-09-14T19:32:08.443487] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-14T19:32:08.563908] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-14T19:32:08.841316] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-09-14T19:32:08.841462] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-09-14T19:32:08.842892] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-09-14T19:32:08.842978] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-09-14T19:32:08.844515] [DEBUG] [LOCAL ] PCG: Trimmed 58398 records to 40459 (keeping 150 days of data) [2025-09-14T19:32:09.134746] [DEBUG] [LOCAL ] PCG: Primary data saved (40459 records). [2025-09-14T19:32:09.134918] [INFO ] [MAIN ] PCG: Full history saved. [2025-09-14T19:32:09.135021] [INFO ] [MAIN ] Update Progress: 1647/2370 symbols completed. PCG took 34.4s. Estimated remaining: 1h 16m 48s. Rate: 9.4 symbols/min [2025-09-14T19:32:09.304164] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:09.306489] [DEBUG] [LOCAL ] PDCC: Loaded 399 existing records from primary storage. [2025-09-14T19:32:09.306588] [INFO ] [MAIN ] PDCC: Loaded 399 existing records. [2025-09-14T19:32:09.368575] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-14T19:32:09.490395] [WARN ] [MAIN ] PDCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:09.490738] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-14T19:32:09.490804] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-14T19:32:09.491001] [DEBUG] [LOCAL ] PDCC: Deleted primary data file. [2025-09-14T19:32:09.491060] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-14T19:32:09.845359] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:10.158831] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-14T19:32:10.245319] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T19:32:10.459017] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T19:32:10.958917] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-14T19:32:11.267903] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T19:32:11.273070] [INFO ] [REMOTE ] PCOR: Full fetch complete (52676 records). [2025-09-14T19:32:11.273205] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-14T19:32:11.659804] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-14T19:32:11.659928] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-14T19:32:11.660921] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-14T19:32:11.660980] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-14T19:32:11.662389] [DEBUG] [LOCAL ] PCOR: Trimmed 52676 records to 35891 (keeping 150 days of data) [2025-09-14T19:32:11.763727] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-14T19:32:11.847480] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:32:11.870825] [INFO ] [REMOTE ] PCQ: Full fetch complete (12788 records). [2025-09-14T19:32:11.871258] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-14T19:32:12.238989] [DEBUG] [LOCAL ] PCOR: Primary data saved (35891 records). [2025-09-14T19:32:12.253357] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-14T19:32:12.263710] [INFO ] [MAIN ] Update Progress: 1648/2370 symbols completed. PCOR took 28.6s. Estimated remaining: 1h 16m 40s. Rate: 9.4 symbols/min [2025-09-14T19:32:12.278103] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-14T19:32:12.284283] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-14T19:32:12.349015] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-14T19:32:12.370515] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-14T19:32:12.407863] [DEBUG] [LOCAL ] PCQ: Trimmed 12788 records to 8802 (keeping 150 days of data) [2025-09-14T19:32:12.453186] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:12.524936] [DEBUG] [LOCAL ] PDI: Loaded 22369 existing records from primary storage. [2025-09-14T19:32:12.526215] [INFO ] [MAIN ] PDI: Loaded 22369 existing records. [2025-09-14T19:32:12.559367] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-14T19:32:12.588110] [DEBUG] [LOCAL ] PCQ: Primary data saved (8802 records). [2025-09-14T19:32:12.621534] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-14T19:32:12.640501] [INFO ] [MAIN ] Update Progress: 1649/2370 symbols completed. PCQ took 18.2s. Estimated remaining: 1h 16m 31s. Rate: 9.4 symbols/min [2025-09-14T19:32:12.760813] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:12.832040] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-14T19:32:12.843117] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-14T19:32:12.880016] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-14T19:32:12.887880] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-14T19:32:12.905712] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:13.091267] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T19:32:13.132993] [DEBUG] [LOCAL ] PDM: Loaded 16757 existing records from primary storage. [2025-09-14T19:32:13.179573] [INFO ] [MAIN ] PDM: Loaded 16757 existing records. [2025-09-14T19:32:13.372035] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-14T19:32:13.439627] [INFO ] [REMOTE ] PDI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:13.468017] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:13.468247] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-14T19:32:13.468321] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-14T19:32:13.468761] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-14T19:32:13.468833] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-14T19:32:13.841606] [INFO ] [REMOTE ] PDM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:13.867949] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-14T19:32:13.969599] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T19:32:14.158819] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-14T19:32:14.958833] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-14T19:32:15.483173] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T19:32:15.484759] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T19:32:15.758920] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-14T19:32:16.558923] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-14T19:32:17.319279] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T19:32:17.358913] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-14T19:32:18.102467] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T19:32:18.158890] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-14T19:32:18.958853] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-14T19:32:19.026998] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T19:32:19.303945] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-14T19:32:19.758795] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-14T19:32:19.789949] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T19:32:20.558885] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-14T19:32:21.358849] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-14T19:32:21.471745] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T19:32:21.740432] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T19:32:21.952750] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T19:32:22.158871] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-14T19:32:22.958838] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-14T19:32:23.304805] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-14T19:32:23.758870] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-14T19:32:24.156108] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T19:32:24.558829] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-14T19:32:25.358829] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-14T19:32:25.537483] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T19:32:26.016887] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T19:32:26.158806] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-14T19:32:26.562871] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T19:32:26.958828] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-14T19:32:27.054688] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T19:32:27.758828] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-14T19:32:28.558851] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-14T19:32:28.688390] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:32:29.358892] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-14T19:32:29.715635] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T19:32:29.803553] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T19:32:30.158831] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-14T19:32:30.939509] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T19:32:30.945322] [INFO ] [REMOTE ] PD: Full fetch complete (51298 records). [2025-09-14T19:32:30.945536] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-14T19:32:30.966862] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-14T19:32:31.337002] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-14T19:32:31.337117] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-14T19:32:31.338163] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-14T19:32:31.338242] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-14T19:32:31.339493] [DEBUG] [LOCAL ] PD: Trimmed 51298 records to 35887 (keeping 150 days of data) [2025-09-14T19:32:31.481194] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T19:32:31.605856] [DEBUG] [LOCAL ] PD: Primary data saved (35887 records). [2025-09-14T19:32:31.606051] [INFO ] [MAIN ] PD: Full history saved. [2025-09-14T19:32:31.606201] [INFO ] [MAIN ] Update Progress: 1650/2370 symbols completed. PD took 28.0s. Estimated remaining: 1h 16m 31s. Rate: 9.4 symbols/min [2025-09-14T19:32:31.761589] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-14T19:32:31.781145] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:31.802023] [DEBUG] [LOCAL ] PDO: Loaded 13789 existing records from primary storage. [2025-09-14T19:32:31.802248] [INFO ] [MAIN ] PDO: Loaded 13789 existing records. [2025-09-14T19:32:31.980660] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:31.980937] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-14T19:32:31.981005] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-14T19:32:31.981620] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-14T19:32:31.981714] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-14T19:32:32.082898] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T19:32:32.094569] [INFO ] [REMOTE ] PDCC: Full fetch complete (1162 records). [2025-09-14T19:32:32.110079] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-14T19:32:32.506238] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-14T19:32:32.548816] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:32:32.548593] [INFO ] [REMOTE ] PDO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:32.548993] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:32:32.549200] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-14T19:32:32.549751] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-14T19:32:32.549820] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-14T19:32:32.549887] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-14T19:32:32.550019] [INFO ] [MAIN ] Update Progress: 1651/2370 symbols completed. PDCC took 23.4s. Estimated remaining: 1h 16m 22s. Rate: 9.4 symbols/min [2025-09-14T19:32:32.564012] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-14T19:32:32.747629] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:32.762316] [DEBUG] [LOCAL ] PDS: Loaded 7176 existing records from primary storage. [2025-09-14T19:32:32.762517] [INFO ] [MAIN ] PDS: Loaded 7176 existing records. [2025-09-14T19:32:32.948833] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:32.949106] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-14T19:32:32.949173] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-14T19:32:32.949536] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-14T19:32:32.949598] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-14T19:32:33.329965] [INFO ] [REMOTE ] PDS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:33.363553] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-14T19:32:33.372433] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-14T19:32:33.697072] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:32:34.158844] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-14T19:32:34.405235] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T19:32:34.958895] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-14T19:32:35.474879] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T19:32:35.758862] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-14T19:32:35.844897] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:32:35.848936] [INFO ] [REMOTE ] PDM: Full fetch complete (43424 records). [2025-09-14T19:32:35.849047] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-14T19:32:36.223930] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-14T19:32:36.224086] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-14T19:32:36.225149] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-14T19:32:36.225232] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-14T19:32:36.226633] [DEBUG] [LOCAL ] PDM: Trimmed 43424 records to 29797 (keeping 150 days of data) [2025-09-14T19:32:36.413263] [DEBUG] [LOCAL ] PDM: Primary data saved (29797 records). [2025-09-14T19:32:36.413475] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-14T19:32:36.413587] [INFO ] [MAIN ] Update Progress: 1652/2370 symbols completed. PDM took 23.8s. Estimated remaining: 1h 16m 14s. Rate: 9.4 symbols/min [2025-09-14T19:32:36.564572] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-14T19:32:36.590525] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:36.601790] [DEBUG] [LOCAL ] PDT: Loaded 7975 existing records from primary storage. [2025-09-14T19:32:36.601939] [INFO ] [MAIN ] PDT: Loaded 7975 existing records. [2025-09-14T19:32:36.781918] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:36.782212] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-14T19:32:36.782273] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-14T19:32:36.782635] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-14T19:32:36.782720] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-14T19:32:37.148187] [INFO ] [REMOTE ] PDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:37.358789] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-14T19:32:37.626842] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T19:32:37.680291] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T19:32:38.158814] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-14T19:32:38.326085] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T19:32:38.958844] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-14T19:32:39.758785] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-14T19:32:39.870725] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-14T19:32:39.876342] [INFO ] [REMOTE ] PDI: Full fetch complete (54699 records). [2025-09-14T19:32:39.876511] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-14T19:32:40.281132] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-14T19:32:40.281868] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-14T19:32:40.282414] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T19:32:40.283608] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-14T19:32:40.287998] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-14T19:32:40.289937] [DEBUG] [LOCAL ] PDI: Trimmed 54699 records to 37523 (keeping 150 days of data) [2025-09-14T19:32:40.545087] [DEBUG] [LOCAL ] PDI: Primary data saved (37523 records). [2025-09-14T19:32:40.545240] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-14T19:32:40.545349] [INFO ] [MAIN ] Update Progress: 1653/2370 symbols completed. PDI took 28.3s. Estimated remaining: 1h 16m 7s. Rate: 9.4 symbols/min [2025-09-14T19:32:40.566672] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-14T19:32:40.761275] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:40.780212] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T19:32:40.789824] [DEBUG] [LOCAL ] PDX: Loaded 6055 existing records from primary storage. [2025-09-14T19:32:40.789952] [INFO ] [MAIN ] PDX: Loaded 6055 existing records. [2025-09-14T19:32:40.969571] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:40.969854] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-14T19:32:40.969918] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-14T19:32:40.970246] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-14T19:32:40.970307] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-14T19:32:41.324536] [INFO ] [REMOTE ] PDX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:41.358774] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-14T19:32:41.463219] [DEBUG] [REMOTE ] PDX: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-14T19:32:41.463590] [WARN ] [REMOTE ] PDX: No data returned for month 2025-02 [2025-09-14T19:32:42.158851] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-14T19:32:42.294056] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:32:42.761617] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T19:32:42.958832] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-14T19:32:43.758880] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-14T19:32:44.234747] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T19:32:44.558815] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-14T19:32:44.874025] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T19:32:45.358795] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-14T19:32:45.755799] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T19:32:46.033439] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T19:32:46.158786] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-14T19:32:46.958891] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-14T19:32:47.115775] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T19:32:47.662403] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-14T19:32:47.758866] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-14T19:32:48.558812] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-14T19:32:48.740592] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:32:49.358913] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-14T19:32:49.655408] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T19:32:50.158857] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-14T19:32:50.377388] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T19:32:50.958932] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-14T19:32:51.238159] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T19:32:51.758924] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-14T19:32:51.973496] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T19:32:52.336984] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T19:32:52.558842] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-14T19:32:53.358818] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-14T19:32:53.674602] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T19:32:54.158819] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-14T19:32:54.707726] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T19:32:54.721257] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:32:54.725242] [INFO ] [REMOTE ] PDS: Full fetch complete (20472 records). [2025-09-14T19:32:54.725396] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-14T19:32:54.964082] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-14T19:32:55.115268] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-14T19:32:55.115541] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-14T19:32:55.116578] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-14T19:32:55.116679] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-14T19:32:55.118061] [DEBUG] [LOCAL ] PDS: Trimmed 20472 records to 12577 (keeping 150 days of data) [2025-09-14T19:32:55.209883] [DEBUG] [LOCAL ] PDS: Primary data saved (12577 records). [2025-09-14T19:32:55.210129] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-14T19:32:55.210261] [INFO ] [MAIN ] Update Progress: 1654/2370 symbols completed. PDS took 22.7s. Estimated remaining: 1h 16m 4s. Rate: 9.4 symbols/min [2025-09-14T19:32:55.390027] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:32:55.416002] [DEBUG] [LOCAL ] PEB: Loaded 22431 existing records from primary storage. [2025-09-14T19:32:55.416227] [INFO ] [MAIN ] PEB: Loaded 22431 existing records. [2025-09-14T19:32:55.604506] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:32:55.604893] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-14T19:32:55.604964] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-14T19:32:55.605891] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-14T19:32:55.605960] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-14T19:32:55.766986] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-14T19:32:55.974116] [INFO ] [REMOTE ] PEB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:32:56.449361] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T19:32:56.558819] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-14T19:32:56.883403] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T19:32:57.328117] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T19:32:57.358849] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-14T19:32:58.158875] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-14T19:32:58.211115] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T19:32:58.958883] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-14T19:32:59.721108] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:32:59.758923] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-14T19:33:00.230586] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T19:33:00.235674] [INFO ] [REMOTE ] PDO: Full fetch complete (34676 records). [2025-09-14T19:33:00.235844] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-14T19:33:00.561289] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-14T19:33:00.653083] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-14T19:33:00.653256] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-14T19:33:00.654406] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-14T19:33:00.654501] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-14T19:33:00.655797] [DEBUG] [LOCAL ] PDO: Trimmed 34676 records to 23018 (keeping 150 days of data) [2025-09-14T19:33:00.755594] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:33:00.762393] [INFO ] [REMOTE ] PDT: Full fetch complete (19267 records). [2025-09-14T19:33:00.768046] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-14T19:33:01.182084] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-14T19:33:01.184589] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-14T19:33:01.189833] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-14T19:33:01.204851] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-14T19:33:01.209800] [DEBUG] [LOCAL ] PDO: Primary data saved (23018 records). [2025-09-14T19:33:01.210225] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-14T19:33:01.210458] [INFO ] [MAIN ] Update Progress: 1655/2370 symbols completed. PDO took 29.6s. Estimated remaining: 1h 15m 58s. Rate: 9.4 symbols/min [2025-09-14T19:33:01.210312] [DEBUG] [LOCAL ] PDT: Trimmed 19267 records to 13012 (keeping 150 days of data) [2025-09-14T19:33:01.363930] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-14T19:33:01.496949] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:01.521612] [DEBUG] [LOCAL ] PDT: Primary data saved (13012 records). [2025-09-14T19:33:01.521932] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-14T19:33:01.522099] [INFO ] [MAIN ] Update Progress: 1656/2370 symbols completed. PDT took 25.1s. Estimated remaining: 1h 15m 49s. Rate: 9.4 symbols/min [2025-09-14T19:33:01.755363] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:01.757102] [DEBUG] [LOCAL ] PEG: Loaded 23827 existing records from primary storage. [2025-09-14T19:33:01.757526] [INFO ] [MAIN ] PEG: Loaded 23827 existing records. [2025-09-14T19:33:01.916684] [DEBUG] [LOCAL ] PEN: Loaded 12599 existing records from primary storage. [2025-09-14T19:33:01.963219] [INFO ] [MAIN ] PEN: Loaded 12599 existing records. [2025-09-14T19:33:02.001389] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:02.081832] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-14T19:33:02.109204] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-14T19:33:02.119070] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-09-14T19:33:02.134608] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-14T19:33:02.287063] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:02.313845] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-14T19:33:02.319506] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-14T19:33:02.354393] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-14T19:33:02.381920] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-14T19:33:02.760436] [INFO ] [REMOTE ] PEG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:02.798171] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-14T19:33:02.953102] [INFO ] [REMOTE ] PEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:02.965374] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-14T19:33:02.986454] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-14T19:33:03.758865] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-14T19:33:04.016323] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-14T19:33:04.018446] [INFO ] [REMOTE ] PDX: Full fetch complete (14371 records). [2025-09-14T19:33:04.018547] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-14T19:33:04.209075] [WARN ] [VALIDATOR ] PDX: Validation failed - insufficient historical data. Have 135 unique days, need 150 days [2025-09-14T19:33:04.209476] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:33:04.209552] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:33:04.209696] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-14T19:33:04.209796] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-09-14T19:33:04.209855] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-09-14T19:33:04.209931] [DEBUG] [LOCAL ] PDX: No derivative data file found to delete. [2025-09-14T19:33:04.210034] [INFO ] [MAIN ] Update Progress: 1657/2370 symbols completed. PDX took 23.7s. Estimated remaining: 1h 15m 41s. Rate: 9.4 symbols/min [2025-09-14T19:33:04.393204] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:04.400255] [DEBUG] [LOCAL ] PEO: Loaded 5207 existing records from primary storage. [2025-09-14T19:33:04.400390] [INFO ] [MAIN ] PEO: Loaded 5207 existing records. [2025-09-14T19:33:04.584061] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:04.584336] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-14T19:33:04.584401] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-14T19:33:04.584988] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-14T19:33:04.585058] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-14T19:33:04.946394] [INFO ] [REMOTE ] PEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:04.946784] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-14T19:33:05.594184] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-14T19:33:05.601306] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-14T19:33:05.836565] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T19:33:06.012232] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (3.21 seconds). [2025-09-14T19:33:06.158852] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-14T19:33:06.373662] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-14T19:33:06.958896] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-14T19:33:07.157328] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T19:33:07.758897] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-14T19:33:07.784995] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T19:33:08.079442] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T19:33:08.558855] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-14T19:33:09.354701] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T19:33:09.363198] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-14T19:33:09.474742] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T19:33:10.158923] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-14T19:33:10.958900] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-14T19:33:11.078998] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T19:33:11.617510] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T19:33:11.758864] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-14T19:33:11.802748] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T19:33:12.558952] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-14T19:33:12.924252] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T19:33:13.358865] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-14T19:33:14.158864] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-14T19:33:14.908322] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T19:33:14.958782] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-14T19:33:15.225107] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T19:33:15.758878] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-14T19:33:16.403257] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-14T19:33:16.492065] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T19:33:16.558838] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-14T19:33:16.908315] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T19:33:17.358835] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-14T19:33:18.039973] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T19:33:18.158833] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-14T19:33:18.958844] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-14T19:33:19.390451] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T19:33:19.427869] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T19:33:19.758841] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-14T19:33:20.525411] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T19:33:20.558846] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-14T19:33:20.653484] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T19:33:21.358851] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-14T19:33:22.085438] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T19:33:22.158820] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-14T19:33:22.958830] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-14T19:33:23.335747] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T19:33:23.462370] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T19:33:23.730738] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:33:23.732488] [INFO ] [REMOTE ] PEO: Full fetch complete (11749 records). [2025-09-14T19:33:23.732584] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-14T19:33:23.758848] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-14T19:33:24.123956] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-14T19:33:24.124078] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-14T19:33:24.124474] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-14T19:33:24.124529] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-14T19:33:24.125106] [DEBUG] [LOCAL ] PEO: Trimmed 11749 records to 8194 (keeping 150 days of data) [2025-09-14T19:33:24.183569] [DEBUG] [LOCAL ] PEO: Primary data saved (8194 records). [2025-09-14T19:33:24.183787] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-14T19:33:24.183915] [INFO ] [MAIN ] Update Progress: 1658/2370 symbols completed. PEO took 20.0s. Estimated remaining: 1h 15m 40s. Rate: 9.4 symbols/min [2025-09-14T19:33:24.363871] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:24.374739] [DEBUG] [LOCAL ] PERF: Loaded 8156 existing records from primary storage. [2025-09-14T19:33:24.374921] [INFO ] [MAIN ] PERF: Loaded 8156 existing records. [2025-09-14T19:33:24.559094] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-14T19:33:24.565246] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:24.567059] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-14T19:33:24.567337] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-14T19:33:24.573398] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-14T19:33:24.582109] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-14T19:33:24.583371] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T19:33:24.672088] [INFO ] [REMOTE ] PEB: Full fetch complete (55000 records). [2025-09-14T19:33:24.708401] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-14T19:33:25.320766] [INFO ] [REMOTE ] PERF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:25.375722] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-14T19:33:25.412388] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-14T19:33:25.412510] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-14T19:33:25.427902] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-14T19:33:25.428035] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-14T19:33:25.429611] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T19:33:25.435767] [INFO ] [REMOTE ] PEG: Full fetch complete (57730 records). [2025-09-14T19:33:25.436290] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-14T19:33:25.436594] [DEBUG] [LOCAL ] PEB: Trimmed 55000 records to 38074 (keeping 150 days of data) [2025-09-14T19:33:25.931362] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-09-14T19:33:25.931729] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-09-14T19:33:25.932849] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-09-14T19:33:25.933212] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-09-14T19:33:25.935303] [DEBUG] [LOCAL ] PEG: Trimmed 57730 records to 40001 (keeping 150 days of data) [2025-09-14T19:33:26.159682] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-14T19:33:26.302524] [DEBUG] [LOCAL ] PEB: Primary data saved (38074 records). [2025-09-14T19:33:26.303910] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-14T19:33:26.304035] [INFO ] [MAIN ] Update Progress: 1659/2370 symbols completed. PEB took 31.1s. Estimated remaining: 1h 15m 32s. Rate: 9.4 symbols/min [2025-09-14T19:33:26.484822] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:26.500495] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T19:33:26.516600] [DEBUG] [LOCAL ] PEW: Loaded 13542 existing records from primary storage. [2025-09-14T19:33:26.517213] [INFO ] [MAIN ] PEW: Loaded 13542 existing records. [2025-09-14T19:33:26.633769] [DEBUG] [LOCAL ] PEG: Primary data saved (40001 records). [2025-09-14T19:33:26.665834] [INFO ] [MAIN ] PEG: Full history saved. [2025-09-14T19:33:26.694625] [INFO ] [MAIN ] Update Progress: 1660/2370 symbols completed. PEG took 25.5s. Estimated remaining: 1h 15m 23s. Rate: 9.4 symbols/min [2025-09-14T19:33:26.699898] [WARN ] [MAIN ] PEW: Insufficient historical data. Have data from 2025-07-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:26.700343] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-14T19:33:26.779835] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-14T19:33:26.806837] [DEBUG] [LOCAL ] PEW: Deleted primary data file. [2025-09-14T19:33:26.822433] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-14T19:33:26.903294] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:26.939596] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T19:33:26.980970] [INFO ] [REMOTE ] PEN: Full fetch complete (34003 records). [2025-09-14T19:33:26.975214] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-14T19:33:26.981341] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-14T19:33:27.024991] [DEBUG] [LOCAL ] PFD: Loaded 2873 existing records from primary storage. [2025-09-14T19:33:27.114906] [INFO ] [MAIN ] PFD: Loaded 2873 existing records. [2025-09-14T19:33:27.575523] [INFO ] [REMOTE ] PEW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:27.668293] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:27.705630] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-14T19:33:27.715425] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-14T19:33:27.715869] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-14T19:33:27.731379] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-14T19:33:27.816984] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-14T19:33:27.865892] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-14T19:33:27.881739] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-14T19:33:27.901137] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-14T19:33:27.901299] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-14T19:33:27.950772] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T19:33:28.030073] [DEBUG] [LOCAL ] PEN: Trimmed 34003 records to 22890 (keeping 150 days of data) [2025-09-14T19:33:28.152427] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:33:28.201380] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-14T19:33:28.290616] [INFO ] [REMOTE ] PFD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:28.338778] [DEBUG] [LOCAL ] PEN: Primary data saved (22890 records). [2025-09-14T19:33:28.338964] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-14T19:33:28.339116] [INFO ] [MAIN ] Update Progress: 1661/2370 symbols completed. PEN took 26.8s. Estimated remaining: 1h 15m 15s. Rate: 9.4 symbols/min [2025-09-14T19:33:28.520429] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:28.546590] [DEBUG] [LOCAL ] PFE: Loaded 24173 existing records from primary storage. [2025-09-14T19:33:28.546807] [INFO ] [MAIN ] PFE: Loaded 24173 existing records. [2025-09-14T19:33:28.568064] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-14T19:33:28.731152] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:28.731475] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-14T19:33:28.731540] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-14T19:33:28.732345] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-09-14T19:33:28.732415] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-14T19:33:28.939367] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:33:29.012767] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-14T19:33:29.125434] [INFO ] [REMOTE ] PFE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:29.358819] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-14T19:33:29.921267] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-14T19:33:30.158831] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-14T19:33:30.436474] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:33:30.436978] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-14T19:33:30.958845] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-14T19:33:31.758847] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-14T19:33:31.848504] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T19:33:32.393061] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T19:33:32.558873] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-14T19:33:33.358836] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-14T19:33:33.459285] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T19:33:33.616875] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:33:33.617265] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-14T19:33:34.158821] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-14T19:33:34.404263] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:33:34.404768] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-14T19:33:34.958870] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-14T19:33:35.758839] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-14T19:33:36.103361] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T19:33:36.386985] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T19:33:36.558850] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-14T19:33:37.358849] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-14T19:33:37.980989] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T19:33:38.158828] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-14T19:33:38.293288] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T19:33:38.958853] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-14T19:33:39.406298] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T19:33:39.618471] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T19:33:39.758869] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-14T19:33:40.454365] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T19:33:40.558834] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-14T19:33:41.313313] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T19:33:41.358784] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-14T19:33:41.964299] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T19:33:41.965866] [INFO ] [REMOTE ] PFD: Full fetch complete (5511 records). [2025-09-14T19:33:41.965971] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-14T19:33:42.164017] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-14T19:33:42.346415] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-14T19:33:42.346535] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-14T19:33:42.346868] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-14T19:33:42.346962] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-14T19:33:42.347418] [DEBUG] [LOCAL ] PFD: Trimmed 5511 records to 3832 (keeping 150 days of data) [2025-09-14T19:33:42.372212] [DEBUG] [LOCAL ] PFD: Primary data saved (3832 records). [2025-09-14T19:33:42.372350] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-14T19:33:42.372487] [INFO ] [MAIN ] Update Progress: 1662/2370 symbols completed. PFD took 15.7s. Estimated remaining: 1h 15m 12s. Rate: 9.4 symbols/min [2025-09-14T19:33:42.542693] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:42.563881] [DEBUG] [LOCAL ] PFGC: Loaded 21202 existing records from primary storage. [2025-09-14T19:33:42.564122] [INFO ] [MAIN ] PFGC: Loaded 21202 existing records. [2025-09-14T19:33:42.746209] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:42.746562] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-14T19:33:42.746665] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-14T19:33:42.747310] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-14T19:33:42.747372] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-14T19:33:42.964081] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-14T19:33:43.115535] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:43.292676] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T19:33:43.758850] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-14T19:33:44.558856] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-14T19:33:45.358876] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-14T19:33:45.557743] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:33:45.559494] [INFO ] [REMOTE ] PERF: Full fetch complete (16098 records). [2025-09-14T19:33:45.559581] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-14T19:33:45.928868] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-14T19:33:45.929506] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-14T19:33:45.930283] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-14T19:33:45.930398] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-14T19:33:45.932293] [DEBUG] [LOCAL ] PERF: Trimmed 16098 records to 11386 (keeping 150 days of data) [2025-09-14T19:33:45.965918] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-14T19:33:46.044391] [DEBUG] [LOCAL ] PERF: Primary data saved (11386 records). [2025-09-14T19:33:46.044704] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-14T19:33:46.044912] [INFO ] [MAIN ] Update Progress: 1663/2370 symbols completed. PERF took 21.9s. Estimated remaining: 1h 15m 4s. Rate: 9.4 symbols/min [2025-09-14T19:33:46.165717] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-14T19:33:46.179682] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-09-14T19:33:46.264123] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:46.269266] [DEBUG] [LOCAL ] PFH: Loaded 2967 existing records from primary storage. [2025-09-14T19:33:46.269384] [INFO ] [MAIN ] PFH: Loaded 2967 existing records. [2025-09-14T19:33:46.449701] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:46.450051] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-14T19:33:46.450122] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-14T19:33:46.450419] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-14T19:33:46.450480] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-14T19:33:46.792836] [INFO ] [REMOTE ] PFH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:46.958785] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-14T19:33:47.263270] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T19:33:47.758876] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-14T19:33:47.789240] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T19:33:48.008966] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T19:33:48.558922] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-14T19:33:49.317618] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T19:33:49.358804] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-14T19:33:50.158837] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-14T19:33:50.316718] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-14T19:33:50.959099] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-14T19:33:50.961544] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T19:33:51.713502] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T19:33:51.717611] [INFO ] [REMOTE ] PEW: Full fetch complete (13542 records). [2025-09-14T19:33:51.717759] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-14T19:33:51.764040] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-14T19:33:51.911153] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 42 unique days, need 150 days [2025-09-14T19:33:51.912247] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T19:33:51.914837] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:33:51.915197] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:33:51.915275] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-14T19:33:51.915376] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-14T19:33:51.915480] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-14T19:33:51.915569] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-14T19:33:51.915718] [INFO ] [MAIN ] Update Progress: 1664/2370 symbols completed. PEW took 25.6s. Estimated remaining: 1h 14m 57s. Rate: 9.4 symbols/min [2025-09-14T19:33:52.082494] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:33:52.090935] [DEBUG] [LOCAL ] PFL: Loaded 6476 existing records from primary storage. [2025-09-14T19:33:52.091088] [INFO ] [MAIN ] PFL: Loaded 6476 existing records. [2025-09-14T19:33:52.264387] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:33:52.264717] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-14T19:33:52.264795] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-14T19:33:52.265200] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-14T19:33:52.265275] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-14T19:33:52.563908] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-14T19:33:52.615932] [INFO ] [REMOTE ] PFL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:33:53.358852] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-14T19:33:53.547937] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T19:33:54.158833] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-14T19:33:54.574491] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T19:33:54.939320] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T19:33:54.958816] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-14T19:33:55.365482] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-09-14T19:33:55.758857] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-14T19:33:56.558863] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-14T19:33:56.594765] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T19:33:57.308524] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-14T19:33:57.358848] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-14T19:33:58.158867] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-14T19:33:58.257705] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T19:33:58.590761] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-14T19:33:58.944018] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T19:33:58.958778] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-14T19:33:59.708536] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T19:33:59.758802] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-14T19:34:00.558799] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-14T19:34:00.858210] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T19:34:01.358837] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-14T19:34:02.158841] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-14T19:34:02.701917] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T19:34:02.705347] [INFO ] [REMOTE ] PFH: Full fetch complete (7655 records). [2025-09-14T19:34:02.706052] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-14T19:34:02.965928] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-14T19:34:03.344556] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-14T19:34:03.345134] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-14T19:34:03.346206] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-14T19:34:03.348884] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T19:34:03.359942] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-14T19:34:03.362377] [DEBUG] [LOCAL ] PFH: Trimmed 7655 records to 5261 (keeping 150 days of data) [2025-09-14T19:34:03.440684] [DEBUG] [LOCAL ] PFH: Primary data saved (5261 records). [2025-09-14T19:34:03.444076] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-14T19:34:03.444415] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-14T19:34:03.460087] [INFO ] [MAIN ] Update Progress: 1665/2370 symbols completed. PFH took 17.4s. Estimated remaining: 1h 14m 53s. Rate: 9.4 symbols/min [2025-09-14T19:34:03.638699] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:03.658562] [DEBUG] [LOCAL ] PFLT: Loaded 18815 existing records from primary storage. [2025-09-14T19:34:03.658791] [INFO ] [MAIN ] PFLT: Loaded 18815 existing records. [2025-09-14T19:34:03.759804] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-14T19:34:03.841754] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:03.842042] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-14T19:34:03.842104] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-14T19:34:03.842751] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-14T19:34:03.842823] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-14T19:34:04.050294] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T19:34:04.227544] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:04.558882] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-14T19:34:05.358897] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-14T19:34:05.629394] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T19:34:06.059256] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T19:34:06.158840] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-14T19:34:06.564471] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T19:34:06.959275] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-14T19:34:07.318415] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T19:34:07.758963] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-14T19:34:08.461890] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:34:08.467428] [INFO ] [REMOTE ] PFGC: Full fetch complete (51138 records). [2025-09-14T19:34:08.467635] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-14T19:34:08.564248] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-14T19:34:08.889887] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-14T19:34:08.890117] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-14T19:34:08.891836] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-14T19:34:08.891935] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-14T19:34:08.920559] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T19:34:08.920791] [DEBUG] [LOCAL ] PFGC: Trimmed 51138 records to 35492 (keeping 150 days of data) [2025-09-14T19:34:09.171396] [DEBUG] [LOCAL ] PFGC: Primary data saved (35492 records). [2025-09-14T19:34:09.171666] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-14T19:34:09.171810] [INFO ] [MAIN ] Update Progress: 1666/2370 symbols completed. PFGC took 26.8s. Estimated remaining: 1h 14m 47s. Rate: 9.4 symbols/min [2025-09-14T19:34:09.370862] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-14T19:34:09.377002] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:09.391302] [DEBUG] [LOCAL ] PFN: Loaded 9877 existing records from primary storage. [2025-09-14T19:34:09.391472] [INFO ] [MAIN ] PFN: Loaded 9877 existing records. [2025-09-14T19:34:09.586558] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:09.586848] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-14T19:34:09.586913] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-14T19:34:09.587424] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-14T19:34:09.587494] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-14T19:34:09.911800] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T19:34:09.974896] [INFO ] [REMOTE ] PFN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:10.158824] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-14T19:34:10.958897] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-14T19:34:11.758842] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-14T19:34:12.198085] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T19:34:12.521138] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-14T19:34:12.565023] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-14T19:34:12.568515] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T19:34:12.578408] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T19:34:12.580931] [INFO ] [REMOTE ] PFL: Full fetch complete (15152 records). [2025-09-14T19:34:12.581016] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-14T19:34:12.943571] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-14T19:34:12.943694] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-14T19:34:12.944047] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-14T19:34:12.944106] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-14T19:34:12.945233] [DEBUG] [LOCAL ] PFL: Trimmed 15152 records to 9928 (keeping 150 days of data) [2025-09-14T19:34:13.025235] [DEBUG] [LOCAL ] PFL: Primary data saved (9928 records). [2025-09-14T19:34:13.025412] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-14T19:34:13.025569] [INFO ] [MAIN ] Update Progress: 1667/2370 symbols completed. PFL took 21.1s. Estimated remaining: 1h 14m 39s. Rate: 9.4 symbols/min [2025-09-14T19:34:13.195711] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:13.200688] [DEBUG] [LOCAL ] PFO: Loaded 2904 existing records from primary storage. [2025-09-14T19:34:13.200797] [INFO ] [MAIN ] PFO: Loaded 2904 existing records. [2025-09-14T19:34:13.363413] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-14T19:34:13.384373] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:13.385550] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-14T19:34:13.385618] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-14T19:34:13.385916] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-14T19:34:13.386013] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-14T19:34:13.736998] [INFO ] [REMOTE ] PFO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:14.158873] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-14T19:34:14.354548] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:34:14.566583] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T19:34:14.958889] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-14T19:34:15.084739] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T19:34:15.758829] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-14T19:34:16.558838] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-14T19:34:16.763292] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T19:34:16.834513] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T19:34:17.251795] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T19:34:17.358831] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-14T19:34:18.158865] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-14T19:34:18.869895] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T19:34:18.958826] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-14T19:34:19.758836] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-14T19:34:19.989792] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-14T19:34:20.242341] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T19:34:20.558836] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-14T19:34:20.711037] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T19:34:21.307726] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:34:21.313722] [INFO ] [REMOTE ] PFE: Full fetch complete (58493 records). [2025-09-14T19:34:21.313867] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-14T19:34:21.368676] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-14T19:34:21.703335] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-09-14T19:34:21.703450] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-09-14T19:34:21.704504] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-09-14T19:34:21.704565] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-09-14T19:34:21.706202] [DEBUG] [LOCAL ] PFE: Trimmed 58493 records to 40553 (keeping 150 days of data) [2025-09-14T19:34:21.986240] [DEBUG] [LOCAL ] PFE: Primary data saved (40553 records). [2025-09-14T19:34:21.986413] [INFO ] [MAIN ] PFE: Full history saved. [2025-09-14T19:34:21.986553] [INFO ] [MAIN ] Update Progress: 1668/2370 symbols completed. PFE took 53.6s. Estimated remaining: 1h 14m 34s. Rate: 9.4 symbols/min [2025-09-14T19:34:22.159249] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:22.159411] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-14T19:34:22.180359] [DEBUG] [LOCAL ] PFS: Loaded 15505 existing records from primary storage. [2025-09-14T19:34:22.180538] [INFO ] [MAIN ] PFS: Loaded 15505 existing records. [2025-09-14T19:34:22.364864] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:22.365165] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-14T19:34:22.365234] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-14T19:34:22.366055] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-14T19:34:22.366126] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-14T19:34:22.732131] [INFO ] [REMOTE ] PFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:22.780069] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T19:34:22.958825] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-14T19:34:23.203033] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T19:34:23.758830] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-14T19:34:24.558847] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-14T19:34:24.675158] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T19:34:25.148358] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T19:34:25.154811] [INFO ] [REMOTE ] PFLT: Full fetch complete (47640 records). [2025-09-14T19:34:25.154993] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-14T19:34:25.279712] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T19:34:25.360632] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-14T19:34:25.565753] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-14T19:34:25.565873] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-14T19:34:25.567057] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-14T19:34:25.567116] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-14T19:34:25.568583] [DEBUG] [LOCAL ] PFLT: Trimmed 47640 records to 31971 (keeping 150 days of data) [2025-09-14T19:34:25.781844] [DEBUG] [LOCAL ] PFLT: Primary data saved (31971 records). [2025-09-14T19:34:25.782021] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-14T19:34:25.782140] [INFO ] [MAIN ] Update Progress: 1669/2370 symbols completed. PFLT took 22.3s. Estimated remaining: 1h 14m 26s. Rate: 9.4 symbols/min [2025-09-14T19:34:25.954376] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:25.969419] [DEBUG] [LOCAL ] PFSI: Loaded 13348 existing records from primary storage. [2025-09-14T19:34:25.969597] [INFO ] [MAIN ] PFSI: Loaded 13348 existing records. [2025-09-14T19:34:26.146109] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:26.146387] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-14T19:34:26.146452] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-14T19:34:26.146960] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-14T19:34:26.147022] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-14T19:34:26.167131] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-14T19:34:26.547282] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:26.575916] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T19:34:26.762226] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T19:34:26.958825] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-14T19:34:27.470361] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T19:34:27.471893] [INFO ] [REMOTE ] PFO: Full fetch complete (5902 records). [2025-09-14T19:34:27.471982] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-14T19:34:27.763470] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-14T19:34:27.842759] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-14T19:34:27.842858] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-14T19:34:27.843039] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-14T19:34:27.843091] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-14T19:34:27.843491] [DEBUG] [LOCAL ] PFO: Trimmed 5902 records to 4456 (keeping 150 days of data) [2025-09-14T19:34:27.871210] [DEBUG] [LOCAL ] PFO: Primary data saved (4456 records). [2025-09-14T19:34:27.871301] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-14T19:34:27.871401] [INFO ] [MAIN ] Update Progress: 1670/2370 symbols completed. PFO took 14.8s. Estimated remaining: 1h 14m 18s. Rate: 9.4 symbols/min [2025-09-14T19:34:28.042934] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:28.076187] [DEBUG] [LOCAL ] PG: Loaded 24168 existing records from primary storage. [2025-09-14T19:34:28.076413] [INFO ] [MAIN ] PG: Loaded 24168 existing records. [2025-09-14T19:34:28.253333] [WARN ] [MAIN ] PG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:28.253629] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-14T19:34:28.253703] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-14T19:34:28.254423] [DEBUG] [LOCAL ] PG: Deleted primary data file. [2025-09-14T19:34:28.254483] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-14T19:34:28.566853] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-14T19:34:28.606036] [INFO ] [REMOTE ] PG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:29.267016] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T19:34:29.358813] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-14T19:34:29.666594] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T19:34:30.158848] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-14T19:34:30.792879] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T19:34:30.958871] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-14T19:34:31.758842] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-14T19:34:31.910809] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T19:34:32.558827] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-14T19:34:32.880304] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T19:34:33.358851] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-14T19:34:33.605053] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-14T19:34:34.059241] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T19:34:34.158828] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-14T19:34:34.601500] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T19:34:34.958889] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-14T19:34:35.569209] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T19:34:35.758876] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-14T19:34:36.558885] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-14T19:34:36.905961] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T19:34:37.164703] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T19:34:37.358839] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-14T19:34:37.727482] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T19:34:38.158844] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-14T19:34:38.958873] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-14T19:34:39.646984] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-14T19:34:39.691490] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:34:39.695553] [INFO ] [REMOTE ] PFN: Full fetch complete (23294 records). [2025-09-14T19:34:39.696024] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-14T19:34:39.762882] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-14T19:34:39.828728] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T19:34:40.107875] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-14T19:34:40.108014] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-14T19:34:40.108740] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-14T19:34:40.108805] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-14T19:34:40.109810] [DEBUG] [LOCAL ] PFN: Trimmed 23294 records to 15751 (keeping 150 days of data) [2025-09-14T19:34:40.209590] [DEBUG] [LOCAL ] PFN: Primary data saved (15751 records). [2025-09-14T19:34:40.209783] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-14T19:34:40.209898] [INFO ] [MAIN ] Update Progress: 1671/2370 symbols completed. PFN took 31.0s. Estimated remaining: 1h 14m 14s. Rate: 9.4 symbols/min [2025-09-14T19:34:40.379683] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:40.383793] [DEBUG] [LOCAL ] PGP: Loaded 2620 existing records from primary storage. [2025-09-14T19:34:40.383906] [INFO ] [MAIN ] PGP: Loaded 2620 existing records. [2025-09-14T19:34:40.568420] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-14T19:34:40.574618] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:40.576208] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-14T19:34:40.576288] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-14T19:34:40.576563] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-14T19:34:40.576623] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-14T19:34:40.932383] [INFO ] [REMOTE ] PGP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:41.358894] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-14T19:34:42.065109] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-14T19:34:42.101400] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T19:34:42.158867] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-14T19:34:42.255169] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T19:34:42.958830] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-14T19:34:43.481351] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T19:34:43.626095] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T19:34:43.758873] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-14T19:34:44.558905] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-14T19:34:45.358878] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-14T19:34:45.750285] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T19:34:45.868687] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T19:34:46.158835] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-14T19:34:46.245376] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T19:34:46.958827] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-14T19:34:47.544752] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T19:34:47.548521] [INFO ] [REMOTE ] PFS: Full fetch complete (38649 records). [2025-09-14T19:34:47.548718] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-14T19:34:47.764627] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-14T19:34:47.956101] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-14T19:34:47.956352] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-14T19:34:47.957272] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-14T19:34:47.975417] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-14T19:34:47.977251] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T19:34:47.985202] [DEBUG] [LOCAL ] PFS: Trimmed 38649 records to 26037 (keeping 150 days of data) [2025-09-14T19:34:48.179059] [DEBUG] [LOCAL ] PFS: Primary data saved (26037 records). [2025-09-14T19:34:48.179309] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-14T19:34:48.179442] [INFO ] [MAIN ] Update Progress: 1672/2370 symbols completed. PFS took 26.2s. Estimated remaining: 1h 14m 9s. Rate: 9.4 symbols/min [2025-09-14T19:34:48.366585] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:48.392417] [DEBUG] [LOCAL ] PGR: Loaded 23762 existing records from primary storage. [2025-09-14T19:34:48.392705] [INFO ] [MAIN ] PGR: Loaded 23762 existing records. [2025-09-14T19:34:48.561696] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-14T19:34:48.592313] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:48.594228] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T19:34:48.594371] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-14T19:34:48.594688] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-14T19:34:48.598278] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-09-14T19:34:48.598373] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-14T19:34:48.978044] [INFO ] [REMOTE ] PGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:49.358836] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-14T19:34:50.158844] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-14T19:34:50.739076] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T19:34:50.894576] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T19:34:50.958890] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-14T19:34:51.050085] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T19:34:51.758884] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-14T19:34:52.116252] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-14T19:34:52.120310] [INFO ] [REMOTE ] PFSI: Full fetch complete (30931 records). [2025-09-14T19:34:52.120459] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-14T19:34:52.503755] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-14T19:34:52.503949] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-14T19:34:52.504692] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-14T19:34:52.504811] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-14T19:34:52.505885] [DEBUG] [LOCAL ] PFSI: Trimmed 30931 records to 21119 (keeping 150 days of data) [2025-09-14T19:34:52.561758] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-14T19:34:52.649548] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T19:34:52.682471] [DEBUG] [LOCAL ] PFSI: Primary data saved (21119 records). [2025-09-14T19:34:52.682619] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-14T19:34:52.682744] [INFO ] [MAIN ] Update Progress: 1673/2370 symbols completed. PFSI took 26.9s. Estimated remaining: 1h 14m 2s. Rate: 9.4 symbols/min [2025-09-14T19:34:52.856315] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:52.875780] [DEBUG] [LOCAL ] PGRE: Loaded 21281 existing records from primary storage. [2025-09-14T19:34:52.875943] [INFO ] [MAIN ] PGRE: Loaded 21281 existing records. [2025-09-14T19:34:53.058212] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:53.058564] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-14T19:34:53.058634] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-14T19:34:53.059267] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-14T19:34:53.059342] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-14T19:34:53.355528] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T19:34:53.366070] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-14T19:34:53.433659] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:54.158846] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-14T19:34:54.348911] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T19:34:54.578117] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-14T19:34:54.958907] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-14T19:34:55.758871] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-14T19:34:55.879398] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T19:34:56.190344] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:34:56.191708] [INFO ] [REMOTE ] PGP: Full fetch complete (5917 records). [2025-09-14T19:34:56.191794] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-14T19:34:56.564721] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-14T19:34:56.573079] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-14T19:34:56.574412] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-14T19:34:56.574703] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-14T19:34:56.574790] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-14T19:34:56.575333] [DEBUG] [LOCAL ] PGP: Trimmed 5917 records to 4011 (keeping 150 days of data) [2025-09-14T19:34:56.600856] [DEBUG] [LOCAL ] PGP: Primary data saved (4011 records). [2025-09-14T19:34:56.601041] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-14T19:34:56.601204] [INFO ] [MAIN ] Update Progress: 1674/2370 symbols completed. PGP took 16.4s. Estimated remaining: 1h 13m 54s. Rate: 9.4 symbols/min [2025-09-14T19:34:56.771583] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:34:56.776230] [DEBUG] [LOCAL ] PGZ: Loaded 2678 existing records from primary storage. [2025-09-14T19:34:56.776381] [INFO ] [MAIN ] PGZ: Loaded 2678 existing records. [2025-09-14T19:34:56.951321] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:34:56.951607] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-14T19:34:56.951700] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-14T19:34:56.952052] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-14T19:34:56.952126] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-14T19:34:57.296406] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:34:57.358783] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-14T19:34:58.143458] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T19:34:58.158790] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-14T19:34:58.794317] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T19:34:58.958802] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-14T19:34:59.021351] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-14T19:34:59.634538] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T19:34:59.758826] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-14T19:35:00.379406] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T19:35:00.558806] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-14T19:35:01.358932] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-14T19:35:02.158898] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-14T19:35:02.283694] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T19:35:02.290470] [INFO ] [REMOTE ] PG: Full fetch complete (58431 records). [2025-09-14T19:35:02.290722] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-14T19:35:02.741198] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-09-14T19:35:02.741361] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-09-14T19:35:02.742981] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-09-14T19:35:02.743085] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-09-14T19:35:02.762353] [DEBUG] [LOCAL ] PG: Trimmed 58431 records to 40493 (keeping 150 days of data) [2025-09-14T19:35:02.764324] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-14T19:35:02.963981] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-14T19:35:03.050142] [DEBUG] [LOCAL ] PG: Primary data saved (40493 records). [2025-09-14T19:35:03.050317] [INFO ] [MAIN ] PG: Full history saved. [2025-09-14T19:35:03.050416] [INFO ] [MAIN ] Update Progress: 1675/2370 symbols completed. PG took 35.2s. Estimated remaining: 1h 13m 48s. Rate: 9.4 symbols/min [2025-09-14T19:35:03.233366] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:03.269460] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T19:35:03.294170] [DEBUG] [LOCAL ] PH: Loaded 16008 existing records from primary storage. [2025-09-14T19:35:03.294371] [INFO ] [MAIN ] PH: Loaded 16008 existing records. [2025-09-14T19:35:03.479847] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:03.480137] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-14T19:35:03.480202] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-14T19:35:03.480736] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-14T19:35:03.480800] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-14T19:35:03.764049] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-14T19:35:03.836061] [INFO ] [REMOTE ] PH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:04.558934] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-14T19:35:04.587033] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T19:35:04.635344] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T19:35:05.358909] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-14T19:35:05.411442] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T19:35:06.158877] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-14T19:35:06.958809] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-14T19:35:07.118797] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T19:35:07.228411] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T19:35:07.636457] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T19:35:07.758867] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-14T19:35:08.558862] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-14T19:35:09.328095] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T19:35:09.358836] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-14T19:35:09.417305] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T19:35:10.158879] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-14T19:35:10.269015] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T19:35:10.958837] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-14T19:35:11.602444] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T19:35:11.603789] [INFO ] [REMOTE ] PGZ: Full fetch complete (5852 records). [2025-09-14T19:35:11.603872] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-14T19:35:11.777023] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-14T19:35:11.984245] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-14T19:35:11.984498] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-14T19:35:11.984841] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-14T19:35:11.984991] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-14T19:35:11.985706] [DEBUG] [LOCAL ] PGZ: Trimmed 5852 records to 4131 (keeping 150 days of data) [2025-09-14T19:35:12.014233] [DEBUG] [LOCAL ] PGZ: Primary data saved (4131 records). [2025-09-14T19:35:12.014558] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-14T19:35:12.014792] [INFO ] [MAIN ] Update Progress: 1676/2370 symbols completed. PGZ took 15.4s. Estimated remaining: 1h 13m 43s. Rate: 9.4 symbols/min [2025-09-14T19:35:12.140873] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-14T19:35:12.241403] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:12.248492] [DEBUG] [LOCAL ] PHD: Loaded 4602 existing records from primary storage. [2025-09-14T19:35:12.248682] [INFO ] [MAIN ] PHD: Loaded 4602 existing records. [2025-09-14T19:35:12.435343] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:12.435671] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-14T19:35:12.435737] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-14T19:35:12.436131] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-14T19:35:12.436197] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-14T19:35:12.564004] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-14T19:35:12.831868] [INFO ] [REMOTE ] PHD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:13.358835] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-14T19:35:13.423753] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T19:35:13.429491] [INFO ] [REMOTE ] PGR: Full fetch complete (57629 records). [2025-09-14T19:35:13.429662] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-14T19:35:13.824910] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-09-14T19:35:13.839381] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-09-14T19:35:13.849985] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-09-14T19:35:13.850801] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-09-14T19:35:13.852740] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-14T19:35:13.857104] [DEBUG] [LOCAL ] PGR: Trimmed 57629 records to 39822 (keeping 150 days of data) [2025-09-14T19:35:14.133833] [DEBUG] [LOCAL ] PGR: Primary data saved (39822 records). [2025-09-14T19:35:14.134048] [INFO ] [MAIN ] PGR: Full history saved. [2025-09-14T19:35:14.134175] [INFO ] [MAIN ] Update Progress: 1677/2370 symbols completed. PGR took 26.0s. Estimated remaining: 1h 13m 34s. Rate: 9.4 symbols/min [2025-09-14T19:35:14.158803] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-14T19:35:14.587954] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T19:35:14.958827] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-14T19:35:15.758847] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-14T19:35:15.809830] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T19:35:15.880114] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T19:35:16.558827] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-14T19:35:17.358836] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-14T19:35:17.567342] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T19:35:17.597885] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T19:35:18.158822] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-14T19:35:18.932074] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T19:35:18.958849] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-14T19:35:19.168363] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T19:35:19.758839] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-14T19:35:20.421145] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T19:35:20.532622] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T19:35:20.558891] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-14T19:35:21.358850] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-14T19:35:21.641717] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T19:35:22.158921] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-14T19:35:22.847624] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T19:35:22.853768] [INFO ] [REMOTE ] PGRE: Full fetch complete (48703 records). [2025-09-14T19:35:22.854057] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-14T19:35:22.969217] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-14T19:35:22.982030] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T19:35:23.282085] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-14T19:35:23.282247] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-14T19:35:23.283538] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-14T19:35:23.283608] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-14T19:35:23.285369] [DEBUG] [LOCAL ] PGRE: Trimmed 48703 records to 35261 (keeping 150 days of data) [2025-09-14T19:35:23.531446] [DEBUG] [LOCAL ] PGRE: Primary data saved (35261 records). [2025-09-14T19:35:23.531736] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-14T19:35:23.531873] [INFO ] [MAIN ] Update Progress: 1678/2370 symbols completed. PGRE took 30.8s. Estimated remaining: 1h 13m 29s. Rate: 9.4 symbols/min [2025-09-14T19:35:23.758839] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-14T19:35:24.563786] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T19:35:24.566058] [INFO ] [REMOTE ] PHD: Full fetch complete (10206 records). [2025-09-14T19:35:24.566303] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-14T19:35:24.940248] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-14T19:35:24.964038] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-14T19:35:24.964741] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-14T19:35:24.965612] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-14T19:35:24.967762] [DEBUG] [LOCAL ] PHD: Trimmed 10206 records to 6860 (keeping 150 days of data) [2025-09-14T19:35:24.966958] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T19:35:24.999384] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-14T19:35:25.023095] [DEBUG] [LOCAL ] PHD: Primary data saved (6860 records). [2025-09-14T19:35:25.023597] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-14T19:35:25.023749] [INFO ] [MAIN ] Update Progress: 1679/2370 symbols completed. PHD took 13.0s. Estimated remaining: 1h 13m 21s. Rate: 9.4 symbols/min [2025-09-14T19:35:26.601590] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T19:35:26.610547] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-14T19:35:28.108943] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T19:35:28.118818] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-14T19:35:29.718363] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T19:35:29.727830] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-14T19:35:30.386787] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:35:30.392314] [INFO ] [REMOTE ] PH: Full fetch complete (43021 records). [2025-09-14T19:35:30.392618] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-14T19:35:30.808120] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-14T19:35:30.808263] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-14T19:35:30.809335] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-14T19:35:30.809412] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-14T19:35:30.810623] [DEBUG] [LOCAL ] PH: Trimmed 43021 records to 28162 (keeping 150 days of data) [2025-09-14T19:35:31.002014] [DEBUG] [LOCAL ] PH: Primary data saved (28162 records). [2025-09-14T19:35:31.002208] [INFO ] [MAIN ] PH: Full history saved. [2025-09-14T19:35:31.002342] [INFO ] [MAIN ] Update Progress: 1680/2370 symbols completed. PH took 28.0s. Estimated remaining: 1h 13m 14s. Rate: 9.4 symbols/min [2025-09-14T19:35:31.597895] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:31.779554] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:31.837343] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:31.838767] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:31.852085] [DEBUG] [LOCAL ] PHG: Loaded 20588 existing records from primary storage. [2025-09-14T19:35:31.855996] [INFO ] [MAIN ] PHG: Loaded 20588 existing records. [2025-09-14T19:35:31.909388] [DEBUG] [LOCAL ] PHK: Loaded 11952 existing records from primary storage. [2025-09-14T19:35:31.909692] [DEBUG] [LOCAL ] PHI: Loaded 6890 existing records from primary storage. [2025-09-14T19:35:31.976149] [INFO ] [MAIN ] PHI: Loaded 6890 existing records. [2025-09-14T19:35:31.976516] [DEBUG] [LOCAL ] PHIN: Loaded 13917 existing records from primary storage. [2025-09-14T19:35:31.976047] [INFO ] [MAIN ] PHK: Loaded 11952 existing records. [2025-09-14T19:35:32.010533] [INFO ] [MAIN ] PHIN: Loaded 13917 existing records. [2025-09-14T19:35:32.276210] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:32.375278] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-14T19:35:32.456716] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:32.514941] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-14T19:35:32.569845] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:32.575069] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-14T19:35:32.639027] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:32.639085] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-14T19:35:32.639157] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-14T19:35:32.639561] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-14T19:35:32.639323] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-14T19:35:32.639770] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-14T19:35:32.639471] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-14T19:35:32.645313] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-14T19:35:32.668382] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-14T19:35:32.668538] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-14T19:35:32.684084] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-14T19:35:32.678837] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-14T19:35:32.692985] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-14T19:35:32.744352] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-14T19:35:33.870339] [INFO ] [REMOTE ] PHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:33.922188] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-14T19:35:34.113586] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:34.132794] [INFO ] [REMOTE ] PHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:34.135917] [INFO ] [REMOTE ] PHK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:34.137150] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-14T19:35:34.136915] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-14T19:35:34.138431] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-14T19:35:35.330828] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T19:35:35.334044] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-14T19:35:35.570970] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T19:35:35.576719] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-14T19:35:35.758781] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T19:35:35.765859] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-14T19:35:35.976163] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T19:35:35.980130] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-14T19:35:36.021273] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T19:35:36.030169] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-14T19:35:37.001486] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T19:35:37.007563] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-14T19:35:37.048821] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T19:35:37.057948] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-14T19:35:37.080256] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T19:35:37.084190] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-14T19:35:37.367197] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T19:35:37.377109] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-14T19:35:37.703322] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T19:35:38.027705] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T19:35:38.158865] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-14T19:35:38.204725] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T19:35:38.707833] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T19:35:38.958839] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-14T19:35:39.534828] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T19:35:39.758844] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-14T19:35:40.236365] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T19:35:40.558834] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-14T19:35:41.358818] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-14T19:35:41.625488] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T19:35:41.741307] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T19:35:42.158855] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-14T19:35:42.455385] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T19:35:42.958830] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-14T19:35:43.758828] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-14T19:35:43.797519] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T19:35:43.982313] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T19:35:44.558831] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-14T19:35:45.137930] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T19:35:45.358819] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-14T19:35:46.158928] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-14T19:35:46.324272] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:35:46.447355] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T19:35:46.958911] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-14T19:35:47.431615] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T19:35:47.758898] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-14T19:35:48.558848] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-14T19:35:48.588597] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T19:35:48.737123] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T19:35:49.358907] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-14T19:35:49.820592] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T19:35:50.158896] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-14T19:35:50.295235] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T19:35:50.301981] [INFO ] [REMOTE ] PHI: Full fetch complete (15683 records). [2025-09-14T19:35:50.302213] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-14T19:35:50.689539] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-14T19:35:50.689706] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-14T19:35:50.690361] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-14T19:35:50.690430] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-14T19:35:50.691287] [DEBUG] [LOCAL ] PHI: Trimmed 15683 records to 10886 (keeping 150 days of data) [2025-09-14T19:35:50.764415] [DEBUG] [LOCAL ] PHI: Primary data saved (10886 records). [2025-09-14T19:35:50.764683] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-14T19:35:50.764834] [INFO ] [MAIN ] Update Progress: 1681/2370 symbols completed. PHI took 19.8s. Estimated remaining: 1h 13m 13s. Rate: 9.4 symbols/min [2025-09-14T19:35:50.940775] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:50.959105] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-14T19:35:50.976517] [DEBUG] [LOCAL ] PHM: Loaded 23253 existing records from primary storage. [2025-09-14T19:35:50.976792] [INFO ] [MAIN ] PHM: Loaded 23253 existing records. [2025-09-14T19:35:51.166106] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:51.166389] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-14T19:35:51.166466] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-14T19:35:51.167212] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-09-14T19:35:51.167280] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-14T19:35:51.533347] [INFO ] [REMOTE ] PHM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:51.592827] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T19:35:51.646561] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:35:51.650147] [INFO ] [REMOTE ] PHIN: Full fetch complete (36696 records). [2025-09-14T19:35:51.650241] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-14T19:35:51.764045] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-14T19:35:52.033502] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-14T19:35:52.033661] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-14T19:35:52.035378] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-14T19:35:52.035474] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-14T19:35:52.036995] [DEBUG] [LOCAL ] PHIN: Trimmed 36696 records to 23699 (keeping 150 days of data) [2025-09-14T19:35:52.204969] [DEBUG] [LOCAL ] PHIN: Primary data saved (23699 records). [2025-09-14T19:35:52.205242] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-14T19:35:52.205445] [INFO ] [MAIN ] Update Progress: 1682/2370 symbols completed. PHIN took 21.2s. Estimated remaining: 1h 13m 5s. Rate: 9.4 symbols/min [2025-09-14T19:35:52.407532] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:52.427354] [DEBUG] [LOCAL ] PHR: Loaded 17164 existing records from primary storage. [2025-09-14T19:35:52.427564] [INFO ] [MAIN ] PHR: Loaded 17164 existing records. [2025-09-14T19:35:52.569583] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-14T19:35:52.612420] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:52.612999] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-14T19:35:52.613104] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-14T19:35:52.613799] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-14T19:35:52.614029] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-14T19:35:53.001561] [INFO ] [REMOTE ] PHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:53.030951] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T19:35:53.358874] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-14T19:35:54.158902] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-14T19:35:54.182016] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T19:35:54.187092] [INFO ] [REMOTE ] PHG: Full fetch complete (50270 records). [2025-09-14T19:35:54.187239] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-14T19:35:54.584179] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-14T19:35:54.584330] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-14T19:35:54.585891] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-14T19:35:54.585971] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-14T19:35:54.587601] [DEBUG] [LOCAL ] PHG: Trimmed 50270 records to 34714 (keeping 150 days of data) [2025-09-14T19:35:54.812301] [DEBUG] [LOCAL ] PHG: Primary data saved (34714 records). [2025-09-14T19:35:54.812705] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-14T19:35:54.813215] [INFO ] [MAIN ] Update Progress: 1683/2370 symbols completed. PHG took 23.8s. Estimated remaining: 1h 12m 57s. Rate: 9.4 symbols/min [2025-09-14T19:35:54.961306] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-14T19:35:55.014590] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:55.018433] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:35:55.040426] [DEBUG] [LOCAL ] PHT: Loaded 8005 existing records from primary storage. [2025-09-14T19:35:55.040692] [INFO ] [MAIN ] PHT: Loaded 8005 existing records. [2025-09-14T19:35:55.244143] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:55.244525] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-14T19:35:55.244588] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-14T19:35:55.245030] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-14T19:35:55.245103] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-14T19:35:55.585305] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T19:35:55.632282] [INFO ] [REMOTE ] PHK: Full fetch complete (29133 records). [2025-09-14T19:35:55.652903] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-14T19:35:55.652680] [INFO ] [REMOTE ] PHT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:55.759153] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-14T19:35:56.070176] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-14T19:35:56.070316] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-14T19:35:56.071115] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-14T19:35:56.071183] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-14T19:35:56.072066] [DEBUG] [LOCAL ] PHK: Trimmed 29133 records to 19411 (keeping 150 days of data) [2025-09-14T19:35:56.193438] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T19:35:56.240437] [DEBUG] [LOCAL ] PHK: Primary data saved (19411 records). [2025-09-14T19:35:56.240615] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-14T19:35:56.240740] [INFO ] [MAIN ] Update Progress: 1684/2370 symbols completed. PHK took 25.2s. Estimated remaining: 1h 12m 49s. Rate: 9.4 symbols/min [2025-09-14T19:35:56.419564] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:35:56.442070] [DEBUG] [LOCAL ] PII: Loaded 21610 existing records from primary storage. [2025-09-14T19:35:56.442259] [INFO ] [MAIN ] PII: Loaded 21610 existing records. [2025-09-14T19:35:56.564059] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-14T19:35:56.621255] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:35:56.621534] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-14T19:35:56.621600] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-14T19:35:56.622284] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-14T19:35:56.622353] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-14T19:35:57.000972] [INFO ] [REMOTE ] PII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:35:57.324814] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T19:35:57.358772] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-14T19:35:57.662748] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T19:35:58.158866] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-14T19:35:58.873419] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T19:35:58.958893] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-14T19:35:59.758865] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-14T19:35:59.897623] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T19:36:00.355378] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-14T19:36:00.558895] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-14T19:36:00.618175] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T19:36:01.358854] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-14T19:36:02.158888] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-14T19:36:02.958867] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-14T19:36:03.282911] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-14T19:36:03.758832] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-14T19:36:04.095733] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T19:36:04.272894] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T19:36:04.558849] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-14T19:36:05.358853] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-14T19:36:05.461673] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T19:36:05.549468] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T19:36:05.845813] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (4.49 seconds). [2025-09-14T19:36:06.158910] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-14T19:36:06.253341] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T19:36:06.958892] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-14T19:36:07.758968] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-14T19:36:07.988513] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T19:36:07.992248] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T19:36:08.558895] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-14T19:36:08.837686] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T19:36:09.358861] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-14T19:36:10.158844] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-14T19:36:10.348686] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T19:36:10.387629] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T19:36:10.958862] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-14T19:36:11.616364] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T19:36:11.653938] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:36:11.659461] [INFO ] [REMOTE ] PHM: Full fetch complete (56291 records). [2025-09-14T19:36:11.659627] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-14T19:36:11.764181] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-14T19:36:12.106830] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-09-14T19:36:12.106955] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-09-14T19:36:12.107986] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-09-14T19:36:12.108063] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-09-14T19:36:12.110619] [DEBUG] [LOCAL ] PHM: Trimmed 56291 records to 38859 (keeping 150 days of data) [2025-09-14T19:36:12.358326] [DEBUG] [LOCAL ] PHM: Primary data saved (38859 records). [2025-09-14T19:36:12.358533] [INFO ] [MAIN ] PHM: Full history saved. [2025-09-14T19:36:12.358712] [INFO ] [MAIN ] Update Progress: 1685/2370 symbols completed. PHM took 21.6s. Estimated remaining: 1h 12m 46s. Rate: 9.4 symbols/min [2025-09-14T19:36:12.531100] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:36:12.540147] [DEBUG] [LOCAL ] PIM: Loaded 2414 existing records from primary storage. [2025-09-14T19:36:12.540405] [INFO ] [MAIN ] PIM: Loaded 2414 existing records. [2025-09-14T19:36:12.564020] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-14T19:36:12.721917] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:36:12.722207] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-14T19:36:12.722292] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-14T19:36:12.722555] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-14T19:36:12.722613] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-14T19:36:13.081599] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T19:36:13.101994] [INFO ] [REMOTE ] PIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:36:13.358857] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-14T19:36:14.158853] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-14T19:36:14.297215] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:36:14.349887] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-14T19:36:14.958833] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-14T19:36:15.261712] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T19:36:15.758841] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-14T19:36:16.558837] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-14T19:36:16.945820] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T19:36:17.358838] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-14T19:36:17.786668] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T19:36:18.050584] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-09-14T19:36:18.083054] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-14T19:36:18.158817] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-14T19:36:18.958832] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-14T19:36:19.758828] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-14T19:36:19.908596] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T19:36:20.465379] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-14T19:36:20.480757] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T19:36:20.485686] [INFO ] [REMOTE ] PHR: Full fetch complete (39454 records). [2025-09-14T19:36:20.485829] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-14T19:36:20.563954] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-14T19:36:20.865079] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-14T19:36:20.865195] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-14T19:36:20.866081] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-14T19:36:20.866142] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-14T19:36:20.867447] [DEBUG] [LOCAL ] PHR: Trimmed 39454 records to 27578 (keeping 150 days of data) [2025-09-14T19:36:21.039368] [DEBUG] [LOCAL ] PHR: Primary data saved (27578 records). [2025-09-14T19:36:21.039562] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-14T19:36:21.039701] [INFO ] [MAIN ] Update Progress: 1686/2370 symbols completed. PHR took 28.8s. Estimated remaining: 1h 12m 41s. Rate: 9.4 symbols/min [2025-09-14T19:36:21.206149] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:36:21.214616] [DEBUG] [LOCAL ] PINE: Loaded 6352 existing records from primary storage. [2025-09-14T19:36:21.214777] [INFO ] [MAIN ] PINE: Loaded 6352 existing records. [2025-09-14T19:36:21.359806] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-14T19:36:21.398198] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:36:21.399138] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-14T19:36:21.399238] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-14T19:36:21.405957] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-14T19:36:21.412605] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-14T19:36:21.424579] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T19:36:21.489443] [INFO ] [REMOTE ] PII: Full fetch complete (53871 records). [2025-09-14T19:36:21.520939] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-14T19:36:22.056108] [INFO ] [REMOTE ] PINE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:36:22.173704] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-14T19:36:22.196681] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-14T19:36:22.196831] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-14T19:36:22.198341] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-14T19:36:22.198894] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-14T19:36:22.201193] [DEBUG] [LOCAL ] PII: Trimmed 53871 records to 37006 (keeping 150 days of data) [2025-09-14T19:36:22.433964] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T19:36:22.438489] [INFO ] [REMOTE ] PHT: Full fetch complete (16063 records). [2025-09-14T19:36:22.440443] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-14T19:36:22.844290] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-14T19:36:22.845318] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-14T19:36:22.847198] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-14T19:36:22.847565] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-14T19:36:22.850537] [DEBUG] [LOCAL ] PHT: Trimmed 16063 records to 12120 (keeping 150 days of data) [2025-09-14T19:36:22.919188] [DEBUG] [LOCAL ] PII: Primary data saved (37006 records). [2025-09-14T19:36:22.920924] [INFO ] [MAIN ] PII: Full history saved. [2025-09-14T19:36:22.922799] [INFO ] [MAIN ] Update Progress: 1687/2370 symbols completed. PII took 26.7s. Estimated remaining: 1h 12m 33s. Rate: 9.4 symbols/min [2025-09-14T19:36:22.984364] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-14T19:36:23.091328] [DEBUG] [LOCAL ] PHT: Primary data saved (12120 records). [2025-09-14T19:36:23.104686] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-14T19:36:23.123511] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:36:23.123671] [INFO ] [MAIN ] Update Progress: 1688/2370 symbols completed. PHT took 28.3s. Estimated remaining: 1h 12m 24s. Rate: 9.4 symbols/min [2025-09-14T19:36:23.275434] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T19:36:23.325509] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:36:23.337611] [DEBUG] [LOCAL ] PINS: Loaded 24104 existing records from primary storage. [2025-09-14T19:36:23.338092] [INFO ] [MAIN ] PINS: Loaded 24104 existing records. [2025-09-14T19:36:23.448092] [DEBUG] [LOCAL ] PIPR: Loaded 6591 existing records from primary storage. [2025-09-14T19:36:23.459405] [INFO ] [MAIN ] PIPR: Loaded 6591 existing records. [2025-09-14T19:36:23.618261] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:36:23.639913] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-14T19:36:23.645786] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-14T19:36:23.691963] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-14T19:36:23.720373] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:36:23.720818] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-14T19:36:23.721135] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-14T19:36:23.721411] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-14T19:36:23.770713] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T19:36:23.770108] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-14T19:36:23.784551] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-14T19:36:23.810281] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-14T19:36:24.398815] [INFO ] [REMOTE ] PINS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:36:24.499200] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:36:24.558864] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-14T19:36:24.843751] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:36:25.358834] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-14T19:36:25.797529] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T19:36:26.104740] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T19:36:26.158819] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-14T19:36:26.958838] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-14T19:36:27.134497] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T19:36:27.758870] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-14T19:36:28.558862] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-14T19:36:29.009513] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-14T19:36:29.054796] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T19:36:29.358845] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-14T19:36:29.511182] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T19:36:30.158863] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-14T19:36:30.958841] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-14T19:36:31.193580] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T19:36:31.379196] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T19:36:31.743171] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T19:36:31.758787] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-14T19:36:32.558882] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-14T19:36:32.846696] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T19:36:33.358817] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-14T19:36:33.435870] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T19:36:34.158855] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-14T19:36:34.370098] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T19:36:34.958880] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-14T19:36:35.608266] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T19:36:35.758801] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-14T19:36:36.311146] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T19:36:36.558807] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-14T19:36:36.874855] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T19:36:37.358844] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-14T19:36:37.457219] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T19:36:37.460001] [INFO ] [REMOTE ] PINE: Full fetch complete (15646 records). [2025-09-14T19:36:37.460404] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-14T19:36:37.836684] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-14T19:36:37.836805] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-14T19:36:37.837189] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-14T19:36:37.837243] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-14T19:36:37.837962] [DEBUG] [LOCAL ] PINE: Trimmed 15646 records to 10663 (keeping 150 days of data) [2025-09-14T19:36:37.908261] [DEBUG] [LOCAL ] PINE: Primary data saved (10663 records). [2025-09-14T19:36:37.908454] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-14T19:36:37.908583] [INFO ] [MAIN ] Update Progress: 1689/2370 symbols completed. PINE took 16.9s. Estimated remaining: 1h 12m 21s. Rate: 9.4 symbols/min [2025-09-14T19:36:38.023800] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T19:36:38.092973] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:36:38.106068] [DEBUG] [LOCAL ] PJT: Loaded 9017 existing records from primary storage. [2025-09-14T19:36:38.106294] [INFO ] [MAIN ] PJT: Loaded 9017 existing records. [2025-09-14T19:36:38.164068] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-14T19:36:38.293152] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:36:38.293412] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-14T19:36:38.293471] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-14T19:36:38.293952] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-14T19:36:38.294015] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-14T19:36:38.689961] [INFO ] [REMOTE ] PJT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:36:38.958897] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-14T19:36:38.968366] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T19:36:38.970537] [INFO ] [REMOTE ] PIM: Full fetch complete (4908 records). [2025-09-14T19:36:38.970665] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-14T19:36:39.322636] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-14T19:36:39.322761] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-14T19:36:39.322938] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-14T19:36:39.323007] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-14T19:36:39.323424] [DEBUG] [LOCAL ] PIM: Trimmed 4908 records to 3668 (keeping 150 days of data) [2025-09-14T19:36:39.346203] [DEBUG] [LOCAL ] PIM: Primary data saved (3668 records). [2025-09-14T19:36:39.346317] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-14T19:36:39.346443] [INFO ] [MAIN ] Update Progress: 1690/2370 symbols completed. PIM took 27.0s. Estimated remaining: 1h 12m 13s. Rate: 9.4 symbols/min [2025-09-14T19:36:39.526005] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:36:39.555425] [DEBUG] [LOCAL ] PK: Loaded 23621 existing records from primary storage. [2025-09-14T19:36:39.555718] [INFO ] [MAIN ] PK: Loaded 23621 existing records. [2025-09-14T19:36:39.765540] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-14T19:36:39.765830] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:36:39.767346] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-14T19:36:39.767417] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-14T19:36:39.768490] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-14T19:36:39.768569] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-14T19:36:40.157761] [INFO ] [REMOTE ] PK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:36:40.558834] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-14T19:36:41.235842] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T19:36:41.261991] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T19:36:41.308462] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T19:36:41.358820] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-14T19:36:41.831453] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T19:36:41.833080] [INFO ] [REMOTE ] PIPR: Full fetch complete (16306 records). [2025-09-14T19:36:41.833165] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-14T19:36:42.167736] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-14T19:36:42.213672] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-14T19:36:42.213817] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-14T19:36:42.214317] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-14T19:36:42.214372] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-14T19:36:42.215217] [DEBUG] [LOCAL ] PIPR: Trimmed 16306 records to 10990 (keeping 150 days of data) [2025-09-14T19:36:42.293440] [DEBUG] [LOCAL ] PIPR: Primary data saved (10990 records). [2025-09-14T19:36:42.293714] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-14T19:36:42.293846] [INFO ] [MAIN ] Update Progress: 1691/2370 symbols completed. PIPR took 19.2s. Estimated remaining: 1h 12m 5s. Rate: 9.4 symbols/min [2025-09-14T19:36:42.474478] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:36:42.485443] [DEBUG] [LOCAL ] PKE: Loaded 7449 existing records from primary storage. [2025-09-14T19:36:42.485687] [INFO ] [MAIN ] PKE: Loaded 7449 existing records. [2025-09-14T19:36:42.668075] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:36:42.668389] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-14T19:36:42.668455] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-14T19:36:42.669150] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-14T19:36:42.669483] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-14T19:36:42.967835] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-14T19:36:43.051133] [INFO ] [REMOTE ] PKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:36:43.758886] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-14T19:36:44.299458] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-14T19:36:44.450220] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T19:36:44.558817] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-14T19:36:44.884151] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:36:45.358919] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-14T19:36:45.898925] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T19:36:46.158865] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-14T19:36:46.941850] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T19:36:46.958791] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-14T19:36:47.365144] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T19:36:47.758924] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-14T19:36:48.558904] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-14T19:36:48.850000] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T19:36:49.089135] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T19:36:49.358938] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-14T19:36:50.158815] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-14T19:36:50.667011] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T19:36:50.958886] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-14T19:36:51.003284] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T19:36:51.230872] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T19:36:51.758921] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-14T19:36:52.078061] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T19:36:52.558860] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-14T19:36:53.358908] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-14T19:36:53.536112] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T19:36:53.800554] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T19:36:53.943355] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-14T19:36:54.158888] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-14T19:36:54.958863] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-14T19:36:55.758908] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-14T19:36:56.099405] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T19:36:56.372470] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-14T19:36:56.558851] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-14T19:36:56.668345] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T19:36:57.358847] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-14T19:36:57.895306] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T19:36:57.897595] [INFO ] [REMOTE ] PJT: Full fetch complete (25062 records). [2025-09-14T19:36:57.897734] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-14T19:36:58.163911] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-14T19:36:58.274722] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-14T19:36:58.274913] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-14T19:36:58.275707] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-14T19:36:58.275841] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-14T19:36:58.276978] [DEBUG] [LOCAL ] PJT: Trimmed 25062 records to 16167 (keeping 150 days of data) [2025-09-14T19:36:58.364947] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-14T19:36:58.373997] [INFO ] [REMOTE ] PINS: Full fetch complete (58373 records). [2025-09-14T19:36:58.375113] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-14T19:36:58.791673] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-14T19:36:58.792550] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-14T19:36:58.794218] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-14T19:36:58.794833] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-14T19:36:58.808243] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T19:36:58.807710] [DEBUG] [LOCAL ] PINS: Trimmed 58373 records to 40433 (keeping 150 days of data) [2025-09-14T19:36:58.816489] [DEBUG] [LOCAL ] PJT: Primary data saved (16167 records). [2025-09-14T19:36:58.816671] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-14T19:36:58.816814] [INFO ] [MAIN ] Update Progress: 1692/2370 symbols completed. PJT took 20.9s. Estimated remaining: 1h 12m 3s. Rate: 9.4 symbols/min [2025-09-14T19:36:58.994810] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-14T19:36:59.110067] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:36:59.205574] [DEBUG] [LOCAL ] PKG: Loaded 16973 existing records from primary storage. [2025-09-14T19:36:59.216341] [INFO ] [MAIN ] PKG: Loaded 16973 existing records. [2025-09-14T19:36:59.464486] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:36:59.465713] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-14T19:36:59.465796] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-14T19:36:59.466515] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-14T19:36:59.467427] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-14T19:36:59.790604] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-14T19:36:59.874677] [INFO ] [REMOTE ] PKG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:36:59.890599] [DEBUG] [LOCAL ] PINS: Primary data saved (40433 records). [2025-09-14T19:36:59.890806] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-14T19:36:59.890916] [INFO ] [MAIN ] Update Progress: 1693/2370 symbols completed. PINS took 37.0s. Estimated remaining: 1h 11m 54s. Rate: 9.4 symbols/min [2025-09-14T19:37:00.096002] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:00.107402] [DEBUG] [LOCAL ] PKST: Loaded 8001 existing records from primary storage. [2025-09-14T19:37:00.107586] [INFO ] [MAIN ] PKST: Loaded 8001 existing records. [2025-09-14T19:37:00.326326] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:00.326747] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-14T19:37:00.326843] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-14T19:37:00.327341] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-14T19:37:00.327439] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-14T19:37:00.561401] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-14T19:37:00.928684] [INFO ] [REMOTE ] PKST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:01.160449] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T19:37:01.228416] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T19:37:01.358894] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-14T19:37:01.688327] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:37:02.158845] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-14T19:37:02.958903] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-14T19:37:03.117404] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T19:37:03.226952] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T19:37:03.746014] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T19:37:03.758803] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-14T19:37:04.558902] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-14T19:37:04.710784] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T19:37:04.930254] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T19:37:04.937453] [INFO ] [REMOTE ] PK: Full fetch complete (57455 records). [2025-09-14T19:37:04.937862] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-14T19:37:05.339469] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-14T19:37:05.339599] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-14T19:37:05.341062] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-14T19:37:05.341147] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-14T19:37:05.342635] [DEBUG] [LOCAL ] PK: Trimmed 57455 records to 39726 (keeping 150 days of data) [2025-09-14T19:37:05.404372] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-14T19:37:05.619262] [DEBUG] [LOCAL ] PK: Primary data saved (39726 records). [2025-09-14T19:37:05.619455] [INFO ] [MAIN ] PK: Full history saved. [2025-09-14T19:37:05.619570] [INFO ] [MAIN ] Update Progress: 1694/2370 symbols completed. PK took 26.3s. Estimated remaining: 1h 11m 47s. Rate: 9.4 symbols/min [2025-09-14T19:37:05.790257] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:05.802030] [DEBUG] [LOCAL ] PKX: Loaded 9451 existing records from primary storage. [2025-09-14T19:37:05.802192] [INFO ] [MAIN ] PKX: Loaded 9451 existing records. [2025-09-14T19:37:05.980895] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:05.981195] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-14T19:37:05.981257] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-14T19:37:05.981863] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-14T19:37:05.981927] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-14T19:37:06.167247] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-14T19:37:06.348869] [INFO ] [REMOTE ] PKX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:06.374757] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T19:37:06.958835] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-14T19:37:07.654526] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T19:37:07.758857] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-14T19:37:08.565075] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-14T19:37:08.570607] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T19:37:08.732369] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T19:37:09.358829] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-14T19:37:09.859908] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T19:37:10.104025] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:37:10.106017] [INFO ] [REMOTE ] PKE: Full fetch complete (13083 records). [2025-09-14T19:37:10.106207] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-14T19:37:10.164100] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-14T19:37:10.493331] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-14T19:37:10.493461] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-14T19:37:10.493827] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-14T19:37:10.493878] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-14T19:37:10.494663] [DEBUG] [LOCAL ] PKE: Trimmed 13083 records to 9995 (keeping 150 days of data) [2025-09-14T19:37:10.556974] [DEBUG] [LOCAL ] PKE: Primary data saved (9995 records). [2025-09-14T19:37:10.557158] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-14T19:37:10.557282] [INFO ] [MAIN ] Update Progress: 1695/2370 symbols completed. PKE took 28.3s. Estimated remaining: 1h 11m 40s. Rate: 9.4 symbols/min [2025-09-14T19:37:10.726722] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:10.749610] [DEBUG] [LOCAL ] PL: Loaded 24059 existing records from primary storage. [2025-09-14T19:37:10.749783] [INFO ] [MAIN ] PL: Loaded 24059 existing records. [2025-09-14T19:37:10.925300] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:10.925590] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-14T19:37:10.925684] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-14T19:37:10.926443] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-14T19:37:10.926505] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-14T19:37:10.963955] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-14T19:37:11.291838] [INFO ] [REMOTE ] PL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:11.507360] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T19:37:11.758785] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-14T19:37:12.558899] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-14T19:37:12.682255] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T19:37:12.703989] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T19:37:13.358866] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-14T19:37:14.158855] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-14T19:37:14.525786] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T19:37:14.773458] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-14T19:37:14.958840] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-14T19:37:15.696090] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T19:37:15.758831] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-14T19:37:16.558852] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-14T19:37:17.051112] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T19:37:17.239750] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-14T19:37:17.358835] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-14T19:37:17.444807] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T19:37:18.158838] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-14T19:37:18.340978] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T19:37:18.958843] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-14T19:37:19.758952] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-14T19:37:20.177171] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T19:37:20.215342] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T19:37:20.559766] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-14T19:37:20.567125] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T19:37:21.358843] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-14T19:37:21.860237] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T19:37:22.158835] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-14T19:37:22.432051] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T19:37:22.958890] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-14T19:37:23.758814] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-14T19:37:23.885733] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T19:37:23.888492] [INFO ] [REMOTE ] PKST: Full fetch complete (21664 records). [2025-09-14T19:37:23.888585] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-14T19:37:24.320741] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-14T19:37:24.320894] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-14T19:37:24.321811] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-14T19:37:24.321909] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-14T19:37:24.323133] [DEBUG] [LOCAL ] PKST: Trimmed 21664 records to 13160 (keeping 150 days of data) [2025-09-14T19:37:24.432174] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-14T19:37:24.448077] [DEBUG] [LOCAL ] PKST: Primary data saved (13160 records). [2025-09-14T19:37:24.460144] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-14T19:37:24.460693] [INFO ] [MAIN ] Update Progress: 1696/2370 symbols completed. PKST took 24.6s. Estimated remaining: 1h 11m 37s. Rate: 9.4 symbols/min [2025-09-14T19:37:24.566728] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-14T19:37:24.654861] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:24.681549] [DEBUG] [LOCAL ] PLD: Loaded 23909 existing records from primary storage. [2025-09-14T19:37:24.681797] [INFO ] [MAIN ] PLD: Loaded 23909 existing records. [2025-09-14T19:37:24.870030] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:24.870400] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-14T19:37:24.870659] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-14T19:37:24.876584] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-14T19:37:24.883031] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-14T19:37:24.883497] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T19:37:25.263014] [INFO ] [REMOTE ] PLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:25.358879] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-14T19:37:26.158880] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-14T19:37:26.455427] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T19:37:26.458915] [INFO ] [REMOTE ] PKX: Full fetch complete (28182 records). [2025-09-14T19:37:26.459052] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-14T19:37:26.859506] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-14T19:37:26.859717] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-14T19:37:26.861007] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-14T19:37:26.861195] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-14T19:37:26.862787] [DEBUG] [LOCAL ] PKX: Trimmed 28182 records to 17013 (keeping 150 days of data) [2025-09-14T19:37:26.876221] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:37:26.935103] [INFO ] [REMOTE ] PKG: Full fetch complete (43223 records). [2025-09-14T19:37:26.958268] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-14T19:37:26.960514] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-14T19:37:27.091174] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-14T19:37:27.444514] [DEBUG] [LOCAL ] PKX: Primary data saved (17013 records). [2025-09-14T19:37:27.444712] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-14T19:37:27.444871] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-14T19:37:27.445076] [INFO ] [MAIN ] Update Progress: 1697/2370 symbols completed. PKX took 21.8s. Estimated remaining: 1h 11m 29s. Rate: 9.4 symbols/min [2025-09-14T19:37:27.445174] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-14T19:37:27.496465] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-14T19:37:27.535586] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-14T19:37:27.636715] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:27.637134] [DEBUG] [LOCAL ] PKG: Trimmed 43223 records to 29138 (keeping 150 days of data) [2025-09-14T19:37:27.757884] [DEBUG] [LOCAL ] PLNT: Loaded 21235 existing records from primary storage. [2025-09-14T19:37:27.758316] [INFO ] [MAIN ] PLNT: Loaded 21235 existing records. [2025-09-14T19:37:27.770583] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-14T19:37:28.047574] [DEBUG] [LOCAL ] PKG: Primary data saved (29138 records). [2025-09-14T19:37:28.053891] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-14T19:37:28.053730] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:28.054182] [INFO ] [MAIN ] Update Progress: 1698/2370 symbols completed. PKG took 29.2s. Estimated remaining: 1h 11m 21s. Rate: 9.4 symbols/min [2025-09-14T19:37:28.054443] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-14T19:37:28.088949] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-14T19:37:28.149948] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-14T19:37:28.160694] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-14T19:37:28.352483] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:28.506850] [DEBUG] [LOCAL ] PLOW: Loaded 8792 existing records from primary storage. [2025-09-14T19:37:28.527284] [INFO ] [MAIN ] PLOW: Loaded 8792 existing records. [2025-09-14T19:37:28.711662] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:28.732459] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-14T19:37:28.799694] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:28.800059] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-14T19:37:28.800132] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-14T19:37:28.800733] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-14T19:37:28.800807] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-14T19:37:29.174694] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:29.206636] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-14T19:37:29.358956] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-14T19:37:30.158960] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-14T19:37:30.326502] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-14T19:37:30.487532] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T19:37:30.594336] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T19:37:30.958891] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-14T19:37:31.763946] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-14T19:37:31.785868] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T19:37:31.813948] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T19:37:32.558876] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-14T19:37:33.358933] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-14T19:37:33.618256] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T19:37:34.169018] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-14T19:37:34.175245] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T19:37:34.958876] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-14T19:37:35.331482] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T19:37:35.479023] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T19:37:35.758873] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-14T19:37:36.176119] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T19:37:36.558900] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-14T19:37:37.358898] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-14T19:37:37.860786] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-14T19:37:37.866326] [INFO ] [REMOTE ] PL: Full fetch complete (57762 records). [2025-09-14T19:37:37.866483] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-14T19:37:38.158858] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-14T19:37:38.252202] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-14T19:37:38.252369] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-14T19:37:38.253824] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-14T19:37:38.253932] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-14T19:37:38.256112] [DEBUG] [LOCAL ] PL: Trimmed 57762 records to 39968 (keeping 150 days of data) [2025-09-14T19:37:38.521931] [DEBUG] [LOCAL ] PL: Primary data saved (39968 records). [2025-09-14T19:37:38.522256] [INFO ] [MAIN ] PL: Full history saved. [2025-09-14T19:37:38.522417] [INFO ] [MAIN ] Update Progress: 1699/2370 symbols completed. PL took 28.0s. Estimated remaining: 1h 11m 16s. Rate: 9.4 symbols/min [2025-09-14T19:37:38.707059] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:38.740281] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T19:37:38.767931] [DEBUG] [LOCAL ] PLYM: Loaded 15581 existing records from primary storage. [2025-09-14T19:37:38.768157] [INFO ] [MAIN ] PLYM: Loaded 15581 existing records. [2025-09-14T19:37:38.958433] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:38.958883] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-14T19:37:38.959220] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-14T19:37:38.960428] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-14T19:37:38.961061] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-14T19:37:38.961139] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-14T19:37:39.294118] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T19:37:39.374388] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:39.409271] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-14T19:37:39.758863] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-14T19:37:40.558851] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-14T19:37:40.808938] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T19:37:40.975583] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T19:37:41.358847] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-14T19:37:41.858030] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T19:37:42.158836] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-14T19:37:42.524402] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T19:37:42.958845] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-14T19:37:43.758860] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-14T19:37:44.121405] [DEBUG] [REMOTE ] PLNT: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-14T19:37:44.121805] [WARN ] [REMOTE ] PLNT: No data returned for month 2025-06 [2025-09-14T19:37:44.165774] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T19:37:44.225603] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T19:37:44.558862] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-14T19:37:45.358855] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-14T19:37:46.158841] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-14T19:37:46.442389] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T19:37:46.958800] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-14T19:37:47.408013] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-14T19:37:47.608086] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T19:37:47.723593] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T19:37:47.758806] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-14T19:37:48.558875] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-14T19:37:48.664586] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T19:37:48.666851] [INFO ] [REMOTE ] PLOW: Full fetch complete (22451 records). [2025-09-14T19:37:48.666940] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-14T19:37:49.057974] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-14T19:37:49.058098] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-14T19:37:49.058727] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-14T19:37:49.058791] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-14T19:37:49.059623] [DEBUG] [LOCAL ] PLOW: Trimmed 22451 records to 15707 (keeping 150 days of data) [2025-09-14T19:37:49.159506] [DEBUG] [LOCAL ] PLOW: Primary data saved (15707 records). [2025-09-14T19:37:49.159762] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-14T19:37:49.159902] [INFO ] [MAIN ] Update Progress: 1700/2370 symbols completed. PLOW took 21.1s. Estimated remaining: 1h 11m 11s. Rate: 9.4 symbols/min [2025-09-14T19:37:49.347134] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:49.398771] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-14T19:37:49.410960] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T19:37:49.416996] [INFO ] [REMOTE ] PLD: Full fetch complete (58118 records). [2025-09-14T19:37:49.417149] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-14T19:37:49.596256] [DEBUG] [LOCAL ] PM: Loaded 24100 existing records from primary storage. [2025-09-14T19:37:49.616137] [INFO ] [MAIN ] PM: Loaded 24100 existing records. [2025-09-14T19:37:50.027294] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-14T19:37:50.027473] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:50.027770] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-14T19:37:50.028021] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-14T19:37:50.030088] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-14T19:37:50.030266] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-14T19:37:50.030526] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-14T19:37:50.031623] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-09-14T19:37:50.031944] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-14T19:37:50.109286] [DEBUG] [LOCAL ] PLD: Trimmed 58118 records to 40247 (keeping 150 days of data) [2025-09-14T19:37:50.224418] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-14T19:37:50.528174] [INFO ] [REMOTE ] PM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:50.697397] [DEBUG] [LOCAL ] PLD: Primary data saved (40247 records). [2025-09-14T19:37:50.697588] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-14T19:37:50.697742] [INFO ] [MAIN ] Update Progress: 1701/2370 symbols completed. PLD took 26.2s. Estimated remaining: 1h 11m 3s. Rate: 9.4 symbols/min [2025-09-14T19:37:50.867110] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:50.878334] [DEBUG] [LOCAL ] PML: Loaded 10814 existing records from primary storage. [2025-09-14T19:37:50.878493] [INFO ] [MAIN ] PML: Loaded 10814 existing records. [2025-09-14T19:37:50.967969] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-14T19:37:51.064695] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:51.065131] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-14T19:37:51.065228] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-14T19:37:51.065944] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-14T19:37:51.066075] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-14T19:37:51.450634] [INFO ] [REMOTE ] PML: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:51.454917] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T19:37:51.486130] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T19:37:51.758845] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-14T19:37:52.558875] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-14T19:37:53.122018] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T19:37:53.267101] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:37:53.275385] [INFO ] [REMOTE ] PLNT: Full fetch complete (45783 records). [2025-09-14T19:37:53.277741] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-14T19:37:53.376565] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-14T19:37:53.401081] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-14T19:37:53.659261] [WARN ] [VALIDATOR ] PLNT: Validation failed - insufficient historical data. Have 130 unique days, need 150 days [2025-09-14T19:37:53.660163] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:37:53.660251] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:37:53.660311] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-14T19:37:53.660425] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-09-14T19:37:53.660481] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-09-14T19:37:53.660546] [DEBUG] [LOCAL ] PLNT: No derivative data file found to delete. [2025-09-14T19:37:53.660697] [INFO ] [MAIN ] Update Progress: 1702/2370 symbols completed. PLNT took 26.2s. Estimated remaining: 1h 10m 55s. Rate: 9.4 symbols/min [2025-09-14T19:37:53.864241] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:37:53.871572] [DEBUG] [LOCAL ] PMM: Loaded 4025 existing records from primary storage. [2025-09-14T19:37:53.871771] [INFO ] [MAIN ] PMM: Loaded 4025 existing records. [2025-09-14T19:37:54.089657] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:37:54.089954] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-14T19:37:54.090031] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-14T19:37:54.090387] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-14T19:37:54.090473] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-14T19:37:54.164206] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-14T19:37:54.466493] [INFO ] [REMOTE ] PMM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:37:54.706981] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T19:37:54.958847] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-14T19:37:55.668444] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T19:37:55.758929] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-14T19:37:56.278068] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T19:37:56.558873] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-14T19:37:57.358845] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-14T19:37:57.922150] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T19:37:58.067010] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T19:37:58.158863] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-14T19:37:58.366277] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T19:37:58.958841] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-14T19:37:59.456379] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T19:37:59.461003] [INFO ] [REMOTE ] PLYM: Full fetch complete (35331 records). [2025-09-14T19:37:59.461146] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-14T19:37:59.750545] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T19:37:59.762857] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-14T19:37:59.880106] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-14T19:37:59.880276] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-14T19:37:59.881332] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-14T19:37:59.881394] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-14T19:37:59.883661] [DEBUG] [LOCAL ] PLYM: Trimmed 35331 records to 24636 (keeping 150 days of data) [2025-09-14T19:38:00.062283] [DEBUG] [LOCAL ] PLYM: Primary data saved (24636 records). [2025-09-14T19:38:00.062503] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-14T19:38:00.062691] [INFO ] [MAIN ] Update Progress: 1703/2370 symbols completed. PLYM took 21.5s. Estimated remaining: 1h 10m 49s. Rate: 9.4 symbols/min [2025-09-14T19:38:00.257269] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:00.264556] [DEBUG] [LOCAL ] PMO: Loaded 3895 existing records from primary storage. [2025-09-14T19:38:00.264759] [INFO ] [MAIN ] PMO: Loaded 3895 existing records. [2025-09-14T19:38:00.447953] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:00.448306] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-14T19:38:00.448385] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-14T19:38:00.448759] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-14T19:38:00.448824] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-14T19:38:00.563988] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-14T19:38:00.823124] [INFO ] [REMOTE ] PMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:00.836693] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:38:01.358851] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-14T19:38:02.158872] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-14T19:38:02.175799] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T19:38:02.775380] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-14T19:38:02.958879] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-14T19:38:03.490133] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T19:38:03.758924] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-14T19:38:04.558896] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-14T19:38:04.659419] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T19:38:05.106929] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T19:38:05.358847] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-14T19:38:05.375668] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T19:38:06.158859] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-14T19:38:06.419119] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T19:38:06.958869] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-14T19:38:07.033074] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T19:38:07.758881] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-14T19:38:07.939986] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T19:38:08.301954] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T19:38:08.558856] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-14T19:38:09.358872] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-14T19:38:09.872416] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T19:38:09.917629] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T19:38:10.158874] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-14T19:38:10.958858] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-14T19:38:11.420967] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T19:38:11.758882] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-14T19:38:12.157611] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T19:38:12.161301] [INFO ] [REMOTE ] PML: Full fetch complete (21304 records). [2025-09-14T19:38:12.161475] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-14T19:38:12.543568] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-14T19:38:12.543708] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-14T19:38:12.544244] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-14T19:38:12.544522] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-14T19:38:12.545255] [DEBUG] [LOCAL ] PML: Trimmed 21304 records to 15514 (keeping 150 days of data) [2025-09-14T19:38:12.591421] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-14T19:38:12.659792] [DEBUG] [LOCAL ] PML: Primary data saved (15514 records). [2025-09-14T19:38:12.660012] [INFO ] [MAIN ] PML: Full history saved. [2025-09-14T19:38:12.660166] [INFO ] [MAIN ] Update Progress: 1704/2370 symbols completed. PML took 22.0s. Estimated remaining: 1h 10m 45s. Rate: 9.4 symbols/min [2025-09-14T19:38:12.846004] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:12.854625] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T19:38:12.879094] [DEBUG] [LOCAL ] PMT: Loaded 17597 existing records from primary storage. [2025-09-14T19:38:12.879321] [INFO ] [MAIN ] PMT: Loaded 17597 existing records. [2025-09-14T19:38:13.071619] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:13.071934] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-14T19:38:13.071997] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-14T19:38:13.072985] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-14T19:38:13.073303] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-14T19:38:13.364170] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-14T19:38:13.472941] [INFO ] [REMOTE ] PMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:13.483403] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T19:38:14.012974] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T19:38:14.158858] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-14T19:38:14.958858] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-14T19:38:15.689490] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T19:38:15.758852] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-14T19:38:16.526993] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:38:16.528691] [INFO ] [REMOTE ] PMM: Full fetch complete (12433 records). [2025-09-14T19:38:16.528786] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-14T19:38:16.564007] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-14T19:38:16.898861] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-14T19:38:16.899130] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-14T19:38:16.899586] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-14T19:38:16.899691] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-14T19:38:16.900388] [DEBUG] [LOCAL ] PMM: Trimmed 12433 records to 6973 (keeping 150 days of data) [2025-09-14T19:38:16.967591] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T19:38:16.988754] [DEBUG] [LOCAL ] PMM: Primary data saved (6973 records). [2025-09-14T19:38:16.988896] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-14T19:38:16.989005] [INFO ] [MAIN ] Update Progress: 1705/2370 symbols completed. PMM took 23.3s. Estimated remaining: 1h 10m 38s. Rate: 9.4 symbols/min [2025-09-14T19:38:17.158815] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:17.160891] [DEBUG] [LOCAL ] PMTU: Loaded 265 existing records from primary storage. [2025-09-14T19:38:17.160979] [INFO ] [MAIN ] PMTU: Loaded 265 existing records. [2025-09-14T19:38:17.336430] [WARN ] [MAIN ] PMTU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:17.336738] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-14T19:38:17.336801] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-14T19:38:17.337096] [DEBUG] [LOCAL ] PMTU: Deleted primary data file. [2025-09-14T19:38:17.337156] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-14T19:38:17.369265] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-14T19:38:17.689124] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:18.158858] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-14T19:38:18.231489] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T19:38:18.958864] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-14T19:38:18.967552] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T19:38:19.765371] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-14T19:38:19.778546] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-14T19:38:20.558890] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-14T19:38:20.691567] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:38:20.735102] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T19:38:21.119033] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-14T19:38:21.358898] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-14T19:38:21.809701] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T19:38:22.158890] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-14T19:38:22.632680] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-14T19:38:22.958867] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-14T19:38:23.703292] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:38:23.704894] [INFO ] [REMOTE ] PMO: Full fetch complete (11500 records). [2025-09-14T19:38:23.704998] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-14T19:38:23.765904] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-14T19:38:24.080289] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-14T19:38:24.080412] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-14T19:38:24.080798] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-14T19:38:24.080911] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-14T19:38:24.081465] [DEBUG] [LOCAL ] PMO: Trimmed 11500 records to 7053 (keeping 150 days of data) [2025-09-14T19:38:24.126415] [DEBUG] [LOCAL ] PMO: Primary data saved (7053 records). [2025-09-14T19:38:24.126632] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-14T19:38:24.126798] [INFO ] [MAIN ] Update Progress: 1706/2370 symbols completed. PMO took 24.1s. Estimated remaining: 1h 10m 32s. Rate: 9.4 symbols/min [2025-09-14T19:38:24.235135] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T19:38:24.319821] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:24.324151] [DEBUG] [LOCAL ] PMTV: Loaded 1823 existing records from primary storage. [2025-09-14T19:38:24.324312] [INFO ] [MAIN ] PMTV: Loaded 1823 existing records. [2025-09-14T19:38:24.518872] [WARN ] [MAIN ] PMTV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:24.519187] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-14T19:38:24.519247] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-14T19:38:24.519537] [DEBUG] [LOCAL ] PMTV: Deleted primary data file. [2025-09-14T19:38:24.519596] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-14T19:38:24.563922] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-14T19:38:24.879428] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:24.996427] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-14T19:38:25.358871] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-14T19:38:26.158858] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-14T19:38:26.958808] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-14T19:38:27.451747] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-14T19:38:27.758836] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-14T19:38:27.777271] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T19:38:27.806147] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T19:38:28.194170] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T19:38:28.558839] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-14T19:38:29.182213] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T19:38:29.358841] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-14T19:38:29.789782] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T19:38:30.158832] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-14T19:38:30.457727] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T19:38:30.458466] [INFO ] [REMOTE ] PMTU: Full fetch complete (848 records). [2025-09-14T19:38:30.458552] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-14T19:38:30.635911] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T19:38:30.636122] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:38:30.636182] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:38:30.636231] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-14T19:38:30.636305] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-14T19:38:30.636364] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-14T19:38:30.636429] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-14T19:38:30.636512] [INFO ] [MAIN ] Update Progress: 1707/2370 symbols completed. PMTU took 13.6s. Estimated remaining: 1h 10m 25s. Rate: 9.4 symbols/min [2025-09-14T19:38:30.809851] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:30.815189] [DEBUG] [LOCAL ] PMTW: Loaded 3146 existing records from primary storage. [2025-09-14T19:38:30.815333] [INFO ] [MAIN ] PMTW: Loaded 3146 existing records. [2025-09-14T19:38:30.964067] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-14T19:38:31.002915] [WARN ] [MAIN ] PMTW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:31.003205] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-14T19:38:31.003267] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-14T19:38:31.003734] [DEBUG] [LOCAL ] PMTW: Deleted primary data file. [2025-09-14T19:38:31.003799] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-14T19:38:31.378992] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:31.706615] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:38:31.712096] [INFO ] [REMOTE ] PM: Full fetch complete (58343 records). [2025-09-14T19:38:31.712226] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-14T19:38:31.767906] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-14T19:38:32.102351] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-09-14T19:38:32.102471] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-09-14T19:38:32.103628] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-09-14T19:38:32.103706] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-09-14T19:38:32.105047] [DEBUG] [LOCAL ] PM: Trimmed 58343 records to 40417 (keeping 150 days of data) [2025-09-14T19:38:32.396151] [DEBUG] [LOCAL ] PM: Primary data saved (40417 records). [2025-09-14T19:38:32.396315] [INFO ] [MAIN ] PM: Full history saved. [2025-09-14T19:38:32.396431] [INFO ] [MAIN ] Update Progress: 1708/2370 symbols completed. PM took 43.2s. Estimated remaining: 1h 10m 17s. Rate: 9.4 symbols/min [2025-09-14T19:38:32.563226] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-14T19:38:32.564732] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:32.589118] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T19:38:32.599970] [DEBUG] [LOCAL ] PNC: Loaded 23272 existing records from primary storage. [2025-09-14T19:38:32.600159] [INFO ] [MAIN ] PNC: Loaded 23272 existing records. [2025-09-14T19:38:32.776445] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:32.776730] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-14T19:38:32.776792] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-14T19:38:32.777694] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-09-14T19:38:32.777757] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-14T19:38:33.129824] [INFO ] [REMOTE ] PNC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:33.358873] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-14T19:38:34.085746] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T19:38:34.165359] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-14T19:38:34.183718] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T19:38:34.456167] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:38:34.456590] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-14T19:38:34.958843] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-14T19:38:35.758929] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-14T19:38:36.042281] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:38:36.042725] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-14T19:38:36.558847] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-14T19:38:36.822513] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:38:36.823561] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-14T19:38:36.825254] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T19:38:37.358893] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-14T19:38:37.614066] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:38:37.614464] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-14T19:38:38.158855] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-14T19:38:38.958848] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-14T19:38:39.052952] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T19:38:39.636804] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T19:38:39.758902] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-14T19:38:40.418609] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T19:38:40.558813] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-14T19:38:41.206163] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T19:38:41.358890] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-14T19:38:42.158896] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-14T19:38:42.924908] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T19:38:42.954359] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T19:38:42.962603] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-14T19:38:43.532165] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:38:43.533216] [INFO ] [REMOTE ] PMTV: Full fetch complete (5992 records). [2025-09-14T19:38:43.533307] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-14T19:38:43.716912] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 145 unique days, need 150 days [2025-09-14T19:38:43.717211] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:38:43.717288] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:38:43.717346] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-14T19:38:43.717454] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-14T19:38:43.717532] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-14T19:38:43.717623] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-14T19:38:43.717767] [INFO ] [MAIN ] Update Progress: 1709/2370 symbols completed. PMTV took 19.6s. Estimated remaining: 1h 10m 13s. Rate: 9.4 symbols/min [2025-09-14T19:38:43.764069] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-14T19:38:43.895392] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:43.900309] [DEBUG] [LOCAL ] PNI: Loaded 3016 existing records from primary storage. [2025-09-14T19:38:43.900466] [INFO ] [MAIN ] PNI: Loaded 3016 existing records. [2025-09-14T19:38:44.080125] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:44.080431] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-14T19:38:44.080493] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-14T19:38:44.080770] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-14T19:38:44.080835] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-14T19:38:44.438146] [INFO ] [REMOTE ] PNI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:44.513366] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:38:44.517404] [INFO ] [REMOTE ] PMT: Full fetch complete (43720 records). [2025-09-14T19:38:44.517519] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-14T19:38:44.563894] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-14T19:38:44.888041] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-14T19:38:44.888147] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-14T19:38:44.889059] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-14T19:38:44.889118] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-14T19:38:44.890087] [DEBUG] [LOCAL ] PMT: Trimmed 43720 records to 29928 (keeping 150 days of data) [2025-09-14T19:38:45.075829] [DEBUG] [LOCAL ] PMT: Primary data saved (29928 records). [2025-09-14T19:38:45.076004] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-14T19:38:45.076108] [INFO ] [MAIN ] Update Progress: 1710/2370 symbols completed. PMT took 32.4s. Estimated remaining: 1h 10m 4s. Rate: 9.4 symbols/min [2025-09-14T19:38:45.244405] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:45.259040] [DEBUG] [LOCAL ] PNNT: Loaded 14152 existing records from primary storage. [2025-09-14T19:38:45.259187] [INFO ] [MAIN ] PNNT: Loaded 14152 existing records. [2025-09-14T19:38:45.364237] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-14T19:38:45.443690] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:45.452582] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-14T19:38:45.452447] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T19:38:45.452739] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-14T19:38:45.455848] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-14T19:38:45.456074] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-14T19:38:45.822187] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:46.158902] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-14T19:38:46.420682] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T19:38:46.958894] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-14T19:38:47.731236] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T19:38:47.732688] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T19:38:47.758772] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-14T19:38:48.259405] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T19:38:48.260572] [INFO ] [REMOTE ] PMTW: Full fetch complete (3520 records). [2025-09-14T19:38:48.260692] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-14T19:38:48.447095] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 64 unique days, need 150 days [2025-09-14T19:38:48.447341] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:38:48.447439] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:38:48.447493] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-14T19:38:48.447567] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-14T19:38:48.447618] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-14T19:38:48.447693] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-14T19:38:48.447788] [INFO ] [MAIN ] Update Progress: 1711/2370 symbols completed. PMTW took 17.8s. Estimated remaining: 1h 9m 57s. Rate: 9.4 symbols/min [2025-09-14T19:38:48.564016] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-14T19:38:48.637345] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:38:48.663029] [DEBUG] [LOCAL ] PNR: Loaded 21397 existing records from primary storage. [2025-09-14T19:38:48.663242] [INFO ] [MAIN ] PNR: Loaded 21397 existing records. [2025-09-14T19:38:48.839849] [WARN ] [MAIN ] PNR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:38:48.840127] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-14T19:38:48.840191] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-14T19:38:48.840967] [DEBUG] [LOCAL ] PNR: Deleted primary data file. [2025-09-14T19:38:48.841031] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-14T19:38:49.192175] [INFO ] [REMOTE ] PNR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:38:49.358863] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-14T19:38:50.158885] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-14T19:38:50.168367] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T19:38:50.515029] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T19:38:50.729877] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-14T19:38:50.958885] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-14T19:38:51.758845] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-14T19:38:52.476241] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T19:38:52.519632] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T19:38:52.558810] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-14T19:38:53.358877] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-14T19:38:53.533663] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T19:38:54.158892] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-14T19:38:54.426955] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T19:38:54.868163] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T19:38:54.958912] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-14T19:38:55.752018] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T19:38:55.758770] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-14T19:38:56.434057] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T19:38:56.558843] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-14T19:38:57.163435] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-14T19:38:57.358830] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-14T19:38:58.100532] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-14T19:38:58.158869] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-14T19:38:58.954889] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T19:38:58.958771] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-14T19:38:59.608801] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:38:59.610494] [INFO ] [REMOTE ] PNI: Full fetch complete (7145 records). [2025-09-14T19:38:59.610595] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-14T19:38:59.766134] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-14T19:39:00.010277] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-14T19:39:00.010428] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-14T19:39:00.010702] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-14T19:39:00.010759] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-14T19:39:00.011348] [DEBUG] [LOCAL ] PNI: Trimmed 7145 records to 4942 (keeping 150 days of data) [2025-09-14T19:39:00.042666] [DEBUG] [LOCAL ] PNI: Primary data saved (4942 records). [2025-09-14T19:39:00.042861] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-14T19:39:00.042992] [INFO ] [MAIN ] Update Progress: 1712/2370 symbols completed. PNI took 16.3s. Estimated remaining: 1h 9m 53s. Rate: 9.4 symbols/min [2025-09-14T19:39:00.218947] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:00.241690] [DEBUG] [LOCAL ] PNW: Loaded 20438 existing records from primary storage. [2025-09-14T19:39:00.241913] [INFO ] [MAIN ] PNW: Loaded 20438 existing records. [2025-09-14T19:39:00.441125] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:00.442141] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-14T19:39:00.442214] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-14T19:39:00.443550] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-14T19:39:00.443625] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-14T19:39:00.564032] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-14T19:39:00.821864] [INFO ] [REMOTE ] PNW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:01.358900] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-14T19:39:01.444427] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T19:39:01.711304] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T19:39:02.158865] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-14T19:39:02.958917] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-14T19:39:03.758887] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-14T19:39:05.250461] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-09-14T19:39:05.258576] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-14T19:39:05.293370] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-14T19:39:05.351075] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (3.99 seconds). [2025-09-14T19:39:05.360245] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-14T19:39:05.595111] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T19:39:06.071000] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:39:06.076276] [INFO ] [REMOTE ] PNC: Full fetch complete (56912 records). [2025-09-14T19:39:06.076396] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-14T19:39:06.168501] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-14T19:39:06.466924] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-09-14T19:39:06.467079] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-09-14T19:39:06.468204] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-09-14T19:39:06.468325] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-09-14T19:39:06.469717] [DEBUG] [LOCAL ] PNC: Trimmed 56912 records to 39287 (keeping 150 days of data) [2025-09-14T19:39:06.488253] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T19:39:06.768110] [DEBUG] [LOCAL ] PNC: Primary data saved (39287 records). [2025-09-14T19:39:06.768299] [INFO ] [MAIN ] PNC: Full history saved. [2025-09-14T19:39:06.768424] [INFO ] [MAIN ] Update Progress: 1713/2370 symbols completed. PNC took 34.4s. Estimated remaining: 1h 9m 46s. Rate: 9.4 symbols/min [2025-09-14T19:39:06.942070] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:06.963884] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-14T19:39:06.965399] [DEBUG] [LOCAL ] POR: Loaded 21557 existing records from primary storage. [2025-09-14T19:39:06.966411] [INFO ] [MAIN ] POR: Loaded 21557 existing records. [2025-09-14T19:39:07.148151] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:07.148423] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-14T19:39:07.148486] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-14T19:39:07.149229] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-14T19:39:07.149295] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-14T19:39:07.495511] [INFO ] [REMOTE ] POR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:07.758800] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-14T19:39:08.102713] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T19:39:08.140786] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T19:39:08.145979] [INFO ] [REMOTE ] PNNT: Full fetch complete (35618 records). [2025-09-14T19:39:08.146113] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-14T19:39:08.524354] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-14T19:39:08.524493] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-14T19:39:08.525320] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-14T19:39:08.525379] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-14T19:39:08.526392] [DEBUG] [LOCAL ] PNNT: Trimmed 35618 records to 24207 (keeping 150 days of data) [2025-09-14T19:39:08.591961] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-14T19:39:08.693329] [DEBUG] [LOCAL ] PNNT: Primary data saved (24207 records). [2025-09-14T19:39:08.693530] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-14T19:39:08.693679] [INFO ] [MAIN ] Update Progress: 1714/2370 symbols completed. PNNT took 23.6s. Estimated remaining: 1h 9m 38s. Rate: 9.4 symbols/min [2025-09-14T19:39:08.884709] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:08.903841] [DEBUG] [LOCAL ] POST: Loaded 18234 existing records from primary storage. [2025-09-14T19:39:08.904020] [INFO ] [MAIN ] POST: Loaded 18234 existing records. [2025-09-14T19:39:09.085807] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:09.086118] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-14T19:39:09.086187] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-14T19:39:09.087073] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-14T19:39:09.087141] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-14T19:39:09.363304] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-14T19:39:09.446946] [INFO ] [REMOTE ] POST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:09.623695] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T19:39:09.963381] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T19:39:10.158856] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-14T19:39:10.958869] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-14T19:39:11.090154] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T19:39:11.756323] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T19:39:11.764749] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-14T19:39:12.558863] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-14T19:39:12.760836] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T19:39:13.358893] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-14T19:39:13.743271] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T19:39:14.021827] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T19:39:14.158852] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-14T19:39:14.958887] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-14T19:39:15.586980] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-14T19:39:15.758864] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-14T19:39:16.512623] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-14T19:39:16.558801] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-14T19:39:17.315783] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-14T19:39:17.358859] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-14T19:39:17.610526] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T19:39:18.046765] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T19:39:18.158885] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-14T19:39:18.958894] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-14T19:39:19.431161] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-14T19:39:19.563887] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T19:39:19.758899] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-14T19:39:20.558921] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-14T19:39:20.711341] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T19:39:21.102046] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T19:39:21.358909] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-14T19:39:22.003693] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T19:39:22.008958] [INFO ] [REMOTE ] PNW: Full fetch complete (49964 records). [2025-09-14T19:39:22.009114] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-14T19:39:22.170597] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-14T19:39:22.396948] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-14T19:39:22.397113] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-14T19:39:22.398211] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-14T19:39:22.398310] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-14T19:39:22.422953] [DEBUG] [LOCAL ] PNW: Trimmed 49964 records to 34616 (keeping 150 days of data) [2025-09-14T19:39:22.423854] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T19:39:22.654033] [DEBUG] [LOCAL ] PNW: Primary data saved (34616 records). [2025-09-14T19:39:22.654246] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-14T19:39:22.654384] [INFO ] [MAIN ] Update Progress: 1715/2370 symbols completed. PNW took 22.6s. Estimated remaining: 1h 9m 35s. Rate: 9.4 symbols/min [2025-09-14T19:39:22.825628] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:22.849266] [DEBUG] [LOCAL ] PPG: Loaded 22445 existing records from primary storage. [2025-09-14T19:39:22.849480] [INFO ] [MAIN ] PPG: Loaded 22445 existing records. [2025-09-14T19:39:22.964071] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-14T19:39:23.040678] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:23.040974] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-14T19:39:23.041038] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-14T19:39:23.041779] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-14T19:39:23.041843] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-14T19:39:23.401794] [INFO ] [REMOTE ] PPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:23.758896] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-14T19:39:23.930733] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T19:39:24.558944] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-14T19:39:24.725797] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T19:39:25.358868] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-14T19:39:25.505597] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T19:39:26.006887] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T19:39:26.033890] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:39:26.038455] [INFO ] [REMOTE ] POST: Full fetch complete (42330 records). [2025-09-14T19:39:26.038563] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-14T19:39:26.164056] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-14T19:39:26.420487] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-14T19:39:26.420602] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-14T19:39:26.421545] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-14T19:39:26.421611] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-14T19:39:26.422599] [DEBUG] [LOCAL ] POST: Trimmed 42330 records to 29045 (keeping 150 days of data) [2025-09-14T19:39:26.603556] [DEBUG] [LOCAL ] POST: Primary data saved (29045 records). [2025-09-14T19:39:26.603740] [INFO ] [MAIN ] POST: Full history saved. [2025-09-14T19:39:26.603845] [INFO ] [MAIN ] Update Progress: 1716/2370 symbols completed. POST took 17.9s. Estimated remaining: 1h 9m 28s. Rate: 9.4 symbols/min [2025-09-14T19:39:26.774126] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:26.797010] [DEBUG] [LOCAL ] PPL: Loaded 23985 existing records from primary storage. [2025-09-14T19:39:26.797193] [INFO ] [MAIN ] PPL: Loaded 23985 existing records. [2025-09-14T19:39:26.960610] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-14T19:39:26.984398] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:26.984610] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-14T19:39:26.984708] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-14T19:39:26.985494] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-09-14T19:39:26.985629] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-14T19:39:27.348326] [INFO ] [REMOTE ] PPL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:27.758873] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-14T19:39:28.050375] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T19:39:28.558907] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-14T19:39:28.768247] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T19:39:28.896387] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T19:39:28.901511] [INFO ] [REMOTE ] PNR: Full fetch complete (52571 records). [2025-09-14T19:39:28.901684] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-14T19:39:29.291201] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-09-14T19:39:29.291340] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-09-14T19:39:29.292712] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-09-14T19:39:29.292811] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-09-14T19:39:29.294278] [DEBUG] [LOCAL ] PNR: Trimmed 52571 records to 35810 (keeping 150 days of data) [2025-09-14T19:39:29.366359] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-14T19:39:29.546146] [DEBUG] [LOCAL ] PNR: Primary data saved (35810 records). [2025-09-14T19:39:29.546336] [INFO ] [MAIN ] PNR: Full history saved. [2025-09-14T19:39:29.546445] [INFO ] [MAIN ] Update Progress: 1717/2370 symbols completed. PNR took 41.1s. Estimated remaining: 1h 9m 20s. Rate: 9.4 symbols/min [2025-09-14T19:39:29.870455] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T19:39:30.158900] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-14T19:39:30.958846] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-14T19:39:31.000238] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T19:39:31.758908] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-14T19:39:32.021202] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T19:39:32.558848] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-14T19:39:32.846724] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T19:39:33.133396] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T19:39:33.358840] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-14T19:39:34.158893] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-14T19:39:34.309224] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T19:39:34.958834] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-14T19:39:35.228767] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T19:39:35.758897] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-14T19:39:35.891455] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:39:36.350496] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T19:39:36.558846] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-14T19:39:36.956074] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T19:39:36.961304] [INFO ] [REMOTE ] POR: Full fetch complete (51185 records). [2025-09-14T19:39:36.961501] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-14T19:39:37.347077] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-14T19:39:37.347294] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-14T19:39:37.348338] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-14T19:39:37.348598] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-14T19:39:37.349792] [DEBUG] [LOCAL ] POR: Trimmed 51185 records to 35115 (keeping 150 days of data) [2025-09-14T19:39:37.405981] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-14T19:39:37.586276] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T19:39:37.620055] [DEBUG] [LOCAL ] POR: Primary data saved (35115 records). [2025-09-14T19:39:37.620287] [INFO ] [MAIN ] POR: Full history saved. [2025-09-14T19:39:37.620409] [INFO ] [MAIN ] Update Progress: 1718/2370 symbols completed. POR took 30.9s. Estimated remaining: 1h 9m 14s. Rate: 9.4 symbols/min [2025-09-14T19:39:38.158836] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-14T19:39:39.070188] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T19:39:39.081577] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-14T19:39:40.017179] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T19:39:40.029043] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-14T19:39:40.708496] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T19:39:40.719600] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-14T19:39:41.419533] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:39:41.424833] [INFO ] [REMOTE ] PPG: Full fetch complete (55324 records). [2025-09-14T19:39:41.424965] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-14T19:39:41.830846] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-14T19:39:41.830978] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-14T19:39:41.832148] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-14T19:39:41.832263] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-14T19:39:41.834043] [DEBUG] [LOCAL ] PPG: Trimmed 55324 records to 37868 (keeping 150 days of data) [2025-09-14T19:39:41.865624] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T19:39:41.942466] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-14T19:39:42.144440] [DEBUG] [LOCAL ] PPG: Primary data saved (37868 records). [2025-09-14T19:39:42.144672] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-14T19:39:42.144811] [INFO ] [MAIN ] Update Progress: 1719/2370 symbols completed. PPG took 19.5s. Estimated remaining: 1h 9m 7s. Rate: 9.4 symbols/min [2025-09-14T19:39:43.804012] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T19:39:43.816625] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-14T19:39:45.751441] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T19:39:45.763225] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-14T19:39:46.497498] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:39:46.504747] [INFO ] [REMOTE ] PPL: Full fetch complete (58188 records). [2025-09-14T19:39:46.504959] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-14T19:39:46.983688] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-09-14T19:39:46.983842] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-09-14T19:39:46.985283] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-09-14T19:39:46.985353] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-09-14T19:39:46.989059] [DEBUG] [LOCAL ] PPL: Trimmed 58188 records to 40279 (keeping 150 days of data) [2025-09-14T19:39:47.258180] [DEBUG] [LOCAL ] PPL: Primary data saved (40279 records). [2025-09-14T19:39:47.258397] [INFO ] [MAIN ] PPL: Full history saved. [2025-09-14T19:39:47.258518] [INFO ] [MAIN ] Update Progress: 1720/2370 symbols completed. PPL took 20.7s. Estimated remaining: 1h 9m 0s. Rate: 9.4 symbols/min [2025-09-14T19:39:47.958624] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:47.987148] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:47.978115] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:48.015544] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:48.021716] [DEBUG] [LOCAL ] PRCS: Loaded 1188 existing records from primary storage. [2025-09-14T19:39:48.022381] [INFO ] [MAIN ] PRCS: Loaded 1188 existing records. [2025-09-14T19:39:48.111363] [DEBUG] [LOCAL ] PPT: Loaded 9732 existing records from primary storage. [2025-09-14T19:39:48.133085] [INFO ] [MAIN ] PPT: Loaded 9732 existing records. [2025-09-14T19:39:48.234235] [DEBUG] [LOCAL ] PRA: Loaded 14640 existing records from primary storage. [2025-09-14T19:39:48.278020] [INFO ] [MAIN ] PRA: Loaded 14640 existing records. [2025-09-14T19:39:48.262102] [DEBUG] [LOCAL ] PR: Loaded 24044 existing records from primary storage. [2025-09-14T19:39:48.363549] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:48.368852] [INFO ] [MAIN ] PR: Loaded 24044 existing records. [2025-09-14T19:39:48.477630] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-14T19:39:48.592214] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-14T19:39:48.630889] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-09-14T19:39:48.649578] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-14T19:39:48.655602] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:48.763247] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-14T19:39:48.898247] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:48.898373] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-14T19:39:48.939792] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-14T19:39:48.939522] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:48.940150] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-14T19:39:48.945629] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-14T19:39:48.956019] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-14T19:39:48.956219] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-14T19:39:48.961372] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-14T19:39:48.991815] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-14T19:39:49.060143] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-14T19:39:49.198458] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-14T19:39:49.242004] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-14T19:39:49.817359] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:49.866968] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-14T19:39:50.194110] [INFO ] [REMOTE ] PR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:50.243228] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-14T19:39:50.337870] [INFO ] [REMOTE ] PPT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:50.342016] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-14T19:39:50.422322] [INFO ] [REMOTE ] PRA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:50.422721] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-14T19:39:50.641925] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T19:39:50.643377] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-14T19:39:51.008565] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-14T19:39:51.011164] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-14T19:39:51.516767] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:39:51.521526] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-14T19:39:51.588169] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T19:39:51.593057] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-14T19:39:51.616039] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-14T19:39:51.618469] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-14T19:39:51.735824] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T19:39:51.746472] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-14T19:39:51.983980] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T19:39:51.985757] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-14T19:39:52.365617] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T19:39:52.493680] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T19:39:52.558811] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-14T19:39:52.925955] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T19:39:53.115223] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T19:39:53.358876] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-14T19:39:53.542343] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T19:39:54.158840] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-14T19:39:54.547277] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T19:39:54.687267] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T19:39:54.958851] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-14T19:39:55.758835] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-14T19:39:56.558906] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T19:39:56.558978] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-14T19:39:56.937810] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T19:39:56.973357] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T19:39:56.974239] [INFO ] [REMOTE ] PRCS: Full fetch complete (3087 records). [2025-09-14T19:39:56.974331] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-14T19:39:57.334551] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-09-14T19:39:57.334676] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-09-14T19:39:57.334816] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-09-14T19:39:57.334876] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-09-14T19:39:57.335287] [DEBUG] [LOCAL ] PRCS: Trimmed 3087 records to 2019 (keeping 150 days of data) [2025-09-14T19:39:57.348775] [DEBUG] [LOCAL ] PRCS: Primary data saved (2019 records). [2025-09-14T19:39:57.348918] [INFO ] [MAIN ] PRCS: Full history saved. [2025-09-14T19:39:57.349065] [INFO ] [MAIN ] Update Progress: 1721/2370 symbols completed. PRCS took 10.1s. Estimated remaining: 1h 8m 55s. Rate: 9.4 symbols/min [2025-09-14T19:39:57.363894] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-14T19:39:57.524840] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:39:57.542201] [DEBUG] [LOCAL ] PRG: Loaded 12253 existing records from primary storage. [2025-09-14T19:39:57.542406] [INFO ] [MAIN ] PRG: Loaded 12253 existing records. [2025-09-14T19:39:57.752839] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:39:57.753180] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-14T19:39:57.753271] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-14T19:39:57.753887] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-14T19:39:57.753968] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-14T19:39:58.170421] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-14T19:39:58.330913] [INFO ] [REMOTE ] PRG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:39:58.958876] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-14T19:39:59.306444] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T19:39:59.441806] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-14T19:39:59.758872] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-14T19:40:00.558885] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-14T19:40:00.711557] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T19:40:01.358886] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-14T19:40:01.812578] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-14T19:40:02.158861] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-14T19:40:02.328517] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T19:40:02.823703] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T19:40:02.958844] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-14T19:40:03.722137] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T19:40:03.758888] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-14T19:40:04.381940] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T19:40:04.558871] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-14T19:40:05.358844] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-14T19:40:05.704531] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T19:40:06.152197] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T19:40:06.160664] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-14T19:40:06.970084] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-14T19:40:06.973081] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T19:40:07.758825] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-14T19:40:07.939304] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T19:40:08.062306] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T19:40:08.558823] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-14T19:40:09.011208] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T19:40:09.358838] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-14T19:40:09.584273] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T19:40:09.588061] [INFO ] [REMOTE ] PPT: Full fetch complete (22015 records). [2025-09-14T19:40:09.588237] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-14T19:40:09.969779] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-14T19:40:09.969917] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-14T19:40:09.970495] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-14T19:40:09.970550] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-14T19:40:09.971553] [DEBUG] [LOCAL ] PPT: Trimmed 22015 records to 15034 (keeping 150 days of data) [2025-09-14T19:40:10.065123] [DEBUG] [LOCAL ] PPT: Primary data saved (15034 records). [2025-09-14T19:40:10.065293] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-14T19:40:10.065417] [INFO ] [MAIN ] Update Progress: 1722/2370 symbols completed. PPT took 22.8s. Estimated remaining: 1h 8m 51s. Rate: 9.4 symbols/min [2025-09-14T19:40:10.165097] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-14T19:40:10.254322] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:10.275926] [DEBUG] [LOCAL ] PRGO: Loaded 20580 existing records from primary storage. [2025-09-14T19:40:10.276144] [INFO ] [MAIN ] PRGO: Loaded 20580 existing records. [2025-09-14T19:40:10.456113] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:10.456425] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-14T19:40:10.456485] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-14T19:40:10.457094] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-14T19:40:10.457157] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-14T19:40:10.821725] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:10.958871] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-14T19:40:11.356121] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T19:40:11.408306] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T19:40:11.758872] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-14T19:40:12.558861] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-14T19:40:12.723237] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T19:40:13.187741] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T19:40:13.215547] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:40:13.219125] [INFO ] [REMOTE ] PRA: Full fetch complete (36403 records). [2025-09-14T19:40:13.219231] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-14T19:40:13.366270] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-14T19:40:13.647205] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-14T19:40:13.647350] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-14T19:40:13.648255] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-14T19:40:13.648318] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-14T19:40:13.649592] [DEBUG] [LOCAL ] PRA: Trimmed 36403 records to 26274 (keeping 150 days of data) [2025-09-14T19:40:13.820022] [DEBUG] [LOCAL ] PRA: Primary data saved (26274 records). [2025-09-14T19:40:13.820195] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-14T19:40:13.820317] [INFO ] [MAIN ] Update Progress: 1723/2370 symbols completed. PRA took 26.6s. Estimated remaining: 1h 8m 44s. Rate: 9.4 symbols/min [2025-09-14T19:40:13.987102] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:13.991149] [DEBUG] [LOCAL ] PRH: Loaded 1799 existing records from primary storage. [2025-09-14T19:40:13.991251] [INFO ] [MAIN ] PRH: Loaded 1799 existing records. [2025-09-14T19:40:14.164000] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-14T19:40:14.163901] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:14.165419] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-14T19:40:14.165512] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-14T19:40:14.165820] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-14T19:40:14.165882] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-14T19:40:14.521905] [INFO ] [REMOTE ] PRH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:14.870186] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T19:40:14.958844] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-14T19:40:15.026760] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T19:40:15.032919] [INFO ] [REMOTE ] PR: Full fetch complete (58285 records). [2025-09-14T19:40:15.033098] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-14T19:40:15.422883] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-14T19:40:15.423021] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-14T19:40:15.424216] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-14T19:40:15.424285] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-14T19:40:15.425784] [DEBUG] [LOCAL ] PR: Trimmed 58285 records to 40354 (keeping 150 days of data) [2025-09-14T19:40:15.712723] [DEBUG] [LOCAL ] PR: Primary data saved (40354 records). [2025-09-14T19:40:15.712882] [INFO ] [MAIN ] PR: Full history saved. [2025-09-14T19:40:15.713000] [INFO ] [MAIN ] Update Progress: 1724/2370 symbols completed. PR took 28.5s. Estimated remaining: 1h 8m 36s. Rate: 9.4 symbols/min [2025-09-14T19:40:15.767594] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-14T19:40:15.884319] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:15.894228] [DEBUG] [LOCAL ] PRI: Loaded 7920 existing records from primary storage. [2025-09-14T19:40:15.894384] [INFO ] [MAIN ] PRI: Loaded 7920 existing records. [2025-09-14T19:40:16.069768] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:16.070078] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-14T19:40:16.070139] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-14T19:40:16.070492] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-14T19:40:16.070574] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-14T19:40:16.417219] [INFO ] [REMOTE ] PRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:16.558804] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-14T19:40:16.783067] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:40:16.875701] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T19:40:17.358854] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-14T19:40:17.667578] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T19:40:18.158846] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-14T19:40:18.744423] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T19:40:18.958838] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-14T19:40:19.671345] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T19:40:19.758847] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-14T19:40:19.893585] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:40:20.329922] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:40:20.333149] [INFO ] [REMOTE ] PRG: Full fetch complete (34205 records). [2025-09-14T19:40:20.333295] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-14T19:40:20.564004] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-14T19:40:20.715119] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-14T19:40:20.715236] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-14T19:40:20.716128] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-14T19:40:20.716218] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-14T19:40:20.717255] [DEBUG] [LOCAL ] PRG: Trimmed 34205 records to 22008 (keeping 150 days of data) [2025-09-14T19:40:20.862231] [DEBUG] [LOCAL ] PRG: Primary data saved (22008 records). [2025-09-14T19:40:20.862393] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-14T19:40:20.862507] [INFO ] [MAIN ] Update Progress: 1725/2370 symbols completed. PRG took 23.5s. Estimated remaining: 1h 8m 29s. Rate: 9.4 symbols/min [2025-09-14T19:40:21.043479] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:21.067576] [DEBUG] [LOCAL ] PRIM: Loaded 19984 existing records from primary storage. [2025-09-14T19:40:21.067815] [INFO ] [MAIN ] PRIM: Loaded 19984 existing records. [2025-09-14T19:40:21.258984] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:21.259271] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-14T19:40:21.259333] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-14T19:40:21.260047] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-14T19:40:21.260112] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-14T19:40:21.359899] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-14T19:40:21.622935] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:22.158836] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-14T19:40:22.268010] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T19:40:22.498702] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T19:40:22.958894] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-14T19:40:23.758923] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-14T19:40:23.938444] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T19:40:24.193874] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T19:40:24.248050] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T19:40:24.558920] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-14T19:40:25.358865] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-14T19:40:25.702251] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T19:40:26.158900] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-14T19:40:26.958822] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-14T19:40:26.991131] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T19:40:27.009334] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T19:40:27.758899] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-14T19:40:28.558881] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-14T19:40:28.695312] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T19:40:29.179202] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T19:40:29.358845] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-14T19:40:29.453622] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T19:40:29.958202] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T19:40:30.158879] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-14T19:40:30.785057] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T19:40:30.958861] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-14T19:40:31.382126] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T19:40:31.383126] [INFO ] [REMOTE ] PRH: Full fetch complete (5874 records). [2025-09-14T19:40:31.383213] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-14T19:40:31.748917] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-14T19:40:31.749055] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-14T19:40:31.749334] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-14T19:40:31.749401] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-14T19:40:31.749877] [DEBUG] [LOCAL ] PRH: Trimmed 5874 records to 3644 (keeping 150 days of data) [2025-09-14T19:40:31.762372] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-14T19:40:31.776747] [DEBUG] [LOCAL ] PRH: Primary data saved (3644 records). [2025-09-14T19:40:31.776886] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-14T19:40:31.776995] [INFO ] [MAIN ] Update Progress: 1726/2370 symbols completed. PRH took 18.0s. Estimated remaining: 1h 8m 24s. Rate: 9.4 symbols/min [2025-09-14T19:40:31.958992] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:31.978926] [DEBUG] [LOCAL ] PRKS: Loaded 19091 existing records from primary storage. [2025-09-14T19:40:31.979117] [INFO ] [MAIN ] PRKS: Loaded 19091 existing records. [2025-09-14T19:40:32.165327] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:32.165706] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-14T19:40:32.165794] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-14T19:40:32.166465] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-14T19:40:32.166532] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-14T19:40:32.538477] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:32.558770] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-14T19:40:33.358877] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-14T19:40:33.408709] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T19:40:34.166804] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-14T19:40:34.172269] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T19:40:34.425112] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T19:40:34.925378] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:40:34.931015] [INFO ] [REMOTE ] PRGO: Full fetch complete (51147 records). [2025-09-14T19:40:34.931218] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-14T19:40:34.965638] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-14T19:40:35.391863] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-14T19:40:35.392067] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-14T19:40:35.395314] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-14T19:40:35.395424] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-14T19:40:35.397681] [DEBUG] [LOCAL ] PRGO: Trimmed 51147 records to 34678 (keeping 150 days of data) [2025-09-14T19:40:35.650372] [DEBUG] [LOCAL ] PRGO: Primary data saved (34678 records). [2025-09-14T19:40:35.650614] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-14T19:40:35.650809] [INFO ] [MAIN ] Update Progress: 1727/2370 symbols completed. PRGO took 25.6s. Estimated remaining: 1h 8m 17s. Rate: 9.4 symbols/min [2025-09-14T19:40:35.763936] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-14T19:40:35.832602] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:35.844244] [DEBUG] [LOCAL ] PRLB: Loaded 8716 existing records from primary storage. [2025-09-14T19:40:35.844448] [INFO ] [MAIN ] PRLB: Loaded 8716 existing records. [2025-09-14T19:40:36.027172] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:36.027531] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-14T19:40:36.027606] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-14T19:40:36.028137] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-14T19:40:36.028205] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-14T19:40:36.408553] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:36.558872] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-14T19:40:36.694200] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:40:37.294344] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T19:40:37.358855] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-14T19:40:37.896825] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T19:40:38.158901] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-14T19:40:38.761145] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T19:40:38.958889] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-14T19:40:39.082907] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T19:40:39.758885] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-14T19:40:39.786937] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T19:40:40.558893] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-14T19:40:41.273496] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T19:40:41.358783] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-14T19:40:42.158853] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-14T19:40:42.342384] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T19:40:42.890214] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T19:40:42.958831] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-14T19:40:43.212466] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T19:40:43.758876] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-14T19:40:44.364207] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T19:40:44.558871] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-14T19:40:45.051503] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T19:40:45.358879] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-14T19:40:45.920799] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T19:40:46.158863] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-14T19:40:46.958856] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-14T19:40:47.086981] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T19:40:47.252419] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T19:40:47.758899] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-14T19:40:48.224984] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T19:40:48.299242] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T19:40:48.301970] [INFO ] [REMOTE ] PRI: Full fetch complete (19924 records). [2025-09-14T19:40:48.302083] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-14T19:40:48.568719] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-14T19:40:48.693498] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-14T19:40:48.693670] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-14T19:40:48.694465] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-14T19:40:48.694538] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-14T19:40:48.695314] [DEBUG] [LOCAL ] PRI: Trimmed 19924 records to 13321 (keeping 150 days of data) [2025-09-14T19:40:48.779132] [DEBUG] [LOCAL ] PRI: Primary data saved (13321 records). [2025-09-14T19:40:48.779318] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-14T19:40:48.779422] [INFO ] [MAIN ] Update Progress: 1728/2370 symbols completed. PRI took 33.1s. Estimated remaining: 1h 8m 13s. Rate: 9.4 symbols/min [2025-09-14T19:40:48.962534] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:48.986104] [DEBUG] [LOCAL ] PRM: Loaded 20311 existing records from primary storage. [2025-09-14T19:40:48.986327] [INFO ] [MAIN ] PRM: Loaded 20311 existing records. [2025-09-14T19:40:49.173223] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:49.173577] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-14T19:40:49.173681] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-14T19:40:49.174549] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-14T19:40:49.174627] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-14T19:40:49.364157] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-14T19:40:49.559736] [INFO ] [REMOTE ] PRM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:50.005910] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T19:40:50.011283] [INFO ] [REMOTE ] PRKS: Full fetch complete (46582 records). [2025-09-14T19:40:50.011452] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-14T19:40:50.165572] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-14T19:40:50.509678] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-14T19:40:50.509877] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-14T19:40:50.512485] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-14T19:40:50.512626] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-14T19:40:50.514858] [DEBUG] [LOCAL ] PRKS: Trimmed 46582 records to 31624 (keeping 150 days of data) [2025-09-14T19:40:50.819266] [DEBUG] [LOCAL ] PRKS: Primary data saved (31624 records). [2025-09-14T19:40:50.819702] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-14T19:40:50.819918] [INFO ] [MAIN ] Update Progress: 1729/2370 symbols completed. PRKS took 19.0s. Estimated remaining: 1h 8m 5s. Rate: 9.4 symbols/min [2025-09-14T19:40:50.963862] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-14T19:40:51.072751] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:51.103718] [DEBUG] [LOCAL ] PRMB: Loaded 23861 existing records from primary storage. [2025-09-14T19:40:51.103990] [INFO ] [MAIN ] PRMB: Loaded 23861 existing records. [2025-09-14T19:40:51.344039] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:51.344460] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-14T19:40:51.344540] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-14T19:40:51.345898] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-14T19:40:51.345978] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-14T19:40:51.708959] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-14T19:40:51.768482] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-14T19:40:51.807989] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:52.114948] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T19:40:52.157874] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T19:40:52.558845] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-14T19:40:53.009712] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-14T19:40:53.014709] [INFO ] [REMOTE ] PRIM: Full fetch complete (48565 records). [2025-09-14T19:40:53.014903] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-14T19:40:53.364072] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-14T19:40:53.430889] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-14T19:40:53.431028] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-14T19:40:53.432173] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-14T19:40:53.432235] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-14T19:40:53.434022] [DEBUG] [LOCAL ] PRIM: Trimmed 48565 records to 33406 (keeping 150 days of data) [2025-09-14T19:40:53.659117] [DEBUG] [LOCAL ] PRIM: Primary data saved (33406 records). [2025-09-14T19:40:53.659349] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-14T19:40:53.659756] [INFO ] [MAIN ] Update Progress: 1730/2370 symbols completed. PRIM took 32.8s. Estimated remaining: 1h 7m 57s. Rate: 9.4 symbols/min [2025-09-14T19:40:53.837340] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:53.857439] [DEBUG] [LOCAL ] PRO: Loaded 18566 existing records from primary storage. [2025-09-14T19:40:53.857667] [INFO ] [MAIN ] PRO: Loaded 18566 existing records. [2025-09-14T19:40:54.040809] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:54.041087] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-14T19:40:54.041156] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-14T19:40:54.041787] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-14T19:40:54.041850] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-14T19:40:54.164049] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-14T19:40:54.423377] [INFO ] [REMOTE ] PRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:54.460964] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T19:40:54.958849] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-14T19:40:55.283583] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T19:40:55.425996] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T19:40:55.758841] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-14T19:40:55.888729] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T19:40:56.558838] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-14T19:40:56.935311] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:40:57.358841] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-14T19:40:58.158876] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-14T19:40:58.343366] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T19:40:58.401197] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-14T19:40:58.403533] [INFO ] [REMOTE ] PRLB: Full fetch complete (23454 records). [2025-09-14T19:40:58.403625] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-14T19:40:58.770415] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-14T19:40:58.770604] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-14T19:40:58.771348] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-14T19:40:58.771543] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-14T19:40:58.790546] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T19:40:58.790754] [DEBUG] [LOCAL ] PRLB: Trimmed 23454 records to 15442 (keeping 150 days of data) [2025-09-14T19:40:58.890658] [DEBUG] [LOCAL ] PRLB: Primary data saved (15442 records). [2025-09-14T19:40:58.890836] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-14T19:40:58.890939] [INFO ] [MAIN ] Update Progress: 1731/2370 symbols completed. PRLB took 23.2s. Estimated remaining: 1h 7m 51s. Rate: 9.4 symbols/min [2025-09-14T19:40:58.964101] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-14T19:40:59.063257] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:40:59.074698] [DEBUG] [LOCAL ] PRSU: Loaded 10475 existing records from primary storage. [2025-09-14T19:40:59.074850] [INFO ] [MAIN ] PRSU: Loaded 10475 existing records. [2025-09-14T19:40:59.247751] [WARN ] [MAIN ] PRSU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:40:59.247985] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-14T19:40:59.248045] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-14T19:40:59.248396] [DEBUG] [LOCAL ] PRSU: Deleted primary data file. [2025-09-14T19:40:59.248454] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-14T19:40:59.596915] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:40:59.758842] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-14T19:41:00.558893] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-14T19:41:00.814901] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T19:41:00.987323] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T19:41:01.358845] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-14T19:41:02.158856] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-14T19:41:02.911511] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-14T19:41:02.958837] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-14T19:41:03.207534] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T19:41:03.451168] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T19:41:03.758827] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-14T19:41:04.558836] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-14T19:41:04.735291] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T19:41:05.265102] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T19:41:05.358849] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-14T19:41:06.158793] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-14T19:41:06.297233] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T19:41:06.870779] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T19:41:06.958828] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-14T19:41:07.734943] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T19:41:07.758805] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-14T19:41:08.559253] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-14T19:41:08.570961] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T19:41:09.358870] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-14T19:41:09.748473] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T19:41:10.158839] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-14T19:41:10.236402] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T19:41:10.657158] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T19:41:10.958881] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-14T19:41:11.758887] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-14T19:41:11.962516] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T19:41:12.558878] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-14T19:41:12.688771] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:41:13.096504] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T19:41:13.358863] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-14T19:41:14.158891] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-14T19:41:14.242356] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T19:41:14.248308] [INFO ] [REMOTE ] PRMB: Full fetch complete (57607 records). [2025-09-14T19:41:14.248493] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-14T19:41:14.649587] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-14T19:41:14.649726] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-14T19:41:14.650867] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-14T19:41:14.650956] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-14T19:41:14.652267] [DEBUG] [LOCAL ] PRMB: Trimmed 57607 records to 40051 (keeping 150 days of data) [2025-09-14T19:41:14.797683] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T19:41:14.804278] [INFO ] [REMOTE ] PRM: Full fetch complete (48728 records). [2025-09-14T19:41:14.804896] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-14T19:41:14.985230] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-14T19:41:15.305134] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-14T19:41:15.305255] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-14T19:41:15.306392] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-14T19:41:15.306827] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-14T19:41:15.308884] [DEBUG] [LOCAL ] PRM: Trimmed 48728 records to 33203 (keeping 150 days of data) [2025-09-14T19:41:15.517475] [DEBUG] [LOCAL ] PRMB: Primary data saved (40051 records). [2025-09-14T19:41:15.519409] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-14T19:41:15.520047] [INFO ] [MAIN ] Update Progress: 1732/2370 symbols completed. PRMB took 24.7s. Estimated remaining: 1h 7m 48s. Rate: 9.4 symbols/min [2025-09-14T19:41:15.704337] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:15.705354] [DEBUG] [LOCAL ] PRM: Primary data saved (33203 records). [2025-09-14T19:41:15.705983] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-14T19:41:15.706102] [INFO ] [MAIN ] Update Progress: 1733/2370 symbols completed. PRM took 26.9s. Estimated remaining: 1h 7m 39s. Rate: 9.4 symbols/min [2025-09-14T19:41:15.776555] [DEBUG] [LOCAL ] PRT: Loaded 2383 existing records from primary storage. [2025-09-14T19:41:15.806961] [INFO ] [MAIN ] PRT: Loaded 2383 existing records. [2025-09-14T19:41:15.999083] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:16.087681] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:16.088480] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-14T19:41:16.088675] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-14T19:41:16.089283] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-14T19:41:16.089388] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-14T19:41:16.197966] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T19:41:16.288197] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-14T19:41:16.354691] [DEBUG] [LOCAL ] PRU: Loaded 22879 existing records from primary storage. [2025-09-14T19:41:16.387617] [INFO ] [MAIN ] PRU: Loaded 22879 existing records. [2025-09-14T19:41:16.746311] [INFO ] [REMOTE ] PRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:16.767564] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-14T19:41:16.771725] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:16.773635] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-14T19:41:16.773940] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-14T19:41:16.781401] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-14T19:41:16.790422] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-14T19:41:16.797113] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T19:41:17.160162] [INFO ] [REMOTE ] PRU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:17.358845] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-14T19:41:17.646811] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T19:41:17.650915] [INFO ] [REMOTE ] PRO: Full fetch complete (39641 records). [2025-09-14T19:41:17.651015] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-14T19:41:17.785142] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:41:18.035520] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-14T19:41:18.035658] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-14T19:41:18.036724] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-14T19:41:18.036793] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-14T19:41:18.037822] [DEBUG] [LOCAL ] PRO: Trimmed 39641 records to 28932 (keeping 150 days of data) [2025-09-14T19:41:18.159027] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-14T19:41:18.230600] [DEBUG] [LOCAL ] PRO: Primary data saved (28932 records). [2025-09-14T19:41:18.230790] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-14T19:41:18.230900] [INFO ] [MAIN ] Update Progress: 1734/2370 symbols completed. PRO took 24.6s. Estimated remaining: 1h 7m 32s. Rate: 9.4 symbols/min [2025-09-14T19:41:18.406307] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:18.408775] [DEBUG] [LOCAL ] PRVS: Loaded 245 existing records from primary storage. [2025-09-14T19:41:18.408874] [INFO ] [MAIN ] PRVS: Loaded 245 existing records. [2025-09-14T19:41:18.586769] [WARN ] [MAIN ] PRVS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:18.587179] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-14T19:41:18.587343] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-14T19:41:18.587707] [DEBUG] [LOCAL ] PRVS: Deleted primary data file. [2025-09-14T19:41:18.587791] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-14T19:41:18.705916] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T19:41:18.975595] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-14T19:41:18.984262] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:18.985347] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T19:41:19.758845] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-14T19:41:20.391162] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T19:41:20.422454] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T19:41:20.558816] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-14T19:41:21.083894] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T19:41:21.358865] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-14T19:41:21.809542] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-14T19:41:22.158861] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-14T19:41:22.958847] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-14T19:41:23.440407] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T19:41:23.758885] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-14T19:41:24.428411] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T19:41:24.558855] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-14T19:41:24.791920] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T19:41:25.223759] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T19:41:25.358888] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-14T19:41:25.926760] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:41:25.929735] [INFO ] [REMOTE ] PRSU: Full fetch complete (26878 records). [2025-09-14T19:41:25.929841] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-14T19:41:26.164049] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-14T19:41:26.323873] [DEBUG] [VALIDATOR ] PRSU: All expected trading days are present. [2025-09-14T19:41:26.324022] [DEBUG] [VALIDATOR ] PRSU: Primary data validation passed. [2025-09-14T19:41:26.325048] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-09-14T19:41:26.325125] [DEBUG] [LOCAL ] PRSU: Saving primary data. [2025-09-14T19:41:26.326445] [DEBUG] [LOCAL ] PRSU: Trimmed 26878 records to 17935 (keeping 150 days of data) [2025-09-14T19:41:26.444391] [DEBUG] [LOCAL ] PRSU: Primary data saved (17935 records). [2025-09-14T19:41:26.444677] [INFO ] [MAIN ] PRSU: Full history saved. [2025-09-14T19:41:26.444843] [INFO ] [MAIN ] Update Progress: 1735/2370 symbols completed. PRSU took 27.6s. Estimated remaining: 1h 7m 26s. Rate: 9.4 symbols/min [2025-09-14T19:41:26.626324] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:26.643526] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-14T19:41:26.653768] [DEBUG] [LOCAL ] PSA: Loaded 18752 existing records from primary storage. [2025-09-14T19:41:26.653990] [INFO ] [MAIN ] PSA: Loaded 18752 existing records. [2025-09-14T19:41:26.845812] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:26.846159] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-14T19:41:26.846232] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-14T19:41:26.846940] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-14T19:41:26.847022] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-14T19:41:26.964021] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-14T19:41:27.252967] [INFO ] [REMOTE ] PSA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:27.758895] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-14T19:41:28.180972] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-14T19:41:28.558874] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-14T19:41:28.927888] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T19:41:29.045184] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-14T19:41:29.358900] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-14T19:41:30.158892] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-14T19:41:30.859856] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T19:41:30.958936] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-14T19:41:31.230400] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T19:41:31.327133] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-14T19:41:31.758911] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-14T19:41:32.558883] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-14T19:41:33.358872] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-14T19:41:33.547270] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T19:41:33.939072] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T19:41:33.940545] [INFO ] [REMOTE ] PRT: Full fetch complete (6039 records). [2025-09-14T19:41:33.940659] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-14T19:41:34.163925] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-14T19:41:34.323014] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-14T19:41:34.323264] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-14T19:41:34.323584] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-14T19:41:34.323667] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-14T19:41:34.324363] [DEBUG] [LOCAL ] PRT: Trimmed 6039 records to 3655 (keeping 150 days of data) [2025-09-14T19:41:34.377148] [DEBUG] [LOCAL ] PRT: Primary data saved (3655 records). [2025-09-14T19:41:34.380338] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-14T19:41:34.380713] [INFO ] [MAIN ] Update Progress: 1736/2370 symbols completed. PRT took 18.9s. Estimated remaining: 1h 7m 20s. Rate: 9.4 symbols/min [2025-09-14T19:41:34.383115] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T19:41:34.574278] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:34.580262] [DEBUG] [LOCAL ] PSBD: Loaded 3334 existing records from primary storage. [2025-09-14T19:41:34.580396] [INFO ] [MAIN ] PSBD: Loaded 3334 existing records. [2025-09-14T19:41:34.782364] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:34.782674] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-14T19:41:34.782742] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-14T19:41:34.783006] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-14T19:41:34.783066] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-14T19:41:34.964149] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-14T19:41:35.145753] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:35.758872] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-14T19:41:36.011493] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T19:41:36.132852] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T19:41:36.558868] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-14T19:41:36.914679] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-14T19:41:36.923068] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T19:41:37.358899] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-14T19:41:38.158844] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-14T19:41:38.800396] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-14T19:41:38.958841] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-14T19:41:38.994788] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T19:41:39.269714] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T19:41:39.270700] [INFO ] [REMOTE ] PRVS: Full fetch complete (876 records). [2025-09-14T19:41:39.270792] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-14T19:41:39.505338] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T19:41:39.505578] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:41:39.505634] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:41:39.505705] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-14T19:41:39.505778] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-14T19:41:39.505826] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-14T19:41:39.505887] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-14T19:41:39.505967] [INFO ] [MAIN ] Update Progress: 1737/2370 symbols completed. PRVS took 21.3s. Estimated remaining: 1h 7m 13s. Rate: 9.4 symbols/min [2025-09-14T19:41:39.675213] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:39.679962] [DEBUG] [LOCAL ] PSF: Loaded 2912 existing records from primary storage. [2025-09-14T19:41:39.680072] [INFO ] [MAIN ] PSF: Loaded 2912 existing records. [2025-09-14T19:41:39.764101] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-14T19:41:39.867704] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:39.867982] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-14T19:41:39.868046] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-14T19:41:39.868357] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-14T19:41:39.868424] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-14T19:41:40.222731] [INFO ] [REMOTE ] PSF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:40.558841] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-14T19:41:41.358953] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-14T19:41:41.417632] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T19:41:41.482385] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T19:41:42.158899] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-14T19:41:42.958903] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-14T19:41:43.263266] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T19:41:43.734570] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T19:41:43.758910] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-14T19:41:43.859121] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T19:41:44.558856] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-14T19:41:44.622392] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:41:45.244956] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T19:41:45.358856] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-14T19:41:46.158901] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-14T19:41:46.958831] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-14T19:41:47.374359] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T19:41:47.741418] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T19:41:47.763942] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-14T19:41:47.778203] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:41:48.321308] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T19:41:48.558874] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-14T19:41:49.206072] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T19:41:49.358879] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-14T19:41:50.158846] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-14T19:41:50.813536] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:41:50.818208] [INFO ] [REMOTE ] PSA: Full fetch complete (45163 records). [2025-09-14T19:41:50.818353] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-14T19:41:50.959739] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-14T19:41:51.210474] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-14T19:41:51.210777] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-14T19:41:51.211928] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-14T19:41:51.212104] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-14T19:41:51.223631] [DEBUG] [LOCAL ] PSA: Trimmed 45163 records to 31590 (keeping 150 days of data) [2025-09-14T19:41:51.244391] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T19:41:51.455207] [DEBUG] [LOCAL ] PSA: Primary data saved (31590 records). [2025-09-14T19:41:51.455377] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-14T19:41:51.455523] [INFO ] [MAIN ] Update Progress: 1738/2370 symbols completed. PSA took 25.0s. Estimated remaining: 1h 7m 9s. Rate: 9.4 symbols/min [2025-09-14T19:41:51.624686] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:51.639533] [DEBUG] [LOCAL ] PSFE: Loaded 13661 existing records from primary storage. [2025-09-14T19:41:51.639702] [INFO ] [MAIN ] PSFE: Loaded 13661 existing records. [2025-09-14T19:41:51.764026] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-14T19:41:51.824091] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:51.824433] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-14T19:41:51.828717] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-14T19:41:51.829366] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T19:41:51.830887] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-14T19:41:51.831571] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-14T19:41:52.200110] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:52.558898] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-14T19:41:52.567353] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T19:41:53.352311] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T19:41:53.358768] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-14T19:41:54.079009] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:41:54.080591] [INFO ] [REMOTE ] PSF: Full fetch complete (7170 records). [2025-09-14T19:41:54.081168] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-14T19:41:54.163990] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-14T19:41:54.455886] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-14T19:41:54.456005] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-14T19:41:54.456264] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-14T19:41:54.456319] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-14T19:41:54.456777] [DEBUG] [LOCAL ] PSF: Trimmed 7170 records to 5000 (keeping 150 days of data) [2025-09-14T19:41:54.493262] [DEBUG] [LOCAL ] PSF: Primary data saved (5000 records). [2025-09-14T19:41:54.493435] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-14T19:41:54.493559] [INFO ] [MAIN ] Update Progress: 1739/2370 symbols completed. PSF took 15.0s. Estimated remaining: 1h 7m 1s. Rate: 9.4 symbols/min [2025-09-14T19:41:54.667800] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:54.697070] [DEBUG] [LOCAL ] PSN: Loaded 19660 existing records from primary storage. [2025-09-14T19:41:54.697320] [INFO ] [MAIN ] PSN: Loaded 19660 existing records. [2025-09-14T19:41:54.872408] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:54.872707] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-14T19:41:54.872768] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-14T19:41:54.873456] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-14T19:41:54.873519] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-14T19:41:54.959186] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-14T19:41:55.230659] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T19:41:55.264479] [INFO ] [REMOTE ] PSN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:55.265734] [INFO ] [REMOTE ] PRU: Full fetch complete (56092 records). [2025-09-14T19:41:55.265964] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-14T19:41:55.657384] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-14T19:41:55.657512] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-14T19:41:55.658601] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-14T19:41:55.658684] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-14T19:41:55.660021] [DEBUG] [LOCAL ] PRU: Trimmed 56092 records to 38574 (keeping 150 days of data) [2025-09-14T19:41:55.762612] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-14T19:41:55.778770] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T19:41:55.946151] [DEBUG] [LOCAL ] PRU: Primary data saved (38574 records). [2025-09-14T19:41:55.946333] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-14T19:41:55.946463] [INFO ] [MAIN ] Update Progress: 1740/2370 symbols completed. PRU took 40.2s. Estimated remaining: 1h 6m 53s. Rate: 9.4 symbols/min [2025-09-14T19:41:56.115675] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:41:56.133280] [DEBUG] [LOCAL ] PSO: Loaded 16194 existing records from primary storage. [2025-09-14T19:41:56.133437] [INFO ] [MAIN ] PSO: Loaded 16194 existing records. [2025-09-14T19:41:56.308060] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:41:56.308317] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-14T19:41:56.308378] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-14T19:41:56.308942] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-14T19:41:56.309008] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-14T19:41:56.568880] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-14T19:41:56.674702] [INFO ] [REMOTE ] PSO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:41:57.180439] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T19:41:57.358831] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-14T19:41:57.634139] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T19:41:58.158833] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-14T19:41:58.824190] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T19:41:58.958833] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-14T19:41:59.637585] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T19:41:59.758849] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-14T19:42:00.558836] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-14T19:42:00.655256] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:42:01.358839] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-14T19:42:01.525357] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T19:42:01.752759] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T19:42:02.158822] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-14T19:42:02.958832] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-14T19:42:03.335470] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T19:42:03.758809] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-14T19:42:04.296313] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T19:42:04.297717] [INFO ] [REMOTE ] PSBD: Full fetch complete (7072 records). [2025-09-14T19:42:04.297817] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-14T19:42:04.564945] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-14T19:42:04.675951] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-14T19:42:04.676058] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-14T19:42:04.676291] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-14T19:42:04.676342] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-14T19:42:04.676781] [DEBUG] [LOCAL ] PSBD: Trimmed 7072 records to 5174 (keeping 150 days of data) [2025-09-14T19:42:04.711487] [DEBUG] [LOCAL ] PSBD: Primary data saved (5174 records). [2025-09-14T19:42:04.711623] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-14T19:42:04.711761] [INFO ] [MAIN ] Update Progress: 1741/2370 symbols completed. PSBD took 30.3s. Estimated remaining: 1h 6m 48s. Rate: 9.4 symbols/min [2025-09-14T19:42:04.882105] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:04.905134] [DEBUG] [LOCAL ] PSQH: Loaded 14679 existing records from primary storage. [2025-09-14T19:42:04.905292] [INFO ] [MAIN ] PSQH: Loaded 14679 existing records. [2025-09-14T19:42:05.081783] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:05.082046] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-14T19:42:05.082105] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-14T19:42:05.082762] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-14T19:42:05.082827] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-14T19:42:05.437828] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:05.438420] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-14T19:42:05.471283] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-09-14T19:42:06.010971] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-14T19:42:06.158842] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-14T19:42:06.424396] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T19:42:06.958856] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-14T19:42:07.183246] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T19:42:07.553288] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T19:42:07.758838] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-14T19:42:08.558839] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-14T19:42:08.826878] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T19:42:09.318199] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T19:42:09.358835] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-14T19:42:10.158888] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T19:42:10.158983] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-14T19:42:10.685844] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T19:42:10.958880] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-14T19:42:11.723528] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T19:42:11.758858] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-14T19:42:12.558854] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-14T19:42:12.638376] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T19:42:13.363933] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-14T19:42:13.375005] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T19:42:14.158857] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-14T19:42:14.302149] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T19:42:14.684438] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T19:42:14.958874] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-14T19:42:15.594958] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T19:42:15.758866] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-14T19:42:16.183453] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T19:42:16.187814] [INFO ] [REMOTE ] PSO: Full fetch complete (40301 records). [2025-09-14T19:42:16.187963] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-14T19:42:16.565102] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-14T19:42:16.589600] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-14T19:42:16.589763] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-14T19:42:16.591551] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-14T19:42:16.591773] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-14T19:42:16.593081] [DEBUG] [LOCAL ] PSO: Trimmed 40301 records to 27438 (keeping 150 days of data) [2025-09-14T19:42:16.776152] [DEBUG] [LOCAL ] PSO: Primary data saved (27438 records). [2025-09-14T19:42:16.776353] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-14T19:42:16.776468] [INFO ] [MAIN ] Update Progress: 1742/2370 symbols completed. PSO took 20.8s. Estimated remaining: 1h 6m 43s. Rate: 9.4 symbols/min [2025-09-14T19:42:16.950223] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:16.974091] [DEBUG] [LOCAL ] PSTG: Loaded 23577 existing records from primary storage. [2025-09-14T19:42:16.974278] [INFO ] [MAIN ] PSTG: Loaded 23577 existing records. [2025-09-14T19:42:17.152493] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:17.152816] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-14T19:42:17.152877] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-14T19:42:17.153533] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-14T19:42:17.153596] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-14T19:42:17.360247] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-14T19:42:17.510005] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:17.531684] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T19:42:18.158892] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-14T19:42:18.958958] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-14T19:42:19.422413] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T19:42:19.496362] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-09-14T19:42:19.722909] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T19:42:19.758856] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-14T19:42:20.560375] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-14T19:42:20.564407] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T19:42:21.359009] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-14T19:42:21.465656] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T19:42:21.575290] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T19:42:22.158878] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-14T19:42:22.958907] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-14T19:42:23.212354] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T19:42:23.216851] [INFO ] [REMOTE ] PSFE: Full fetch complete (34037 records). [2025-09-14T19:42:23.217015] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-14T19:42:23.667105] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-14T19:42:23.667485] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-14T19:42:23.669488] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-14T19:42:23.672470] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-14T19:42:23.672656] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-14T19:42:23.684819] [DEBUG] [LOCAL ] PSFE: Trimmed 34037 records to 22960 (keeping 150 days of data) [2025-09-14T19:42:23.775834] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-14T19:42:23.839482] [DEBUG] [LOCAL ] PSFE: Primary data saved (22960 records). [2025-09-14T19:42:23.839740] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-14T19:42:23.839882] [INFO ] [MAIN ] Update Progress: 1743/2370 symbols completed. PSFE took 32.4s. Estimated remaining: 1h 6m 37s. Rate: 9.4 symbols/min [2025-09-14T19:42:24.016442] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:24.027792] [DEBUG] [LOCAL ] PSTL: Loaded 8409 existing records from primary storage. [2025-09-14T19:42:24.028094] [INFO ] [MAIN ] PSTL: Loaded 8409 existing records. [2025-09-14T19:42:24.216944] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:24.217291] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-14T19:42:24.217432] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-14T19:42:24.218140] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-14T19:42:24.238120] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-14T19:42:24.245157] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T19:42:24.571288] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-14T19:42:24.612288] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:25.358909] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-14T19:42:25.734161] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T19:42:26.087422] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T19:42:26.092746] [INFO ] [REMOTE ] PSQH: Full fetch complete (37910 records). [2025-09-14T19:42:26.092941] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-14T19:42:26.164047] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-14T19:42:26.509210] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-14T19:42:26.509334] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-14T19:42:26.510335] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-14T19:42:26.510405] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-14T19:42:26.511343] [DEBUG] [LOCAL ] PSQH: Trimmed 37910 records to 25231 (keeping 150 days of data) [2025-09-14T19:42:26.685923] [DEBUG] [LOCAL ] PSQH: Primary data saved (25231 records). [2025-09-14T19:42:26.687892] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-14T19:42:26.688919] [INFO ] [MAIN ] Update Progress: 1744/2370 symbols completed. PSQH took 22.0s. Estimated remaining: 1h 6m 30s. Rate: 9.4 symbols/min [2025-09-14T19:42:26.688554] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T19:42:26.766496] [INFO ] [REMOTE ] PSN: Full fetch complete (50831 records). [2025-09-14T19:42:26.806786] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-14T19:42:26.808463] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T19:42:26.962861] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-14T19:42:27.035086] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:27.258937] [DEBUG] [LOCAL ] PSX: Loaded 23797 existing records from primary storage. [2025-09-14T19:42:27.280287] [INFO ] [MAIN ] PSX: Loaded 23797 existing records. [2025-09-14T19:42:27.463382] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-14T19:42:27.469221] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-14T19:42:27.475707] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-14T19:42:27.491097] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-14T19:42:27.550512] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:27.550976] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-14T19:42:27.551059] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-14T19:42:27.551148] [DEBUG] [LOCAL ] PSN: Trimmed 50831 records to 34321 (keeping 150 days of data) [2025-09-14T19:42:27.552107] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-14T19:42:27.552199] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-14T19:42:27.771499] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-14T19:42:28.049075] [INFO ] [REMOTE ] PSX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:28.174435] [DEBUG] [LOCAL ] PSN: Primary data saved (34321 records). [2025-09-14T19:42:28.174724] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-14T19:42:28.174854] [INFO ] [MAIN ] Update Progress: 1745/2370 symbols completed. PSN took 33.7s. Estimated remaining: 1h 6m 22s. Rate: 9.4 symbols/min [2025-09-14T19:42:28.360059] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:28.369978] [DEBUG] [LOCAL ] PTA: Loaded 6755 existing records from primary storage. [2025-09-14T19:42:28.370193] [INFO ] [MAIN ] PTA: Loaded 6755 existing records. [2025-09-14T19:42:28.561057] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:28.561133] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-14T19:42:28.561824] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-14T19:42:28.563086] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-14T19:42:28.563743] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-14T19:42:28.563830] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-14T19:42:28.942234] [INFO ] [REMOTE ] PTA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:28.983908] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T19:42:29.059469] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-14T19:42:29.358830] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-14T19:42:30.158820] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-14T19:42:30.407497] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T19:42:30.488431] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T19:42:30.958855] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-14T19:42:31.444042] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T19:42:31.758861] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-14T19:42:32.558865] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-14T19:42:32.867507] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T19:42:33.243178] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T19:42:33.358883] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-14T19:42:33.769689] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T19:42:34.158933] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-14T19:42:34.958868] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-14T19:42:35.159750] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T19:42:35.416305] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T19:42:35.758914] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-14T19:42:36.055819] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T19:42:36.558948] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-14T19:42:36.886101] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T19:42:37.358902] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-14T19:42:37.634578] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T19:42:38.158833] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-14T19:42:38.342988] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T19:42:38.958867] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-14T19:42:39.279924] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T19:42:39.758870] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-14T19:42:39.821801] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T19:42:40.558899] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-14T19:42:41.358889] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-14T19:42:41.496484] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T19:42:41.498939] [INFO ] [REMOTE ] PSTL: Full fetch complete (22570 records). [2025-09-14T19:42:41.499141] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-14T19:42:41.885709] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-14T19:42:41.885976] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-14T19:42:41.886601] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-14T19:42:41.886706] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-14T19:42:41.887762] [DEBUG] [LOCAL ] PSTL: Trimmed 22570 records to 15028 (keeping 150 days of data) [2025-09-14T19:42:42.000679] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-14T19:42:42.025742] [DEBUG] [LOCAL ] PSTL: Primary data saved (15028 records). [2025-09-14T19:42:42.025884] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-14T19:42:42.025989] [INFO ] [MAIN ] Update Progress: 1746/2370 symbols completed. PSTL took 18.2s. Estimated remaining: 1h 6m 18s. Rate: 9.4 symbols/min [2025-09-14T19:42:42.171523] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-14T19:42:42.236099] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:42.253693] [DEBUG] [LOCAL ] PTY: Loaded 16367 existing records from primary storage. [2025-09-14T19:42:42.253850] [INFO ] [MAIN ] PTY: Loaded 16367 existing records. [2025-09-14T19:42:42.463667] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:42.464039] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-14T19:42:42.464118] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-14T19:42:42.464801] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-14T19:42:42.464892] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-14T19:42:42.831970] [INFO ] [REMOTE ] PTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:42.958847] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-14T19:42:43.296914] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T19:42:43.629681] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T19:42:43.758850] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-14T19:42:44.177829] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T19:42:44.558838] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-14T19:42:44.758210] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T19:42:45.358845] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-14T19:42:46.158900] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-14T19:42:46.240138] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T19:42:46.242494] [INFO ] [REMOTE ] PTA: Full fetch complete (16088 records). [2025-09-14T19:42:46.242591] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-14T19:42:46.633120] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-14T19:42:46.633989] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-14T19:42:46.634714] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-14T19:42:46.635168] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-14T19:42:46.642206] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-14T19:42:46.643342] [DEBUG] [LOCAL ] PTA: Trimmed 16088 records to 10651 (keeping 150 days of data) [2025-09-14T19:42:46.709430] [DEBUG] [LOCAL ] PTA: Primary data saved (10651 records). [2025-09-14T19:42:46.709594] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-14T19:42:46.709735] [INFO ] [MAIN ] Update Progress: 1747/2370 symbols completed. PTA took 18.5s. Estimated remaining: 1h 6m 11s. Rate: 9.4 symbols/min [2025-09-14T19:42:46.878778] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:46.898238] [DEBUG] [LOCAL ] PUK: Loaded 19506 existing records from primary storage. [2025-09-14T19:42:46.898459] [INFO ] [MAIN ] PUK: Loaded 19506 existing records. [2025-09-14T19:42:46.963910] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-14T19:42:47.077221] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:47.077517] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-14T19:42:47.077600] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-14T19:42:47.078492] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-14T19:42:47.078564] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-14T19:42:47.434577] [INFO ] [REMOTE ] PUK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:47.758807] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-14T19:42:47.845233] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T19:42:48.558845] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-14T19:42:48.984123] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T19:42:49.049348] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T19:42:49.358862] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-14T19:42:50.012058] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:42:50.017685] [INFO ] [REMOTE ] PSTG: Full fetch complete (57448 records). [2025-09-14T19:42:50.017891] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-14T19:42:50.171057] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-14T19:42:50.421277] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-14T19:42:50.421517] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-14T19:42:50.423071] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-14T19:42:50.423162] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-14T19:42:50.424953] [DEBUG] [LOCAL ] PSTG: Trimmed 57448 records to 39671 (keeping 150 days of data) [2025-09-14T19:42:50.543578] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T19:42:50.718265] [DEBUG] [LOCAL ] PSTG: Primary data saved (39671 records). [2025-09-14T19:42:50.718487] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-14T19:42:50.718701] [INFO ] [MAIN ] Update Progress: 1748/2370 symbols completed. PSTG took 33.9s. Estimated remaining: 1h 6m 4s. Rate: 9.4 symbols/min [2025-09-14T19:42:50.899494] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:50.921373] [DEBUG] [LOCAL ] PUMP: Loaded 22248 existing records from primary storage. [2025-09-14T19:42:50.921566] [INFO ] [MAIN ] PUMP: Loaded 22248 existing records. [2025-09-14T19:42:50.966614] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-14T19:42:51.115041] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:51.115335] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-14T19:42:51.115422] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-14T19:42:51.116192] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-14T19:42:51.116271] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-14T19:42:51.485394] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:51.751096] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T19:42:51.756837] [INFO ] [REMOTE ] PSX: Full fetch complete (57819 records). [2025-09-14T19:42:51.757005] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-14T19:42:51.769061] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-14T19:42:52.242596] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-14T19:42:52.245552] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T19:42:52.245781] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-14T19:42:52.257686] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-14T19:42:52.258705] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-14T19:42:52.261155] [DEBUG] [LOCAL ] PSX: Trimmed 57819 records to 40017 (keeping 150 days of data) [2025-09-14T19:42:52.536958] [DEBUG] [LOCAL ] PSX: Primary data saved (40017 records). [2025-09-14T19:42:52.537118] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-14T19:42:52.537236] [INFO ] [MAIN ] Update Progress: 1749/2370 symbols completed. PSX took 25.8s. Estimated remaining: 1h 5m 56s. Rate: 9.4 symbols/min [2025-09-14T19:42:52.567880] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-14T19:42:52.710000] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:42:52.730883] [DEBUG] [LOCAL ] PVH: Loaded 22491 existing records from primary storage. [2025-09-14T19:42:52.731069] [INFO ] [MAIN ] PVH: Loaded 22491 existing records. [2025-09-14T19:42:52.914891] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:42:52.915270] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-14T19:42:52.915341] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-14T19:42:52.916072] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-14T19:42:52.916144] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-14T19:42:53.280773] [INFO ] [REMOTE ] PVH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:42:53.358868] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-14T19:42:53.448687] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T19:42:54.158802] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-14T19:42:54.200454] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T19:42:54.958879] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-14T19:42:55.246456] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T19:42:55.758845] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-14T19:42:55.844792] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T19:42:56.566738] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-14T19:42:56.587718] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T19:42:57.162767] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T19:42:57.358845] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-14T19:42:58.158797] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-14T19:42:58.183228] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T19:42:58.958863] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-14T19:42:59.204893] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T19:42:59.758846] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-14T19:43:00.035501] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T19:43:00.410459] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T19:43:00.558831] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-14T19:43:01.358865] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-14T19:43:01.890274] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T19:43:02.158905] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-14T19:43:02.257997] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T19:43:02.958940] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-14T19:43:03.151503] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:43:03.758872] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-14T19:43:04.024949] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T19:43:04.166112] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T19:43:04.558875] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-14T19:43:05.205266] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T19:43:05.358948] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-14T19:43:05.829771] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T19:43:05.834242] [INFO ] [REMOTE ] PTY: Full fetch complete (40415 records). [2025-09-14T19:43:05.834377] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-14T19:43:06.167687] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-14T19:43:06.217664] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-14T19:43:06.217779] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-14T19:43:06.218922] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-14T19:43:06.218994] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-14T19:43:06.220101] [DEBUG] [LOCAL ] PTY: Trimmed 40415 records to 27619 (keeping 150 days of data) [2025-09-14T19:43:06.436452] [DEBUG] [LOCAL ] PTY: Primary data saved (27619 records). [2025-09-14T19:43:06.436664] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-14T19:43:06.436810] [INFO ] [MAIN ] Update Progress: 1750/2370 symbols completed. PTY took 24.4s. Estimated remaining: 1h 5m 52s. Rate: 9.4 symbols/min [2025-09-14T19:43:06.613205] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:43:06.617502] [DEBUG] [LOCAL ] PVL: Loaded 2007 existing records from primary storage. [2025-09-14T19:43:06.617705] [INFO ] [MAIN ] PVL: Loaded 2007 existing records. [2025-09-14T19:43:06.801838] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:43:06.802253] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-14T19:43:06.802428] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-14T19:43:06.802728] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-14T19:43:06.802790] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-14T19:43:06.982811] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-14T19:43:07.061415] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T19:43:07.230280] [INFO ] [REMOTE ] PVL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:43:07.758872] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-14T19:43:07.825366] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T19:43:08.558813] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-14T19:43:08.601233] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T19:43:09.011562] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T19:43:09.358879] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-14T19:43:10.151052] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T19:43:10.161227] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-14T19:43:10.791145] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T19:43:10.958883] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-14T19:43:11.139448] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T19:43:11.758866] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-14T19:43:12.424137] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T19:43:12.558896] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-14T19:43:12.718530] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T19:43:13.230536] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:43:13.358865] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-14T19:43:14.158855] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-14T19:43:14.874939] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T19:43:14.958879] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-14T19:43:15.043847] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T19:43:15.758913] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-14T19:43:16.530972] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:43:16.536847] [INFO ] [REMOTE ] PUMP: Full fetch complete (53710 records). [2025-09-14T19:43:16.537042] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-14T19:43:16.564037] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-14T19:43:16.946037] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-14T19:43:16.946194] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-14T19:43:16.948079] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-14T19:43:16.948219] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-14T19:43:16.949939] [DEBUG] [LOCAL ] PUMP: Trimmed 53710 records to 37018 (keeping 150 days of data) [2025-09-14T19:43:17.074149] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-14T19:43:17.239263] [DEBUG] [LOCAL ] PUMP: Primary data saved (37018 records). [2025-09-14T19:43:17.239516] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-14T19:43:17.239678] [INFO ] [MAIN ] Update Progress: 1751/2370 symbols completed. PUMP took 26.5s. Estimated remaining: 1h 5m 47s. Rate: 9.4 symbols/min [2025-09-14T19:43:17.362815] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-14T19:43:17.356757] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T19:43:17.445574] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:43:17.468761] [DEBUG] [LOCAL ] PWR: Loaded 20572 existing records from primary storage. [2025-09-14T19:43:17.469004] [INFO ] [MAIN ] PWR: Loaded 20572 existing records. [2025-09-14T19:43:17.654725] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:43:17.655057] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-14T19:43:17.655136] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-14T19:43:17.655812] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-14T19:43:17.655888] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-14T19:43:18.018161] [INFO ] [REMOTE ] PWR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:43:18.158844] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-14T19:43:18.807056] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:43:18.812406] [INFO ] [REMOTE ] PVH: Full fetch complete (54272 records). [2025-09-14T19:43:18.812548] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-14T19:43:18.966931] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-14T19:43:19.203029] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-14T19:43:19.203275] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-14T19:43:19.205173] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-14T19:43:19.205363] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-14T19:43:19.232117] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T19:43:19.241173] [DEBUG] [LOCAL ] PVH: Trimmed 54272 records to 38089 (keeping 150 days of data) [2025-09-14T19:43:19.519904] [DEBUG] [LOCAL ] PVH: Primary data saved (38089 records). [2025-09-14T19:43:19.520217] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-14T19:43:19.520370] [INFO ] [MAIN ] Update Progress: 1752/2370 symbols completed. PVH took 27.0s. Estimated remaining: 1h 5m 39s. Rate: 9.4 symbols/min [2025-09-14T19:43:19.643481] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T19:43:19.710088] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:43:19.729278] [DEBUG] [LOCAL ] PX: Loaded 15316 existing records from primary storage. [2025-09-14T19:43:19.729507] [INFO ] [MAIN ] PX: Loaded 15316 existing records. [2025-09-14T19:43:19.763958] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-14T19:43:19.911741] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:43:19.912040] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-14T19:43:19.912105] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-14T19:43:19.912830] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-14T19:43:19.912903] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-14T19:43:20.263156] [INFO ] [REMOTE ] PX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:43:20.558842] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-14T19:43:21.186980] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T19:43:21.191847] [INFO ] [REMOTE ] PUK: Full fetch complete (48812 records). [2025-09-14T19:43:21.192012] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-14T19:43:21.372939] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-14T19:43:21.582565] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-14T19:43:21.582708] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-14T19:43:21.583884] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-14T19:43:21.583965] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-14T19:43:21.585196] [DEBUG] [LOCAL ] PUK: Trimmed 48812 records to 32908 (keeping 150 days of data) [2025-09-14T19:43:21.808382] [DEBUG] [LOCAL ] PUK: Primary data saved (32908 records). [2025-09-14T19:43:21.808626] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-14T19:43:21.808813] [INFO ] [MAIN ] Update Progress: 1753/2370 symbols completed. PUK took 35.1s. Estimated remaining: 1h 5m 32s. Rate: 9.4 symbols/min [2025-09-14T19:43:21.984200] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:43:22.009393] [DEBUG] [LOCAL ] QBTS: Loaded 24180 existing records from primary storage. [2025-09-14T19:43:22.009669] [INFO ] [MAIN ] QBTS: Loaded 24180 existing records. [2025-09-14T19:43:22.162205] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-14T19:43:22.192106] [WARN ] [MAIN ] QBTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:43:22.193932] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-14T19:43:22.194010] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-14T19:43:22.195111] [DEBUG] [LOCAL ] QBTS: Deleted primary data file. [2025-09-14T19:43:22.195215] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-14T19:43:22.441193] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T19:43:22.598340] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:43:22.906131] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:43:22.907283] [INFO ] [REMOTE ] PVL: Full fetch complete (5115 records). [2025-09-14T19:43:22.907394] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-14T19:43:22.969779] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-14T19:43:23.276109] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-14T19:43:23.276358] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-14T19:43:23.276598] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-14T19:43:23.289321] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-14T19:43:23.302113] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T19:43:23.302400] [DEBUG] [LOCAL ] PVL: Trimmed 5115 records to 3548 (keeping 150 days of data) [2025-09-14T19:43:23.332452] [DEBUG] [LOCAL ] PVL: Primary data saved (3548 records). [2025-09-14T19:43:23.332608] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-14T19:43:23.332743] [INFO ] [MAIN ] Update Progress: 1754/2370 symbols completed. PVL took 16.9s. Estimated remaining: 1h 5m 23s. Rate: 9.4 symbols/min [2025-09-14T19:43:23.511393] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:43:23.527065] [DEBUG] [LOCAL ] QD: Loaded 12980 existing records from primary storage. [2025-09-14T19:43:23.527312] [INFO ] [MAIN ] QD: Loaded 12980 existing records. [2025-09-14T19:43:23.708517] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:43:23.708894] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-14T19:43:23.708959] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-14T19:43:23.709364] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-14T19:43:23.709426] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-14T19:43:23.765377] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-14T19:43:24.187696] [INFO ] [REMOTE ] QD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:43:24.558818] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-14T19:43:24.884107] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T19:43:25.358874] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-14T19:43:25.881687] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T19:43:26.158913] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-14T19:43:26.266389] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-14T19:43:26.958892] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-14T19:43:27.144629] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T19:43:27.599352] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T19:43:27.758933] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-14T19:43:28.153491] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T19:43:28.558910] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-14T19:43:29.358852] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-14T19:43:29.942693] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T19:43:30.158867] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-14T19:43:30.564239] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-09-14T19:43:30.675318] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T19:43:30.958845] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-14T19:43:31.603700] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T19:43:31.758903] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-14T19:43:32.313054] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T19:43:32.558844] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-14T19:43:33.358886] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-14T19:43:33.904709] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T19:43:34.158890] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-14T19:43:34.501091] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-14T19:43:34.623415] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T19:43:34.958962] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-14T19:43:35.758811] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-14T19:43:35.879631] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T19:43:36.043840] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T19:43:36.558909] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-14T19:43:37.358833] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-14T19:43:38.158816] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-14T19:43:38.236924] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-14T19:43:38.277900] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T19:43:38.594925] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T19:43:38.958834] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-14T19:43:39.433727] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T19:43:39.758842] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-14T19:43:40.558840] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-14T19:43:40.662629] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T19:43:41.149479] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T19:43:41.358832] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-14T19:43:42.158844] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-14T19:43:42.418734] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-14T19:43:42.424297] [INFO ] [REMOTE ] PX: Full fetch complete (38487 records). [2025-09-14T19:43:42.424496] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-14T19:43:42.820752] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-14T19:43:42.821022] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-14T19:43:42.822536] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-14T19:43:42.822706] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-14T19:43:42.824401] [DEBUG] [LOCAL ] PX: Trimmed 38487 records to 26389 (keeping 150 days of data) [2025-09-14T19:43:42.961618] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-14T19:43:42.959733] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-14T19:43:43.049922] [DEBUG] [LOCAL ] PX: Primary data saved (26389 records). [2025-09-14T19:43:43.050124] [INFO ] [MAIN ] PX: Full history saved. [2025-09-14T19:43:43.050286] [INFO ] [MAIN ] Update Progress: 1755/2370 symbols completed. PX took 23.5s. Estimated remaining: 1h 5m 22s. Rate: 9.4 symbols/min [2025-09-14T19:43:43.220069] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:43:43.232924] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T19:43:43.237218] [INFO ] [REMOTE ] QD: Full fetch complete (30443 records). [2025-09-14T19:43:43.237433] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-14T19:43:43.369982] [DEBUG] [LOCAL ] QGEN: Loaded 21916 existing records from primary storage. [2025-09-14T19:43:43.385496] [INFO ] [MAIN ] QGEN: Loaded 21916 existing records. [2025-09-14T19:43:43.748736] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:43:43.759217] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-14T19:43:43.797482] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-14T19:43:43.826825] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-14T19:43:43.835123] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-14T19:43:43.835297] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-14T19:43:43.836617] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-14T19:43:43.836672] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-14T19:43:43.836842] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-14T19:43:43.836771] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-14T19:43:43.906763] [DEBUG] [LOCAL ] QD: Trimmed 30443 records to 20705 (keeping 150 days of data) [2025-09-14T19:43:44.319721] [DEBUG] [LOCAL ] QD: Primary data saved (20705 records). [2025-09-14T19:43:44.339841] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:43:44.340232] [INFO ] [MAIN ] QD: Full history saved. [2025-09-14T19:43:44.340394] [INFO ] [MAIN ] Update Progress: 1756/2370 symbols completed. QD took 21.0s. Estimated remaining: 1h 5m 14s. Rate: 9.4 symbols/min [2025-09-14T19:43:44.514565] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:43:44.543748] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T19:43:44.561979] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-14T19:43:44.576990] [DEBUG] [LOCAL ] QS: Loaded 24211 existing records from primary storage. [2025-09-14T19:43:44.577209] [INFO ] [MAIN ] QS: Loaded 24211 existing records. [2025-09-14T19:43:44.763819] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:43:44.764083] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-14T19:43:44.764145] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-14T19:43:44.764891] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-14T19:43:44.764953] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-14T19:43:45.116263] [INFO ] [REMOTE ] QS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:43:45.358822] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-14T19:43:46.158858] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-14T19:43:46.374238] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T19:43:46.471569] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T19:43:46.476669] [INFO ] [REMOTE ] PWR: Full fetch complete (52192 records). [2025-09-14T19:43:46.476786] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-14T19:43:46.858873] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-14T19:43:46.859021] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-14T19:43:46.860254] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-14T19:43:46.860369] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-14T19:43:46.861746] [DEBUG] [LOCAL ] PWR: Trimmed 52192 records to 35178 (keeping 150 days of data) [2025-09-14T19:43:46.962805] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-14T19:43:47.002597] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (3.24 seconds). [2025-09-14T19:43:47.158302] [DEBUG] [LOCAL ] PWR: Primary data saved (35178 records). [2025-09-14T19:43:47.158498] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-14T19:43:47.158636] [INFO ] [MAIN ] Update Progress: 1757/2370 symbols completed. PWR took 29.9s. Estimated remaining: 1h 5m 6s. Rate: 9.4 symbols/min [2025-09-14T19:43:47.416963] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T19:43:47.758890] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-14T19:43:48.558891] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-14T19:43:48.680826] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T19:43:49.358855] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-14T19:43:50.614921] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-14T19:43:50.627377] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-14T19:43:50.688256] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T19:43:50.789234] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T19:43:50.958830] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-14T19:43:51.758903] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-14T19:43:52.701817] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T19:43:52.712797] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-14T19:43:52.812907] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-14T19:43:52.819487] [INFO ] [REMOTE ] QBTS: Full fetch complete (58423 records). [2025-09-14T19:43:52.819681] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-14T19:43:53.216610] [DEBUG] [VALIDATOR ] QBTS: All expected trading days are present. [2025-09-14T19:43:53.216746] [DEBUG] [VALIDATOR ] QBTS: Primary data validation passed. [2025-09-14T19:43:53.217833] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-09-14T19:43:53.217892] [DEBUG] [LOCAL ] QBTS: Saving primary data. [2025-09-14T19:43:53.219094] [DEBUG] [LOCAL ] QBTS: Trimmed 58423 records to 40560 (keeping 150 days of data) [2025-09-14T19:43:53.477885] [DEBUG] [LOCAL ] QBTS: Primary data saved (40560 records). [2025-09-14T19:43:53.478050] [INFO ] [MAIN ] QBTS: Full history saved. [2025-09-14T19:43:53.478162] [INFO ] [MAIN ] Update Progress: 1758/2370 symbols completed. QBTS took 31.7s. Estimated remaining: 1h 4m 60s. Rate: 9.4 symbols/min [2025-09-14T19:43:53.989105] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-14T19:43:54.002527] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-14T19:43:54.453395] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T19:43:54.463929] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-14T19:43:55.860346] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T19:43:55.872612] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-14T19:43:56.272599] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T19:43:56.284517] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-14T19:43:58.107957] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T19:43:58.119323] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-14T19:43:58.155451] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-14T19:43:58.167854] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-14T19:43:59.753310] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T19:43:59.758633] [INFO ] [REMOTE ] QGEN: Full fetch complete (53378 records). [2025-09-14T19:43:59.758845] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-14T19:44:00.156936] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-14T19:44:00.157117] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-14T19:44:00.158194] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-14T19:44:00.158257] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-14T19:44:00.159527] [DEBUG] [LOCAL ] QGEN: Trimmed 53378 records to 37071 (keeping 150 days of data) [2025-09-14T19:44:00.399218] [DEBUG] [LOCAL ] QGEN: Primary data saved (37071 records). [2025-09-14T19:44:00.399395] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-14T19:44:00.399502] [INFO ] [MAIN ] Update Progress: 1759/2370 symbols completed. QGEN took 17.3s. Estimated remaining: 1h 4m 53s. Rate: 9.4 symbols/min [2025-09-14T19:44:00.742140] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-14T19:44:00.755105] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-14T19:44:03.124873] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-14T19:44:03.137166] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-14T19:44:05.150414] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-14T19:44:05.156241] [INFO ] [REMOTE ] QS: Full fetch complete (58422 records). [2025-09-14T19:44:05.156413] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-14T19:44:05.544919] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-14T19:44:05.545082] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-14T19:44:05.547513] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-14T19:44:05.547592] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-14T19:44:05.549023] [DEBUG] [LOCAL ] QS: Trimmed 58422 records to 40500 (keeping 150 days of data) [2025-09-14T19:44:05.804259] [DEBUG] [LOCAL ] QS: Primary data saved (40500 records). [2025-09-14T19:44:05.804434] [INFO ] [MAIN ] QS: Full history saved. [2025-09-14T19:44:05.804580] [INFO ] [MAIN ] Update Progress: 1760/2370 symbols completed. QS took 21.5s. Estimated remaining: 1h 4m 47s. Rate: 9.4 symbols/min [2025-09-14T19:44:06.331298] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:06.442124] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:06.504407] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:06.507502] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:06.523195] [DEBUG] [LOCAL ] QVCC: Loaded 3777 existing records from primary storage. [2025-09-14T19:44:06.523604] [INFO ] [MAIN ] QVCC: Loaded 3777 existing records. [2025-09-14T19:44:06.610230] [DEBUG] [LOCAL ] QUAD: Loaded 10064 existing records from primary storage. [2025-09-14T19:44:06.637128] [INFO ] [MAIN ] QUAD: Loaded 10064 existing records. [2025-09-14T19:44:06.653513] [DEBUG] [LOCAL ] QSR: Loaded 23409 existing records from primary storage. [2025-09-14T19:44:06.649504] [DEBUG] [LOCAL ] QTWO: Loaded 17208 existing records from primary storage. [2025-09-14T19:44:06.658895] [INFO ] [MAIN ] QTWO: Loaded 17208 existing records. [2025-09-14T19:44:06.659040] [INFO ] [MAIN ] QSR: Loaded 23409 existing records. [2025-09-14T19:44:07.000394] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:07.026448] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-14T19:44:07.100051] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-14T19:44:07.271229] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:07.271092] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-14T19:44:07.271328] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:07.271839] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-14T19:44:07.271447] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:07.271955] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-14T19:44:07.301497] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-14T19:44:07.317197] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-14T19:44:07.311962] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-14T19:44:07.340071] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-14T19:44:07.356700] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-14T19:44:07.375157] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-14T19:44:07.375229] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-14T19:44:07.375323] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-14T19:44:07.375670] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-14T19:44:07.513604] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-14T19:44:07.586339] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-14T19:44:08.195202] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:08.277955] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-14T19:44:08.729609] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:08.761549] [INFO ] [REMOTE ] QSR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:08.767477] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-14T19:44:08.801358] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-14T19:44:08.828250] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:08.830170] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-14T19:44:08.927250] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T19:44:08.929687] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-14T19:44:09.680355] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T19:44:09.691124] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-14T19:44:09.801797] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T19:44:09.804967] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-14T19:44:09.963626] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T19:44:09.969465] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-14T19:44:10.416934] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T19:44:10.425220] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-14T19:44:10.852692] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T19:44:10.864618] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T19:44:10.867438] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-14T19:44:10.867683] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-14T19:44:11.264617] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T19:44:11.270890] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-14T19:44:11.679083] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T19:44:11.682153] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-14T19:44:11.817331] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T19:44:11.828744] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-14T19:44:12.106844] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T19:44:12.116273] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-14T19:44:12.487489] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T19:44:12.490884] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-14T19:44:12.672230] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T19:44:12.679828] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-14T19:44:12.844986] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T19:44:13.201559] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T19:44:13.358827] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-14T19:44:13.461085] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T19:44:13.656521] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T19:44:14.158863] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-14T19:44:14.167750] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T19:44:14.958942] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-14T19:44:15.758858] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-14T19:44:15.817274] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T19:44:15.923080] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T19:44:16.558885] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-14T19:44:16.571805] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T19:44:16.573425] [INFO ] [REMOTE ] QVCC: Full fetch complete (9346 records). [2025-09-14T19:44:16.573516] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-14T19:44:16.969296] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-14T19:44:16.969406] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-14T19:44:16.969680] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-14T19:44:16.969733] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-14T19:44:16.970200] [DEBUG] [LOCAL ] QVCC: Trimmed 9346 records to 6548 (keeping 150 days of data) [2025-09-14T19:44:17.010244] [DEBUG] [LOCAL ] QVCC: Primary data saved (6548 records). [2025-09-14T19:44:17.010390] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-14T19:44:17.010490] [INFO ] [MAIN ] Update Progress: 1761/2370 symbols completed. QVCC took 11.2s. Estimated remaining: 1h 4m 42s. Rate: 9.4 symbols/min [2025-09-14T19:44:17.184898] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:17.188440] [DEBUG] [LOCAL ] QVCD: Loaded 1810 existing records from primary storage. [2025-09-14T19:44:17.188535] [INFO ] [MAIN ] QVCD: Loaded 1810 existing records. [2025-09-14T19:44:17.367904] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-14T19:44:17.373346] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:17.374702] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-14T19:44:17.374780] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-14T19:44:17.375035] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-14T19:44:17.375093] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-14T19:44:17.737418] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:17.903066] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T19:44:18.158898] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-14T19:44:18.558279] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T19:44:18.958832] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-14T19:44:19.072737] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T19:44:19.758909] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-14T19:44:20.549487] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T19:44:20.559321] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-14T19:44:20.871587] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T19:44:21.358808] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-14T19:44:21.472983] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T19:44:22.158930] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-14T19:44:22.832055] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T19:44:22.872798] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:44:22.879015] [INFO ] [REMOTE ] QSR: Full fetch complete (57047 records). [2025-09-14T19:44:22.879238] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-14T19:44:22.964066] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-14T19:44:23.281244] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-14T19:44:23.281418] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-14T19:44:23.283219] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-14T19:44:23.283299] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-14T19:44:23.285112] [DEBUG] [LOCAL ] QSR: Trimmed 57047 records to 39436 (keeping 150 days of data) [2025-09-14T19:44:23.577110] [DEBUG] [LOCAL ] QSR: Primary data saved (39436 records). [2025-09-14T19:44:23.577369] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-14T19:44:23.577506] [INFO ] [MAIN ] Update Progress: 1762/2370 symbols completed. QSR took 17.8s. Estimated remaining: 1h 4m 36s. Rate: 9.4 symbols/min [2025-09-14T19:44:23.753199] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:23.758877] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-14T19:44:23.781097] [DEBUG] [LOCAL ] QXO: Loaded 24015 existing records from primary storage. [2025-09-14T19:44:23.781892] [INFO ] [MAIN ] QXO: Loaded 24015 existing records. [2025-09-14T19:44:23.994282] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:23.994625] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-14T19:44:23.994715] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-14T19:44:23.995571] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-14T19:44:23.995673] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-14T19:44:24.371675] [INFO ] [REMOTE ] QXO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:24.394070] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T19:44:24.558831] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-14T19:44:25.196254] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T19:44:25.201668] [INFO ] [REMOTE ] QTWO: Full fetch complete (42631 records). [2025-09-14T19:44:25.201811] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-14T19:44:25.365963] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-14T19:44:25.632776] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-14T19:44:25.633096] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T19:44:25.633299] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-14T19:44:25.636966] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-14T19:44:25.637684] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-14T19:44:25.638082] [INFO ] [REMOTE ] QUAD: Full fetch complete (26822 records). [2025-09-14T19:44:25.638694] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-14T19:44:25.704878] [DEBUG] [LOCAL ] QTWO: Trimmed 42631 records to 28213 (keeping 150 days of data) [2025-09-14T19:44:26.133712] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T19:44:26.164982] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-14T19:44:26.177984] [DEBUG] [LOCAL ] QTWO: Primary data saved (28213 records). [2025-09-14T19:44:26.178203] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-14T19:44:26.185149] [INFO ] [MAIN ] Update Progress: 1763/2370 symbols completed. QTWO took 20.4s. Estimated remaining: 1h 4m 28s. Rate: 9.4 symbols/min [2025-09-14T19:44:26.382736] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-14T19:44:26.403618] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-14T19:44:26.450107] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:26.451133] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-14T19:44:26.451912] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-14T19:44:26.453746] [DEBUG] [LOCAL ] QUAD: Trimmed 26822 records to 18029 (keeping 150 days of data) [2025-09-14T19:44:26.581454] [DEBUG] [LOCAL ] QUAD: Primary data saved (18029 records). [2025-09-14T19:44:26.582962] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-14T19:44:26.582692] [DEBUG] [LOCAL ] R: Loaded 11769 existing records from primary storage. [2025-09-14T19:44:26.583126] [INFO ] [MAIN ] Update Progress: 1764/2370 symbols completed. QUAD took 20.8s. Estimated remaining: 1h 4m 20s. Rate: 9.4 symbols/min [2025-09-14T19:44:26.588931] [INFO ] [MAIN ] R: Loaded 11769 existing records. [2025-09-14T19:44:26.960338] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:26.960429] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-14T19:44:26.964184] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:26.970353] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:44:26.969199] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-14T19:44:26.974595] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-14T19:44:26.975288] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-14T19:44:26.975388] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-14T19:44:27.108196] [DEBUG] [LOCAL ] RA: Loaded 10235 existing records from primary storage. [2025-09-14T19:44:27.137026] [INFO ] [MAIN ] RA: Loaded 10235 existing records. [2025-09-14T19:44:27.530454] [INFO ] [REMOTE ] R: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:27.530555] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:27.531071] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-14T19:44:27.531135] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-14T19:44:27.531501] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-14T19:44:27.531557] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-14T19:44:27.764483] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-14T19:44:27.889679] [INFO ] [REMOTE ] RA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:28.558792] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-14T19:44:28.655611] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T19:44:29.358850] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-14T19:44:29.384293] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T19:44:29.876517] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T19:44:30.158837] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-14T19:44:30.958887] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-14T19:44:31.165238] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T19:44:31.334864] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T19:44:31.362256] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-14T19:44:31.758842] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-14T19:44:32.558897] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-14T19:44:33.039880] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T19:44:33.325755] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T19:44:33.358826] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-14T19:44:33.970879] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T19:44:34.158884] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-14T19:44:34.958882] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-14T19:44:35.586089] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T19:44:35.758933] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-14T19:44:36.358822] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T19:44:36.558899] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-14T19:44:36.706602] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T19:44:37.358830] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-14T19:44:37.534383] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T19:44:38.158895] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-14T19:44:38.821116] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T19:44:38.929430] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T19:44:38.958799] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-14T19:44:39.758869] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-14T19:44:40.283881] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T19:44:40.558943] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-14T19:44:41.070090] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T19:44:41.072603] [INFO ] [REMOTE ] QVCD: Full fetch complete (4854 records). [2025-09-14T19:44:41.073253] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-14T19:44:41.364050] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-14T19:44:41.601427] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-14T19:44:41.601669] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-14T19:44:41.601945] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-14T19:44:41.602015] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-14T19:44:41.602836] [DEBUG] [LOCAL ] QVCD: Trimmed 4854 records to 3433 (keeping 150 days of data) [2025-09-14T19:44:41.627061] [DEBUG] [LOCAL ] QVCD: Primary data saved (3433 records). [2025-09-14T19:44:41.627265] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-14T19:44:41.627402] [INFO ] [MAIN ] Update Progress: 1765/2370 symbols completed. QVCD took 24.6s. Estimated remaining: 1h 4m 16s. Rate: 9.4 symbols/min [2025-09-14T19:44:41.809557] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:41.849980] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T19:44:41.872924] [DEBUG] [LOCAL ] RACE: Loaded 13642 existing records from primary storage. [2025-09-14T19:44:41.873110] [INFO ] [MAIN ] RACE: Loaded 13642 existing records. [2025-09-14T19:44:42.052703] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:42.053031] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-14T19:44:42.053100] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-14T19:44:42.053516] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-14T19:44:42.053575] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-14T19:44:42.164122] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-14T19:44:42.406415] [INFO ] [REMOTE ] RACE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:42.682102] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T19:44:42.958880] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-14T19:44:43.087617] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T19:44:43.746148] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T19:44:43.758772] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-14T19:44:44.558898] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-14T19:44:44.707046] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T19:44:45.358841] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-14T19:44:46.139927] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:44:46.158803] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-14T19:44:46.560612] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T19:44:46.958853] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-14T19:44:47.758863] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-14T19:44:48.066382] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T19:44:48.130705] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T19:44:48.558798] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-14T19:44:48.643974] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T19:44:49.107985] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T19:44:49.111163] [INFO ] [REMOTE ] R: Full fetch complete (32715 records). [2025-09-14T19:44:49.111304] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-14T19:44:49.363970] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-14T19:44:49.525612] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-14T19:44:49.525775] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-14T19:44:49.526714] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-14T19:44:49.526809] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-14T19:44:49.527899] [DEBUG] [LOCAL ] R: Trimmed 32715 records to 20906 (keeping 150 days of data) [2025-09-14T19:44:49.666418] [DEBUG] [LOCAL ] R: Primary data saved (20906 records). [2025-09-14T19:44:49.666624] [INFO ] [MAIN ] R: Full history saved. [2025-09-14T19:44:49.666774] [INFO ] [MAIN ] Update Progress: 1766/2370 symbols completed. R took 23.5s. Estimated remaining: 1h 4m 10s. Rate: 9.4 symbols/min [2025-09-14T19:44:49.843495] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:49.859922] [DEBUG] [LOCAL ] RAMP: Loaded 15917 existing records from primary storage. [2025-09-14T19:44:49.860103] [INFO ] [MAIN ] RAMP: Loaded 15917 existing records. [2025-09-14T19:44:50.043091] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:50.044356] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-14T19:44:50.044435] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-14T19:44:50.045726] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-14T19:44:50.045813] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-14T19:44:50.163928] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-14T19:44:50.409253] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:50.958827] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-14T19:44:51.175884] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T19:44:51.178199] [INFO ] [REMOTE ] RA: Full fetch complete (23851 records). [2025-09-14T19:44:51.178418] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-14T19:44:51.563102] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-14T19:44:51.563372] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-14T19:44:51.564337] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-14T19:44:51.564539] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-14T19:44:51.565587] [DEBUG] [LOCAL ] RA: Trimmed 23851 records to 15948 (keeping 150 days of data) [2025-09-14T19:44:51.695857] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T19:44:51.706738] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-14T19:44:51.744470] [DEBUG] [LOCAL ] RA: Primary data saved (15948 records). [2025-09-14T19:44:51.744688] [INFO ] [MAIN ] RA: Full history saved. [2025-09-14T19:44:51.744812] [INFO ] [MAIN ] Update Progress: 1767/2370 symbols completed. RA took 25.2s. Estimated remaining: 1h 4m 3s. Rate: 9.4 symbols/min [2025-09-14T19:44:51.765846] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-14T19:44:51.932253] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:51.953183] [DEBUG] [LOCAL ] RBA: Loaded 20214 existing records from primary storage. [2025-09-14T19:44:51.953355] [INFO ] [MAIN ] RBA: Loaded 20214 existing records. [2025-09-14T19:44:52.128223] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:52.128516] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-14T19:44:52.128581] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-14T19:44:52.129468] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-14T19:44:52.129538] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-14T19:44:52.484061] [INFO ] [REMOTE ] RBA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:52.558799] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-14T19:44:52.627292] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T19:44:53.358895] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-14T19:44:54.158852] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-14T19:44:54.582432] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T19:44:54.958803] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-14T19:44:55.006871] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T19:44:55.014950] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:44:55.758874] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-14T19:44:56.526839] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T19:44:56.532352] [INFO ] [REMOTE ] QXO: Full fetch complete (57460 records). [2025-09-14T19:44:56.532503] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-14T19:44:56.565000] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-14T19:44:56.933222] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-14T19:44:56.933356] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-14T19:44:56.934448] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-14T19:44:56.934511] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-14T19:44:56.935998] [DEBUG] [LOCAL ] QXO: Trimmed 57460 records to 40263 (keeping 150 days of data) [2025-09-14T19:44:57.197264] [DEBUG] [LOCAL ] QXO: Primary data saved (40263 records). [2025-09-14T19:44:57.197421] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-14T19:44:57.197535] [INFO ] [MAIN ] Update Progress: 1768/2370 symbols completed. QXO took 33.6s. Estimated remaining: 1h 3m 56s. Rate: 9.4 symbols/min [2025-09-14T19:44:57.368267] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:44:57.365541] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-14T19:44:57.378125] [DEBUG] [LOCAL ] RBC: Loaded 6392 existing records from primary storage. [2025-09-14T19:44:57.378283] [INFO ] [MAIN ] RBC: Loaded 6392 existing records. [2025-09-14T19:44:57.576104] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:44:57.583180] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-14T19:44:57.583565] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-14T19:44:57.584713] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-14T19:44:57.587847] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-14T19:44:57.587608] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T19:44:57.687880] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T19:44:58.021946] [INFO ] [REMOTE ] RBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:44:58.158774] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-14T19:44:58.939735] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T19:44:58.958782] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-14T19:44:58.992976] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T19:44:59.758834] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-14T19:45:00.437062] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T19:45:00.558797] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-14T19:45:00.870236] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T19:45:01.358886] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-14T19:45:02.158875] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-14T19:45:02.472584] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T19:45:02.958840] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-14T19:45:03.758915] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-14T19:45:04.295027] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-09-14T19:45:04.558840] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-14T19:45:04.798679] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T19:45:05.254112] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-14T19:45:05.358842] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-14T19:45:06.159587] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-14T19:45:06.162790] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (4.00 seconds). [2025-09-14T19:45:06.428316] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-14T19:45:06.448575] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T19:45:06.518680] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T19:45:06.522309] [INFO ] [REMOTE ] RACE: Full fetch complete (36366 records). [2025-09-14T19:45:06.522461] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-14T19:45:06.912342] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-14T19:45:06.912519] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-14T19:45:06.913987] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-14T19:45:06.914084] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-14T19:45:06.915431] [DEBUG] [LOCAL ] RACE: Trimmed 36366 records to 23019 (keeping 150 days of data) [2025-09-14T19:45:06.970863] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-14T19:45:07.068850] [DEBUG] [LOCAL ] RACE: Primary data saved (23019 records). [2025-09-14T19:45:07.069087] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-14T19:45:07.069246] [INFO ] [MAIN ] Update Progress: 1769/2370 symbols completed. RACE took 25.4s. Estimated remaining: 1h 3m 51s. Rate: 9.4 symbols/min [2025-09-14T19:45:07.248773] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:07.276486] [DEBUG] [LOCAL ] RBLX: Loaded 24096 existing records from primary storage. [2025-09-14T19:45:07.276735] [INFO ] [MAIN ] RBLX: Loaded 24096 existing records. [2025-09-14T19:45:07.464882] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:07.465273] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-14T19:45:07.465347] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-14T19:45:07.466191] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-14T19:45:07.466262] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-14T19:45:07.762785] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-14T19:45:07.830062] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:07.840572] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T19:45:08.558890] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-14T19:45:09.358880] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-14T19:45:09.636812] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T19:45:10.158829] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-14T19:45:10.360333] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T19:45:10.958900] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-14T19:45:10.964955] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-14T19:45:11.403235] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T19:45:11.466986] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T19:45:11.469093] [INFO ] [REMOTE ] RBC: Full fetch complete (16061 records). [2025-09-14T19:45:11.469290] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-14T19:45:11.764431] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-14T19:45:11.865746] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-14T19:45:11.865898] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-14T19:45:11.866537] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-14T19:45:11.866636] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-14T19:45:11.867434] [DEBUG] [LOCAL ] RBC: Trimmed 16061 records to 11038 (keeping 150 days of data) [2025-09-14T19:45:11.937032] [DEBUG] [LOCAL ] RBC: Primary data saved (11038 records). [2025-09-14T19:45:11.937246] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-14T19:45:11.937373] [INFO ] [MAIN ] Update Progress: 1770/2370 symbols completed. RBC took 14.7s. Estimated remaining: 1h 3m 44s. Rate: 9.4 symbols/min [2025-09-14T19:45:12.110515] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:12.115420] [DEBUG] [LOCAL ] RBOT: Loaded 2806 existing records from primary storage. [2025-09-14T19:45:12.115619] [INFO ] [MAIN ] RBOT: Loaded 2806 existing records. [2025-09-14T19:45:12.294505] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:12.294850] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-14T19:45:12.294917] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-14T19:45:12.295174] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-14T19:45:12.295231] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-14T19:45:12.568982] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-14T19:45:12.658427] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:13.358875] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-14T19:45:14.060043] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T19:45:14.158808] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-14T19:45:14.424480] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-14T19:45:14.711586] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T19:45:14.958876] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-14T19:45:15.758850] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-14T19:45:16.216035] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T19:45:16.558879] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-14T19:45:17.358935] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-14T19:45:17.473709] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T19:45:17.608323] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-14T19:45:18.049625] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-14T19:45:18.158893] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-14T19:45:18.897589] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T19:45:18.958816] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-14T19:45:19.758869] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-14T19:45:20.049725] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T19:45:20.053971] [INFO ] [REMOTE ] RAMP: Full fetch complete (40983 records). [2025-09-14T19:45:20.054125] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-14T19:45:20.447541] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-14T19:45:20.448633] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-14T19:45:20.449961] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-14T19:45:20.450100] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-14T19:45:20.452206] [DEBUG] [LOCAL ] RAMP: Trimmed 40983 records to 27463 (keeping 150 days of data) [2025-09-14T19:45:20.560122] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-14T19:45:20.626709] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:45:20.629787] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-14T19:45:20.717540] [DEBUG] [LOCAL ] RAMP: Primary data saved (27463 records). [2025-09-14T19:45:20.717754] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-14T19:45:20.717883] [INFO ] [MAIN ] Update Progress: 1771/2370 symbols completed. RAMP took 31.1s. Estimated remaining: 1h 3m 38s. Rate: 9.4 symbols/min [2025-09-14T19:45:20.904202] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:20.927543] [DEBUG] [LOCAL ] RBRK: Loaded 23878 existing records from primary storage. [2025-09-14T19:45:20.927783] [INFO ] [MAIN ] RBRK: Loaded 23878 existing records. [2025-09-14T19:45:21.104162] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:21.104425] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-14T19:45:21.104502] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-14T19:45:21.105330] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-14T19:45:21.105410] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-14T19:45:21.360082] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-14T19:45:21.380793] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T19:45:21.480477] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:22.158874] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-14T19:45:22.686856] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T19:45:22.958838] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-14T19:45:23.758808] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-14T19:45:23.836506] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-14T19:45:24.095194] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-14T19:45:24.558843] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-14T19:45:24.792151] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T19:45:24.852345] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T19:45:24.857793] [INFO ] [REMOTE ] RBA: Full fetch complete (50209 records). [2025-09-14T19:45:24.857940] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-14T19:45:25.260849] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-14T19:45:25.261045] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-14T19:45:25.263313] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-14T19:45:25.263409] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-14T19:45:25.265220] [DEBUG] [LOCAL ] RBA: Trimmed 50209 records to 34408 (keeping 150 days of data) [2025-09-14T19:45:25.369197] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-14T19:45:25.517917] [DEBUG] [LOCAL ] RBA: Primary data saved (34408 records). [2025-09-14T19:45:25.518125] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-14T19:45:25.518257] [INFO ] [MAIN ] Update Progress: 1772/2370 symbols completed. RBA took 33.8s. Estimated remaining: 1h 3m 31s. Rate: 9.4 symbols/min [2025-09-14T19:45:25.700364] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:25.722061] [DEBUG] [LOCAL ] RC: Loaded 21335 existing records from primary storage. [2025-09-14T19:45:25.722268] [INFO ] [MAIN ] RC: Loaded 21335 existing records. [2025-09-14T19:45:25.907792] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:25.908047] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-14T19:45:25.908108] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-14T19:45:25.908831] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-14T19:45:25.908916] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-14T19:45:26.164478] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-14T19:45:26.294115] [INFO ] [REMOTE ] RC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:26.958887] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-14T19:45:27.010879] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T19:45:27.221777] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T19:45:27.758966] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-14T19:45:28.558840] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-14T19:45:28.614960] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:45:29.358890] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-14T19:45:29.577727] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T19:45:29.843226] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-14T19:45:30.158877] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-14T19:45:30.597235] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T19:45:30.598533] [INFO ] [REMOTE ] RBOT: Full fetch complete (5828 records). [2025-09-14T19:45:30.598624] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-14T19:45:30.958839] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-14T19:45:30.959075] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-14T19:45:30.959404] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-14T19:45:30.959678] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-14T19:45:30.960657] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-14T19:45:30.961293] [DEBUG] [LOCAL ] RBOT: Trimmed 5828 records to 3824 (keeping 150 days of data) [2025-09-14T19:45:31.019555] [DEBUG] [LOCAL ] RBOT: Primary data saved (3824 records). [2025-09-14T19:45:31.019465] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-14T19:45:31.023775] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-14T19:45:31.030910] [INFO ] [MAIN ] Update Progress: 1773/2370 symbols completed. RBOT took 19.1s. Estimated remaining: 1h 3m 25s. Rate: 9.4 symbols/min [2025-09-14T19:45:31.198310] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:31.200737] [DEBUG] [LOCAL ] RCB: Loaded 497 existing records from primary storage. [2025-09-14T19:45:31.200829] [INFO ] [MAIN ] RCB: Loaded 497 existing records. [2025-09-14T19:45:31.372331] [WARN ] [MAIN ] RCB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:31.372596] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-14T19:45:31.372673] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-14T19:45:31.372897] [DEBUG] [LOCAL ] RCB: Deleted primary data file. [2025-09-14T19:45:31.372956] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-14T19:45:31.726443] [INFO ] [REMOTE ] RCB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:31.758816] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-14T19:45:32.558890] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-14T19:45:32.604795] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T19:45:32.806465] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T19:45:33.358936] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-14T19:45:34.158922] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-14T19:45:34.531813] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T19:45:34.958847] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-14T19:45:35.592446] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T19:45:35.735303] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-14T19:45:35.758786] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-14T19:45:36.261012] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-14T19:45:36.558882] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-14T19:45:37.165152] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T19:45:37.358845] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-14T19:45:37.652202] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-14T19:45:37.659230] [INFO ] [REMOTE ] RBLX: Full fetch complete (58403 records). [2025-09-14T19:45:37.659432] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-14T19:45:38.046762] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-14T19:45:38.046893] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-14T19:45:38.048150] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-14T19:45:38.048240] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-14T19:45:38.049823] [DEBUG] [LOCAL ] RBLX: Trimmed 58403 records to 40472 (keeping 150 days of data) [2025-09-14T19:45:38.159104] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-14T19:45:38.341156] [DEBUG] [LOCAL ] RBLX: Primary data saved (40472 records). [2025-09-14T19:45:38.341344] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-14T19:45:38.341539] [INFO ] [MAIN ] Update Progress: 1774/2370 symbols completed. RBLX took 31.3s. Estimated remaining: 1h 3m 19s. Rate: 9.4 symbols/min [2025-09-14T19:45:38.516442] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:38.520756] [DEBUG] [LOCAL ] RCD: Loaded 1625 existing records from primary storage. [2025-09-14T19:45:38.520875] [INFO ] [MAIN ] RCD: Loaded 1625 existing records. [2025-09-14T19:45:38.702604] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:38.702922] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-14T19:45:38.703018] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-14T19:45:38.703295] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-09-14T19:45:38.703394] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-14T19:45:38.976561] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-14T19:45:39.092915] [INFO ] [REMOTE ] RCD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:39.367794] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T19:45:39.449459] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T19:45:39.661695] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T19:45:39.758811] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-14T19:45:40.265392] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T19:45:40.558845] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-14T19:45:41.358850] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-14T19:45:42.158861] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-14T19:45:42.360043] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T19:45:42.747855] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T19:45:42.958841] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-14T19:45:43.569624] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-14T19:45:43.757491] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T19:45:43.760311] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-14T19:45:44.175620] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-14T19:45:44.558848] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-14T19:45:45.358845] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-14T19:45:45.968872] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T19:45:46.158865] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-14T19:45:46.262390] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T19:45:46.268203] [INFO ] [REMOTE ] RBRK: Full fetch complete (57531 records). [2025-09-14T19:45:46.268396] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-14T19:45:46.659320] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-14T19:45:46.659468] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-14T19:45:46.660604] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-14T19:45:46.660706] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-14T19:45:46.663546] [DEBUG] [LOCAL ] RBRK: Trimmed 57531 records to 39987 (keeping 150 days of data) [2025-09-14T19:45:46.926139] [DEBUG] [LOCAL ] RBRK: Primary data saved (39987 records). [2025-09-14T19:45:46.926316] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-14T19:45:46.926461] [INFO ] [MAIN ] Update Progress: 1775/2370 symbols completed. RBRK took 26.2s. Estimated remaining: 1h 3m 13s. Rate: 9.4 symbols/min [2025-09-14T19:45:46.964262] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-14T19:45:47.099392] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:47.121228] [DEBUG] [LOCAL ] RCI: Loaded 21925 existing records from primary storage. [2025-09-14T19:45:47.121440] [INFO ] [MAIN ] RCI: Loaded 21925 existing records. [2025-09-14T19:45:47.295388] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:47.295679] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-14T19:45:47.295742] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-14T19:45:47.296427] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-14T19:45:47.296491] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-14T19:45:47.651567] [INFO ] [REMOTE ] RCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:47.758840] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-14T19:45:47.769249] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T19:45:47.806944] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T19:45:47.865324] [DEBUG] [REMOTE ] RCI: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-14T19:45:47.865960] [WARN ] [REMOTE ] RCI: No data returned for month 2025-02 [2025-09-14T19:45:48.558833] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-14T19:45:49.358825] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-14T19:45:49.971379] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T19:45:50.158822] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-14T19:45:50.302310] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T19:45:50.800690] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T19:45:50.958835] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-14T19:45:51.758838] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-14T19:45:52.368142] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T19:45:52.558805] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-14T19:45:52.652197] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T19:45:52.897221] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T19:45:52.898359] [INFO ] [REMOTE ] RCD: Full fetch complete (4498 records). [2025-09-14T19:45:52.898447] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-14T19:45:53.281507] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-09-14T19:45:53.281672] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-09-14T19:45:53.281932] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-09-14T19:45:53.281999] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-09-14T19:45:53.282562] [DEBUG] [LOCAL ] RCD: Trimmed 4498 records to 2632 (keeping 150 days of data) [2025-09-14T19:45:53.301704] [DEBUG] [LOCAL ] RCD: Primary data saved (2632 records). [2025-09-14T19:45:53.302000] [INFO ] [MAIN ] RCD: Full history saved. [2025-09-14T19:45:53.302149] [INFO ] [MAIN ] Update Progress: 1776/2370 symbols completed. RCD took 15.0s. Estimated remaining: 1h 3m 7s. Rate: 9.4 symbols/min [2025-09-14T19:45:53.364087] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-14T19:45:53.501859] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:53.540391] [DEBUG] [LOCAL ] RCL: Loaded 23282 existing records from primary storage. [2025-09-14T19:45:53.540657] [INFO ] [MAIN ] RCL: Loaded 23282 existing records. [2025-09-14T19:45:53.744388] [WARN ] [MAIN ] RCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:53.744864] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-14T19:45:53.744934] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-14T19:45:53.746127] [DEBUG] [LOCAL ] RCL: Deleted primary data file. [2025-09-14T19:45:53.746214] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-14T19:45:53.945232] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T19:45:54.164451] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-14T19:45:54.170065] [INFO ] [REMOTE ] RCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:54.570536] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T19:45:54.571392] [INFO ] [REMOTE ] RCB: Full fetch complete (3062 records). [2025-09-14T19:45:54.571475] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-14T19:45:54.747562] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T19:45:54.747791] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:45:54.747843] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:45:54.747892] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-14T19:45:54.747969] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-14T19:45:54.748025] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-14T19:45:54.748085] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-14T19:45:54.748178] [INFO ] [MAIN ] Update Progress: 1777/2370 symbols completed. RCB took 23.7s. Estimated remaining: 1h 2m 59s. Rate: 9.4 symbols/min [2025-09-14T19:45:54.917988] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:45:54.927999] [DEBUG] [LOCAL ] RCS: Loaded 4951 existing records from primary storage. [2025-09-14T19:45:54.928155] [INFO ] [MAIN ] RCS: Loaded 4951 existing records. [2025-09-14T19:45:54.964127] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-14T19:45:55.122686] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:45:55.122986] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-14T19:45:55.123050] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-14T19:45:55.123489] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-14T19:45:55.123555] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-14T19:45:55.499505] [INFO ] [REMOTE ] RCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:45:55.758844] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-14T19:45:56.003997] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T19:45:56.558876] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-14T19:45:57.358849] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-14T19:45:57.399753] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T19:45:57.543285] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T19:45:58.158844] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-14T19:45:58.632029] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T19:45:58.958845] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-14T19:45:59.126634] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T19:45:59.758836] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-14T19:45:59.818486] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T19:46:00.558863] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-14T19:46:00.787825] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T19:46:01.358850] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-14T19:46:02.158887] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-14T19:46:02.429272] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T19:46:02.506347] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T19:46:02.746096] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T19:46:02.958845] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-14T19:46:03.758882] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-14T19:46:04.558800] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-14T19:46:04.672148] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T19:46:04.691421] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T19:46:05.358833] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-14T19:46:06.158884] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-14T19:46:06.203313] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T19:46:06.346010] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-14T19:46:06.958843] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-14T19:46:07.758787] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-14T19:46:07.867972] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T19:46:07.959994] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T19:46:08.558841] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-14T19:46:08.676010] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T19:46:09.245709] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:46:09.251609] [INFO ] [REMOTE ] RCL: Full fetch complete (56791 records). [2025-09-14T19:46:09.251866] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-14T19:46:09.359767] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-14T19:46:09.644712] [DEBUG] [VALIDATOR ] RCL: All expected trading days are present. [2025-09-14T19:46:09.644842] [DEBUG] [VALIDATOR ] RCL: Primary data validation passed. [2025-09-14T19:46:09.645932] [INFO ] [MAIN ] RCL: Fetched primary data is valid. [2025-09-14T19:46:09.645994] [DEBUG] [LOCAL ] RCL: Saving primary data. [2025-09-14T19:46:09.647451] [DEBUG] [LOCAL ] RCL: Trimmed 56791 records to 39084 (keeping 150 days of data) [2025-09-14T19:46:09.920473] [DEBUG] [LOCAL ] RCL: Primary data saved (39084 records). [2025-09-14T19:46:09.920809] [INFO ] [MAIN ] RCL: Full history saved. [2025-09-14T19:46:09.920929] [INFO ] [MAIN ] Update Progress: 1778/2370 symbols completed. RCL took 16.6s. Estimated remaining: 1h 2m 55s. Rate: 9.4 symbols/min [2025-09-14T19:46:10.091567] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:46:10.109554] [DEBUG] [LOCAL ] RCUS: Loaded 18333 existing records from primary storage. [2025-09-14T19:46:10.109723] [INFO ] [MAIN ] RCUS: Loaded 18333 existing records. [2025-09-14T19:46:10.164036] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-14T19:46:10.291363] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:46:10.291659] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-14T19:46:10.291721] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-14T19:46:10.292336] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-14T19:46:10.292397] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-14T19:46:10.426886] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T19:46:10.651386] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:46:10.958853] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-14T19:46:11.604530] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T19:46:11.609534] [INFO ] [REMOTE ] RCI: Full fetch complete (47834 records). [2025-09-14T19:46:11.609662] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-14T19:46:11.759680] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-14T19:46:11.796488] [WARN ] [VALIDATOR ] RCI: Validation failed - insufficient historical data. Have 135 unique days, need 150 days [2025-09-14T19:46:11.798017] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:46:11.798077] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:46:11.798127] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-14T19:46:11.798198] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-09-14T19:46:11.798245] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-09-14T19:46:11.798295] [DEBUG] [LOCAL ] RCI: No derivative data file found to delete. [2025-09-14T19:46:11.798399] [INFO ] [MAIN ] Update Progress: 1779/2370 symbols completed. RCI took 24.9s. Estimated remaining: 1h 2m 47s. Rate: 9.4 symbols/min [2025-09-14T19:46:11.979623] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:46:12.004218] [DEBUG] [LOCAL ] RDDT: Loaded 24157 existing records from primary storage. [2025-09-14T19:46:12.004385] [INFO ] [MAIN ] RDDT: Loaded 24157 existing records. [2025-09-14T19:46:12.180931] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:46:12.181183] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-14T19:46:12.181241] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-14T19:46:12.181984] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-14T19:46:12.182046] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-14T19:46:12.477467] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T19:46:12.547623] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:46:12.563930] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-14T19:46:12.584440] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T19:46:13.358838] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-14T19:46:14.158903] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-14T19:46:14.819627] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-14T19:46:14.871453] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:46:14.873292] [INFO ] [REMOTE ] RCS: Full fetch complete (12780 records). [2025-09-14T19:46:14.873379] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-14T19:46:14.964027] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-14T19:46:15.263862] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-14T19:46:15.264070] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-14T19:46:15.264468] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-14T19:46:15.264527] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-14T19:46:15.265433] [DEBUG] [LOCAL ] RCS: Trimmed 12780 records to 8525 (keeping 150 days of data) [2025-09-14T19:46:15.335190] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T19:46:15.359557] [DEBUG] [LOCAL ] RCS: Primary data saved (8525 records). [2025-09-14T19:46:15.359785] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-14T19:46:15.359912] [INFO ] [MAIN ] Update Progress: 1780/2370 symbols completed. RCS took 20.6s. Estimated remaining: 1h 2m 40s. Rate: 9.4 symbols/min [2025-09-14T19:46:15.541510] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:46:15.561151] [DEBUG] [LOCAL ] RDN: Loaded 19315 existing records from primary storage. [2025-09-14T19:46:15.561319] [INFO ] [MAIN ] RDN: Loaded 19315 existing records. [2025-09-14T19:46:15.738845] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:46:15.739128] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-14T19:46:15.739190] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-14T19:46:15.739928] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-14T19:46:15.739996] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-14T19:46:15.770897] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-14T19:46:16.097822] [INFO ] [REMOTE ] RDN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:46:16.558878] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-14T19:46:17.236539] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:46:17.241692] [INFO ] [REMOTE ] RC: Full fetch complete (53388 records). [2025-09-14T19:46:17.241836] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-14T19:46:17.361773] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-14T19:46:17.657823] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-14T19:46:17.658269] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-14T19:46:17.659660] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-14T19:46:17.659817] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-14T19:46:17.661952] [DEBUG] [LOCAL ] RC: Trimmed 53388 records to 36469 (keeping 150 days of data) [2025-09-14T19:46:17.690866] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T19:46:17.830290] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-14T19:46:17.987523] [DEBUG] [LOCAL ] RC: Primary data saved (36469 records). [2025-09-14T19:46:17.987733] [INFO ] [MAIN ] RC: Full history saved. [2025-09-14T19:46:17.987842] [INFO ] [MAIN ] Update Progress: 1781/2370 symbols completed. RC took 52.5s. Estimated remaining: 1h 2m 32s. Rate: 9.4 symbols/min [2025-09-14T19:46:18.164959] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-14T19:46:18.169138] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:46:18.200382] [DEBUG] [LOCAL ] RDW: Loaded 23919 existing records from primary storage. [2025-09-14T19:46:18.200613] [INFO ] [MAIN ] RDW: Loaded 23919 existing records. [2025-09-14T19:46:18.379926] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:46:18.380281] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-14T19:46:18.380379] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-14T19:46:18.381305] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-14T19:46:18.381378] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-14T19:46:18.744027] [INFO ] [REMOTE ] RDW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:46:18.958813] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-14T19:46:19.438196] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-14T19:46:19.758844] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-14T19:46:20.250415] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T19:46:20.506685] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T19:46:20.558894] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-14T19:46:21.358879] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-14T19:46:21.440008] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T19:46:22.059013] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T19:46:22.158912] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-14T19:46:22.958946] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-14T19:46:23.423497] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T19:46:23.758933] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-14T19:46:24.357494] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T19:46:24.524583] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-14T19:46:24.558861] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-14T19:46:25.358939] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-14T19:46:25.690904] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T19:46:26.043053] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T19:46:26.158944] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-14T19:46:26.958942] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-14T19:46:27.007087] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T19:46:27.722134] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T19:46:27.758921] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-14T19:46:28.439847] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:46:28.445070] [INFO ] [REMOTE ] RCUS: Full fetch complete (46768 records). [2025-09-14T19:46:28.445336] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-14T19:46:28.563968] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-14T19:46:28.849090] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-14T19:46:28.849242] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-14T19:46:28.850501] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-14T19:46:28.850573] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-14T19:46:28.851993] [DEBUG] [LOCAL ] RCUS: Trimmed 46768 records to 32146 (keeping 150 days of data) [2025-09-14T19:46:29.057197] [DEBUG] [LOCAL ] RCUS: Primary data saved (32146 records). [2025-09-14T19:46:29.057450] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-14T19:46:29.057591] [INFO ] [MAIN ] Update Progress: 1782/2370 symbols completed. RCUS took 19.1s. Estimated remaining: 1h 2m 28s. Rate: 9.4 symbols/min [2025-09-14T19:46:29.239260] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:46:29.275955] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-14T19:46:29.304572] [DEBUG] [LOCAL ] RDY: Loaded 20557 existing records from primary storage. [2025-09-14T19:46:29.304829] [INFO ] [MAIN ] RDY: Loaded 20557 existing records. [2025-09-14T19:46:29.365587] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-14T19:46:29.503819] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:46:29.504152] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-14T19:46:29.504217] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-14T19:46:29.505261] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-14T19:46:29.505344] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-14T19:46:29.889428] [INFO ] [REMOTE ] RDY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:46:30.158922] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-14T19:46:30.431997] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T19:46:30.958927] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-14T19:46:31.432785] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T19:46:31.758928] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-14T19:46:31.826295] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T19:46:32.558875] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-14T19:46:32.935453] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T19:46:33.358923] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-14T19:46:34.158921] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-14T19:46:34.353872] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T19:46:34.470500] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-14T19:46:34.958882] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-14T19:46:35.285573] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T19:46:35.350332] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T19:46:35.758865] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-14T19:46:36.558894] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-14T19:46:37.133181] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-14T19:46:37.139275] [INFO ] [REMOTE ] RDDT: Full fetch complete (58461 records). [2025-09-14T19:46:37.139458] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-14T19:46:37.374321] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-14T19:46:37.542013] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-14T19:46:37.542307] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-14T19:46:37.543581] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-14T19:46:37.543668] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-14T19:46:37.545079] [DEBUG] [LOCAL ] RDDT: Trimmed 58461 records to 40527 (keeping 150 days of data) [2025-09-14T19:46:37.819893] [DEBUG] [LOCAL ] RDDT: Primary data saved (40527 records). [2025-09-14T19:46:37.820292] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-14T19:46:37.820413] [INFO ] [MAIN ] Update Progress: 1783/2370 symbols completed. RDDT took 26.0s. Estimated remaining: 1h 2m 22s. Rate: 9.4 symbols/min [2025-09-14T19:46:38.007146] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:46:38.035348] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T19:46:38.068716] [DEBUG] [LOCAL ] RELX: Loaded 22267 existing records from primary storage. [2025-09-14T19:46:38.068955] [INFO ] [MAIN ] RELX: Loaded 22267 existing records. [2025-09-14T19:46:38.160883] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-14T19:46:38.259150] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:46:38.259537] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-14T19:46:38.259608] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-14T19:46:38.260668] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-14T19:46:38.260781] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-14T19:46:38.627481] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-14T19:46:38.744604] [INFO ] [REMOTE ] RELX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:46:38.958932] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-14T19:46:39.145116] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:46:39.758889] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-14T19:46:40.111569] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T19:46:40.543766] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T19:46:40.558776] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-14T19:46:41.358879] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-14T19:46:42.057465] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-14T19:46:42.132862] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T19:46:42.158920] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-14T19:46:42.920496] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T19:46:42.958786] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-14T19:46:43.758882] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-14T19:46:43.902758] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T19:46:44.436746] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T19:46:44.443091] [INFO ] [REMOTE ] RDW: Full fetch complete (56508 records). [2025-09-14T19:46:44.443294] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-14T19:46:44.559383] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-14T19:46:44.838756] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-14T19:46:44.838871] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-14T19:46:44.839957] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-14T19:46:44.840022] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-14T19:46:44.841457] [DEBUG] [LOCAL ] RDW: Trimmed 56508 records to 39148 (keeping 150 days of data) [2025-09-14T19:46:45.084344] [DEBUG] [LOCAL ] RDW: Primary data saved (39148 records). [2025-09-14T19:46:45.084569] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-14T19:46:45.084717] [INFO ] [MAIN ] Update Progress: 1784/2370 symbols completed. RDW took 27.1s. Estimated remaining: 1h 2m 16s. Rate: 9.4 symbols/min [2025-09-14T19:46:45.253312] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:46:45.273805] [DEBUG] [LOCAL ] RERE: Loaded 21120 existing records from primary storage. [2025-09-14T19:46:45.274033] [INFO ] [MAIN ] RERE: Loaded 21120 existing records. [2025-09-14T19:46:45.364772] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-14T19:46:45.453265] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:46:45.453656] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-14T19:46:45.453773] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-14T19:46:45.454480] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-14T19:46:45.454548] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-14T19:46:45.837796] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-14T19:46:45.842920] [INFO ] [REMOTE ] RERE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:46:46.134380] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:46:46.138576] [INFO ] [REMOTE ] RDN: Full fetch complete (49586 records). [2025-09-14T19:46:46.138732] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-14T19:46:46.169873] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-14T19:46:46.523599] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-14T19:46:46.523935] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-14T19:46:46.525162] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-14T19:46:46.525248] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-14T19:46:46.536915] [DEBUG] [LOCAL ] RDN: Trimmed 49586 records to 33040 (keeping 150 days of data) [2025-09-14T19:46:46.559694] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T19:46:46.778932] [DEBUG] [LOCAL ] RDN: Primary data saved (33040 records). [2025-09-14T19:46:46.779106] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-14T19:46:46.779225] [INFO ] [MAIN ] Update Progress: 1785/2370 symbols completed. RDN took 31.4s. Estimated remaining: 1h 2m 8s. Rate: 9.4 symbols/min [2025-09-14T19:46:46.947739] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:46:46.958829] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-14T19:46:46.969499] [DEBUG] [LOCAL ] RES: Loaded 21236 existing records from primary storage. [2025-09-14T19:46:46.969630] [INFO ] [MAIN ] RES: Loaded 21236 existing records. [2025-09-14T19:46:47.151012] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:46:47.151315] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-14T19:46:47.151393] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-14T19:46:47.152111] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-14T19:46:47.152183] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-14T19:46:47.515549] [INFO ] [REMOTE ] RES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:46:47.703271] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T19:46:47.758798] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-14T19:46:48.558860] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-14T19:46:48.816529] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T19:46:48.940104] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T19:46:49.358846] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-14T19:46:50.082225] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T19:46:50.158893] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-14T19:46:50.958849] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-14T19:46:51.135965] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T19:46:51.706804] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T19:46:51.758839] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-14T19:46:52.558836] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-14T19:46:52.818836] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T19:46:53.358836] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-14T19:46:53.550817] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T19:46:53.966813] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T19:46:54.158902] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-14T19:46:54.884379] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T19:46:54.958965] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-14T19:46:55.101501] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T19:46:55.758885] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-14T19:46:56.522582] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T19:46:56.558829] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-14T19:46:57.358886] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-14T19:46:57.510747] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T19:46:58.158847] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-14T19:46:58.227616] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T19:46:58.958933] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-14T19:46:59.130048] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:46:59.447098] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T19:46:59.451790] [INFO ] [REMOTE ] RDY: Full fetch complete (51586 records). [2025-09-14T19:46:59.451931] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-14T19:46:59.764024] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-14T19:46:59.847092] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-14T19:46:59.847215] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-14T19:46:59.848357] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-14T19:46:59.848442] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-14T19:46:59.850219] [DEBUG] [LOCAL ] RDY: Trimmed 51586 records to 35140 (keeping 150 days of data) [2025-09-14T19:47:00.078404] [DEBUG] [LOCAL ] RDY: Primary data saved (35140 records). [2025-09-14T19:47:00.078607] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-14T19:47:00.078748] [INFO ] [MAIN ] Update Progress: 1786/2370 symbols completed. RDY took 31.0s. Estimated remaining: 1h 2m 4s. Rate: 9.4 symbols/min [2025-09-14T19:47:00.256932] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:00.276083] [DEBUG] [LOCAL ] REVG: Loaded 17978 existing records from primary storage. [2025-09-14T19:47:00.276266] [INFO ] [MAIN ] REVG: Loaded 17978 existing records. [2025-09-14T19:47:00.465747] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:00.479466] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-14T19:47:00.480249] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-14T19:47:00.481011] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T19:47:00.485934] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-14T19:47:00.486504] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-14T19:47:00.530993] [INFO ] [REMOTE ] RELX: Full fetch complete (51528 records). [2025-09-14T19:47:00.564021] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-14T19:47:00.575543] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-14T19:47:01.194462] [INFO ] [REMOTE ] REVG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:01.266598] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-14T19:47:01.266764] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-14T19:47:01.267877] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-14T19:47:01.267943] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-14T19:47:01.269383] [DEBUG] [LOCAL ] RELX: Trimmed 51528 records to 36245 (keeping 150 days of data) [2025-09-14T19:47:01.361463] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-14T19:47:01.516304] [DEBUG] [LOCAL ] RELX: Primary data saved (36245 records). [2025-09-14T19:47:01.516492] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-14T19:47:01.516602] [INFO ] [MAIN ] Update Progress: 1787/2370 symbols completed. RELX took 23.7s. Estimated remaining: 1h 1m 56s. Rate: 9.4 symbols/min [2025-09-14T19:47:01.688090] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:01.717674] [DEBUG] [LOCAL ] REX: Loaded 5498 existing records from primary storage. [2025-09-14T19:47:01.728995] [INFO ] [MAIN ] REX: Loaded 5498 existing records. [2025-09-14T19:47:01.827491] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T19:47:01.925487] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:01.925801] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-14T19:47:01.925864] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-14T19:47:01.926184] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-14T19:47:01.926245] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-14T19:47:02.176977] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-14T19:47:02.301949] [INFO ] [REMOTE ] REX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:02.412708] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T19:47:02.941518] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T19:47:02.958792] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-14T19:47:03.708012] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T19:47:03.713092] [INFO ] [REMOTE ] RERE: Full fetch complete (43934 records). [2025-09-14T19:47:03.713219] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-14T19:47:03.767234] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-14T19:47:04.117348] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T19:47:04.117551] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-14T19:47:04.120968] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-14T19:47:04.122006] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-14T19:47:04.122067] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-14T19:47:04.123135] [DEBUG] [LOCAL ] RERE: Trimmed 43934 records to 31030 (keeping 150 days of data) [2025-09-14T19:47:04.298765] [DEBUG] [LOCAL ] RERE: Primary data saved (31030 records). [2025-09-14T19:47:04.298940] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-14T19:47:04.299043] [INFO ] [MAIN ] Update Progress: 1788/2370 symbols completed. RERE took 19.2s. Estimated remaining: 1h 1m 48s. Rate: 9.4 symbols/min [2025-09-14T19:47:04.471505] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:04.494093] [DEBUG] [LOCAL ] REXR: Loaded 23321 existing records from primary storage. [2025-09-14T19:47:04.494265] [INFO ] [MAIN ] REXR: Loaded 23321 existing records. [2025-09-14T19:47:04.564112] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-14T19:47:04.679882] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:04.680129] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-14T19:47:04.680191] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-14T19:47:04.680995] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-14T19:47:04.681057] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-14T19:47:05.039289] [INFO ] [REMOTE ] REXR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:05.302266] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T19:47:05.358784] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-14T19:47:05.659475] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T19:47:06.158880] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-14T19:47:06.958886] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-14T19:47:07.011913] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T19:47:07.758863] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-14T19:47:07.855294] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T19:47:08.211976] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T19:47:08.558863] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-14T19:47:09.218817] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T19:47:09.358877] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-14T19:47:10.158879] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-14T19:47:10.361355] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T19:47:10.406800] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T19:47:10.872233] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:47:10.877274] [INFO ] [REMOTE ] RES: Full fetch complete (51575 records). [2025-09-14T19:47:10.877445] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-14T19:47:10.963973] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-14T19:47:11.265361] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-14T19:47:11.265525] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-14T19:47:11.266758] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-14T19:47:11.266832] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-14T19:47:11.268437] [DEBUG] [LOCAL ] RES: Trimmed 51575 records to 35403 (keeping 150 days of data) [2025-09-14T19:47:11.490120] [DEBUG] [LOCAL ] RES: Primary data saved (35403 records). [2025-09-14T19:47:11.490319] [INFO ] [MAIN ] RES: Full history saved. [2025-09-14T19:47:11.490459] [INFO ] [MAIN ] Update Progress: 1789/2370 symbols completed. RES took 24.7s. Estimated remaining: 1h 1m 42s. Rate: 9.4 symbols/min [2025-09-14T19:47:11.661917] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:11.682765] [DEBUG] [LOCAL ] REZI: Loaded 21387 existing records from primary storage. [2025-09-14T19:47:11.682956] [INFO ] [MAIN ] REZI: Loaded 21387 existing records. [2025-09-14T19:47:11.764089] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-14T19:47:11.883840] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:11.884102] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-14T19:47:11.884161] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-14T19:47:11.884727] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-14T19:47:11.884798] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-14T19:47:12.242473] [INFO ] [REMOTE ] REZI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:12.558838] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-14T19:47:13.358835] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-14T19:47:13.391756] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T19:47:13.433408] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-14T19:47:14.112562] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T19:47:14.158878] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-14T19:47:14.405536] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T19:47:14.958883] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-14T19:47:15.758897] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-14T19:47:15.807545] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T19:47:16.558851] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-14T19:47:16.636127] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T19:47:16.731133] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T19:47:17.358907] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-14T19:47:18.158875] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-14T19:47:18.386771] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T19:47:18.958852] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-14T19:47:19.119240] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T19:47:19.301298] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T19:47:19.758869] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-14T19:47:20.558946] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-14T19:47:21.015519] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T19:47:21.199097] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T19:47:21.317484] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T19:47:21.358798] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-14T19:47:22.158892] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-14T19:47:22.324930] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T19:47:22.958856] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-14T19:47:23.430591] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T19:47:23.432783] [INFO ] [REMOTE ] REX: Full fetch complete (14881 records). [2025-09-14T19:47:23.432917] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-14T19:47:23.763887] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-14T19:47:23.836992] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-14T19:47:23.837209] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-14T19:47:23.837711] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-14T19:47:23.837852] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-14T19:47:23.839347] [DEBUG] [LOCAL ] REX: Trimmed 14881 records to 9452 (keeping 150 days of data) [2025-09-14T19:47:23.918361] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T19:47:23.948342] [DEBUG] [LOCAL ] REX: Primary data saved (9452 records). [2025-09-14T19:47:23.948562] [INFO ] [MAIN ] REX: Full history saved. [2025-09-14T19:47:23.948754] [INFO ] [MAIN ] Update Progress: 1790/2370 symbols completed. REX took 22.4s. Estimated remaining: 1h 1m 38s. Rate: 9.4 symbols/min [2025-09-14T19:47:24.133496] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:24.163551] [DEBUG] [LOCAL ] RF: Loaded 24054 existing records from primary storage. [2025-09-14T19:47:24.163840] [INFO ] [MAIN ] RF: Loaded 24054 existing records. [2025-09-14T19:47:24.356659] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:24.357148] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-14T19:47:24.357224] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-14T19:47:24.358145] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-14T19:47:24.358219] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-14T19:47:24.565477] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-14T19:47:24.739553] [INFO ] [REMOTE ] RF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:25.358855] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-14T19:47:25.699266] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T19:47:25.776377] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T19:47:26.158840] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-14T19:47:26.958888] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-14T19:47:27.216403] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T19:47:27.278513] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T19:47:27.285740] [INFO ] [REMOTE ] REVG: Full fetch complete (44453 records). [2025-09-14T19:47:27.285918] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-14T19:47:27.671043] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-14T19:47:27.671178] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-14T19:47:27.672300] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-14T19:47:27.672371] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-14T19:47:27.675624] [DEBUG] [LOCAL ] REVG: Trimmed 44453 records to 30564 (keeping 150 days of data) [2025-09-14T19:47:27.769499] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-14T19:47:27.877138] [DEBUG] [LOCAL ] REVG: Primary data saved (30564 records). [2025-09-14T19:47:27.877364] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-14T19:47:27.877533] [INFO ] [MAIN ] Update Progress: 1791/2370 symbols completed. REVG took 27.8s. Estimated remaining: 1h 1m 31s. Rate: 9.4 symbols/min [2025-09-14T19:47:28.055146] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:28.063199] [DEBUG] [LOCAL ] RFI: Loaded 5026 existing records from primary storage. [2025-09-14T19:47:28.063375] [INFO ] [MAIN ] RFI: Loaded 5026 existing records. [2025-09-14T19:47:28.242878] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:28.243224] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-14T19:47:28.243288] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-14T19:47:28.243588] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-14T19:47:28.243683] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-14T19:47:28.559020] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-14T19:47:28.616437] [INFO ] [REMOTE ] RFI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:28.649322] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T19:47:29.358885] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-14T19:47:29.668863] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T19:47:30.129417] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T19:47:30.158789] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-14T19:47:30.231183] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T19:47:30.866778] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:47:30.872531] [INFO ] [REMOTE ] REZI: Full fetch complete (50265 records). [2025-09-14T19:47:30.872711] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-14T19:47:30.964357] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-14T19:47:31.270997] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-14T19:47:31.271113] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-14T19:47:31.272148] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-14T19:47:31.272207] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-14T19:47:31.273343] [DEBUG] [LOCAL ] REZI: Trimmed 50265 records to 35073 (keeping 150 days of data) [2025-09-14T19:47:31.497724] [DEBUG] [LOCAL ] REZI: Primary data saved (35073 records). [2025-09-14T19:47:31.497939] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-14T19:47:31.498091] [INFO ] [MAIN ] Update Progress: 1792/2370 symbols completed. REZI took 20.0s. Estimated remaining: 1h 1m 23s. Rate: 9.4 symbols/min [2025-09-14T19:47:31.669233] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:31.676540] [DEBUG] [LOCAL ] RFL: Loaded 5129 existing records from primary storage. [2025-09-14T19:47:31.676700] [INFO ] [MAIN ] RFL: Loaded 5129 existing records. [2025-09-14T19:47:31.767546] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-14T19:47:31.864966] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:31.865269] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-14T19:47:31.865333] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-14T19:47:31.865689] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-14T19:47:31.865752] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-14T19:47:32.236179] [INFO ] [REMOTE ] RFL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:32.558851] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-14T19:47:32.630931] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T19:47:32.691741] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:47:33.332760] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T19:47:33.358806] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-14T19:47:33.992226] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T19:47:34.158904] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-14T19:47:34.751179] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T19:47:34.958900] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-14T19:47:35.758868] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-14T19:47:36.558782] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-14T19:47:36.576532] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T19:47:36.582104] [INFO ] [REMOTE ] REXR: Full fetch complete (56413 records). [2025-09-14T19:47:36.582236] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-14T19:47:36.974301] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-14T19:47:36.974503] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-14T19:47:36.975691] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-14T19:47:36.975833] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-14T19:47:36.977824] [DEBUG] [LOCAL ] REXR: Trimmed 56413 records to 39194 (keeping 150 days of data) [2025-09-14T19:47:37.122866] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T19:47:37.316573] [DEBUG] [LOCAL ] REXR: Primary data saved (39194 records). [2025-09-14T19:47:37.316824] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-14T19:47:37.316958] [INFO ] [MAIN ] Update Progress: 1793/2370 symbols completed. REXR took 33.0s. Estimated remaining: 1h 1m 17s. Rate: 9.4 symbols/min [2025-09-14T19:47:37.368435] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-14T19:47:37.564868] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:37.576818] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T19:47:37.587235] [DEBUG] [LOCAL ] RFM: Loaded 1872 existing records from primary storage. [2025-09-14T19:47:37.587455] [INFO ] [MAIN ] RFM: Loaded 1872 existing records. [2025-09-14T19:47:37.890494] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:37.890947] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-14T19:47:37.891043] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-14T19:47:37.891369] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-14T19:47:37.892960] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-14T19:47:38.167363] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-14T19:47:38.358410] [INFO ] [REMOTE ] RFM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:38.368325] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T19:47:38.958840] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-14T19:47:39.399238] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T19:47:39.599076] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-14T19:47:39.758867] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-14T19:47:40.337785] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T19:47:40.558849] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-14T19:47:41.175443] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T19:47:41.358825] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-14T19:47:42.158821] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-14T19:47:42.166372] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T19:47:42.958868] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-14T19:47:43.758857] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-14T19:47:43.806341] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T19:47:44.106467] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T19:47:44.539488] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T19:47:44.558819] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-14T19:47:45.358854] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-14T19:47:45.458669] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T19:47:46.158853] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-14T19:47:46.331807] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T19:47:46.958843] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-14T19:47:47.532527] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T19:47:47.758878] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-14T19:47:47.900684] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T19:47:48.500857] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:47:48.502589] [INFO ] [REMOTE ] RFI: Full fetch complete (11489 records). [2025-09-14T19:47:48.502694] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-14T19:47:48.564552] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-14T19:47:48.868710] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-14T19:47:48.868825] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-14T19:47:48.869136] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-14T19:47:48.869190] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-14T19:47:48.869734] [DEBUG] [LOCAL ] RFI: Trimmed 11489 records to 7764 (keeping 150 days of data) [2025-09-14T19:47:48.919243] [DEBUG] [LOCAL ] RFI: Primary data saved (7764 records). [2025-09-14T19:47:48.919426] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-14T19:47:48.919533] [INFO ] [MAIN ] Update Progress: 1794/2370 symbols completed. RFI took 21.0s. Estimated remaining: 1h 1m 12s. Rate: 9.4 symbols/min [2025-09-14T19:47:49.092363] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:49.098182] [DEBUG] [LOCAL ] RFMZ: Loaded 3495 existing records from primary storage. [2025-09-14T19:47:49.098298] [INFO ] [MAIN ] RFMZ: Loaded 3495 existing records. [2025-09-14T19:47:49.322570] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:49.322894] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T19:47:49.323853] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-14T19:47:49.325700] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-14T19:47:49.326066] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-14T19:47:49.326128] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-14T19:47:49.363934] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-14T19:47:49.709397] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:50.051716] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T19:47:50.158794] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-14T19:47:50.725990] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T19:47:50.958844] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-14T19:47:51.481137] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T19:47:51.482449] [INFO ] [REMOTE ] RFM: Full fetch complete (4168 records). [2025-09-14T19:47:51.482540] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-14T19:47:51.764014] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-14T19:47:51.863494] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-14T19:47:51.863681] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-14T19:47:51.863961] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-14T19:47:51.864018] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-14T19:47:51.865061] [DEBUG] [LOCAL ] RFM: Trimmed 4168 records to 2930 (keeping 150 days of data) [2025-09-14T19:47:51.883902] [DEBUG] [LOCAL ] RFM: Primary data saved (2930 records). [2025-09-14T19:47:51.884007] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-14T19:47:51.884127] [INFO ] [MAIN ] Update Progress: 1795/2370 symbols completed. RFM took 14.6s. Estimated remaining: 1h 1m 5s. Rate: 9.4 symbols/min [2025-09-14T19:47:52.051933] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:52.066539] [DEBUG] [LOCAL ] RGA: Loaded 12289 existing records from primary storage. [2025-09-14T19:47:52.066744] [INFO ] [MAIN ] RGA: Loaded 12289 existing records. [2025-09-14T19:47:52.249032] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:52.249302] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-14T19:47:52.249361] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-14T19:47:52.249920] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-14T19:47:52.249998] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-14T19:47:52.567313] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-14T19:47:52.606289] [INFO ] [REMOTE ] RGA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:53.363167] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-14T19:47:53.364366] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T19:47:53.498354] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T19:47:53.779523] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-14T19:47:54.158853] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-14T19:47:54.958866] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-14T19:47:55.666178] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T19:47:55.758793] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-14T19:47:55.766407] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:47:56.558872] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-14T19:47:57.358873] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-14T19:47:57.397076] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T19:47:57.734661] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T19:47:58.158872] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-14T19:47:58.252276] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:47:58.254443] [INFO ] [REMOTE ] RFL: Full fetch complete (10300 records). [2025-09-14T19:47:58.254536] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-14T19:47:58.619795] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-14T19:47:58.619914] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-14T19:47:58.620244] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-14T19:47:58.620296] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-14T19:47:58.620841] [DEBUG] [LOCAL ] RFL: Trimmed 10300 records to 8876 (keeping 150 days of data) [2025-09-14T19:47:58.674684] [DEBUG] [LOCAL ] RFL: Primary data saved (8876 records). [2025-09-14T19:47:58.674888] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-14T19:47:58.674994] [INFO ] [MAIN ] Update Progress: 1796/2370 symbols completed. RFL took 27.2s. Estimated remaining: 1h 0m 58s. Rate: 9.4 symbols/min [2025-09-14T19:47:58.848933] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:47:58.859233] [DEBUG] [LOCAL ] RGR: Loaded 9044 existing records from primary storage. [2025-09-14T19:47:58.859378] [INFO ] [MAIN ] RGR: Loaded 9044 existing records. [2025-09-14T19:47:58.960262] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-14T19:47:59.047692] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:47:59.019796] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T19:47:59.050872] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-14T19:47:59.051743] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-14T19:47:59.052137] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-14T19:47:59.052204] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-14T19:47:59.423932] [INFO ] [REMOTE ] RGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:47:59.758842] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-14T19:48:00.558796] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-14T19:48:00.917716] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T19:48:01.032895] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-14T19:48:01.358838] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-14T19:48:02.158873] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-14T19:48:02.435155] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T19:48:02.958889] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-14T19:48:03.758901] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-14T19:48:05.189337] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (3.03 seconds). [2025-09-14T19:48:05.208079] [INFO ] [REMOTE ] RF: Full fetch complete (58305 records). [2025-09-14T19:48:05.209435] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-14T19:48:05.210669] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (3.85 seconds). [2025-09-14T19:48:05.234574] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-14T19:48:05.227531] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-14T19:48:05.374386] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-14T19:48:05.621913] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-14T19:48:05.622136] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-14T19:48:05.623353] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-14T19:48:05.623447] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-14T19:48:05.643505] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T19:48:05.650679] [DEBUG] [LOCAL ] RF: Trimmed 58305 records to 40373 (keeping 150 days of data) [2025-09-14T19:48:05.915028] [DEBUG] [LOCAL ] RF: Primary data saved (40373 records). [2025-09-14T19:48:05.915202] [INFO ] [MAIN ] RF: Full history saved. [2025-09-14T19:48:05.915302] [INFO ] [MAIN ] Update Progress: 1797/2370 symbols completed. RF took 42.0s. Estimated remaining: 1h 0m 52s. Rate: 9.4 symbols/min [2025-09-14T19:48:06.071276] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T19:48:06.158835] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-14T19:48:06.482156] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T19:48:06.658621] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T19:48:06.958852] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-14T19:48:07.758844] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-14T19:48:08.238313] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T19:48:08.558870] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-14T19:48:09.255958] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T19:48:09.358839] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-14T19:48:09.706675] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T19:48:10.158903] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-14T19:48:10.542422] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T19:48:10.958939] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-14T19:48:11.299052] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T19:48:11.528849] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T19:48:11.530457] [INFO ] [REMOTE ] RFMZ: Full fetch complete (8946 records). [2025-09-14T19:48:11.530546] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-14T19:48:11.767578] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-14T19:48:11.893423] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-14T19:48:11.893529] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-14T19:48:11.893806] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-14T19:48:11.893862] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-14T19:48:11.894329] [DEBUG] [LOCAL ] RFMZ: Trimmed 8946 records to 6214 (keeping 150 days of data) [2025-09-14T19:48:11.931670] [DEBUG] [LOCAL ] RFMZ: Primary data saved (6214 records). [2025-09-14T19:48:11.931797] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-14T19:48:11.931893] [INFO ] [MAIN ] Update Progress: 1798/2370 symbols completed. RFMZ took 23.0s. Estimated remaining: 1h 0m 46s. Rate: 9.4 symbols/min [2025-09-14T19:48:12.558846] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-14T19:48:12.988843] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T19:48:13.358836] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-14T19:48:13.867920] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T19:48:13.923788] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:48:13.926273] [INFO ] [REMOTE ] RGR: Full fetch complete (21574 records). [2025-09-14T19:48:13.926362] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-14T19:48:14.168234] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-14T19:48:14.290512] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-14T19:48:14.290623] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-14T19:48:14.291179] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-14T19:48:14.291246] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-14T19:48:14.291944] [DEBUG] [LOCAL ] RGR: Trimmed 21574 records to 15444 (keeping 150 days of data) [2025-09-14T19:48:14.386851] [DEBUG] [LOCAL ] RGR: Primary data saved (15444 records). [2025-09-14T19:48:14.387041] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-14T19:48:14.387174] [INFO ] [MAIN ] Update Progress: 1799/2370 symbols completed. RGR took 15.7s. Estimated remaining: 1h 0m 38s. Rate: 9.4 symbols/min [2025-09-14T19:48:15.964222] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T19:48:15.971268] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-14T19:48:17.353726] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T19:48:17.356842] [INFO ] [REMOTE ] RGA: Full fetch complete (33767 records). [2025-09-14T19:48:17.356962] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-14T19:48:17.760442] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-14T19:48:17.760672] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-14T19:48:17.761456] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-14T19:48:17.761514] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-14T19:48:17.762659] [DEBUG] [LOCAL ] RGA: Trimmed 33767 records to 21448 (keeping 150 days of data) [2025-09-14T19:48:17.902705] [DEBUG] [LOCAL ] RGA: Primary data saved (21448 records). [2025-09-14T19:48:17.902878] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-14T19:48:17.902979] [INFO ] [MAIN ] Update Progress: 1800/2370 symbols completed. RGA took 26.0s. Estimated remaining: 1h 0m 31s. Rate: 9.4 symbols/min [2025-09-14T19:48:18.549606] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:18.604514] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:18.623256] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:18.641096] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:18.646476] [DEBUG] [LOCAL ] RGT: Loaded 1274 existing records from primary storage. [2025-09-14T19:48:18.646634] [INFO ] [MAIN ] RGT: Loaded 1274 existing records. [2025-09-14T19:48:18.761502] [DEBUG] [LOCAL ] RHP: Loaded 17264 existing records from primary storage. [2025-09-14T19:48:18.783481] [INFO ] [MAIN ] RHP: Loaded 17264 existing records. [2025-09-14T19:48:18.822624] [DEBUG] [LOCAL ] RHI: Loaded 22668 existing records from primary storage. [2025-09-14T19:48:18.932522] [DEBUG] [LOCAL ] RH: Loaded 20916 existing records from primary storage. [2025-09-14T19:48:18.946622] [INFO ] [MAIN ] RH: Loaded 20916 existing records. [2025-09-14T19:48:18.917070] [INFO ] [MAIN ] RHI: Loaded 22668 existing records. [2025-09-14T19:48:18.917005] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:18.996565] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-14T19:48:19.086521] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-14T19:48:19.133590] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-14T19:48:19.159557] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-14T19:48:19.380827] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:19.495040] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:19.445550] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-14T19:48:19.514749] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-14T19:48:19.600481] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:19.626344] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-14T19:48:19.600703] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-14T19:48:19.652357] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-14T19:48:19.652258] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-14T19:48:19.654213] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-14T19:48:19.674934] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-14T19:48:19.787834] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-14T19:48:19.773352] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-14T19:48:19.830242] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-14T19:48:19.840678] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-14T19:48:20.092905] [INFO ] [REMOTE ] RGT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:20.124268] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-14T19:48:20.769809] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T19:48:20.830517] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-14T19:48:20.834855] [INFO ] [REMOTE ] RHP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:20.848880] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-14T19:48:20.995597] [INFO ] [REMOTE ] RH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:21.023275] [INFO ] [REMOTE ] RHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:21.023950] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-14T19:48:21.024446] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-14T19:48:21.460521] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T19:48:21.462054] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-14T19:48:22.074250] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T19:48:22.075868] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-14T19:48:22.405144] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:48:22.413958] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-14T19:48:22.480892] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T19:48:22.488437] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-14T19:48:22.625868] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T19:48:22.697141] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T19:48:22.958837] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-14T19:48:23.310372] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-14T19:48:23.758851] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-14T19:48:23.937260] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T19:48:24.082828] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T19:48:24.135885] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-14T19:48:24.558882] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-14T19:48:25.358876] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-14T19:48:26.158829] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-14T19:48:26.355174] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T19:48:26.958915] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-14T19:48:27.559765] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-14T19:48:27.764777] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-14T19:48:27.783173] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T19:48:28.187515] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-14T19:48:28.558815] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-14T19:48:28.622733] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T19:48:29.358823] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-14T19:48:29.995973] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T19:48:30.158924] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-14T19:48:30.586890] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:48:30.588858] [INFO ] [REMOTE ] RGT: Full fetch complete (3049 records). [2025-09-14T19:48:30.588994] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-14T19:48:30.972674] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-14T19:48:31.020170] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-14T19:48:31.020298] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-14T19:48:31.020469] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-14T19:48:31.020548] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-14T19:48:31.021195] [DEBUG] [LOCAL ] RGT: Trimmed 3049 records to 2040 (keeping 150 days of data) [2025-09-14T19:48:31.036213] [DEBUG] [LOCAL ] RGT: Primary data saved (2040 records). [2025-09-14T19:48:31.036436] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-14T19:48:31.036578] [INFO ] [MAIN ] Update Progress: 1801/2370 symbols completed. RGT took 13.1s. Estimated remaining: 1h 0m 27s. Rate: 9.4 symbols/min [2025-09-14T19:48:31.226683] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:31.261782] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T19:48:31.291414] [DEBUG] [LOCAL ] RIG: Loaded 24102 existing records from primary storage. [2025-09-14T19:48:31.291607] [INFO ] [MAIN ] RIG: Loaded 24102 existing records. [2025-09-14T19:48:31.484583] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:31.484955] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-14T19:48:31.485041] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-14T19:48:31.485851] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-14T19:48:31.485928] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-14T19:48:31.766580] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-14T19:48:31.857658] [INFO ] [REMOTE ] RIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:32.519491] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:48:32.558815] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-14T19:48:33.358859] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-14T19:48:33.858104] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-14T19:48:33.945049] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T19:48:34.158819] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-14T19:48:34.958916] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-14T19:48:35.336347] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-14T19:48:35.758869] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-14T19:48:35.794499] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T19:48:36.558835] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-14T19:48:36.708825] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T19:48:37.358901] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-14T19:48:37.391379] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T19:48:38.158856] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-14T19:48:38.354421] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T19:48:38.958860] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-14T19:48:39.396972] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T19:48:39.616899] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:48:39.622216] [INFO ] [REMOTE ] RH: Full fetch complete (51040 records). [2025-09-14T19:48:39.622394] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-14T19:48:39.781952] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-14T19:48:40.032875] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-14T19:48:40.033117] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-14T19:48:40.034839] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-14T19:48:40.034945] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-14T19:48:40.048063] [DEBUG] [LOCAL ] RH: Trimmed 51040 records to 35612 (keeping 150 days of data) [2025-09-14T19:48:40.071468] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T19:48:40.332740] [DEBUG] [LOCAL ] RH: Primary data saved (35612 records). [2025-09-14T19:48:40.332999] [INFO ] [MAIN ] RH: Full history saved. [2025-09-14T19:48:40.333155] [INFO ] [MAIN ] Update Progress: 1802/2370 symbols completed. RH took 22.4s. Estimated remaining: 1h 0m 21s. Rate: 9.4 symbols/min [2025-09-14T19:48:40.551426] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:40.561491] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-14T19:48:40.569304] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T19:48:40.580738] [INFO ] [REMOTE ] RHP: Full fetch complete (45057 records). [2025-09-14T19:48:40.580996] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-14T19:48:40.697833] [DEBUG] [LOCAL ] RIO: Loaded 23951 existing records from primary storage. [2025-09-14T19:48:40.708836] [INFO ] [MAIN ] RIO: Loaded 23951 existing records. [2025-09-14T19:48:41.113445] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:41.154418] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-14T19:48:41.172866] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-14T19:48:41.187675] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-14T19:48:41.187779] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-14T19:48:41.189207] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-14T19:48:41.189161] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-14T19:48:41.189371] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-14T19:48:41.194611] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-14T19:48:41.294911] [DEBUG] [LOCAL ] RHP: Trimmed 45057 records to 30244 (keeping 150 days of data) [2025-09-14T19:48:41.437356] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-14T19:48:41.760005] [INFO ] [REMOTE ] RIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:41.780589] [DEBUG] [LOCAL ] RHP: Primary data saved (30244 records). [2025-09-14T19:48:41.781571] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-14T19:48:41.781759] [INFO ] [MAIN ] Update Progress: 1803/2370 symbols completed. RHP took 23.9s. Estimated remaining: 1h 0m 13s. Rate: 9.4 symbols/min [2025-09-14T19:48:41.968182] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:41.994187] [DEBUG] [LOCAL ] RITM: Loaded 23662 existing records from primary storage. [2025-09-14T19:48:41.994413] [INFO ] [MAIN ] RITM: Loaded 23662 existing records. [2025-09-14T19:48:42.173802] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-14T19:48:42.179677] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:42.181321] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-14T19:48:42.181407] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-14T19:48:42.182034] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-14T19:48:42.182102] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-14T19:48:42.543047] [INFO ] [REMOTE ] RITM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:42.779959] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T19:48:42.958865] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-14T19:48:43.320044] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T19:48:43.758890] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-14T19:48:44.037747] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T19:48:44.558836] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-14T19:48:45.108525] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T19:48:45.358896] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-14T19:48:45.453522] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T19:48:46.158845] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-14T19:48:46.650356] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T19:48:46.675603] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T19:48:46.681060] [INFO ] [REMOTE ] RHI: Full fetch complete (53443 records). [2025-09-14T19:48:46.681214] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-14T19:48:46.963471] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-14T19:48:47.082555] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-14T19:48:47.082921] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-14T19:48:47.084237] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-14T19:48:47.084425] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-14T19:48:47.086011] [DEBUG] [LOCAL ] RHI: Trimmed 53443 records to 37368 (keeping 150 days of data) [2025-09-14T19:48:47.213596] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T19:48:47.367799] [DEBUG] [LOCAL ] RHI: Primary data saved (37368 records). [2025-09-14T19:48:47.368012] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-14T19:48:47.368141] [INFO ] [MAIN ] Update Progress: 1804/2370 symbols completed. RHI took 29.5s. Estimated remaining: 1h 0m 7s. Rate: 9.4 symbols/min [2025-09-14T19:48:47.536735] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:47.544605] [DEBUG] [LOCAL ] RIV: Loaded 6302 existing records from primary storage. [2025-09-14T19:48:47.544769] [INFO ] [MAIN ] RIV: Loaded 6302 existing records. [2025-09-14T19:48:47.722733] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:47.723031] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-14T19:48:47.723113] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-14T19:48:47.723499] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-14T19:48:47.723563] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-14T19:48:47.765546] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-14T19:48:48.075036] [INFO ] [REMOTE ] RIV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:48.558898] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-14T19:48:49.304931] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T19:48:49.305930] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T19:48:49.358784] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-14T19:48:49.631828] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T19:48:50.160474] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-14T19:48:50.161469] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T19:48:50.958889] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-14T19:48:51.758856] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-14T19:48:51.833396] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T19:48:52.268798] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T19:48:52.558891] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-14T19:48:53.358891] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-14T19:48:53.548672] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T19:48:54.158843] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-14T19:48:54.613987] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T19:48:54.743904] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T19:48:54.958874] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-14T19:48:55.758911] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-14T19:48:55.998650] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T19:48:56.508333] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T19:48:56.567634] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-14T19:48:56.572436] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T19:48:56.579011] [INFO ] [REMOTE ] RIG: Full fetch complete (58352 records). [2025-09-14T19:48:56.579179] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-14T19:48:56.971688] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-14T19:48:56.971817] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-14T19:48:56.973105] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-14T19:48:56.973171] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-14T19:48:56.974634] [DEBUG] [LOCAL ] RIG: Trimmed 58352 records to 40421 (keeping 150 days of data) [2025-09-14T19:48:57.215471] [DEBUG] [LOCAL ] RIG: Primary data saved (40421 records). [2025-09-14T19:48:57.215718] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-14T19:48:57.215854] [INFO ] [MAIN ] Update Progress: 1805/2370 symbols completed. RIG took 26.2s. Estimated remaining: 1h 0m 1s. Rate: 9.4 symbols/min [2025-09-14T19:48:57.363990] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-14T19:48:57.392881] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:48:57.416378] [DEBUG] [LOCAL ] RJF: Loaded 20321 existing records from primary storage. [2025-09-14T19:48:57.416610] [INFO ] [MAIN ] RJF: Loaded 20321 existing records. [2025-09-14T19:48:57.611036] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:48:57.611510] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-14T19:48:57.611584] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-14T19:48:57.612205] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-14T19:48:57.612287] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-14T19:48:58.005350] [INFO ] [REMOTE ] RJF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:48:58.158842] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-14T19:48:58.534720] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T19:48:58.958942] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-14T19:48:59.357381] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T19:48:59.761570] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-14T19:48:59.767599] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T19:49:00.391897] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T19:49:00.558917] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-14T19:49:01.358829] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-14T19:49:01.435300] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-14T19:49:02.158840] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-14T19:49:02.831696] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-14T19:49:02.958889] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-14T19:49:03.055997] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T19:49:03.136543] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T19:49:03.758859] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-14T19:49:04.558919] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-14T19:49:04.959776] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T19:49:05.179780] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T19:49:05.358833] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-14T19:49:05.498781] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T19:49:06.158840] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-14T19:49:06.958860] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-14T19:49:07.407335] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-14T19:49:07.720860] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T19:49:07.758787] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-14T19:49:07.906557] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T19:49:07.909569] [INFO ] [REMOTE ] RIV: Full fetch complete (12264 records). [2025-09-14T19:49:07.909679] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-14T19:49:08.286454] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-14T19:49:08.286567] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-14T19:49:08.287006] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-14T19:49:08.287077] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-14T19:49:08.287624] [DEBUG] [LOCAL ] RIV: Trimmed 12264 records to 8659 (keeping 150 days of data) [2025-09-14T19:49:08.341821] [DEBUG] [LOCAL ] RIV: Primary data saved (8659 records). [2025-09-14T19:49:08.341992] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-14T19:49:08.342148] [INFO ] [MAIN ] Update Progress: 1806/2370 symbols completed. RIV took 21.0s. Estimated remaining: 59m 57s. Rate: 9.4 symbols/min [2025-09-14T19:49:08.525076] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:08.549285] [DEBUG] [LOCAL ] RKT: Loaded 24144 existing records from primary storage. [2025-09-14T19:49:08.549467] [INFO ] [MAIN ] RKT: Loaded 24144 existing records. [2025-09-14T19:49:08.564087] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-14T19:49:08.732370] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:08.732663] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-14T19:49:08.732724] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-14T19:49:08.733499] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-14T19:49:08.733569] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-14T19:49:09.083829] [INFO ] [REMOTE ] RKT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:09.355849] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T19:49:09.361094] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-14T19:49:09.362539] [INFO ] [REMOTE ] RIO: Full fetch complete (58055 records). [2025-09-14T19:49:09.362685] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-14T19:49:09.754810] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-14T19:49:09.754948] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-14T19:49:09.756052] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-14T19:49:09.756116] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-14T19:49:09.757791] [DEBUG] [LOCAL ] RIO: Trimmed 58055 records to 40165 (keeping 150 days of data) [2025-09-14T19:49:10.028686] [DEBUG] [LOCAL ] RIO: Primary data saved (40165 records). [2025-09-14T19:49:10.028899] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-14T19:49:10.029065] [INFO ] [MAIN ] Update Progress: 1807/2370 symbols completed. RIO took 29.7s. Estimated remaining: 59m 49s. Rate: 9.4 symbols/min [2025-09-14T19:49:10.164216] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-14T19:49:10.226226] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:10.277039] [DEBUG] [LOCAL ] RL: Loaded 17351 existing records from primary storage. [2025-09-14T19:49:10.277538] [INFO ] [MAIN ] RL: Loaded 17351 existing records. [2025-09-14T19:49:10.284942] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T19:49:10.493315] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:10.493765] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-14T19:49:10.493856] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-14T19:49:10.494698] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-14T19:49:10.494840] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-14T19:49:10.889396] [INFO ] [REMOTE ] RL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:10.958347] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T19:49:10.966386] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-14T19:49:10.969858] [INFO ] [REMOTE ] RITM: Full fetch complete (57407 records). [2025-09-14T19:49:10.970363] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-14T19:49:11.390609] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-14T19:49:11.390737] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-14T19:49:11.391893] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-14T19:49:11.391952] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-14T19:49:11.395594] [DEBUG] [LOCAL ] RITM: Trimmed 57407 records to 39747 (keeping 150 days of data) [2025-09-14T19:49:11.655886] [DEBUG] [LOCAL ] RITM: Primary data saved (39747 records). [2025-09-14T19:49:11.656082] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-14T19:49:11.656222] [INFO ] [MAIN ] Update Progress: 1808/2370 symbols completed. RITM took 29.9s. Estimated remaining: 59m 41s. Rate: 9.4 symbols/min [2025-09-14T19:49:11.760378] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-14T19:49:11.856416] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:11.875807] [DEBUG] [LOCAL ] RLI: Loaded 16023 existing records from primary storage. [2025-09-14T19:49:11.875988] [INFO ] [MAIN ] RLI: Loaded 16023 existing records. [2025-09-14T19:49:12.052251] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:12.052752] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-14T19:49:12.052830] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-14T19:49:12.053508] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-14T19:49:12.053585] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-14T19:49:12.182300] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-14T19:49:12.453935] [INFO ] [REMOTE ] RLI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:12.487417] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T19:49:12.558858] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-14T19:49:13.360855] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-14T19:49:13.362732] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T19:49:13.742442] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T19:49:14.158875] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-14T19:49:14.958894] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-14T19:49:15.526378] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-14T19:49:15.758901] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-14T19:49:15.998821] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T19:49:16.362058] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T19:49:16.558846] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-14T19:49:17.358830] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-14T19:49:17.475392] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T19:49:18.158855] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-14T19:49:18.347778] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T19:49:18.958857] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-14T19:49:19.370859] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T19:49:19.758837] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-14T19:49:19.831223] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:49:20.219276] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T19:49:20.558874] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-14T19:49:20.903342] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T19:49:21.314676] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:49:21.319370] [INFO ] [REMOTE ] RJF: Full fetch complete (51427 records). [2025-09-14T19:49:21.319525] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-14T19:49:21.364007] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-14T19:49:21.728946] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-14T19:49:21.729057] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-14T19:49:21.730105] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-14T19:49:21.730173] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-14T19:49:21.731375] [DEBUG] [LOCAL ] RJF: Trimmed 51427 records to 34710 (keeping 150 days of data) [2025-09-14T19:49:21.977963] [DEBUG] [LOCAL ] RJF: Primary data saved (34710 records). [2025-09-14T19:49:21.978166] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-14T19:49:21.978325] [INFO ] [MAIN ] Update Progress: 1809/2370 symbols completed. RJF took 24.8s. Estimated remaining: 59m 36s. Rate: 9.4 symbols/min [2025-09-14T19:49:22.151018] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:22.162718] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-14T19:49:22.173184] [DEBUG] [LOCAL ] RLJ: Loaded 20921 existing records from primary storage. [2025-09-14T19:49:22.173338] [INFO ] [MAIN ] RLJ: Loaded 20921 existing records. [2025-09-14T19:49:22.357363] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:22.357663] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-14T19:49:22.357725] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-14T19:49:22.358334] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-14T19:49:22.358411] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-14T19:49:22.921334] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:22.954385] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T19:49:22.959813] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-14T19:49:23.758904] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-14T19:49:24.093696] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T19:49:24.553415] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T19:49:24.561863] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-14T19:49:25.198535] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T19:49:25.358900] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-14T19:49:25.797980] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T19:49:26.158866] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-14T19:49:26.958927] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-14T19:49:27.194459] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T19:49:27.758892] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-14T19:49:28.259515] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-14T19:49:28.558903] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-14T19:49:28.709352] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T19:49:29.016954] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T19:49:29.358870] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-14T19:49:30.042516] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:49:30.047410] [INFO ] [REMOTE ] RL: Full fetch complete (45699 records). [2025-09-14T19:49:30.047585] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-14T19:49:30.163908] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-14T19:49:30.465654] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-14T19:49:30.465834] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-14T19:49:30.467050] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-14T19:49:30.467132] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-14T19:49:30.468836] [DEBUG] [LOCAL ] RL: Trimmed 45699 records to 30364 (keeping 150 days of data) [2025-09-14T19:49:30.683659] [DEBUG] [LOCAL ] RL: Primary data saved (30364 records). [2025-09-14T19:49:30.683898] [INFO ] [MAIN ] RL: Full history saved. [2025-09-14T19:49:30.684030] [INFO ] [MAIN ] Update Progress: 1810/2370 symbols completed. RL took 20.7s. Estimated remaining: 59m 30s. Rate: 9.4 symbols/min [2025-09-14T19:49:30.863757] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:30.898312] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-14T19:49:30.913075] [DEBUG] [LOCAL ] RLTY: Loaded 4945 existing records from primary storage. [2025-09-14T19:49:30.913631] [INFO ] [MAIN ] RLTY: Loaded 4945 existing records. [2025-09-14T19:49:30.969520] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-14T19:49:31.098550] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:31.098905] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-14T19:49:31.098974] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-14T19:49:31.099325] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-14T19:49:31.099387] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-14T19:49:31.459173] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:31.758906] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-14T19:49:31.993114] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T19:49:32.568909] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-14T19:49:32.591338] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T19:49:33.358808] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-14T19:49:33.718704] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T19:49:33.859737] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T19:49:34.158834] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-14T19:49:34.931979] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T19:49:34.958774] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-14T19:49:35.010560] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T19:49:35.758880] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-14T19:49:36.559880] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-14T19:49:36.561476] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T19:49:36.589107] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T19:49:37.358842] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-14T19:49:37.946955] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T19:49:38.158840] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-14T19:49:38.440803] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-14T19:49:38.444596] [INFO ] [REMOTE ] RLI: Full fetch complete (36065 records). [2025-09-14T19:49:38.444715] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-14T19:49:38.828596] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-14T19:49:38.828764] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-14T19:49:38.829606] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-14T19:49:38.829676] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-14T19:49:38.831373] [DEBUG] [LOCAL ] RLI: Trimmed 36065 records to 25165 (keeping 150 days of data) [2025-09-14T19:49:38.858007] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T19:49:38.962360] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-14T19:49:39.047933] [DEBUG] [LOCAL ] RLI: Primary data saved (25165 records). [2025-09-14T19:49:39.048145] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-14T19:49:39.048284] [INFO ] [MAIN ] Update Progress: 1811/2370 symbols completed. RLI took 27.4s. Estimated remaining: 59m 24s. Rate: 9.4 symbols/min [2025-09-14T19:49:39.220569] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:39.240904] [DEBUG] [LOCAL ] RLX: Loaded 21462 existing records from primary storage. [2025-09-14T19:49:39.241066] [INFO ] [MAIN ] RLX: Loaded 21462 existing records. [2025-09-14T19:49:39.427559] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:39.427975] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-14T19:49:39.428044] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-14T19:49:39.428858] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-14T19:49:39.428930] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-14T19:49:39.762921] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-14T19:49:39.846197] [INFO ] [REMOTE ] RLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:39.848712] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T19:49:40.558846] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-14T19:49:41.358842] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-14T19:49:41.461063] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T19:49:41.839737] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-14T19:49:41.845215] [INFO ] [REMOTE ] RKT: Full fetch complete (58271 records). [2025-09-14T19:49:41.845337] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-14T19:49:42.163965] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-14T19:49:42.236051] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-14T19:49:42.236168] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-14T19:49:42.237312] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-14T19:49:42.237373] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-14T19:49:42.238719] [DEBUG] [LOCAL ] RKT: Trimmed 58271 records to 40469 (keeping 150 days of data) [2025-09-14T19:49:42.506372] [DEBUG] [LOCAL ] RKT: Primary data saved (40469 records). [2025-09-14T19:49:42.506547] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-14T19:49:42.506667] [INFO ] [MAIN ] Update Progress: 1812/2370 symbols completed. RKT took 34.2s. Estimated remaining: 59m 17s. Rate: 9.4 symbols/min [2025-09-14T19:49:42.676882] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:42.682000] [DEBUG] [LOCAL ] RM: Loaded 3248 existing records from primary storage. [2025-09-14T19:49:42.682111] [INFO ] [MAIN ] RM: Loaded 3248 existing records. [2025-09-14T19:49:42.858732] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:42.859019] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-14T19:49:42.859082] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-14T19:49:42.859370] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-14T19:49:42.859430] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-14T19:49:42.961109] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-14T19:49:43.218678] [INFO ] [REMOTE ] RM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:43.248826] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T19:49:43.758830] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-14T19:49:43.845260] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T19:49:43.915231] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T19:49:44.558863] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-14T19:49:44.569816] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T19:49:45.358849] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-14T19:49:46.158874] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-14T19:49:46.225219] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T19:49:46.503484] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T19:49:46.958841] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-14T19:49:47.736292] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T19:49:47.748904] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T19:49:47.749061] [INFO ] [REMOTE ] RLJ: Full fetch complete (52235 records). [2025-09-14T19:49:47.751908] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-14T19:49:47.764589] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-14T19:49:48.141385] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-14T19:49:48.141532] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-14T19:49:48.142964] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-14T19:49:48.143030] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-14T19:49:48.144558] [DEBUG] [LOCAL ] RLJ: Trimmed 52235 records to 35839 (keeping 150 days of data) [2025-09-14T19:49:48.366902] [DEBUG] [LOCAL ] RLJ: Primary data saved (35839 records). [2025-09-14T19:49:48.367139] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-14T19:49:48.367263] [INFO ] [MAIN ] Update Progress: 1813/2370 symbols completed. RLJ took 26.4s. Estimated remaining: 59m 11s. Rate: 9.4 symbols/min [2025-09-14T19:49:48.555879] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:48.558827] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-14T19:49:48.570370] [DEBUG] [LOCAL ] RMAX: Loaded 11235 existing records from primary storage. [2025-09-14T19:49:48.570582] [INFO ] [MAIN ] RMAX: Loaded 11235 existing records. [2025-09-14T19:49:48.763563] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:48.764821] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T19:49:48.768308] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-14T19:49:48.768450] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-14T19:49:48.768915] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-14T19:49:48.768984] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-14T19:49:49.122711] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:49.358856] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-14T19:49:49.473088] [DEBUG] [REMOTE ] RM: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-14T19:49:49.473546] [WARN ] [REMOTE ] RM: No data returned for month 2025-06 [2025-09-14T19:49:50.158908] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-14T19:49:50.364052] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T19:49:50.934610] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T19:49:50.958833] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-14T19:49:51.735975] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T19:49:51.737626] [INFO ] [REMOTE ] RLTY: Full fetch complete (12983 records). [2025-09-14T19:49:51.737757] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-14T19:49:51.766774] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-14T19:49:52.099318] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-14T19:49:52.099451] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-14T19:49:52.099913] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-14T19:49:52.099995] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-14T19:49:52.100716] [DEBUG] [LOCAL ] RLTY: Trimmed 12983 records to 8084 (keeping 150 days of data) [2025-09-14T19:49:52.150499] [DEBUG] [LOCAL ] RLTY: Primary data saved (8084 records). [2025-09-14T19:49:52.150722] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-14T19:49:52.150862] [INFO ] [MAIN ] Update Progress: 1814/2370 symbols completed. RLTY took 21.5s. Estimated remaining: 59m 3s. Rate: 9.4 symbols/min [2025-09-14T19:49:52.319193] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:52.338430] [DEBUG] [LOCAL ] RMD: Loaded 18890 existing records from primary storage. [2025-09-14T19:49:52.338595] [INFO ] [MAIN ] RMD: Loaded 18890 existing records. [2025-09-14T19:49:52.516657] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:52.516894] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-14T19:49:52.516955] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-14T19:49:52.517723] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-14T19:49:52.517786] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-14T19:49:52.570662] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-14T19:49:52.879568] [INFO ] [REMOTE ] RMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:52.893772] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:49:53.358846] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-14T19:49:54.158862] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-14T19:49:54.338435] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T19:49:54.885254] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T19:49:54.940580] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T19:49:54.958791] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-14T19:49:55.758915] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-14T19:49:55.786141] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T19:49:56.558786] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-14T19:49:56.877242] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T19:49:57.167908] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T19:49:57.169423] [INFO ] [REMOTE ] RM: Full fetch complete (7430 records). [2025-09-14T19:49:57.169530] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-14T19:49:57.353414] [WARN ] [VALIDATOR ] RM: Validation failed - insufficient historical data. Have 130 unique days, need 150 days [2025-09-14T19:49:57.353791] [FATAL] [MAIN ] RM: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:49:57.353860] [WARN ] [MAIN ] RM: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:49:57.353917] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-14T19:49:57.354003] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-09-14T19:49:57.354056] [INFO ] [LOCAL ] RM: Starting deletion of derivative data. [2025-09-14T19:49:57.354170] [DEBUG] [LOCAL ] RM: No derivative data file found to delete. [2025-09-14T19:49:57.354273] [INFO ] [MAIN ] Update Progress: 1815/2370 symbols completed. RM took 14.8s. Estimated remaining: 58m 57s. Rate: 9.4 symbols/min [2025-09-14T19:49:57.365710] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-14T19:49:57.534103] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:49:57.538961] [DEBUG] [LOCAL ] RMI: Loaded 2386 existing records from primary storage. [2025-09-14T19:49:57.539087] [INFO ] [MAIN ] RMI: Loaded 2386 existing records. [2025-09-14T19:49:57.749801] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:49:57.750413] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-14T19:49:57.750503] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-14T19:49:57.750938] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-14T19:49:57.751007] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-14T19:49:58.121540] [INFO ] [REMOTE ] RMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:49:58.158808] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-14T19:49:58.958889] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-14T19:49:59.193917] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T19:49:59.300407] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T19:49:59.758847] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-14T19:50:00.558877] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-14T19:50:00.651303] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T19:50:01.358842] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-14T19:50:01.417657] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T19:50:01.778480] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T19:50:02.158902] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-14T19:50:02.958885] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-14T19:50:03.608200] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-14T19:50:03.656910] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T19:50:03.698501] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T19:50:03.758803] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-14T19:50:04.558876] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-14T19:50:05.359564] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-14T19:50:05.371457] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T19:50:05.751360] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T19:50:06.158856] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-14T19:50:06.838302] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T19:50:06.958856] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-14T19:50:07.032334] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:50:07.758842] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-14T19:50:08.558867] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-14T19:50:08.783428] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T19:50:09.358841] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-14T19:50:09.445336] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-14T19:50:09.451473] [INFO ] [REMOTE ] RLX: Full fetch complete (52250 records). [2025-09-14T19:50:09.451696] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-14T19:50:09.767835] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T19:50:09.860762] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-14T19:50:09.860869] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-14T19:50:09.861992] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-14T19:50:09.862057] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-14T19:50:09.863309] [DEBUG] [LOCAL ] RLX: Trimmed 52250 records to 35814 (keeping 150 days of data) [2025-09-14T19:50:10.085738] [DEBUG] [LOCAL ] RLX: Primary data saved (35814 records). [2025-09-14T19:50:10.085928] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-14T19:50:10.086047] [INFO ] [MAIN ] Update Progress: 1816/2370 symbols completed. RLX took 31.0s. Estimated remaining: 58m 52s. Rate: 9.4 symbols/min [2025-09-14T19:50:10.164037] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-14T19:50:10.265802] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:50:10.275674] [DEBUG] [LOCAL ] RMM: Loaded 5344 existing records from primary storage. [2025-09-14T19:50:10.275853] [INFO ] [MAIN ] RMM: Loaded 5344 existing records. [2025-09-14T19:50:10.449995] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:50:10.450313] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-14T19:50:10.450379] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-14T19:50:10.450791] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-14T19:50:10.450853] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-14T19:50:10.804536] [INFO ] [REMOTE ] RMM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:50:10.810465] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T19:50:10.958905] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-14T19:50:11.230036] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T19:50:11.574000] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T19:50:11.758900] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-14T19:50:12.452883] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:50:12.457609] [INFO ] [REMOTE ] RMD: Full fetch complete (46333 records). [2025-09-14T19:50:12.457794] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-14T19:50:12.560107] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-14T19:50:12.880378] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-14T19:50:12.880495] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-14T19:50:12.881684] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-14T19:50:12.881782] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-14T19:50:12.883057] [DEBUG] [LOCAL ] RMD: Trimmed 46333 records to 31549 (keeping 150 days of data) [2025-09-14T19:50:13.113997] [DEBUG] [LOCAL ] RMD: Primary data saved (31549 records). [2025-09-14T19:50:13.114216] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-14T19:50:13.114353] [INFO ] [MAIN ] Update Progress: 1817/2370 symbols completed. RMD took 21.0s. Estimated remaining: 58m 45s. Rate: 9.4 symbols/min [2025-09-14T19:50:13.286437] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:50:13.290867] [DEBUG] [LOCAL ] RMMZ: Loaded 2444 existing records from primary storage. [2025-09-14T19:50:13.290972] [INFO ] [MAIN ] RMMZ: Loaded 2444 existing records. [2025-09-14T19:50:13.364038] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-14T19:50:13.476680] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:50:13.476951] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-14T19:50:13.477014] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-14T19:50:13.477286] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-14T19:50:13.477369] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-14T19:50:13.840337] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:50:14.019420] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T19:50:14.158818] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-14T19:50:14.294834] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T19:50:14.712566] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T19:50:14.958897] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-14T19:50:15.599291] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T19:50:15.758922] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-14T19:50:16.558943] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-14T19:50:16.661669] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T19:50:17.201898] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T19:50:17.358845] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-14T19:50:18.158829] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-14T19:50:18.221933] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:50:18.840222] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T19:50:18.958858] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-14T19:50:19.633520] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:50:19.758845] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-14T19:50:20.379903] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T19:50:20.558854] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-14T19:50:21.233541] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T19:50:21.358824] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-14T19:50:22.120797] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T19:50:22.158859] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-14T19:50:22.910072] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T19:50:22.958802] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-14T19:50:23.498864] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T19:50:23.499942] [INFO ] [REMOTE ] RMMZ: Full fetch complete (5077 records). [2025-09-14T19:50:23.500025] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-14T19:50:23.764083] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-14T19:50:23.856161] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-14T19:50:23.856268] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-14T19:50:23.856455] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-14T19:50:23.856510] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-14T19:50:23.856950] [DEBUG] [LOCAL ] RMMZ: Trimmed 5077 records to 3746 (keeping 150 days of data) [2025-09-14T19:50:23.879773] [DEBUG] [LOCAL ] RMMZ: Primary data saved (3746 records). [2025-09-14T19:50:23.879864] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-14T19:50:23.879981] [INFO ] [MAIN ] Update Progress: 1818/2370 symbols completed. RMMZ took 10.8s. Estimated remaining: 58m 40s. Rate: 9.4 symbols/min [2025-09-14T19:50:24.052956] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:50:24.062497] [DEBUG] [LOCAL ] RMT: Loaded 7799 existing records from primary storage. [2025-09-14T19:50:24.062699] [INFO ] [MAIN ] RMT: Loaded 7799 existing records. [2025-09-14T19:50:24.237509] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:50:24.237779] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-14T19:50:24.237850] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-14T19:50:24.238268] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-14T19:50:24.238329] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-14T19:50:24.515793] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T19:50:24.561841] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-14T19:50:24.596459] [INFO ] [REMOTE ] RMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:50:25.358820] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-14T19:50:25.427772] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:50:26.158850] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-14T19:50:26.678353] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T19:50:26.958843] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-14T19:50:27.105926] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T19:50:27.714447] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:50:27.715836] [INFO ] [REMOTE ] RMI: Full fetch complete (4742 records). [2025-09-14T19:50:27.715921] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-14T19:50:27.769077] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-14T19:50:28.081976] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-14T19:50:28.082099] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-14T19:50:28.082273] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-14T19:50:28.082337] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-14T19:50:28.082803] [DEBUG] [LOCAL ] RMI: Trimmed 4742 records to 3564 (keeping 150 days of data) [2025-09-14T19:50:28.104740] [DEBUG] [LOCAL ] RMI: Primary data saved (3564 records). [2025-09-14T19:50:28.104865] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-14T19:50:28.105014] [INFO ] [MAIN ] Update Progress: 1819/2370 symbols completed. RMI took 30.8s. Estimated remaining: 58m 33s. Rate: 9.4 symbols/min [2025-09-14T19:50:28.276742] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:50:28.298236] [DEBUG] [LOCAL ] RNG: Loaded 21837 existing records from primary storage. [2025-09-14T19:50:28.298410] [INFO ] [MAIN ] RNG: Loaded 21837 existing records. [2025-09-14T19:50:28.477191] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:50:28.477419] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-14T19:50:28.477498] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-14T19:50:28.478132] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-14T19:50:28.478202] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-14T19:50:28.568534] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-14T19:50:28.841915] [INFO ] [REMOTE ] RNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:50:28.855685] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:50:29.358795] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-14T19:50:29.623308] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T19:50:29.625836] [INFO ] [REMOTE ] RMAX: Full fetch complete (23119 records). [2025-09-14T19:50:29.625934] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-14T19:50:29.989244] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-14T19:50:29.989358] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-14T19:50:29.989986] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-14T19:50:29.990046] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-14T19:50:29.990765] [DEBUG] [LOCAL ] RMAX: Trimmed 23119 records to 16702 (keeping 150 days of data) [2025-09-14T19:50:30.090976] [DEBUG] [LOCAL ] RMAX: Primary data saved (16702 records). [2025-09-14T19:50:30.091177] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-14T19:50:30.091319] [INFO ] [MAIN ] Update Progress: 1820/2370 symbols completed. RMAX took 41.7s. Estimated remaining: 58m 25s. Rate: 9.4 symbols/min [2025-09-14T19:50:30.166760] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-14T19:50:30.272050] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:50:30.281338] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T19:50:30.293238] [DEBUG] [LOCAL ] RNGR: Loaded 9386 existing records from primary storage. [2025-09-14T19:50:30.293374] [INFO ] [MAIN ] RNGR: Loaded 9386 existing records. [2025-09-14T19:50:30.467308] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:50:30.467604] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-14T19:50:30.467683] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-14T19:50:30.468184] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-14T19:50:30.468247] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-14T19:50:30.822770] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:50:30.958832] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-14T19:50:31.358900] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T19:50:31.758837] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-14T19:50:31.869876] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T19:50:32.558846] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-14T19:50:33.049852] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T19:50:33.358829] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-14T19:50:33.479046] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T19:50:33.481139] [INFO ] [REMOTE ] RMM: Full fetch complete (10835 records). [2025-09-14T19:50:33.481226] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-14T19:50:33.871446] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-14T19:50:33.871567] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-14T19:50:33.871913] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-14T19:50:33.871974] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-14T19:50:33.872589] [DEBUG] [LOCAL ] RMM: Trimmed 10835 records to 7621 (keeping 150 days of data) [2025-09-14T19:50:33.924468] [DEBUG] [LOCAL ] RMM: Primary data saved (7621 records). [2025-09-14T19:50:33.924726] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-14T19:50:33.924864] [INFO ] [MAIN ] Update Progress: 1821/2370 symbols completed. RMM took 23.8s. Estimated remaining: 58m 18s. Rate: 9.4 symbols/min [2025-09-14T19:50:34.102158] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:50:34.112240] [DEBUG] [LOCAL ] RNP: Loaded 7185 existing records from primary storage. [2025-09-14T19:50:34.112437] [INFO ] [MAIN ] RNP: Loaded 7185 existing records. [2025-09-14T19:50:34.169184] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-14T19:50:34.301728] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:50:34.302012] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-14T19:50:34.302075] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-14T19:50:34.302429] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-14T19:50:34.302491] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-14T19:50:34.665681] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T19:50:34.695671] [INFO ] [REMOTE ] RNP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:50:34.958792] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-14T19:50:35.014561] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T19:50:35.696133] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T19:50:35.758868] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-14T19:50:36.558805] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-14T19:50:36.920666] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-14T19:50:37.358845] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-14T19:50:38.140077] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T19:50:38.158789] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-14T19:50:38.189161] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T19:50:38.958852] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-14T19:50:39.758836] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-14T19:50:39.935774] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T19:50:40.026553] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T19:50:40.558800] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-14T19:50:40.874467] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T19:50:41.358837] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-14T19:50:42.158874] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-14T19:50:42.218484] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T19:50:42.220428] [INFO ] [REMOTE ] RMT: Full fetch complete (19170 records). [2025-09-14T19:50:42.220529] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-14T19:50:42.570002] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T19:50:42.663552] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-14T19:50:42.663696] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-14T19:50:42.664293] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-14T19:50:42.664385] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-14T19:50:42.665295] [DEBUG] [LOCAL ] RMT: Trimmed 19170 records to 12915 (keeping 150 days of data) [2025-09-14T19:50:42.749281] [DEBUG] [LOCAL ] RMT: Primary data saved (12915 records). [2025-09-14T19:50:42.749488] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-14T19:50:42.749600] [INFO ] [MAIN ] Update Progress: 1822/2370 symbols completed. RMT took 18.9s. Estimated remaining: 58m 12s. Rate: 9.4 symbols/min [2025-09-14T19:50:42.922500] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:50:42.938593] [DEBUG] [LOCAL ] RNR: Loaded 14275 existing records from primary storage. [2025-09-14T19:50:42.938827] [INFO ] [MAIN ] RNR: Loaded 14275 existing records. [2025-09-14T19:50:42.968567] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-14T19:50:43.121966] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:50:43.122240] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-14T19:50:43.122302] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-14T19:50:43.122806] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-14T19:50:43.122878] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-14T19:50:43.469161] [INFO ] [REMOTE ] RNR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:50:43.489101] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T19:50:43.758841] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-14T19:50:44.105069] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T19:50:44.558915] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-14T19:50:45.314324] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:50:45.358860] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-14T19:50:45.855167] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T19:50:46.158859] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-14T19:50:46.366377] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T19:50:46.958891] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-14T19:50:47.758863] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-14T19:50:47.825996] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T19:50:48.178353] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T19:50:48.558807] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-14T19:50:48.850022] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T19:50:49.358858] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-14T19:50:49.410245] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T19:50:50.158875] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-14T19:50:50.912901] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:50:50.958811] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-14T19:50:51.758884] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-14T19:50:51.793920] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T19:50:52.558816] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-14T19:50:52.595664] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T19:50:52.617843] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T19:50:53.358899] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-14T19:50:53.920470] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T19:50:54.158858] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-14T19:50:54.214300] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T19:50:54.958872] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-14T19:50:54.992069] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T19:50:54.994234] [INFO ] [REMOTE ] RNGR: Full fetch complete (21333 records). [2025-09-14T19:50:54.994374] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-14T19:50:55.373795] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-14T19:50:55.373904] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-14T19:50:55.374403] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-14T19:50:55.374456] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-14T19:50:55.375092] [DEBUG] [LOCAL ] RNGR: Trimmed 21333 records to 15606 (keeping 150 days of data) [2025-09-14T19:50:55.481370] [DEBUG] [LOCAL ] RNGR: Primary data saved (15606 records). [2025-09-14T19:50:55.481562] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-14T19:50:55.481685] [INFO ] [MAIN ] Update Progress: 1823/2370 symbols completed. RNGR took 25.4s. Estimated remaining: 58m 8s. Rate: 9.4 symbols/min [2025-09-14T19:50:55.673328] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:50:55.692095] [DEBUG] [LOCAL ] RNST: Loaded 15657 existing records from primary storage. [2025-09-14T19:50:55.692267] [INFO ] [MAIN ] RNST: Loaded 15657 existing records. [2025-09-14T19:50:55.767365] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-14T19:50:55.885525] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:50:55.885824] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-14T19:50:55.885887] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-14T19:50:55.886436] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-14T19:50:55.886522] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-14T19:50:56.244314] [INFO ] [REMOTE ] RNST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:50:56.558902] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-14T19:50:56.729434] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T19:50:57.286770] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T19:50:57.358786] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-14T19:50:57.679791] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T19:50:58.158888] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-14T19:50:58.909758] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T19:50:58.958848] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-14T19:50:59.670986] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T19:50:59.732942] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T19:50:59.758775] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-14T19:51:00.558903] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-14T19:51:00.595548] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T19:51:00.597849] [INFO ] [REMOTE ] RNP: Full fetch complete (17328 records). [2025-09-14T19:51:00.597992] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-14T19:51:00.973132] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-14T19:51:00.973241] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-14T19:51:00.973675] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-14T19:51:00.973760] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-14T19:51:00.975617] [DEBUG] [LOCAL ] RNP: Trimmed 17328 records to 11789 (keeping 150 days of data) [2025-09-14T19:51:01.071328] [DEBUG] [LOCAL ] RNP: Primary data saved (11789 records). [2025-09-14T19:51:01.071529] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-14T19:51:01.071711] [INFO ] [MAIN ] Update Progress: 1824/2370 symbols completed. RNP took 27.1s. Estimated remaining: 58m 1s. Rate: 9.4 symbols/min [2025-09-14T19:51:01.243348] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:01.254948] [DEBUG] [LOCAL ] ROG: Loaded 9454 existing records from primary storage. [2025-09-14T19:51:01.255091] [INFO ] [MAIN ] ROG: Loaded 9454 existing records. [2025-09-14T19:51:01.363943] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-14T19:51:01.439799] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:01.440041] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-14T19:51:01.440106] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-14T19:51:01.440407] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-14T19:51:01.440465] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-14T19:51:01.815310] [INFO ] [REMOTE ] ROG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:02.122075] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T19:51:02.158875] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-14T19:51:02.958857] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-14T19:51:03.759006] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-14T19:51:04.449891] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-14T19:51:04.454631] [INFO ] [REMOTE ] RNR: Full fetch complete (38296 records). [2025-09-14T19:51:04.454834] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-14T19:51:04.826969] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-14T19:51:04.827093] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-14T19:51:04.827985] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-14T19:51:04.828053] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-14T19:51:04.829333] [DEBUG] [LOCAL ] RNR: Trimmed 38296 records to 25420 (keeping 150 days of data) [2025-09-14T19:51:04.957485] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T19:51:04.962517] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-14T19:51:05.029876] [DEBUG] [LOCAL ] RNR: Primary data saved (25420 records). [2025-09-14T19:51:05.030055] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-14T19:51:05.030208] [INFO ] [MAIN ] Update Progress: 1825/2370 symbols completed. RNR took 22.3s. Estimated remaining: 57m 54s. Rate: 9.4 symbols/min [2025-09-14T19:51:05.201790] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:05.221489] [DEBUG] [LOCAL ] ROK: Loaded 18709 existing records from primary storage. [2025-09-14T19:51:05.221706] [INFO ] [MAIN ] ROK: Loaded 18709 existing records. [2025-09-14T19:51:05.399078] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:05.399375] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-14T19:51:05.399441] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-14T19:51:05.400071] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-14T19:51:05.400136] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-14T19:51:05.771332] [INFO ] [REMOTE ] ROK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:05.771761] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-14T19:51:05.917113] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-14T19:51:05.923081] [INFO ] [REMOTE ] RNG: Full fetch complete (52500 records). [2025-09-14T19:51:05.923299] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-14T19:51:06.137902] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (4.77 seconds). [2025-09-14T19:51:06.212999] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-14T19:51:06.370074] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-14T19:51:06.370306] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-14T19:51:06.372077] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-14T19:51:06.372191] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-14T19:51:06.389928] [DEBUG] [LOCAL ] RNG: Trimmed 52500 records to 35802 (keeping 150 days of data) [2025-09-14T19:51:06.390614] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T19:51:06.622487] [DEBUG] [LOCAL ] RNG: Primary data saved (35802 records). [2025-09-14T19:51:06.622704] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-14T19:51:06.622880] [INFO ] [MAIN ] Update Progress: 1826/2370 symbols completed. RNG took 38.5s. Estimated remaining: 57m 46s. Rate: 9.4 symbols/min [2025-09-14T19:51:06.797587] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:06.821039] [DEBUG] [LOCAL ] ROL: Loaded 22046 existing records from primary storage. [2025-09-14T19:51:06.821224] [INFO ] [MAIN ] ROL: Loaded 22046 existing records. [2025-09-14T19:51:06.964061] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-14T19:51:07.001202] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:07.001502] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-14T19:51:07.001580] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-14T19:51:07.002309] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-14T19:51:07.002382] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-14T19:51:07.367471] [INFO ] [REMOTE ] ROL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:07.574203] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T19:51:07.758821] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-14T19:51:08.091188] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T19:51:08.563796] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-14T19:51:08.571022] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T19:51:09.171291] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T19:51:09.358859] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-14T19:51:09.586382] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:51:10.158847] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-14T19:51:10.958840] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-14T19:51:11.286020] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T19:51:11.333916] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T19:51:11.758886] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-14T19:51:12.506384] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T19:51:12.558861] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-14T19:51:13.329508] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T19:51:13.358818] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-14T19:51:14.158869] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-14T19:51:14.367172] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T19:51:14.958849] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-14T19:51:15.132444] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T19:51:15.244868] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T19:51:15.629366] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T19:51:15.758837] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-14T19:51:16.558822] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-14T19:51:17.358864] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-14T19:51:17.501556] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T19:51:18.158899] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-14T19:51:18.958840] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-14T19:51:19.162413] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T19:51:19.548148] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T19:51:19.668263] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (3.11 seconds). [2025-09-14T19:51:19.758818] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-14T19:51:20.361470] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T19:51:20.558838] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-14T19:51:21.358825] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-14T19:51:21.456570] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T19:51:21.580383] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T19:51:22.040262] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:51:22.044397] [INFO ] [REMOTE ] RNST: Full fetch complete (40481 records). [2025-09-14T19:51:22.044527] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-14T19:51:22.163910] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-14T19:51:22.431722] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-14T19:51:22.431832] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-14T19:51:22.432795] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-14T19:51:22.432856] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-14T19:51:22.433886] [DEBUG] [LOCAL ] RNST: Trimmed 40481 records to 27088 (keeping 150 days of data) [2025-09-14T19:51:22.623374] [DEBUG] [LOCAL ] RNST: Primary data saved (27088 records). [2025-09-14T19:51:22.623574] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-14T19:51:22.623720] [INFO ] [MAIN ] Update Progress: 1827/2370 symbols completed. RNST took 27.1s. Estimated remaining: 57m 43s. Rate: 9.4 symbols/min [2025-09-14T19:51:22.793215] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:22.812741] [DEBUG] [LOCAL ] RPM: Loaded 18168 existing records from primary storage. [2025-09-14T19:51:22.812906] [INFO ] [MAIN ] RPM: Loaded 18168 existing records. [2025-09-14T19:51:22.961184] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-14T19:51:22.989692] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:22.989983] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-14T19:51:22.990168] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-14T19:51:22.999718] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-14T19:51:23.000004] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-14T19:51:23.114074] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T19:51:23.386014] [INFO ] [REMOTE ] RPM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:23.759689] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-14T19:51:23.761793] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T19:51:23.766042] [INFO ] [REMOTE ] ROK: Full fetch complete (48162 records). [2025-09-14T19:51:23.766176] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-14T19:51:24.144365] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-14T19:51:24.144478] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-14T19:51:24.145616] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-14T19:51:24.145731] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-14T19:51:24.147009] [DEBUG] [LOCAL ] ROK: Trimmed 48162 records to 32763 (keeping 150 days of data) [2025-09-14T19:51:24.377367] [DEBUG] [LOCAL ] ROK: Primary data saved (32763 records). [2025-09-14T19:51:24.377545] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-14T19:51:24.377684] [INFO ] [MAIN ] Update Progress: 1828/2370 symbols completed. ROK took 19.3s. Estimated remaining: 57m 35s. Rate: 9.4 symbols/min [2025-09-14T19:51:24.549173] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:24.559738] [DEBUG] [LOCAL ] RPT: Loaded 8672 existing records from primary storage. [2025-09-14T19:51:24.559395] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-14T19:51:24.560877] [INFO ] [MAIN ] RPT: Loaded 8672 existing records. [2025-09-14T19:51:24.738920] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:24.739328] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-14T19:51:24.739487] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-14T19:51:24.749217] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-14T19:51:24.765557] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-14T19:51:24.837687] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T19:51:25.164083] [INFO ] [REMOTE ] RPT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:25.358884] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-14T19:51:25.789158] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T19:51:26.158893] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-14T19:51:26.739357] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T19:51:26.742807] [INFO ] [REMOTE ] ROG: Full fetch complete (25205 records). [2025-09-14T19:51:26.742917] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-14T19:51:26.963404] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-14T19:51:27.133439] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-14T19:51:27.163758] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-14T19:51:27.164736] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-14T19:51:27.165269] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-14T19:51:27.166439] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T19:51:27.175975] [DEBUG] [LOCAL ] ROG: Trimmed 25205 records to 17081 (keeping 150 days of data) [2025-09-14T19:51:27.286922] [DEBUG] [LOCAL ] ROG: Primary data saved (17081 records). [2025-09-14T19:51:27.287137] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-14T19:51:27.287262] [INFO ] [MAIN ] Update Progress: 1829/2370 symbols completed. ROG took 26.2s. Estimated remaining: 57m 28s. Rate: 9.4 symbols/min [2025-09-14T19:51:27.464009] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:27.480889] [DEBUG] [LOCAL ] RQI: Loaded 13211 existing records from primary storage. [2025-09-14T19:51:27.481069] [INFO ] [MAIN ] RQI: Loaded 13211 existing records. [2025-09-14T19:51:27.669234] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:27.669514] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-14T19:51:27.669574] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-14T19:51:27.670121] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-14T19:51:27.670185] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-14T19:51:27.767430] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-14T19:51:28.031310] [INFO ] [REMOTE ] RQI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:28.061694] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T19:51:28.558829] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-14T19:51:29.261178] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T19:51:29.358899] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-14T19:51:29.831482] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T19:51:30.158832] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-14T19:51:30.292636] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T19:51:30.958847] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-14T19:51:31.758902] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-14T19:51:31.906483] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T19:51:32.404151] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T19:51:32.558846] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-14T19:51:32.835714] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T19:51:33.358855] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-14T19:51:34.066741] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T19:51:34.158837] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-14T19:51:34.849410] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:51:34.854442] [INFO ] [REMOTE ] ROL: Full fetch complete (54718 records). [2025-09-14T19:51:34.854576] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-14T19:51:34.959037] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-14T19:51:35.252852] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-14T19:51:35.252968] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-14T19:51:35.254111] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-14T19:51:35.254177] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-14T19:51:35.255619] [DEBUG] [LOCAL ] ROL: Trimmed 54718 records to 37448 (keeping 150 days of data) [2025-09-14T19:51:35.404391] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-14T19:51:35.556036] [DEBUG] [LOCAL ] ROL: Primary data saved (37448 records). [2025-09-14T19:51:35.556277] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-14T19:51:35.556403] [INFO ] [MAIN ] Update Progress: 1830/2370 symbols completed. ROL took 28.9s. Estimated remaining: 57m 22s. Rate: 9.4 symbols/min [2025-09-14T19:51:35.735609] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:35.762308] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-14T19:51:35.765403] [DEBUG] [LOCAL ] RRC: Loaded 23552 existing records from primary storage. [2025-09-14T19:51:35.765630] [INFO ] [MAIN ] RRC: Loaded 23552 existing records. [2025-09-14T19:51:35.941926] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:35.942175] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-14T19:51:35.942236] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-14T19:51:35.942960] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-14T19:51:35.943024] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-14T19:51:36.299391] [INFO ] [REMOTE ] RRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:36.391110] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T19:51:36.558831] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-14T19:51:37.360066] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T19:51:37.359221] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-14T19:51:37.955009] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T19:51:38.158790] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-14T19:51:38.547928] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T19:51:38.958873] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-14T19:51:39.758858] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-14T19:51:39.837380] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T19:51:40.362946] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T19:51:40.526317] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T19:51:40.558781] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-14T19:51:41.358865] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-14T19:51:41.843849] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T19:51:42.158921] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-14T19:51:42.704252] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T19:51:42.958824] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-14T19:51:43.273932] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T19:51:43.758852] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-14T19:51:44.186577] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T19:51:44.190342] [INFO ] [REMOTE ] RQI: Full fetch complete (31477 records). [2025-09-14T19:51:44.190456] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-14T19:51:44.563634] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-14T19:51:44.595735] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-14T19:51:44.595835] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-14T19:51:44.596906] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-14T19:51:44.596986] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-14T19:51:44.598407] [DEBUG] [LOCAL ] RQI: Trimmed 31477 records to 21324 (keeping 150 days of data) [2025-09-14T19:51:44.743932] [DEBUG] [LOCAL ] RQI: Primary data saved (21324 records). [2025-09-14T19:51:44.744116] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-14T19:51:44.744228] [INFO ] [MAIN ] Update Progress: 1831/2370 symbols completed. RQI took 17.5s. Estimated remaining: 57m 16s. Rate: 9.4 symbols/min [2025-09-14T19:51:44.919752] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:44.941469] [DEBUG] [LOCAL ] RRX: Loaded 17962 existing records from primary storage. [2025-09-14T19:51:44.941700] [INFO ] [MAIN ] RRX: Loaded 17962 existing records. [2025-09-14T19:51:45.128308] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:45.128596] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-14T19:51:45.128682] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-14T19:51:45.129323] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-14T19:51:45.129388] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-14T19:51:45.366173] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-14T19:51:45.494953] [INFO ] [REMOTE ] RRX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:45.602840] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T19:51:45.745762] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:51:46.158880] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-14T19:51:46.958817] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-14T19:51:47.027085] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T19:51:47.029349] [INFO ] [REMOTE ] RPT: Full fetch complete (21393 records). [2025-09-14T19:51:47.029456] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-14T19:51:47.370357] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T19:51:47.465731] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-14T19:51:47.465861] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-14T19:51:47.466566] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-14T19:51:47.466623] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-14T19:51:47.467500] [DEBUG] [LOCAL ] RPT: Trimmed 21393 records to 14770 (keeping 150 days of data) [2025-09-14T19:51:47.557496] [DEBUG] [LOCAL ] RPT: Primary data saved (14770 records). [2025-09-14T19:51:47.557728] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-14T19:51:47.557854] [INFO ] [MAIN ] Update Progress: 1832/2370 symbols completed. RPT took 23.2s. Estimated remaining: 57m 9s. Rate: 9.4 symbols/min [2025-09-14T19:51:47.732600] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:47.745058] [DEBUG] [LOCAL ] RS: Loaded 11040 existing records from primary storage. [2025-09-14T19:51:47.745214] [INFO ] [MAIN ] RS: Loaded 11040 existing records. [2025-09-14T19:51:47.765784] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-14T19:51:47.933455] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:47.933747] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-14T19:51:47.933852] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-14T19:51:47.934262] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-14T19:51:47.934339] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-14T19:51:48.291585] [INFO ] [REMOTE ] RS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:48.558881] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-14T19:51:48.614273] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:51:49.358838] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-14T19:51:49.448880] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T19:51:50.158872] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-14T19:51:50.531923] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T19:51:50.835954] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:51:50.840413] [INFO ] [REMOTE ] RPM: Full fetch complete (44574 records). [2025-09-14T19:51:50.840513] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-14T19:51:50.964067] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-14T19:51:51.225616] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-14T19:51:51.225759] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-14T19:51:51.226867] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-14T19:51:51.226967] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-14T19:51:51.228413] [DEBUG] [LOCAL ] RPM: Trimmed 44574 records to 31152 (keeping 150 days of data) [2025-09-14T19:51:51.347529] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T19:51:51.470589] [DEBUG] [LOCAL ] RPM: Primary data saved (31152 records). [2025-09-14T19:51:51.470781] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-14T19:51:51.470898] [INFO ] [MAIN ] Update Progress: 1833/2370 symbols completed. RPM took 28.8s. Estimated remaining: 57m 2s. Rate: 9.4 symbols/min [2025-09-14T19:51:51.644138] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:51:51.648571] [DEBUG] [LOCAL ] RSF: Loaded 2175 existing records from primary storage. [2025-09-14T19:51:51.648695] [INFO ] [MAIN ] RSF: Loaded 2175 existing records. [2025-09-14T19:51:51.763963] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-14T19:51:51.831433] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:51:51.832776] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-14T19:51:51.832843] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-14T19:51:51.833158] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-14T19:51:51.833218] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-14T19:51:52.200982] [INFO ] [REMOTE ] RSF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:51:52.558931] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-14T19:51:52.853559] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T19:51:53.229047] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T19:51:53.358866] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-14T19:51:53.712409] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T19:51:54.158884] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-14T19:51:54.958829] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-14T19:51:55.093017] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T19:51:55.758835] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-14T19:51:55.854278] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T19:51:56.005972] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T19:51:56.270842] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T19:51:56.558848] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-14T19:51:57.169007] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T19:51:57.358841] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-14T19:51:58.158848] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-14T19:51:58.871335] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T19:51:58.958847] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-14T19:51:59.624511] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T19:51:59.758830] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-14T19:52:00.402195] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T19:52:00.558842] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-14T19:52:01.358828] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-14T19:52:01.602297] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T19:52:01.878765] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T19:52:02.000372] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T19:52:02.158857] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-14T19:52:02.958877] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-14T19:52:03.758853] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-14T19:52:03.932574] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:52:04.317182] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T19:52:04.434087] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T19:52:04.558833] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-14T19:52:05.252848] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T19:52:05.358897] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-14T19:52:06.158863] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-14T19:52:06.822876] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T19:52:06.958855] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-14T19:52:07.073990] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T19:52:07.463295] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T19:52:07.464423] [INFO ] [REMOTE ] RSF: Full fetch complete (4426 records). [2025-09-14T19:52:07.464532] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-14T19:52:07.764037] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-14T19:52:07.826078] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-14T19:52:07.826194] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-14T19:52:07.826434] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-14T19:52:07.826489] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-14T19:52:07.826961] [DEBUG] [LOCAL ] RSF: Trimmed 4426 records to 3410 (keeping 150 days of data) [2025-09-14T19:52:07.852742] [DEBUG] [LOCAL ] RSF: Primary data saved (3410 records). [2025-09-14T19:52:07.852871] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-14T19:52:07.852994] [INFO ] [MAIN ] Update Progress: 1834/2370 symbols completed. RSF took 16.4s. Estimated remaining: 56m 58s. Rate: 9.4 symbols/min [2025-09-14T19:52:08.024055] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:08.045014] [DEBUG] [LOCAL ] RSG: Loaded 21087 existing records from primary storage. [2025-09-14T19:52:08.045169] [INFO ] [MAIN ] RSG: Loaded 21087 existing records. [2025-09-14T19:52:08.219107] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:08.219374] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-14T19:52:08.219450] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-14T19:52:08.220160] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-14T19:52:08.220223] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-14T19:52:08.569008] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-14T19:52:08.578526] [INFO ] [REMOTE ] RSG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:09.358826] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-14T19:52:09.392988] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T19:52:10.158840] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-14T19:52:10.458278] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T19:52:10.958857] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-14T19:52:11.154620] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T19:52:11.462884] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T19:52:11.542394] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T19:52:11.550760] [INFO ] [REMOTE ] RRC: Full fetch complete (57400 records). [2025-09-14T19:52:11.550948] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-14T19:52:11.763933] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-14T19:52:11.955373] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-14T19:52:11.955479] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-14T19:52:11.956605] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-14T19:52:11.956700] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-14T19:52:11.957962] [DEBUG] [LOCAL ] RRC: Trimmed 57400 records to 39706 (keeping 150 days of data) [2025-09-14T19:52:12.228166] [DEBUG] [LOCAL ] RRC: Primary data saved (39706 records). [2025-09-14T19:52:12.228388] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-14T19:52:12.228520] [INFO ] [MAIN ] Update Progress: 1835/2370 symbols completed. RRC took 36.7s. Estimated remaining: 56m 51s. Rate: 9.4 symbols/min [2025-09-14T19:52:12.399421] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:12.420533] [DEBUG] [LOCAL ] RSI: Loaded 21128 existing records from primary storage. [2025-09-14T19:52:12.420747] [INFO ] [MAIN ] RSI: Loaded 21128 existing records. [2025-09-14T19:52:12.576059] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-14T19:52:12.607392] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:12.607905] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-14T19:52:12.608120] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-14T19:52:12.614183] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-14T19:52:12.624585] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-14T19:52:12.670030] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T19:52:12.734200] [INFO ] [REMOTE ] RRX: Full fetch complete (44810 records). [2025-09-14T19:52:12.745053] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-14T19:52:13.196390] [INFO ] [REMOTE ] RSI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:13.313639] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:52:13.358541] [INFO ] [REMOTE ] RS: Full fetch complete (28880 records). [2025-09-14T19:52:13.378941] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-14T19:52:13.367870] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-14T19:52:13.482747] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-14T19:52:13.519451] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-14T19:52:13.523536] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-14T19:52:13.534507] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-14T19:52:13.618488] [DEBUG] [LOCAL ] RRX: Trimmed 44810 records to 30539 (keeping 150 days of data) [2025-09-14T19:52:14.022531] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-14T19:52:14.024217] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-14T19:52:14.026884] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-14T19:52:14.027688] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-14T19:52:14.033351] [DEBUG] [LOCAL ] RS: Trimmed 28880 records to 18263 (keeping 150 days of data) [2025-09-14T19:52:14.161027] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-14T19:52:14.161278] [DEBUG] [LOCAL ] RRX: Primary data saved (30539 records). [2025-09-14T19:52:14.176091] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-14T19:52:14.176775] [INFO ] [MAIN ] Update Progress: 1836/2370 symbols completed. RRX took 29.4s. Estimated remaining: 56m 44s. Rate: 9.4 symbols/min [2025-09-14T19:52:14.179329] [DEBUG] [LOCAL ] RS: Primary data saved (18263 records). [2025-09-14T19:52:14.185631] [INFO ] [MAIN ] RS: Full history saved. [2025-09-14T19:52:14.217780] [INFO ] [MAIN ] Update Progress: 1837/2370 symbols completed. RS took 26.7s. Estimated remaining: 56m 35s. Rate: 9.4 symbols/min [2025-09-14T19:52:14.368037] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:14.385253] [DEBUG] [LOCAL ] RSKD: Loaded 14925 existing records from primary storage. [2025-09-14T19:52:14.385476] [INFO ] [MAIN ] RSKD: Loaded 14925 existing records. [2025-09-14T19:52:14.577915] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:14.578299] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-14T19:52:14.578386] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-14T19:52:14.578961] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-14T19:52:14.579035] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-14T19:52:14.942122] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:14.958781] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-14T19:52:15.161202] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T19:52:15.758892] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-14T19:52:15.979887] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T19:52:16.300467] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T19:52:16.558907] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-14T19:52:17.227417] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:52:17.358832] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-14T19:52:18.158917] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-14T19:52:18.300688] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T19:52:18.962795] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-14T19:52:18.968871] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T19:52:19.758860] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-14T19:52:19.805076] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T19:52:20.558956] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-14T19:52:20.640406] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T19:52:21.359006] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-14T19:52:21.573247] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T19:52:21.729357] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T19:52:22.158943] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-14T19:52:22.958957] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-14T19:52:23.185605] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T19:52:23.363415] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T19:52:23.758834] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-14T19:52:24.499208] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T19:52:24.558918] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-14T19:52:25.358891] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-14T19:52:25.525238] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:52:25.931005] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T19:52:26.158914] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-14T19:52:26.888334] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T19:52:26.958871] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-14T19:52:27.087677] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T19:52:27.758892] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-14T19:52:28.567736] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-14T19:52:28.574971] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:52:29.103493] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T19:52:29.358903] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-14T19:52:30.158838] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-14T19:52:30.206068] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T19:52:30.555793] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T19:52:30.559288] [INFO ] [REMOTE ] RSKD: Full fetch complete (36866 records). [2025-09-14T19:52:30.559434] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-14T19:52:30.930918] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-14T19:52:30.931118] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-14T19:52:30.932008] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-14T19:52:30.932120] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-14T19:52:30.945109] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T19:52:30.944609] [DEBUG] [LOCAL ] RSKD: Trimmed 36866 records to 25033 (keeping 150 days of data) [2025-09-14T19:52:30.950686] [INFO ] [REMOTE ] RSG: Full fetch complete (51460 records). [2025-09-14T19:52:30.950836] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-14T19:52:31.013377] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-14T19:52:31.447763] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-14T19:52:31.451878] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-14T19:52:31.457093] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-14T19:52:31.470963] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-14T19:52:31.485841] [DEBUG] [LOCAL ] RSG: Trimmed 51460 records to 35548 (keeping 150 days of data) [2025-09-14T19:52:31.488474] [DEBUG] [LOCAL ] RSKD: Primary data saved (25033 records). [2025-09-14T19:52:31.488909] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-14T19:52:31.489016] [INFO ] [MAIN ] Update Progress: 1838/2370 symbols completed. RSKD took 17.3s. Estimated remaining: 56m 32s. Rate: 9.4 symbols/min [2025-09-14T19:52:31.732063] [DEBUG] [LOCAL ] RSG: Primary data saved (35548 records). [2025-09-14T19:52:31.732276] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-14T19:52:31.732410] [INFO ] [MAIN ] Update Progress: 1839/2370 symbols completed. RSG took 23.9s. Estimated remaining: 56m 24s. Rate: 9.4 symbols/min [2025-09-14T19:52:32.579173] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T19:52:32.584221] [INFO ] [REMOTE ] RSI: Full fetch complete (51869 records). [2025-09-14T19:52:32.584413] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-14T19:52:32.959157] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-14T19:52:32.959283] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-14T19:52:32.960556] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-14T19:52:32.960677] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-14T19:52:32.962014] [DEBUG] [LOCAL ] RSI: Trimmed 51869 records to 34908 (keeping 150 days of data) [2025-09-14T19:52:33.189056] [DEBUG] [LOCAL ] RSI: Primary data saved (34908 records). [2025-09-14T19:52:33.189229] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-14T19:52:33.189333] [INFO ] [MAIN ] Update Progress: 1840/2370 symbols completed. RSI took 21.0s. Estimated remaining: 56m 16s. Rate: 9.4 symbols/min [2025-09-14T19:52:33.830039] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:33.912837] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:33.930574] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:33.934048] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:33.968798] [DEBUG] [LOCAL ] RVT: Loaded 12163 existing records from primary storage. [2025-09-14T19:52:33.969310] [DEBUG] [LOCAL ] RVLV: Loaded 20822 existing records from primary storage. [2025-09-14T19:52:33.969616] [INFO ] [MAIN ] RVLV: Loaded 20822 existing records. [2025-09-14T19:52:33.969942] [INFO ] [MAIN ] RVT: Loaded 12163 existing records. [2025-09-14T19:52:34.156020] [DEBUG] [LOCAL ] RTO: Loaded 17874 existing records from primary storage. [2025-09-14T19:52:34.175216] [INFO ] [MAIN ] RTO: Loaded 17874 existing records. [2025-09-14T19:52:34.198359] [DEBUG] [LOCAL ] RTX: Loaded 24141 existing records from primary storage. [2025-09-14T19:52:34.242816] [INFO ] [MAIN ] RTX: Loaded 24141 existing records. [2025-09-14T19:52:34.488808] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:34.480711] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:34.510268] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-14T19:52:34.541257] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-14T19:52:34.556205] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-14T19:52:34.530948] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-14T19:52:34.572086] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-14T19:52:34.576275] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-14T19:52:34.611912] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-14T19:52:34.681179] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-14T19:52:34.681080] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:34.823949] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-14T19:52:34.889193] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-14T19:52:35.000403] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-14T19:52:35.011115] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:35.064621] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-14T19:52:35.133375] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-14T19:52:35.243350] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-14T19:52:35.402476] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-14T19:52:35.475077] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-14T19:52:35.721679] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:35.785055] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-14T19:52:35.799580] [INFO ] [REMOTE ] RVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:35.869736] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-14T19:52:36.048697] [INFO ] [REMOTE ] RTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:36.112231] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-14T19:52:36.216049] [INFO ] [REMOTE ] RTX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:36.216423] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-14T19:52:37.277156] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T19:52:37.282982] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-14T19:52:37.445769] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:52:37.455316] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-14T19:52:37.585556] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T19:52:37.592918] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-14T19:52:38.226682] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T19:52:38.236952] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-14T19:52:38.345787] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T19:52:38.352897] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-14T19:52:39.260678] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T19:52:39.273091] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-14T19:52:39.312229] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T19:52:39.384152] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T19:52:39.758849] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-14T19:52:40.299186] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T19:52:40.558890] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-14T19:52:41.107750] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T19:52:41.358844] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-14T19:52:41.541314] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T19:52:42.158896] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-14T19:52:42.462754] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T19:52:42.958906] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-14T19:52:43.117304] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T19:52:43.259598] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T19:52:43.758910] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-14T19:52:44.176694] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T19:52:44.558847] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-14T19:52:45.202559] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T19:52:45.358915] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-14T19:52:46.158989] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-14T19:52:46.676361] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-14T19:52:46.831610] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T19:52:46.958946] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-14T19:52:47.312041] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T19:52:47.758892] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-14T19:52:48.137183] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:52:48.558804] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-14T19:52:48.961215] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T19:52:49.358890] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-14T19:52:49.987447] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T19:52:49.991905] [INFO ] [REMOTE ] RTO: Full fetch complete (43879 records). [2025-09-14T19:52:49.992073] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-14T19:52:50.173469] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-14T19:52:50.448271] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-14T19:52:50.448411] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-14T19:52:50.450254] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-14T19:52:50.450348] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-14T19:52:50.452659] [DEBUG] [LOCAL ] RTO: Trimmed 43879 records to 29502 (keeping 150 days of data) [2025-09-14T19:52:50.672987] [DEBUG] [LOCAL ] RTO: Primary data saved (29502 records). [2025-09-14T19:52:50.673233] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-14T19:52:50.673434] [INFO ] [MAIN ] Update Progress: 1841/2370 symbols completed. RTO took 17.5s. Estimated remaining: 56m 13s. Rate: 9.4 symbols/min [2025-09-14T19:52:50.851385] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:50.874752] [DEBUG] [LOCAL ] RVTY: Loaded 20925 existing records from primary storage. [2025-09-14T19:52:50.875005] [INFO ] [MAIN ] RVTY: Loaded 20925 existing records. [2025-09-14T19:52:50.959584] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-14T19:52:51.095536] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:51.096014] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-14T19:52:51.096173] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-14T19:52:51.097279] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-14T19:52:51.097533] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-14T19:52:51.399809] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T19:52:51.527549] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:51.545829] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T19:52:51.758904] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-14T19:52:52.558895] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-14T19:52:52.881496] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T19:52:52.885165] [INFO ] [REMOTE ] RVT: Full fetch complete (29638 records). [2025-09-14T19:52:52.885296] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-14T19:52:53.309791] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-14T19:52:53.310013] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-14T19:52:53.311406] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-14T19:52:53.311679] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-14T19:52:53.313353] [DEBUG] [LOCAL ] RVT: Trimmed 29638 records to 19660 (keeping 150 days of data) [2025-09-14T19:52:53.382090] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-14T19:52:53.449354] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-14T19:52:53.496044] [DEBUG] [LOCAL ] RVT: Primary data saved (19660 records). [2025-09-14T19:52:53.496287] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-14T19:52:53.496439] [INFO ] [MAIN ] Update Progress: 1842/2370 symbols completed. RVT took 20.3s. Estimated remaining: 56m 6s. Rate: 9.4 symbols/min [2025-09-14T19:52:53.677313] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:52:53.697657] [DEBUG] [LOCAL ] RWT: Loaded 18160 existing records from primary storage. [2025-09-14T19:52:53.697887] [INFO ] [MAIN ] RWT: Loaded 18160 existing records. [2025-09-14T19:52:53.888999] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:52:53.889295] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-14T19:52:53.889355] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-14T19:52:53.890018] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-14T19:52:53.890084] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-14T19:52:54.172163] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-14T19:52:54.302510] [INFO ] [REMOTE ] RWT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:52:54.441623] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T19:52:54.958901] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-14T19:52:55.042119] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:52:55.758955] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-14T19:52:56.572585] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-14T19:52:56.584932] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-14T19:52:56.619527] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:52:57.157138] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T19:52:57.358866] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-14T19:52:58.120111] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T19:52:58.158848] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-14T19:52:58.958905] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-14T19:52:59.235551] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T19:52:59.556531] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T19:52:59.563548] [INFO ] [REMOTE ] RVLV: Full fetch complete (52166 records). [2025-09-14T19:52:59.563790] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-14T19:52:59.764504] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-14T19:52:59.980215] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-14T19:52:59.980380] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-14T19:52:59.982218] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-14T19:52:59.982297] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-14T19:52:59.983997] [DEBUG] [LOCAL ] RVLV: Trimmed 52166 records to 35712 (keeping 150 days of data) [2025-09-14T19:53:00.227547] [DEBUG] [LOCAL ] RVLV: Primary data saved (35712 records). [2025-09-14T19:53:00.227792] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-14T19:53:00.228037] [INFO ] [MAIN ] Update Progress: 1843/2370 symbols completed. RVLV took 27.0s. Estimated remaining: 55m 59s. Rate: 9.4 symbols/min [2025-09-14T19:53:00.403322] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:00.406607] [DEBUG] [LOCAL ] RWTN: Loaded 997 existing records from primary storage. [2025-09-14T19:53:00.406730] [INFO ] [MAIN ] RWTN: Loaded 997 existing records. [2025-09-14T19:53:00.560227] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-14T19:53:00.600935] [WARN ] [MAIN ] RWTN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:00.601446] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-14T19:53:00.601516] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-14T19:53:00.602001] [DEBUG] [LOCAL ] RWTN: Deleted primary data file. [2025-09-14T19:53:00.602309] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-14T19:53:00.967205] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:01.180979] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-14T19:53:01.358872] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-14T19:53:01.802577] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T19:53:01.905272] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T19:53:02.158927] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-14T19:53:02.238365] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T19:53:02.958912] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-14T19:53:03.758929] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-14T19:53:03.807932] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T19:53:04.275299] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T19:53:04.351142] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T19:53:04.558940] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-14T19:53:05.358854] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-14T19:53:06.047757] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:53:06.053589] [INFO ] [REMOTE ] RTX: Full fetch complete (58392 records). [2025-09-14T19:53:06.053821] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-14T19:53:06.161256] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-14T19:53:06.471712] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-14T19:53:06.472055] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-14T19:53:06.473850] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-14T19:53:06.473930] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-14T19:53:06.503341] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T19:53:06.503626] [DEBUG] [LOCAL ] RTX: Trimmed 58392 records to 40455 (keeping 150 days of data) [2025-09-14T19:53:06.812807] [DEBUG] [LOCAL ] RTX: Primary data saved (40455 records). [2025-09-14T19:53:06.813009] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-14T19:53:06.813138] [INFO ] [MAIN ] Update Progress: 1844/2370 symbols completed. RTX took 33.6s. Estimated remaining: 55m 53s. Rate: 9.4 symbols/min [2025-09-14T19:53:06.967534] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-14T19:53:06.995340] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:07.001159] [DEBUG] [LOCAL ] RWTO: Loaded 2310 existing records from primary storage. [2025-09-14T19:53:07.001353] [INFO ] [MAIN ] RWTO: Loaded 2310 existing records. [2025-09-14T19:53:07.180215] [WARN ] [MAIN ] RWTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:07.180513] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-14T19:53:07.180589] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-14T19:53:07.180888] [DEBUG] [LOCAL ] RWTO: Deleted primary data file. [2025-09-14T19:53:07.180957] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-14T19:53:07.534761] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:07.578475] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T19:53:07.758809] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-14T19:53:07.842412] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T19:53:08.271605] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T19:53:08.558856] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-14T19:53:09.358848] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-14T19:53:09.763081] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-14T19:53:10.158848] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-14T19:53:10.309821] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T19:53:10.958843] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-14T19:53:11.534014] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T19:53:11.748365] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T19:53:11.758775] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-14T19:53:12.558885] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-14T19:53:12.993433] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-14T19:53:13.358926] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-14T19:53:13.470186] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T19:53:13.969410] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T19:53:14.158912] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-14T19:53:14.892212] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:53:14.900138] [INFO ] [REMOTE ] RVTY: Full fetch complete (51393 records). [2025-09-14T19:53:14.900416] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-14T19:53:14.964092] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-14T19:53:15.363828] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-14T19:53:15.363974] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-14T19:53:15.365418] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-14T19:53:15.365504] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-14T19:53:15.366987] [DEBUG] [LOCAL ] RVTY: Trimmed 51393 records to 35767 (keeping 150 days of data) [2025-09-14T19:53:15.508986] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T19:53:15.510898] [INFO ] [REMOTE ] RWTN: Full fetch complete (2247 records). [2025-09-14T19:53:15.510980] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-14T19:53:15.762941] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-14T19:53:15.763476] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:53:15.763000] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-14T19:53:15.764424] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:53:15.765769] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-14T19:53:15.765952] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-14T19:53:15.766023] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-14T19:53:15.766107] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-14T19:53:15.766470] [INFO ] [MAIN ] Update Progress: 1845/2370 symbols completed. RWTN took 15.5s. Estimated remaining: 55m 48s. Rate: 9.4 symbols/min [2025-09-14T19:53:15.945197] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:15.951349] [DEBUG] [LOCAL ] RWTP: Loaded 1179 existing records from primary storage. [2025-09-14T19:53:15.951715] [INFO ] [MAIN ] RWTP: Loaded 1179 existing records. [2025-09-14T19:53:16.135461] [WARN ] [MAIN ] RWTP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:16.137735] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-14T19:53:16.138137] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-14T19:53:16.138523] [DEBUG] [LOCAL ] RWTP: Deleted primary data file. [2025-09-14T19:53:16.138585] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-14T19:53:16.363075] [DEBUG] [LOCAL ] RVTY: Primary data saved (35767 records). [2025-09-14T19:53:16.378337] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T19:53:16.378510] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-14T19:53:16.406601] [INFO ] [MAIN ] Update Progress: 1846/2370 symbols completed. RVTY took 25.7s. Estimated remaining: 55m 39s. Rate: 9.4 symbols/min [2025-09-14T19:53:16.564541] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-14T19:53:16.656879] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:16.686561] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:16.710575] [DEBUG] [LOCAL ] RXO: Loaded 21701 existing records from primary storage. [2025-09-14T19:53:16.710756] [INFO ] [MAIN ] RXO: Loaded 21701 existing records. [2025-09-14T19:53:16.883346] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:16.883610] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-14T19:53:16.883689] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-14T19:53:16.884324] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-14T19:53:16.884382] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-14T19:53:17.245958] [INFO ] [REMOTE ] RXO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:17.248920] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T19:53:17.358850] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-14T19:53:18.158835] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-14T19:53:18.803909] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T19:53:18.958849] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-14T19:53:19.071519] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T19:53:19.450889] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-14T19:53:19.758834] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-14T19:53:20.558893] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-14T19:53:21.029748] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-14T19:53:21.358875] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-14T19:53:21.441808] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T19:53:22.158834] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-14T19:53:22.629224] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T19:53:22.865287] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T19:53:22.958787] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-14T19:53:23.651359] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:53:23.657325] [INFO ] [REMOTE ] RWT: Full fetch complete (43751 records). [2025-09-14T19:53:23.657519] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-14T19:53:23.766953] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-14T19:53:24.047823] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-14T19:53:24.047946] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-14T19:53:24.049146] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-14T19:53:24.049220] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-14T19:53:24.050253] [DEBUG] [LOCAL ] RWT: Trimmed 43751 records to 30008 (keeping 150 days of data) [2025-09-14T19:53:24.239383] [DEBUG] [LOCAL ] RWT: Primary data saved (30008 records). [2025-09-14T19:53:24.239589] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-14T19:53:24.239728] [INFO ] [MAIN ] Update Progress: 1847/2370 symbols completed. RWT took 30.7s. Estimated remaining: 55m 34s. Rate: 9.4 symbols/min [2025-09-14T19:53:24.416287] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:24.420626] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T19:53:24.443085] [DEBUG] [LOCAL ] RY: Loaded 21017 existing records from primary storage. [2025-09-14T19:53:24.443238] [INFO ] [MAIN ] RY: Loaded 21017 existing records. [2025-09-14T19:53:24.563979] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-14T19:53:24.622001] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:24.622229] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-14T19:53:24.622287] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-14T19:53:24.623059] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-14T19:53:24.623129] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-14T19:53:24.976388] [INFO ] [REMOTE ] RY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:25.195655] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T19:53:25.358856] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-14T19:53:25.820786] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T19:53:26.158825] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-14T19:53:26.621970] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-14T19:53:26.958874] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-14T19:53:27.478873] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T19:53:27.758822] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-14T19:53:28.399109] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T19:53:28.558879] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-14T19:53:29.071414] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T19:53:29.073086] [INFO ] [REMOTE ] RWTP: Full fetch complete (3424 records). [2025-09-14T19:53:29.073203] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-14T19:53:29.364376] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-14T19:53:29.449455] [DEBUG] [VALIDATOR ] RWTP: All expected trading days are present. [2025-09-14T19:53:29.449578] [DEBUG] [VALIDATOR ] RWTP: Primary data validation passed. [2025-09-14T19:53:29.449784] [INFO ] [MAIN ] RWTP: Fetched primary data is valid. [2025-09-14T19:53:29.449847] [DEBUG] [LOCAL ] RWTP: Saving primary data. [2025-09-14T19:53:29.450323] [DEBUG] [LOCAL ] RWTP: Trimmed 3424 records to 2038 (keeping 150 days of data) [2025-09-14T19:53:29.463161] [DEBUG] [LOCAL ] RWTP: Primary data saved (2038 records). [2025-09-14T19:53:29.463280] [INFO ] [MAIN ] RWTP: Full history saved. [2025-09-14T19:53:29.463380] [INFO ] [MAIN ] Update Progress: 1848/2370 symbols completed. RWTP took 13.7s. Estimated remaining: 55m 27s. Rate: 9.4 symbols/min [2025-09-14T19:53:29.633283] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:29.650001] [DEBUG] [LOCAL ] RYAM: Loaded 15588 existing records from primary storage. [2025-09-14T19:53:29.650180] [INFO ] [MAIN ] RYAM: Loaded 15588 existing records. [2025-09-14T19:53:29.826973] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:29.827240] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-14T19:53:29.827306] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-14T19:53:29.827828] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-14T19:53:29.827899] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-14T19:53:30.164036] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-14T19:53:30.225482] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:30.282149] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T19:53:30.958865] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-14T19:53:31.758862] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-14T19:53:31.944474] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T19:53:32.160493] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T19:53:32.558837] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-14T19:53:32.633715] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T19:53:33.192550] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T19:53:33.358845] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-14T19:53:34.158940] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-14T19:53:34.862316] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T19:53:34.958835] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-14T19:53:35.615247] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:53:35.616683] [INFO ] [REMOTE ] RWTO: Full fetch complete (3502 records). [2025-09-14T19:53:35.616773] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-14T19:53:35.763331] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-14T19:53:35.805182] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T19:53:35.806535] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:53:35.806686] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:53:35.806746] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-14T19:53:35.806930] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-14T19:53:35.806990] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-14T19:53:35.807161] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-14T19:53:35.807256] [INFO ] [MAIN ] Update Progress: 1849/2370 symbols completed. RWTO took 29.0s. Estimated remaining: 55m 20s. Rate: 9.4 symbols/min [2025-09-14T19:53:35.990026] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:36.021927] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T19:53:36.047300] [DEBUG] [LOCAL ] RYAN: Loaded 19927 existing records from primary storage. [2025-09-14T19:53:36.047488] [INFO ] [MAIN ] RYAN: Loaded 19927 existing records. [2025-09-14T19:53:36.229016] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:36.229342] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-14T19:53:36.229408] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-14T19:53:36.230129] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-14T19:53:36.230207] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-14T19:53:36.564167] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-14T19:53:36.583260] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:37.358861] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-14T19:53:37.433871] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T19:53:37.542961] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T19:53:38.158912] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-14T19:53:38.921689] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:53:38.958779] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-14T19:53:39.030811] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:53:39.758875] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-14T19:53:40.558880] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-14T19:53:40.636102] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T19:53:41.296635] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T19:53:41.358879] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-14T19:53:41.514015] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T19:53:42.158882] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-14T19:53:42.916783] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T19:53:42.958808] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-14T19:53:43.758933] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-14T19:53:43.928507] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:53:44.080979] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T19:53:44.558921] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-14T19:53:45.252703] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T19:53:45.358871] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-14T19:53:46.158819] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-14T19:53:46.259335] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T19:53:46.804276] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T19:53:46.958859] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-14T19:53:47.506105] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T19:53:47.612217] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T19:53:47.758952] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-14T19:53:48.558912] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-14T19:53:49.188892] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T19:53:49.231036] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T19:53:49.358902] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-14T19:53:50.158911] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-14T19:53:50.832690] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T19:53:50.837949] [INFO ] [REMOTE ] RXO: Full fetch complete (51607 records). [2025-09-14T19:53:50.838492] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-14T19:53:50.962416] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-14T19:53:51.253298] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-14T19:53:51.253466] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-14T19:53:51.254909] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-14T19:53:51.255039] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-14T19:53:51.288195] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T19:53:51.288472] [DEBUG] [LOCAL ] RXO: Trimmed 51607 records to 35965 (keeping 150 days of data) [2025-09-14T19:53:51.578076] [DEBUG] [LOCAL ] RXO: Primary data saved (35965 records). [2025-09-14T19:53:51.578749] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-14T19:53:51.579045] [INFO ] [MAIN ] Update Progress: 1850/2370 symbols completed. RXO took 35.2s. Estimated remaining: 55m 17s. Rate: 9.4 symbols/min [2025-09-14T19:53:51.766683] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-14T19:53:51.770178] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:51.788840] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T19:53:51.798141] [INFO ] [REMOTE ] RY: Full fetch complete (52129 records). [2025-09-14T19:53:51.798388] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-14T19:53:51.817037] [DEBUG] [LOCAL ] RYI: Loaded 10475 existing records from primary storage. [2025-09-14T19:53:51.871208] [INFO ] [MAIN ] RYI: Loaded 10475 existing records. [2025-09-14T19:53:52.289350] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:52.303096] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-14T19:53:52.333228] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-14T19:53:52.382587] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-14T19:53:52.382855] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-14T19:53:52.384150] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-14T19:53:52.379861] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-14T19:53:52.384420] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-14T19:53:52.384549] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-14T19:53:52.485178] [DEBUG] [LOCAL ] RY: Trimmed 52129 records to 35706 (keeping 150 days of data) [2025-09-14T19:53:52.576599] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-14T19:53:52.934933] [INFO ] [REMOTE ] RYI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:53.047908] [DEBUG] [LOCAL ] RY: Primary data saved (35706 records). [2025-09-14T19:53:53.048165] [INFO ] [MAIN ] RY: Full history saved. [2025-09-14T19:53:53.048287] [INFO ] [MAIN ] Update Progress: 1851/2370 symbols completed. RY took 28.8s. Estimated remaining: 55m 9s. Rate: 9.4 symbols/min [2025-09-14T19:53:53.225469] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:53.247894] [DEBUG] [LOCAL ] RYN: Loaded 20460 existing records from primary storage. [2025-09-14T19:53:53.248132] [INFO ] [MAIN ] RYN: Loaded 20460 existing records. [2025-09-14T19:53:53.362782] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-14T19:53:53.436206] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:53.436617] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-14T19:53:53.436705] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-14T19:53:53.466945] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-14T19:53:53.467160] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-14T19:53:53.519849] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T19:53:53.890523] [INFO ] [REMOTE ] RYN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:54.158872] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-14T19:53:54.267334] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T19:53:54.608624] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T19:53:54.958921] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-14T19:53:55.758812] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-14T19:53:56.079009] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T19:53:56.558882] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-14T19:53:56.908605] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-14T19:53:56.913879] [INFO ] [REMOTE ] RYAN: Full fetch complete (47570 records). [2025-09-14T19:53:56.914029] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-14T19:53:57.339016] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-14T19:53:57.339186] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-14T19:53:57.340671] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-14T19:53:57.340773] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-14T19:53:57.342848] [DEBUG] [LOCAL ] RYAN: Trimmed 47570 records to 32666 (keeping 150 days of data) [2025-09-14T19:53:57.406857] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-14T19:53:57.506726] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T19:53:57.624436] [DEBUG] [LOCAL ] RYAN: Primary data saved (32666 records). [2025-09-14T19:53:57.624685] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-14T19:53:57.624812] [INFO ] [MAIN ] Update Progress: 1852/2370 symbols completed. RYAN took 21.8s. Estimated remaining: 55m 2s. Rate: 9.4 symbols/min [2025-09-14T19:53:57.807630] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:57.813037] [DEBUG] [LOCAL ] RZB: Loaded 2877 existing records from primary storage. [2025-09-14T19:53:57.813163] [INFO ] [MAIN ] RZB: Loaded 2877 existing records. [2025-09-14T19:53:58.014025] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:58.014411] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-14T19:53:58.014482] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-14T19:53:58.014860] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-14T19:53:58.014923] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-14T19:53:58.181565] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-14T19:53:58.461191] [INFO ] [REMOTE ] RZB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:53:58.808674] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T19:53:58.813011] [INFO ] [REMOTE ] RYAM: Full fetch complete (37533 records). [2025-09-14T19:53:58.813125] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-14T19:53:58.968249] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-14T19:53:59.208688] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-14T19:53:59.209499] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-14T19:53:59.210098] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-14T19:53:59.211012] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-14T19:53:59.211205] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-14T19:53:59.218000] [DEBUG] [LOCAL ] RYAM: Trimmed 37533 records to 26099 (keeping 150 days of data) [2025-09-14T19:53:59.368685] [DEBUG] [LOCAL ] RYAM: Primary data saved (26099 records). [2025-09-14T19:53:59.368870] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-14T19:53:59.368983] [INFO ] [MAIN ] Update Progress: 1853/2370 symbols completed. RYAM took 29.9s. Estimated remaining: 54m 54s. Rate: 9.4 symbols/min [2025-09-14T19:53:59.541256] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:53:59.546063] [DEBUG] [LOCAL ] RZC: Loaded 3180 existing records from primary storage. [2025-09-14T19:53:59.546166] [INFO ] [MAIN ] RZC: Loaded 3180 existing records. [2025-09-14T19:53:59.718984] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:53:59.719206] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-14T19:53:59.719276] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-14T19:53:59.719535] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-14T19:53:59.719593] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-14T19:53:59.762347] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-14T19:53:59.829974] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T19:54:00.103212] [INFO ] [REMOTE ] RZC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:00.127826] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T19:54:00.558848] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-14T19:54:00.791776] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T19:54:01.358840] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-14T19:54:01.444092] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T19:54:02.158853] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-14T19:54:02.958887] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-14T19:54:03.758908] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-14T19:54:04.654031] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (3.30 seconds). [2025-09-14T19:54:04.659017] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-14T19:54:04.712130] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-14T19:54:05.178618] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T19:54:05.358838] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-14T19:54:05.726990] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-14T19:54:05.797524] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T19:54:06.011728] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T19:54:06.158930] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-14T19:54:06.797283] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T19:54:06.958897] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-14T19:54:07.758923] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-14T19:54:08.466354] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T19:54:08.558831] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-14T19:54:08.764302] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T19:54:09.358843] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-14T19:54:10.086306] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T19:54:10.113332] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:54:10.158793] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-14T19:54:10.958896] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-14T19:54:11.759467] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-14T19:54:11.761724] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T19:54:11.806313] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T19:54:12.558815] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-14T19:54:12.932703] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T19:54:13.295907] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-14T19:54:13.358791] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-14T19:54:14.058931] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T19:54:14.158848] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-14T19:54:14.902804] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T19:54:14.958823] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-14T19:54:15.758876] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-14T19:54:16.558875] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-14T19:54:17.140423] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T19:54:17.141559] [INFO ] [REMOTE ] RZB: Full fetch complete (6705 records). [2025-09-14T19:54:17.141669] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-14T19:54:17.330896] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T19:54:17.366496] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-14T19:54:17.416284] [INFO ] [REMOTE ] RYI: Full fetch complete (23585 records). [2025-09-14T19:54:17.445509] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-14T19:54:17.628859] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-14T19:54:17.639920] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-14T19:54:17.655762] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-14T19:54:17.679370] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-14T19:54:17.748894] [DEBUG] [LOCAL ] RZB: Trimmed 6705 records to 4775 (keeping 150 days of data) [2025-09-14T19:54:17.934533] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-14T19:54:17.935550] [DEBUG] [LOCAL ] RZB: Primary data saved (4775 records). [2025-09-14T19:54:17.935910] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-14T19:54:17.935708] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-14T19:54:17.936153] [INFO ] [MAIN ] Update Progress: 1854/2370 symbols completed. RZB took 20.3s. Estimated remaining: 54m 51s. Rate: 9.4 symbols/min [2025-09-14T19:54:17.936902] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-14T19:54:17.942455] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-14T19:54:18.039840] [DEBUG] [LOCAL ] RYI: Trimmed 23585 records to 16156 (keeping 150 days of data) [2025-09-14T19:54:18.184922] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:18.218424] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-09-14T19:54:18.236074] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-14T19:54:18.253587] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T19:54:18.270860] [DEBUG] [LOCAL ] S: Loaded 24018 existing records from primary storage. [2025-09-14T19:54:18.271786] [INFO ] [MAIN ] S: Loaded 24018 existing records. [2025-09-14T19:54:18.464686] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:18.467061] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-14T19:54:18.467957] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-14T19:54:18.469685] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-14T19:54:18.470583] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-14T19:54:18.642196] [DEBUG] [LOCAL ] RYI: Primary data saved (16156 records). [2025-09-14T19:54:18.693319] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-14T19:54:18.741805] [INFO ] [MAIN ] Update Progress: 1855/2370 symbols completed. RYI took 27.2s. Estimated remaining: 54m 44s. Rate: 9.4 symbols/min [2025-09-14T19:54:18.959967] [INFO ] [REMOTE ] S: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:18.960061] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-14T19:54:19.021337] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:19.034353] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T19:54:19.039168] [INFO ] [REMOTE ] RYN: Full fetch complete (49693 records). [2025-09-14T19:54:19.039320] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-14T19:54:19.172602] [DEBUG] [LOCAL ] SA: Loaded 19015 existing records from primary storage. [2025-09-14T19:54:19.196152] [INFO ] [MAIN ] SA: Loaded 19015 existing records. [2025-09-14T19:54:19.604118] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:19.616286] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-14T19:54:19.616530] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-14T19:54:19.616597] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-14T19:54:19.616744] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-14T19:54:19.617941] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-14T19:54:19.618070] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-14T19:54:19.618711] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-14T19:54:19.618915] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-14T19:54:19.682611] [DEBUG] [LOCAL ] RYN: Trimmed 49693 records to 34168 (keeping 150 days of data) [2025-09-14T19:54:19.782278] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-14T19:54:19.983595] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T19:54:20.130960] [INFO ] [REMOTE ] SA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:20.238595] [DEBUG] [LOCAL ] RYN: Primary data saved (34168 records). [2025-09-14T19:54:20.238815] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-14T19:54:20.238925] [INFO ] [MAIN ] Update Progress: 1856/2370 symbols completed. RYN took 27.2s. Estimated remaining: 54m 36s. Rate: 9.4 symbols/min [2025-09-14T19:54:20.408894] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:20.414726] [DEBUG] [LOCAL ] SABA: Loaded 4029 existing records from primary storage. [2025-09-14T19:54:20.414866] [INFO ] [MAIN ] SABA: Loaded 4029 existing records. [2025-09-14T19:54:20.564800] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-14T19:54:20.596227] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:20.597267] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-14T19:54:20.597335] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-14T19:54:20.597874] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-14T19:54:20.597937] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-14T19:54:20.949762] [INFO ] [REMOTE ] SABA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:21.358861] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-14T19:54:21.915886] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-14T19:54:22.045697] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:54:22.047491] [INFO ] [REMOTE ] RZC: Full fetch complete (7633 records). [2025-09-14T19:54:22.047609] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-14T19:54:22.164006] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-14T19:54:22.416326] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-14T19:54:22.416527] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-14T19:54:22.416851] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-14T19:54:22.416954] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-14T19:54:22.417572] [DEBUG] [LOCAL ] RZC: Trimmed 7633 records to 5053 (keeping 150 days of data) [2025-09-14T19:54:22.471995] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T19:54:22.473472] [DEBUG] [LOCAL ] RZC: Primary data saved (5053 records). [2025-09-14T19:54:22.482245] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-14T19:54:22.482392] [INFO ] [MAIN ] Update Progress: 1857/2370 symbols completed. RZC took 23.1s. Estimated remaining: 54m 28s. Rate: 9.4 symbols/min [2025-09-14T19:54:22.656999] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:22.674602] [DEBUG] [LOCAL ] SAFE: Loaded 14024 existing records from primary storage. [2025-09-14T19:54:22.674869] [INFO ] [MAIN ] SAFE: Loaded 14024 existing records. [2025-09-14T19:54:22.855328] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:22.855717] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-14T19:54:22.855793] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-14T19:54:22.856254] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-14T19:54:22.856314] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-14T19:54:22.962608] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-14T19:54:23.219224] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:23.226370] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T19:54:23.758894] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-14T19:54:24.558871] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-14T19:54:25.053493] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T19:54:25.358842] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-14T19:54:25.791433] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T19:54:26.158835] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-14T19:54:26.958849] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-14T19:54:27.137504] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-14T19:54:27.485946] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T19:54:27.484508] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T19:54:27.758846] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-14T19:54:27.774290] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T19:54:28.558836] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-14T19:54:29.358843] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-14T19:54:30.087360] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-14T19:54:30.147310] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T19:54:30.158762] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-14T19:54:30.958853] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-14T19:54:31.016175] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T19:54:31.758829] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-14T19:54:32.006027] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T19:54:32.558843] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-14T19:54:33.222034] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-14T19:54:33.311952] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T19:54:33.358851] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-14T19:54:33.535251] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T19:54:34.158845] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-14T19:54:34.958845] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-14T19:54:35.382493] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T19:54:35.758825] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-14T19:54:35.809929] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T19:54:36.435892] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-14T19:54:36.558792] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-14T19:54:36.921448] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T19:54:37.358851] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-14T19:54:38.158870] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-14T19:54:38.800559] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-14T19:54:38.958832] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-14T19:54:38.988374] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T19:54:39.156042] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T19:54:39.758839] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-14T19:54:40.558803] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-14T19:54:40.767761] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-14T19:54:40.773611] [INFO ] [REMOTE ] S: Full fetch complete (58200 records). [2025-09-14T19:54:40.773851] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-14T19:54:41.173880] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-14T19:54:41.174053] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-14T19:54:41.175985] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-14T19:54:41.176115] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-14T19:54:41.178123] [DEBUG] [LOCAL ] S: Trimmed 58200 records to 40297 (keeping 150 days of data) [2025-09-14T19:54:41.362728] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-14T19:54:41.433060] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T19:54:41.459283] [DEBUG] [LOCAL ] S: Primary data saved (40297 records). [2025-09-14T19:54:41.459615] [INFO ] [MAIN ] S: Full history saved. [2025-09-14T19:54:41.459813] [INFO ] [MAIN ] Update Progress: 1858/2370 symbols completed. S took 23.5s. Estimated remaining: 54m 25s. Rate: 9.4 symbols/min [2025-09-14T19:54:41.605715] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T19:54:41.698109] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:41.712522] [DEBUG] [LOCAL ] SAH: Loaded 9329 existing records from primary storage. [2025-09-14T19:54:41.712795] [INFO ] [MAIN ] SAH: Loaded 9329 existing records. [2025-09-14T19:54:41.898926] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:41.899338] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-14T19:54:41.899411] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-14T19:54:41.899971] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-14T19:54:41.900052] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-14T19:54:42.164556] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-14T19:54:42.314269] [INFO ] [REMOTE ] SAH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:42.856336] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T19:54:42.889044] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T19:54:42.958785] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-14T19:54:43.758863] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-14T19:54:43.773588] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T19:54:44.558837] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-14T19:54:45.030717] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T19:54:45.036178] [INFO ] [REMOTE ] SA: Full fetch complete (46531 records). [2025-09-14T19:54:45.036412] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-14T19:54:45.363926] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-14T19:54:45.382968] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T19:54:45.414072] [INFO ] [REMOTE ] SABA: Full fetch complete (10387 records). [2025-09-14T19:54:45.454403] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-14T19:54:45.454577] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-14T19:54:45.455087] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-14T19:54:45.500922] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-14T19:54:45.532143] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-14T19:54:45.566854] [DEBUG] [LOCAL ] SA: Trimmed 46531 records to 32071 (keeping 150 days of data) [2025-09-14T19:54:45.939715] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-14T19:54:45.940425] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-14T19:54:45.941557] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-14T19:54:45.942293] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-14T19:54:45.946275] [DEBUG] [LOCAL ] SABA: Trimmed 10387 records to 6842 (keeping 150 days of data) [2025-09-14T19:54:46.060112] [DEBUG] [LOCAL ] SABA: Primary data saved (6842 records). [2025-09-14T19:54:46.062513] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-14T19:54:46.063516] [INFO ] [MAIN ] Update Progress: 1859/2370 symbols completed. SABA took 25.8s. Estimated remaining: 54m 19s. Rate: 9.4 symbols/min [2025-09-14T19:54:46.165057] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-14T19:54:46.251450] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:46.257310] [DEBUG] [LOCAL ] SAJ: Loaded 329 existing records from primary storage. [2025-09-14T19:54:46.258670] [INFO ] [MAIN ] SAJ: Loaded 329 existing records. [2025-09-14T19:54:46.428731] [DEBUG] [LOCAL ] SA: Primary data saved (32071 records). [2025-09-14T19:54:46.449730] [WARN ] [MAIN ] SAJ: Insufficient historical data. Have data from 2025-06-17, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:46.449898] [INFO ] [MAIN ] SA: Full history saved. [2025-09-14T19:54:46.450180] [INFO ] [MAIN ] Update Progress: 1860/2370 symbols completed. SA took 27.7s. Estimated remaining: 54m 10s. Rate: 9.4 symbols/min [2025-09-14T19:54:46.450339] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-14T19:54:46.482737] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-14T19:54:46.526373] [DEBUG] [LOCAL ] SAJ: Deleted primary data file. [2025-09-14T19:54:46.552898] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-14T19:54:46.729019] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:46.919519] [DEBUG] [LOCAL ] SAM: Loaded 10949 existing records from primary storage. [2025-09-14T19:54:46.930437] [INFO ] [MAIN ] SAM: Loaded 10949 existing records. [2025-09-14T19:54:47.058749] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:54:47.065500] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T19:54:47.048526] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:47.079563] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-14T19:54:47.132866] [INFO ] [REMOTE ] SAFE: Full fetch complete (33249 records). [2025-09-14T19:54:47.144127] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-14T19:54:47.355693] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:47.371295] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-14T19:54:47.404349] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-14T19:54:47.405800] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-14T19:54:47.465787] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-14T19:54:47.681760] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-14T19:54:47.767012] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-14T19:54:47.857144] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-14T19:54:47.883341] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-14T19:54:47.908475] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-14T19:54:47.941727] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-14T19:54:47.975194] [DEBUG] [LOCAL ] SAFE: Trimmed 33249 records to 22773 (keeping 150 days of data) [2025-09-14T19:54:48.111229] [INFO ] [REMOTE ] SAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:48.204882] [DEBUG] [LOCAL ] SAFE: Primary data saved (22773 records). [2025-09-14T19:54:48.205089] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-14T19:54:48.205211] [INFO ] [MAIN ] Update Progress: 1861/2370 symbols completed. SAFE took 25.7s. Estimated remaining: 54m 3s. Rate: 9.4 symbols/min [2025-09-14T19:54:48.285118] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T19:54:48.416966] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:48.443030] [DEBUG] [LOCAL ] SAN: Loaded 23758 existing records from primary storage. [2025-09-14T19:54:48.443266] [INFO ] [MAIN ] SAN: Loaded 23758 existing records. [2025-09-14T19:54:48.560600] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-14T19:54:48.644396] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:48.644674] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-14T19:54:48.644741] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-14T19:54:48.645800] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-14T19:54:48.646102] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-14T19:54:49.011897] [INFO ] [REMOTE ] SAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:54:49.031042] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-14T19:54:49.358857] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-14T19:54:50.158913] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-14T19:54:50.546186] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T19:54:50.958861] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-14T19:54:51.200208] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T19:54:51.758934] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-14T19:54:51.822287] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T19:54:52.172187] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-14T19:54:52.558885] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-14T19:54:53.358882] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-14T19:54:54.158819] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-14T19:54:54.568009] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T19:54:54.572157] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T19:54:54.611150] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T19:54:54.958914] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-14T19:54:55.758890] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-14T19:54:56.558935] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-14T19:54:56.941581] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T19:54:56.955699] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T19:54:57.185605] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T19:54:57.358813] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-14T19:54:58.158895] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-14T19:54:58.663265] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T19:54:58.958867] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-14T19:54:59.260494] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T19:54:59.261427] [INFO ] [REMOTE ] SAJ: Full fetch complete (697 records). [2025-09-14T19:54:59.261554] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-14T19:54:59.456449] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-14T19:54:59.456765] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:54:59.456821] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:54:59.456876] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-14T19:54:59.456966] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-14T19:54:59.457027] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-14T19:54:59.457079] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-14T19:54:59.457196] [INFO ] [MAIN ] Update Progress: 1862/2370 symbols completed. SAJ took 13.4s. Estimated remaining: 53m 58s. Rate: 9.4 symbols/min [2025-09-14T19:54:59.625303] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:54:59.650547] [DEBUG] [LOCAL ] SAND: Loaded 23350 existing records from primary storage. [2025-09-14T19:54:59.650752] [INFO ] [MAIN ] SAND: Loaded 23350 existing records. [2025-09-14T19:54:59.763987] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-14T19:54:59.830824] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:54:59.831255] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-14T19:54:59.831327] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-14T19:54:59.832156] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-14T19:54:59.832224] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-14T19:55:00.119218] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T19:55:00.237235] [INFO ] [REMOTE ] SAND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:00.558832] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-14T19:55:00.724477] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T19:55:01.358891] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-14T19:55:02.016402] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T19:55:02.158879] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-14T19:55:02.580097] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T19:55:02.958847] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-14T19:55:03.758844] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-14T19:55:04.191035] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T19:55:04.558829] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-14T19:55:04.673397] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T19:55:04.907103] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T19:55:05.358898] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-14T19:55:05.613345] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T19:55:06.158857] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-14T19:55:06.542202] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:55:06.958894] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-14T19:55:07.758923] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-14T19:55:07.979635] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T19:55:08.558895] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-14T19:55:08.965138] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T19:55:09.049511] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T19:55:09.358869] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-14T19:55:09.923430] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:55:09.925990] [INFO ] [REMOTE ] SAH: Full fetch complete (24464 records). [2025-09-14T19:55:09.926283] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-14T19:55:10.163957] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-14T19:55:10.309604] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-14T19:55:10.309789] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-14T19:55:10.310569] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-14T19:55:10.310669] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-14T19:55:10.311396] [DEBUG] [LOCAL ] SAH: Trimmed 24464 records to 15981 (keeping 150 days of data) [2025-09-14T19:55:10.424205] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T19:55:10.468677] [DEBUG] [LOCAL ] SAH: Primary data saved (15981 records). [2025-09-14T19:55:10.468900] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-14T19:55:10.469047] [INFO ] [MAIN ] Update Progress: 1863/2370 symbols completed. SAH took 29.0s. Estimated remaining: 53m 53s. Rate: 9.4 symbols/min [2025-09-14T19:55:10.645149] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:10.668588] [DEBUG] [LOCAL ] SAP: Loaded 22285 existing records from primary storage. [2025-09-14T19:55:10.668805] [INFO ] [MAIN ] SAP: Loaded 22285 existing records. [2025-09-14T19:55:10.845398] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:10.846065] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-14T19:55:10.846188] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-14T19:55:10.846973] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-14T19:55:10.847040] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-14T19:55:10.963954] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-14T19:55:11.204282] [INFO ] [REMOTE ] SAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:11.625241] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T19:55:11.758836] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-14T19:55:12.558890] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-14T19:55:12.642060] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T19:55:12.756936] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:55:13.358833] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-14T19:55:14.158836] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-14T19:55:14.486348] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T19:55:14.958902] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-14T19:55:15.070323] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T19:55:15.233463] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T19:55:15.758875] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-14T19:55:16.316156] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T19:55:16.324880] [INFO ] [REMOTE ] SAN: Full fetch complete (57626 records). [2025-09-14T19:55:16.325144] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-14T19:55:16.564311] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-14T19:55:16.747320] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-14T19:55:16.747479] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-14T19:55:16.748887] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-14T19:55:16.748965] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-14T19:55:16.750609] [DEBUG] [LOCAL ] SAN: Trimmed 57626 records to 39900 (keeping 150 days of data) [2025-09-14T19:55:17.001676] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T19:55:17.029355] [DEBUG] [LOCAL ] SAN: Primary data saved (39900 records). [2025-09-14T19:55:17.029585] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-14T19:55:17.029751] [INFO ] [MAIN ] Update Progress: 1864/2370 symbols completed. SAN took 28.8s. Estimated remaining: 53m 46s. Rate: 9.4 symbols/min [2025-09-14T19:55:17.210811] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:17.220849] [DEBUG] [LOCAL ] SAR: Loaded 7718 existing records from primary storage. [2025-09-14T19:55:17.221023] [INFO ] [MAIN ] SAR: Loaded 7718 existing records. [2025-09-14T19:55:17.368469] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-14T19:55:17.409389] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:17.411342] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-14T19:55:17.411460] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-14T19:55:17.411951] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-14T19:55:17.412026] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-14T19:55:17.797744] [INFO ] [REMOTE ] SAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:17.834772] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T19:55:18.158893] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-14T19:55:18.958876] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-14T19:55:19.244603] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:55:19.483727] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-14T19:55:19.556399] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T19:55:19.561377] [INFO ] [REMOTE ] SAM: Full fetch complete (23812 records). [2025-09-14T19:55:19.561700] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-14T19:55:19.764208] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-14T19:55:20.100962] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-14T19:55:20.101169] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-14T19:55:20.102162] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-14T19:55:20.102280] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-14T19:55:20.103625] [DEBUG] [LOCAL ] SAM: Trimmed 23812 records to 16280 (keeping 150 days of data) [2025-09-14T19:55:20.219000] [DEBUG] [LOCAL ] SAM: Primary data saved (16280 records). [2025-09-14T19:55:20.219239] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-14T19:55:20.219413] [INFO ] [MAIN ] Update Progress: 1865/2370 symbols completed. SAM took 33.8s. Estimated remaining: 53m 39s. Rate: 9.4 symbols/min [2025-09-14T19:55:20.407093] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:20.448215] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T19:55:20.468054] [DEBUG] [LOCAL ] SARO: Loaded 21245 existing records from primary storage. [2025-09-14T19:55:20.468327] [INFO ] [MAIN ] SARO: Loaded 21245 existing records. [2025-09-14T19:55:20.564103] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-14T19:55:20.658140] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:20.658424] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-14T19:55:20.658492] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-14T19:55:20.659232] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-14T19:55:20.659307] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-14T19:55:21.010413] [INFO ] [REMOTE ] SARO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:21.358812] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-14T19:55:21.476778] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T19:55:22.158808] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-14T19:55:22.246626] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T19:55:22.958855] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-14T19:55:23.557567] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T19:55:23.758872] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-14T19:55:24.558850] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-14T19:55:24.843583] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T19:55:25.358882] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-14T19:55:25.564273] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T19:55:25.603306] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T19:55:26.158843] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-14T19:55:26.771720] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T19:55:26.800400] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T19:55:26.808690] [INFO ] [REMOTE ] SAND: Full fetch complete (56248 records). [2025-09-14T19:55:26.809036] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-14T19:55:26.964008] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-14T19:55:27.213058] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-14T19:55:27.213204] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-14T19:55:27.214425] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-14T19:55:27.214494] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-14T19:55:27.215997] [DEBUG] [LOCAL ] SAND: Trimmed 56248 records to 38913 (keeping 150 days of data) [2025-09-14T19:55:27.476505] [DEBUG] [LOCAL ] SAND: Primary data saved (38913 records). [2025-09-14T19:55:27.476734] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-14T19:55:27.476857] [INFO ] [MAIN ] Update Progress: 1866/2370 symbols completed. SAND took 28.0s. Estimated remaining: 53m 33s. Rate: 9.4 symbols/min [2025-09-14T19:55:27.648935] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:27.651434] [DEBUG] [LOCAL ] SAT: Loaded 470 existing records from primary storage. [2025-09-14T19:55:27.651526] [INFO ] [MAIN ] SAT: Loaded 470 existing records. [2025-09-14T19:55:27.761804] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-14T19:55:27.830620] [WARN ] [MAIN ] SAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:27.831050] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-14T19:55:27.831140] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-14T19:55:27.831353] [DEBUG] [LOCAL ] SAT: Deleted primary data file. [2025-09-14T19:55:27.831468] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-14T19:55:28.224195] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T19:55:28.229025] [INFO ] [REMOTE ] SAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:28.558830] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-14T19:55:28.929910] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T19:55:28.935116] [INFO ] [REMOTE ] SAP: Full fetch complete (54216 records). [2025-09-14T19:55:28.935242] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-14T19:55:29.314002] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-14T19:55:29.314120] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-14T19:55:29.315194] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-14T19:55:29.315253] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-14T19:55:29.316535] [DEBUG] [LOCAL ] SAP: Trimmed 54216 records to 37315 (keeping 150 days of data) [2025-09-14T19:55:29.372935] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-14T19:55:29.568206] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T19:55:29.594976] [DEBUG] [LOCAL ] SAP: Primary data saved (37315 records). [2025-09-14T19:55:29.595134] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-14T19:55:29.595232] [INFO ] [MAIN ] Update Progress: 1867/2370 symbols completed. SAP took 19.1s. Estimated remaining: 53m 25s. Rate: 9.4 symbols/min [2025-09-14T19:55:29.763821] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:29.766018] [DEBUG] [LOCAL ] SAY: Loaded 387 existing records from primary storage. [2025-09-14T19:55:29.766108] [INFO ] [MAIN ] SAY: Loaded 387 existing records. [2025-09-14T19:55:29.941196] [WARN ] [MAIN ] SAY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:29.941453] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-14T19:55:29.941512] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-14T19:55:29.941737] [DEBUG] [LOCAL ] SAY: Deleted primary data file. [2025-09-14T19:55:29.941800] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-14T19:55:30.042450] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T19:55:30.164008] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-14T19:55:30.312792] [INFO ] [REMOTE ] SAY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:30.958888] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-14T19:55:31.431414] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T19:55:31.758899] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-14T19:55:32.008475] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T19:55:32.558924] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-14T19:55:32.823908] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T19:55:33.358885] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-14T19:55:33.755522] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-14T19:55:33.904228] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T19:55:34.158876] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-14T19:55:34.535952] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-14T19:55:34.958835] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-14T19:55:35.758880] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-14T19:55:36.558839] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-14T19:55:36.743340] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:55:36.833476] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T19:55:36.927306] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T19:55:37.358837] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-14T19:55:37.757364] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T19:55:38.158854] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-14T19:55:38.566392] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-14T19:55:38.958846] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-14T19:55:39.339211] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T19:55:39.758852] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-14T19:55:40.558856] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-14T19:55:40.958594] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T19:55:41.114509] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T19:55:41.358880] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-14T19:55:41.670439] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-14T19:55:42.158886] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-14T19:55:42.958895] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-14T19:55:43.373546] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T19:55:43.749571] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T19:55:43.759149] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-14T19:55:44.558859] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-14T19:55:44.869460] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T19:55:44.970036] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-14T19:55:45.358846] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-14T19:55:45.783884] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-14T19:55:46.158894] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-14T19:55:46.958857] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-14T19:55:47.090415] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T19:55:47.092873] [INFO ] [REMOTE ] SAR: Full fetch complete (18132 records). [2025-09-14T19:55:47.092972] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-14T19:55:47.386079] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:55:47.402777] [INFO ] [REMOTE ] SAY: Full fetch complete (1049 records). [2025-09-14T19:55:47.426801] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-14T19:55:47.549218] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-14T19:55:47.571137] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-14T19:55:47.583034] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-14T19:55:47.609926] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-14T19:55:47.666994] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 145 unique days, need 150 days [2025-09-14T19:55:47.667881] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:55:47.667965] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:55:47.668058] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-14T19:55:47.667756] [DEBUG] [LOCAL ] SAR: Trimmed 18132 records to 12203 (keeping 150 days of data) [2025-09-14T19:55:47.668273] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-14T19:55:47.669168] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-14T19:55:47.669264] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-14T19:55:47.669373] [INFO ] [MAIN ] Update Progress: 1868/2370 symbols completed. SAY took 18.1s. Estimated remaining: 53m 22s. Rate: 9.4 symbols/min [2025-09-14T19:55:47.768966] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-14T19:55:47.934545] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:47.945702] [DEBUG] [LOCAL ] SAZ: Loaded 398 existing records from primary storage. [2025-09-14T19:55:47.946435] [INFO ] [MAIN ] SAZ: Loaded 398 existing records. [2025-09-14T19:55:48.123933] [DEBUG] [LOCAL ] SAR: Primary data saved (12203 records). [2025-09-14T19:55:48.141252] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-14T19:55:48.144981] [INFO ] [MAIN ] Update Progress: 1869/2370 symbols completed. SAR took 31.1s. Estimated remaining: 53m 14s. Rate: 9.4 symbols/min [2025-09-14T19:55:48.144716] [WARN ] [MAIN ] SAZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:48.216827] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-14T19:55:48.244957] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-14T19:55:48.262270] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T19:55:48.278685] [DEBUG] [LOCAL ] SAZ: Deleted primary data file. [2025-09-14T19:55:48.317543] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-14T19:55:48.348408] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:48.587135] [DEBUG] [LOCAL ] SB: Loaded 14607 existing records from primary storage. [2025-09-14T19:55:48.563970] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-14T19:55:48.635838] [INFO ] [MAIN ] SB: Loaded 14607 existing records. [2025-09-14T19:55:48.870116] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:48.941687] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:48.942035] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-14T19:55:48.942102] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-14T19:55:48.942848] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-14T19:55:48.942941] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-14T19:55:49.212401] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:55:49.244991] [INFO ] [REMOTE ] SAT: Full fetch complete (1147 records). [2025-09-14T19:55:49.251136] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-14T19:55:49.380495] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-14T19:55:49.406250] [INFO ] [REMOTE ] SB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:49.534874] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-14T19:55:49.535121] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:55:49.535177] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:55:49.535231] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-14T19:55:49.535330] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-14T19:55:49.535384] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-14T19:55:49.535438] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-14T19:55:49.535557] [INFO ] [MAIN ] Update Progress: 1870/2370 symbols completed. SAT took 22.1s. Estimated remaining: 53m 7s. Rate: 9.4 symbols/min [2025-09-14T19:55:49.714812] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:49.717519] [DEBUG] [LOCAL ] SBDS: Loaded 829 existing records from primary storage. [2025-09-14T19:55:49.717609] [INFO ] [MAIN ] SBDS: Loaded 829 existing records. [2025-09-14T19:55:49.895160] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T19:55:49.922023] [WARN ] [MAIN ] SBDS: Insufficient historical data. Have data from 2025-07-24, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:49.922381] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-14T19:55:49.922454] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-14T19:55:49.922805] [DEBUG] [LOCAL ] SBDS: Deleted primary data file. [2025-09-14T19:55:49.922875] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-14T19:55:50.164172] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-14T19:55:50.282799] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:50.714543] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T19:55:50.958906] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-14T19:55:51.216902] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:55:51.217276] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-14T19:55:51.758887] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-14T19:55:52.218292] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T19:55:52.558840] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-14T19:55:53.055770] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-14T19:55:53.358913] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-14T19:55:53.619620] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:55:53.620031] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-14T19:55:54.158888] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-14T19:55:54.958867] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-14T19:55:55.504615] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T19:55:55.758874] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-14T19:55:55.966112] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T19:55:55.971060] [INFO ] [REMOTE ] SARO: Full fetch complete (52166 records). [2025-09-14T19:55:55.971175] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-14T19:55:56.066615] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:55:56.083613] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-14T19:55:56.353473] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-14T19:55:56.353584] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-14T19:55:56.354695] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-14T19:55:56.354755] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-14T19:55:56.356074] [DEBUG] [LOCAL ] SARO: Trimmed 52166 records to 36248 (keeping 150 days of data) [2025-09-14T19:55:56.558851] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-14T19:55:56.586354] [DEBUG] [LOCAL ] SARO: Primary data saved (36248 records). [2025-09-14T19:55:56.586545] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-14T19:55:56.586687] [INFO ] [MAIN ] Update Progress: 1871/2370 symbols completed. SARO took 36.4s. Estimated remaining: 53m 0s. Rate: 9.4 symbols/min [2025-09-14T19:55:56.755297] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:55:56.777793] [DEBUG] [LOCAL ] SBH: Loaded 22239 existing records from primary storage. [2025-09-14T19:55:56.777963] [INFO ] [MAIN ] SBH: Loaded 22239 existing records. [2025-09-14T19:55:56.964371] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:55:56.964679] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-14T19:55:56.966352] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-14T19:55:56.966441] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-14T19:55:56.967299] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-14T19:55:56.967362] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-14T19:55:57.325127] [INFO ] [REMOTE ] SBH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:55:57.358799] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-14T19:55:58.158846] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-14T19:55:58.430047] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:55:58.430380] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-14T19:55:58.958853] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-14T19:55:59.019596] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:55:59.758872] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-14T19:56:00.079129] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-14T19:56:00.391020] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T19:56:00.558831] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-14T19:56:01.358838] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-14T19:56:01.684456] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:56:01.684832] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-14T19:56:02.158800] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-14T19:56:02.563067] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T19:56:02.594321] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T19:56:02.958875] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-14T19:56:03.758880] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-14T19:56:04.402228] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T19:56:04.558853] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-14T19:56:04.871782] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T19:56:04.983103] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-14T19:56:05.358849] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-14T19:56:06.158844] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-14T19:56:06.578899] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T19:56:06.579855] [INFO ] [REMOTE ] SAZ: Full fetch complete (1495 records). [2025-09-14T19:56:06.579946] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-14T19:56:06.763136] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:56:06.763472] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:56:06.763558] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:56:06.763655] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-14T19:56:06.763852] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-14T19:56:06.763941] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-14T19:56:06.764048] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-14T19:56:06.764175] [INFO ] [MAIN ] Update Progress: 1872/2370 symbols completed. SAZ took 19.1s. Estimated remaining: 52m 55s. Rate: 9.4 symbols/min [2025-09-14T19:56:06.906441] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T19:56:06.963900] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-14T19:56:06.967801] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:06.975352] [DEBUG] [LOCAL ] SBI: Loaded 3190 existing records from primary storage. [2025-09-14T19:56:06.975510] [INFO ] [MAIN ] SBI: Loaded 3190 existing records. [2025-09-14T19:56:07.161036] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:07.161302] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-14T19:56:07.161367] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-14T19:56:07.161588] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-14T19:56:07.161672] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-14T19:56:07.515118] [INFO ] [REMOTE ] SBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:07.758832] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-14T19:56:08.313634] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T19:56:08.314710] [INFO ] [REMOTE ] SBDS: Full fetch complete (829 records). [2025-09-14T19:56:08.314795] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-14T19:56:08.494535] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 36 unique days, need 150 days [2025-09-14T19:56:08.494791] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:56:08.494885] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:56:08.494937] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-14T19:56:08.495004] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-14T19:56:08.495052] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-14T19:56:08.495100] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-14T19:56:08.495189] [INFO ] [MAIN ] Update Progress: 1873/2370 symbols completed. SBDS took 19.0s. Estimated remaining: 52m 47s. Rate: 9.4 symbols/min [2025-09-14T19:56:08.563907] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-14T19:56:08.678508] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:08.685424] [DEBUG] [LOCAL ] SBR: Loaded 3404 existing records from primary storage. [2025-09-14T19:56:08.685564] [INFO ] [MAIN ] SBR: Loaded 3404 existing records. [2025-09-14T19:56:08.863553] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:08.864090] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-14T19:56:08.864221] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-14T19:56:08.864610] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-14T19:56:08.864703] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-14T19:56:09.188388] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T19:56:09.282998] [INFO ] [REMOTE ] SBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:09.358857] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-14T19:56:09.541776] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T19:56:10.158883] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-14T19:56:10.958875] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-14T19:56:11.061106] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T19:56:11.065743] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T19:56:11.758878] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-14T19:56:12.472144] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T19:56:12.561374] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-14T19:56:12.652083] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T19:56:13.358843] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-14T19:56:13.373206] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:56:13.989198] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T19:56:14.158904] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-14T19:56:14.958864] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-14T19:56:15.545976] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T19:56:15.763986] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-14T19:56:15.775239] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T19:56:16.558862] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-14T19:56:16.581968] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T19:56:17.358836] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-14T19:56:17.813952] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T19:56:18.067031] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T19:56:18.158842] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-14T19:56:18.958839] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-14T19:56:19.381971] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T19:56:19.758835] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-14T19:56:19.776323] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T19:56:20.558829] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-14T19:56:20.610072] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T19:56:21.358796] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-14T19:56:21.730170] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T19:56:21.733724] [INFO ] [REMOTE ] SB: Full fetch complete (37360 records). [2025-09-14T19:56:21.733839] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-14T19:56:22.120367] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-14T19:56:22.120510] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-14T19:56:22.121418] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-14T19:56:22.121474] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-14T19:56:22.122490] [DEBUG] [LOCAL ] SB: Trimmed 37360 records to 24605 (keeping 150 days of data) [2025-09-14T19:56:22.173600] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-14T19:56:22.271998] [DEBUG] [LOCAL ] SB: Primary data saved (24605 records). [2025-09-14T19:56:22.272192] [INFO ] [MAIN ] SB: Full history saved. [2025-09-14T19:56:22.272327] [INFO ] [MAIN ] Update Progress: 1874/2370 symbols completed. SB took 34.1s. Estimated remaining: 52m 43s. Rate: 9.4 symbols/min [2025-09-14T19:56:22.441483] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:22.464341] [DEBUG] [LOCAL ] SBS: Loaded 21929 existing records from primary storage. [2025-09-14T19:56:22.464541] [INFO ] [MAIN ] SBS: Loaded 21929 existing records. [2025-09-14T19:56:22.645989] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:22.646335] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-14T19:56:22.646420] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-14T19:56:22.647290] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-14T19:56:22.647383] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-14T19:56:22.968110] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-14T19:56:23.014294] [INFO ] [REMOTE ] SBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:23.015006] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T19:56:23.055612] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T19:56:23.510259] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T19:56:23.511812] [INFO ] [REMOTE ] SBR: Full fetch complete (7957 records). [2025-09-14T19:56:23.511927] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-14T19:56:23.764212] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-14T19:56:23.893243] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-14T19:56:23.893363] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-14T19:56:23.893681] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-14T19:56:23.893781] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-14T19:56:23.894296] [DEBUG] [LOCAL ] SBR: Trimmed 7957 records to 5266 (keeping 150 days of data) [2025-09-14T19:56:23.930523] [DEBUG] [LOCAL ] SBR: Primary data saved (5266 records). [2025-09-14T19:56:23.930738] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-14T19:56:23.930867] [INFO ] [MAIN ] Update Progress: 1875/2370 symbols completed. SBR took 15.4s. Estimated remaining: 52m 35s. Rate: 9.4 symbols/min [2025-09-14T19:56:24.103057] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:24.111555] [DEBUG] [LOCAL ] SBSI: Loaded 6582 existing records from primary storage. [2025-09-14T19:56:24.111719] [INFO ] [MAIN ] SBSI: Loaded 6582 existing records. [2025-09-14T19:56:24.306577] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:24.306887] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-14T19:56:24.306972] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-14T19:56:24.307318] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-14T19:56:24.307416] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-14T19:56:24.567032] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-14T19:56:24.671520] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:25.344203] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T19:56:25.358767] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-14T19:56:25.434290] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T19:56:26.158927] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-14T19:56:26.201381] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T19:56:26.958859] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-14T19:56:27.460027] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-14T19:56:27.758971] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-14T19:56:27.948816] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T19:56:28.558884] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-14T19:56:29.358896] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-14T19:56:29.493087] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:56:29.514414] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T19:56:30.153629] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T19:56:30.158770] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-14T19:56:30.719516] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:56:30.720948] [INFO ] [REMOTE ] SBI: Full fetch complete (8210 records). [2025-09-14T19:56:30.721196] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-14T19:56:30.968612] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-14T19:56:31.090253] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-14T19:56:31.090375] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-14T19:56:31.090622] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-14T19:56:31.090696] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-14T19:56:31.091143] [DEBUG] [LOCAL ] SBI: Trimmed 8210 records to 5659 (keeping 150 days of data) [2025-09-14T19:56:31.125118] [DEBUG] [LOCAL ] SBI: Primary data saved (5659 records). [2025-09-14T19:56:31.125287] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-14T19:56:31.125443] [INFO ] [MAIN ] Update Progress: 1876/2370 symbols completed. SBI took 24.4s. Estimated remaining: 52m 29s. Rate: 9.4 symbols/min [2025-09-14T19:56:31.296760] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:31.320676] [DEBUG] [LOCAL ] SBSW: Loaded 23821 existing records from primary storage. [2025-09-14T19:56:31.320881] [INFO ] [MAIN ] SBSW: Loaded 23821 existing records. [2025-09-14T19:56:31.498895] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:31.499232] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-14T19:56:31.499312] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-14T19:56:31.500243] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-14T19:56:31.500320] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-14T19:56:31.764075] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-14T19:56:31.861980] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:32.484234] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:56:32.489629] [INFO ] [REMOTE ] SBH: Full fetch complete (54310 records). [2025-09-14T19:56:32.489774] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-14T19:56:32.565217] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-14T19:56:32.882538] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-14T19:56:32.882870] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-14T19:56:32.884140] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-14T19:56:32.884218] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-14T19:56:32.885791] [DEBUG] [LOCAL ] SBH: Trimmed 54310 records to 37080 (keeping 150 days of data) [2025-09-14T19:56:33.017748] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-14T19:56:33.174081] [DEBUG] [LOCAL ] SBH: Primary data saved (37080 records). [2025-09-14T19:56:33.174298] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-14T19:56:33.174448] [INFO ] [MAIN ] Update Progress: 1877/2370 symbols completed. SBH took 36.6s. Estimated remaining: 52m 22s. Rate: 9.4 symbols/min [2025-09-14T19:56:33.358885] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-14T19:56:34.158916] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-14T19:56:34.599700] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T19:56:34.738234] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T19:56:34.958864] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-14T19:56:35.328003] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T19:56:35.758905] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-14T19:56:36.558908] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-14T19:56:36.599223] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T19:56:36.654369] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T19:56:37.358865] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-14T19:56:38.158875] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-14T19:56:38.237699] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T19:56:38.318203] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T19:56:38.958848] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-14T19:56:39.758817] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-14T19:56:39.855988] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T19:56:40.044587] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T19:56:40.558894] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-14T19:56:41.358903] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-14T19:56:41.536092] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T19:56:41.988908] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T19:56:42.158923] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-14T19:56:42.354058] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T19:56:42.958845] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-14T19:56:43.444532] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T19:56:43.446608] [INFO ] [REMOTE ] SBSI: Full fetch complete (15619 records). [2025-09-14T19:56:43.446731] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-14T19:56:43.759395] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-14T19:56:43.843758] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-14T19:56:43.843868] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-14T19:56:43.844285] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-14T19:56:43.844347] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-14T19:56:43.844932] [DEBUG] [LOCAL ] SBSI: Trimmed 15619 records to 10587 (keeping 150 days of data) [2025-09-14T19:56:43.912768] [DEBUG] [LOCAL ] SBSI: Primary data saved (10587 records). [2025-09-14T19:56:43.912982] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-14T19:56:43.913160] [INFO ] [MAIN ] Update Progress: 1878/2370 symbols completed. SBSI took 20.0s. Estimated remaining: 52m 16s. Rate: 9.4 symbols/min [2025-09-14T19:56:43.949955] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:56:44.558872] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-14T19:56:45.085095] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T19:56:45.092468] [INFO ] [REMOTE ] SBS: Full fetch complete (53305 records). [2025-09-14T19:56:45.092717] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-14T19:56:45.529614] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-14T19:56:45.529785] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-14T19:56:45.530973] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-14T19:56:45.531032] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-14T19:56:45.532344] [DEBUG] [LOCAL ] SBS: Trimmed 53305 records to 37095 (keeping 150 days of data) [2025-09-14T19:56:45.770450] [DEBUG] [LOCAL ] SBS: Primary data saved (37095 records). [2025-09-14T19:56:45.770631] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-14T19:56:45.770761] [INFO ] [MAIN ] Update Progress: 1879/2370 symbols completed. SBS took 23.5s. Estimated remaining: 52m 9s. Rate: 9.4 symbols/min [2025-09-14T19:56:46.366811] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T19:56:46.378255] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-14T19:56:48.459314] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T19:56:48.471547] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-14T19:56:50.089330] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:56:50.101502] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-14T19:56:51.702762] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T19:56:51.708529] [INFO ] [REMOTE ] SBSW: Full fetch complete (57479 records). [2025-09-14T19:56:51.708721] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-14T19:56:52.127018] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-14T19:56:52.127168] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-14T19:56:52.128651] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-14T19:56:52.128730] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-14T19:56:52.132243] [DEBUG] [LOCAL ] SBSW: Trimmed 57479 records to 39957 (keeping 150 days of data) [2025-09-14T19:56:52.408366] [DEBUG] [LOCAL ] SBSW: Primary data saved (39957 records). [2025-09-14T19:56:52.408603] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-14T19:56:52.408801] [INFO ] [MAIN ] Update Progress: 1880/2370 symbols completed. SBSW took 21.3s. Estimated remaining: 52m 3s. Rate: 9.4 symbols/min [2025-09-14T19:56:53.099758] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:53.109601] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:53.139120] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:53.164806] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:56:53.182635] [DEBUG] [LOCAL ] SBXD: Loaded 2170 existing records from primary storage. [2025-09-14T19:56:53.182857] [INFO ] [MAIN ] SBXD: Loaded 2170 existing records. [2025-09-14T19:56:53.312003] [DEBUG] [LOCAL ] SCD: Loaded 7294 existing records from primary storage. [2025-09-14T19:56:53.316591] [DEBUG] [LOCAL ] SCCO: Loaded 21768 existing records from primary storage. [2025-09-14T19:56:53.329215] [INFO ] [MAIN ] SCCO: Loaded 21768 existing records. [2025-09-14T19:56:53.339847] [DEBUG] [LOCAL ] SCHW: Loaded 24098 existing records from primary storage. [2025-09-14T19:56:53.356067] [INFO ] [MAIN ] SCHW: Loaded 24098 existing records. [2025-09-14T19:56:53.340030] [INFO ] [MAIN ] SCD: Loaded 7294 existing records. [2025-09-14T19:56:53.474111] [WARN ] [MAIN ] SBXD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:53.680310] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-14T19:56:53.768407] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-14T19:56:53.968068] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:53.985185] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:53.995760] [DEBUG] [LOCAL ] SBXD: Deleted primary data file. [2025-09-14T19:56:53.996395] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:56:53.996734] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-14T19:56:53.997020] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-14T19:56:53.997764] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-14T19:56:53.997700] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-14T19:56:53.997846] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-14T19:56:54.044864] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-14T19:56:54.045016] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-14T19:56:54.078972] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-14T19:56:54.104671] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-14T19:56:54.111428] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-14T19:56:54.122116] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-14T19:56:54.111253] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-14T19:56:54.177685] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-14T19:56:55.403939] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:55.568802] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:55.520157] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-14T19:56:55.627319] [INFO ] [REMOTE ] SCD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:55.660225] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-14T19:56:55.678140] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-14T19:56:55.683696] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:56:55.685078] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-14T19:56:56.057274] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T19:56:56.058354] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-14T19:56:56.348892] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-14T19:56:56.350051] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-14T19:56:56.519191] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T19:56:56.520875] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T19:56:56.534515] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-14T19:56:56.534010] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-14T19:56:56.611486] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-14T19:56:56.612480] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-14T19:56:56.970612] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-14T19:56:56.971845] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-14T19:56:57.368620] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T19:56:57.378362] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-14T19:56:57.393299] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T19:56:57.396156] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-14T19:56:57.475913] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T19:56:57.487765] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-14T19:56:57.768954] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T19:56:58.158858] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-14T19:56:58.256129] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:56:58.477065] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T19:56:58.553138] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-14T19:56:58.827623] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T19:56:58.958837] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-14T19:56:59.442752] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-14T19:56:59.758878] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-14T19:57:00.120732] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T19:57:00.121563] [INFO ] [REMOTE ] SBXD: Full fetch complete (2925 records). [2025-09-14T19:57:00.121672] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-14T19:57:00.305347] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 135 unique days, need 150 days [2025-09-14T19:57:00.306101] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:57:00.306264] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:57:00.306329] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-14T19:57:00.306438] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-14T19:57:00.306513] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-14T19:57:00.306572] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-14T19:57:00.306761] [INFO ] [MAIN ] Update Progress: 1881/2370 symbols completed. SBXD took 7.9s. Estimated remaining: 51m 57s. Rate: 9.4 symbols/min [2025-09-14T19:57:00.485515] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:00.510795] [DEBUG] [LOCAL ] SCI: Loaded 20413 existing records from primary storage. [2025-09-14T19:57:00.510993] [INFO ] [MAIN ] SCI: Loaded 20413 existing records. [2025-09-14T19:57:00.566316] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-14T19:57:00.694836] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:00.695101] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-14T19:57:00.695162] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-14T19:57:00.695798] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-14T19:57:00.695860] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-14T19:57:01.047033] [INFO ] [REMOTE ] SCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:01.358830] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-14T19:57:02.158872] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-14T19:57:02.741741] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-14T19:57:02.958832] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-14T19:57:03.454924] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-14T19:57:03.758889] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-14T19:57:04.577503] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-14T19:57:04.585188] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-14T19:57:05.039204] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T19:57:05.360187] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-14T19:57:05.663543] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-14T19:57:05.781997] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T19:57:06.036829] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T19:57:06.158873] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-14T19:57:06.958866] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-14T19:57:07.035277] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T19:57:07.758916] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-14T19:57:08.291236] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T19:57:08.558877] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-14T19:57:09.358878] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-14T19:57:09.392987] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T19:57:10.158849] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-14T19:57:10.293379] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T19:57:10.356939] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T19:57:10.958875] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-14T19:57:11.758914] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-14T19:57:11.833228] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:57:11.909794] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T19:57:12.558856] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-14T19:57:13.011249] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T19:57:13.017201] [INFO ] [REMOTE ] SCHW: Full fetch complete (58365 records). [2025-09-14T19:57:13.017362] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-14T19:57:13.359606] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-14T19:57:13.407297] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-14T19:57:13.408570] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-14T19:57:13.409774] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-14T19:57:13.409998] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-14T19:57:13.411718] [DEBUG] [LOCAL ] SCHW: Trimmed 58365 records to 40425 (keeping 150 days of data) [2025-09-14T19:57:13.443840] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T19:57:13.712884] [DEBUG] [LOCAL ] SCHW: Primary data saved (40425 records). [2025-09-14T19:57:13.713066] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-14T19:57:13.713181] [INFO ] [MAIN ] Update Progress: 1882/2370 symbols completed. SCHW took 21.3s. Estimated remaining: 51m 52s. Rate: 9.4 symbols/min [2025-09-14T19:57:13.881366] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:13.889326] [DEBUG] [LOCAL ] SCL: Loaded 6260 existing records from primary storage. [2025-09-14T19:57:13.889472] [INFO ] [MAIN ] SCL: Loaded 6260 existing records. [2025-09-14T19:57:14.091239] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:14.091550] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-14T19:57:14.091609] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-14T19:57:14.092047] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-14T19:57:14.092126] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-14T19:57:14.161328] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-14T19:57:14.225081] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T19:57:14.319669] [INFO ] [REMOTE ] SCD: Full fetch complete (13066 records). [2025-09-14T19:57:14.368135] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-14T19:57:14.557028] [INFO ] [REMOTE ] SCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:14.815891] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-14T19:57:14.816013] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-14T19:57:14.816517] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-14T19:57:14.816585] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-14T19:57:14.817147] [DEBUG] [LOCAL ] SCD: Trimmed 13066 records to 10340 (keeping 150 days of data) [2025-09-14T19:57:14.885675] [DEBUG] [LOCAL ] SCD: Primary data saved (10340 records). [2025-09-14T19:57:14.885856] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-14T19:57:14.885980] [INFO ] [MAIN ] Update Progress: 1883/2370 symbols completed. SCD took 22.5s. Estimated remaining: 51m 44s. Rate: 9.4 symbols/min [2025-09-14T19:57:14.963905] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-14T19:57:15.062876] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:15.075110] [DEBUG] [LOCAL ] SCM: Loaded 8538 existing records from primary storage. [2025-09-14T19:57:15.075253] [INFO ] [MAIN ] SCM: Loaded 8538 existing records. [2025-09-14T19:57:15.249661] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:15.249966] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-14T19:57:15.250028] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-14T19:57:15.250434] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-14T19:57:15.250496] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-14T19:57:15.601880] [INFO ] [REMOTE ] SCM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:15.758784] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-14T19:57:16.518841] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-14T19:57:16.558773] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-14T19:57:16.959906] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T19:57:17.141811] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-14T19:57:17.358839] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-14T19:57:18.158853] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-14T19:57:18.439465] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T19:57:18.916852] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-14T19:57:18.958777] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-14T19:57:19.607498] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T19:57:19.613260] [INFO ] [REMOTE ] SCCO: Full fetch complete (53645 records). [2025-09-14T19:57:19.613434] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-14T19:57:19.767695] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-14T19:57:20.005941] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-14T19:57:20.006122] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-14T19:57:20.007601] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-14T19:57:20.007689] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-14T19:57:20.009395] [DEBUG] [LOCAL ] SCCO: Trimmed 53645 records to 36751 (keeping 150 days of data) [2025-09-14T19:57:20.257301] [DEBUG] [LOCAL ] SCCO: Primary data saved (36751 records). [2025-09-14T19:57:20.257503] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-14T19:57:20.257660] [INFO ] [MAIN ] Update Progress: 1884/2370 symbols completed. SCCO took 27.8s. Estimated remaining: 51m 38s. Rate: 9.4 symbols/min [2025-09-14T19:57:20.429567] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:20.451678] [DEBUG] [LOCAL ] SCS: Loaded 20366 existing records from primary storage. [2025-09-14T19:57:20.451897] [INFO ] [MAIN ] SCS: Loaded 20366 existing records. [2025-09-14T19:57:20.559312] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-14T19:57:20.635803] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:20.636274] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-14T19:57:20.661291] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-14T19:57:20.664999] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-14T19:57:20.665079] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-14T19:57:20.666754] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T19:57:21.053974] [INFO ] [REMOTE ] SCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:21.067443] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T19:57:21.359197] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-14T19:57:21.528871] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T19:57:22.158896] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-14T19:57:22.649848] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T19:57:22.958898] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-14T19:57:23.634951] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T19:57:23.758889] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-14T19:57:23.795571] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T19:57:24.558851] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-14T19:57:24.916573] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-14T19:57:25.358853] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-14T19:57:25.569729] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T19:57:26.053955] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:57:26.058953] [INFO ] [REMOTE ] SCI: Full fetch complete (51286 records). [2025-09-14T19:57:26.059143] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-14T19:57:26.159526] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-14T19:57:26.438279] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-14T19:57:26.438389] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-14T19:57:26.439514] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-14T19:57:26.439575] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-14T19:57:26.440779] [DEBUG] [LOCAL ] SCI: Trimmed 51286 records to 35142 (keeping 150 days of data) [2025-09-14T19:57:26.671414] [DEBUG] [LOCAL ] SCI: Primary data saved (35142 records). [2025-09-14T19:57:26.671674] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-14T19:57:26.671804] [INFO ] [MAIN ] Update Progress: 1885/2370 symbols completed. SCI took 26.4s. Estimated remaining: 51m 31s. Rate: 9.4 symbols/min [2025-09-14T19:57:26.848301] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:26.863675] [DEBUG] [LOCAL ] SD: Loaded 12252 existing records from primary storage. [2025-09-14T19:57:26.863956] [INFO ] [MAIN ] SD: Loaded 12252 existing records. [2025-09-14T19:57:26.963918] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-14T19:57:27.063486] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:27.063867] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-14T19:57:27.063931] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-14T19:57:27.064522] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-14T19:57:27.064588] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-14T19:57:27.323928] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T19:57:27.492445] [INFO ] [REMOTE ] SD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:27.758889] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-14T19:57:28.085719] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T19:57:28.558890] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-14T19:57:28.856466] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T19:57:29.358795] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-14T19:57:29.631272] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T19:57:30.158895] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-14T19:57:30.901303] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T19:57:30.958875] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-14T19:57:31.032477] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T19:57:31.758862] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-14T19:57:32.180938] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T19:57:32.558941] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-14T19:57:32.744396] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T19:57:33.358884] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-14T19:57:33.635863] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T19:57:34.158854] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-14T19:57:34.535699] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:57:34.958933] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-14T19:57:35.650581] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T19:57:35.658185] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:57:35.668726] [INFO ] [REMOTE ] SCL: Full fetch complete (15810 records). [2025-09-14T19:57:35.668884] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-14T19:57:35.768053] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-14T19:57:36.054384] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-14T19:57:36.054499] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-14T19:57:36.054972] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-14T19:57:36.055033] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-14T19:57:36.055596] [DEBUG] [LOCAL ] SCL: Trimmed 15810 records to 10822 (keeping 150 days of data) [2025-09-14T19:57:36.124040] [DEBUG] [LOCAL ] SCL: Primary data saved (10822 records). [2025-09-14T19:57:36.124239] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-14T19:57:36.124364] [INFO ] [MAIN ] Update Progress: 1886/2370 symbols completed. SCL took 22.4s. Estimated remaining: 51m 26s. Rate: 9.4 symbols/min [2025-09-14T19:57:36.296171] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:36.302924] [DEBUG] [LOCAL ] SDHC: Loaded 4834 existing records from primary storage. [2025-09-14T19:57:36.303072] [INFO ] [MAIN ] SDHC: Loaded 4834 existing records. [2025-09-14T19:57:36.477042] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:36.477319] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-14T19:57:36.477384] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-14T19:57:36.477712] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-14T19:57:36.477773] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-14T19:57:36.564112] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-14T19:57:36.835785] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:37.358875] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-14T19:57:37.412014] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T19:57:37.932938] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T19:57:38.158885] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-14T19:57:38.219761] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T19:57:38.958884] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-14T19:57:39.081808] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T19:57:39.084362] [INFO ] [REMOTE ] SCM: Full fetch complete (21550 records). [2025-09-14T19:57:39.084478] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-14T19:57:39.475725] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-14T19:57:39.475907] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-14T19:57:39.476721] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-14T19:57:39.476787] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-14T19:57:39.477976] [DEBUG] [LOCAL ] SCM: Trimmed 21550 records to 13776 (keeping 150 days of data) [2025-09-14T19:57:39.580885] [DEBUG] [LOCAL ] SCM: Primary data saved (13776 records). [2025-09-14T19:57:39.581151] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-14T19:57:39.581300] [INFO ] [MAIN ] Update Progress: 1887/2370 symbols completed. SCM took 24.7s. Estimated remaining: 51m 19s. Rate: 9.4 symbols/min [2025-09-14T19:57:39.760758] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-14T19:57:39.780355] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:39.789302] [DEBUG] [LOCAL ] SDHY: Loaded 4556 existing records from primary storage. [2025-09-14T19:57:39.789481] [INFO ] [MAIN ] SDHY: Loaded 4556 existing records. [2025-09-14T19:57:39.984054] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:39.984403] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-14T19:57:39.984471] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-14T19:57:39.984869] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-14T19:57:39.984936] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-14T19:57:40.382712] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:40.428450] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T19:57:40.558883] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-14T19:57:41.100977] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T19:57:41.358862] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-14T19:57:41.611895] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T19:57:42.158914] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-14T19:57:42.305289] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T19:57:42.958876] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-14T19:57:43.576954] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T19:57:43.602589] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T19:57:43.758834] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-14T19:57:44.558876] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-14T19:57:45.363957] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-14T19:57:45.379687] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T19:57:45.999531] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T19:57:46.158839] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-14T19:57:46.245179] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T19:57:46.958852] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-14T19:57:47.694928] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T19:57:47.740828] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T19:57:47.758778] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-14T19:57:48.346404] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T19:57:48.558836] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-14T19:57:49.358845] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-14T19:57:49.539206] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T19:57:50.158828] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-14T19:57:50.661002] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T19:57:50.959156] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-14T19:57:51.707137] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T19:57:51.712592] [INFO ] [REMOTE ] SCS: Full fetch complete (45924 records). [2025-09-14T19:57:51.712837] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-14T19:57:51.771310] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-14T19:57:51.908309] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T19:57:52.157712] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-14T19:57:52.157837] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-14T19:57:52.159369] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-14T19:57:52.159473] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-14T19:57:52.160780] [DEBUG] [LOCAL ] SCS: Trimmed 45924 records to 31859 (keeping 150 days of data) [2025-09-14T19:57:52.380317] [DEBUG] [LOCAL ] SCS: Primary data saved (31859 records). [2025-09-14T19:57:52.380538] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-14T19:57:52.380706] [INFO ] [MAIN ] Update Progress: 1888/2370 symbols completed. SCS took 32.1s. Estimated remaining: 51m 14s. Rate: 9.4 symbols/min [2025-09-14T19:57:52.559088] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:52.559230] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-14T19:57:52.581200] [DEBUG] [LOCAL ] SDRL: Loaded 18403 existing records from primary storage. [2025-09-14T19:57:52.581395] [INFO ] [MAIN ] SDRL: Loaded 18403 existing records. [2025-09-14T19:57:52.696737] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T19:57:52.774678] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:52.774968] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-14T19:57:52.775034] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-14T19:57:52.775750] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-14T19:57:52.775816] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-14T19:57:53.173672] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:53.358919] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-14T19:57:53.382038] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T19:57:54.158803] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-14T19:57:54.461599] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T19:57:54.465056] [INFO ] [REMOTE ] SD: Full fetch complete (31271 records). [2025-09-14T19:57:54.465223] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-14T19:57:54.849590] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-14T19:57:54.849747] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-14T19:57:54.850907] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-14T19:57:54.850976] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-14T19:57:54.852159] [DEBUG] [LOCAL ] SD: Trimmed 31271 records to 21092 (keeping 150 days of data) [2025-09-14T19:57:54.920140] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:57:54.956832] [INFO ] [REMOTE ] SDHC: Full fetch complete (11834 records). [2025-09-14T19:57:54.965003] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-14T19:57:54.965464] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-14T19:57:55.170279] [DEBUG] [LOCAL ] SD: Primary data saved (21092 records). [2025-09-14T19:57:55.228237] [INFO ] [MAIN ] SD: Full history saved. [2025-09-14T19:57:55.262213] [INFO ] [MAIN ] Update Progress: 1889/2370 symbols completed. SD took 28.6s. Estimated remaining: 51m 7s. Rate: 9.4 symbols/min [2025-09-14T19:57:55.509495] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-14T19:57:55.525479] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-14T19:57:55.551700] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-14T19:57:55.565128] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-14T19:57:55.585727] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:55.586770] [DEBUG] [LOCAL ] SDHC: Trimmed 11834 records to 7254 (keeping 150 days of data) [2025-09-14T19:57:55.632719] [DEBUG] [LOCAL ] SDHC: Primary data saved (7254 records). [2025-09-14T19:57:55.632934] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-14T19:57:55.633079] [INFO ] [MAIN ] Update Progress: 1890/2370 symbols completed. SDHC took 19.5s. Estimated remaining: 50m 59s. Rate: 9.4 symbols/min [2025-09-14T19:57:55.759398] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-14T19:57:55.815201] [DEBUG] [LOCAL ] SE: Loaded 23950 existing records from primary storage. [2025-09-14T19:57:55.844805] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:57:55.845014] [INFO ] [MAIN ] SE: Loaded 23950 existing records. [2025-09-14T19:57:56.061875] [DEBUG] [LOCAL ] SEE: Loaded 21101 existing records from primary storage. [2025-09-14T19:57:56.062069] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:56.062734] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-14T19:57:56.062508] [INFO ] [MAIN ] SEE: Loaded 21101 existing records. [2025-09-14T19:57:56.062896] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-14T19:57:56.096091] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-09-14T19:57:56.144019] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-14T19:57:56.382685] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:57:56.443762] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-14T19:57:56.505949] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-14T19:57:56.556342] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-14T19:57:56.556894] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-14T19:57:56.711544] [INFO ] [REMOTE ] SE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:56.712114] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-14T19:57:56.837633] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T19:57:57.153604] [INFO ] [REMOTE ] SEE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:57:57.158709] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-14T19:57:57.358971] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-14T19:57:57.671099] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T19:57:58.158938] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-14T19:57:58.958936] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-14T19:57:59.017484] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T19:57:59.758869] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-14T19:57:59.874292] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T19:57:59.914961] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T19:58:00.558832] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-14T19:58:01.358933] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-14T19:58:01.611823] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T19:58:02.158822] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-14T19:58:02.192360] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T19:58:02.535701] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T19:58:02.958841] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-14T19:58:03.639113] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T19:58:03.763908] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-14T19:58:03.783891] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T19:58:04.558835] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-14T19:58:04.758347] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T19:58:05.358833] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-14T19:58:06.158881] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-14T19:58:06.270226] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T19:58:06.318700] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T19:58:06.650985] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T19:58:06.958834] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-14T19:58:07.633102] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T19:58:07.634817] [INFO ] [REMOTE ] SDHY: Full fetch complete (11553 records). [2025-09-14T19:58:07.634926] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-14T19:58:07.763893] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-14T19:58:08.022545] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-14T19:58:08.022711] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-14T19:58:08.023086] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-14T19:58:08.023165] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-14T19:58:08.023754] [DEBUG] [LOCAL ] SDHY: Trimmed 11553 records to 7727 (keeping 150 days of data) [2025-09-14T19:58:08.072147] [DEBUG] [LOCAL ] SDHY: Primary data saved (7727 records). [2025-09-14T19:58:08.072329] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-14T19:58:08.072461] [INFO ] [MAIN ] Update Progress: 1891/2370 symbols completed. SDHY took 28.5s. Estimated remaining: 50m 54s. Rate: 9.4 symbols/min [2025-09-14T19:58:08.252118] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:58:08.261939] [DEBUG] [LOCAL ] SEG: Loaded 6035 existing records from primary storage. [2025-09-14T19:58:08.262135] [INFO ] [MAIN ] SEG: Loaded 6035 existing records. [2025-09-14T19:58:08.436353] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:58:08.436625] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-14T19:58:08.436717] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-14T19:58:08.437102] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-14T19:58:08.437165] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-14T19:58:08.574449] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-14T19:58:08.795793] [INFO ] [REMOTE ] SEG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:58:09.358886] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-14T19:58:09.403999] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T19:58:10.040066] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:58:10.158849] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-14T19:58:10.446517] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T19:58:10.958851] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-14T19:58:11.763902] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-14T19:58:11.781471] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:58:12.446524] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:58:12.452050] [INFO ] [REMOTE ] SE: Full fetch complete (58056 records). [2025-09-14T19:58:12.452186] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-14T19:58:12.561291] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-14T19:58:12.854368] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-09-14T19:58:12.854519] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-09-14T19:58:12.859402] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-09-14T19:58:12.859675] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-09-14T19:58:12.861455] [DEBUG] [LOCAL ] SE: Trimmed 58056 records to 40176 (keeping 150 days of data) [2025-09-14T19:58:12.985369] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T19:58:13.167909] [DEBUG] [LOCAL ] SE: Primary data saved (40176 records). [2025-09-14T19:58:13.168079] [INFO ] [MAIN ] SE: Full history saved. [2025-09-14T19:58:13.168202] [INFO ] [MAIN ] Update Progress: 1892/2370 symbols completed. SE took 17.9s. Estimated remaining: 50m 47s. Rate: 9.4 symbols/min [2025-09-14T19:58:13.340196] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:58:13.361595] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-14T19:58:13.362113] [DEBUG] [LOCAL ] SEI: Loaded 21862 existing records from primary storage. [2025-09-14T19:58:13.362279] [INFO ] [MAIN ] SEI: Loaded 21862 existing records. [2025-09-14T19:58:13.543831] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:58:13.544178] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-14T19:58:13.544281] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-14T19:58:13.544985] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-14T19:58:13.545063] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-14T19:58:13.859420] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T19:58:13.925064] [INFO ] [REMOTE ] SEI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:58:14.158896] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-14T19:58:14.487907] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T19:58:14.492264] [INFO ] [REMOTE ] SDRL: Full fetch complete (46466 records). [2025-09-14T19:58:14.492424] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-14T19:58:14.882315] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-14T19:58:14.882442] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-14T19:58:14.883657] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-14T19:58:14.883719] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-14T19:58:14.884919] [DEBUG] [LOCAL ] SDRL: Trimmed 46466 records to 30940 (keeping 150 days of data) [2025-09-14T19:58:14.977200] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-14T19:58:15.087934] [DEBUG] [LOCAL ] SDRL: Primary data saved (30940 records). [2025-09-14T19:58:15.088152] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-14T19:58:15.088322] [INFO ] [MAIN ] Update Progress: 1893/2370 symbols completed. SDRL took 22.7s. Estimated remaining: 50m 40s. Rate: 9.4 symbols/min [2025-09-14T19:58:15.291634] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:58:15.311521] [DEBUG] [LOCAL ] SEM: Loaded 19418 existing records from primary storage. [2025-09-14T19:58:15.311716] [INFO ] [MAIN ] SEM: Loaded 19418 existing records. [2025-09-14T19:58:15.498573] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:58:15.498948] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-14T19:58:15.499021] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-14T19:58:15.499779] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-14T19:58:15.499850] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-14T19:58:15.761795] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-14T19:58:15.917415] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T19:58:15.922572] [INFO ] [REMOTE ] SEM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:58:15.947441] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T19:58:16.558875] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-14T19:58:17.358885] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-14T19:58:17.675720] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T19:58:17.958758] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T19:58:18.158894] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-14T19:58:18.916857] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:58:18.958786] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-14T19:58:19.758863] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-14T19:58:19.843846] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T19:58:20.485455] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T19:58:20.558828] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-14T19:58:21.269676] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T19:58:21.358902] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-14T19:58:21.841980] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T19:58:22.158908] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-14T19:58:22.311368] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T19:58:22.958878] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-14T19:58:23.692982] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T19:58:23.758856] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-14T19:58:24.558831] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-14T19:58:24.591975] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T19:58:25.358878] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-14T19:58:25.613509] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T19:58:26.168667] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-14T19:58:26.171239] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T19:58:26.226577] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:58:26.958863] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-14T19:58:27.758810] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-14T19:58:27.831837] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T19:58:28.056357] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T19:58:28.349815] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T19:58:28.558841] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-14T19:58:29.358870] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-14T19:58:30.158877] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-14T19:58:30.293970] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T19:58:30.944906] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T19:58:30.958829] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-14T19:58:31.394484] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T19:58:31.400165] [INFO ] [REMOTE ] SEE: Full fetch complete (52689 records). [2025-09-14T19:58:31.400389] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-14T19:58:31.763010] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-14T19:58:31.798715] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-14T19:58:31.798882] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-14T19:58:31.800228] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-14T19:58:31.800414] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-14T19:58:31.801922] [DEBUG] [LOCAL ] SEE: Trimmed 52689 records to 35894 (keeping 150 days of data) [2025-09-14T19:58:32.036492] [DEBUG] [LOCAL ] SEE: Primary data saved (35894 records). [2025-09-14T19:58:32.036871] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-14T19:58:32.036999] [INFO ] [MAIN ] Update Progress: 1894/2370 symbols completed. SEE took 36.4s. Estimated remaining: 50m 36s. Rate: 9.4 symbols/min [2025-09-14T19:58:32.210892] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:58:32.247050] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T19:58:32.275158] [DEBUG] [LOCAL ] SEMR: Loaded 19226 existing records from primary storage. [2025-09-14T19:58:32.275350] [INFO ] [MAIN ] SEMR: Loaded 19226 existing records. [2025-09-14T19:58:32.465518] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:58:32.465869] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-14T19:58:32.465935] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-14T19:58:32.466432] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-14T19:58:32.466513] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-14T19:58:32.565199] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-14T19:58:32.831043] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:58:32.842397] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T19:58:33.260119] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:58:33.264323] [INFO ] [REMOTE ] SEM: Full fetch complete (46810 records). [2025-09-14T19:58:33.264446] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-14T19:58:33.364267] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-14T19:58:33.637786] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-14T19:58:33.637916] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-14T19:58:33.639047] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-14T19:58:33.639109] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-14T19:58:33.640328] [DEBUG] [LOCAL ] SEM: Trimmed 46810 records to 32787 (keeping 150 days of data) [2025-09-14T19:58:33.877631] [DEBUG] [LOCAL ] SEM: Primary data saved (32787 records). [2025-09-14T19:58:33.877827] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-14T19:58:33.877934] [INFO ] [MAIN ] Update Progress: 1895/2370 symbols completed. SEM took 18.8s. Estimated remaining: 50m 29s. Rate: 9.4 symbols/min [2025-09-14T19:58:34.050606] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:58:34.072803] [DEBUG] [LOCAL ] SES: Loaded 22658 existing records from primary storage. [2025-09-14T19:58:34.072971] [INFO ] [MAIN ] SES: Loaded 22658 existing records. [2025-09-14T19:58:34.169091] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-14T19:58:34.253571] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:58:34.253875] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-14T19:58:34.253943] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-14T19:58:34.254597] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-14T19:58:34.254699] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-14T19:58:34.605049] [INFO ] [REMOTE ] SES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:58:34.958885] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-14T19:58:35.175171] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T19:58:35.758821] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-14T19:58:35.831763] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:58:36.558904] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-14T19:58:36.762441] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T19:58:37.325483] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-14T19:58:37.358779] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-14T19:58:37.752953] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T19:58:37.758586] [INFO ] [REMOTE ] SEI: Full fetch complete (53317 records). [2025-09-14T19:58:37.758835] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-14T19:58:38.142692] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-14T19:58:38.142816] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-14T19:58:38.143916] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-14T19:58:38.143975] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-14T19:58:38.145269] [DEBUG] [LOCAL ] SEI: Trimmed 53317 records to 36952 (keeping 150 days of data) [2025-09-14T19:58:38.198994] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-14T19:58:38.379575] [DEBUG] [LOCAL ] SEI: Primary data saved (36952 records). [2025-09-14T19:58:38.379808] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-14T19:58:38.380009] [INFO ] [MAIN ] Update Progress: 1896/2370 symbols completed. SEI took 25.2s. Estimated remaining: 50m 22s. Rate: 9.4 symbols/min [2025-09-14T19:58:38.553581] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:58:38.574869] [DEBUG] [LOCAL ] SF: Loaded 17879 existing records from primary storage. [2025-09-14T19:58:38.575067] [INFO ] [MAIN ] SF: Loaded 17879 existing records. [2025-09-14T19:58:38.753908] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:58:38.754175] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-14T19:58:38.754237] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-14T19:58:38.754801] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-14T19:58:38.754874] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-14T19:58:38.964972] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-14T19:58:39.051323] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T19:58:39.105005] [INFO ] [REMOTE ] SEG: Full fetch complete (15680 records). [2025-09-14T19:58:39.114748] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-14T19:58:39.134498] [INFO ] [REMOTE ] SF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:58:39.511109] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-14T19:58:39.511226] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-14T19:58:39.511633] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-14T19:58:39.511705] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-14T19:58:39.512672] [DEBUG] [LOCAL ] SEG: Trimmed 15680 records to 9710 (keeping 150 days of data) [2025-09-14T19:58:39.576093] [DEBUG] [LOCAL ] SEG: Primary data saved (9710 records). [2025-09-14T19:58:39.576302] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-14T19:58:39.576459] [INFO ] [MAIN ] Update Progress: 1897/2370 symbols completed. SEG took 31.5s. Estimated remaining: 50m 14s. Rate: 9.4 symbols/min [2025-09-14T19:58:39.748770] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:58:39.752211] [DEBUG] [LOCAL ] SFB: Loaded 1557 existing records from primary storage. [2025-09-14T19:58:39.752309] [INFO ] [MAIN ] SFB: Loaded 1557 existing records. [2025-09-14T19:58:39.784703] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-14T19:58:39.938590] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:58:39.939006] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-14T19:58:39.939112] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-14T19:58:39.939445] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-14T19:58:39.939517] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-14T19:58:40.165340] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-09-14T19:58:40.374357] [INFO ] [REMOTE ] SFB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:58:40.407540] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T19:58:40.558831] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-14T19:58:41.219548] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T19:58:41.358797] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-14T19:58:42.158842] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-14T19:58:42.638197] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T19:58:42.838984] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-14T19:58:42.958914] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-14T19:58:43.000915] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T19:58:43.758883] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-14T19:58:44.558835] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-14T19:58:45.191370] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-14T19:58:45.239365] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T19:58:45.358813] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-14T19:58:45.904433] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T19:58:46.158850] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-14T19:58:46.654463] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T19:58:46.958919] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-14T19:58:47.758894] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-14T19:58:48.311381] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-14T19:58:48.530914] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T19:58:48.558782] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-14T19:58:48.898909] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T19:58:49.358891] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-14T19:58:50.039180] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T19:58:50.158855] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-14T19:58:50.958822] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-14T19:58:51.429867] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T19:58:51.567381] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T19:58:51.758947] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-14T19:58:51.796584] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T19:58:52.480135] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-14T19:58:52.558875] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-14T19:58:53.358880] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-14T19:58:53.971170] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T19:58:54.158940] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-14T19:58:54.509635] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T19:58:54.958911] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-14T19:58:55.573820] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T19:58:55.757189] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T19:58:55.765918] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-14T19:58:56.558940] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-14T19:58:57.358820] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-14T19:58:57.600245] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-14T19:58:57.606331] [INFO ] [REMOTE ] SES: Full fetch complete (56236 records). [2025-09-14T19:58:57.606462] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-14T19:58:57.996840] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-14T19:58:57.997003] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-14T19:58:58.000086] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-14T19:58:58.000177] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-14T19:58:58.002026] [DEBUG] [LOCAL ] SES: Trimmed 56236 records to 38498 (keeping 150 days of data) [2025-09-14T19:58:58.162429] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-14T19:58:58.168055] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T19:58:58.302153] [DEBUG] [LOCAL ] SES: Primary data saved (38498 records). [2025-09-14T19:58:58.302407] [INFO ] [MAIN ] SES: Full history saved. [2025-09-14T19:58:58.302603] [INFO ] [MAIN ] Update Progress: 1898/2370 symbols completed. SES took 24.4s. Estimated remaining: 50m 11s. Rate: 9.4 symbols/min [2025-09-14T19:58:58.474512] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:58:58.485419] [DEBUG] [LOCAL ] SFBS: Loaded 9722 existing records from primary storage. [2025-09-14T19:58:58.485595] [INFO ] [MAIN ] SFBS: Loaded 9722 existing records. [2025-09-14T19:58:58.663171] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:58:58.663437] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-14T19:58:58.663499] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-14T19:58:58.663863] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-14T19:58:58.663926] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-14T19:58:58.921943] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T19:58:58.964038] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-14T19:58:59.037049] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:58:59.076332] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T19:58:59.682761] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T19:58:59.688222] [INFO ] [REMOTE ] SF: Full fetch complete (45421 records). [2025-09-14T19:58:59.688352] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-14T19:58:59.764164] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-14T19:59:00.089059] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-14T19:59:00.089172] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-14T19:59:00.090404] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-14T19:59:00.090470] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-14T19:59:00.091633] [DEBUG] [LOCAL ] SF: Trimmed 45421 records to 30808 (keeping 150 days of data) [2025-09-14T19:59:00.295499] [DEBUG] [LOCAL ] SF: Primary data saved (30808 records). [2025-09-14T19:59:00.295724] [INFO ] [MAIN ] SF: Full history saved. [2025-09-14T19:59:00.295824] [INFO ] [MAIN ] Update Progress: 1899/2370 symbols completed. SF took 21.9s. Estimated remaining: 50m 3s. Rate: 9.4 symbols/min [2025-09-14T19:59:00.466783] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:00.486397] [DEBUG] [LOCAL ] SFL: Loaded 20011 existing records from primary storage. [2025-09-14T19:59:00.486563] [INFO ] [MAIN ] SFL: Loaded 20011 existing records. [2025-09-14T19:59:00.563969] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-14T19:59:00.668432] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:00.668725] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-14T19:59:00.668790] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-14T19:59:00.669302] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-14T19:59:00.669367] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-14T19:59:01.031263] [INFO ] [REMOTE ] SFL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:01.258468] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T19:59:01.358860] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-14T19:59:01.384968] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T19:59:01.390052] [INFO ] [REMOTE ] SEMR: Full fetch complete (45088 records). [2025-09-14T19:59:01.390190] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-14T19:59:01.778101] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-14T19:59:01.778231] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-14T19:59:01.779311] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-14T19:59:01.779376] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-14T19:59:01.780688] [DEBUG] [LOCAL ] SEMR: Trimmed 45088 records to 31104 (keeping 150 days of data) [2025-09-14T19:59:01.880834] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T19:59:01.892169] [INFO ] [REMOTE ] SFB: Full fetch complete (4340 records). [2025-09-14T19:59:01.893428] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-14T19:59:02.169390] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-14T19:59:02.372448] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-14T19:59:02.384598] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-14T19:59:02.387256] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-14T19:59:02.387712] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-14T19:59:02.396238] [DEBUG] [LOCAL ] SEMR: Primary data saved (31104 records). [2025-09-14T19:59:02.396432] [DEBUG] [LOCAL ] SFB: Trimmed 4340 records to 2633 (keeping 150 days of data) [2025-09-14T19:59:02.396768] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-14T19:59:02.397242] [INFO ] [MAIN ] Update Progress: 1900/2370 symbols completed. SEMR took 30.4s. Estimated remaining: 49m 56s. Rate: 9.4 symbols/min [2025-09-14T19:59:02.537734] [DEBUG] [LOCAL ] SFB: Primary data saved (2633 records). [2025-09-14T19:59:02.581633] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-14T19:59:02.583630] [INFO ] [MAIN ] Update Progress: 1901/2370 symbols completed. SFB took 23.0s. Estimated remaining: 49m 48s. Rate: 9.4 symbols/min [2025-09-14T19:59:02.602390] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:02.791030] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:02.801919] [DEBUG] [LOCAL ] SG: Loaded 23963 existing records from primary storage. [2025-09-14T19:59:02.802102] [INFO ] [MAIN ] SG: Loaded 23963 existing records. [2025-09-14T19:59:02.968865] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-14T19:59:02.998435] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:03.000331] [DEBUG] [LOCAL ] SGHC: Loaded 21544 existing records from primary storage. [2025-09-14T19:59:03.000859] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-14T19:59:03.001002] [INFO ] [MAIN ] SGHC: Loaded 21544 existing records. [2025-09-14T19:59:03.001064] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-14T19:59:03.073339] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-14T19:59:03.084631] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-14T19:59:03.314386] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:03.358423] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-14T19:59:03.382722] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-14T19:59:03.465162] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-14T19:59:03.485916] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-14T19:59:03.622296] [INFO ] [REMOTE ] SG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:03.725929] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T19:59:03.764158] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-14T19:59:03.972305] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:04.558842] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-14T19:59:04.653070] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T19:59:05.358845] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-14T19:59:05.679937] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T19:59:05.757526] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T19:59:06.158838] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-14T19:59:06.958846] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-14T19:59:07.186534] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T19:59:07.758870] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-14T19:59:08.062938] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T19:59:08.558822] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-14T19:59:08.949409] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T19:59:09.032991] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T19:59:09.358862] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-14T19:59:10.158871] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-14T19:59:10.286133] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:59:10.704844] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T19:59:10.958897] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-14T19:59:11.758852] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-14T19:59:12.006591] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T19:59:12.247236] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T19:59:12.558895] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-14T19:59:13.358850] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-14T19:59:13.563962] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T19:59:13.814929] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T19:59:14.158878] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-14T19:59:14.656058] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T19:59:14.958904] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-14T19:59:15.758862] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-14T19:59:16.326111] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-14T19:59:16.558845] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-14T19:59:16.702044] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T19:59:16.758553] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T19:59:17.358897] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-14T19:59:18.158858] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-14T19:59:18.681729] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-14T19:59:18.725482] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T19:59:18.958865] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-14T19:59:19.729225] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T19:59:19.758788] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-14T19:59:20.558883] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-14T19:59:20.845766] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T19:59:21.358939] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-14T19:59:21.641438] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T19:59:21.881951] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T19:59:22.158845] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-14T19:59:22.958829] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-14T19:59:23.060529] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T19:59:23.066278] [INFO ] [REMOTE ] SG: Full fetch complete (58135 records). [2025-09-14T19:59:23.066479] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-14T19:59:23.470170] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-14T19:59:23.470425] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-14T19:59:23.471624] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-14T19:59:23.471708] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-14T19:59:23.487708] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T19:59:23.493206] [DEBUG] [LOCAL ] SG: Trimmed 58135 records to 40295 (keeping 150 days of data) [2025-09-14T19:59:23.758003] [DEBUG] [LOCAL ] SG: Primary data saved (40295 records). [2025-09-14T19:59:23.758178] [INFO ] [MAIN ] SG: Full history saved. [2025-09-14T19:59:23.758304] [INFO ] [MAIN ] Update Progress: 1902/2370 symbols completed. SG took 21.4s. Estimated remaining: 49m 45s. Rate: 9.4 symbols/min [2025-09-14T19:59:23.763897] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-14T19:59:23.930527] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:23.952433] [DEBUG] [LOCAL ] SGI: Loaded 23182 existing records from primary storage. [2025-09-14T19:59:23.952592] [INFO ] [MAIN ] SGI: Loaded 23182 existing records. [2025-09-14T19:59:24.135071] [WARN ] [MAIN ] SGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:24.135780] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-14T19:59:24.135978] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-14T19:59:24.136806] [DEBUG] [LOCAL ] SGI: Deleted primary data file. [2025-09-14T19:59:24.136870] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-14T19:59:24.492567] [INFO ] [REMOTE ] SGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:24.558881] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-14T19:59:24.852276] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T19:59:25.358835] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-14T19:59:25.633392] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T19:59:25.693072] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:59:26.158852] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-14T19:59:26.468697] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T19:59:26.476841] [INFO ] [REMOTE ] SGHC: Full fetch complete (49009 records). [2025-09-14T19:59:26.477053] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-14T19:59:26.869519] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-14T19:59:26.869691] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-14T19:59:26.871130] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-14T19:59:26.871215] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-14T19:59:26.872705] [DEBUG] [LOCAL ] SGHC: Trimmed 49009 records to 34823 (keeping 150 days of data) [2025-09-14T19:59:26.968741] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-14T19:59:27.101816] [DEBUG] [LOCAL ] SGHC: Primary data saved (34823 records). [2025-09-14T19:59:27.102011] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-14T19:59:27.102125] [INFO ] [MAIN ] Update Progress: 1903/2370 symbols completed. SGHC took 24.5s. Estimated remaining: 49m 38s. Rate: 9.4 symbols/min [2025-09-14T19:59:27.276020] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:27.292061] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T19:59:27.300036] [DEBUG] [LOCAL ] SGU: Loaded 3414 existing records from primary storage. [2025-09-14T19:59:27.300544] [INFO ] [MAIN ] SGU: Loaded 3414 existing records. [2025-09-14T19:59:27.476975] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:27.477242] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-14T19:59:27.477305] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-14T19:59:27.477673] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-14T19:59:27.477740] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-14T19:59:27.764018] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-14T19:59:27.833807] [INFO ] [REMOTE ] SGU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:28.558928] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-14T19:59:28.825763] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T19:59:28.918611] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T19:59:28.924151] [INFO ] [REMOTE ] SFL: Full fetch complete (49761 records). [2025-09-14T19:59:28.924348] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-14T19:59:29.313948] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-14T19:59:29.319486] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-14T19:59:29.319571] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-14T19:59:29.321742] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-14T19:59:29.321814] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-14T19:59:29.323403] [DEBUG] [LOCAL ] SFL: Trimmed 49761 records to 33415 (keeping 150 days of data) [2025-09-14T19:59:29.376889] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-14T19:59:29.557729] [DEBUG] [LOCAL ] SFL: Primary data saved (33415 records). [2025-09-14T19:59:29.558005] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-14T19:59:29.558156] [INFO ] [MAIN ] Update Progress: 1904/2370 symbols completed. SFL took 29.3s. Estimated remaining: 49m 31s. Rate: 9.4 symbols/min [2025-09-14T19:59:29.742608] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:29.766955] [DEBUG] [LOCAL ] SHAK: Loaded 21513 existing records from primary storage. [2025-09-14T19:59:29.767188] [INFO ] [MAIN ] SHAK: Loaded 21513 existing records. [2025-09-14T19:59:29.948697] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:29.949018] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-14T19:59:29.949079] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-14T19:59:29.949675] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-14T19:59:29.949742] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-14T19:59:30.164088] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-14T19:59:30.315938] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:30.813936] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:59:30.816701] [INFO ] [REMOTE ] SFBS: Full fetch complete (22935 records). [2025-09-14T19:59:30.816840] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-14T19:59:30.965804] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-14T19:59:31.209307] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-14T19:59:31.209598] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-14T19:59:31.210748] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-14T19:59:31.210846] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-14T19:59:31.211811] [DEBUG] [LOCAL ] SFBS: Trimmed 22935 records to 15651 (keeping 150 days of data) [2025-09-14T19:59:31.329155] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T19:59:31.374066] [DEBUG] [LOCAL ] SFBS: Primary data saved (15651 records). [2025-09-14T19:59:31.374609] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-14T19:59:31.374810] [INFO ] [MAIN ] Update Progress: 1905/2370 symbols completed. SFBS took 33.1s. Estimated remaining: 49m 23s. Rate: 9.4 symbols/min [2025-09-14T19:59:31.554906] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:31.569696] [DEBUG] [LOCAL ] SHCO: Loaded 12841 existing records from primary storage. [2025-09-14T19:59:31.569896] [INFO ] [MAIN ] SHCO: Loaded 12841 existing records. [2025-09-14T19:59:31.760608] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-14T19:59:31.760413] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:31.761751] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-14T19:59:31.761836] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-14T19:59:31.763632] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-14T19:59:31.763768] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-14T19:59:32.182821] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:32.513458] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T19:59:32.558902] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-14T19:59:32.789913] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T19:59:33.358885] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-14T19:59:34.158855] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-14T19:59:34.229787] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T19:59:34.307102] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T19:59:34.958893] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-14T19:59:35.729131] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T19:59:35.758788] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-14T19:59:35.983651] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T19:59:36.558852] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-14T19:59:36.662569] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T19:59:37.358873] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-14T19:59:38.158851] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-14T19:59:38.354808] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T19:59:38.958862] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-14T19:59:39.198153] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T19:59:39.268223] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T19:59:39.758889] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-14T19:59:39.786859] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T19:59:40.558874] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-14T19:59:41.011854] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T19:59:41.126432] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T19:59:41.358855] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-14T19:59:42.086889] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:59:42.088545] [INFO ] [REMOTE ] SGU: Full fetch complete (7008 records). [2025-09-14T19:59:42.088681] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-14T19:59:42.165531] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-14T19:59:42.467668] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-14T19:59:42.467796] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-14T19:59:42.468158] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-14T19:59:42.468222] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-14T19:59:42.468789] [DEBUG] [LOCAL ] SGU: Trimmed 7008 records to 5139 (keeping 150 days of data) [2025-09-14T19:59:42.503534] [DEBUG] [LOCAL ] SGU: Primary data saved (5139 records). [2025-09-14T19:59:42.503793] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-14T19:59:42.503946] [INFO ] [MAIN ] Update Progress: 1906/2370 symbols completed. SGU took 15.4s. Estimated remaining: 49m 18s. Rate: 9.4 symbols/min [2025-09-14T19:59:42.688696] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:42.715808] [DEBUG] [LOCAL ] SHEL: Loaded 24052 existing records from primary storage. [2025-09-14T19:59:42.716011] [INFO ] [MAIN ] SHEL: Loaded 24052 existing records. [2025-09-14T19:59:42.905760] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:42.906850] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-14T19:59:42.906919] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-14T19:59:42.907864] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-14T19:59:42.907929] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-14T19:59:42.966449] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-14T19:59:43.273731] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:43.534852] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T19:59:43.758836] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-14T19:59:44.558808] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-14T19:59:44.874187] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T19:59:44.912741] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T19:59:45.358913] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-14T19:59:46.158839] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-14T19:59:46.250800] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T19:59:46.616837] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T19:59:46.958842] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-14T19:59:47.709496] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T19:59:47.758829] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-14T19:59:48.558858] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-14T19:59:48.747773] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T19:59:49.358801] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-14T19:59:49.653962] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T19:59:49.800007] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T19:59:50.158907] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-14T19:59:50.958897] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-14T19:59:51.190709] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T19:59:51.758866] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-14T19:59:52.078418] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T19:59:52.558838] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-14T19:59:52.782217] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T19:59:53.056999] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T19:59:53.078071] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T19:59:53.083731] [INFO ] [REMOTE ] SGI: Full fetch complete (54551 records). [2025-09-14T19:59:53.083885] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-14T19:59:53.305788] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 144 unique days, need 150 days [2025-09-14T19:59:53.306429] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:59:53.306485] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:59:53.306535] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-14T19:59:53.306611] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-14T19:59:53.306678] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-14T19:59:53.306739] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-14T19:59:53.306831] [INFO ] [MAIN ] Update Progress: 1907/2370 symbols completed. SGI took 29.5s. Estimated remaining: 49m 13s. Rate: 9.4 symbols/min [2025-09-14T19:59:53.369056] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-14T19:59:53.490219] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:53.503022] [DEBUG] [LOCAL ] SHG: Loaded 11341 existing records from primary storage. [2025-09-14T19:59:53.503230] [INFO ] [MAIN ] SHG: Loaded 11341 existing records. [2025-09-14T19:59:53.688672] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:53.688960] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-14T19:59:53.689025] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-14T19:59:53.689361] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-14T19:59:53.689420] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-14T19:59:54.052179] [INFO ] [REMOTE ] SHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:54.067515] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:59:54.072963] [INFO ] [REMOTE ] SHAK: Full fetch complete (53747 records). [2025-09-14T19:59:54.073114] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-14T19:59:54.163962] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-14T19:59:54.483247] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-14T19:59:54.483431] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-14T19:59:54.485311] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-14T19:59:54.485407] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-14T19:59:54.487064] [DEBUG] [LOCAL ] SHAK: Trimmed 53747 records to 36751 (keeping 150 days of data) [2025-09-14T19:59:54.738781] [DEBUG] [LOCAL ] SHAK: Primary data saved (36751 records). [2025-09-14T19:59:54.739017] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-14T19:59:54.739170] [INFO ] [MAIN ] Update Progress: 1908/2370 symbols completed. SHAK took 25.2s. Estimated remaining: 49m 5s. Rate: 9.4 symbols/min [2025-09-14T19:59:54.906958] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:54.929167] [DEBUG] [LOCAL ] SHO: Loaded 22053 existing records from primary storage. [2025-09-14T19:59:54.929354] [INFO ] [MAIN ] SHO: Loaded 22053 existing records. [2025-09-14T19:59:54.963948] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-14T19:59:55.108791] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:55.109047] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-14T19:59:55.109108] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-14T19:59:55.109618] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-14T19:59:55.109698] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-14T19:59:55.462072] [INFO ] [REMOTE ] SHO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:55.566473] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T19:59:55.758848] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-14T19:59:56.401832] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T19:59:56.558839] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-14T19:59:57.358858] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-14T19:59:57.879342] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-14T19:59:57.905037] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T19:59:57.909716] [INFO ] [REMOTE ] SHCO: Full fetch complete (28285 records). [2025-09-14T19:59:57.909823] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-14T19:59:58.168966] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-14T19:59:58.284110] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-14T19:59:58.284224] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-14T19:59:58.285062] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-14T19:59:58.285660] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-14T19:59:58.286542] [DEBUG] [LOCAL ] SHCO: Trimmed 28285 records to 18424 (keeping 150 days of data) [2025-09-14T19:59:58.392318] [DEBUG] [LOCAL ] SHCO: Primary data saved (18424 records). [2025-09-14T19:59:58.392491] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-14T19:59:58.392613] [INFO ] [MAIN ] Update Progress: 1909/2370 symbols completed. SHCO took 27.0s. Estimated remaining: 48m 58s. Rate: 9.4 symbols/min [2025-09-14T19:59:58.561972] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:59:58.565138] [DEBUG] [LOCAL ] SHOC: Loaded 1319 existing records from primary storage. [2025-09-14T19:59:58.565235] [INFO ] [MAIN ] SHOC: Loaded 1319 existing records. [2025-09-14T19:59:58.741194] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:59:58.741490] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-14T19:59:58.741704] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-14T19:59:58.741913] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-14T19:59:58.741991] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-14T19:59:58.967958] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-14T19:59:59.050589] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T19:59:59.135253] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:59:59.758831] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-14T20:00:00.378625] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-14T20:00:00.558829] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-14T20:00:00.735820] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T20:00:00.812996] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T20:00:01.358836] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-14T20:00:02.165772] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-14T20:00:02.958944] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-14T20:00:03.693042] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-09-14T20:00:03.758862] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-14T20:00:04.479359] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (3.12 seconds). [2025-09-14T20:00:04.558893] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-14T20:00:05.632773] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (3.47 seconds). [2025-09-14T20:00:05.634984] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-14T20:00:06.324130] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-14T20:00:06.330343] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-14T20:00:06.967299] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (3.21 seconds). [2025-09-14T20:00:06.979324] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-14T20:00:07.267735] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T20:00:07.678110] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T20:00:07.758783] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-14T20:00:08.282234] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (3.72 seconds). [2025-09-14T20:00:08.558882] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-14T20:00:09.358902] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-14T20:00:09.416990] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T20:00:09.568405] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-14T20:00:09.574191] [INFO ] [REMOTE ] SHEL: Full fetch complete (58343 records). [2025-09-14T20:00:09.574373] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-14T20:00:09.971221] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-14T20:00:09.971363] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-14T20:00:09.972773] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-14T20:00:09.972863] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-14T20:00:09.974387] [DEBUG] [LOCAL ] SHEL: Trimmed 58343 records to 40417 (keeping 150 days of data) [2025-09-14T20:00:10.164149] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-14T20:00:10.253781] [DEBUG] [LOCAL ] SHEL: Primary data saved (40417 records). [2025-09-14T20:00:10.253943] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-14T20:00:10.254059] [INFO ] [MAIN ] Update Progress: 1910/2370 symbols completed. SHEL took 27.7s. Estimated remaining: 48m 53s. Rate: 9.4 symbols/min [2025-09-14T20:00:10.394726] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T20:00:10.457049] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:00:10.481043] [DEBUG] [LOCAL ] SHW: Loaded 22873 existing records from primary storage. [2025-09-14T20:00:10.481220] [INFO ] [MAIN ] SHW: Loaded 22873 existing records. [2025-09-14T20:00:10.657996] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:00:10.658239] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-14T20:00:10.658307] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-14T20:00:10.658961] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-14T20:00:10.659026] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-14T20:00:10.981375] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-14T20:00:11.016146] [INFO ] [REMOTE ] SHW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:00:11.512301] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T20:00:11.556723] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T20:00:11.758846] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-14T20:00:12.267474] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T20:00:12.558836] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-14T20:00:13.181097] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T20:00:13.358873] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-14T20:00:13.707623] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T20:00:14.158873] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-14T20:00:14.434909] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T20:00:14.437952] [INFO ] [REMOTE ] SHG: Full fetch complete (31005 records). [2025-09-14T20:00:14.438046] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-14T20:00:14.814849] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-14T20:00:14.814975] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-14T20:00:14.815973] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-14T20:00:14.816041] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-14T20:00:14.817098] [DEBUG] [LOCAL ] SHG: Trimmed 31005 records to 19301 (keeping 150 days of data) [2025-09-14T20:00:14.937973] [DEBUG] [LOCAL ] SHG: Primary data saved (19301 records). [2025-09-14T20:00:14.938198] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-14T20:00:14.938328] [INFO ] [MAIN ] Update Progress: 1911/2370 symbols completed. SHG took 21.6s. Estimated remaining: 48m 46s. Rate: 9.4 symbols/min [2025-09-14T20:00:14.969494] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-14T20:00:15.110174] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:00:15.117495] [DEBUG] [LOCAL ] SI: Loaded 4797 existing records from primary storage. [2025-09-14T20:00:15.117665] [INFO ] [MAIN ] SI: Loaded 4797 existing records. [2025-09-14T20:00:15.294448] [WARN ] [MAIN ] SI: Insufficient historical data. Have data from 2025-07-31, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:00:15.294766] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-14T20:00:15.294828] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-14T20:00:15.295107] [DEBUG] [LOCAL ] SI: Deleted primary data file. [2025-09-14T20:00:15.295192] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-14T20:00:15.668341] [INFO ] [REMOTE ] SI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:00:15.758870] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-14T20:00:16.419579] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T20:00:16.558871] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-14T20:00:16.601843] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T20:00:16.899904] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:00:16.900323] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-14T20:00:17.358856] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-14T20:00:18.158896] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-14T20:00:18.818467] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T20:00:18.958849] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-14T20:00:19.006486] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:00:19.006931] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-14T20:00:19.455248] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T20:00:19.504134] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-14T20:00:19.758855] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-14T20:00:20.558862] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-14T20:00:20.865581] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:00:20.866016] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-14T20:00:21.358816] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-14T20:00:21.607559] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:00:21.607979] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-14T20:00:21.716099] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T20:00:22.158880] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-14T20:00:22.958850] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-14T20:00:23.663175] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:00:23.668578] [INFO ] [REMOTE ] SHO: Full fetch complete (53799 records). [2025-09-14T20:00:23.668801] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-14T20:00:23.763954] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-14T20:00:24.061734] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-14T20:00:24.061862] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-14T20:00:24.062981] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-14T20:00:24.063041] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-14T20:00:24.064367] [DEBUG] [LOCAL ] SHO: Trimmed 53799 records to 37266 (keeping 150 days of data) [2025-09-14T20:00:24.313444] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T20:00:24.360222] [DEBUG] [LOCAL ] SHO: Primary data saved (37266 records). [2025-09-14T20:00:24.360495] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-14T20:00:24.360671] [INFO ] [MAIN ] Update Progress: 1912/2370 symbols completed. SHO took 29.6s. Estimated remaining: 48m 41s. Rate: 9.4 symbols/min [2025-09-14T20:00:24.535695] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:00:24.555380] [DEBUG] [LOCAL ] SID: Loaded 19172 existing records from primary storage. [2025-09-14T20:00:24.555599] [INFO ] [MAIN ] SID: Loaded 19172 existing records. [2025-09-14T20:00:24.566882] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-14T20:00:24.668145] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T20:00:24.722788] [INFO ] [REMOTE ] SHOC: Full fetch complete (4819 records). [2025-09-14T20:00:24.734202] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-14T20:00:24.755330] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:00:24.857417] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-14T20:00:24.857911] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-14T20:00:24.897519] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-14T20:00:24.917084] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-14T20:00:25.317099] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-14T20:00:25.327810] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-14T20:00:25.377058] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-14T20:00:25.380869] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-14T20:00:25.399217] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-14T20:00:25.426305] [DEBUG] [LOCAL ] SHOC: Trimmed 4819 records to 2100 (keeping 150 days of data) [2025-09-14T20:00:25.522207] [INFO ] [REMOTE ] SID: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:00:25.527808] [DEBUG] [LOCAL ] SHOC: Primary data saved (2100 records). [2025-09-14T20:00:25.528061] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-14T20:00:25.528197] [INFO ] [MAIN ] Update Progress: 1913/2370 symbols completed. SHOC took 27.1s. Estimated remaining: 48m 33s. Rate: 9.4 symbols/min [2025-09-14T20:00:25.689436] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:00:25.735978] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:00:25.734249] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-14T20:00:25.758898] [DEBUG] [LOCAL ] SIG: Loaded 20214 existing records from primary storage. [2025-09-14T20:00:25.759111] [INFO ] [MAIN ] SIG: Loaded 20214 existing records. [2025-09-14T20:00:25.935872] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:00:25.936184] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-14T20:00:25.936251] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-14T20:00:25.936847] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-14T20:00:25.936913] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-14T20:00:26.170029] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-14T20:00:26.299200] [INFO ] [REMOTE ] SIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:00:26.465235] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T20:00:26.739014] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T20:00:26.958853] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-14T20:00:27.758842] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-14T20:00:28.546544] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T20:00:28.558784] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-14T20:00:29.358881] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-14T20:00:29.654204] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T20:00:30.158901] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-14T20:00:30.630405] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T20:00:30.958849] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-14T20:00:31.113457] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T20:00:31.758803] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-14T20:00:32.218010] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T20:00:32.558892] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-14T20:00:32.622341] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T20:00:32.925906] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T20:00:33.358852] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-14T20:00:34.158846] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-14T20:00:34.253318] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T20:00:34.958862] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-14T20:00:35.219280] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T20:00:35.677597] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:00:35.683381] [INFO ] [REMOTE ] SHW: Full fetch complete (54859 records). [2025-09-14T20:00:35.683525] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-14T20:00:35.760496] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-14T20:00:36.010485] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T20:00:36.138629] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-14T20:00:36.138802] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-14T20:00:36.140937] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-14T20:00:36.141047] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-14T20:00:36.142941] [DEBUG] [LOCAL ] SHW: Trimmed 54859 records to 37713 (keeping 150 days of data) [2025-09-14T20:00:36.418516] [DEBUG] [LOCAL ] SHW: Primary data saved (37713 records). [2025-09-14T20:00:36.418773] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-14T20:00:36.418944] [INFO ] [MAIN ] Update Progress: 1914/2370 symbols completed. SHW took 26.2s. Estimated remaining: 48m 28s. Rate: 9.4 symbols/min [2025-09-14T20:00:36.564013] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-14T20:00:36.598894] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:00:36.614046] [DEBUG] [LOCAL ] SII: Loaded 10242 existing records from primary storage. [2025-09-14T20:00:36.614427] [INFO ] [MAIN ] SII: Loaded 10242 existing records. [2025-09-14T20:00:36.804431] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:00:36.804774] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-14T20:00:36.804841] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-14T20:00:36.805245] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-14T20:00:36.805322] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-14T20:00:37.194965] [INFO ] [REMOTE ] SII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:00:37.212365] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T20:00:37.358907] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-14T20:00:38.158857] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-14T20:00:38.225549] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T20:00:38.257162] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T20:00:38.958842] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-14T20:00:39.758900] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-14T20:00:39.890158] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T20:00:39.915448] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T20:00:39.917809] [INFO ] [REMOTE ] SI: Full fetch complete (4797 records). [2025-09-14T20:00:39.917905] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-14T20:00:40.095522] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 31 unique days, need 150 days [2025-09-14T20:00:40.095811] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:00:40.095871] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:00:40.095923] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-14T20:00:40.096012] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-14T20:00:40.096086] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-14T20:00:40.096153] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-14T20:00:40.096268] [INFO ] [MAIN ] Update Progress: 1915/2370 symbols completed. SI took 25.2s. Estimated remaining: 48m 21s. Rate: 9.4 symbols/min [2025-09-14T20:00:40.263553] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:00:40.282763] [DEBUG] [LOCAL ] SILA: Loaded 13419 existing records from primary storage. [2025-09-14T20:00:40.282930] [INFO ] [MAIN ] SILA: Loaded 13419 existing records. [2025-09-14T20:00:40.461529] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:00:40.461857] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-14T20:00:40.461922] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-14T20:00:40.462554] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-14T20:00:40.462631] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-14T20:00:40.562126] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-14T20:00:40.817735] [INFO ] [REMOTE ] SILA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:00:41.358872] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-14T20:00:41.530945] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T20:00:41.817458] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T20:00:42.158858] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-14T20:00:42.958897] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-14T20:00:43.156221] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T20:00:43.607144] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T20:00:43.758850] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-14T20:00:44.558937] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-14T20:00:44.705687] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T20:00:45.042143] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T20:00:45.358855] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-14T20:00:45.788610] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T20:00:46.158893] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-14T20:00:46.398896] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T20:00:46.403603] [INFO ] [REMOTE ] SID: Full fetch complete (45135 records). [2025-09-14T20:00:46.403738] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-14T20:00:46.816796] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-14T20:00:46.816935] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-14T20:00:46.818022] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-14T20:00:46.818087] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-14T20:00:46.819344] [DEBUG] [LOCAL ] SID: Trimmed 45135 records to 31896 (keeping 150 days of data) [2025-09-14T20:00:46.973116] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-14T20:00:47.022272] [DEBUG] [LOCAL ] SID: Primary data saved (31896 records). [2025-09-14T20:00:47.022489] [INFO ] [MAIN ] SID: Full history saved. [2025-09-14T20:00:47.022935] [INFO ] [MAIN ] Update Progress: 1916/2370 symbols completed. SID took 22.7s. Estimated remaining: 48m 14s. Rate: 9.4 symbols/min [2025-09-14T20:00:47.202424] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:00:47.222736] [DEBUG] [LOCAL ] SITC: Loaded 19432 existing records from primary storage. [2025-09-14T20:00:47.222925] [INFO ] [MAIN ] SITC: Loaded 19432 existing records. [2025-09-14T20:00:47.399981] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:00:47.400290] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-14T20:00:47.400378] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-14T20:00:47.400903] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-14T20:00:47.400969] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-14T20:00:47.757604] [INFO ] [REMOTE ] SITC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:00:47.765895] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-14T20:00:47.782325] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T20:00:48.372426] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T20:00:48.558887] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-14T20:00:49.332800] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T20:00:49.358871] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-14T20:00:49.734417] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T20:00:50.158847] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-14T20:00:50.956347] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T20:00:50.966834] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-14T20:00:51.526319] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T20:00:51.758875] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-14T20:00:52.229181] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T20:00:52.558848] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-14T20:00:53.363906] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-14T20:00:53.380757] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T20:00:53.818404] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T20:00:54.158852] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-14T20:00:54.538373] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T20:00:54.958912] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-14T20:00:55.588745] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T20:00:55.758857] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-14T20:00:55.938175] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T20:00:55.941017] [INFO ] [REMOTE ] SII: Full fetch complete (24199 records). [2025-09-14T20:00:55.941172] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-14T20:00:56.310280] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-14T20:00:56.310402] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-14T20:00:56.311072] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-14T20:00:56.311154] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-14T20:00:56.312216] [DEBUG] [LOCAL ] SII: Trimmed 24199 records to 17573 (keeping 150 days of data) [2025-09-14T20:00:56.425700] [DEBUG] [LOCAL ] SII: Primary data saved (17573 records). [2025-09-14T20:00:56.425909] [INFO ] [MAIN ] SII: Full history saved. [2025-09-14T20:00:56.426093] [INFO ] [MAIN ] Update Progress: 1917/2370 symbols completed. SII took 20.0s. Estimated remaining: 48m 9s. Rate: 9.4 symbols/min [2025-09-14T20:00:56.558853] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-14T20:00:57.108133] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T20:00:57.112758] [INFO ] [REMOTE ] SIG: Full fetch complete (51140 records). [2025-09-14T20:00:57.112874] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-14T20:00:57.369279] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-14T20:00:57.541216] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-14T20:00:57.541407] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-14T20:00:57.542489] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-14T20:00:57.542585] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-14T20:00:57.544005] [DEBUG] [LOCAL ] SIG: Trimmed 51140 records to 34498 (keeping 150 days of data) [2025-09-14T20:00:57.660987] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T20:00:57.800502] [DEBUG] [LOCAL ] SIG: Primary data saved (34498 records). [2025-09-14T20:00:57.800696] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-14T20:00:57.800815] [INFO ] [MAIN ] Update Progress: 1918/2370 symbols completed. SIG took 32.3s. Estimated remaining: 48m 1s. Rate: 9.4 symbols/min [2025-09-14T20:00:58.158844] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-14T20:00:58.764861] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T20:00:58.958894] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-14T20:00:59.549399] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T20:00:59.758886] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-14T20:01:00.265887] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T20:01:00.558841] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-14T20:01:01.353205] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T20:01:01.362923] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-14T20:01:01.401104] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T20:01:01.404168] [INFO ] [REMOTE ] SILA: Full fetch complete (34347 records). [2025-09-14T20:01:01.404303] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-14T20:01:01.787963] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-14T20:01:01.788102] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-14T20:01:01.788916] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-14T20:01:01.788974] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-14T20:01:01.790167] [DEBUG] [LOCAL ] SILA: Trimmed 34347 records to 23103 (keeping 150 days of data) [2025-09-14T20:01:01.948760] [DEBUG] [LOCAL ] SILA: Primary data saved (23103 records). [2025-09-14T20:01:01.948955] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-14T20:01:01.949076] [INFO ] [MAIN ] Update Progress: 1919/2370 symbols completed. SILA took 21.9s. Estimated remaining: 47m 54s. Rate: 9.4 symbols/min [2025-09-14T20:01:03.998992] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-14T20:01:04.008684] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-14T20:01:05.733443] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T20:01:05.742942] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-14T20:01:06.439602] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:01:06.444469] [INFO ] [REMOTE ] SITC: Full fetch complete (45227 records). [2025-09-14T20:01:06.444592] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-14T20:01:06.822359] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-14T20:01:06.822492] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-14T20:01:06.823875] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-14T20:01:06.823968] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-14T20:01:06.825313] [DEBUG] [LOCAL ] SITC: Trimmed 45227 records to 30807 (keeping 150 days of data) [2025-09-14T20:01:07.051404] [DEBUG] [LOCAL ] SITC: Primary data saved (30807 records). [2025-09-14T20:01:07.051679] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-14T20:01:07.051845] [INFO ] [MAIN ] Update Progress: 1920/2370 symbols completed. SITC took 20.0s. Estimated remaining: 47m 48s. Rate: 9.4 symbols/min [2025-09-14T20:01:07.730908] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:07.757168] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:07.840940] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:07.863980] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:07.892494] [DEBUG] [LOCAL ] SKE: Loaded 15568 existing records from primary storage. [2025-09-14T20:01:07.892305] [DEBUG] [LOCAL ] SJT: Loaded 9657 existing records from primary storage. [2025-09-14T20:01:07.898368] [INFO ] [MAIN ] SKE: Loaded 15568 existing records. [2025-09-14T20:01:07.898753] [DEBUG] [LOCAL ] SITE: Loaded 15793 existing records from primary storage. [2025-09-14T20:01:07.904205] [INFO ] [MAIN ] SITE: Loaded 15793 existing records. [2025-09-14T20:01:07.898907] [INFO ] [MAIN ] SJT: Loaded 9657 existing records. [2025-09-14T20:01:08.135500] [DEBUG] [LOCAL ] SJM: Loaded 23326 existing records from primary storage. [2025-09-14T20:01:08.167494] [INFO ] [MAIN ] SJM: Loaded 23326 existing records. [2025-09-14T20:01:08.390317] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:08.553485] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-14T20:01:08.558849] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:08.584355] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-14T20:01:08.584188] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-14T20:01:08.676361] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-14T20:01:08.698112] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:08.715631] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-14T20:01:08.723086] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:08.723231] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-14T20:01:08.723584] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-14T20:01:08.723402] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-14T20:01:08.729357] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-14T20:01:08.729421] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-14T20:01:08.771740] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-14T20:01:08.729506] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-14T20:01:08.804189] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-14T20:01:08.828416] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-14T20:01:08.907590] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-14T20:01:08.923076] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-14T20:01:10.154907] [INFO ] [REMOTE ] SKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:10.263327] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-14T20:01:10.235967] [INFO ] [REMOTE ] SITE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:10.337726] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-14T20:01:10.390519] [INFO ] [REMOTE ] SJT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:10.423694] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-14T20:01:10.426784] [INFO ] [REMOTE ] SJM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:10.428483] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-14T20:01:11.905369] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T20:01:11.917458] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-14T20:01:11.977944] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T20:01:11.985280] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-14T20:01:12.308076] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T20:01:12.313588] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-14T20:01:12.519323] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T20:01:12.530115] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-14T20:01:13.086505] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T20:01:13.094218] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-14T20:01:13.433753] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T20:01:13.440916] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-14T20:01:13.493875] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T20:01:13.501748] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-14T20:01:14.045597] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T20:01:14.062825] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-14T20:01:14.257106] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-14T20:01:14.266350] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-14T20:01:14.910157] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T20:01:14.917618] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-14T20:01:15.155896] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T20:01:15.165161] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-14T20:01:15.841517] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T20:01:15.861925] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-14T20:01:15.884857] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T20:01:16.148295] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T20:01:16.558868] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-14T20:01:16.804198] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T20:01:17.358911] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-14T20:01:17.844757] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-14T20:01:18.061550] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T20:01:18.084351] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-14T20:01:18.158818] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-14T20:01:18.958838] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-14T20:01:19.274591] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T20:01:19.758864] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-14T20:01:20.423120] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T20:01:20.558780] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-14T20:01:20.655035] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T20:01:21.358895] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-14T20:01:22.033400] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T20:01:22.158818] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-14T20:01:22.422968] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-14T20:01:22.425471] [INFO ] [REMOTE ] SJT: Full fetch complete (24313 records). [2025-09-14T20:01:22.428627] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-14T20:01:22.792567] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-14T20:01:22.792706] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-14T20:01:22.793243] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-14T20:01:22.793296] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-14T20:01:22.793991] [DEBUG] [LOCAL ] SJT: Trimmed 24313 records to 16927 (keeping 150 days of data) [2025-09-14T20:01:22.888630] [DEBUG] [LOCAL ] SJT: Primary data saved (16927 records). [2025-09-14T20:01:22.888815] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-14T20:01:22.888921] [INFO ] [MAIN ] Update Progress: 1921/2370 symbols completed. SJT took 15.8s. Estimated remaining: 47m 44s. Rate: 9.4 symbols/min [2025-09-14T20:01:22.963952] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-14T20:01:23.062105] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:23.067169] [DEBUG] [LOCAL ] SKIL: Loaded 3040 existing records from primary storage. [2025-09-14T20:01:23.067280] [INFO ] [MAIN ] SKIL: Loaded 3040 existing records. [2025-09-14T20:01:23.244058] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:23.244287] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-14T20:01:23.244346] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-14T20:01:23.244574] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-14T20:01:23.244633] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-14T20:01:23.596370] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:23.606470] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T20:01:23.610409] [INFO ] [REMOTE ] SKE: Full fetch complete (37954 records). [2025-09-14T20:01:23.610515] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-14T20:01:23.766539] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-14T20:01:23.983523] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-14T20:01:23.983667] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-14T20:01:23.984492] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-14T20:01:23.984546] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-14T20:01:23.985493] [DEBUG] [LOCAL ] SKE: Trimmed 37954 records to 26035 (keeping 150 days of data) [2025-09-14T20:01:24.141138] [DEBUG] [LOCAL ] SKE: Primary data saved (26035 records). [2025-09-14T20:01:24.141308] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-14T20:01:24.141428] [INFO ] [MAIN ] Update Progress: 1922/2370 symbols completed. SKE took 17.1s. Estimated remaining: 47m 36s. Rate: 9.4 symbols/min [2025-09-14T20:01:24.311168] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:24.319265] [DEBUG] [LOCAL ] SKLZ: Loaded 5817 existing records from primary storage. [2025-09-14T20:01:24.319401] [INFO ] [MAIN ] SKLZ: Loaded 5817 existing records. [2025-09-14T20:01:24.495416] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:24.495716] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-14T20:01:24.495779] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-14T20:01:24.496043] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-14T20:01:24.496104] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-14T20:01:24.569813] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-14T20:01:24.854221] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:24.884955] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T20:01:24.981681] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T20:01:25.358895] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-14T20:01:25.453352] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T20:01:26.158891] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-14T20:01:26.900767] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T20:01:26.958845] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-14T20:01:27.136253] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T20:01:27.717429] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T20:01:27.758798] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-14T20:01:28.491214] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T20:01:28.558918] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-14T20:01:29.358853] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-14T20:01:29.969092] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T20:01:30.158882] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-14T20:01:30.160834] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T20:01:30.958843] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-14T20:01:31.758801] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-14T20:01:31.801515] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T20:01:31.923188] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T20:01:32.558831] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-14T20:01:32.962461] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T20:01:33.358833] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-14T20:01:33.677579] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T20:01:34.096253] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T20:01:34.158801] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-14T20:01:34.755799] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T20:01:34.757404] [INFO ] [REMOTE ] SKIL: Full fetch complete (6808 records). [2025-09-14T20:01:34.757503] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-14T20:01:34.963965] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-14T20:01:35.131126] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-14T20:01:35.131229] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-14T20:01:35.131444] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-14T20:01:35.131500] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-14T20:01:35.131953] [DEBUG] [LOCAL ] SKIL: Trimmed 6808 records to 4455 (keeping 150 days of data) [2025-09-14T20:01:35.157985] [DEBUG] [LOCAL ] SKIL: Primary data saved (4455 records). [2025-09-14T20:01:35.158072] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-14T20:01:35.158179] [INFO ] [MAIN ] Update Progress: 1923/2370 symbols completed. SKIL took 12.3s. Estimated remaining: 47m 31s. Rate: 9.4 symbols/min [2025-09-14T20:01:35.332798] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:35.348573] [DEBUG] [LOCAL ] SKM: Loaded 15087 existing records from primary storage. [2025-09-14T20:01:35.348751] [INFO ] [MAIN ] SKM: Loaded 15087 existing records. [2025-09-14T20:01:35.525409] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:35.525700] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-14T20:01:35.525794] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-14T20:01:35.526238] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-14T20:01:35.526299] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-14T20:01:35.763683] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-14T20:01:35.888725] [INFO ] [REMOTE ] SKM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:35.902285] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T20:01:35.907611] [INFO ] [REMOTE ] SJM: Full fetch complete (54473 records). [2025-09-14T20:01:35.907745] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-14T20:01:36.306825] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-14T20:01:36.307005] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-14T20:01:36.308776] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-14T20:01:36.308878] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-14T20:01:36.310677] [DEBUG] [LOCAL ] SJM: Trimmed 54473 records to 37734 (keeping 150 days of data) [2025-09-14T20:01:36.559480] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-14T20:01:36.563529] [DEBUG] [LOCAL ] SJM: Primary data saved (37734 records). [2025-09-14T20:01:36.564583] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-14T20:01:36.564739] [INFO ] [MAIN ] Update Progress: 1924/2370 symbols completed. SJM took 29.5s. Estimated remaining: 47m 23s. Rate: 9.4 symbols/min [2025-09-14T20:01:36.736922] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:36.762200] [DEBUG] [LOCAL ] SKT: Loaded 18635 existing records from primary storage. [2025-09-14T20:01:36.762571] [INFO ] [MAIN ] SKT: Loaded 18635 existing records. [2025-09-14T20:01:36.951269] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T20:01:36.957341] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:36.961518] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-14T20:01:36.961607] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-14T20:01:36.962134] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-14T20:01:36.962212] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-14T20:01:37.324403] [INFO ] [REMOTE ] SKT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:37.358778] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-14T20:01:38.158837] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-14T20:01:38.238002] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T20:01:38.958865] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-14T20:01:39.149599] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T20:01:39.174173] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T20:01:39.758858] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-14T20:01:40.118623] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T20:01:40.558836] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-14T20:01:41.272713] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T20:01:41.358865] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-14T20:01:41.821735] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T20:01:42.158835] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-14T20:01:42.267432] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T20:01:42.958844] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-14T20:01:43.751398] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T20:01:43.759400] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-14T20:01:44.522100] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-14T20:01:44.526330] [INFO ] [REMOTE ] SITE: Full fetch complete (38566 records). [2025-09-14T20:01:44.526461] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-14T20:01:44.563987] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-14T20:01:44.912227] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-14T20:01:44.912412] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-14T20:01:44.913989] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-14T20:01:44.914103] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-14T20:01:44.915861] [DEBUG] [LOCAL ] SITE: Trimmed 38566 records to 26142 (keeping 150 days of data) [2025-09-14T20:01:45.090850] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T20:01:45.107499] [DEBUG] [LOCAL ] SITE: Primary data saved (26142 records). [2025-09-14T20:01:45.108232] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-14T20:01:45.108369] [INFO ] [MAIN ] Update Progress: 1925/2370 symbols completed. SITE took 38.1s. Estimated remaining: 47m 17s. Rate: 9.4 symbols/min [2025-09-14T20:01:45.294511] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:45.315496] [DEBUG] [LOCAL ] SKY: Loaded 17538 existing records from primary storage. [2025-09-14T20:01:45.315821] [INFO ] [MAIN ] SKY: Loaded 17538 existing records. [2025-09-14T20:01:45.364162] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-14T20:01:45.507947] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:45.508278] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-14T20:01:45.508360] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-14T20:01:45.508982] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-14T20:01:45.509064] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-14T20:01:45.877081] [INFO ] [REMOTE ] SKY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:46.158876] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-14T20:01:46.371883] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T20:01:46.738169] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T20:01:46.828715] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T20:01:46.958845] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-14T20:01:47.758916] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-14T20:01:48.384098] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T20:01:48.558915] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-14T20:01:49.358848] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-14T20:01:49.482159] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T20:01:49.705164] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T20:01:50.158838] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-14T20:01:50.230003] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T20:01:50.231813] [INFO ] [REMOTE ] SKLZ: Full fetch complete (13025 records). [2025-09-14T20:01:50.231905] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-14T20:01:50.599222] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-14T20:01:50.599335] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-14T20:01:50.599710] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-14T20:01:50.599793] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-14T20:01:50.600347] [DEBUG] [LOCAL ] SKLZ: Trimmed 13025 records to 8626 (keeping 150 days of data) [2025-09-14T20:01:50.655319] [DEBUG] [LOCAL ] SKLZ: Primary data saved (8626 records). [2025-09-14T20:01:50.655743] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-14T20:01:50.655871] [INFO ] [MAIN ] Update Progress: 1926/2370 symbols completed. SKLZ took 26.5s. Estimated remaining: 47m 11s. Rate: 9.4 symbols/min [2025-09-14T20:01:50.829294] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:50.837799] [DEBUG] [LOCAL ] SKYH: Loaded 6416 existing records from primary storage. [2025-09-14T20:01:50.837951] [INFO ] [MAIN ] SKYH: Loaded 6416 existing records. [2025-09-14T20:01:50.963979] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-14T20:01:51.017093] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:51.017632] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-14T20:01:51.017719] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-14T20:01:51.018258] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-14T20:01:51.018326] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-14T20:01:51.380710] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:51.758862] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-14T20:01:51.830348] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T20:01:52.558854] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-14T20:01:52.609829] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T20:01:52.857496] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T20:01:53.358835] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-14T20:01:54.158888] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-14T20:01:54.198599] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T20:01:54.421511] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T20:01:54.958835] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-14T20:01:55.758863] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-14T20:01:55.903546] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T20:01:56.349337] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T20:01:56.558835] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-14T20:01:56.624861] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T20:01:56.628855] [INFO ] [REMOTE ] SKM: Full fetch complete (38173 records). [2025-09-14T20:01:56.628980] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-14T20:01:57.010106] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-14T20:01:57.010220] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-14T20:01:57.011080] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-14T20:01:57.011168] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-14T20:01:57.012217] [DEBUG] [LOCAL ] SKM: Trimmed 38173 records to 26547 (keeping 150 days of data) [2025-09-14T20:01:57.173360] [DEBUG] [LOCAL ] SKM: Primary data saved (26547 records). [2025-09-14T20:01:57.173532] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-14T20:01:57.173661] [INFO ] [MAIN ] Update Progress: 1927/2370 symbols completed. SKM took 22.0s. Estimated remaining: 47m 4s. Rate: 9.4 symbols/min [2025-09-14T20:01:57.356461] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:57.358812] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-14T20:01:57.382825] [DEBUG] [LOCAL ] SLB: Loaded 24109 existing records from primary storage. [2025-09-14T20:01:57.383013] [INFO ] [MAIN ] SLB: Loaded 24109 existing records. [2025-09-14T20:01:57.569858] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:57.570104] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-14T20:01:57.570191] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-14T20:01:57.570874] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-14T20:01:57.570946] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-14T20:01:57.925971] [INFO ] [REMOTE ] SLB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:58.012681] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T20:01:58.017276] [INFO ] [REMOTE ] SKT: Full fetch complete (46086 records). [2025-09-14T20:01:58.017402] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-14T20:01:58.165008] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-14T20:01:58.395089] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-14T20:01:58.395244] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-14T20:01:58.396566] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-14T20:01:58.396660] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-14T20:01:58.398040] [DEBUG] [LOCAL ] SKT: Trimmed 46086 records to 31692 (keeping 150 days of data) [2025-09-14T20:01:58.512364] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T20:01:58.635228] [DEBUG] [LOCAL ] SKT: Primary data saved (31692 records). [2025-09-14T20:01:58.635435] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-14T20:01:58.635624] [INFO ] [MAIN ] Update Progress: 1928/2370 symbols completed. SKT took 22.1s. Estimated remaining: 46m 57s. Rate: 9.4 symbols/min [2025-09-14T20:01:58.811558] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:01:58.832401] [DEBUG] [LOCAL ] SLF: Loaded 17982 existing records from primary storage. [2025-09-14T20:01:58.832603] [INFO ] [MAIN ] SLF: Loaded 17982 existing records. [2025-09-14T20:01:58.963893] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-14T20:01:59.016703] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:01:59.016932] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-14T20:01:59.016997] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-14T20:01:59.017477] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-14T20:01:59.017542] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-14T20:01:59.393153] [INFO ] [REMOTE ] SLF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:01:59.758809] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-14T20:01:59.935957] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T20:02:00.558892] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-14T20:02:00.805599] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T20:02:01.358854] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-14T20:02:01.392406] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T20:02:01.752795] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T20:02:02.158855] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-14T20:02:02.958856] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-14T20:02:03.184874] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T20:02:03.722726] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T20:02:03.758855] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-14T20:02:04.558906] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-14T20:02:05.240987] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-14T20:02:05.285063] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T20:02:05.358856] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-14T20:02:06.164144] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-14T20:02:06.175162] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T20:02:06.958886] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-14T20:02:07.384131] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T20:02:07.661770] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-14T20:02:07.758806] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-14T20:02:08.558842] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-14T20:02:08.872184] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T20:02:09.057552] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T20:02:09.358854] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-14T20:02:10.158895] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-14T20:02:10.650952] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T20:02:10.900835] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-14T20:02:10.930590] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T20:02:10.936903] [INFO ] [REMOTE ] SKY: Full fetch complete (40265 records). [2025-09-14T20:02:10.937064] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-14T20:02:10.968843] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-14T20:02:11.328912] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-14T20:02:11.329031] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-14T20:02:11.330183] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-14T20:02:11.330265] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-14T20:02:11.331379] [DEBUG] [LOCAL ] SKY: Trimmed 40265 records to 28735 (keeping 150 days of data) [2025-09-14T20:02:11.513867] [DEBUG] [LOCAL ] SKY: Primary data saved (28735 records). [2025-09-14T20:02:11.514063] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-14T20:02:11.514201] [INFO ] [MAIN ] Update Progress: 1929/2370 symbols completed. SKY took 26.4s. Estimated remaining: 46m 52s. Rate: 9.4 symbols/min [2025-09-14T20:02:11.700996] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:02:11.723173] [DEBUG] [LOCAL ] SLG: Loaded 20759 existing records from primary storage. [2025-09-14T20:02:11.723373] [INFO ] [MAIN ] SLG: Loaded 20759 existing records. [2025-09-14T20:02:11.768343] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-14T20:02:11.916184] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:02:11.916503] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-14T20:02:11.916593] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-14T20:02:11.917391] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-14T20:02:11.917466] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-14T20:02:12.299096] [INFO ] [REMOTE ] SLG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:02:12.315709] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T20:02:12.558891] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-14T20:02:13.358869] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-14T20:02:14.034932] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-14T20:02:14.158883] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-14T20:02:14.462858] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T20:02:14.602100] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T20:02:14.958840] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-14T20:02:15.758845] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-14T20:02:16.373103] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T20:02:16.503229] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T20:02:16.558797] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-14T20:02:17.358873] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-14T20:02:17.710690] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T20:02:18.161123] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-14T20:02:18.168488] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T20:02:18.958797] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-14T20:02:19.428437] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-14T20:02:19.758886] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-14T20:02:19.985811] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T20:02:20.122311] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-14T20:02:20.127102] [INFO ] [REMOTE ] SLF: Full fetch complete (43164 records). [2025-09-14T20:02:20.127314] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-14T20:02:20.418205] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T20:02:20.461326] [INFO ] [REMOTE ] SLB: Full fetch complete (58377 records). [2025-09-14T20:02:20.494310] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-14T20:02:20.563079] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-14T20:02:20.606146] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-14T20:02:20.642671] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-14T20:02:20.655229] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-14T20:02:20.703998] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-14T20:02:20.819905] [DEBUG] [LOCAL ] SLF: Trimmed 43164 records to 29232 (keeping 150 days of data) [2025-09-14T20:02:21.074627] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-14T20:02:21.074838] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-14T20:02:21.076316] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-14T20:02:21.101041] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-14T20:02:21.126722] [DEBUG] [LOCAL ] SLB: Trimmed 58377 records to 40437 (keeping 150 days of data) [2025-09-14T20:02:21.205721] [DEBUG] [LOCAL ] SLF: Primary data saved (29232 records). [2025-09-14T20:02:21.239089] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-14T20:02:21.240101] [INFO ] [MAIN ] Update Progress: 1930/2370 symbols completed. SLF took 22.6s. Estimated remaining: 46m 46s. Rate: 9.4 symbols/min [2025-09-14T20:02:21.362895] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-14T20:02:21.439364] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:02:21.538295] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T20:02:21.586176] [DEBUG] [LOCAL ] SLGN: Loaded 18407 existing records from primary storage. [2025-09-14T20:02:21.586917] [INFO ] [MAIN ] SLGN: Loaded 18407 existing records. [2025-09-14T20:02:21.791826] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:02:21.792478] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-14T20:02:21.792562] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-14T20:02:21.793531] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-14T20:02:21.793618] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-14T20:02:22.163799] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-14T20:02:22.168713] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:02:22.188984] [DEBUG] [LOCAL ] SLB: Primary data saved (40437 records). [2025-09-14T20:02:22.189148] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-14T20:02:22.189254] [INFO ] [MAIN ] Update Progress: 1931/2370 symbols completed. SLB took 25.0s. Estimated remaining: 46m 39s. Rate: 9.4 symbols/min [2025-09-14T20:02:22.358877] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:02:22.361093] [DEBUG] [LOCAL ] SLNZ: Loaded 307 existing records from primary storage. [2025-09-14T20:02:22.361182] [INFO ] [MAIN ] SLNZ: Loaded 307 existing records. [2025-09-14T20:02:22.536726] [WARN ] [MAIN ] SLNZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:02:22.536994] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-14T20:02:22.537056] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-14T20:02:22.537292] [DEBUG] [LOCAL ] SLNZ: Deleted primary data file. [2025-09-14T20:02:22.537352] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-14T20:02:22.893430] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:02:22.958843] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-14T20:02:23.046911] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T20:02:23.194032] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T20:02:23.356480] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-14T20:02:23.758860] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-14T20:02:24.558951] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-14T20:02:24.656660] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T20:02:24.658866] [INFO ] [REMOTE ] SKYH: Full fetch complete (17408 records). [2025-09-14T20:02:24.658961] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-14T20:02:24.975337] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T20:02:25.029313] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-14T20:02:25.029440] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-14T20:02:25.030005] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-14T20:02:25.030103] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-14T20:02:25.030918] [DEBUG] [LOCAL ] SKYH: Trimmed 17408 records to 11692 (keeping 150 days of data) [2025-09-14T20:02:25.108931] [DEBUG] [LOCAL ] SKYH: Primary data saved (11692 records). [2025-09-14T20:02:25.109130] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-14T20:02:25.109248] [INFO ] [MAIN ] Update Progress: 1932/2370 symbols completed. SKYH took 34.5s. Estimated remaining: 46m 32s. Rate: 9.4 symbols/min [2025-09-14T20:02:25.292030] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:02:25.313080] [DEBUG] [LOCAL ] SLQT: Loaded 19745 existing records from primary storage. [2025-09-14T20:02:25.313259] [INFO ] [MAIN ] SLQT: Loaded 19745 existing records. [2025-09-14T20:02:25.365751] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-14T20:02:25.494225] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:02:25.494515] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-14T20:02:25.494578] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-14T20:02:25.495167] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-14T20:02:25.495232] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-14T20:02:25.849274] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:02:25.898444] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T20:02:26.158851] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-14T20:02:26.958886] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-14T20:02:27.378858] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-14T20:02:27.758848] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-14T20:02:27.993527] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T20:02:28.558850] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-14T20:02:29.261911] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T20:02:29.358870] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-14T20:02:29.721503] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-14T20:02:30.158804] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-14T20:02:30.193996] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T20:02:30.490994] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-14T20:02:30.958898] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-14T20:02:31.758865] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-14T20:02:32.558880] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-14T20:02:32.648014] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T20:02:32.959051] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T20:02:33.358841] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-14T20:02:33.477177] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:02:33.680715] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T20:02:33.681521] [INFO ] [REMOTE ] SLNZ: Full fetch complete (804 records). [2025-09-14T20:02:33.681613] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-14T20:02:33.866827] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-14T20:02:33.867073] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:02:33.867128] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:02:33.867181] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-14T20:02:33.867256] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-14T20:02:33.867319] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-14T20:02:33.867424] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-14T20:02:33.867589] [INFO ] [MAIN ] Update Progress: 1933/2370 symbols completed. SLNZ took 11.7s. Estimated remaining: 46m 26s. Rate: 9.4 symbols/min [2025-09-14T20:02:34.039085] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:02:34.056682] [DEBUG] [LOCAL ] SLVM: Loaded 12612 existing records from primary storage. [2025-09-14T20:02:34.056843] [INFO ] [MAIN ] SLVM: Loaded 12612 existing records. [2025-09-14T20:02:34.163915] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-14T20:02:34.238271] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:02:34.238523] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-14T20:02:34.238582] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-14T20:02:34.238961] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-14T20:02:34.239031] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-14T20:02:34.606890] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:02:34.958918] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-14T20:02:35.758794] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-14T20:02:36.261431] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T20:02:36.558843] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-14T20:02:36.726619] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T20:02:37.330313] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T20:02:37.358792] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-14T20:02:37.434329] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T20:02:38.158878] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-14T20:02:38.914140] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T20:02:38.958824] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-14T20:02:39.758839] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-14T20:02:39.832087] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T20:02:40.392611] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T20:02:40.558875] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-14T20:02:41.263583] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T20:02:41.326536] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T20:02:41.331803] [INFO ] [REMOTE ] SLG: Full fetch complete (49144 records). [2025-09-14T20:02:41.331930] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-14T20:02:41.364021] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-14T20:02:41.712257] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-14T20:02:41.712386] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-14T20:02:41.713591] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-14T20:02:41.713681] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-14T20:02:41.715476] [DEBUG] [LOCAL ] SLG: Trimmed 49144 records to 34484 (keeping 150 days of data) [2025-09-14T20:02:41.954165] [DEBUG] [LOCAL ] SLG: Primary data saved (34484 records). [2025-09-14T20:02:41.954345] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-14T20:02:41.954584] [INFO ] [MAIN ] Update Progress: 1934/2370 symbols completed. SLG took 30.4s. Estimated remaining: 46m 20s. Rate: 9.4 symbols/min [2025-09-14T20:02:42.122952] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:02:42.146292] [DEBUG] [LOCAL ] SM: Loaded 23301 existing records from primary storage. [2025-09-14T20:02:42.146468] [INFO ] [MAIN ] SM: Loaded 23301 existing records. [2025-09-14T20:02:42.167077] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-14T20:02:42.325934] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:02:42.326223] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-14T20:02:42.326289] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-14T20:02:42.326849] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-14T20:02:42.326917] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-14T20:02:42.684266] [INFO ] [REMOTE ] SM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:02:42.958935] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-14T20:02:43.033846] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T20:02:43.560239] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T20:02:43.758847] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-14T20:02:44.558879] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-14T20:02:44.715377] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T20:02:45.358875] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-14T20:02:45.515694] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T20:02:46.158882] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-14T20:02:46.286763] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T20:02:46.690787] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T20:02:46.958877] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-14T20:02:47.758873] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-14T20:02:47.810170] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T20:02:48.045321] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T20:02:48.050427] [INFO ] [REMOTE ] SLGN: Full fetch complete (43662 records). [2025-09-14T20:02:48.050560] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-14T20:02:48.465722] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-14T20:02:48.465879] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-14T20:02:48.467570] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-14T20:02:48.467635] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-14T20:02:48.469091] [DEBUG] [LOCAL ] SLGN: Trimmed 43662 records to 29671 (keeping 150 days of data) [2025-09-14T20:02:48.569830] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-14T20:02:48.696011] [DEBUG] [LOCAL ] SLGN: Primary data saved (29671 records). [2025-09-14T20:02:48.696245] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-14T20:02:48.696518] [INFO ] [MAIN ] Update Progress: 1935/2370 symbols completed. SLGN took 27.5s. Estimated remaining: 46m 13s. Rate: 9.4 symbols/min [2025-09-14T20:02:48.881254] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:02:48.924878] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T20:02:48.956246] [DEBUG] [LOCAL ] SMA: Loaded 15236 existing records from primary storage. [2025-09-14T20:02:48.956512] [INFO ] [MAIN ] SMA: Loaded 15236 existing records. [2025-09-14T20:02:49.155969] [WARN ] [MAIN ] SMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:02:49.156362] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-14T20:02:49.156426] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-14T20:02:49.157076] [DEBUG] [LOCAL ] SMA: Deleted primary data file. [2025-09-14T20:02:49.157146] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-14T20:02:49.365474] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-14T20:02:49.535508] [INFO ] [REMOTE ] SMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:02:49.907339] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T20:02:50.158878] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-14T20:02:50.428612] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:02:50.429095] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-14T20:02:50.958854] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-14T20:02:50.994680] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T20:02:51.235201] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:02:51.235696] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-14T20:02:51.758875] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-14T20:02:52.558865] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-14T20:02:53.118974] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T20:02:53.358856] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-14T20:02:54.158852] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-14T20:02:54.675145] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T20:02:54.681906] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T20:02:54.697178] [INFO ] [REMOTE ] SLQT: Full fetch complete (48945 records). [2025-09-14T20:02:54.697343] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-14T20:02:54.968096] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-14T20:02:55.090934] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-14T20:02:55.091075] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-14T20:02:55.092663] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-14T20:02:55.092726] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-14T20:02:55.094182] [DEBUG] [LOCAL ] SLQT: Trimmed 48945 records to 33229 (keeping 150 days of data) [2025-09-14T20:02:55.326418] [DEBUG] [LOCAL ] SLQT: Primary data saved (33229 records). [2025-09-14T20:02:55.326624] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-14T20:02:55.326783] [INFO ] [MAIN ] Update Progress: 1936/2370 symbols completed. SLQT took 30.2s. Estimated remaining: 46m 7s. Rate: 9.4 symbols/min [2025-09-14T20:02:55.507443] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:02:55.514273] [DEBUG] [LOCAL ] SMBK: Loaded 3572 existing records from primary storage. [2025-09-14T20:02:55.514456] [INFO ] [MAIN ] SMBK: Loaded 3572 existing records. [2025-09-14T20:02:55.700700] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:02:55.701183] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-14T20:02:55.701261] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-14T20:02:55.701762] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-14T20:02:55.701848] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-14T20:02:55.767100] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-14T20:02:55.956290] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T20:02:56.101598] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:02:56.558843] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-14T20:02:56.905990] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T20:02:57.030388] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T20:02:57.075928] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-14T20:02:57.358836] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-14T20:02:58.158894] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-14T20:02:58.773571] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T20:02:58.958859] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-14T20:02:59.537733] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T20:02:59.758908] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-14T20:03:00.535243] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T20:03:00.558887] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-14T20:03:01.358849] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-14T20:03:01.513838] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T20:03:02.141268] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T20:03:02.158838] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-14T20:03:02.958875] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-14T20:03:03.758847] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-14T20:03:04.726698] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-14T20:03:04.729981] [INFO ] [REMOTE ] SLVM: Full fetch complete (30634 records). [2025-09-14T20:03:04.730079] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-14T20:03:04.915267] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-14T20:03:04.967940] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-14T20:03:05.118803] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-14T20:03:05.118921] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-14T20:03:05.119801] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-14T20:03:05.119869] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-14T20:03:05.120892] [DEBUG] [LOCAL ] SLVM: Trimmed 30634 records to 20614 (keeping 150 days of data) [2025-09-14T20:03:05.244541] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (3.89 seconds). [2025-09-14T20:03:05.284749] [DEBUG] [LOCAL ] SLVM: Primary data saved (20614 records). [2025-09-14T20:03:05.284928] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-14T20:03:05.285087] [INFO ] [MAIN ] Update Progress: 1937/2370 symbols completed. SLVM took 31.4s. Estimated remaining: 46m 2s. Rate: 9.4 symbols/min [2025-09-14T20:03:05.373581] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-14T20:03:05.458291] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:05.466746] [DEBUG] [LOCAL ] SMC: Loaded 5112 existing records from primary storage. [2025-09-14T20:03:05.466927] [INFO ] [MAIN ] SMC: Loaded 5112 existing records. [2025-09-14T20:03:05.655105] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:05.655415] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-14T20:03:05.655493] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-14T20:03:05.656187] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-14T20:03:05.656260] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-14T20:03:06.034525] [INFO ] [REMOTE ] SMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:06.041974] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T20:03:06.076828] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-14T20:03:06.158771] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-14T20:03:06.958877] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-14T20:03:07.186315] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T20:03:07.744453] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T20:03:07.758783] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-14T20:03:07.961964] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T20:03:08.558821] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-14T20:03:09.032116] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T20:03:09.035677] [INFO ] [REMOTE ] SMA: Full fetch complete (27727 records). [2025-09-14T20:03:09.035794] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-14T20:03:09.217722] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 113 unique days, need 150 days [2025-09-14T20:03:09.218265] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:03:09.218343] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:03:09.218420] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-14T20:03:09.218597] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-14T20:03:09.218693] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-14T20:03:09.218838] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-14T20:03:09.218971] [INFO ] [MAIN ] Update Progress: 1938/2370 symbols completed. SMA took 20.5s. Estimated remaining: 45m 55s. Rate: 9.4 symbols/min [2025-09-14T20:03:09.372161] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-14T20:03:09.397957] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:09.414365] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T20:03:09.420035] [INFO ] [REMOTE ] SM: Full fetch complete (56942 records). [2025-09-14T20:03:09.420214] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-14T20:03:09.594631] [DEBUG] [LOCAL ] SMFG: Loaded 21444 existing records from primary storage. [2025-09-14T20:03:09.631324] [INFO ] [MAIN ] SMFG: Loaded 21444 existing records. [2025-09-14T20:03:10.018915] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-14T20:03:10.024398] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-14T20:03:10.024343] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:10.025559] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-14T20:03:10.025869] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-14T20:03:10.025907] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-14T20:03:10.026109] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-14T20:03:10.026823] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-14T20:03:10.027062] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-14T20:03:10.058721] [DEBUG] [LOCAL ] SM: Trimmed 56942 records to 39255 (keeping 150 days of data) [2025-09-14T20:03:10.183417] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-14T20:03:10.365453] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T20:03:10.517297] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:10.665538] [DEBUG] [LOCAL ] SM: Primary data saved (39255 records). [2025-09-14T20:03:10.665758] [INFO ] [MAIN ] SM: Full history saved. [2025-09-14T20:03:10.665889] [INFO ] [MAIN ] Update Progress: 1939/2370 symbols completed. SM took 28.7s. Estimated remaining: 45m 47s. Rate: 9.4 symbols/min [2025-09-14T20:03:10.839467] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:10.858117] [DEBUG] [LOCAL ] SMG: Loaded 18483 existing records from primary storage. [2025-09-14T20:03:10.858294] [INFO ] [MAIN ] SMG: Loaded 18483 existing records. [2025-09-14T20:03:10.960547] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-14T20:03:11.040596] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:11.040892] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-14T20:03:11.040963] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-14T20:03:11.041449] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-14T20:03:11.041510] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-14T20:03:11.397018] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T20:03:11.421443] [INFO ] [REMOTE ] SMG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:11.490502] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T20:03:11.758843] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-14T20:03:12.558877] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-14T20:03:12.633311] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T20:03:13.358840] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-14T20:03:13.803578] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T20:03:14.158877] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-14T20:03:14.187177] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T20:03:14.188473] [INFO ] [REMOTE ] SMBK: Full fetch complete (8770 records). [2025-09-14T20:03:14.188558] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-14T20:03:14.557155] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-14T20:03:14.557261] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-14T20:03:14.557520] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-14T20:03:14.557571] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-14T20:03:14.558052] [DEBUG] [LOCAL ] SMBK: Trimmed 8770 records to 6091 (keeping 150 days of data) [2025-09-14T20:03:14.600684] [DEBUG] [LOCAL ] SMBK: Primary data saved (6091 records). [2025-09-14T20:03:14.600863] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-14T20:03:14.600974] [INFO ] [MAIN ] Update Progress: 1940/2370 symbols completed. SMBK took 19.3s. Estimated remaining: 45m 40s. Rate: 9.4 symbols/min [2025-09-14T20:03:14.769769] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:14.777157] [DEBUG] [LOCAL ] SMHI: Loaded 5602 existing records from primary storage. [2025-09-14T20:03:14.777304] [INFO ] [MAIN ] SMHI: Loaded 5602 existing records. [2025-09-14T20:03:14.955100] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:14.955355] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-14T20:03:14.955414] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-14T20:03:14.955761] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-14T20:03:14.955829] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-14T20:03:14.966895] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-14T20:03:15.354000] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:15.758834] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-14T20:03:16.558866] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-14T20:03:16.817451] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T20:03:16.865250] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T20:03:16.908445] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-14T20:03:17.358864] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-14T20:03:18.148158] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T20:03:18.158773] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-14T20:03:18.695189] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T20:03:18.958813] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-14T20:03:19.209854] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T20:03:19.758831] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-14T20:03:20.029563] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T20:03:20.558873] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-14T20:03:20.641168] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T20:03:21.358852] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-14T20:03:21.718838] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-14T20:03:22.158865] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-14T20:03:22.871981] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T20:03:22.958889] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-14T20:03:23.051706] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T20:03:23.758842] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-14T20:03:24.558797] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-14T20:03:24.609480] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T20:03:24.902105] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T20:03:25.358931] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-14T20:03:25.545044] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T20:03:26.158898] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-14T20:03:26.344629] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T20:03:26.907119] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T20:03:26.908898] [INFO ] [REMOTE ] SMC: Full fetch complete (12579 records). [2025-09-14T20:03:26.908992] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-14T20:03:26.964126] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-14T20:03:27.278881] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-14T20:03:27.279016] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-14T20:03:27.279463] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-14T20:03:27.279519] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-14T20:03:27.280135] [DEBUG] [LOCAL ] SMC: Trimmed 12579 records to 7971 (keeping 150 days of data) [2025-09-14T20:03:27.330611] [DEBUG] [LOCAL ] SMC: Primary data saved (7971 records). [2025-09-14T20:03:27.330837] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-14T20:03:27.330956] [INFO ] [MAIN ] Update Progress: 1941/2370 symbols completed. SMC took 22.0s. Estimated remaining: 45m 35s. Rate: 9.4 symbols/min [2025-09-14T20:03:27.511275] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:27.522961] [DEBUG] [LOCAL ] SMP: Loaded 8121 existing records from primary storage. [2025-09-14T20:03:27.523186] [INFO ] [MAIN ] SMP: Loaded 8121 existing records. [2025-09-14T20:03:27.714289] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:27.714699] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-14T20:03:27.714772] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-14T20:03:27.715218] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-14T20:03:27.715279] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-14T20:03:27.770319] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-14T20:03:28.100534] [INFO ] [REMOTE ] SMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:28.558920] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-14T20:03:28.756795] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-14T20:03:29.008736] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T20:03:29.358861] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-14T20:03:29.606744] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T20:03:30.158836] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-14T20:03:30.223373] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T20:03:30.958841] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-14T20:03:31.758882] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-14T20:03:31.905687] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T20:03:31.934509] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T20:03:32.289928] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T20:03:32.295240] [INFO ] [REMOTE ] SMFG: Full fetch complete (52121 records). [2025-09-14T20:03:32.295443] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-14T20:03:32.564049] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-14T20:03:32.683478] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-14T20:03:32.683617] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-14T20:03:32.684829] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-14T20:03:32.684943] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-14T20:03:32.686438] [DEBUG] [LOCAL ] SMFG: Trimmed 52121 records to 36185 (keeping 150 days of data) [2025-09-14T20:03:32.930903] [DEBUG] [LOCAL ] SMFG: Primary data saved (36185 records). [2025-09-14T20:03:32.931124] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-14T20:03:32.931294] [INFO ] [MAIN ] Update Progress: 1942/2370 symbols completed. SMFG took 23.7s. Estimated remaining: 45m 29s. Rate: 9.4 symbols/min [2025-09-14T20:03:33.108166] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:33.132380] [DEBUG] [LOCAL ] SMR: Loaded 24221 existing records from primary storage. [2025-09-14T20:03:33.132562] [INFO ] [MAIN ] SMR: Loaded 24221 existing records. [2025-09-14T20:03:33.311287] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:33.311571] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-14T20:03:33.311633] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-14T20:03:33.312332] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-09-14T20:03:33.312411] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-14T20:03:33.367194] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-14T20:03:33.683809] [INFO ] [REMOTE ] SMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:33.689206] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:03:34.158836] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-14T20:03:34.964020] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-14T20:03:34.966247] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T20:03:35.758858] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-14T20:03:35.876194] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T20:03:36.558860] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-14T20:03:36.737121] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-14T20:03:37.036272] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T20:03:37.358845] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-14T20:03:38.158849] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-14T20:03:38.335920] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T20:03:38.682958] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T20:03:38.958853] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-14T20:03:39.758833] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-14T20:03:40.140068] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T20:03:40.455423] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:03:40.459835] [INFO ] [REMOTE ] SMG: Full fetch complete (48569 records). [2025-09-14T20:03:40.459968] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-14T20:03:40.564159] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-14T20:03:40.871099] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-14T20:03:40.871355] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-14T20:03:40.872786] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-14T20:03:40.872917] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-14T20:03:40.874520] [DEBUG] [LOCAL ] SMG: Trimmed 48569 records to 32743 (keeping 150 days of data) [2025-09-14T20:03:41.008890] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-14T20:03:41.147875] [DEBUG] [LOCAL ] SMG: Primary data saved (32743 records). [2025-09-14T20:03:41.148134] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-14T20:03:41.148269] [INFO ] [MAIN ] Update Progress: 1943/2370 symbols completed. SMG took 30.5s. Estimated remaining: 45m 23s. Rate: 9.4 symbols/min [2025-09-14T20:03:41.302939] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T20:03:41.357230] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:41.358790] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-14T20:03:41.380014] [DEBUG] [LOCAL ] SMRT: Loaded 18937 existing records from primary storage. [2025-09-14T20:03:41.380259] [INFO ] [MAIN ] SMRT: Loaded 18937 existing records. [2025-09-14T20:03:41.598212] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:41.598587] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-14T20:03:41.598682] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-14T20:03:41.599266] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-14T20:03:41.599334] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-14T20:03:41.973427] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:42.158850] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-14T20:03:42.241507] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T20:03:42.673381] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T20:03:42.674932] [INFO ] [REMOTE ] SMHI: Full fetch complete (16443 records). [2025-09-14T20:03:42.675017] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-14T20:03:42.963998] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-14T20:03:43.046454] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-14T20:03:43.046558] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-14T20:03:43.046994] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-14T20:03:43.047051] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-14T20:03:43.047662] [DEBUG] [LOCAL ] SMHI: Trimmed 16443 records to 9825 (keeping 150 days of data) [2025-09-14T20:03:43.103464] [DEBUG] [LOCAL ] SMHI: Primary data saved (9825 records). [2025-09-14T20:03:43.103660] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-14T20:03:43.103781] [INFO ] [MAIN ] Update Progress: 1944/2370 symbols completed. SMHI took 28.5s. Estimated remaining: 45m 15s. Rate: 9.4 symbols/min [2025-09-14T20:03:43.285479] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:43.301008] [DEBUG] [LOCAL ] SMWB: Loaded 14804 existing records from primary storage. [2025-09-14T20:03:43.301167] [INFO ] [MAIN ] SMWB: Loaded 14804 existing records. [2025-09-14T20:03:43.478537] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:43.478849] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-14T20:03:43.478915] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-14T20:03:43.479272] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-14T20:03:43.479333] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-14T20:03:43.764914] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-14T20:03:43.849072] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:44.449228] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T20:03:44.558838] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-14T20:03:44.999954] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T20:03:45.358876] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-14T20:03:46.158839] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-14T20:03:46.191362] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T20:03:46.259113] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T20:03:46.958839] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-14T20:03:47.581079] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T20:03:47.583329] [INFO ] [REMOTE ] SMP: Full fetch complete (21339 records). [2025-09-14T20:03:47.583424] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-14T20:03:47.764319] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-14T20:03:47.966169] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-14T20:03:47.966325] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-14T20:03:47.966926] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-14T20:03:47.967098] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-14T20:03:48.001183] [DEBUG] [LOCAL ] SMP: Trimmed 21339 records to 14146 (keeping 150 days of data) [2025-09-14T20:03:48.006777] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T20:03:48.110473] [DEBUG] [LOCAL ] SMP: Primary data saved (14146 records). [2025-09-14T20:03:48.110711] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-14T20:03:48.110831] [INFO ] [MAIN ] Update Progress: 1945/2370 symbols completed. SMP took 20.8s. Estimated remaining: 45m 9s. Rate: 9.4 symbols/min [2025-09-14T20:03:48.303930] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:03:48.331082] [DEBUG] [LOCAL ] SN: Loaded 22192 existing records from primary storage. [2025-09-14T20:03:48.331324] [INFO ] [MAIN ] SN: Loaded 22192 existing records. [2025-09-14T20:03:48.526413] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:03:48.526844] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-14T20:03:48.526916] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-14T20:03:48.527542] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-14T20:03:48.527617] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-14T20:03:48.564030] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-14T20:03:48.914124] [INFO ] [REMOTE ] SN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:03:49.301726] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T20:03:49.358784] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-14T20:03:50.158841] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-14T20:03:50.847005] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T20:03:50.958837] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-14T20:03:51.182077] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-14T20:03:51.758860] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-14T20:03:51.841284] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T20:03:52.451029] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T20:03:52.558786] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-14T20:03:53.358852] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-14T20:03:54.093680] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T20:03:54.158856] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-14T20:03:54.522312] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-14T20:03:54.958863] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-14T20:03:55.179341] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T20:03:55.529295] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T20:03:55.758908] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-14T20:03:56.558844] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-14T20:03:56.666951] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T20:03:57.150095] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T20:03:57.358851] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-14T20:03:58.060162] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T20:03:58.158874] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-14T20:03:58.958870] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-14T20:03:59.758892] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-14T20:03:59.861882] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T20:04:00.096088] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-09-14T20:04:00.558909] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-14T20:04:00.803939] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T20:04:01.063673] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T20:04:01.067584] [INFO ] [REMOTE ] SMWB: Full fetch complete (37539 records). [2025-09-14T20:04:01.067783] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-14T20:04:01.366089] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-14T20:04:01.462318] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-14T20:04:01.462497] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-14T20:04:01.463471] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-14T20:04:01.463541] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-14T20:04:01.464759] [DEBUG] [LOCAL ] SMWB: Trimmed 37539 records to 25149 (keeping 150 days of data) [2025-09-14T20:04:01.615261] [DEBUG] [LOCAL ] SMWB: Primary data saved (25149 records). [2025-09-14T20:04:01.615445] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-14T20:04:01.615597] [INFO ] [MAIN ] Update Progress: 1946/2370 symbols completed. SMWB took 18.5s. Estimated remaining: 45m 4s. Rate: 9.4 symbols/min [2025-09-14T20:04:01.799162] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:01.815015] [DEBUG] [LOCAL ] SNA: Loaded 10648 existing records from primary storage. [2025-09-14T20:04:01.815227] [INFO ] [MAIN ] SNA: Loaded 10648 existing records. [2025-09-14T20:04:02.004148] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:02.004462] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-14T20:04:02.004533] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-14T20:04:02.004923] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-14T20:04:02.004983] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-14T20:04:02.182446] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-14T20:04:02.382042] [INFO ] [REMOTE ] SNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:02.958885] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-14T20:04:03.666522] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (3.11 seconds). [2025-09-14T20:04:03.713047] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-14T20:04:03.758847] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-14T20:04:04.026616] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T20:04:04.071895] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T20:04:04.558826] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-14T20:04:05.358841] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-14T20:04:05.644313] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T20:04:05.695819] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-14T20:04:05.699944] [INFO ] [REMOTE ] SMRT: Full fetch complete (48250 records). [2025-09-14T20:04:05.700132] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-14T20:04:06.109689] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-14T20:04:06.109805] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-14T20:04:06.110976] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-14T20:04:06.111041] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-14T20:04:06.112187] [DEBUG] [LOCAL ] SMRT: Trimmed 48250 records to 33340 (keeping 150 days of data) [2025-09-14T20:04:06.161466] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-14T20:04:06.309243] [DEBUG] [LOCAL ] SMRT: Primary data saved (33340 records). [2025-09-14T20:04:06.309432] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-14T20:04:06.309571] [INFO ] [MAIN ] Update Progress: 1947/2370 symbols completed. SMRT took 25.2s. Estimated remaining: 44m 57s. Rate: 9.4 symbols/min [2025-09-14T20:04:06.492066] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:06.516814] [DEBUG] [LOCAL ] SNAP: Loaded 24209 existing records from primary storage. [2025-09-14T20:04:06.517074] [INFO ] [MAIN ] SNAP: Loaded 24209 existing records. [2025-09-14T20:04:06.703525] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:06.703852] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-14T20:04:06.703918] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-14T20:04:06.704444] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-14T20:04:06.704513] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-14T20:04:06.972462] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-14T20:04:07.108852] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:07.258688] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T20:04:07.758872] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-14T20:04:08.558823] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-14T20:04:08.904477] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-14T20:04:09.096736] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-09-14T20:04:09.358846] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-14T20:04:09.932847] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-14T20:04:10.053429] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T20:04:10.158866] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-14T20:04:10.958854] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-14T20:04:11.513343] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T20:04:11.758887] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-14T20:04:11.990921] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-14T20:04:11.997354] [INFO ] [REMOTE ] SMR: Full fetch complete (58477 records). [2025-09-14T20:04:11.997688] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-14T20:04:12.422773] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-09-14T20:04:12.422934] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-09-14T20:04:12.424535] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-09-14T20:04:12.424616] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-09-14T20:04:12.426713] [DEBUG] [LOCAL ] SMR: Trimmed 58477 records to 40540 (keeping 150 days of data) [2025-09-14T20:04:12.559690] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-14T20:04:12.720247] [DEBUG] [LOCAL ] SMR: Primary data saved (40540 records). [2025-09-14T20:04:12.720486] [INFO ] [MAIN ] SMR: Full history saved. [2025-09-14T20:04:12.720614] [INFO ] [MAIN ] Update Progress: 1948/2370 symbols completed. SMR took 39.8s. Estimated remaining: 44m 51s. Rate: 9.4 symbols/min [2025-09-14T20:04:12.916419] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:12.947796] [DEBUG] [LOCAL ] SNDA: Loaded 1788 existing records from primary storage. [2025-09-14T20:04:12.955392] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T20:04:12.966610] [INFO ] [MAIN ] SNDA: Loaded 1788 existing records. [2025-09-14T20:04:12.978794] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T20:04:13.200874] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:13.201239] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-14T20:04:13.201379] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-14T20:04:13.201743] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-14T20:04:13.201819] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-14T20:04:13.367245] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-14T20:04:13.578719] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:14.158911] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-14T20:04:14.865301] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T20:04:14.883933] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T20:04:14.958793] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-14T20:04:14.999926] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-14T20:04:15.758905] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-14T20:04:16.327028] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T20:04:16.558835] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-14T20:04:17.358895] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-14T20:04:17.777258] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T20:04:17.918057] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T20:04:17.920823] [INFO ] [REMOTE ] SNA: Full fetch complete (28899 records). [2025-09-14T20:04:17.920970] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-14T20:04:18.170799] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-14T20:04:18.315738] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-14T20:04:18.315857] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-14T20:04:18.316607] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-14T20:04:18.316690] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-14T20:04:18.317720] [DEBUG] [LOCAL ] SNA: Trimmed 28899 records to 18915 (keeping 150 days of data) [2025-09-14T20:04:18.452516] [DEBUG] [LOCAL ] SNA: Primary data saved (18915 records). [2025-09-14T20:04:18.452779] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-14T20:04:18.452955] [INFO ] [MAIN ] Update Progress: 1949/2370 symbols completed. SNA took 16.8s. Estimated remaining: 44m 44s. Rate: 9.4 symbols/min [2025-09-14T20:04:18.642694] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:18.665016] [DEBUG] [LOCAL ] SNDR: Loaded 18089 existing records from primary storage. [2025-09-14T20:04:18.665256] [INFO ] [MAIN ] SNDR: Loaded 18089 existing records. [2025-09-14T20:04:18.866351] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:18.866731] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-14T20:04:18.866842] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-14T20:04:18.867437] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-14T20:04:18.867515] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-14T20:04:18.964711] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-14T20:04:19.189262] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T20:04:19.258062] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:19.298352] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-14T20:04:19.758876] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-14T20:04:20.558841] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-14T20:04:20.671535] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-14T20:04:20.677658] [INFO ] [REMOTE ] SN: Full fetch complete (54242 records). [2025-09-14T20:04:20.677819] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-14T20:04:21.056860] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-14T20:04:21.056988] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-14T20:04:21.058152] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-14T20:04:21.058221] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-14T20:04:21.059792] [DEBUG] [LOCAL ] SN: Trimmed 54242 records to 37572 (keeping 150 days of data) [2025-09-14T20:04:21.316828] [DEBUG] [LOCAL ] SN: Primary data saved (37572 records). [2025-09-14T20:04:21.317030] [INFO ] [MAIN ] SN: Full history saved. [2025-09-14T20:04:21.317193] [INFO ] [MAIN ] Update Progress: 1950/2370 symbols completed. SN took 33.2s. Estimated remaining: 44m 37s. Rate: 9.4 symbols/min [2025-09-14T20:04:21.363823] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-14T20:04:21.451402] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T20:04:21.529200] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:21.556791] [DEBUG] [LOCAL ] SNN: Loaded 20430 existing records from primary storage. [2025-09-14T20:04:21.557022] [INFO ] [MAIN ] SNN: Loaded 20430 existing records. [2025-09-14T20:04:21.744397] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:21.744781] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-14T20:04:21.744850] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-14T20:04:21.745354] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-14T20:04:21.745418] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-14T20:04:22.126544] [INFO ] [REMOTE ] SNN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:22.158780] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-14T20:04:22.236113] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-14T20:04:22.958893] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-14T20:04:23.081985] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T20:04:23.758908] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-14T20:04:23.952487] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T20:04:24.558857] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-14T20:04:24.657329] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T20:04:25.346982] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-14T20:04:25.358764] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-14T20:04:26.158895] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-14T20:04:26.278194] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:04:26.958887] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-14T20:04:27.758883] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-14T20:04:27.838521] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T20:04:27.946762] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-14T20:04:28.314216] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-14T20:04:28.558829] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-14T20:04:28.709842] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T20:04:29.358890] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-14T20:04:30.156184] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T20:04:30.165137] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-14T20:04:30.958851] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-14T20:04:31.598598] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T20:04:31.758810] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-14T20:04:31.795009] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T20:04:32.043091] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-14T20:04:32.558812] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-14T20:04:33.358822] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-14T20:04:33.521515] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T20:04:34.158880] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-14T20:04:34.578561] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T20:04:34.894264] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-14T20:04:34.900684] [INFO ] [REMOTE ] SNAP: Full fetch complete (58475 records). [2025-09-14T20:04:34.900872] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-14T20:04:34.964598] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-14T20:04:35.287098] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-14T20:04:35.287206] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-14T20:04:35.288883] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-14T20:04:35.288970] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-14T20:04:35.290273] [DEBUG] [LOCAL ] SNAP: Trimmed 58475 records to 40536 (keeping 150 days of data) [2025-09-14T20:04:35.529619] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T20:04:35.585505] [DEBUG] [LOCAL ] SNAP: Primary data saved (40536 records). [2025-09-14T20:04:35.585703] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-14T20:04:35.585888] [INFO ] [MAIN ] Update Progress: 1951/2370 symbols completed. SNAP took 29.3s. Estimated remaining: 44m 32s. Rate: 9.4 symbols/min [2025-09-14T20:04:35.754935] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:35.758938] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-14T20:04:35.759318] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T20:04:35.785782] [DEBUG] [LOCAL ] SNOW: Loaded 24015 existing records from primary storage. [2025-09-14T20:04:35.785964] [INFO ] [MAIN ] SNOW: Loaded 24015 existing records. [2025-09-14T20:04:35.964478] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:35.964845] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-14T20:04:35.964919] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-14T20:04:35.965576] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-09-14T20:04:35.965696] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-14T20:04:36.311090] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:36.558874] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-14T20:04:37.358859] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-14T20:04:37.520362] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T20:04:38.158800] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-14T20:04:38.196298] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T20:04:38.294794] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T20:04:38.958882] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-14T20:04:39.513497] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T20:04:39.514556] [INFO ] [REMOTE ] SNDA: Full fetch complete (5327 records). [2025-09-14T20:04:39.514673] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-14T20:04:39.766594] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-14T20:04:39.879981] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-14T20:04:39.880241] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-14T20:04:39.880550] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-14T20:04:39.902008] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-14T20:04:39.907173] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T20:04:39.905980] [DEBUG] [LOCAL ] SNDA: Trimmed 5327 records to 3402 (keeping 150 days of data) [2025-09-14T20:04:39.937806] [DEBUG] [LOCAL ] SNDA: Primary data saved (3402 records). [2025-09-14T20:04:39.937945] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-14T20:04:39.938055] [INFO ] [MAIN ] Update Progress: 1952/2370 symbols completed. SNDA took 27.2s. Estimated remaining: 44m 26s. Rate: 9.4 symbols/min [2025-09-14T20:04:40.106817] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:40.132340] [DEBUG] [LOCAL ] SNV: Loaded 22406 existing records from primary storage. [2025-09-14T20:04:40.132522] [INFO ] [MAIN ] SNV: Loaded 22406 existing records. [2025-09-14T20:04:40.314806] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:40.315117] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-14T20:04:40.315183] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-14T20:04:40.315839] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-14T20:04:40.315907] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-14T20:04:40.563995] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-14T20:04:40.673820] [INFO ] [REMOTE ] SNV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:41.358906] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-14T20:04:41.437706] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T20:04:41.633250] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T20:04:42.158873] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-14T20:04:42.833301] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:04:42.838142] [INFO ] [REMOTE ] SNDR: Full fetch complete (44070 records). [2025-09-14T20:04:42.838346] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-14T20:04:42.960080] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-14T20:04:43.183176] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-14T20:04:43.262422] [INFO ] [REMOTE ] SNN: Full fetch complete (47887 records). [2025-09-14T20:04:43.278985] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-14T20:04:43.278841] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-14T20:04:43.279099] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-14T20:04:43.280787] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-14T20:04:43.280904] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-14T20:04:43.386562] [DEBUG] [LOCAL ] SNDR: Trimmed 44070 records to 30052 (keeping 150 days of data) [2025-09-14T20:04:43.771051] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-14T20:04:43.785978] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-14T20:04:43.787076] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-14T20:04:43.789309] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-14T20:04:43.790909] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-14T20:04:43.794889] [DEBUG] [LOCAL ] SNN: Trimmed 47887 records to 33604 (keeping 150 days of data) [2025-09-14T20:04:44.070624] [DEBUG] [LOCAL ] SNDR: Primary data saved (30052 records). [2025-09-14T20:04:44.078530] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-14T20:04:44.079796] [INFO ] [MAIN ] Update Progress: 1953/2370 symbols completed. SNDR took 25.6s. Estimated remaining: 44m 19s. Rate: 9.4 symbols/min [2025-09-14T20:04:44.110374] [DEBUG] [LOCAL ] SNN: Primary data saved (33604 records). [2025-09-14T20:04:44.142571] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-14T20:04:44.164768] [INFO ] [MAIN ] Update Progress: 1954/2370 symbols completed. SNN took 22.8s. Estimated remaining: 44m 11s. Rate: 9.4 symbols/min [2025-09-14T20:04:44.403149] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:44.465915] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:44.507404] [DEBUG] [LOCAL ] SNX: Loaded 16870 existing records from primary storage. [2025-09-14T20:04:44.507766] [INFO ] [MAIN ] SNX: Loaded 16870 existing records. [2025-09-14T20:04:44.608152] [DEBUG] [LOCAL ] SO: Loaded 24005 existing records from primary storage. [2025-09-14T20:04:44.632439] [INFO ] [MAIN ] SO: Loaded 24005 existing records. [2025-09-14T20:04:44.810211] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:44.821845] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-14T20:04:44.830994] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-14T20:04:44.853599] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-14T20:04:44.887121] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-14T20:04:44.922596] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:44.983297] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-14T20:04:44.998260] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-14T20:04:45.035736] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-09-14T20:04:45.043141] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-14T20:04:45.582205] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-14T20:04:45.615667] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T20:04:45.737314] [INFO ] [REMOTE ] SNX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:45.730996] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-14T20:04:45.776037] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-14T20:04:45.841162] [INFO ] [REMOTE ] SO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:46.158970] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-14T20:04:46.800025] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T20:04:46.958906] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-14T20:04:47.289151] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T20:04:47.599006] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T20:04:47.758838] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-14T20:04:48.558822] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-14T20:04:48.584073] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T20:04:48.717385] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T20:04:49.358837] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-14T20:04:50.158866] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-14T20:04:50.444951] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T20:04:50.958847] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-14T20:04:51.031602] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T20:04:51.082601] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:04:51.758849] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-14T20:04:52.558822] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-14T20:04:52.813547] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T20:04:52.896120] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T20:04:53.358823] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-14T20:04:54.158792] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-14T20:04:54.441603] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T20:04:54.958827] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-14T20:04:55.319395] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T20:04:55.474393] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T20:04:55.480009] [INFO ] [REMOTE ] SNOW: Full fetch complete (58250 records). [2025-09-14T20:04:55.480157] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-14T20:04:55.763906] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-14T20:04:55.865139] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-09-14T20:04:55.865256] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-09-14T20:04:55.866550] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-09-14T20:04:55.866636] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-09-14T20:04:55.868117] [DEBUG] [LOCAL ] SNOW: Trimmed 58250 records to 40348 (keeping 150 days of data) [2025-09-14T20:04:56.140514] [DEBUG] [LOCAL ] SNOW: Primary data saved (40348 records). [2025-09-14T20:04:56.140710] [INFO ] [MAIN ] SNOW: Full history saved. [2025-09-14T20:04:56.140813] [INFO ] [MAIN ] Update Progress: 1955/2370 symbols completed. SNOW took 20.6s. Estimated remaining: 44m 6s. Rate: 9.4 symbols/min [2025-09-14T20:04:56.309943] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:04:56.327393] [DEBUG] [LOCAL ] SOBO: Loaded 16852 existing records from primary storage. [2025-09-14T20:04:56.327559] [INFO ] [MAIN ] SOBO: Loaded 16852 existing records. [2025-09-14T20:04:56.505246] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:04:56.505603] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-14T20:04:56.505702] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-14T20:04:56.506334] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-14T20:04:56.506400] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-14T20:04:56.569357] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-14T20:04:56.866183] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:04:56.982180] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T20:04:57.358811] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-14T20:04:57.420790] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:04:58.158867] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-14T20:04:58.574634] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T20:04:58.917676] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T20:04:58.958785] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-14T20:04:59.758879] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-14T20:04:59.836905] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T20:05:00.558841] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-14T20:05:00.720383] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T20:05:01.358836] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-14T20:05:01.644990] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T20:05:02.158897] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-14T20:05:02.945635] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-14T20:05:02.963896] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-14T20:05:02.972575] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T20:05:02.978525] [INFO ] [REMOTE ] SNV: Full fetch complete (53205 records). [2025-09-14T20:05:02.978738] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-14T20:05:03.367043] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-14T20:05:03.367344] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-14T20:05:03.368258] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-14T20:05:03.368332] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-14T20:05:03.369711] [DEBUG] [LOCAL ] SNV: Trimmed 53205 records to 36219 (keeping 150 days of data) [2025-09-14T20:05:03.595188] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-14T20:05:03.634965] [DEBUG] [LOCAL ] SNV: Primary data saved (36219 records). [2025-09-14T20:05:03.635235] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-14T20:05:03.635383] [INFO ] [MAIN ] Update Progress: 1956/2370 symbols completed. SNV took 23.7s. Estimated remaining: 43m 60s. Rate: 9.4 symbols/min [2025-09-14T20:05:03.773928] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-14T20:05:03.804377] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:03.826321] [DEBUG] [LOCAL ] SOC: Loaded 22733 existing records from primary storage. [2025-09-14T20:05:03.826487] [INFO ] [MAIN ] SOC: Loaded 22733 existing records. [2025-09-14T20:05:03.999689] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:03.999910] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-14T20:05:04.000014] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-14T20:05:04.000757] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-14T20:05:04.000821] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-14T20:05:04.342371] [INFO ] [REMOTE ] SOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:04.558839] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-14T20:05:05.167488] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T20:05:05.358909] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-14T20:05:05.455919] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T20:05:06.158840] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-14T20:05:06.575566] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T20:05:06.958884] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-14T20:05:07.103513] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T20:05:07.350247] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T20:05:07.758911] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-14T20:05:08.543940] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T20:05:08.558769] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-14T20:05:09.111481] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T20:05:09.358807] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-14T20:05:10.158798] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-14T20:05:10.649533] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T20:05:10.958922] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-14T20:05:11.072266] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T20:05:11.758922] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-14T20:05:11.863281] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T20:05:12.558830] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-14T20:05:12.710409] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T20:05:13.301689] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T20:05:13.358824] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-14T20:05:13.932909] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-14T20:05:13.937348] [INFO ] [REMOTE ] SOBO: Full fetch complete (43696 records). [2025-09-14T20:05:13.937510] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-14T20:05:14.164001] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-14T20:05:14.325566] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-14T20:05:14.325727] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-14T20:05:14.326846] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-14T20:05:14.326910] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-14T20:05:14.328184] [DEBUG] [LOCAL ] SOBO: Trimmed 43696 records to 29189 (keeping 150 days of data) [2025-09-14T20:05:14.512715] [DEBUG] [LOCAL ] SOBO: Primary data saved (29189 records). [2025-09-14T20:05:14.512912] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-14T20:05:14.513013] [INFO ] [MAIN ] Update Progress: 1957/2370 symbols completed. SOBO took 18.4s. Estimated remaining: 43m 54s. Rate: 9.4 symbols/min [2025-09-14T20:05:14.958888] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-14T20:05:14.987275] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T20:05:14.993079] [INFO ] [REMOTE ] SO: Full fetch complete (58280 records). [2025-09-14T20:05:14.993294] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-14T20:05:15.325774] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T20:05:15.433967] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-09-14T20:05:15.434108] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-09-14T20:05:15.435515] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-09-14T20:05:15.435661] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-09-14T20:05:15.446830] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T20:05:15.451116] [DEBUG] [LOCAL ] SO: Trimmed 58280 records to 40357 (keeping 150 days of data) [2025-09-14T20:05:15.451221] [INFO ] [REMOTE ] SNX: Full fetch complete (42532 records). [2025-09-14T20:05:15.451397] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-14T20:05:15.763971] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-14T20:05:15.942858] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-14T20:05:15.943890] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-14T20:05:15.945263] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-14T20:05:15.946365] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-14T20:05:15.950655] [DEBUG] [LOCAL ] SNX: Trimmed 42532 records to 28354 (keeping 150 days of data) [2025-09-14T20:05:16.263287] [DEBUG] [LOCAL ] SNX: Primary data saved (28354 records). [2025-09-14T20:05:16.264270] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-14T20:05:16.265295] [INFO ] [MAIN ] Update Progress: 1958/2370 symbols completed. SNX took 32.2s. Estimated remaining: 43m 47s. Rate: 9.4 symbols/min [2025-09-14T20:05:16.294853] [DEBUG] [LOCAL ] SO: Primary data saved (40357 records). [2025-09-14T20:05:16.295067] [INFO ] [MAIN ] SO: Full history saved. [2025-09-14T20:05:16.295197] [INFO ] [MAIN ] Update Progress: 1959/2370 symbols completed. SO took 32.1s. Estimated remaining: 43m 39s. Rate: 9.4 symbols/min [2025-09-14T20:05:17.988996] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-14T20:05:18.000059] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-14T20:05:19.806871] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T20:05:19.817892] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-14T20:05:21.679381] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T20:05:21.690909] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-14T20:05:23.581147] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T20:05:23.592088] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-14T20:05:25.192471] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T20:05:25.198028] [INFO ] [REMOTE ] SOC: Full fetch complete (54292 records). [2025-09-14T20:05:25.198196] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-14T20:05:25.586863] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-14T20:05:25.586985] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-14T20:05:25.588105] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-14T20:05:25.588177] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-14T20:05:25.589424] [DEBUG] [LOCAL ] SOC: Trimmed 54292 records to 38142 (keeping 150 days of data) [2025-09-14T20:05:25.916329] [DEBUG] [LOCAL ] SOC: Primary data saved (38142 records). [2025-09-14T20:05:25.916520] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-14T20:05:25.916659] [INFO ] [MAIN ] Update Progress: 1960/2370 symbols completed. SOC took 22.3s. Estimated remaining: 43m 34s. Rate: 9.4 symbols/min [2025-09-14T20:05:26.617923] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:26.620936] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:26.670320] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:26.673682] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:26.685357] [DEBUG] [LOCAL ] SOJC: Loaded 1811 existing records from primary storage. [2025-09-14T20:05:26.691327] [INFO ] [MAIN ] SOJC: Loaded 1811 existing records. [2025-09-14T20:05:26.691185] [DEBUG] [LOCAL ] SOJE: Loaded 3961 existing records from primary storage. [2025-09-14T20:05:26.691963] [DEBUG] [LOCAL ] SOJF: Loaded 3998 existing records from primary storage. [2025-09-14T20:05:26.698850] [INFO ] [MAIN ] SOJF: Loaded 3998 existing records. [2025-09-14T20:05:26.714889] [INFO ] [MAIN ] SOJE: Loaded 3961 existing records. [2025-09-14T20:05:26.879338] [DEBUG] [LOCAL ] SOJD: Loaded 5410 existing records from primary storage. [2025-09-14T20:05:26.930303] [INFO ] [MAIN ] SOJD: Loaded 5410 existing records. [2025-09-14T20:05:27.295795] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:27.260843] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:27.377370] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-14T20:05:27.363920] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-14T20:05:27.418126] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-14T20:05:27.427258] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-14T20:05:27.438599] [WARN ] [MAIN ] SOJF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:27.508206] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:27.508370] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-14T20:05:27.508480] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-14T20:05:27.509235] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-14T20:05:27.509424] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-14T20:05:27.509064] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-14T20:05:27.508987] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-14T20:05:27.509882] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-14T20:05:27.509917] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-14T20:05:27.595260] [DEBUG] [LOCAL ] SOJF: Deleted primary data file. [2025-09-14T20:05:27.600523] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-14T20:05:27.651742] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-14T20:05:27.643949] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-14T20:05:28.878466] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:28.917280] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-14T20:05:28.922000] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:28.983787] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-14T20:05:29.061251] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:29.090716] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-14T20:05:29.090280] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:29.091932] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-14T20:05:29.721384] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T20:05:29.722997] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-14T20:05:29.875390] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T20:05:29.877992] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-14T20:05:29.898243] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T20:05:29.900994] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-14T20:05:29.957358] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T20:05:29.960755] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-14T20:05:30.509308] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T20:05:30.511604] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-14T20:05:30.592704] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T20:05:30.596361] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-14T20:05:30.731800] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T20:05:30.734560] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-14T20:05:30.811939] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T20:05:30.815354] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-14T20:05:31.297059] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T20:05:31.300374] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-14T20:05:31.374000] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T20:05:31.377226] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-14T20:05:31.609315] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T20:05:31.612284] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-14T20:05:31.791498] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T20:05:31.797572] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-14T20:05:31.954484] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T20:05:32.232776] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T20:05:32.304324] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T20:05:32.492373] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T20:05:32.558793] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-14T20:05:33.358841] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-14T20:05:33.440844] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T20:05:33.848785] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T20:05:34.158843] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-14T20:05:34.835632] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T20:05:34.958853] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-14T20:05:35.758850] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-14T20:05:35.922464] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T20:05:36.345737] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T20:05:36.558818] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-14T20:05:37.115865] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T20:05:37.116992] [INFO ] [REMOTE ] SOJC: Full fetch complete (5427 records). [2025-09-14T20:05:37.117090] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-14T20:05:37.363893] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-14T20:05:37.473829] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-14T20:05:37.473945] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-14T20:05:37.474129] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-14T20:05:37.474196] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-14T20:05:37.474682] [DEBUG] [LOCAL ] SOJC: Trimmed 5427 records to 3322 (keeping 150 days of data) [2025-09-14T20:05:37.495777] [DEBUG] [LOCAL ] SOJC: Primary data saved (3322 records). [2025-09-14T20:05:37.495885] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-14T20:05:37.495983] [INFO ] [MAIN ] Update Progress: 1961/2370 symbols completed. SOJC took 11.6s. Estimated remaining: 43m 28s. Rate: 9.4 symbols/min [2025-09-14T20:05:37.671109] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:37.678973] [DEBUG] [LOCAL ] SOL: Loaded 6114 existing records from primary storage. [2025-09-14T20:05:37.679099] [INFO ] [MAIN ] SOL: Loaded 6114 existing records. [2025-09-14T20:05:37.856037] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:37.856298] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-14T20:05:37.856374] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-14T20:05:37.856688] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-14T20:05:37.856780] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-14T20:05:38.172519] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-14T20:05:38.211464] [INFO ] [REMOTE ] SOL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:38.276591] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T20:05:38.900190] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-14T20:05:38.958893] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-14T20:05:39.763927] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-14T20:05:39.778000] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T20:05:40.558819] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-14T20:05:40.593165] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T20:05:41.149135] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T20:05:41.358849] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-14T20:05:42.158870] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-14T20:05:42.363632] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T20:05:42.917762] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T20:05:42.958790] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-14T20:05:43.550594] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T20:05:43.552057] [INFO ] [REMOTE ] SOJE: Full fetch complete (10309 records). [2025-09-14T20:05:43.552150] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-14T20:05:43.770394] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-14T20:05:43.966091] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-14T20:05:43.966225] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-14T20:05:43.966566] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-14T20:05:43.966635] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-14T20:05:43.967160] [DEBUG] [LOCAL ] SOJE: Trimmed 10309 records to 6732 (keeping 150 days of data) [2025-09-14T20:05:44.012231] [DEBUG] [LOCAL ] SOJE: Primary data saved (6732 records). [2025-09-14T20:05:44.012416] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-14T20:05:44.012521] [INFO ] [MAIN ] Update Progress: 1962/2370 symbols completed. SOJE took 18.1s. Estimated remaining: 43m 22s. Rate: 9.4 symbols/min [2025-09-14T20:05:44.187475] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:44.206834] [DEBUG] [LOCAL ] SOLV: Loaded 19089 existing records from primary storage. [2025-09-14T20:05:44.207064] [INFO ] [MAIN ] SOLV: Loaded 19089 existing records. [2025-09-14T20:05:44.390429] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:44.390729] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-14T20:05:44.390794] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-14T20:05:44.391275] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-14T20:05:44.391346] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-14T20:05:44.562944] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-14T20:05:44.660248] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T20:05:44.699249] [INFO ] [REMOTE ] SOJD: Full fetch complete (14317 records). [2025-09-14T20:05:44.719863] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-14T20:05:44.772620] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:45.160724] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-14T20:05:45.160861] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-14T20:05:45.161342] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-14T20:05:45.161400] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-14T20:05:45.161995] [DEBUG] [LOCAL ] SOJD: Trimmed 14317 records to 9332 (keeping 150 days of data) [2025-09-14T20:05:45.219887] [DEBUG] [LOCAL ] SOJD: Primary data saved (9332 records). [2025-09-14T20:05:45.220063] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-14T20:05:45.220188] [INFO ] [MAIN ] Update Progress: 1963/2370 symbols completed. SOJD took 19.3s. Estimated remaining: 43m 15s. Rate: 9.4 symbols/min [2025-09-14T20:05:45.367205] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-14T20:05:45.391932] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:45.400003] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T20:05:45.420711] [DEBUG] [LOCAL ] SON: Loaded 19592 existing records from primary storage. [2025-09-14T20:05:45.420876] [INFO ] [MAIN ] SON: Loaded 19592 existing records. [2025-09-14T20:05:45.611273] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:45.611553] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-14T20:05:45.611666] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-14T20:05:45.612187] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-14T20:05:45.612253] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-14T20:05:45.988114] [INFO ] [REMOTE ] SON: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:46.158854] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-14T20:05:46.522001] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T20:05:46.781937] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T20:05:46.783225] [INFO ] [REMOTE ] SOJF: Full fetch complete (9658 records). [2025-09-14T20:05:46.783310] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-14T20:05:46.964011] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-14T20:05:47.153247] [DEBUG] [VALIDATOR ] SOJF: All expected trading days are present. [2025-09-14T20:05:47.153351] [DEBUG] [VALIDATOR ] SOJF: Primary data validation passed. [2025-09-14T20:05:47.153595] [INFO ] [MAIN ] SOJF: Fetched primary data is valid. [2025-09-14T20:05:47.153666] [DEBUG] [LOCAL ] SOJF: Saving primary data. [2025-09-14T20:05:47.154126] [DEBUG] [LOCAL ] SOJF: Trimmed 9658 records to 6057 (keeping 150 days of data) [2025-09-14T20:05:47.191632] [DEBUG] [LOCAL ] SOJF: Primary data saved (6057 records). [2025-09-14T20:05:47.191797] [INFO ] [MAIN ] SOJF: Full history saved. [2025-09-14T20:05:47.191920] [INFO ] [MAIN ] Update Progress: 1964/2370 symbols completed. SOJF took 21.3s. Estimated remaining: 43m 7s. Rate: 9.4 symbols/min [2025-09-14T20:05:47.361639] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:05:47.385224] [DEBUG] [LOCAL ] SONY: Loaded 23920 existing records from primary storage. [2025-09-14T20:05:47.385396] [INFO ] [MAIN ] SONY: Loaded 23920 existing records. [2025-09-14T20:05:47.562134] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:05:47.562456] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-14T20:05:47.562525] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-14T20:05:47.563129] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-14T20:05:47.563201] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-14T20:05:47.768471] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-14T20:05:47.918155] [INFO ] [REMOTE ] SONY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:05:48.072618] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T20:05:48.558817] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-14T20:05:49.358810] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-14T20:05:49.443434] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T20:05:50.076853] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T20:05:50.158824] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-14T20:05:50.244345] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T20:05:50.958829] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-14T20:05:51.758844] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-14T20:05:51.908717] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T20:05:52.397557] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T20:05:52.558823] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-14T20:05:52.795191] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T20:05:53.014194] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-14T20:05:53.358827] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-14T20:05:54.158855] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-14T20:05:54.958800] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-14T20:05:55.132197] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T20:05:55.322468] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T20:05:55.758848] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-14T20:05:56.558837] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-14T20:05:56.615154] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T20:05:57.309575] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T20:05:57.358798] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-14T20:05:58.158901] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-14T20:05:58.442873] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T20:05:58.958858] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-14T20:05:58.998449] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-14T20:05:59.695245] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T20:05:59.758809] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-14T20:05:59.900199] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T20:06:00.558875] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-14T20:06:01.358874] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-14T20:06:01.686256] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-14T20:06:02.158911] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-14T20:06:02.373830] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T20:06:02.958857] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-14T20:06:03.758816] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-14T20:06:04.234456] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-09-14T20:06:04.558896] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-14T20:06:05.121923] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T20:06:05.358913] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-14T20:06:06.307137] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-14T20:06:06.310395] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-14T20:06:06.419708] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (4.26 seconds). [2025-09-14T20:06:06.473830] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T20:06:06.963939] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-14T20:06:06.978961] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-14T20:06:07.301801] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T20:06:07.303729] [INFO ] [REMOTE ] SOL: Full fetch complete (14993 records). [2025-09-14T20:06:07.303822] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-14T20:06:07.697458] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-14T20:06:07.697592] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-14T20:06:07.698424] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-14T20:06:07.698497] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-14T20:06:07.699234] [DEBUG] [LOCAL ] SOL: Trimmed 14993 records to 9735 (keeping 150 days of data) [2025-09-14T20:06:07.759886] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-14T20:06:07.774058] [DEBUG] [LOCAL ] SOL: Primary data saved (9735 records). [2025-09-14T20:06:07.774283] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-14T20:06:07.774525] [INFO ] [MAIN ] Update Progress: 1965/2370 symbols completed. SOL took 30.3s. Estimated remaining: 43m 4s. Rate: 9.4 symbols/min [2025-09-14T20:06:07.953190] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:07.957338] [DEBUG] [LOCAL ] SOR: Loaded 1224 existing records from primary storage. [2025-09-14T20:06:07.957448] [INFO ] [MAIN ] SOR: Loaded 1224 existing records. [2025-09-14T20:06:08.135148] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:08.135385] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-14T20:06:08.135445] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-14T20:06:08.135691] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-14T20:06:08.135766] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-14T20:06:08.489585] [INFO ] [REMOTE ] SOR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:08.531310] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T20:06:08.538713] [INFO ] [REMOTE ] SONY: Full fetch complete (58021 records). [2025-09-14T20:06:08.538927] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-14T20:06:08.564180] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-14T20:06:08.930220] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-14T20:06:08.930399] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-14T20:06:08.931583] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-14T20:06:08.931659] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-14T20:06:08.932894] [DEBUG] [LOCAL ] SONY: Trimmed 58021 records to 40174 (keeping 150 days of data) [2025-09-14T20:06:09.210795] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-14T20:06:09.226534] [DEBUG] [LOCAL ] SONY: Primary data saved (40174 records). [2025-09-14T20:06:09.226879] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-14T20:06:09.227014] [INFO ] [MAIN ] Update Progress: 1966/2370 symbols completed. SONY took 22.0s. Estimated remaining: 42m 56s. Rate: 9.4 symbols/min [2025-09-14T20:06:09.369502] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-14T20:06:09.401172] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:09.408574] [DEBUG] [LOCAL ] SOS: Loaded 5806 existing records from primary storage. [2025-09-14T20:06:09.408735] [INFO ] [MAIN ] SOS: Loaded 5806 existing records. [2025-09-14T20:06:09.588286] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:09.588614] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-14T20:06:09.588696] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-14T20:06:09.589046] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-14T20:06:09.589104] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-14T20:06:09.942713] [INFO ] [REMOTE ] SOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:10.158795] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-14T20:06:10.280888] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T20:06:10.424101] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T20:06:10.629104] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T20:06:10.634022] [INFO ] [REMOTE ] SOLV: Full fetch complete (47998 records). [2025-09-14T20:06:10.634145] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-14T20:06:10.965986] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-14T20:06:11.017221] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-14T20:06:11.017322] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-14T20:06:11.018361] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-14T20:06:11.018418] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-14T20:06:11.019782] [DEBUG] [LOCAL ] SOLV: Trimmed 47998 records to 32609 (keeping 150 days of data) [2025-09-14T20:06:11.235362] [DEBUG] [LOCAL ] SOLV: Primary data saved (32609 records). [2025-09-14T20:06:11.235561] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-14T20:06:11.235766] [INFO ] [MAIN ] Update Progress: 1967/2370 symbols completed. SOLV took 27.2s. Estimated remaining: 42m 49s. Rate: 9.4 symbols/min [2025-09-14T20:06:11.408086] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:11.424788] [DEBUG] [LOCAL ] SPB: Loaded 15636 existing records from primary storage. [2025-09-14T20:06:11.424942] [INFO ] [MAIN ] SPB: Loaded 15636 existing records. [2025-09-14T20:06:11.602841] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:11.603123] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-14T20:06:11.603185] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-14T20:06:11.603677] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-14T20:06:11.603739] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-14T20:06:11.766009] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-14T20:06:11.896758] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T20:06:11.992423] [INFO ] [REMOTE ] SPB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:12.523957] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T20:06:12.530222] [INFO ] [REMOTE ] SON: Full fetch complete (46581 records). [2025-09-14T20:06:12.530457] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-14T20:06:12.564136] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-14T20:06:12.926377] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-14T20:06:12.926489] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-14T20:06:12.927620] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-14T20:06:12.927719] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-14T20:06:12.928849] [DEBUG] [LOCAL ] SON: Trimmed 46581 records to 31881 (keeping 150 days of data) [2025-09-14T20:06:13.152431] [DEBUG] [LOCAL ] SON: Primary data saved (31881 records). [2025-09-14T20:06:13.152616] [INFO ] [MAIN ] SON: Full history saved. [2025-09-14T20:06:13.152798] [INFO ] [MAIN ] Update Progress: 1968/2370 symbols completed. SON took 27.9s. Estimated remaining: 42m 42s. Rate: 9.4 symbols/min [2025-09-14T20:06:13.330997] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:13.335788] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T20:06:13.361248] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-14T20:06:13.363039] [DEBUG] [LOCAL ] SPCE: Loaded 22294 existing records from primary storage. [2025-09-14T20:06:13.364278] [INFO ] [MAIN ] SPCE: Loaded 22294 existing records. [2025-09-14T20:06:13.546193] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:13.546499] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-14T20:06:13.546563] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-14T20:06:13.547113] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-14T20:06:13.547173] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-14T20:06:13.903852] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:14.082810] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-14T20:06:14.158827] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-14T20:06:14.672548] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T20:06:14.958854] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-14T20:06:15.640259] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T20:06:15.758842] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-14T20:06:16.558835] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-14T20:06:17.228656] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T20:06:17.358846] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-14T20:06:17.682466] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T20:06:17.886790] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-14T20:06:18.158866] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-14T20:06:18.958867] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-14T20:06:19.632593] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T20:06:19.758863] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-14T20:06:20.558876] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-14T20:06:21.057445] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T20:06:21.358878] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-14T20:06:21.686027] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T20:06:21.700336] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T20:06:22.158830] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-14T20:06:22.779194] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T20:06:22.958854] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-14T20:06:23.758844] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-14T20:06:24.010335] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T20:06:24.438908] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T20:06:24.554034] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T20:06:24.556624] [INFO ] [REMOTE ] SOS: Full fetch complete (7540 records). [2025-09-14T20:06:24.556738] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-14T20:06:24.568424] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-14T20:06:24.956388] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-14T20:06:24.956593] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-14T20:06:24.956872] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-14T20:06:24.956928] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-14T20:06:24.957425] [DEBUG] [LOCAL ] SOS: Trimmed 7540 records to 6662 (keeping 150 days of data) [2025-09-14T20:06:25.002986] [DEBUG] [LOCAL ] SOS: Primary data saved (6662 records). [2025-09-14T20:06:25.003244] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-14T20:06:25.003381] [INFO ] [MAIN ] Update Progress: 1969/2370 symbols completed. SOS took 15.8s. Estimated remaining: 42m 37s. Rate: 9.4 symbols/min [2025-09-14T20:06:25.184293] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:25.189717] [DEBUG] [LOCAL ] SPE: Loaded 2822 existing records from primary storage. [2025-09-14T20:06:25.189838] [INFO ] [MAIN ] SPE: Loaded 2822 existing records. [2025-09-14T20:06:25.299305] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T20:06:25.361432] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-14T20:06:25.384980] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:25.385461] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-14T20:06:25.385534] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-14T20:06:25.385902] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-14T20:06:25.385980] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-14T20:06:25.760434] [INFO ] [REMOTE ] SPE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:26.158833] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-14T20:06:26.827734] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T20:06:26.958847] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-14T20:06:27.685872] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T20:06:27.707983] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T20:06:27.758829] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-14T20:06:28.268880] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T20:06:28.558816] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-14T20:06:29.358851] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-14T20:06:30.158869] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-14T20:06:30.637816] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-14T20:06:30.672112] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T20:06:30.958899] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-14T20:06:31.359461] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T20:06:31.758832] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-14T20:06:32.558828] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-14T20:06:33.258278] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:06:33.259297] [INFO ] [REMOTE ] SOR: Full fetch complete (3161 records). [2025-09-14T20:06:33.259428] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-14T20:06:33.360026] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-14T20:06:33.621860] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-14T20:06:33.622280] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-14T20:06:33.622545] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-14T20:06:33.622710] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-14T20:06:33.623599] [DEBUG] [LOCAL ] SOR: Trimmed 3161 records to 2202 (keeping 150 days of data) [2025-09-14T20:06:33.686443] [DEBUG] [LOCAL ] SOR: Primary data saved (2202 records). [2025-09-14T20:06:33.687675] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-14T20:06:33.688962] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-14T20:06:33.690059] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-14T20:06:33.690284] [INFO ] [MAIN ] Update Progress: 1970/2370 symbols completed. SOR took 25.9s. Estimated remaining: 42m 31s. Rate: 9.4 symbols/min [2025-09-14T20:06:33.879385] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:33.907074] [DEBUG] [LOCAL ] SPG: Loaded 22389 existing records from primary storage. [2025-09-14T20:06:33.907225] [INFO ] [MAIN ] SPG: Loaded 22389 existing records. [2025-09-14T20:06:34.085435] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:34.085752] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-14T20:06:34.085814] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-14T20:06:34.086464] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-14T20:06:34.086524] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-14T20:06:34.166791] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-14T20:06:34.255490] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T20:06:34.506123] [INFO ] [REMOTE ] SPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:34.958837] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-14T20:06:35.758853] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-14T20:06:35.966449] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T20:06:36.558843] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-14T20:06:36.718667] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T20:06:37.077353] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T20:06:37.358890] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-14T20:06:37.821308] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T20:06:38.158886] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-14T20:06:38.958863] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-14T20:06:39.398808] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T20:06:39.490165] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T20:06:39.519190] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T20:06:39.758872] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-14T20:06:40.558857] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-14T20:06:41.277995] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T20:06:41.358800] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-14T20:06:41.447892] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-14T20:06:41.454838] [INFO ] [REMOTE ] SPCE: Full fetch complete (53966 records). [2025-09-14T20:06:41.455000] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-14T20:06:41.852602] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-14T20:06:41.852814] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-14T20:06:41.854315] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-14T20:06:41.854389] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-14T20:06:41.856076] [DEBUG] [LOCAL ] SPCE: Trimmed 53966 records to 37283 (keeping 150 days of data) [2025-09-14T20:06:42.100764] [DEBUG] [LOCAL ] SPCE: Primary data saved (37283 records). [2025-09-14T20:06:42.101017] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-14T20:06:42.101160] [INFO ] [MAIN ] Update Progress: 1971/2370 symbols completed. SPCE took 28.9s. Estimated remaining: 42m 25s. Rate: 9.4 symbols/min [2025-09-14T20:06:42.160967] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-14T20:06:42.223459] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T20:06:42.294305] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:42.316839] [DEBUG] [LOCAL ] SPGI: Loaded 19879 existing records from primary storage. [2025-09-14T20:06:42.317067] [INFO ] [MAIN ] SPGI: Loaded 19879 existing records. [2025-09-14T20:06:42.501984] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:42.502349] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-14T20:06:42.502417] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-14T20:06:42.503025] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-14T20:06:42.503127] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-14T20:06:42.868278] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:42.958835] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-14T20:06:43.758891] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-14T20:06:43.915420] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T20:06:44.173818] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T20:06:44.558865] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-14T20:06:44.758995] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T20:06:44.762379] [INFO ] [REMOTE ] SPB: Full fetch complete (37004 records). [2025-09-14T20:06:44.762477] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-14T20:06:45.133228] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-14T20:06:45.133346] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-14T20:06:45.134276] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-14T20:06:45.134338] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-14T20:06:45.135272] [DEBUG] [LOCAL ] SPB: Trimmed 37004 records to 26486 (keeping 150 days of data) [2025-09-14T20:06:45.301989] [DEBUG] [LOCAL ] SPB: Primary data saved (26486 records). [2025-09-14T20:06:45.302179] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-14T20:06:45.302289] [INFO ] [MAIN ] Update Progress: 1972/2370 symbols completed. SPB took 34.1s. Estimated remaining: 42m 18s. Rate: 9.4 symbols/min [2025-09-14T20:06:45.365862] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-14T20:06:45.476780] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:45.486421] [DEBUG] [LOCAL ] SPH: Loaded 7487 existing records from primary storage. [2025-09-14T20:06:45.486601] [INFO ] [MAIN ] SPH: Loaded 7487 existing records. [2025-09-14T20:06:45.663255] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:45.663558] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-14T20:06:45.663622] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-14T20:06:45.663935] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-14T20:06:45.663995] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-14T20:06:46.030844] [INFO ] [REMOTE ] SPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:46.158849] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-14T20:06:46.444279] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T20:06:46.486048] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T20:06:46.911476] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T20:06:46.958847] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-14T20:06:47.758855] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-14T20:06:47.800292] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T20:06:47.801806] [INFO ] [REMOTE ] SPE: Full fetch complete (7029 records). [2025-09-14T20:06:47.801904] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-14T20:06:48.179927] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-14T20:06:48.180121] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-14T20:06:48.180443] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-14T20:06:48.180499] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-14T20:06:48.180971] [DEBUG] [LOCAL ] SPE: Trimmed 7029 records to 4408 (keeping 150 days of data) [2025-09-14T20:06:48.208628] [DEBUG] [LOCAL ] SPE: Primary data saved (4408 records). [2025-09-14T20:06:48.208764] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-14T20:06:48.208878] [INFO ] [MAIN ] Update Progress: 1973/2370 symbols completed. SPE took 23.2s. Estimated remaining: 42m 11s. Rate: 9.4 symbols/min [2025-09-14T20:06:48.378373] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:06:48.397484] [DEBUG] [LOCAL ] SPHR: Loaded 17190 existing records from primary storage. [2025-09-14T20:06:48.397690] [INFO ] [MAIN ] SPHR: Loaded 17190 existing records. [2025-09-14T20:06:48.562013] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-14T20:06:48.572316] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:06:48.573132] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-14T20:06:48.574132] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-14T20:06:48.574825] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-14T20:06:48.574905] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-14T20:06:48.954247] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:06:48.988199] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T20:06:49.358865] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-14T20:06:49.904220] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T20:06:50.158846] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-14T20:06:50.531937] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T20:06:50.781967] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T20:06:50.958862] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-14T20:06:51.758932] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-14T20:06:52.258405] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T20:06:52.558842] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-14T20:06:53.358895] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-14T20:06:53.440839] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T20:06:53.680026] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T20:06:54.158884] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-14T20:06:54.209326] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T20:06:54.958886] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-14T20:06:55.223413] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T20:06:55.758880] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-14T20:06:56.558828] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-14T20:06:56.791438] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T20:06:56.884435] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:06:57.361201] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-14T20:06:57.366842] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T20:06:58.158833] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-14T20:06:58.954343] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T20:06:58.963396] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-14T20:06:59.673332] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-14T20:06:59.758857] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-14T20:07:00.558837] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-14T20:07:00.618819] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T20:07:00.959825] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T20:07:01.358876] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-14T20:07:02.158882] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-14T20:07:02.827945] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:07:02.832701] [INFO ] [REMOTE ] SPGI: Full fetch complete (50163 records). [2025-09-14T20:07:02.832834] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-14T20:07:02.962489] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-14T20:07:03.261630] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-14T20:07:03.261953] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-14T20:07:03.263443] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-14T20:07:03.263677] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-14T20:07:03.300990] [DEBUG] [LOCAL ] SPGI: Trimmed 50163 records to 33520 (keeping 150 days of data) [2025-09-14T20:07:03.304278] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-14T20:07:03.458494] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-14T20:07:03.591480] [DEBUG] [LOCAL ] SPGI: Primary data saved (33520 records). [2025-09-14T20:07:03.591714] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-14T20:07:03.591829] [INFO ] [MAIN ] Update Progress: 1974/2370 symbols completed. SPGI took 21.5s. Estimated remaining: 42m 6s. Rate: 9.4 symbols/min [2025-09-14T20:07:03.763995] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-14T20:07:03.766923] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:03.786139] [DEBUG] [LOCAL ] SPIR: Loaded 15878 existing records from primary storage. [2025-09-14T20:07:03.786305] [INFO ] [MAIN ] SPIR: Loaded 15878 existing records. [2025-09-14T20:07:03.980902] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:03.993133] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-14T20:07:03.993823] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-14T20:07:03.994288] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T20:07:03.998604] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-14T20:07:03.999076] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-14T20:07:04.372423] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:04.443764] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:07:04.449685] [INFO ] [REMOTE ] SPG: Full fetch complete (54480 records). [2025-09-14T20:07:04.449805] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-14T20:07:04.564034] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-14T20:07:04.850873] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-14T20:07:04.851001] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-14T20:07:04.852289] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-14T20:07:04.852377] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-14T20:07:04.853892] [DEBUG] [LOCAL ] SPG: Trimmed 54480 records to 37747 (keeping 150 days of data) [2025-09-14T20:07:05.111347] [DEBUG] [LOCAL ] SPG: Primary data saved (37747 records). [2025-09-14T20:07:05.111551] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-14T20:07:05.111720] [INFO ] [MAIN ] Update Progress: 1975/2370 symbols completed. SPG took 31.4s. Estimated remaining: 41m 59s. Rate: 9.4 symbols/min [2025-09-14T20:07:05.281019] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:05.285232] [DEBUG] [LOCAL ] SPMC: Loaded 2309 existing records from primary storage. [2025-09-14T20:07:05.285336] [INFO ] [MAIN ] SPMC: Loaded 2309 existing records. [2025-09-14T20:07:05.364015] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-14T20:07:05.462989] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:05.463207] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-14T20:07:05.463266] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-14T20:07:05.463535] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-14T20:07:05.463592] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-14T20:07:05.824618] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:06.082347] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T20:07:06.087530] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:07:06.098327] [INFO ] [REMOTE ] SPH: Full fetch complete (20729 records). [2025-09-14T20:07:06.098455] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-14T20:07:06.163994] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-14T20:07:06.468024] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-14T20:07:06.468170] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-14T20:07:06.468837] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-14T20:07:06.469945] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-14T20:07:06.470588] [DEBUG] [LOCAL ] SPH: Trimmed 20729 records to 12937 (keeping 150 days of data) [2025-09-14T20:07:06.555695] [DEBUG] [LOCAL ] SPH: Primary data saved (12937 records). [2025-09-14T20:07:06.555878] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-14T20:07:06.555995] [INFO ] [MAIN ] Update Progress: 1976/2370 symbols completed. SPH took 21.3s. Estimated remaining: 41m 51s. Rate: 9.4 symbols/min [2025-09-14T20:07:06.726458] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:06.728903] [DEBUG] [LOCAL ] SPME: Loaded 650 existing records from primary storage. [2025-09-14T20:07:06.728992] [INFO ] [MAIN ] SPME: Loaded 650 existing records. [2025-09-14T20:07:06.910507] [WARN ] [MAIN ] SPME: Insufficient historical data. Have data from 2025-07-18, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:06.910811] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-14T20:07:06.910955] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-14T20:07:06.911198] [DEBUG] [LOCAL ] SPME: Deleted primary data file. [2025-09-14T20:07:06.911265] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-14T20:07:06.965401] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-14T20:07:07.267098] [INFO ] [REMOTE ] SPME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:07.758810] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-14T20:07:07.775631] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T20:07:07.799397] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T20:07:08.007004] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:07:08.007430] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-14T20:07:08.558849] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-14T20:07:09.358859] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-14T20:07:09.399630] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T20:07:09.644603] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:07:09.645014] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-14T20:07:10.158855] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-14T20:07:10.397617] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:07:10.398037] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-14T20:07:10.958889] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-14T20:07:11.758837] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-14T20:07:12.558812] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-14T20:07:12.645448] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T20:07:13.315748] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T20:07:13.358925] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-14T20:07:13.432836] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T20:07:13.651729] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:07:13.652260] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-14T20:07:14.158881] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-14T20:07:14.415396] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:07:14.415858] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-14T20:07:14.958845] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-14T20:07:15.758881] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-14T20:07:16.405505] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T20:07:16.410554] [INFO ] [REMOTE ] SPHR: Full fetch complete (43158 records). [2025-09-14T20:07:16.410711] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-14T20:07:16.559114] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-14T20:07:16.800360] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-14T20:07:16.800477] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-14T20:07:16.801563] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-14T20:07:16.801635] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-14T20:07:16.802684] [DEBUG] [LOCAL ] SPHR: Trimmed 43158 records to 29000 (keeping 150 days of data) [2025-09-14T20:07:16.990284] [DEBUG] [LOCAL ] SPHR: Primary data saved (29000 records). [2025-09-14T20:07:16.990485] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-14T20:07:16.990608] [INFO ] [MAIN ] Update Progress: 1977/2370 symbols completed. SPHR took 28.8s. Estimated remaining: 41m 46s. Rate: 9.4 symbols/min [2025-09-14T20:07:17.155480] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T20:07:17.178827] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:17.195260] [DEBUG] [LOCAL ] SPNT: Loaded 15599 existing records from primary storage. [2025-09-14T20:07:17.195436] [INFO ] [MAIN ] SPNT: Loaded 15599 existing records. [2025-09-14T20:07:17.366724] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-14T20:07:17.371213] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:17.372454] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-14T20:07:17.372518] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-14T20:07:17.372952] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-14T20:07:17.373018] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-14T20:07:17.734172] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:17.757115] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T20:07:17.927402] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T20:07:18.158852] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-14T20:07:18.958915] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-14T20:07:19.485629] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T20:07:19.583671] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T20:07:19.758839] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-14T20:07:20.180183] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T20:07:20.181032] [INFO ] [REMOTE ] SPME: Full fetch complete (620 records). [2025-09-14T20:07:20.181154] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-14T20:07:20.355255] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 40 unique days, need 150 days [2025-09-14T20:07:20.355451] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:07:20.355532] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:07:20.355621] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-14T20:07:20.355749] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-14T20:07:20.355833] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-14T20:07:20.355922] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-14T20:07:20.356049] [INFO ] [MAIN ] Update Progress: 1978/2370 symbols completed. SPME took 13.8s. Estimated remaining: 41m 39s. Rate: 9.4 symbols/min [2025-09-14T20:07:20.528566] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:20.551939] [DEBUG] [LOCAL ] SPOT: Loaded 22415 existing records from primary storage. [2025-09-14T20:07:20.552120] [INFO ] [MAIN ] SPOT: Loaded 22415 existing records. [2025-09-14T20:07:20.564065] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-14T20:07:20.734780] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:20.735112] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-14T20:07:20.735202] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-14T20:07:20.735840] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-14T20:07:20.735913] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-14T20:07:21.089051] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:21.358826] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-14T20:07:22.158864] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-14T20:07:22.313441] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T20:07:22.958906] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-14T20:07:23.349342] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T20:07:23.650844] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-14T20:07:23.758915] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-14T20:07:24.550714] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T20:07:24.562777] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-14T20:07:25.330984] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T20:07:25.358776] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-14T20:07:25.831629] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T20:07:26.069454] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T20:07:26.158869] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-14T20:07:26.958855] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-14T20:07:27.664002] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T20:07:27.758798] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-14T20:07:28.558896] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-14T20:07:29.205448] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T20:07:29.270799] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T20:07:29.275219] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T20:07:29.358850] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-14T20:07:30.158859] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-14T20:07:30.828488] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T20:07:30.958892] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-14T20:07:31.507805] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T20:07:31.509539] [INFO ] [REMOTE ] SPMC: Full fetch complete (6523 records). [2025-09-14T20:07:31.509732] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-14T20:07:31.759604] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-14T20:07:31.954905] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-14T20:07:31.955136] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-14T20:07:31.955435] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-14T20:07:31.955585] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-14T20:07:31.956427] [DEBUG] [LOCAL ] SPMC: Trimmed 6523 records to 3882 (keeping 150 days of data) [2025-09-14T20:07:32.011562] [DEBUG] [LOCAL ] SPMC: Primary data saved (3882 records). [2025-09-14T20:07:32.014084] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-14T20:07:32.013794] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T20:07:32.014381] [INFO ] [MAIN ] Update Progress: 1979/2370 symbols completed. SPMC took 26.9s. Estimated remaining: 41m 33s. Rate: 9.4 symbols/min [2025-09-14T20:07:32.214840] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:32.236683] [DEBUG] [LOCAL ] SPR: Loaded 17188 existing records from primary storage. [2025-09-14T20:07:32.236926] [INFO ] [MAIN ] SPR: Loaded 17188 existing records. [2025-09-14T20:07:32.424024] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:32.424384] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-14T20:07:32.424451] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-14T20:07:32.425036] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-14T20:07:32.425102] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-14T20:07:32.571288] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-14T20:07:32.783728] [INFO ] [REMOTE ] SPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:33.330042] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T20:07:33.358797] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-14T20:07:34.158838] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-14T20:07:34.908760] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T20:07:34.958776] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-14T20:07:35.186374] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-14T20:07:35.758933] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-14T20:07:35.860745] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T20:07:36.349046] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T20:07:36.558835] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-14T20:07:37.358885] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-14T20:07:38.032680] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T20:07:38.067796] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-14T20:07:38.158795] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-14T20:07:38.827895] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:07:38.831973] [INFO ] [REMOTE ] SPNT: Full fetch complete (37585 records). [2025-09-14T20:07:38.832108] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-14T20:07:38.974765] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-14T20:07:39.212672] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-14T20:07:39.212910] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-14T20:07:39.214040] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-14T20:07:39.214270] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-14T20:07:39.239010] [DEBUG] [LOCAL ] SPNT: Trimmed 37585 records to 25918 (keeping 150 days of data) [2025-09-14T20:07:39.240694] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T20:07:39.407207] [DEBUG] [LOCAL ] SPNT: Primary data saved (25918 records). [2025-09-14T20:07:39.407384] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-14T20:07:39.407491] [INFO ] [MAIN ] Update Progress: 1980/2370 symbols completed. SPNT took 22.4s. Estimated remaining: 41m 27s. Rate: 9.4 symbols/min [2025-09-14T20:07:39.577464] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:39.583984] [DEBUG] [LOCAL ] SPRU: Loaded 4859 existing records from primary storage. [2025-09-14T20:07:39.584104] [INFO ] [MAIN ] SPRU: Loaded 4859 existing records. [2025-09-14T20:07:39.758939] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:39.759067] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-14T20:07:39.760452] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-14T20:07:39.760527] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-14T20:07:39.760884] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-14T20:07:39.760961] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-14T20:07:40.108558] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:40.515901] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T20:07:40.520734] [INFO ] [REMOTE ] SPIR: Full fetch complete (41475 records). [2025-09-14T20:07:40.520917] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-14T20:07:40.564071] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-14T20:07:40.900383] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-14T20:07:40.900489] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-14T20:07:40.901325] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-14T20:07:40.901384] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-14T20:07:40.902399] [DEBUG] [LOCAL ] SPIR: Trimmed 41475 records to 28150 (keeping 150 days of data) [2025-09-14T20:07:41.074657] [DEBUG] [LOCAL ] SPIR: Primary data saved (28150 records). [2025-09-14T20:07:41.074852] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-14T20:07:41.074992] [INFO ] [MAIN ] Update Progress: 1981/2370 symbols completed. SPIR took 37.5s. Estimated remaining: 41m 20s. Rate: 9.4 symbols/min [2025-09-14T20:07:41.256219] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:41.268864] [DEBUG] [LOCAL ] SPXC: Loaded 11036 existing records from primary storage. [2025-09-14T20:07:41.269084] [INFO ] [MAIN ] SPXC: Loaded 11036 existing records. [2025-09-14T20:07:41.366370] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-14T20:07:41.445537] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:41.445785] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-14T20:07:41.445846] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-14T20:07:41.446202] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-14T20:07:41.446259] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-14T20:07:41.796556] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:42.122739] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-14T20:07:42.158815] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-14T20:07:42.308314] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T20:07:42.391447] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-14T20:07:42.871532] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T20:07:42.958880] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-14T20:07:43.758882] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-14T20:07:43.776134] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T20:07:44.558912] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-14T20:07:45.358850] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-14T20:07:46.105447] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-14T20:07:46.158835] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-14T20:07:46.221560] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:07:46.254482] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T20:07:46.958896] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-14T20:07:47.758829] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-14T20:07:47.982450] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-14T20:07:47.987953] [INFO ] [REMOTE ] SPOT: Full fetch complete (55737 records). [2025-09-14T20:07:47.988098] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-14T20:07:48.367906] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-14T20:07:48.368100] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-14T20:07:48.369234] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-14T20:07:48.369351] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-14T20:07:48.383622] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T20:07:48.383976] [DEBUG] [LOCAL ] SPOT: Trimmed 55737 records to 38128 (keeping 150 days of data) [2025-09-14T20:07:48.571973] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-14T20:07:48.641268] [DEBUG] [LOCAL ] SPOT: Primary data saved (38128 records). [2025-09-14T20:07:48.641432] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-14T20:07:48.641534] [INFO ] [MAIN ] Update Progress: 1982/2370 symbols completed. SPOT took 28.3s. Estimated remaining: 41m 14s. Rate: 9.4 symbols/min [2025-09-14T20:07:48.823766] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:48.830801] [DEBUG] [LOCAL ] SPXX: Loaded 3715 existing records from primary storage. [2025-09-14T20:07:48.830937] [INFO ] [MAIN ] SPXX: Loaded 3715 existing records. [2025-09-14T20:07:49.012778] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:49.013103] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-14T20:07:49.013172] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-14T20:07:49.013409] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-14T20:07:49.013473] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-14T20:07:49.368676] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-14T20:07:49.371829] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:49.396705] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T20:07:49.784314] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T20:07:50.006695] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T20:07:50.158812] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-14T20:07:50.958816] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-14T20:07:51.205086] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T20:07:51.758893] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-14T20:07:52.315777] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T20:07:52.558870] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-14T20:07:53.083780] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T20:07:53.358871] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-14T20:07:54.158910] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-14T20:07:54.268132] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T20:07:54.328455] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T20:07:54.958816] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-14T20:07:55.136582] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T20:07:55.758856] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-14T20:07:56.085803] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:07:56.558928] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-14T20:07:56.673976] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T20:07:57.358883] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-14T20:07:57.860665] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T20:07:57.864797] [INFO ] [REMOTE ] SPR: Full fetch complete (44870 records). [2025-09-14T20:07:57.864932] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-14T20:07:58.164216] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-14T20:07:58.266105] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-14T20:07:58.266241] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-14T20:07:58.267293] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-14T20:07:58.267440] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-14T20:07:58.276149] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T20:07:58.279381] [DEBUG] [LOCAL ] SPR: Trimmed 44870 records to 30220 (keeping 150 days of data) [2025-09-14T20:07:58.483123] [DEBUG] [LOCAL ] SPR: Primary data saved (30220 records). [2025-09-14T20:07:58.483315] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-14T20:07:58.483829] [INFO ] [MAIN ] Update Progress: 1983/2370 symbols completed. SPR took 26.5s. Estimated remaining: 41m 8s. Rate: 9.4 symbols/min [2025-09-14T20:07:58.657579] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:07:58.683939] [DEBUG] [LOCAL ] SQM: Loaded 22327 existing records from primary storage. [2025-09-14T20:07:58.684159] [INFO ] [MAIN ] SQM: Loaded 22327 existing records. [2025-09-14T20:07:58.871840] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:07:58.872173] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-14T20:07:58.872240] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-14T20:07:58.872917] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-14T20:07:58.872986] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-14T20:07:58.964044] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-14T20:07:59.245477] [INFO ] [REMOTE ] SQM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:07:59.334441] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T20:07:59.597025] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T20:07:59.758875] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-14T20:08:00.558886] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-14T20:08:01.358847] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-14T20:08:02.031086] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-14T20:08:02.158940] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-14T20:08:02.958950] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-14T20:08:03.066466] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-14T20:08:03.068040] [INFO ] [REMOTE ] SPRU: Full fetch complete (8499 records). [2025-09-14T20:08:03.068125] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-14T20:08:03.423194] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-14T20:08:03.423445] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-14T20:08:03.423778] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-14T20:08:03.423905] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-14T20:08:03.424660] [DEBUG] [LOCAL ] SPRU: Trimmed 8499 records to 6819 (keeping 150 days of data) [2025-09-14T20:08:03.468344] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T20:08:03.485429] [DEBUG] [LOCAL ] SPRU: Primary data saved (6819 records). [2025-09-14T20:08:03.485585] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-14T20:08:03.485788] [INFO ] [MAIN ] Update Progress: 1984/2370 symbols completed. SPRU took 24.1s. Estimated remaining: 41m 1s. Rate: 9.4 symbols/min [2025-09-14T20:08:03.656945] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:03.679793] [DEBUG] [LOCAL ] SQNS: Loaded 20109 existing records from primary storage. [2025-09-14T20:08:03.680002] [INFO ] [MAIN ] SQNS: Loaded 20109 existing records. [2025-09-14T20:08:03.771200] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-14T20:08:03.863886] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:03.864156] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-14T20:08:03.864220] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-14T20:08:03.864747] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-14T20:08:03.864824] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-14T20:08:04.226468] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:04.256531] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T20:08:04.341598] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T20:08:04.558859] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-14T20:08:05.358901] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-14T20:08:05.411790] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T20:08:06.158894] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-14T20:08:06.366083] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T20:08:06.419878] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T20:08:06.443985] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T20:08:06.446699] [INFO ] [REMOTE ] SPXC: Full fetch complete (25782 records). [2025-09-14T20:08:06.446796] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-14T20:08:06.818881] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-14T20:08:06.819010] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-14T20:08:06.820543] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-14T20:08:06.820613] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-14T20:08:06.822297] [DEBUG] [LOCAL ] SPXC: Trimmed 25782 records to 17225 (keeping 150 days of data) [2025-09-14T20:08:06.937677] [DEBUG] [LOCAL ] SPXC: Primary data saved (17225 records). [2025-09-14T20:08:06.937883] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-14T20:08:06.938030] [INFO ] [MAIN ] Update Progress: 1985/2370 symbols completed. SPXC took 25.9s. Estimated remaining: 40m 55s. Rate: 9.4 symbols/min [2025-09-14T20:08:06.963960] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-14T20:08:07.119748] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:07.136967] [DEBUG] [LOCAL ] SR: Loaded 14933 existing records from primary storage. [2025-09-14T20:08:07.137138] [INFO ] [MAIN ] SR: Loaded 14933 existing records. [2025-09-14T20:08:07.312146] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:07.312414] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-14T20:08:07.312476] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-14T20:08:07.312894] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-14T20:08:07.312954] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-14T20:08:07.662131] [INFO ] [REMOTE ] SR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:07.758834] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-14T20:08:07.761360] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T20:08:08.558828] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-14T20:08:08.995136] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T20:08:09.358832] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-14T20:08:09.381276] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T20:08:10.158911] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-14T20:08:10.958865] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-14T20:08:11.044232] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T20:08:11.143677] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T20:08:11.597371] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T20:08:11.758878] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-14T20:08:12.558853] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-14T20:08:12.864711] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T20:08:13.358847] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-14T20:08:14.019934] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T20:08:14.158795] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-14T20:08:14.958859] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-14T20:08:15.663545] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T20:08:15.712851] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T20:08:15.758786] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-14T20:08:16.209921] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T20:08:16.558827] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-14T20:08:17.317234] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T20:08:17.358783] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-14T20:08:17.792804] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-14T20:08:17.842323] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T20:08:17.843994] [INFO ] [REMOTE ] SPXX: Full fetch complete (9809 records). [2025-09-14T20:08:17.844084] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-14T20:08:18.164015] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-14T20:08:18.234356] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-14T20:08:18.234469] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-14T20:08:18.234774] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-14T20:08:18.235209] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-14T20:08:18.235784] [DEBUG] [LOCAL ] SPXX: Trimmed 9809 records to 6007 (keeping 150 days of data) [2025-09-14T20:08:18.274367] [DEBUG] [LOCAL ] SPXX: Primary data saved (6007 records). [2025-09-14T20:08:18.274503] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-14T20:08:18.274612] [INFO ] [MAIN ] Update Progress: 1986/2370 symbols completed. SPXX took 29.6s. Estimated remaining: 40m 49s. Rate: 9.4 symbols/min [2025-09-14T20:08:18.458882] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:18.487453] [DEBUG] [LOCAL ] SRE: Loaded 23872 existing records from primary storage. [2025-09-14T20:08:18.487669] [INFO ] [MAIN ] SRE: Loaded 23872 existing records. [2025-09-14T20:08:18.667274] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:18.667588] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-14T20:08:18.667682] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-14T20:08:18.668263] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-14T20:08:18.668323] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-14T20:08:18.964052] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-14T20:08:19.066880] [INFO ] [REMOTE ] SRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:19.758842] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-14T20:08:20.039108] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T20:08:20.558862] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-14T20:08:20.821098] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-14T20:08:20.825973] [INFO ] [REMOTE ] SQNS: Full fetch complete (25702 records). [2025-09-14T20:08:20.826108] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-14T20:08:21.200691] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-14T20:08:21.200972] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-14T20:08:21.201765] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-14T20:08:21.201864] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-14T20:08:21.221254] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T20:08:21.221592] [DEBUG] [LOCAL ] SQNS: Trimmed 25702 records to 22731 (keeping 150 days of data) [2025-09-14T20:08:21.359231] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-14T20:08:21.389115] [DEBUG] [LOCAL ] SQNS: Primary data saved (22731 records). [2025-09-14T20:08:21.389278] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-14T20:08:21.389385] [INFO ] [MAIN ] Update Progress: 1987/2370 symbols completed. SQNS took 17.9s. Estimated remaining: 40m 42s. Rate: 9.4 symbols/min [2025-09-14T20:08:21.563955] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:21.570232] [DEBUG] [LOCAL ] SREA: Loaded 4054 existing records from primary storage. [2025-09-14T20:08:21.570373] [INFO ] [MAIN ] SREA: Loaded 4054 existing records. [2025-09-14T20:08:21.745760] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:21.746005] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-14T20:08:21.746065] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-14T20:08:21.746320] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-14T20:08:21.746377] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-14T20:08:22.095819] [INFO ] [REMOTE ] SREA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:22.158776] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-14T20:08:22.474811] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T20:08:22.558475] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T20:08:22.681313] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-14T20:08:22.958838] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-14T20:08:23.758837] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-14T20:08:24.326700] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-14T20:08:24.332681] [INFO ] [REMOTE ] SQM: Full fetch complete (52492 records). [2025-09-14T20:08:24.332860] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-14T20:08:24.568903] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-14T20:08:24.740692] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-14T20:08:24.740804] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-14T20:08:24.741910] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-14T20:08:24.741976] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-14T20:08:24.743308] [DEBUG] [LOCAL ] SQM: Trimmed 52492 records to 36523 (keeping 150 days of data) [2025-09-14T20:08:24.973865] [DEBUG] [LOCAL ] SQM: Primary data saved (36523 records). [2025-09-14T20:08:24.974240] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-14T20:08:24.974372] [INFO ] [MAIN ] Update Progress: 1988/2370 symbols completed. SQM took 26.5s. Estimated remaining: 40m 35s. Rate: 9.4 symbols/min [2025-09-14T20:08:25.144287] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:25.165723] [DEBUG] [LOCAL ] SRFM: Loaded 22447 existing records from primary storage. [2025-09-14T20:08:25.165899] [INFO ] [MAIN ] SRFM: Loaded 22447 existing records. [2025-09-14T20:08:25.345019] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:25.345269] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-14T20:08:25.345332] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-14T20:08:25.345974] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-14T20:08:25.346050] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-14T20:08:25.377558] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-14T20:08:25.665886] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T20:08:25.727409] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:25.762694] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T20:08:26.158846] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-14T20:08:26.547226] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T20:08:26.958882] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-14T20:08:27.756785] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T20:08:27.767828] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-14T20:08:28.521864] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T20:08:28.558786] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-14T20:08:28.847188] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T20:08:29.179912] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T20:08:29.183351] [INFO ] [REMOTE ] SR: Full fetch complete (35213 records). [2025-09-14T20:08:29.183462] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-14T20:08:29.361601] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-14T20:08:29.561456] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-14T20:08:29.561557] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-14T20:08:29.562345] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-14T20:08:29.562400] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-14T20:08:29.563417] [DEBUG] [LOCAL ] SR: Trimmed 35213 records to 24495 (keeping 150 days of data) [2025-09-14T20:08:29.720224] [DEBUG] [LOCAL ] SR: Primary data saved (24495 records). [2025-09-14T20:08:29.720394] [INFO ] [MAIN ] SR: Full history saved. [2025-09-14T20:08:29.720494] [INFO ] [MAIN ] Update Progress: 1989/2370 symbols completed. SR took 22.8s. Estimated remaining: 40m 29s. Rate: 9.4 symbols/min [2025-09-14T20:08:29.891074] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:29.899224] [DEBUG] [LOCAL ] SRG: Loaded 6412 existing records from primary storage. [2025-09-14T20:08:29.899370] [INFO ] [MAIN ] SRG: Loaded 6412 existing records. [2025-09-14T20:08:30.079162] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:30.079406] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-14T20:08:30.079486] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-14T20:08:30.079782] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-14T20:08:30.079842] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-14T20:08:30.164005] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-14T20:08:30.456360] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T20:08:30.476363] [INFO ] [REMOTE ] SRG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:30.958876] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-14T20:08:31.470800] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T20:08:31.758844] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-14T20:08:32.048469] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T20:08:32.558829] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-14T20:08:32.721593] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T20:08:33.358864] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-14T20:08:33.481805] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T20:08:34.158873] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-14T20:08:34.315196] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T20:08:34.927690] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T20:08:34.958778] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-14T20:08:35.758830] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-14T20:08:35.779496] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T20:08:36.558914] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-14T20:08:36.905318] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T20:08:37.358875] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-14T20:08:38.147486] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T20:08:38.158869] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-14T20:08:38.646495] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T20:08:38.873942] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-14T20:08:38.958789] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-14T20:08:39.758868] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-14T20:08:39.813370] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T20:08:40.558841] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-14T20:08:41.358855] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-14T20:08:41.370989] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T20:08:41.906230] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-14T20:08:42.143275] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T20:08:42.158775] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-14T20:08:42.669422] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T20:08:42.670940] [INFO ] [REMOTE ] SREA: Full fetch complete (11452 records). [2025-09-14T20:08:42.671049] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-14T20:08:42.961598] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-14T20:08:43.049700] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-14T20:08:43.049848] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-14T20:08:43.050273] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-14T20:08:43.050339] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-14T20:08:43.051025] [DEBUG] [LOCAL ] SREA: Trimmed 11452 records to 7599 (keeping 150 days of data) [2025-09-14T20:08:43.100170] [DEBUG] [LOCAL ] SREA: Primary data saved (7599 records). [2025-09-14T20:08:43.100402] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-14T20:08:43.100534] [INFO ] [MAIN ] Update Progress: 1990/2370 symbols completed. SREA took 21.7s. Estimated remaining: 40m 23s. Rate: 9.4 symbols/min [2025-09-14T20:08:43.302104] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:43.316123] [DEBUG] [LOCAL ] SRI: Loaded 12494 existing records from primary storage. [2025-09-14T20:08:43.316345] [INFO ] [MAIN ] SRI: Loaded 12494 existing records. [2025-09-14T20:08:43.505945] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:43.506306] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-14T20:08:43.506374] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-14T20:08:43.506889] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-14T20:08:43.506964] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-14T20:08:43.764909] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-14T20:08:43.905557] [INFO ] [REMOTE ] SRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:44.558906] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-14T20:08:44.856166] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T20:08:45.358890] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-14T20:08:45.575968] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T20:08:45.629345] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T20:08:46.158855] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-14T20:08:46.951975] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T20:08:46.962559] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-14T20:08:47.758947] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-14T20:08:47.778126] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T20:08:47.783196] [INFO ] [REMOTE ] SRFM: Full fetch complete (36585 records). [2025-09-14T20:08:47.783358] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-14T20:08:47.955898] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-14T20:08:48.196795] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-14T20:08:48.196932] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-14T20:08:48.197985] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-14T20:08:48.198054] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-14T20:08:48.199223] [DEBUG] [LOCAL ] SRFM: Trimmed 36585 records to 28759 (keeping 150 days of data) [2025-09-14T20:08:48.385899] [DEBUG] [LOCAL ] SRFM: Primary data saved (28759 records). [2025-09-14T20:08:48.386138] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-14T20:08:48.386266] [INFO ] [MAIN ] Update Progress: 1991/2370 symbols completed. SRFM took 23.4s. Estimated remaining: 40m 17s. Rate: 9.4 symbols/min [2025-09-14T20:08:48.563778] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-14T20:08:48.584962] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:48.589489] [DEBUG] [LOCAL ] SRL: Loaded 341 existing records from primary storage. [2025-09-14T20:08:48.589889] [INFO ] [MAIN ] SRL: Loaded 341 existing records. [2025-09-14T20:08:48.784349] [WARN ] [MAIN ] SRL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:48.784874] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-14T20:08:48.784947] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-14T20:08:48.785311] [DEBUG] [LOCAL ] SRL: Deleted primary data file. [2025-09-14T20:08:48.785378] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-14T20:08:49.154930] [INFO ] [REMOTE ] SRL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:49.358844] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-14T20:08:49.678274] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T20:08:49.704307] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T20:08:50.158893] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-14T20:08:50.587591] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T20:08:50.958854] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-14T20:08:51.758873] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-14T20:08:51.903741] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T20:08:51.939502] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T20:08:52.341297] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T20:08:52.343618] [INFO ] [REMOTE ] SRG: Full fetch complete (17617 records). [2025-09-14T20:08:52.343730] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-14T20:08:52.564053] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-14T20:08:52.720188] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-14T20:08:52.720301] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-14T20:08:52.720764] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-14T20:08:52.720821] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-14T20:08:52.721408] [DEBUG] [LOCAL ] SRG: Trimmed 17617 records to 11020 (keeping 150 days of data) [2025-09-14T20:08:52.785946] [DEBUG] [LOCAL ] SRG: Primary data saved (11020 records). [2025-09-14T20:08:52.786148] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-14T20:08:52.786280] [INFO ] [MAIN ] Update Progress: 1992/2370 symbols completed. SRG took 23.1s. Estimated remaining: 40m 10s. Rate: 9.4 symbols/min [2025-09-14T20:08:52.954920] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:52.959615] [DEBUG] [LOCAL ] SRV: Loaded 3159 existing records from primary storage. [2025-09-14T20:08:52.959744] [INFO ] [MAIN ] SRV: Loaded 3159 existing records. [2025-09-14T20:08:53.107699] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T20:08:53.142955] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:53.143240] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-14T20:08:53.143300] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-14T20:08:53.143566] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-14T20:08:53.143625] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-14T20:08:53.364192] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-14T20:08:53.507611] [INFO ] [REMOTE ] SRV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:54.158883] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-14T20:08:54.406564] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T20:08:54.893142] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T20:08:54.958857] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-14T20:08:55.758855] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-14T20:08:55.788241] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T20:08:56.323025] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T20:08:56.328574] [INFO ] [REMOTE ] SRE: Full fetch complete (58083 records). [2025-09-14T20:08:56.328726] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-14T20:08:56.564054] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-14T20:08:56.714451] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-14T20:08:56.714552] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-14T20:08:56.715665] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-14T20:08:56.715723] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-14T20:08:56.716872] [DEBUG] [LOCAL ] SRE: Trimmed 58083 records to 40187 (keeping 150 days of data) [2025-09-14T20:08:56.981483] [DEBUG] [LOCAL ] SRE: Primary data saved (40187 records). [2025-09-14T20:08:56.982010] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-14T20:08:56.982226] [INFO ] [MAIN ] Update Progress: 1993/2370 symbols completed. SRE took 38.7s. Estimated remaining: 40m 3s. Rate: 9.4 symbols/min [2025-09-14T20:08:57.156046] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:08:57.176297] [DEBUG] [LOCAL ] SSB: Loaded 19443 existing records from primary storage. [2025-09-14T20:08:57.176459] [INFO ] [MAIN ] SSB: Loaded 19443 existing records. [2025-09-14T20:08:57.356730] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:08:57.357017] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-14T20:08:57.357081] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-14T20:08:57.357767] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-14T20:08:57.357832] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-14T20:08:57.369058] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-14T20:08:57.539495] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T20:08:57.749391] [INFO ] [REMOTE ] SSB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:08:57.862064] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T20:08:58.158879] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-14T20:08:58.904355] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T20:08:58.958868] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-14T20:08:59.758875] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-14T20:08:59.929418] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T20:09:00.558886] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-14T20:09:01.253994] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T20:09:01.358870] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-14T20:09:02.108844] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T20:09:02.158849] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-14T20:09:02.958856] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-14T20:09:03.758916] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-14T20:09:05.011475] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T20:09:05.012710] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-14T20:09:05.247136] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-14T20:09:05.358858] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-14T20:09:05.416966] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T20:09:05.446459] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (4.09 seconds). [2025-09-14T20:09:05.638864] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (3.48 seconds). [2025-09-14T20:09:06.150480] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T20:09:06.158762] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-14T20:09:06.819219] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T20:09:06.958833] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-14T20:09:07.537960] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T20:09:07.539430] [INFO ] [REMOTE ] SRV: Full fetch complete (8445 records). [2025-09-14T20:09:07.539546] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-14T20:09:07.763911] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-14T20:09:07.919308] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-14T20:09:07.919591] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-14T20:09:07.919872] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-14T20:09:07.919928] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-14T20:09:07.920444] [DEBUG] [LOCAL ] SRV: Trimmed 8445 records to 5408 (keeping 150 days of data) [2025-09-14T20:09:07.953910] [DEBUG] [LOCAL ] SRV: Primary data saved (5408 records). [2025-09-14T20:09:07.954004] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-14T20:09:07.954129] [INFO ] [MAIN ] Update Progress: 1994/2370 symbols completed. SRV took 15.2s. Estimated remaining: 39m 58s. Rate: 9.4 symbols/min [2025-09-14T20:09:08.122857] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:08.135331] [DEBUG] [LOCAL ] SSD: Loaded 10298 existing records from primary storage. [2025-09-14T20:09:08.135478] [INFO ] [MAIN ] SSD: Loaded 10298 existing records. [2025-09-14T20:09:08.313841] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:08.314207] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-14T20:09:08.314271] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-14T20:09:08.314968] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-14T20:09:08.315036] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-14T20:09:08.568595] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-14T20:09:08.724969] [INFO ] [REMOTE ] SSD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:09.073077] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T20:09:09.358844] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-14T20:09:10.163973] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-14T20:09:10.183344] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T20:09:10.365677] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T20:09:10.368208] [INFO ] [REMOTE ] SRI: Full fetch complete (31060 records). [2025-09-14T20:09:10.368301] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-14T20:09:10.592639] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T20:09:10.750825] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-14T20:09:10.750941] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-14T20:09:10.751636] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-14T20:09:10.751709] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-14T20:09:10.752469] [DEBUG] [LOCAL ] SRI: Trimmed 31060 records to 20709 (keeping 150 days of data) [2025-09-14T20:09:10.868858] [DEBUG] [LOCAL ] SRI: Primary data saved (20709 records). [2025-09-14T20:09:10.869019] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-14T20:09:10.869115] [INFO ] [MAIN ] Update Progress: 1995/2370 symbols completed. SRI took 27.8s. Estimated remaining: 39m 51s. Rate: 9.4 symbols/min [2025-09-14T20:09:10.967159] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-14T20:09:11.044842] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:11.063770] [DEBUG] [LOCAL ] SSL: Loaded 18846 existing records from primary storage. [2025-09-14T20:09:11.063950] [INFO ] [MAIN ] SSL: Loaded 18846 existing records. [2025-09-14T20:09:11.240229] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:11.240514] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-14T20:09:11.240578] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-14T20:09:11.241052] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-14T20:09:11.241127] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-14T20:09:11.596490] [INFO ] [REMOTE ] SSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:11.758856] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-14T20:09:12.558850] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-14T20:09:12.691063] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T20:09:13.324278] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T20:09:13.325267] [INFO ] [REMOTE ] SRL: Full fetch complete (1110 records). [2025-09-14T20:09:13.325361] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-14T20:09:13.364157] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-14T20:09:13.529859] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T20:09:13.530205] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:09:13.530276] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:09:13.550442] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-14T20:09:13.551116] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-14T20:09:13.551913] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T20:09:13.552017] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-14T20:09:13.559879] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-14T20:09:13.560011] [INFO ] [MAIN ] Update Progress: 1996/2370 symbols completed. SRL took 25.2s. Estimated remaining: 39m 44s. Rate: 9.4 symbols/min [2025-09-14T20:09:13.730081] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:13.737663] [DEBUG] [LOCAL ] SST: Loaded 6018 existing records from primary storage. [2025-09-14T20:09:13.737804] [INFO ] [MAIN ] SST: Loaded 6018 existing records. [2025-09-14T20:09:13.914392] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:13.914683] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-14T20:09:13.914744] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-14T20:09:13.915022] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-14T20:09:13.915081] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-14T20:09:14.167306] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-14T20:09:14.276421] [INFO ] [REMOTE ] SST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:14.606567] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T20:09:14.958847] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-14T20:09:15.758851] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-14T20:09:15.880488] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T20:09:16.558887] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-14T20:09:17.231800] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-14T20:09:17.358838] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-14T20:09:17.569905] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T20:09:18.158794] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-14T20:09:18.267011] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T20:09:18.783627] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T20:09:18.958827] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-14T20:09:19.051833] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:09:19.758863] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-14T20:09:20.242811] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T20:09:20.558899] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-14T20:09:21.063146] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T20:09:21.358855] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-14T20:09:22.158829] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-14T20:09:22.211936] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T20:09:22.237535] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T20:09:22.958879] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-14T20:09:23.758866] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-14T20:09:23.915324] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T20:09:23.932609] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T20:09:24.558833] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-14T20:09:25.277409] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T20:09:25.358922] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-14T20:09:26.158840] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-14T20:09:26.257563] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T20:09:26.966883] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-14T20:09:26.971711] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T20:09:27.312223] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T20:09:27.735909] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T20:09:27.740829] [INFO ] [REMOTE ] SSB: Full fetch complete (46058 records). [2025-09-14T20:09:27.741035] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-14T20:09:27.763959] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-14T20:09:28.129783] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-14T20:09:28.129979] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-14T20:09:28.131250] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-14T20:09:28.131324] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-14T20:09:28.132532] [DEBUG] [LOCAL ] SSB: Trimmed 46058 records to 32376 (keeping 150 days of data) [2025-09-14T20:09:28.356036] [DEBUG] [LOCAL ] SSB: Primary data saved (32376 records). [2025-09-14T20:09:28.356221] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-14T20:09:28.356333] [INFO ] [MAIN ] Update Progress: 1997/2370 symbols completed. SSB took 31.4s. Estimated remaining: 39m 39s. Rate: 9.4 symbols/min [2025-09-14T20:09:28.558889] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-14T20:09:29.358975] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-14T20:09:29.493446] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T20:09:29.641030] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T20:09:29.946455] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T20:09:30.158881] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-14T20:09:30.958868] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-14T20:09:31.728771] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T20:09:31.733392] [INFO ] [REMOTE ] SSL: Full fetch complete (44489 records). [2025-09-14T20:09:31.733535] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-14T20:09:31.768123] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-14T20:09:31.919306] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T20:09:32.165734] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-14T20:09:32.165901] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-14T20:09:32.167456] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-14T20:09:32.167577] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-14T20:09:32.169189] [DEBUG] [LOCAL ] SSL: Trimmed 44489 records to 30733 (keeping 150 days of data) [2025-09-14T20:09:32.361233] [DEBUG] [LOCAL ] SSL: Primary data saved (30733 records). [2025-09-14T20:09:32.361493] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-14T20:09:32.361623] [INFO ] [MAIN ] Update Progress: 1998/2370 symbols completed. SSL took 21.5s. Estimated remaining: 39m 32s. Rate: 9.4 symbols/min [2025-09-14T20:09:32.558852] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-14T20:09:32.987465] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T20:09:33.313941] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T20:09:33.315398] [INFO ] [REMOTE ] SST: Full fetch complete (13759 records). [2025-09-14T20:09:33.315490] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-14T20:09:33.384256] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-14T20:09:33.687886] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-14T20:09:33.688041] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-14T20:09:33.688380] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-14T20:09:33.688432] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-14T20:09:33.688978] [DEBUG] [LOCAL ] SST: Trimmed 13759 records to 9946 (keeping 150 days of data) [2025-09-14T20:09:33.749682] [DEBUG] [LOCAL ] SST: Primary data saved (9946 records). [2025-09-14T20:09:33.749866] [INFO ] [MAIN ] SST: Full history saved. [2025-09-14T20:09:33.749984] [INFO ] [MAIN ] Update Progress: 1999/2370 symbols completed. SST took 20.2s. Estimated remaining: 39m 25s. Rate: 9.4 symbols/min [2025-09-14T20:09:34.434293] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T20:09:34.439961] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-14T20:09:35.710221] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T20:09:35.716144] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-14T20:09:36.002499] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T20:09:36.005337] [INFO ] [REMOTE ] SSD: Full fetch complete (24476 records). [2025-09-14T20:09:36.005462] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-14T20:09:36.379263] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-14T20:09:36.379376] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-14T20:09:36.379971] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-14T20:09:36.380030] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-14T20:09:36.380959] [DEBUG] [LOCAL ] SSD: Trimmed 24476 records to 16821 (keeping 150 days of data) [2025-09-14T20:09:36.496045] [DEBUG] [LOCAL ] SSD: Primary data saved (16821 records). [2025-09-14T20:09:36.496236] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-14T20:09:36.496359] [INFO ] [MAIN ] Update Progress: 2000/2370 symbols completed. SSD took 28.5s. Estimated remaining: 39m 18s. Rate: 9.4 symbols/min [2025-09-14T20:09:37.111924] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:37.149622] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:37.195993] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:37.194630] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:37.210684] [DEBUG] [LOCAL ] STC: Loaded 8269 existing records from primary storage. [2025-09-14T20:09:37.211002] [INFO ] [MAIN ] STC: Loaded 8269 existing records. [2025-09-14T20:09:37.249606] [DEBUG] [LOCAL ] SSTK: Loaded 10677 existing records from primary storage. [2025-09-14T20:09:37.297576] [INFO ] [MAIN ] SSTK: Loaded 10677 existing records. [2025-09-14T20:09:37.483039] [DEBUG] [LOCAL ] ST: Loaded 22202 existing records from primary storage. [2025-09-14T20:09:37.531894] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:37.525917] [INFO ] [MAIN ] ST: Loaded 22202 existing records. [2025-09-14T20:09:37.532758] [DEBUG] [LOCAL ] STAG: Loaded 21961 existing records from primary storage. [2025-09-14T20:09:37.554383] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-14T20:09:37.574754] [INFO ] [MAIN ] STAG: Loaded 21961 existing records. [2025-09-14T20:09:37.615447] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-14T20:09:37.728946] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-14T20:09:37.713702] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:37.774443] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-14T20:09:37.759474] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-14T20:09:37.845605] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-14T20:09:37.940087] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:37.960231] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-14T20:09:38.045598] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-14T20:09:38.015070] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-14T20:09:38.107354] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:38.107059] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-14T20:09:38.210991] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-14T20:09:38.256385] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-14T20:09:38.221286] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-14T20:09:38.298687] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-14T20:09:38.298585] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-14T20:09:38.317389] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-14T20:09:38.948732] [INFO ] [REMOTE ] STC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:38.983541] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-14T20:09:39.254215] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:39.319520] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-14T20:09:39.420433] [INFO ] [REMOTE ] STAG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:39.461835] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-14T20:09:39.501106] [INFO ] [REMOTE ] ST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:39.501481] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-14T20:09:40.280455] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T20:09:40.284521] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-14T20:09:40.897069] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T20:09:40.903662] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-14T20:09:40.987307] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T20:09:40.997267] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-14T20:09:41.041407] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T20:09:41.064867] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T20:09:41.358838] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-14T20:09:42.158848] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-14T20:09:42.308298] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T20:09:42.412568] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T20:09:42.950891] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T20:09:42.961101] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-14T20:09:43.237444] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T20:09:43.758829] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-14T20:09:44.270935] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T20:09:44.558811] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-14T20:09:44.717221] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T20:09:45.358835] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-14T20:09:45.840592] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T20:09:46.158824] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-14T20:09:46.430768] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T20:09:46.958894] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-14T20:09:47.133762] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T20:09:47.758877] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-14T20:09:48.485342] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T20:09:48.558831] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-14T20:09:48.908222] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T20:09:49.358949] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-14T20:09:50.158830] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-14T20:09:50.271434] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T20:09:50.309494] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T20:09:50.958863] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-14T20:09:51.307549] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T20:09:51.758842] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-14T20:09:52.237532] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T20:09:52.558889] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-14T20:09:53.358794] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-14T20:09:53.390324] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T20:09:53.410717] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T20:09:53.934573] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T20:09:53.937454] [INFO ] [REMOTE ] SSTK: Full fetch complete (30328 records). [2025-09-14T20:09:53.937573] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-14T20:09:54.164077] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-14T20:09:54.336779] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-14T20:09:54.336932] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-14T20:09:54.337893] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-14T20:09:54.337994] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-14T20:09:54.339123] [DEBUG] [LOCAL ] SSTK: Trimmed 30328 records to 18357 (keeping 150 days of data) [2025-09-14T20:09:54.470545] [DEBUG] [LOCAL ] SSTK: Primary data saved (18357 records). [2025-09-14T20:09:54.470777] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-14T20:09:54.470899] [INFO ] [MAIN ] Update Progress: 2001/2370 symbols completed. SSTK took 18.0s. Estimated remaining: 39m 14s. Rate: 9.4 symbols/min [2025-09-14T20:09:54.644809] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:54.661296] [DEBUG] [LOCAL ] STE: Loaded 15425 existing records from primary storage. [2025-09-14T20:09:54.661464] [INFO ] [MAIN ] STE: Loaded 15425 existing records. [2025-09-14T20:09:54.841123] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:54.841465] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-14T20:09:54.841527] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-14T20:09:54.841960] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-14T20:09:54.842027] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-14T20:09:54.963960] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-14T20:09:55.208877] [INFO ] [REMOTE ] STE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:55.542816] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T20:09:55.545106] [INFO ] [REMOTE ] STC: Full fetch complete (19465 records). [2025-09-14T20:09:55.545196] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-14T20:09:55.765598] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-14T20:09:56.007683] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-14T20:09:56.007892] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-14T20:09:56.008629] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-14T20:09:56.008777] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-14T20:09:56.010071] [DEBUG] [LOCAL ] STC: Trimmed 19465 records to 13380 (keeping 150 days of data) [2025-09-14T20:09:56.107878] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T20:09:56.144926] [DEBUG] [LOCAL ] STC: Primary data saved (13380 records). [2025-09-14T20:09:56.145202] [INFO ] [MAIN ] STC: Full history saved. [2025-09-14T20:09:56.145339] [INFO ] [MAIN ] Update Progress: 2002/2370 symbols completed. STC took 19.6s. Estimated remaining: 39m 6s. Rate: 9.4 symbols/min [2025-09-14T20:09:56.320240] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:09:56.333468] [DEBUG] [LOCAL ] STEL: Loaded 10380 existing records from primary storage. [2025-09-14T20:09:56.333712] [INFO ] [MAIN ] STEL: Loaded 10380 existing records. [2025-09-14T20:09:56.526785] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:09:56.527128] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-14T20:09:56.527205] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-14T20:09:56.527855] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-14T20:09:56.528166] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-14T20:09:56.563982] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-14T20:09:56.911955] [INFO ] [REMOTE ] STEL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:09:57.169169] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T20:09:57.358897] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-14T20:09:58.158946] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-14T20:09:58.292158] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T20:09:58.680491] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T20:09:58.958921] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-14T20:09:59.218391] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T20:09:59.611317] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T20:09:59.617488] [INFO ] [REMOTE ] ST: Full fetch complete (54385 records). [2025-09-14T20:09:59.617719] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-14T20:09:59.764544] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-14T20:10:00.015352] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-14T20:10:00.015494] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-14T20:10:00.016996] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-14T20:10:00.017101] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-14T20:10:00.019844] [DEBUG] [LOCAL ] ST: Trimmed 54385 records to 37314 (keeping 150 days of data) [2025-09-14T20:10:00.267522] [DEBUG] [LOCAL ] ST: Primary data saved (37314 records). [2025-09-14T20:10:00.267704] [INFO ] [MAIN ] ST: Full history saved. [2025-09-14T20:10:00.267849] [INFO ] [MAIN ] Update Progress: 2003/2370 symbols completed. ST took 23.8s. Estimated remaining: 38m 60s. Rate: 9.4 symbols/min [2025-09-14T20:10:00.436345] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:00.451753] [DEBUG] [LOCAL ] STEM: Loaded 14664 existing records from primary storage. [2025-09-14T20:10:00.451911] [INFO ] [MAIN ] STEM: Loaded 14664 existing records. [2025-09-14T20:10:00.564107] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-14T20:10:00.643915] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:00.644385] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-14T20:10:00.644463] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-14T20:10:00.644998] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-14T20:10:00.645074] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-14T20:10:01.005028] [INFO ] [REMOTE ] STEM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:01.230900] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T20:10:01.358850] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-14T20:10:02.158898] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-14T20:10:02.958893] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-14T20:10:03.668695] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (3.10 seconds). [2025-09-14T20:10:03.746698] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T20:10:03.758780] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-14T20:10:04.055307] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-14T20:10:04.269427] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T20:10:04.558932] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-14T20:10:05.192937] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T20:10:05.358876] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-14T20:10:05.412340] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T20:10:06.158921] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-14T20:10:06.953897] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T20:10:06.961127] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-14T20:10:07.758933] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-14T20:10:08.036512] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T20:10:08.256046] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T20:10:08.558947] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-14T20:10:09.137895] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T20:10:09.358938] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-14T20:10:09.794265] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T20:10:10.158898] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-14T20:10:10.958852] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-14T20:10:11.087782] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T20:10:11.423687] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T20:10:11.758861] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-14T20:10:11.819494] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T20:10:12.558887] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-14T20:10:13.358896] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-14T20:10:14.158908] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-14T20:10:14.321368] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T20:10:14.400803] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-14T20:10:14.568583] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T20:10:14.571292] [INFO ] [REMOTE ] STEL: Full fetch complete (25457 records). [2025-09-14T20:10:14.571384] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-14T20:10:14.935227] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-14T20:10:14.935333] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-14T20:10:14.935948] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-14T20:10:14.936016] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-14T20:10:14.936759] [DEBUG] [LOCAL ] STEL: Trimmed 25457 records to 16772 (keeping 150 days of data) [2025-09-14T20:10:14.985185] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-14T20:10:15.054037] [DEBUG] [LOCAL ] STEL: Primary data saved (16772 records). [2025-09-14T20:10:15.054297] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-14T20:10:15.054610] [INFO ] [MAIN ] Update Progress: 2004/2370 symbols completed. STEL took 18.9s. Estimated remaining: 38m 55s. Rate: 9.4 symbols/min [2025-09-14T20:10:15.232817] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T20:10:15.251302] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:15.256025] [INFO ] [REMOTE ] STE: Full fetch complete (38289 records). [2025-09-14T20:10:15.256182] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-14T20:10:15.369555] [DEBUG] [LOCAL ] STEW: Loaded 6213 existing records from primary storage. [2025-09-14T20:10:15.390871] [INFO ] [MAIN ] STEW: Loaded 6213 existing records. [2025-09-14T20:10:15.775860] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:15.784280] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-14T20:10:15.811946] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-14T20:10:15.822505] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-14T20:10:15.822604] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-14T20:10:15.822822] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-14T20:10:15.823862] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-14T20:10:15.824055] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-14T20:10:15.824107] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-14T20:10:15.824317] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-14T20:10:15.925887] [DEBUG] [LOCAL ] STE: Trimmed 38289 records to 26441 (keeping 150 days of data) [2025-09-14T20:10:16.298540] [INFO ] [REMOTE ] STEW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:16.364155] [DEBUG] [LOCAL ] STE: Primary data saved (26441 records). [2025-09-14T20:10:16.364338] [INFO ] [MAIN ] STE: Full history saved. [2025-09-14T20:10:16.364474] [INFO ] [MAIN ] Update Progress: 2005/2370 symbols completed. STE took 21.9s. Estimated remaining: 38m 47s. Rate: 9.4 symbols/min [2025-09-14T20:10:16.544100] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:16.548498] [DEBUG] [LOCAL ] STG: Loaded 1518 existing records from primary storage. [2025-09-14T20:10:16.548728] [INFO ] [MAIN ] STG: Loaded 1518 existing records. [2025-09-14T20:10:16.582159] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-14T20:10:16.734494] [WARN ] [MAIN ] STG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:16.734807] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-14T20:10:16.734870] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-14T20:10:16.735087] [DEBUG] [LOCAL ] STG: Deleted primary data file. [2025-09-14T20:10:16.735146] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-14T20:10:17.088908] [INFO ] [REMOTE ] STG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:17.355479] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-14T20:10:17.365077] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-14T20:10:17.537835] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T20:10:17.755777] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T20:10:17.787676] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T20:10:18.158860] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-14T20:10:18.708061] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T20:10:18.958848] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-14T20:10:19.758830] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-14T20:10:19.974214] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T20:10:20.558885] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-14T20:10:20.969927] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-14T20:10:21.358863] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-14T20:10:21.616282] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T20:10:21.853807] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-14T20:10:22.158843] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-14T20:10:22.958856] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-14T20:10:23.370093] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T20:10:23.424067] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-14T20:10:23.758845] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-14T20:10:24.558868] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-14T20:10:24.594754] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T20:10:25.124721] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T20:10:25.131299] [INFO ] [REMOTE ] STAG: Full fetch complete (54251 records). [2025-09-14T20:10:25.131447] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-14T20:10:25.364032] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-14T20:10:25.516937] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-14T20:10:25.517076] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-14T20:10:25.518147] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-14T20:10:25.518209] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-14T20:10:25.520957] [DEBUG] [LOCAL ] STAG: Trimmed 54251 records to 37366 (keeping 150 days of data) [2025-09-14T20:10:25.782087] [DEBUG] [LOCAL ] STAG: Primary data saved (37366 records). [2025-09-14T20:10:25.782240] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-14T20:10:25.782359] [INFO ] [MAIN ] Update Progress: 2006/2370 symbols completed. STAG took 49.3s. Estimated remaining: 38m 42s. Rate: 9.4 symbols/min [2025-09-14T20:10:25.886418] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T20:10:25.957348] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:25.964034] [DEBUG] [LOCAL ] STK: Loaded 3762 existing records from primary storage. [2025-09-14T20:10:25.964207] [INFO ] [MAIN ] STK: Loaded 3762 existing records. [2025-09-14T20:10:26.140747] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:26.141000] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-14T20:10:26.141060] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-14T20:10:26.141361] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-14T20:10:26.141425] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-14T20:10:26.163999] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-14T20:10:26.523459] [INFO ] [REMOTE ] STK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:26.958822] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-14T20:10:27.275527] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T20:10:27.758848] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-14T20:10:28.558804] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-14T20:10:28.610765] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T20:10:28.733773] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T20:10:28.902871] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T20:10:28.903781] [INFO ] [REMOTE ] STG: Full fetch complete (2062 records). [2025-09-14T20:10:28.903868] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-14T20:10:29.085863] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 140 unique days, need 150 days [2025-09-14T20:10:29.086068] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:10:29.086120] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:10:29.086170] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-14T20:10:29.086240] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-14T20:10:29.086294] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-14T20:10:29.086357] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-14T20:10:29.086455] [INFO ] [MAIN ] Update Progress: 2007/2370 symbols completed. STG took 12.7s. Estimated remaining: 38m 35s. Rate: 9.4 symbols/min [2025-09-14T20:10:29.260376] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:29.285949] [DEBUG] [LOCAL ] STLA: Loaded 24002 existing records from primary storage. [2025-09-14T20:10:29.286193] [INFO ] [MAIN ] STLA: Loaded 24002 existing records. [2025-09-14T20:10:29.363939] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-14T20:10:29.468003] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:29.468257] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-14T20:10:29.468316] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-14T20:10:29.468925] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-14T20:10:29.468987] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-14T20:10:29.823817] [INFO ] [REMOTE ] STLA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:30.158831] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-14T20:10:30.741794] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T20:10:30.768865] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T20:10:30.958798] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-14T20:10:31.758822] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-14T20:10:31.934756] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T20:10:31.937454] [INFO ] [REMOTE ] STEM: Full fetch complete (45154 records). [2025-09-14T20:10:31.937602] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-14T20:10:32.318812] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-14T20:10:32.319025] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-14T20:10:32.320112] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-14T20:10:32.320206] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-14T20:10:32.321679] [DEBUG] [LOCAL ] STEM: Trimmed 45154 records to 29074 (keeping 150 days of data) [2025-09-14T20:10:32.496264] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T20:10:32.539553] [DEBUG] [LOCAL ] STEM: Primary data saved (29074 records). [2025-09-14T20:10:32.539755] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-14T20:10:32.539876] [INFO ] [MAIN ] Update Progress: 2008/2370 symbols completed. STEM took 32.3s. Estimated remaining: 38m 28s. Rate: 9.4 symbols/min [2025-09-14T20:10:32.568953] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-14T20:10:32.712140] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:32.735541] [DEBUG] [LOCAL ] STM: Loaded 23987 existing records from primary storage. [2025-09-14T20:10:32.735741] [INFO ] [MAIN ] STM: Loaded 23987 existing records. [2025-09-14T20:10:32.910722] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:32.911016] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-14T20:10:32.911079] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-14T20:10:32.911625] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-14T20:10:32.911712] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-14T20:10:33.258973] [INFO ] [REMOTE ] STM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:33.358772] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-14T20:10:33.622168] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T20:10:34.158845] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-14T20:10:34.958899] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-14T20:10:35.056432] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T20:10:35.097431] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T20:10:35.564905] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T20:10:35.758827] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-14T20:10:36.291074] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T20:10:36.558826] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-14T20:10:37.358882] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-14T20:10:37.483112] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T20:10:38.000071] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T20:10:38.001863] [INFO ] [REMOTE ] STEW: Full fetch complete (17295 records). [2025-09-14T20:10:38.001951] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-14T20:10:38.163956] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-14T20:10:38.384967] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-14T20:10:38.385088] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-14T20:10:38.385499] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-14T20:10:38.385556] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-14T20:10:38.386372] [DEBUG] [LOCAL ] STEW: Trimmed 17295 records to 11387 (keeping 150 days of data) [2025-09-14T20:10:38.459292] [DEBUG] [LOCAL ] STEW: Primary data saved (11387 records). [2025-09-14T20:10:38.459469] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-14T20:10:38.459585] [INFO ] [MAIN ] Update Progress: 2009/2370 symbols completed. STEW took 23.4s. Estimated remaining: 38m 21s. Rate: 9.4 symbols/min [2025-09-14T20:10:38.627849] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:38.639382] [DEBUG] [LOCAL ] STN: Loaded 9905 existing records from primary storage. [2025-09-14T20:10:38.639560] [INFO ] [MAIN ] STN: Loaded 9905 existing records. [2025-09-14T20:10:38.817203] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:38.817445] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-14T20:10:38.817505] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-14T20:10:38.817933] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-14T20:10:38.817996] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-14T20:10:38.963989] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-14T20:10:39.197493] [INFO ] [REMOTE ] STN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:39.749205] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T20:10:39.758798] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-14T20:10:40.253121] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T20:10:40.534503] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T20:10:40.558785] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-14T20:10:41.358840] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-14T20:10:42.158881] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-14T20:10:42.214862] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T20:10:42.530887] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T20:10:42.944971] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T20:10:42.960616] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-14T20:10:43.758892] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-14T20:10:44.558939] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-14T20:10:44.722428] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T20:10:44.803888] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T20:10:45.362868] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-14T20:10:45.364618] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T20:10:46.158897] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-14T20:10:46.821053] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T20:10:46.828616] [INFO ] [REMOTE ] STLA: Full fetch complete (58208 records). [2025-09-14T20:10:46.828797] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-14T20:10:46.964011] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-14T20:10:47.233474] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-14T20:10:47.233688] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-14T20:10:47.235926] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-14T20:10:47.236161] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-14T20:10:47.255943] [DEBUG] [LOCAL ] STLA: Trimmed 58208 records to 40314 (keeping 150 days of data) [2025-09-14T20:10:47.278535] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T20:10:47.558427] [DEBUG] [LOCAL ] STLA: Primary data saved (40314 records). [2025-09-14T20:10:47.558668] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-14T20:10:47.558807] [INFO ] [MAIN ] Update Progress: 2010/2370 symbols completed. STLA took 18.5s. Estimated remaining: 38m 15s. Rate: 9.4 symbols/min [2025-09-14T20:10:47.735505] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:47.758927] [DEBUG] [LOCAL ] STNG: Loaded 20476 existing records from primary storage. [2025-09-14T20:10:47.759080] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-14T20:10:47.759480] [INFO ] [MAIN ] STNG: Loaded 20476 existing records. [2025-09-14T20:10:47.946293] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:47.946613] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-14T20:10:47.946707] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-14T20:10:47.947441] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-14T20:10:47.947522] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-14T20:10:48.325776] [INFO ] [REMOTE ] STNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:48.342234] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T20:10:48.558894] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-14T20:10:49.358896] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-14T20:10:49.996499] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T20:10:50.158921] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-14T20:10:50.208502] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-14T20:10:50.864346] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T20:10:50.958884] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-14T20:10:51.357387] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T20:10:51.758872] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-14T20:10:52.558827] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-14T20:10:52.633446] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T20:10:53.358881] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-14T20:10:53.377126] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T20:10:53.453218] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T20:10:54.158896] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-14T20:10:54.958957] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-14T20:10:55.123745] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T20:10:55.690754] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-14T20:10:55.712753] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T20:10:55.718593] [INFO ] [REMOTE ] STM: Full fetch complete (58238 records). [2025-09-14T20:10:55.718802] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-14T20:10:55.764021] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-14T20:10:56.140109] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-14T20:10:56.140290] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-14T20:10:56.141995] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-14T20:10:56.142136] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-14T20:10:56.144129] [DEBUG] [LOCAL ] STM: Trimmed 58238 records to 40340 (keeping 150 days of data) [2025-09-14T20:10:56.418602] [DEBUG] [LOCAL ] STM: Primary data saved (40340 records). [2025-09-14T20:10:56.418877] [INFO ] [MAIN ] STM: Full history saved. [2025-09-14T20:10:56.419019] [INFO ] [MAIN ] Update Progress: 2011/2370 symbols completed. STM took 23.9s. Estimated remaining: 38m 9s. Rate: 9.4 symbols/min [2025-09-14T20:10:56.564121] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-14T20:10:56.617754] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:10:56.625304] [DEBUG] [LOCAL ] STRV: Loaded 4124 existing records from primary storage. [2025-09-14T20:10:56.625589] [INFO ] [MAIN ] STRV: Loaded 4124 existing records. [2025-09-14T20:10:56.863459] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:10:56.864425] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-14T20:10:56.864497] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-14T20:10:56.865028] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-14T20:10:56.865100] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-14T20:10:57.242833] [INFO ] [REMOTE ] STRV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:10:57.321112] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T20:10:57.365190] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-14T20:10:57.389274] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T20:10:58.158822] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-14T20:10:58.277893] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T20:10:58.958847] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-14T20:10:59.384846] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T20:10:59.734880] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T20:10:59.758804] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-14T20:11:00.558913] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-14T20:11:00.636212] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T20:11:01.358885] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-14T20:11:02.158848] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-14T20:11:02.420985] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T20:11:02.958872] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-14T20:11:03.758858] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-14T20:11:03.817099] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T20:11:04.152374] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-09-14T20:11:04.211324] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T20:11:04.214086] [INFO ] [REMOTE ] STN: Full fetch complete (25318 records). [2025-09-14T20:11:04.214198] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-14T20:11:04.566790] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-14T20:11:04.579308] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-14T20:11:04.579605] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-14T20:11:04.580356] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-14T20:11:04.580438] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-14T20:11:04.581360] [DEBUG] [LOCAL ] STN: Trimmed 25318 records to 17137 (keeping 150 days of data) [2025-09-14T20:11:04.689158] [DEBUG] [LOCAL ] STN: Primary data saved (17137 records). [2025-09-14T20:11:04.689355] [INFO ] [MAIN ] STN: Full history saved. [2025-09-14T20:11:04.689463] [INFO ] [MAIN ] Update Progress: 2012/2370 symbols completed. STN took 26.2s. Estimated remaining: 38m 3s. Rate: 9.4 symbols/min [2025-09-14T20:11:04.873864] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:04.876011] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T20:11:04.903476] [DEBUG] [LOCAL ] STT: Loaded 22753 existing records from primary storage. [2025-09-14T20:11:04.903680] [INFO ] [MAIN ] STT: Loaded 22753 existing records. [2025-09-14T20:11:05.085657] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:05.085970] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-14T20:11:05.086031] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-14T20:11:05.086670] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-14T20:11:05.086735] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-14T20:11:05.361190] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-14T20:11:05.440121] [INFO ] [REMOTE ] STT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:05.481621] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T20:11:06.145191] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T20:11:06.149024] [INFO ] [REMOTE ] STK: Full fetch complete (10283 records). [2025-09-14T20:11:06.149296] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-14T20:11:06.158947] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-14T20:11:06.533974] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-14T20:11:06.534146] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-14T20:11:06.534775] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-14T20:11:06.534840] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-14T20:11:06.535903] [DEBUG] [LOCAL ] STK: Trimmed 10283 records to 6539 (keeping 150 days of data) [2025-09-14T20:11:06.577488] [DEBUG] [LOCAL ] STK: Primary data saved (6539 records). [2025-09-14T20:11:06.577680] [INFO ] [MAIN ] STK: Full history saved. [2025-09-14T20:11:06.577789] [INFO ] [MAIN ] Update Progress: 2013/2370 symbols completed. STK took 40.8s. Estimated remaining: 37m 56s. Rate: 9.4 symbols/min [2025-09-14T20:11:06.749064] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:06.762972] [DEBUG] [LOCAL ] STVN: Loaded 12388 existing records from primary storage. [2025-09-14T20:11:06.763152] [INFO ] [MAIN ] STVN: Loaded 12388 existing records. [2025-09-14T20:11:06.948762] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:06.949693] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-14T20:11:06.949761] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-14T20:11:06.950427] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-14T20:11:06.950487] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-14T20:11:06.964037] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-14T20:11:07.316292] [INFO ] [REMOTE ] STVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:07.574209] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T20:11:07.766031] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-14T20:11:07.767119] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T20:11:08.558848] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-14T20:11:08.735023] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T20:11:09.358875] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-14T20:11:10.158791] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-14T20:11:10.251734] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T20:11:10.617004] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T20:11:10.958871] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-14T20:11:11.758891] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-14T20:11:12.144426] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T20:11:12.360780] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T20:11:12.558840] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-14T20:11:13.358868] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-14T20:11:13.432457] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T20:11:14.158871] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-14T20:11:14.293076] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T20:11:14.554513] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T20:11:14.958808] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-14T20:11:15.361311] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T20:11:15.758823] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-14T20:11:16.558856] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-14T20:11:17.057222] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-14T20:11:17.142379] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T20:11:17.358880] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-14T20:11:17.883569] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T20:11:18.158844] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-14T20:11:18.198299] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T20:11:18.199699] [INFO ] [REMOTE ] STRV: Full fetch complete (12797 records). [2025-09-14T20:11:18.199780] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-14T20:11:18.555371] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-14T20:11:18.555485] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-14T20:11:18.555742] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-14T20:11:18.555802] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-14T20:11:18.556281] [DEBUG] [LOCAL ] STRV: Trimmed 12797 records to 7828 (keeping 150 days of data) [2025-09-14T20:11:18.603887] [DEBUG] [LOCAL ] STRV: Primary data saved (7828 records). [2025-09-14T20:11:18.604014] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-14T20:11:18.604119] [INFO ] [MAIN ] Update Progress: 2014/2370 symbols completed. STRV took 22.2s. Estimated remaining: 37m 51s. Rate: 9.4 symbols/min [2025-09-14T20:11:18.771587] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:18.793965] [DEBUG] [LOCAL ] STWD: Loaded 23197 existing records from primary storage. [2025-09-14T20:11:18.794139] [INFO ] [MAIN ] STWD: Loaded 23197 existing records. [2025-09-14T20:11:18.964337] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-14T20:11:18.969303] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:18.970291] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-14T20:11:18.970352] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-14T20:11:18.970855] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-14T20:11:18.970914] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-14T20:11:19.335583] [INFO ] [REMOTE ] STWD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:19.413561] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T20:11:19.758840] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-14T20:11:20.428783] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-14T20:11:20.433473] [INFO ] [REMOTE ] STNG: Full fetch complete (48205 records). [2025-09-14T20:11:20.433603] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-14T20:11:20.574078] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-14T20:11:20.813057] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-14T20:11:20.813166] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-14T20:11:20.814149] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-14T20:11:20.814205] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-14T20:11:20.815303] [DEBUG] [LOCAL ] STNG: Trimmed 48205 records to 32791 (keeping 150 days of data) [2025-09-14T20:11:21.018788] [DEBUG] [LOCAL ] STNG: Primary data saved (32791 records). [2025-09-14T20:11:21.018970] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-14T20:11:21.019141] [INFO ] [MAIN ] Update Progress: 2015/2370 symbols completed. STNG took 33.5s. Estimated remaining: 37m 44s. Rate: 9.4 symbols/min [2025-09-14T20:11:21.187992] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:21.190196] [DEBUG] [LOCAL ] STXD: Loaded 414 existing records from primary storage. [2025-09-14T20:11:21.190280] [INFO ] [MAIN ] STXD: Loaded 414 existing records. [2025-09-14T20:11:21.371438] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:21.366163] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-14T20:11:21.372118] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-14T20:11:21.373246] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-14T20:11:21.373477] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-14T20:11:21.373541] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-14T20:11:21.695277] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-14T20:11:21.777600] [INFO ] [REMOTE ] STXD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:22.027324] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T20:11:22.158822] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-14T20:11:22.958882] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-14T20:11:23.243369] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T20:11:23.758848] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-14T20:11:23.893824] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T20:11:23.897428] [INFO ] [REMOTE ] STVN: Full fetch complete (28984 records). [2025-09-14T20:11:23.897539] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-14T20:11:24.279910] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-14T20:11:24.280087] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-14T20:11:24.280970] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-14T20:11:24.295048] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-14T20:11:24.318222] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T20:11:24.329111] [DEBUG] [LOCAL ] STVN: Trimmed 28984 records to 19718 (keeping 150 days of data) [2025-09-14T20:11:24.449582] [DEBUG] [LOCAL ] STVN: Primary data saved (19718 records). [2025-09-14T20:11:24.449777] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-14T20:11:24.449882] [INFO ] [MAIN ] Update Progress: 2016/2370 symbols completed. STVN took 17.9s. Estimated remaining: 37m 37s. Rate: 9.4 symbols/min [2025-09-14T20:11:24.563913] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-14T20:11:24.621168] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:24.623762] [DEBUG] [LOCAL ] STXE: Loaded 838 existing records from primary storage. [2025-09-14T20:11:24.623868] [INFO ] [MAIN ] STXE: Loaded 838 existing records. [2025-09-14T20:11:24.799514] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:24.799789] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-14T20:11:24.799851] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-14T20:11:24.800057] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-14T20:11:24.800115] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-14T20:11:25.154297] [INFO ] [REMOTE ] STXE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:25.204337] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-14T20:11:25.311570] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T20:11:25.358784] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-14T20:11:26.158862] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-14T20:11:26.958829] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-14T20:11:27.104991] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T20:11:27.570517] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T20:11:27.758812] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-14T20:11:28.165119] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T20:11:28.432972] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:11:28.438472] [INFO ] [REMOTE ] STT: Full fetch complete (55808 records). [2025-09-14T20:11:28.438598] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-14T20:11:28.563971] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-14T20:11:28.827318] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-14T20:11:28.827464] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-14T20:11:28.828564] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-14T20:11:28.828658] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-14T20:11:28.830192] [DEBUG] [LOCAL ] STT: Trimmed 55808 records to 38482 (keeping 150 days of data) [2025-09-14T20:11:29.113145] [DEBUG] [LOCAL ] STT: Primary data saved (38482 records). [2025-09-14T20:11:29.113403] [INFO ] [MAIN ] STT: Full history saved. [2025-09-14T20:11:29.113547] [INFO ] [MAIN ] Update Progress: 2017/2370 symbols completed. STT took 24.4s. Estimated remaining: 37m 30s. Rate: 9.4 symbols/min [2025-09-14T20:11:29.230517] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T20:11:29.309467] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:29.312506] [DEBUG] [LOCAL ] STXG: Loaded 808 existing records from primary storage. [2025-09-14T20:11:29.312624] [INFO ] [MAIN ] STXG: Loaded 808 existing records. [2025-09-14T20:11:29.365179] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-14T20:11:29.496683] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:29.496968] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-14T20:11:29.497044] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-14T20:11:29.497242] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-14T20:11:29.497301] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-14T20:11:29.846185] [INFO ] [REMOTE ] STXG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:29.945145] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-14T20:11:30.158845] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-14T20:11:30.669912] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T20:11:30.958851] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-14T20:11:31.758856] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-14T20:11:32.558891] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-14T20:11:32.571531] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T20:11:32.824031] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T20:11:32.978271] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T20:11:33.358857] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-14T20:11:33.981020] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T20:11:34.158896] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-14T20:11:34.843286] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T20:11:34.958877] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-14T20:11:35.343825] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-14T20:11:35.758839] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-14T20:11:36.421680] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T20:11:36.558843] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-14T20:11:37.130918] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T20:11:37.358821] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-14T20:11:38.028244] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T20:11:38.158823] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-14T20:11:38.607017] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-14T20:11:38.958821] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-14T20:11:39.519467] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T20:11:39.759006] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-14T20:11:40.062826] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T20:11:40.063576] [INFO ] [REMOTE ] STXD: Full fetch complete (1501 records). [2025-09-14T20:11:40.063682] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-14T20:11:40.423558] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-14T20:11:40.423690] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-14T20:11:40.423813] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-14T20:11:40.423866] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-14T20:11:40.424249] [DEBUG] [LOCAL ] STXD: Trimmed 1501 records to 838 (keeping 150 days of data) [2025-09-14T20:11:40.430100] [DEBUG] [LOCAL ] STXD: Primary data saved (838 records). [2025-09-14T20:11:40.430186] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-14T20:11:40.430283] [INFO ] [MAIN ] Update Progress: 2018/2370 symbols completed. STXD took 19.4s. Estimated remaining: 37m 25s. Rate: 9.4 symbols/min [2025-09-14T20:11:40.563908] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-14T20:11:40.615483] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:40.618081] [DEBUG] [LOCAL ] STXK: Loaded 544 existing records from primary storage. [2025-09-14T20:11:40.618362] [INFO ] [MAIN ] STXK: Loaded 544 existing records. [2025-09-14T20:11:40.806465] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:40.806783] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-14T20:11:40.806847] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-14T20:11:40.807076] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-14T20:11:40.807139] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-14T20:11:41.146581] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-14T20:11:41.166771] [INFO ] [REMOTE ] STXK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:41.358856] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-14T20:11:41.873002] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T20:11:42.158835] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-14T20:11:42.679562] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T20:11:42.958832] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-14T20:11:43.407304] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T20:11:43.408183] [INFO ] [REMOTE ] STXG: Full fetch complete (3035 records). [2025-09-14T20:11:43.408280] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-14T20:11:43.758825] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-14T20:11:43.763309] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-14T20:11:43.763399] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-14T20:11:43.763532] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-14T20:11:43.763636] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-14T20:11:43.764973] [DEBUG] [LOCAL ] STXG: Trimmed 3035 records to 1621 (keeping 150 days of data) [2025-09-14T20:11:43.775776] [DEBUG] [LOCAL ] STXG: Primary data saved (1621 records). [2025-09-14T20:11:43.775871] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-14T20:11:43.776024] [INFO ] [MAIN ] Update Progress: 2019/2370 symbols completed. STXG took 14.7s. Estimated remaining: 37m 18s. Rate: 9.4 symbols/min [2025-09-14T20:11:43.944867] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:43.947180] [DEBUG] [LOCAL ] STXM: Loaded 346 existing records from primary storage. [2025-09-14T20:11:43.947290] [INFO ] [MAIN ] STXM: Loaded 346 existing records. [2025-09-14T20:11:44.124737] [WARN ] [MAIN ] STXM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:44.125030] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-14T20:11:44.125116] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-14T20:11:44.125373] [DEBUG] [LOCAL ] STXM: Deleted primary data file. [2025-09-14T20:11:44.125449] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-14T20:11:44.408930] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T20:11:44.494782] [INFO ] [REMOTE ] STXM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:44.558797] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-14T20:11:45.058354] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-14T20:11:45.358835] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-14T20:11:45.859749] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T20:11:46.158840] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-14T20:11:46.958851] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-14T20:11:47.438428] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-14T20:11:47.758856] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-14T20:11:47.896190] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T20:11:48.246419] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-14T20:11:48.558850] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-14T20:11:49.056496] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T20:11:49.358885] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-14T20:11:49.797231] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T20:11:49.798131] [INFO ] [REMOTE ] STXE: Full fetch complete (2547 records). [2025-09-14T20:11:49.798225] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-14T20:11:50.164041] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-14T20:11:50.199998] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-14T20:11:50.200109] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-14T20:11:50.200235] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-14T20:11:50.200289] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-14T20:11:50.200706] [DEBUG] [LOCAL ] STXE: Trimmed 2547 records to 1470 (keeping 150 days of data) [2025-09-14T20:11:50.210586] [DEBUG] [LOCAL ] STXE: Primary data saved (1470 records). [2025-09-14T20:11:50.210706] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-14T20:11:50.210801] [INFO ] [MAIN ] Update Progress: 2020/2370 symbols completed. STXE took 25.8s. Estimated remaining: 37m 11s. Rate: 9.4 symbols/min [2025-09-14T20:11:50.380119] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:11:50.383105] [DEBUG] [LOCAL ] STXT: Loaded 1210 existing records from primary storage. [2025-09-14T20:11:50.383193] [INFO ] [MAIN ] STXT: Loaded 1210 existing records. [2025-09-14T20:11:50.563172] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:11:50.563462] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-14T20:11:50.563534] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-14T20:11:50.563825] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-14T20:11:50.563899] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-14T20:11:50.915713] [INFO ] [REMOTE ] STXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:11:50.958785] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-14T20:11:51.543631] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T20:11:51.758892] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-14T20:11:51.953130] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T20:11:52.206311] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T20:11:52.558875] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-14T20:11:52.941552] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-14T20:11:53.358887] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-14T20:11:53.972140] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T20:11:54.158852] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-14T20:11:54.958845] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-14T20:11:55.462431] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T20:11:55.758890] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-14T20:11:56.049892] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T20:11:56.253849] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T20:11:56.558866] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-14T20:11:57.069878] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T20:11:57.358850] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-14T20:11:57.867362] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T20:11:58.158830] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-14T20:11:58.678729] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T20:11:58.958875] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-14T20:11:59.323863] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-14T20:11:59.758847] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-14T20:12:00.457546] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:12:00.463843] [INFO ] [REMOTE ] STWD: Full fetch complete (56361 records). [2025-09-14T20:12:00.464025] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-14T20:12:00.564015] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-14T20:12:00.856916] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-14T20:12:00.857028] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-14T20:12:00.858159] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-14T20:12:00.858232] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-14T20:12:00.860332] [DEBUG] [LOCAL ] STWD: Trimmed 56361 records to 38914 (keeping 150 days of data) [2025-09-14T20:12:01.126473] [DEBUG] [LOCAL ] STWD: Primary data saved (38914 records). [2025-09-14T20:12:01.126672] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-14T20:12:01.126819] [INFO ] [MAIN ] Update Progress: 2021/2370 symbols completed. STWD took 42.5s. Estimated remaining: 37m 6s. Rate: 9.4 symbols/min [2025-09-14T20:12:01.294630] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:01.297247] [DEBUG] [LOCAL ] STXV: Loaded 675 existing records from primary storage. [2025-09-14T20:12:01.297338] [INFO ] [MAIN ] STXV: Loaded 675 existing records. [2025-09-14T20:12:01.364112] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-14T20:12:01.482841] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:01.483182] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-14T20:12:01.483273] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-14T20:12:01.483487] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-14T20:12:01.483559] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-14T20:12:01.847406] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T20:12:01.852388] [INFO ] [REMOTE ] STXV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:02.158861] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-14T20:12:02.958886] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-14T20:12:03.071894] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T20:12:03.758833] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-14T20:12:04.558864] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-14T20:12:04.662257] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T20:12:04.824697] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-14T20:12:05.072568] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T20:12:05.254188] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T20:12:05.358808] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-14T20:12:06.064379] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T20:12:06.158800] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-14T20:12:06.822544] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T20:12:06.958856] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-14T20:12:07.758973] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-14T20:12:08.137613] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T20:12:08.138720] [INFO ] [REMOTE ] STXT: Full fetch complete (2891 records). [2025-09-14T20:12:08.138810] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-14T20:12:08.247300] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T20:12:08.254395] [INFO ] [REMOTE ] STXM: Full fetch complete (1030 records). [2025-09-14T20:12:08.264738] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-14T20:12:08.564083] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-14T20:12:08.639222] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-14T20:12:08.661184] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:12:08.666493] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:12:08.720980] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-14T20:12:08.729342] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-14T20:12:08.729504] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-14T20:12:08.729811] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-14T20:12:08.729890] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-14T20:12:08.730427] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-14T20:12:08.730096] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-14T20:12:08.730888] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-14T20:12:08.730796] [INFO ] [MAIN ] Update Progress: 2022/2370 symbols completed. STXM took 25.0s. Estimated remaining: 36m 60s. Rate: 9.4 symbols/min [2025-09-14T20:12:08.776008] [DEBUG] [LOCAL ] STXT: Trimmed 2891 records to 1916 (keeping 150 days of data) [2025-09-14T20:12:08.917540] [DEBUG] [LOCAL ] STXT: Primary data saved (1916 records). [2025-09-14T20:12:08.925540] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-14T20:12:08.926471] [INFO ] [MAIN ] Update Progress: 2023/2370 symbols completed. STXT took 18.7s. Estimated remaining: 36m 52s. Rate: 9.4 symbols/min [2025-09-14T20:12:08.943863] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:09.150294] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:09.172374] [DEBUG] [LOCAL ] STZ: Loaded 23499 existing records from primary storage. [2025-09-14T20:12:09.172617] [INFO ] [MAIN ] STZ: Loaded 23499 existing records. [2025-09-14T20:12:09.299059] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T20:12:09.373680] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-14T20:12:09.402207] [DEBUG] [LOCAL ] SU: Loaded 23900 existing records from primary storage. [2025-09-14T20:12:09.402580] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:09.403223] [INFO ] [MAIN ] SU: Loaded 23900 existing records. [2025-09-14T20:12:09.403553] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-14T20:12:09.478309] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-14T20:12:09.517957] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-14T20:12:09.538469] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-14T20:12:09.678366] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:09.701414] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-14T20:12:09.701840] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-14T20:12:09.718172] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-14T20:12:09.742130] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-14T20:12:10.014299] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T20:12:10.158908] [INFO ] [REMOTE ] STZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:10.166610] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-14T20:12:10.345400] [INFO ] [REMOTE ] SU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:10.733439] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T20:12:10.958843] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-14T20:12:11.503499] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-14T20:12:11.758840] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-14T20:12:12.176389] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T20:12:12.177265] [INFO ] [REMOTE ] STXK: Full fetch complete (1728 records). [2025-09-14T20:12:12.177348] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-14T20:12:12.526940] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-14T20:12:12.527052] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-14T20:12:12.527156] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-14T20:12:12.527209] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-14T20:12:12.527578] [DEBUG] [LOCAL ] STXK: Trimmed 1728 records to 998 (keeping 150 days of data) [2025-09-14T20:12:12.534737] [DEBUG] [LOCAL ] STXK: Primary data saved (998 records). [2025-09-14T20:12:12.534813] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-14T20:12:12.534920] [INFO ] [MAIN ] Update Progress: 2024/2370 symbols completed. STXK took 32.1s. Estimated remaining: 36m 45s. Rate: 9.4 symbols/min [2025-09-14T20:12:12.564049] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-14T20:12:12.711628] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:12.738550] [DEBUG] [LOCAL ] SUI: Loaded 19436 existing records from primary storage. [2025-09-14T20:12:12.738750] [INFO ] [MAIN ] SUI: Loaded 19436 existing records. [2025-09-14T20:12:12.912222] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:12.912500] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-14T20:12:12.912582] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-14T20:12:12.913144] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-14T20:12:12.913211] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-14T20:12:13.188437] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T20:12:13.266389] [INFO ] [REMOTE ] SUI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:13.358805] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-14T20:12:14.158873] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-14T20:12:14.642622] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T20:12:14.958862] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-14T20:12:15.285371] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T20:12:15.758834] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-14T20:12:16.558869] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-14T20:12:16.583280] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T20:12:17.358884] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-14T20:12:17.758131] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T20:12:17.759012] [INFO ] [REMOTE ] STXV: Full fetch complete (1956 records). [2025-09-14T20:12:17.759097] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-14T20:12:18.134033] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-14T20:12:18.134262] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-14T20:12:18.134437] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-14T20:12:18.134575] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-14T20:12:18.135131] [DEBUG] [LOCAL ] STXV: Trimmed 1956 records to 1125 (keeping 150 days of data) [2025-09-14T20:12:18.143684] [DEBUG] [LOCAL ] STXV: Primary data saved (1125 records). [2025-09-14T20:12:18.143831] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-14T20:12:18.143977] [INFO ] [MAIN ] Update Progress: 2025/2370 symbols completed. STXV took 17.0s. Estimated remaining: 36m 39s. Rate: 9.4 symbols/min [2025-09-14T20:12:18.165738] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-14T20:12:18.319927] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-14T20:12:18.387052] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:18.415995] [DEBUG] [LOCAL ] SUN: Loaded 17559 existing records from primary storage. [2025-09-14T20:12:18.416229] [INFO ] [MAIN ] SUN: Loaded 17559 existing records. [2025-09-14T20:12:18.601912] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:18.602229] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-14T20:12:18.602294] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-14T20:12:18.602784] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-14T20:12:18.602849] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-14T20:12:18.960475] [INFO ] [REMOTE ] SUN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:18.960891] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-14T20:12:19.000589] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-14T20:12:19.758879] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-14T20:12:20.558834] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-14T20:12:20.809416] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T20:12:20.908179] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-09-14T20:12:21.358857] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-14T20:12:21.400667] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T20:12:22.046747] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T20:12:22.158879] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-14T20:12:22.958827] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-14T20:12:23.469399] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T20:12:23.637394] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T20:12:23.758801] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-14T20:12:24.558856] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-14T20:12:24.638111] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T20:12:25.221908] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T20:12:25.358815] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-14T20:12:26.158857] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-14T20:12:26.694200] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-14T20:12:26.940226] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T20:12:26.958927] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-14T20:12:27.758869] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-14T20:12:28.079590] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T20:12:28.509365] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T20:12:28.558789] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-14T20:12:29.358789] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-14T20:12:29.389587] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T20:12:30.122488] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T20:12:30.158780] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-14T20:12:30.958848] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-14T20:12:31.272222] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T20:12:31.758868] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-14T20:12:31.893360] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T20:12:32.558821] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-14T20:12:32.937134] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T20:12:33.047759] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T20:12:33.358866] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-14T20:12:34.024736] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T20:12:34.158873] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-14T20:12:34.958900] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-14T20:12:35.570151] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-14T20:12:35.758832] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-14T20:12:35.967710] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T20:12:36.245483] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T20:12:36.250295] [INFO ] [REMOTE ] SUI: Full fetch complete (45794 records). [2025-09-14T20:12:36.250413] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-14T20:12:36.563910] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-14T20:12:36.641740] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-14T20:12:36.641843] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-14T20:12:36.642826] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-14T20:12:36.642883] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-14T20:12:36.643954] [DEBUG] [LOCAL ] SUI: Trimmed 45794 records to 31838 (keeping 150 days of data) [2025-09-14T20:12:36.864670] [DEBUG] [LOCAL ] SUI: Primary data saved (31838 records). [2025-09-14T20:12:36.864840] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-14T20:12:36.864954] [INFO ] [MAIN ] Update Progress: 2026/2370 symbols completed. SUI took 24.3s. Estimated remaining: 36m 35s. Rate: 9.4 symbols/min [2025-09-14T20:12:37.034237] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:37.055494] [DEBUG] [LOCAL ] SUPV: Loaded 21477 existing records from primary storage. [2025-09-14T20:12:37.055706] [INFO ] [MAIN ] SUPV: Loaded 21477 existing records. [2025-09-14T20:12:37.233258] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:37.233534] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-14T20:12:37.233593] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-14T20:12:37.234095] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-14T20:12:37.234157] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-14T20:12:37.375137] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-14T20:12:37.593451] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:37.994989] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T20:12:37.998958] [INFO ] [REMOTE ] SUN: Full fetch complete (40834 records). [2025-09-14T20:12:37.999110] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-14T20:12:38.188610] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-14T20:12:38.349894] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-14T20:12:38.433343] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-14T20:12:38.433483] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-14T20:12:38.434972] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-14T20:12:38.435046] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-14T20:12:38.436197] [DEBUG] [LOCAL ] SUN: Trimmed 40834 records to 28696 (keeping 150 days of data) [2025-09-14T20:12:38.613684] [DEBUG] [LOCAL ] SUN: Primary data saved (28696 records). [2025-09-14T20:12:38.613880] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-14T20:12:38.614023] [INFO ] [MAIN ] Update Progress: 2027/2370 symbols completed. SUN took 20.5s. Estimated remaining: 36m 27s. Rate: 9.4 symbols/min [2025-09-14T20:12:38.784747] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:38.804027] [DEBUG] [LOCAL ] SUZ: Loaded 20044 existing records from primary storage. [2025-09-14T20:12:38.804216] [INFO ] [MAIN ] SUZ: Loaded 20044 existing records. [2025-09-14T20:12:38.984688] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:38.985029] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-14T20:12:38.984518] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-14T20:12:38.986072] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-14T20:12:38.986780] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-14T20:12:38.986956] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-14T20:12:39.319067] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T20:12:39.391582] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:39.581445] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T20:12:39.758794] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-14T20:12:40.558862] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-14T20:12:41.013088] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-14T20:12:41.183902] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T20:12:41.358835] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-14T20:12:42.158894] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-14T20:12:42.395086] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T20:12:42.837204] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:12:42.844585] [INFO ] [REMOTE ] STZ: Full fetch complete (56915 records). [2025-09-14T20:12:42.844818] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-14T20:12:42.959549] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-14T20:12:43.243339] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-14T20:12:43.243558] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-14T20:12:43.244762] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-14T20:12:43.244873] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-14T20:12:43.278005] [DEBUG] [LOCAL ] STZ: Trimmed 56915 records to 39284 (keeping 150 days of data) [2025-09-14T20:12:43.282682] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T20:12:43.571077] [DEBUG] [LOCAL ] STZ: Primary data saved (39284 records). [2025-09-14T20:12:43.571279] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-14T20:12:43.571416] [INFO ] [MAIN ] Update Progress: 2028/2370 symbols completed. STZ took 34.8s. Estimated remaining: 36m 21s. Rate: 9.4 symbols/min [2025-09-14T20:12:43.739363] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:43.758008] [DEBUG] [LOCAL ] SVV: Loaded 16676 existing records from primary storage. [2025-09-14T20:12:43.758205] [INFO ] [MAIN ] SVV: Loaded 16676 existing records. [2025-09-14T20:12:43.769437] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-14T20:12:43.935418] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:43.935709] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-14T20:12:43.935772] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-14T20:12:43.936169] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-14T20:12:43.936226] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-14T20:12:44.283892] [INFO ] [REMOTE ] SVV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:44.526820] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T20:12:44.533109] [INFO ] [REMOTE ] SU: Full fetch complete (58143 records). [2025-09-14T20:12:44.533236] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-14T20:12:44.567091] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-14T20:12:44.916912] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-14T20:12:44.917025] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-14T20:12:44.918116] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-14T20:12:44.918182] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-14T20:12:44.919517] [DEBUG] [LOCAL ] SU: Trimmed 58143 records to 40234 (keeping 150 days of data) [2025-09-14T20:12:45.180030] [DEBUG] [LOCAL ] SU: Primary data saved (40234 records). [2025-09-14T20:12:45.180213] [INFO ] [MAIN ] SU: Full history saved. [2025-09-14T20:12:45.180347] [INFO ] [MAIN ] Update Progress: 2029/2370 symbols completed. SU took 36.2s. Estimated remaining: 36m 14s. Rate: 9.4 symbols/min [2025-09-14T20:12:45.373537] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-14T20:12:45.377636] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:12:45.412467] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T20:12:45.439445] [DEBUG] [LOCAL ] SW: Loaded 23822 existing records from primary storage. [2025-09-14T20:12:45.439659] [INFO ] [MAIN ] SW: Loaded 23822 existing records. [2025-09-14T20:12:45.618022] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:12:45.618347] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-14T20:12:45.618412] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-14T20:12:45.619088] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-14T20:12:45.619158] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-14T20:12:45.971407] [INFO ] [REMOTE ] SW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:12:46.168771] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-14T20:12:46.173977] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T20:12:46.829410] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T20:12:46.958840] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-14T20:12:47.234999] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T20:12:47.758840] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-14T20:12:48.513911] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T20:12:48.558903] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-14T20:12:49.363936] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-14T20:12:49.388870] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T20:12:49.502858] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T20:12:50.158898] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-14T20:12:50.958811] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-14T20:12:51.125946] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T20:12:51.170354] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T20:12:51.758857] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-14T20:12:52.553605] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T20:12:52.561901] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-14T20:12:53.358891] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-14T20:12:53.440186] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T20:12:53.622468] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T20:12:54.158899] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-14T20:12:54.932371] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T20:12:54.958773] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-14T20:12:55.691073] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T20:12:55.758860] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-14T20:12:56.558791] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-14T20:12:56.663834] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T20:12:57.037874] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-14T20:12:57.320100] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T20:12:57.358795] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-14T20:12:58.158849] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-14T20:12:58.842346] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T20:12:58.958839] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-14T20:12:59.676176] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T20:12:59.681470] [INFO ] [REMOTE ] SUPV: Full fetch complete (50951 records). [2025-09-14T20:12:59.681621] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-14T20:12:59.764048] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-14T20:13:00.066497] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-14T20:13:00.066752] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-14T20:13:00.067882] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-14T20:13:00.068148] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-14T20:13:00.089204] [DEBUG] [LOCAL ] SUPV: Trimmed 50951 records to 35455 (keeping 150 days of data) [2025-09-14T20:13:00.091473] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:13:00.320940] [DEBUG] [LOCAL ] SUPV: Primary data saved (35455 records). [2025-09-14T20:13:00.321129] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-14T20:13:00.321236] [INFO ] [MAIN ] Update Progress: 2030/2370 symbols completed. SUPV took 23.5s. Estimated remaining: 36m 9s. Rate: 9.4 symbols/min [2025-09-14T20:13:00.504370] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:00.527555] [DEBUG] [LOCAL ] SWK: Loaded 23428 existing records from primary storage. [2025-09-14T20:13:00.527752] [INFO ] [MAIN ] SWK: Loaded 23428 existing records. [2025-09-14T20:13:00.564179] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-14T20:13:00.748130] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:00.748397] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-14T20:13:00.748460] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-14T20:13:00.749184] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-14T20:13:00.749250] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-14T20:13:01.119916] [INFO ] [REMOTE ] SWK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:01.358871] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-14T20:13:01.477685] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T20:13:02.158836] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-14T20:13:02.524664] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T20:13:02.958855] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-14T20:13:03.078857] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T20:13:03.195678] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T20:13:03.758881] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-14T20:13:03.889211] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T20:13:04.558834] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-14T20:13:05.358810] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-14T20:13:05.846447] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T20:13:06.032694] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T20:13:06.065104] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:13:06.070843] [INFO ] [REMOTE ] SW: Full fetch complete (57770 records). [2025-09-14T20:13:06.070981] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-14T20:13:06.163938] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-14T20:13:06.462054] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-14T20:13:06.462176] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-14T20:13:06.463264] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-14T20:13:06.463329] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-14T20:13:06.464626] [DEBUG] [LOCAL ] SW: Trimmed 57770 records to 39955 (keeping 150 days of data) [2025-09-14T20:13:06.720531] [DEBUG] [LOCAL ] SW: Primary data saved (39955 records). [2025-09-14T20:13:06.720755] [INFO ] [MAIN ] SW: Full history saved. [2025-09-14T20:13:06.720888] [INFO ] [MAIN ] Update Progress: 2031/2370 symbols completed. SW took 21.5s. Estimated remaining: 36m 2s. Rate: 9.4 symbols/min [2025-09-14T20:13:06.895786] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:06.911393] [DEBUG] [LOCAL ] SWX: Loaded 14093 existing records from primary storage. [2025-09-14T20:13:06.911576] [INFO ] [MAIN ] SWX: Loaded 14093 existing records. [2025-09-14T20:13:06.967879] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-14T20:13:07.098874] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:07.099170] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-14T20:13:07.099230] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-14T20:13:07.099779] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-14T20:13:07.099841] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-14T20:13:07.453054] [INFO ] [REMOTE ] SWX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:07.763968] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-14T20:13:07.778662] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T20:13:08.435550] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T20:13:08.440051] [INFO ] [REMOTE ] SUZ: Full fetch complete (50386 records). [2025-09-14T20:13:08.440185] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-14T20:13:08.563903] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-14T20:13:08.829297] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-14T20:13:08.829403] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-14T20:13:08.830432] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-14T20:13:08.830491] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-14T20:13:08.831565] [DEBUG] [LOCAL ] SUZ: Trimmed 50386 records to 34309 (keeping 150 days of data) [2025-09-14T20:13:09.033515] [DEBUG] [LOCAL ] SUZ: Primary data saved (34309 records). [2025-09-14T20:13:09.033713] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-14T20:13:09.033816] [INFO ] [MAIN ] Update Progress: 2032/2370 symbols completed. SUZ took 30.4s. Estimated remaining: 35m 55s. Rate: 9.4 symbols/min [2025-09-14T20:13:09.209879] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:09.220205] [DEBUG] [LOCAL ] SWZ: Loaded 2661 existing records from primary storage. [2025-09-14T20:13:09.228879] [INFO ] [MAIN ] SWZ: Loaded 2661 existing records. [2025-09-14T20:13:09.261350] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T20:13:09.375359] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-14T20:13:09.412512] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:09.412780] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-14T20:13:09.412846] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-14T20:13:09.413086] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-14T20:13:09.413143] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-14T20:13:09.765612] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:10.158810] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-14T20:13:10.407761] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-14T20:13:10.412979] [INFO ] [REMOTE ] SVV: Full fetch complete (42293 records). [2025-09-14T20:13:10.413131] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-14T20:13:10.700433] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T20:13:10.797608] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-14T20:13:10.797758] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-14T20:13:10.798714] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-14T20:13:10.798769] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-14T20:13:10.799960] [DEBUG] [LOCAL ] SVV: Trimmed 42293 records to 28889 (keeping 150 days of data) [2025-09-14T20:13:10.959544] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-14T20:13:10.976121] [DEBUG] [LOCAL ] SVV: Primary data saved (28889 records). [2025-09-14T20:13:10.976230] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-14T20:13:10.976331] [INFO ] [MAIN ] Update Progress: 2033/2370 symbols completed. SVV took 27.4s. Estimated remaining: 35m 48s. Rate: 9.4 symbols/min [2025-09-14T20:13:11.145370] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:11.163825] [DEBUG] [LOCAL ] SXC: Loaded 18896 existing records from primary storage. [2025-09-14T20:13:11.163998] [INFO ] [MAIN ] SXC: Loaded 18896 existing records. [2025-09-14T20:13:11.349528] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:11.350012] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-14T20:13:11.350164] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-14T20:13:11.350622] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-14T20:13:11.350839] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-14T20:13:11.709062] [INFO ] [REMOTE ] SXC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:11.726135] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T20:13:11.748303] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-14T20:13:11.759003] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-14T20:13:12.558883] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-14T20:13:13.274337] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T20:13:13.358906] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-14T20:13:14.158902] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-14T20:13:14.595701] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T20:13:14.595285] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T20:13:14.958836] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-14T20:13:15.758847] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-14T20:13:15.969558] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T20:13:16.378586] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T20:13:16.558873] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-14T20:13:17.069728] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T20:13:17.358832] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-14T20:13:17.540871] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T20:13:17.792788] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-14T20:13:18.158829] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-14T20:13:18.887015] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T20:13:18.958898] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-14T20:13:19.758914] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-14T20:13:20.558894] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-14T20:13:20.640772] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T20:13:21.337262] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T20:13:21.358773] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-14T20:13:21.702921] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T20:13:21.875011] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T20:13:21.876059] [INFO ] [REMOTE ] SWZ: Full fetch complete (6584 records). [2025-09-14T20:13:21.876144] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-14T20:13:22.168143] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-14T20:13:22.257450] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-14T20:13:22.257567] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-14T20:13:22.257832] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-14T20:13:22.257888] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-14T20:13:22.258325] [DEBUG] [LOCAL ] SWZ: Trimmed 6584 records to 4684 (keeping 150 days of data) [2025-09-14T20:13:22.288897] [DEBUG] [LOCAL ] SWZ: Primary data saved (4684 records). [2025-09-14T20:13:22.289091] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-14T20:13:22.289240] [INFO ] [MAIN ] Update Progress: 2034/2370 symbols completed. SWZ took 13.3s. Estimated remaining: 35m 43s. Rate: 9.4 symbols/min [2025-09-14T20:13:22.459878] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:22.469813] [DEBUG] [LOCAL ] SXI: Loaded 5817 existing records from primary storage. [2025-09-14T20:13:22.470023] [INFO ] [MAIN ] SXI: Loaded 5817 existing records. [2025-09-14T20:13:22.650490] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:22.650785] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-14T20:13:22.650846] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-14T20:13:22.651161] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-14T20:13:22.651223] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-14T20:13:22.968596] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-14T20:13:23.008198] [INFO ] [REMOTE ] SXI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:23.758841] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-14T20:13:24.066707] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T20:13:24.426437] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T20:13:24.558862] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-14T20:13:24.744483] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T20:13:25.358897] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-14T20:13:26.126829] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T20:13:26.158782] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-14T20:13:26.942663] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T20:13:26.958776] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-14T20:13:27.539403] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T20:13:27.758841] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-14T20:13:28.558831] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-14T20:13:28.629590] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T20:13:28.717160] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T20:13:29.358831] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-14T20:13:29.443889] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:13:30.068039] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:13:30.073449] [INFO ] [REMOTE ] SWK: Full fetch complete (56892 records). [2025-09-14T20:13:30.073584] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-14T20:13:30.163887] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-14T20:13:30.456255] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-14T20:13:30.456365] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-14T20:13:30.457408] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-14T20:13:30.457466] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-14T20:13:30.458686] [DEBUG] [LOCAL ] SWK: Trimmed 56892 records to 39632 (keeping 150 days of data) [2025-09-14T20:13:30.715140] [DEBUG] [LOCAL ] SWK: Primary data saved (39632 records). [2025-09-14T20:13:30.715336] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-14T20:13:30.715453] [INFO ] [MAIN ] Update Progress: 2035/2370 symbols completed. SWK took 30.4s. Estimated remaining: 35m 37s. Rate: 9.4 symbols/min [2025-09-14T20:13:30.889196] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:30.904901] [DEBUG] [LOCAL ] SXT: Loaded 13528 existing records from primary storage. [2025-09-14T20:13:30.905070] [INFO ] [MAIN ] SXT: Loaded 13528 existing records. [2025-09-14T20:13:30.966826] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-14T20:13:31.085813] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:31.086114] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-14T20:13:31.086191] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-14T20:13:31.086603] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-14T20:13:31.086684] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-14T20:13:31.433255] [INFO ] [REMOTE ] SXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:31.605558] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T20:13:31.758792] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-14T20:13:32.564038] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-14T20:13:32.584684] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T20:13:32.633011] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T20:13:33.358825] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-14T20:13:33.622761] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T20:13:34.158820] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-14T20:13:34.239523] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T20:13:34.847519] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T20:13:34.851089] [INFO ] [REMOTE ] SWX: Full fetch complete (33828 records). [2025-09-14T20:13:34.851201] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-14T20:13:34.963912] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-14T20:13:35.230916] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-14T20:13:35.231025] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-14T20:13:35.231764] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-14T20:13:35.231820] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-14T20:13:35.232725] [DEBUG] [LOCAL ] SWX: Trimmed 33828 records to 23449 (keeping 150 days of data) [2025-09-14T20:13:35.392009] [DEBUG] [LOCAL ] SWX: Primary data saved (23449 records). [2025-09-14T20:13:35.392211] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-14T20:13:35.392343] [INFO ] [MAIN ] Update Progress: 2036/2370 symbols completed. SWX took 28.7s. Estimated remaining: 35m 30s. Rate: 9.4 symbols/min [2025-09-14T20:13:35.564580] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:35.588168] [DEBUG] [LOCAL ] SYF: Loaded 23918 existing records from primary storage. [2025-09-14T20:13:35.588374] [INFO ] [MAIN ] SYF: Loaded 23918 existing records. [2025-09-14T20:13:35.764155] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-14T20:13:35.771334] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:35.771600] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-14T20:13:35.771681] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-14T20:13:35.772367] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-14T20:13:35.772431] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-14T20:13:36.129903] [INFO ] [REMOTE ] SYF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:36.237800] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T20:13:36.558853] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-14T20:13:36.723606] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T20:13:37.358854] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-14T20:13:37.803679] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T20:13:38.158905] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-14T20:13:38.681967] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T20:13:38.958860] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-14T20:13:39.758824] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-14T20:13:39.862550] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T20:13:39.909443] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T20:13:40.135467] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T20:13:40.139773] [INFO ] [REMOTE ] SXC: Full fetch complete (45694 records). [2025-09-14T20:13:40.139894] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-14T20:13:40.522607] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-14T20:13:40.522730] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-14T20:13:40.523797] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-14T20:13:40.523871] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-14T20:13:40.525016] [DEBUG] [LOCAL ] SXC: Trimmed 45694 records to 30976 (keeping 150 days of data) [2025-09-14T20:13:40.579305] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-14T20:13:40.736128] [DEBUG] [LOCAL ] SXC: Primary data saved (30976 records). [2025-09-14T20:13:40.736340] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-14T20:13:40.736471] [INFO ] [MAIN ] Update Progress: 2037/2370 symbols completed. SXC took 29.8s. Estimated remaining: 35m 23s. Rate: 9.4 symbols/min [2025-09-14T20:13:41.358856] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-14T20:13:41.846430] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T20:13:41.848253] [INFO ] [REMOTE ] SXI: Full fetch complete (11906 records). [2025-09-14T20:13:41.848362] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-14T20:13:42.172715] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-14T20:13:42.209475] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-14T20:13:42.209624] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-14T20:13:42.210778] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-14T20:13:42.210949] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-14T20:13:42.211969] [DEBUG] [LOCAL ] SXI: Trimmed 11906 records to 8735 (keeping 150 days of data) [2025-09-14T20:13:42.274352] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T20:13:42.299995] [DEBUG] [LOCAL ] SXI: Primary data saved (8735 records). [2025-09-14T20:13:42.300171] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-14T20:13:42.300300] [INFO ] [MAIN ] Update Progress: 2038/2370 symbols completed. SXI took 20.0s. Estimated remaining: 35m 16s. Rate: 9.4 symbols/min [2025-09-14T20:13:42.958836] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-14T20:13:44.103052] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T20:13:44.114596] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-14T20:13:44.241907] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T20:13:44.558844] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-14T20:13:45.707910] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T20:13:45.713965] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-14T20:13:45.938912] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T20:13:46.158838] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-14T20:13:46.771750] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T20:13:46.958903] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-14T20:13:48.043500] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T20:13:48.055576] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-14T20:13:48.220034] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T20:13:48.558888] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-14T20:13:49.201982] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T20:13:49.205614] [INFO ] [REMOTE ] SXT: Full fetch complete (30436 records). [2025-09-14T20:13:49.205750] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-14T20:13:49.568462] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-14T20:13:49.568575] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-14T20:13:49.569295] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-14T20:13:49.569353] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-14T20:13:49.570161] [DEBUG] [LOCAL ] SXT: Trimmed 30436 records to 21970 (keeping 150 days of data) [2025-09-14T20:13:49.717089] [DEBUG] [LOCAL ] SXT: Primary data saved (21970 records). [2025-09-14T20:13:49.717256] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-14T20:13:49.717359] [INFO ] [MAIN ] Update Progress: 2039/2370 symbols completed. SXT took 19.0s. Estimated remaining: 35m 10s. Rate: 9.4 symbols/min [2025-09-14T20:13:49.813175] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T20:13:49.824175] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-14T20:13:51.828834] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T20:13:51.843846] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-14T20:13:53.855409] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T20:13:53.868379] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-14T20:13:54.592160] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:13:54.597968] [INFO ] [REMOTE ] SYF: Full fetch complete (58134 records). [2025-09-14T20:13:54.598092] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-14T20:13:55.004252] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-14T20:13:55.004422] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-14T20:13:55.007615] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-14T20:13:55.007717] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-14T20:13:55.010248] [DEBUG] [LOCAL ] SYF: Trimmed 58134 records to 40224 (keeping 150 days of data) [2025-09-14T20:13:55.289796] [DEBUG] [LOCAL ] SYF: Primary data saved (40224 records). [2025-09-14T20:13:55.289995] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-14T20:13:55.290127] [INFO ] [MAIN ] Update Progress: 2040/2370 symbols completed. SYF took 19.9s. Estimated remaining: 35m 4s. Rate: 9.4 symbols/min [2025-09-14T20:13:56.050800] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:56.086958] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:56.102294] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:56.129854] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:13:56.196055] [DEBUG] [LOCAL ] T: Loaded 24158 existing records from primary storage. [2025-09-14T20:13:56.194430] [DEBUG] [LOCAL ] TAC: Loaded 18822 existing records from primary storage. [2025-09-14T20:13:56.196422] [INFO ] [MAIN ] TAC: Loaded 18822 existing records. [2025-09-14T20:13:56.207884] [INFO ] [MAIN ] T: Loaded 24158 existing records. [2025-09-14T20:13:56.346773] [DEBUG] [LOCAL ] SYY: Loaded 23716 existing records from primary storage. [2025-09-14T20:13:56.347151] [DEBUG] [LOCAL ] SYK: Loaded 20514 existing records from primary storage. [2025-09-14T20:13:56.397080] [INFO ] [MAIN ] SYY: Loaded 23716 existing records. [2025-09-14T20:13:56.421773] [INFO ] [MAIN ] SYK: Loaded 20514 existing records. [2025-09-14T20:13:56.697608] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:56.835897] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:56.879659] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-14T20:13:56.905426] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:56.896687] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-14T20:13:56.980200] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-14T20:13:56.954255] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-14T20:13:56.986378] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:13:56.986193] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-14T20:13:56.980584] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-14T20:13:56.986147] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-14T20:13:56.986746] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-14T20:13:56.992234] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-14T20:13:56.999086] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-14T20:13:57.010325] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-14T20:13:57.025190] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-14T20:13:57.030782] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-14T20:13:57.114705] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-14T20:13:57.236538] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-14T20:13:57.274113] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-14T20:13:58.193530] [INFO ] [REMOTE ] TAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:58.285801] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-14T20:13:58.396806] [INFO ] [REMOTE ] SYY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:58.464314] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-14T20:13:58.551049] [INFO ] [REMOTE ] T: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:58.562442] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-14T20:13:58.636469] [INFO ] [REMOTE ] SYK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:13:58.636956] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-14T20:13:59.970913] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T20:13:59.980593] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-14T20:14:00.332429] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T20:14:00.343106] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-14T20:14:00.493196] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T20:14:00.503419] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-14T20:14:00.556723] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T20:14:00.566498] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-14T20:14:02.026283] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-14T20:14:02.036474] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-14T20:14:02.606597] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T20:14:02.617882] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-14T20:14:02.811419] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-14T20:14:02.822731] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-14T20:14:03.042471] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-14T20:14:03.054001] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-14T20:14:04.361867] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T20:14:04.373687] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-14T20:14:04.410038] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-14T20:14:04.419878] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-14T20:14:04.879671] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T20:14:04.890414] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-14T20:14:05.380453] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T20:14:05.391886] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-14T20:14:06.005575] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T20:14:06.014470] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-14T20:14:06.120717] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T20:14:06.132121] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-14T20:14:06.369989] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T20:14:06.380540] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-14T20:14:07.265167] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T20:14:07.279692] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-14T20:14:07.739985] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T20:14:07.758781] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-14T20:14:07.948653] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T20:14:08.356089] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-14T20:14:08.558914] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-14T20:14:09.358894] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-14T20:14:09.535237] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T20:14:09.637714] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-14T20:14:10.158823] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-14T20:14:10.457673] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T20:14:10.958865] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-14T20:14:11.438492] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T20:14:11.758912] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-14T20:14:12.558960] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-14T20:14:12.693502] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T20:14:12.822294] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-14T20:14:13.358908] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-14T20:14:13.454402] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T20:14:14.027816] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:14:14.033356] [INFO ] [REMOTE ] SYK: Full fetch complete (51393 records). [2025-09-14T20:14:14.033463] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-14T20:14:14.164082] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-14T20:14:14.422093] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-14T20:14:14.422310] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-14T20:14:14.423954] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-14T20:14:14.424029] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-14T20:14:14.425356] [DEBUG] [LOCAL ] SYK: Trimmed 51393 records to 34829 (keeping 150 days of data) [2025-09-14T20:14:14.564902] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T20:14:14.694079] [DEBUG] [LOCAL ] SYK: Primary data saved (34829 records). [2025-09-14T20:14:14.694259] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-14T20:14:14.694409] [INFO ] [MAIN ] Update Progress: 2041/2370 symbols completed. SYK took 19.4s. Estimated remaining: 34m 59s. Rate: 9.4 symbols/min [2025-09-14T20:14:14.865147] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:14:14.888444] [DEBUG] [LOCAL ] TAK: Loaded 22806 existing records from primary storage. [2025-09-14T20:14:14.888616] [INFO ] [MAIN ] TAK: Loaded 22806 existing records. [2025-09-14T20:14:14.963964] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-14T20:14:15.071865] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:14:15.072185] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-14T20:14:15.072249] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-14T20:14:15.072797] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-14T20:14:15.072858] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-14T20:14:15.424013] [INFO ] [REMOTE ] TAK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:14:15.758879] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-14T20:14:15.879164] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T20:14:15.885272] [INFO ] [REMOTE ] SYY: Full fetch complete (57918 records). [2025-09-14T20:14:15.885398] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-14T20:14:16.266434] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-14T20:14:16.266565] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-14T20:14:16.267636] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-14T20:14:16.267706] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-14T20:14:16.268977] [DEBUG] [LOCAL ] SYY: Trimmed 57918 records to 40074 (keeping 150 days of data) [2025-09-14T20:14:16.533717] [DEBUG] [LOCAL ] SYY: Primary data saved (40074 records). [2025-09-14T20:14:16.533874] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-14T20:14:16.534009] [INFO ] [MAIN ] Update Progress: 2042/2370 symbols completed. SYY took 21.2s. Estimated remaining: 34m 52s. Rate: 9.4 symbols/min [2025-09-14T20:14:16.565971] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-14T20:14:16.707914] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:14:16.734480] [DEBUG] [LOCAL ] TAL: Loaded 23086 existing records from primary storage. [2025-09-14T20:14:16.734706] [INFO ] [MAIN ] TAL: Loaded 23086 existing records. [2025-09-14T20:14:16.913949] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:14:16.914339] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-14T20:14:16.925209] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-14T20:14:16.944004] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-14T20:14:16.944085] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-14T20:14:16.945151] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-14T20:14:17.314150] [INFO ] [REMOTE ] TAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:14:17.339803] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T20:14:17.358777] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-14T20:14:17.738869] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T20:14:17.744062] [INFO ] [REMOTE ] TAC: Full fetch complete (47332 records). [2025-09-14T20:14:17.744242] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-14T20:14:18.134825] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-14T20:14:18.134970] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-14T20:14:18.136354] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-14T20:14:18.136417] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-14T20:14:18.137784] [DEBUG] [LOCAL ] TAC: Trimmed 47332 records to 31713 (keeping 150 days of data) [2025-09-14T20:14:18.202561] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-14T20:14:18.354370] [DEBUG] [LOCAL ] TAC: Primary data saved (31713 records). [2025-09-14T20:14:18.354572] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-14T20:14:18.354706] [INFO ] [MAIN ] Update Progress: 2043/2370 symbols completed. TAC took 23.1s. Estimated remaining: 34m 45s. Rate: 9.4 symbols/min [2025-09-14T20:14:18.534826] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:14:18.558575] [DEBUG] [LOCAL ] TALO: Loaded 23002 existing records from primary storage. [2025-09-14T20:14:18.558799] [INFO ] [MAIN ] TALO: Loaded 23002 existing records. [2025-09-14T20:14:18.738374] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:14:18.738773] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-14T20:14:18.738836] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-14T20:14:18.739345] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-14T20:14:18.739404] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-14T20:14:18.966749] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-14T20:14:19.094390] [INFO ] [REMOTE ] TALO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:14:19.110316] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T20:14:19.116468] [INFO ] [REMOTE ] T: Full fetch complete (58478 records). [2025-09-14T20:14:19.116661] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-14T20:14:19.271888] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T20:14:19.541266] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-14T20:14:19.541402] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-14T20:14:19.542543] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-14T20:14:19.542613] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-14T20:14:19.544062] [DEBUG] [LOCAL ] T: Trimmed 58478 records to 40538 (keeping 150 days of data) [2025-09-14T20:14:19.771491] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-14T20:14:19.812615] [DEBUG] [LOCAL ] T: Primary data saved (40538 records). [2025-09-14T20:14:19.812787] [INFO ] [MAIN ] T: Full history saved. [2025-09-14T20:14:19.812889] [INFO ] [MAIN ] Update Progress: 2044/2370 symbols completed. T took 24.5s. Estimated remaining: 34m 38s. Rate: 9.4 symbols/min [2025-09-14T20:14:19.985884] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:14:20.009221] [DEBUG] [LOCAL ] TAP: Loaded 23646 existing records from primary storage. [2025-09-14T20:14:20.009394] [INFO ] [MAIN ] TAP: Loaded 23646 existing records. [2025-09-14T20:14:20.195325] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:14:20.195732] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-14T20:14:20.195797] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-14T20:14:20.196340] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-14T20:14:20.196400] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-14T20:14:20.573402] [INFO ] [REMOTE ] TAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:14:20.567199] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-14T20:14:20.899941] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T20:14:21.191814] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T20:14:21.358804] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-14T20:14:21.951618] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T20:14:22.158887] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-14T20:14:22.958883] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-14T20:14:23.192053] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T20:14:23.758827] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-14T20:14:23.954309] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T20:14:24.558840] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-14T20:14:24.854211] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T20:14:25.306402] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T20:14:25.358796] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-14T20:14:26.158832] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-14T20:14:26.207290] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T20:14:26.944311] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T20:14:26.958772] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-14T20:14:27.758823] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-14T20:14:28.053089] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T20:14:28.558890] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-14T20:14:28.927613] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T20:14:29.170538] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T20:14:29.358818] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-14T20:14:30.158816] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-14T20:14:30.509055] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T20:14:30.958899] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-14T20:14:31.285227] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T20:14:31.758859] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-14T20:14:31.845086] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T20:14:32.558845] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-14T20:14:32.745815] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T20:14:33.279380] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T20:14:33.358763] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-14T20:14:34.158844] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-14T20:14:34.429849] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T20:14:34.958854] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-14T20:14:35.187137] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T20:14:35.700616] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T20:14:35.705941] [INFO ] [REMOTE ] TALO: Full fetch complete (55169 records). [2025-09-14T20:14:35.706079] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-14T20:14:35.768916] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-14T20:14:36.089764] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-14T20:14:36.090160] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-14T20:14:36.091543] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-14T20:14:36.091713] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-14T20:14:36.103587] [DEBUG] [LOCAL ] TALO: Trimmed 55169 records to 38386 (keeping 150 days of data) [2025-09-14T20:14:36.124507] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T20:14:36.366160] [DEBUG] [LOCAL ] TALO: Primary data saved (38386 records). [2025-09-14T20:14:36.366346] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-14T20:14:36.366471] [INFO ] [MAIN ] Update Progress: 2045/2370 symbols completed. TALO took 18.0s. Estimated remaining: 34m 33s. Rate: 9.4 symbols/min [2025-09-14T20:14:36.538507] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:14:36.545627] [DEBUG] [LOCAL ] TBB: Loaded 5145 existing records from primary storage. [2025-09-14T20:14:36.545808] [INFO ] [MAIN ] TBB: Loaded 5145 existing records. [2025-09-14T20:14:36.566274] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-14T20:14:36.731907] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:14:36.732207] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-14T20:14:36.732270] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-14T20:14:36.732585] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-14T20:14:36.732672] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-14T20:14:37.087288] [INFO ] [REMOTE ] TBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:14:37.358908] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-14T20:14:37.676164] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T20:14:38.158856] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-14T20:14:38.681025] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T20:14:38.777519] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T20:14:38.784331] [INFO ] [REMOTE ] TAK: Full fetch complete (53931 records). [2025-09-14T20:14:38.784577] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-14T20:14:38.993566] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-14T20:14:39.240785] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-14T20:14:39.240917] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-14T20:14:39.241979] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-14T20:14:39.242048] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-14T20:14:39.243520] [DEBUG] [LOCAL ] TAK: Trimmed 53931 records to 37882 (keeping 150 days of data) [2025-09-14T20:14:39.481476] [DEBUG] [LOCAL ] TAK: Primary data saved (37882 records). [2025-09-14T20:14:39.481697] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-14T20:14:39.481821] [INFO ] [MAIN ] Update Progress: 2046/2370 symbols completed. TAK took 24.8s. Estimated remaining: 34m 26s. Rate: 9.4 symbols/min [2025-09-14T20:14:39.653737] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:14:39.669822] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T20:14:39.675753] [INFO ] [REMOTE ] TAL: Full fetch complete (56883 records). [2025-09-14T20:14:39.675952] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-14T20:14:39.765367] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-14T20:14:39.802484] [DEBUG] [LOCAL ] TBBB: Loaded 15613 existing records from primary storage. [2025-09-14T20:14:39.818769] [INFO ] [MAIN ] TBBB: Loaded 15613 existing records. [2025-09-14T20:14:40.292390] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:14:40.292696] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-14T20:14:40.293123] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-14T20:14:40.293027] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-14T20:14:40.293216] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-14T20:14:40.294674] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-14T20:14:40.294789] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-14T20:14:40.295117] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-14T20:14:40.295198] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-14T20:14:40.396234] [DEBUG] [LOCAL ] TAL: Trimmed 56883 records to 39020 (keeping 150 days of data) [2025-09-14T20:14:40.710455] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T20:14:40.757475] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-14T20:14:40.785853] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:14:40.951314] [DEBUG] [LOCAL ] TAL: Primary data saved (39020 records). [2025-09-14T20:14:40.951524] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-14T20:14:40.951663] [INFO ] [MAIN ] Update Progress: 2047/2370 symbols completed. TAL took 24.4s. Estimated remaining: 34m 19s. Rate: 9.4 symbols/min [2025-09-14T20:14:41.123542] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:14:41.134173] [DEBUG] [LOCAL ] TBI: Loaded 9038 existing records from primary storage. [2025-09-14T20:14:41.134339] [INFO ] [MAIN ] TBI: Loaded 9038 existing records. [2025-09-14T20:14:41.351234] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:14:41.354175] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-14T20:14:41.354427] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-14T20:14:41.365303] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-14T20:14:41.354633] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-14T20:14:41.367119] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-14T20:14:41.367243] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-14T20:14:41.643976] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:14:41.776948] [INFO ] [REMOTE ] TBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:14:42.158884] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-14T20:14:42.800299] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T20:14:42.889356] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T20:14:42.958856] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-14T20:14:43.758901] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-14T20:14:43.872201] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T20:14:44.558902] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-14T20:14:45.293231] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T20:14:45.358853] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-14T20:14:45.795181] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T20:14:46.158860] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-14T20:14:46.945743] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T20:14:46.958764] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-14T20:14:47.420002] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T20:14:47.758867] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-14T20:14:48.360113] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T20:14:48.558908] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-14T20:14:48.643624] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T20:14:49.358851] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-14T20:14:50.158875] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-14T20:14:50.195335] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T20:14:50.395812] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T20:14:50.958888] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-14T20:14:51.176366] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T20:14:51.758924] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-14T20:14:52.558817] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-14T20:14:52.755134] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T20:14:52.916103] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T20:14:53.106423] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T20:14:53.358834] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-14T20:14:54.158900] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-14T20:14:54.958890] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-14T20:14:55.057122] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T20:14:55.136156] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T20:14:55.758794] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-14T20:14:55.868690] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T20:14:56.558847] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-14T20:14:56.908789] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T20:14:57.358911] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-14T20:14:57.801220] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T20:14:57.868211] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T20:14:57.869913] [INFO ] [REMOTE ] TBB: Full fetch complete (12380 records). [2025-09-14T20:14:57.870006] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-14T20:14:58.164321] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-14T20:14:58.247489] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-14T20:14:58.247628] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-14T20:14:58.248000] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-14T20:14:58.248079] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-14T20:14:58.248893] [DEBUG] [LOCAL ] TBB: Trimmed 12380 records to 8605 (keeping 150 days of data) [2025-09-14T20:14:58.309669] [DEBUG] [LOCAL ] TBB: Primary data saved (8605 records). [2025-09-14T20:14:58.309868] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-14T20:14:58.310068] [INFO ] [MAIN ] Update Progress: 2048/2370 symbols completed. TBB took 21.9s. Estimated remaining: 34m 14s. Rate: 9.4 symbols/min [2025-09-14T20:14:58.479374] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:14:58.481990] [DEBUG] [LOCAL ] TBLU: Loaded 363 existing records from primary storage. [2025-09-14T20:14:58.482076] [INFO ] [MAIN ] TBLU: Loaded 363 existing records. [2025-09-14T20:14:58.655279] [WARN ] [MAIN ] TBLU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:14:58.655548] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-14T20:14:58.655608] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-14T20:14:58.659254] [DEBUG] [LOCAL ] TBLU: Deleted primary data file. [2025-09-14T20:14:58.659324] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-14T20:14:58.970929] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-14T20:14:59.008385] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:14:59.553854] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T20:14:59.758821] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-14T20:15:00.081826] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T20:15:00.229880] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T20:15:00.236075] [INFO ] [REMOTE ] TAP: Full fetch complete (57462 records). [2025-09-14T20:15:00.236360] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-14T20:15:00.564184] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-14T20:15:00.648929] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-14T20:15:00.649086] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-14T20:15:00.650800] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-14T20:15:00.650880] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-14T20:15:00.653079] [DEBUG] [LOCAL ] TAP: Trimmed 57462 records to 39854 (keeping 150 days of data) [2025-09-14T20:15:00.936717] [DEBUG] [LOCAL ] TAP: Primary data saved (39854 records). [2025-09-14T20:15:00.937044] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-14T20:15:00.937196] [INFO ] [MAIN ] Update Progress: 2049/2370 symbols completed. TAP took 41.1s. Estimated remaining: 34m 7s. Rate: 9.4 symbols/min [2025-09-14T20:15:01.119780] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:01.123913] [DEBUG] [LOCAL ] TBN: Loaded 1487 existing records from primary storage. [2025-09-14T20:15:01.124039] [INFO ] [MAIN ] TBN: Loaded 1487 existing records. [2025-09-14T20:15:01.312064] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:01.312458] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-14T20:15:01.312538] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-14T20:15:01.313017] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-14T20:15:01.313096] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-14T20:15:01.364097] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-14T20:15:01.734073] [INFO ] [REMOTE ] TBN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:01.898477] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T20:15:01.901949] [INFO ] [REMOTE ] TBI: Full fetch complete (24742 records). [2025-09-14T20:15:01.902229] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-14T20:15:02.169288] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-14T20:15:02.330864] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-14T20:15:02.331065] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-14T20:15:02.331942] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-14T20:15:02.332015] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-14T20:15:02.333402] [DEBUG] [LOCAL ] TBI: Trimmed 24742 records to 16675 (keeping 150 days of data) [2025-09-14T20:15:02.440166] [DEBUG] [LOCAL ] TBI: Primary data saved (16675 records). [2025-09-14T20:15:02.440433] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-14T20:15:02.440587] [INFO ] [MAIN ] Update Progress: 2050/2370 symbols completed. TBI took 21.5s. Estimated remaining: 34m 0s. Rate: 9.4 symbols/min [2025-09-14T20:15:02.653017] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:02.656370] [DEBUG] [LOCAL ] TCAI: Loaded 696 existing records from primary storage. [2025-09-14T20:15:02.656522] [INFO ] [MAIN ] TCAI: Loaded 696 existing records. [2025-09-14T20:15:02.853478] [WARN ] [MAIN ] TCAI: Insufficient historical data. Have data from 2025-08-05, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:02.853878] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-14T20:15:02.853947] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-14T20:15:02.854389] [DEBUG] [LOCAL ] TCAI: Deleted primary data file. [2025-09-14T20:15:02.854458] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-14T20:15:02.969977] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-14T20:15:03.259404] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:03.758918] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-14T20:15:05.384450] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-09-14T20:15:05.386472] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-14T20:15:05.779562] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:15:05.780212] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-14T20:15:05.780886] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-14T20:15:06.079737] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (3.11 seconds). [2025-09-14T20:15:06.158925] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-14T20:15:06.219631] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (4.86 seconds). [2025-09-14T20:15:06.224507] [INFO ] [REMOTE ] TBBB: Full fetch complete (40319 records). [2025-09-14T20:15:06.224840] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-14T20:15:06.632551] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-14T20:15:06.632748] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-14T20:15:06.634610] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-14T20:15:06.634724] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-14T20:15:06.636125] [DEBUG] [LOCAL ] TBBB: Trimmed 40319 records to 26664 (keeping 150 days of data) [2025-09-14T20:15:06.701371] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:15:06.729276] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-14T20:15:06.825629] [DEBUG] [LOCAL ] TBBB: Primary data saved (26664 records). [2025-09-14T20:15:06.825881] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-14T20:15:06.826009] [INFO ] [MAIN ] Update Progress: 2051/2370 symbols completed. TBBB took 27.3s. Estimated remaining: 33m 54s. Rate: 9.4 symbols/min [2025-09-14T20:15:06.931880] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T20:15:06.963998] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-14T20:15:07.011217] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:07.018511] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T20:15:07.045464] [DEBUG] [LOCAL ] TD: Loaded 23298 existing records from primary storage. [2025-09-14T20:15:07.045816] [INFO ] [MAIN ] TD: Loaded 23298 existing records. [2025-09-14T20:15:07.242010] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:07.242449] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-14T20:15:07.242526] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-14T20:15:07.243231] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-14T20:15:07.243304] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-14T20:15:07.310526] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:15:07.349067] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-14T20:15:07.616031] [INFO ] [REMOTE ] TD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:07.758889] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-14T20:15:08.080963] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:15:08.081424] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-14T20:15:08.558909] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-14T20:15:09.358872] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-14T20:15:09.533326] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T20:15:09.842683] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:15:09.843189] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-14T20:15:10.158872] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-14T20:15:10.907548] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:15:10.908047] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-14T20:15:10.958836] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-14T20:15:11.758912] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-14T20:15:12.002527] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T20:15:12.539505] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T20:15:12.558818] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-14T20:15:13.358882] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-14T20:15:13.638411] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T20:15:13.639572] [INFO ] [REMOTE ] TCAI: Full fetch complete (696 records). [2025-09-14T20:15:13.639687] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-14T20:15:13.837413] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 28 unique days, need 150 days [2025-09-14T20:15:13.837734] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:15:13.837798] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:15:13.837856] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-14T20:15:13.837943] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-14T20:15:13.837990] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-14T20:15:13.838052] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-14T20:15:13.838144] [INFO ] [MAIN ] Update Progress: 2052/2370 symbols completed. TCAI took 11.4s. Estimated remaining: 33m 47s. Rate: 9.4 symbols/min [2025-09-14T20:15:13.999232] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T20:15:14.018113] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:14.042898] [DEBUG] [LOCAL ] TDC: Loaded 20612 existing records from primary storage. [2025-09-14T20:15:14.043186] [INFO ] [MAIN ] TDC: Loaded 20612 existing records. [2025-09-14T20:15:14.163900] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-14T20:15:14.230111] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:14.230402] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-14T20:15:14.230464] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-14T20:15:14.231118] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-14T20:15:14.231188] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-14T20:15:14.600197] [INFO ] [REMOTE ] TDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:14.958895] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-14T20:15:15.239437] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T20:15:15.758945] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-14T20:15:16.558892] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-14T20:15:16.625613] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T20:15:16.676899] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T20:15:17.358874] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-14T20:15:17.868889] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T20:15:18.158812] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-14T20:15:18.498128] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-14T20:15:18.751974] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T20:15:18.958873] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-14T20:15:19.447217] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-14T20:15:19.758875] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-14T20:15:20.558868] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-14T20:15:20.793050] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T20:15:21.358862] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-14T20:15:21.980626] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T20:15:22.158877] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-14T20:15:22.406815] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T20:15:22.794570] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T20:15:22.958864] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-14T20:15:23.758832] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-14T20:15:24.069293] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-14T20:15:24.072939] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T20:15:24.558859] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-14T20:15:25.358969] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-14T20:15:25.461154] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T20:15:25.818029] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-14T20:15:26.158845] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-14T20:15:26.576982] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-14T20:15:26.958830] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-14T20:15:27.603861] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T20:15:27.605030] [INFO ] [REMOTE ] TBN: Full fetch complete (3414 records). [2025-09-14T20:15:27.605133] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-14T20:15:27.765087] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-14T20:15:27.971623] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-14T20:15:27.971754] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-14T20:15:27.971926] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-14T20:15:27.971980] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-14T20:15:27.972364] [DEBUG] [LOCAL ] TBN: Trimmed 3414 records to 2041 (keeping 150 days of data) [2025-09-14T20:15:27.984863] [DEBUG] [LOCAL ] TBN: Primary data saved (2041 records). [2025-09-14T20:15:27.984965] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-14T20:15:27.985062] [INFO ] [MAIN ] Update Progress: 2053/2370 symbols completed. TBN took 27.0s. Estimated remaining: 33m 42s. Rate: 9.4 symbols/min [2025-09-14T20:15:28.157193] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:28.161906] [DEBUG] [LOCAL ] TDF: Loaded 2505 existing records from primary storage. [2025-09-14T20:15:28.162067] [INFO ] [MAIN ] TDF: Loaded 2505 existing records. [2025-09-14T20:15:28.345031] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:28.345368] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-14T20:15:28.345433] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-14T20:15:28.345713] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-14T20:15:28.345783] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-14T20:15:28.560902] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-14T20:15:28.719945] [INFO ] [REMOTE ] TDF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:28.734778] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T20:15:28.740594] [INFO ] [REMOTE ] TD: Full fetch complete (56866 records). [2025-09-14T20:15:28.740793] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-14T20:15:29.016348] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T20:15:29.049595] [INFO ] [REMOTE ] TBLU: Full fetch complete (908 records). [2025-09-14T20:15:29.052926] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-14T20:15:29.270581] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-14T20:15:29.286067] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-14T20:15:29.309501] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-14T20:15:29.327448] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-14T20:15:29.349551] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T20:15:29.349930] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:15:29.350050] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:15:29.350178] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-14T20:15:29.350343] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-14T20:15:29.350530] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-14T20:15:29.350600] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-14T20:15:29.350757] [INFO ] [MAIN ] Update Progress: 2054/2370 symbols completed. TBLU took 31.0s. Estimated remaining: 33m 35s. Rate: 9.4 symbols/min [2025-09-14T20:15:29.350855] [DEBUG] [LOCAL ] TD: Trimmed 56866 records to 39289 (keeping 150 days of data) [2025-09-14T20:15:29.362414] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-14T20:15:29.660937] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:29.731924] [DEBUG] [LOCAL ] TDG: Loaded 9920 existing records from primary storage. [2025-09-14T20:15:29.741687] [INFO ] [MAIN ] TDG: Loaded 9920 existing records. [2025-09-14T20:15:29.955832] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:29.956922] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-14T20:15:29.956986] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-14T20:15:29.957471] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-14T20:15:29.957537] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-14T20:15:30.176874] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-14T20:15:30.334936] [INFO ] [REMOTE ] TDG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:30.348683] [DEBUG] [LOCAL ] TD: Primary data saved (39289 records). [2025-09-14T20:15:30.348863] [INFO ] [MAIN ] TD: Full history saved. [2025-09-14T20:15:30.348984] [INFO ] [MAIN ] Update Progress: 2055/2370 symbols completed. TD took 23.5s. Estimated remaining: 33m 28s. Rate: 9.4 symbols/min [2025-09-14T20:15:30.523221] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:30.546128] [DEBUG] [LOCAL ] TDOC: Loaded 23926 existing records from primary storage. [2025-09-14T20:15:30.546290] [INFO ] [MAIN ] TDOC: Loaded 23926 existing records. [2025-09-14T20:15:30.765758] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:30.766914] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T20:15:30.767139] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-14T20:15:30.769885] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-14T20:15:30.770517] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-14T20:15:30.770578] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-14T20:15:30.966024] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-14T20:15:31.124777] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:31.758837] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-14T20:15:31.992477] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T20:15:32.128247] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T20:15:32.558863] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-14T20:15:33.358803] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-14T20:15:33.753006] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T20:15:34.147742] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-14T20:15:34.158764] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-14T20:15:34.958831] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-14T20:15:35.048096] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T20:15:35.758904] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-14T20:15:36.105427] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T20:15:36.133808] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T20:15:36.558899] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-14T20:15:37.358930] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-14T20:15:37.390413] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T20:15:38.158846] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-14T20:15:38.512452] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T20:15:38.601148] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T20:15:38.958908] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-14T20:15:39.759385] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-14T20:15:39.765025] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T20:15:40.061464] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T20:15:40.549327] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T20:15:40.558763] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-14T20:15:41.359073] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-14T20:15:41.360521] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T20:15:42.158862] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-14T20:15:42.958883] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-14T20:15:43.054315] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T20:15:43.116102] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T20:15:43.758852] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-14T20:15:43.868816] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T20:15:44.558882] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-14T20:15:45.128589] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T20:15:45.215993] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T20:15:45.221337] [INFO ] [REMOTE ] TDC: Full fetch complete (51555 records). [2025-09-14T20:15:45.221564] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-14T20:15:45.372908] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-14T20:15:45.617485] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-14T20:15:45.617603] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-14T20:15:45.618695] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-14T20:15:45.618753] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-14T20:15:45.619991] [DEBUG] [LOCAL ] TDC: Trimmed 51555 records to 34553 (keeping 150 days of data) [2025-09-14T20:15:45.838553] [DEBUG] [LOCAL ] TDC: Primary data saved (34553 records). [2025-09-14T20:15:45.838744] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-14T20:15:45.838860] [INFO ] [MAIN ] Update Progress: 2056/2370 symbols completed. TDC took 32.0s. Estimated remaining: 33m 23s. Rate: 9.4 symbols/min [2025-09-14T20:15:46.014577] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:46.035500] [DEBUG] [LOCAL ] TDS: Loaded 19556 existing records from primary storage. [2025-09-14T20:15:46.035715] [INFO ] [MAIN ] TDS: Loaded 19556 existing records. [2025-09-14T20:15:46.174840] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-14T20:15:46.212459] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:46.212830] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-14T20:15:46.212900] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-14T20:15:46.213423] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-14T20:15:46.213497] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-14T20:15:46.570484] [INFO ] [REMOTE ] TDS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:46.826992] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T20:15:46.831478] [INFO ] [REMOTE ] TDG: Full fetch complete (24049 records). [2025-09-14T20:15:46.831606] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-14T20:15:46.973973] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-14T20:15:47.208327] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-14T20:15:47.208487] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-14T20:15:47.209141] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-14T20:15:47.209261] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-14T20:15:47.210375] [DEBUG] [LOCAL ] TDG: Trimmed 24049 records to 16298 (keeping 150 days of data) [2025-09-14T20:15:47.364140] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T20:15:47.379056] [DEBUG] [LOCAL ] TDG: Primary data saved (16298 records). [2025-09-14T20:15:47.379399] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-14T20:15:47.379559] [INFO ] [MAIN ] Update Progress: 2057/2370 symbols completed. TDG took 18.0s. Estimated remaining: 33m 16s. Rate: 9.4 symbols/min [2025-09-14T20:15:47.561221] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:47.583868] [DEBUG] [LOCAL ] TDW: Loaded 19710 existing records from primary storage. [2025-09-14T20:15:47.584057] [INFO ] [MAIN ] TDW: Loaded 19710 existing records. [2025-09-14T20:15:47.764738] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-14T20:15:47.776093] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:47.778364] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-14T20:15:47.778431] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-14T20:15:47.778978] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-14T20:15:47.779054] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-14T20:15:48.150411] [INFO ] [REMOTE ] TDW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:48.245821] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T20:15:48.502677] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T20:15:48.558868] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-14T20:15:49.243713] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T20:15:49.358876] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-14T20:15:50.158853] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-14T20:15:50.840307] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T20:15:50.958814] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-14T20:15:51.598960] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-14T20:15:51.758840] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-14T20:15:52.558865] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-14T20:15:52.605977] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T20:15:53.323145] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T20:15:53.324857] [INFO ] [REMOTE ] TDF: Full fetch complete (7504 records). [2025-09-14T20:15:53.324944] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-14T20:15:53.368491] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-14T20:15:53.690429] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-14T20:15:53.690816] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-14T20:15:53.691119] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-14T20:15:53.691183] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-14T20:15:53.691934] [DEBUG] [LOCAL ] TDF: Trimmed 7504 records to 4207 (keeping 150 days of data) [2025-09-14T20:15:53.718763] [DEBUG] [LOCAL ] TDF: Primary data saved (4207 records). [2025-09-14T20:15:53.718933] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-14T20:15:53.719136] [INFO ] [MAIN ] Update Progress: 2058/2370 symbols completed. TDF took 25.7s. Estimated remaining: 33m 9s. Rate: 9.4 symbols/min [2025-09-14T20:15:53.892899] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:53.929525] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T20:15:53.948130] [DEBUG] [LOCAL ] TDY: Loaded 9942 existing records from primary storage. [2025-09-14T20:15:53.948633] [INFO ] [MAIN ] TDY: Loaded 9942 existing records. [2025-09-14T20:15:54.125635] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:54.125946] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-14T20:15:54.126018] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-14T20:15:54.126349] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-14T20:15:54.126410] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-14T20:15:54.168880] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-14T20:15:54.484046] [INFO ] [REMOTE ] TDY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:54.916966] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T20:15:54.958890] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-14T20:15:55.758852] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-14T20:15:56.362755] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-14T20:15:56.558875] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-14T20:15:56.681768] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T20:15:57.333225] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T20:15:57.358782] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-14T20:15:58.158850] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-14T20:15:58.441403] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-14T20:15:58.450240] [INFO ] [REMOTE ] TDOC: Full fetch complete (58068 records). [2025-09-14T20:15:58.450464] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-14T20:15:58.850828] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-14T20:15:58.850957] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-14T20:15:58.852147] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-14T20:15:58.852215] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-14T20:15:58.853953] [DEBUG] [LOCAL ] TDOC: Trimmed 58068 records to 40156 (keeping 150 days of data) [2025-09-14T20:15:58.963588] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-14T20:15:58.984595] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T20:15:59.163398] [DEBUG] [LOCAL ] TDOC: Primary data saved (40156 records). [2025-09-14T20:15:59.163555] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-14T20:15:59.163718] [INFO ] [MAIN ] Update Progress: 2059/2370 symbols completed. TDOC took 28.8s. Estimated remaining: 33m 3s. Rate: 9.4 symbols/min [2025-09-14T20:15:59.332417] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:15:59.354932] [DEBUG] [LOCAL ] TE: Loaded 20378 existing records from primary storage. [2025-09-14T20:15:59.355100] [INFO ] [MAIN ] TE: Loaded 20378 existing records. [2025-09-14T20:15:59.532602] [WARN ] [MAIN ] TE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:15:59.533104] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-14T20:15:59.533164] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-14T20:15:59.533630] [DEBUG] [LOCAL ] TE: Deleted primary data file. [2025-09-14T20:15:59.533714] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-14T20:15:59.777693] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-14T20:15:59.896735] [INFO ] [REMOTE ] TE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:15:59.969092] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T20:16:00.011080] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T20:16:00.558900] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-14T20:16:01.159967] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:16:01.160399] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-14T20:16:01.358811] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-14T20:16:01.544993] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T20:16:02.158857] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-14T20:16:02.958795] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-14T20:16:03.392262] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T20:16:03.449699] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T20:16:03.758880] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-14T20:16:04.558837] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-14T20:16:04.776310] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T20:16:05.358843] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-14T20:16:05.414196] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T20:16:06.125228] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T20:16:06.158803] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-14T20:16:06.899942] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T20:16:06.958874] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-14T20:16:07.435847] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T20:16:07.758877] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-14T20:16:08.558861] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-14T20:16:09.025566] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T20:16:09.112667] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T20:16:09.358897] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-14T20:16:09.531024] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T20:16:10.158867] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-14T20:16:10.958854] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-14T20:16:11.252122] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T20:16:11.758871] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-14T20:16:11.883981] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T20:16:12.449274] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T20:16:12.454660] [INFO ] [REMOTE ] TDW: Full fetch complete (50004 records). [2025-09-14T20:16:12.454841] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-14T20:16:12.558903] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-14T20:16:12.846328] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-14T20:16:12.846511] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-14T20:16:12.847515] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-14T20:16:12.847610] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-14T20:16:12.848990] [DEBUG] [LOCAL ] TDW: Trimmed 50004 records to 33675 (keeping 150 days of data) [2025-09-14T20:16:12.971250] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T20:16:13.100047] [DEBUG] [LOCAL ] TDW: Primary data saved (33675 records). [2025-09-14T20:16:13.100244] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-14T20:16:13.100373] [INFO ] [MAIN ] Update Progress: 2060/2370 symbols completed. TDW took 25.7s. Estimated remaining: 32m 58s. Rate: 9.4 symbols/min [2025-09-14T20:16:13.272442] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:16:13.277323] [DEBUG] [LOCAL ] TEAF: Loaded 3083 existing records from primary storage. [2025-09-14T20:16:13.277428] [INFO ] [MAIN ] TEAF: Loaded 3083 existing records. [2025-09-14T20:16:13.367859] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-14T20:16:13.459979] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:16:13.460242] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-14T20:16:13.460306] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-14T20:16:13.460548] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-14T20:16:13.460607] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-14T20:16:13.827861] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:16:14.158883] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-14T20:16:14.486046] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T20:16:14.906792] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T20:16:14.958812] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-14T20:16:15.072878] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T20:16:15.745408] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T20:16:15.758773] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-14T20:16:16.558849] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-14T20:16:16.572039] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T20:16:17.358905] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-14T20:16:18.036573] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:16:18.043443] [INFO ] [REMOTE ] TDS: Full fetch complete (46853 records). [2025-09-14T20:16:18.043727] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-14T20:16:18.164036] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-14T20:16:18.516124] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-14T20:16:18.516309] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-14T20:16:18.517677] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-14T20:16:18.517946] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-14T20:16:18.549625] [DEBUG] [LOCAL ] TDS: Trimmed 46853 records to 32088 (keeping 150 days of data) [2025-09-14T20:16:18.551630] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T20:16:18.670667] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T20:16:18.781420] [DEBUG] [LOCAL ] TDS: Primary data saved (32088 records). [2025-09-14T20:16:18.781615] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-14T20:16:18.781756] [INFO ] [MAIN ] Update Progress: 2061/2370 symbols completed. TDS took 32.9s. Estimated remaining: 32m 51s. Rate: 9.4 symbols/min [2025-09-14T20:16:18.953292] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:16:18.958834] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-14T20:16:18.977504] [DEBUG] [LOCAL ] TECK: Loaded 23906 existing records from primary storage. [2025-09-14T20:16:18.977707] [INFO ] [MAIN ] TECK: Loaded 23906 existing records. [2025-09-14T20:16:19.156715] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:16:19.157005] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-14T20:16:19.157069] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-14T20:16:19.157739] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-14T20:16:19.157805] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-14T20:16:19.522484] [INFO ] [REMOTE ] TECK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:16:19.758840] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-14T20:16:20.520399] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T20:16:20.556787] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T20:16:20.561591] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-14T20:16:20.562558] [INFO ] [REMOTE ] TE: Full fetch complete (43977 records). [2025-09-14T20:16:20.563565] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-14T20:16:20.768149] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 135 unique days, need 150 days [2025-09-14T20:16:20.770869] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:16:20.770944] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:16:20.771002] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-14T20:16:20.771094] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-14T20:16:20.771155] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-14T20:16:20.771215] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-14T20:16:20.771351] [INFO ] [MAIN ] Update Progress: 2062/2370 symbols completed. TE took 21.6s. Estimated remaining: 32m 44s. Rate: 9.4 symbols/min [2025-09-14T20:16:20.947729] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:16:20.964525] [DEBUG] [LOCAL ] TEF: Loaded 15678 existing records from primary storage. [2025-09-14T20:16:20.964721] [INFO ] [MAIN ] TEF: Loaded 15678 existing records. [2025-09-14T20:16:21.150189] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:16:21.150474] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-14T20:16:21.150538] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-14T20:16:21.151071] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-14T20:16:21.151139] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-14T20:16:21.369114] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-14T20:16:21.503467] [INFO ] [REMOTE ] TEF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:16:22.158862] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-14T20:16:22.299975] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T20:16:22.884206] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T20:16:22.896231] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-14T20:16:22.958856] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-14T20:16:23.724091] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T20:16:23.758788] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-14T20:16:24.330176] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T20:16:24.331369] [INFO ] [REMOTE ] TEAF: Full fetch complete (7554 records). [2025-09-14T20:16:24.331453] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-14T20:16:24.564048] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-14T20:16:24.700452] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-14T20:16:24.700570] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-14T20:16:24.700804] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-14T20:16:24.700887] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-14T20:16:24.701418] [DEBUG] [LOCAL ] TEAF: Trimmed 7554 records to 5161 (keeping 150 days of data) [2025-09-14T20:16:24.735156] [DEBUG] [LOCAL ] TEAF: Primary data saved (5161 records). [2025-09-14T20:16:24.735343] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-14T20:16:24.735453] [INFO ] [MAIN ] Update Progress: 2063/2370 symbols completed. TEAF took 11.6s. Estimated remaining: 32m 37s. Rate: 9.4 symbols/min [2025-09-14T20:16:24.905989] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:16:24.916185] [DEBUG] [LOCAL ] TEI: Loaded 9568 existing records from primary storage. [2025-09-14T20:16:24.916323] [INFO ] [MAIN ] TEI: Loaded 9568 existing records. [2025-09-14T20:16:25.130584] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:16:25.130882] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-14T20:16:25.130943] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-14T20:16:25.131272] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-14T20:16:25.131329] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-14T20:16:25.363906] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-14T20:16:25.494070] [INFO ] [REMOTE ] TEI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:16:26.082890] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T20:16:26.158806] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-14T20:16:26.535541] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T20:16:26.958849] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-14T20:16:27.758837] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-14T20:16:28.255605] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T20:16:28.291947] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T20:16:28.319455] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T20:16:28.322176] [INFO ] [REMOTE ] TDY: Full fetch complete (24782 records). [2025-09-14T20:16:28.322292] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-14T20:16:28.564005] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-14T20:16:28.727412] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-14T20:16:28.727610] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-14T20:16:28.728614] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-14T20:16:28.728707] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-14T20:16:28.729734] [DEBUG] [LOCAL ] TDY: Trimmed 24782 records to 17017 (keeping 150 days of data) [2025-09-14T20:16:28.862604] [DEBUG] [LOCAL ] TDY: Primary data saved (17017 records). [2025-09-14T20:16:28.862908] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-14T20:16:28.863041] [INFO ] [MAIN ] Update Progress: 2064/2370 symbols completed. TDY took 35.1s. Estimated remaining: 32m 31s. Rate: 9.4 symbols/min [2025-09-14T20:16:29.040001] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:16:29.064713] [DEBUG] [LOCAL ] TEL: Loaded 22778 existing records from primary storage. [2025-09-14T20:16:29.064896] [INFO ] [MAIN ] TEL: Loaded 22778 existing records. [2025-09-14T20:16:29.239302] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:16:29.239568] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-14T20:16:29.239627] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-14T20:16:29.240367] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-14T20:16:29.240431] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-14T20:16:29.364038] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-14T20:16:29.605496] [INFO ] [REMOTE ] TEL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:16:30.158867] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-14T20:16:30.334513] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T20:16:30.689558] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T20:16:30.958849] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-14T20:16:31.758913] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-14T20:16:32.064038] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T20:16:32.558840] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-14T20:16:32.617417] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:16:32.682263] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T20:16:33.358837] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-14T20:16:34.158892] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-14T20:16:34.447481] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T20:16:34.475615] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T20:16:34.958846] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-14T20:16:35.621570] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T20:16:35.758857] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-14T20:16:36.558853] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-14T20:16:36.823514] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T20:16:36.914057] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-14T20:16:37.358865] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-14T20:16:38.151429] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T20:16:38.159227] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-14T20:16:38.336148] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T20:16:38.958919] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-14T20:16:39.758900] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-14T20:16:40.191741] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T20:16:40.442112] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T20:16:40.558867] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-14T20:16:40.645289] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T20:16:41.358957] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-14T20:16:41.979319] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T20:16:41.983802] [INFO ] [REMOTE ] TEF: Full fetch complete (40704 records). [2025-09-14T20:16:41.983953] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-14T20:16:42.160510] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-14T20:16:42.399917] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-14T20:16:42.400071] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-14T20:16:42.402036] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-14T20:16:42.402109] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-14T20:16:42.403502] [DEBUG] [LOCAL ] TEF: Trimmed 40704 records to 27245 (keeping 150 days of data) [2025-09-14T20:16:42.577810] [DEBUG] [LOCAL ] TEF: Primary data saved (27245 records). [2025-09-14T20:16:42.578036] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-14T20:16:42.578211] [INFO ] [MAIN ] Update Progress: 2065/2370 symbols completed. TEF took 21.8s. Estimated remaining: 32m 25s. Rate: 9.4 symbols/min [2025-09-14T20:16:42.777417] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:16:42.795170] [DEBUG] [LOCAL ] TEN: Loaded 14340 existing records from primary storage. [2025-09-14T20:16:42.795401] [INFO ] [MAIN ] TEN: Loaded 14340 existing records. [2025-09-14T20:16:42.962116] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-14T20:16:42.983316] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:16:42.984892] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-14T20:16:42.984965] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-14T20:16:42.985890] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-14T20:16:42.985958] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-14T20:16:43.386085] [INFO ] [REMOTE ] TEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:16:43.426110] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-14T20:16:43.486923] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T20:16:43.758911] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-14T20:16:44.086440] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T20:16:44.558959] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-14T20:16:45.054063] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T20:16:45.358896] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-14T20:16:46.158921] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-14T20:16:46.447771] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-14T20:16:46.453855] [INFO ] [REMOTE ] TECK: Full fetch complete (58108 records). [2025-09-14T20:16:46.454013] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-14T20:16:46.887846] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-14T20:16:46.888165] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-14T20:16:46.890062] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-14T20:16:46.890155] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-14T20:16:46.913172] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T20:16:46.920814] [DEBUG] [LOCAL ] TECK: Trimmed 58108 records to 40206 (keeping 150 days of data) [2025-09-14T20:16:46.980280] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-14T20:16:47.221228] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T20:16:47.242843] [DEBUG] [LOCAL ] TECK: Primary data saved (40206 records). [2025-09-14T20:16:47.243068] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-14T20:16:47.243255] [INFO ] [MAIN ] Update Progress: 2066/2370 symbols completed. TECK took 28.5s. Estimated remaining: 32m 19s. Rate: 9.4 symbols/min [2025-09-14T20:16:47.428342] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:16:47.439702] [DEBUG] [LOCAL ] TEO: Loaded 9816 existing records from primary storage. [2025-09-14T20:16:47.439870] [INFO ] [MAIN ] TEO: Loaded 9816 existing records. [2025-09-14T20:16:47.618627] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:16:47.618901] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-14T20:16:47.618972] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-14T20:16:47.619294] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-14T20:16:47.619352] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-14T20:16:47.763969] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-14T20:16:47.977094] [INFO ] [REMOTE ] TEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:16:48.103836] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T20:16:48.558878] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-14T20:16:49.100175] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T20:16:49.358806] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-14T20:16:49.667098] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T20:16:49.947760] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T20:16:50.158904] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-14T20:16:50.958911] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-14T20:16:51.115196] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T20:16:51.758934] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-14T20:16:52.196761] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T20:16:52.442910] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:16:52.449699] [INFO ] [REMOTE ] TEL: Full fetch complete (55624 records). [2025-09-14T20:16:52.450082] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-14T20:16:52.563991] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-14T20:16:52.850399] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-14T20:16:52.850540] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-14T20:16:52.852134] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-14T20:16:52.852196] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-14T20:16:52.853879] [DEBUG] [LOCAL ] TEL: Trimmed 55624 records to 38555 (keeping 150 days of data) [2025-09-14T20:16:53.137145] [DEBUG] [LOCAL ] TEL: Primary data saved (38555 records). [2025-09-14T20:16:53.137393] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-14T20:16:53.137563] [INFO ] [MAIN ] Update Progress: 2067/2370 symbols completed. TEL took 24.3s. Estimated remaining: 32m 12s. Rate: 9.4 symbols/min [2025-09-14T20:16:53.315621] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:16:53.342795] [DEBUG] [LOCAL ] TEVA: Loaded 24010 existing records from primary storage. [2025-09-14T20:16:53.343017] [INFO ] [MAIN ] TEVA: Loaded 24010 existing records. [2025-09-14T20:16:53.364151] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-14T20:16:53.538699] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:16:53.539074] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-14T20:16:53.539147] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-14T20:16:53.539979] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-14T20:16:53.540050] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-14T20:16:53.929802] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:16:54.158806] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-14T20:16:54.534106] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T20:16:54.912559] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T20:16:54.958857] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-14T20:16:55.758882] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-14T20:16:56.056201] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T20:16:56.088700] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T20:16:56.558895] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-14T20:16:56.904668] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T20:16:57.358878] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-14T20:16:58.158919] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-14T20:16:58.251407] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:16:58.558454] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T20:16:58.958931] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-14T20:16:59.594090] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T20:16:59.668839] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:16:59.671485] [INFO ] [REMOTE ] TEI: Full fetch complete (22403 records). [2025-09-14T20:16:59.671714] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-14T20:16:59.764131] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-14T20:17:00.051594] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-14T20:17:00.051764] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-14T20:17:00.052419] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-14T20:17:00.052490] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-14T20:17:00.053551] [DEBUG] [LOCAL ] TEI: Trimmed 22403 records to 15336 (keeping 150 days of data) [2025-09-14T20:17:00.151568] [DEBUG] [LOCAL ] TEI: Primary data saved (15336 records). [2025-09-14T20:17:00.151773] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-14T20:17:00.151883] [INFO ] [MAIN ] Update Progress: 2068/2370 symbols completed. TEI took 35.4s. Estimated remaining: 32m 6s. Rate: 9.4 symbols/min [2025-09-14T20:17:00.324145] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:00.344030] [DEBUG] [LOCAL ] TEX: Loaded 19491 existing records from primary storage. [2025-09-14T20:17:00.344212] [INFO ] [MAIN ] TEX: Loaded 19491 existing records. [2025-09-14T20:17:00.521679] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:00.521967] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-14T20:17:00.522036] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-14T20:17:00.522579] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-14T20:17:00.522668] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-14T20:17:00.565708] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-14T20:17:00.883810] [INFO ] [REMOTE ] TEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:01.116978] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T20:17:01.121268] [INFO ] [REMOTE ] TEN: Full fetch complete (33515 records). [2025-09-14T20:17:01.121369] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-14T20:17:01.368422] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-14T20:17:01.495231] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-14T20:17:01.495376] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-14T20:17:01.496361] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-14T20:17:01.496464] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-14T20:17:01.497748] [DEBUG] [LOCAL ] TEN: Trimmed 33515 records to 22644 (keeping 150 days of data) [2025-09-14T20:17:01.659405] [DEBUG] [LOCAL ] TEN: Primary data saved (22644 records). [2025-09-14T20:17:01.659620] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-14T20:17:01.659783] [INFO ] [MAIN ] Update Progress: 2069/2370 symbols completed. TEN took 19.1s. Estimated remaining: 31m 59s. Rate: 9.4 symbols/min [2025-09-14T20:17:01.838961] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:01.863306] [DEBUG] [LOCAL ] TFC: Loaded 24028 existing records from primary storage. [2025-09-14T20:17:01.863510] [INFO ] [MAIN ] TFC: Loaded 24028 existing records. [2025-09-14T20:17:02.049061] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:02.049461] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-14T20:17:02.054741] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-14T20:17:02.062907] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T20:17:02.062954] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-14T20:17:02.063130] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-14T20:17:02.166634] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-14T20:17:02.441494] [INFO ] [REMOTE ] TFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:02.958941] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-14T20:17:03.758915] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-14T20:17:03.789904] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T20:17:04.025600] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T20:17:04.045919] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-14T20:17:04.558892] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-14T20:17:05.358928] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-14T20:17:06.158905] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-14T20:17:06.360584] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T20:17:06.401250] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-14T20:17:06.632013] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T20:17:06.958845] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-14T20:17:07.236859] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T20:17:07.758891] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-14T20:17:07.843870] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T20:17:08.558843] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-14T20:17:09.358859] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-14T20:17:09.588912] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T20:17:09.632235] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T20:17:10.158900] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-14T20:17:10.540966] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T20:17:10.958948] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-14T20:17:11.758853] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-14T20:17:12.306244] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T20:17:12.341986] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-14T20:17:12.558844] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-14T20:17:12.894789] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T20:17:13.358865] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-14T20:17:13.881045] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T20:17:13.884441] [INFO ] [REMOTE ] TEO: Full fetch complete (23601 records). [2025-09-14T20:17:13.884531] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-14T20:17:14.164043] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-14T20:17:14.279900] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-14T20:17:14.280073] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-14T20:17:14.281324] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-14T20:17:14.281413] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-14T20:17:14.282485] [DEBUG] [LOCAL ] TEO: Trimmed 23601 records to 16351 (keeping 150 days of data) [2025-09-14T20:17:14.393258] [DEBUG] [LOCAL ] TEO: Primary data saved (16351 records). [2025-09-14T20:17:14.393676] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-14T20:17:14.393831] [INFO ] [MAIN ] Update Progress: 2070/2370 symbols completed. TEO took 27.2s. Estimated remaining: 31m 53s. Rate: 9.4 symbols/min [2025-09-14T20:17:14.620692] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T20:17:14.622950] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:14.652478] [DEBUG] [LOCAL ] TFII: Loaded 14134 existing records from primary storage. [2025-09-14T20:17:14.652769] [INFO ] [MAIN ] TFII: Loaded 14134 existing records. [2025-09-14T20:17:14.853518] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:14.853924] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-14T20:17:14.854021] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-14T20:17:14.854637] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-14T20:17:14.854746] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-14T20:17:14.964338] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-14T20:17:15.239762] [INFO ] [REMOTE ] TFII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:15.758836] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-14T20:17:16.287809] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T20:17:16.568629] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-14T20:17:16.572100] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T20:17:16.735770] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T20:17:17.358878] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-14T20:17:17.829256] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T20:17:17.835411] [INFO ] [REMOTE ] TFC: Full fetch complete (58344 records). [2025-09-14T20:17:17.835728] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-14T20:17:18.173226] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-14T20:17:18.224803] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-14T20:17:18.224948] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-14T20:17:18.226129] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-14T20:17:18.226203] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-14T20:17:18.227948] [DEBUG] [LOCAL ] TFC: Trimmed 58344 records to 40407 (keeping 150 days of data) [2025-09-14T20:17:18.339087] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T20:17:18.520382] [DEBUG] [LOCAL ] TFC: Primary data saved (40407 records). [2025-09-14T20:17:18.520560] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-14T20:17:18.520691] [INFO ] [MAIN ] Update Progress: 2071/2370 symbols completed. TFC took 16.9s. Estimated remaining: 31m 47s. Rate: 9.4 symbols/min [2025-09-14T20:17:18.696101] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:18.709191] [DEBUG] [LOCAL ] TFIN: Loaded 10463 existing records from primary storage. [2025-09-14T20:17:18.709380] [INFO ] [MAIN ] TFIN: Loaded 10463 existing records. [2025-09-14T20:17:18.887219] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:18.887524] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-14T20:17:18.887588] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-14T20:17:18.887908] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-14T20:17:18.887976] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-14T20:17:18.965079] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-14T20:17:19.267538] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:19.758844] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-14T20:17:20.520930] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T20:17:20.558772] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-14T20:17:20.661271] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T20:17:21.370801] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-14T20:17:21.373944] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T20:17:22.158836] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-14T20:17:22.618233] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T20:17:22.781152] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T20:17:22.958776] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-14T20:17:23.768591] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-14T20:17:23.774135] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T20:17:24.558883] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-14T20:17:24.606915] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T20:17:24.860882] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T20:17:25.358853] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-14T20:17:26.085778] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T20:17:26.158812] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-14T20:17:26.479988] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T20:17:26.907872] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T20:17:26.913826] [INFO ] [REMOTE ] TEX: Full fetch complete (49191 records). [2025-09-14T20:17:26.914017] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-14T20:17:26.963955] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-14T20:17:27.307006] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-14T20:17:27.307148] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-14T20:17:27.308254] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-14T20:17:27.308318] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-14T20:17:27.309745] [DEBUG] [LOCAL ] TEX: Trimmed 49191 records to 33110 (keeping 150 days of data) [2025-09-14T20:17:27.529457] [DEBUG] [LOCAL ] TEX: Primary data saved (33110 records). [2025-09-14T20:17:27.529662] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-14T20:17:27.529770] [INFO ] [MAIN ] Update Progress: 2072/2370 symbols completed. TEX took 27.4s. Estimated remaining: 31m 41s. Rate: 9.4 symbols/min [2025-09-14T20:17:27.705813] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:27.725729] [DEBUG] [LOCAL ] TFPM: Loaded 17135 existing records from primary storage. [2025-09-14T20:17:27.725912] [INFO ] [MAIN ] TFPM: Loaded 17135 existing records. [2025-09-14T20:17:27.768163] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-14T20:17:27.914193] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:27.914546] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-14T20:17:27.914613] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-14T20:17:27.915079] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-14T20:17:27.915165] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-14T20:17:28.264336] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:28.335159] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T20:17:28.558844] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-14T20:17:29.227325] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T20:17:29.358831] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-14T20:17:29.931767] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T20:17:30.158851] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-14T20:17:30.917003] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T20:17:30.958774] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-14T20:17:31.292375] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T20:17:31.758886] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-14T20:17:31.911329] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T20:17:32.558852] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-14T20:17:32.929977] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T20:17:33.358881] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-14T20:17:33.934610] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T20:17:34.158810] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-14T20:17:34.626699] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T20:17:34.958857] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-14T20:17:35.758795] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-14T20:17:36.039377] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T20:17:36.042763] [INFO ] [REMOTE ] TFII: Full fetch complete (38177 records). [2025-09-14T20:17:36.042868] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-14T20:17:36.430512] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-14T20:17:36.448773] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-14T20:17:36.449278] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-14T20:17:36.450570] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-14T20:17:36.450840] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-14T20:17:36.451980] [DEBUG] [LOCAL ] TFII: Trimmed 38177 records to 24515 (keeping 150 days of data) [2025-09-14T20:17:36.453747] [INFO ] [REMOTE ] TEVA: Full fetch complete (58306 records). [2025-09-14T20:17:36.453876] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-14T20:17:36.562957] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-14T20:17:36.963378] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-14T20:17:36.972679] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-14T20:17:36.983613] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-14T20:17:36.984062] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-14T20:17:36.991135] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T20:17:37.008292] [DEBUG] [LOCAL ] TEVA: Trimmed 58306 records to 40377 (keeping 150 days of data) [2025-09-14T20:17:37.145996] [DEBUG] [LOCAL ] TFII: Primary data saved (24515 records). [2025-09-14T20:17:37.147051] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-14T20:17:37.147276] [INFO ] [MAIN ] Update Progress: 2073/2370 symbols completed. TFII took 22.8s. Estimated remaining: 31m 35s. Rate: 9.4 symbols/min [2025-09-14T20:17:37.343233] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:37.358911] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-14T20:17:37.376691] [DEBUG] [LOCAL ] TFX: Loaded 15966 existing records from primary storage. [2025-09-14T20:17:37.379700] [INFO ] [MAIN ] TFX: Loaded 15966 existing records. [2025-09-14T20:17:37.693277] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:37.700763] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-14T20:17:37.702527] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-14T20:17:37.709639] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-14T20:17:37.712482] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-14T20:17:37.712294] [DEBUG] [LOCAL ] TEVA: Primary data saved (40377 records). [2025-09-14T20:17:37.712701] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-14T20:17:37.746004] [INFO ] [MAIN ] Update Progress: 2074/2370 symbols completed. TEVA took 44.6s. Estimated remaining: 31m 28s. Rate: 9.4 symbols/min [2025-09-14T20:17:38.129975] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:38.160049] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T20:17:38.192975] [INFO ] [REMOTE ] TFIN: Full fetch complete (25136 records). [2025-09-14T20:17:38.208572] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-14T20:17:38.212984] [DEBUG] [LOCAL ] TG: Loaded 4704 existing records from primary storage. [2025-09-14T20:17:38.287255] [INFO ] [MAIN ] TG: Loaded 4704 existing records. [2025-09-14T20:17:38.338507] [INFO ] [REMOTE ] TFX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:38.411241] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-14T20:17:38.801474] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:38.860090] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-14T20:17:38.870160] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-14T20:17:38.878843] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-14T20:17:38.924851] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-14T20:17:38.960307] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-14T20:17:38.960388] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-14T20:17:38.972627] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-14T20:17:39.000373] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-14T20:17:39.051597] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-14T20:17:39.073861] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-14T20:17:39.121780] [DEBUG] [LOCAL ] TFIN: Trimmed 25136 records to 17488 (keeping 150 days of data) [2025-09-14T20:17:39.431811] [INFO ] [REMOTE ] TG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:39.457771] [DEBUG] [LOCAL ] TFIN: Primary data saved (17488 records). [2025-09-14T20:17:39.458031] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-14T20:17:39.458183] [INFO ] [MAIN ] Update Progress: 2075/2370 symbols completed. TFIN took 20.9s. Estimated remaining: 31m 21s. Rate: 9.4 symbols/min [2025-09-14T20:17:39.633486] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:39.642596] [DEBUG] [LOCAL ] TGE: Loaded 5690 existing records from primary storage. [2025-09-14T20:17:39.642821] [INFO ] [MAIN ] TGE: Loaded 5690 existing records. [2025-09-14T20:17:39.764029] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-14T20:17:39.834787] [WARN ] [MAIN ] TGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:39.835133] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-14T20:17:39.835201] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-14T20:17:39.835514] [DEBUG] [LOCAL ] TGE: Deleted primary data file. [2025-09-14T20:17:39.835578] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-14T20:17:40.206114] [INFO ] [REMOTE ] TGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:40.232465] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T20:17:40.508519] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T20:17:40.537628] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T20:17:40.558827] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-14T20:17:41.358898] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-14T20:17:42.083423] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:17:42.083968] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-14T20:17:42.119667] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T20:17:42.158881] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-14T20:17:42.958898] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-14T20:17:43.758923] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-14T20:17:43.999745] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T20:17:44.101662] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T20:17:44.558887] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-14T20:17:44.674604] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T20:17:45.358834] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-14T20:17:46.158878] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-14T20:17:46.238144] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T20:17:46.364357] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T20:17:46.455134] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:17:46.455519] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-14T20:17:46.958844] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-14T20:17:47.758811] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-14T20:17:47.886131] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T20:17:48.036136] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:17:48.036521] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-14T20:17:48.558874] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-14T20:17:48.815546] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:17:48.816009] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-14T20:17:49.358858] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-14T20:17:50.158846] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-14T20:17:50.711547] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T20:17:50.958881] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-14T20:17:51.744808] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T20:17:51.758876] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-14T20:17:51.812293] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T20:17:52.558878] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-14T20:17:52.974411] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T20:17:53.358840] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-14T20:17:53.763320] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T20:17:53.768453] [INFO ] [REMOTE ] TFPM: Full fetch complete (39564 records). [2025-09-14T20:17:53.768692] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-14T20:17:54.159876] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-14T20:17:54.175287] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-14T20:17:54.175427] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-14T20:17:54.176849] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-14T20:17:54.177032] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-14T20:17:54.178282] [DEBUG] [LOCAL ] TFPM: Trimmed 39564 records to 28963 (keeping 150 days of data) [2025-09-14T20:17:54.391809] [DEBUG] [LOCAL ] TFPM: Primary data saved (28963 records). [2025-09-14T20:17:54.392079] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-14T20:17:54.392204] [INFO ] [MAIN ] Update Progress: 2076/2370 symbols completed. TFPM took 26.9s. Estimated remaining: 31m 15s. Rate: 9.4 symbols/min [2025-09-14T20:17:54.577049] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:17:54.591900] [DEBUG] [LOCAL ] TGLS: Loaded 11821 existing records from primary storage. [2025-09-14T20:17:54.592069] [INFO ] [MAIN ] TGLS: Loaded 11821 existing records. [2025-09-14T20:17:54.781333] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:17:54.781628] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-14T20:17:54.781720] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-14T20:17:54.782194] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-14T20:17:54.782281] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-14T20:17:54.968208] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-14T20:17:55.171167] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:17:55.179787] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T20:17:55.203506] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T20:17:55.758849] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-14T20:17:55.979964] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T20:17:56.558848] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-14T20:17:57.352350] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T20:17:57.363448] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-14T20:17:57.426108] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T20:17:58.158860] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-14T20:17:58.641988] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T20:17:58.958826] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-14T20:17:59.021103] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T20:17:59.023118] [INFO ] [REMOTE ] TGE: Full fetch complete (7311 records). [2025-09-14T20:17:59.023216] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-14T20:17:59.205237] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 69 unique days, need 150 days [2025-09-14T20:17:59.205514] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:17:59.205569] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:17:59.205620] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-14T20:17:59.205714] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-14T20:17:59.205768] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-14T20:17:59.205827] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-14T20:17:59.205930] [INFO ] [MAIN ] Update Progress: 2077/2370 symbols completed. TGE took 19.7s. Estimated remaining: 31m 9s. Rate: 9.4 symbols/min [2025-09-14T20:17:59.758865] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-14T20:18:00.414257] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T20:18:00.558895] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-14T20:18:00.736811] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T20:18:01.358894] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-14T20:18:02.158915] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-14T20:18:02.477216] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T20:18:02.958898] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-14T20:18:04.773813] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-14T20:18:04.775578] [INFO ] [REMOTE ] TG: Full fetch complete (10991 records). [2025-09-14T20:18:04.775702] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-14T20:18:05.134227] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-14T20:18:05.134444] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-14T20:18:05.134935] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-14T20:18:05.135135] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-14T20:18:05.136482] [DEBUG] [LOCAL ] TG: Trimmed 10991 records to 7504 (keeping 150 days of data) [2025-09-14T20:18:05.220313] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-14T20:18:05.220419] [DEBUG] [LOCAL ] TG: Primary data saved (7504 records). [2025-09-14T20:18:05.221912] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (3.86 seconds). [2025-09-14T20:18:05.222059] [INFO ] [MAIN ] TG: Full history saved. [2025-09-14T20:18:05.229393] [INFO ] [MAIN ] Update Progress: 2078/2370 symbols completed. TG took 27.5s. Estimated remaining: 31m 2s. Rate: 9.4 symbols/min [2025-09-14T20:18:05.238218] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-14T20:18:05.238625] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-14T20:18:06.019075] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T20:18:06.023305] [INFO ] [REMOTE ] TFX: Full fetch complete (41334 records). [2025-09-14T20:18:06.023429] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-14T20:18:06.406719] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-14T20:18:06.406859] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-14T20:18:06.408002] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-14T20:18:06.408075] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-14T20:18:06.409262] [DEBUG] [LOCAL ] TFX: Trimmed 41334 records to 26318 (keeping 150 days of data) [2025-09-14T20:18:06.594001] [DEBUG] [LOCAL ] TFX: Primary data saved (26318 records). [2025-09-14T20:18:06.594200] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-14T20:18:06.594334] [INFO ] [MAIN ] Update Progress: 2079/2370 symbols completed. TFX took 29.4s. Estimated remaining: 30m 55s. Rate: 9.4 symbols/min [2025-09-14T20:18:06.625418] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T20:18:06.631540] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-14T20:18:07.789295] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T20:18:07.795631] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-14T20:18:09.179033] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T20:18:09.186021] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-14T20:18:10.366759] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T20:18:10.369860] [INFO ] [REMOTE ] TGLS: Full fetch complete (30882 records). [2025-09-14T20:18:10.369982] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-14T20:18:10.754035] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-14T20:18:10.754210] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-14T20:18:10.755046] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-14T20:18:10.755129] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-14T20:18:10.756321] [DEBUG] [LOCAL ] TGLS: Trimmed 30882 records to 20497 (keeping 150 days of data) [2025-09-14T20:18:10.895220] [DEBUG] [LOCAL ] TGLS: Primary data saved (20497 records). [2025-09-14T20:18:10.895412] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-14T20:18:10.895535] [INFO ] [MAIN ] Update Progress: 2080/2370 symbols completed. TGLS took 16.5s. Estimated remaining: 30m 49s. Rate: 9.4 symbols/min [2025-09-14T20:18:11.540480] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:11.652639] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:11.685957] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:11.745575] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:11.765129] [DEBUG] [LOCAL ] TGS: Loaded 14895 existing records from primary storage. [2025-09-14T20:18:11.765362] [INFO ] [MAIN ] TGS: Loaded 14895 existing records. [2025-09-14T20:18:11.888121] [DEBUG] [LOCAL ] THC: Loaded 20869 existing records from primary storage. [2025-09-14T20:18:11.908136] [INFO ] [MAIN ] THC: Loaded 20869 existing records. [2025-09-14T20:18:11.926243] [DEBUG] [LOCAL ] TGT: Loaded 24138 existing records from primary storage. [2025-09-14T20:18:11.984014] [INFO ] [MAIN ] TGT: Loaded 24138 existing records. [2025-09-14T20:18:11.952780] [DEBUG] [LOCAL ] TGNA: Loaded 21883 existing records from primary storage. [2025-09-14T20:18:12.066962] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:11.999022] [INFO ] [MAIN ] TGNA: Loaded 21883 existing records. [2025-09-14T20:18:12.109368] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-14T20:18:12.194743] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-14T20:18:12.288128] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-14T20:18:12.376901] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-14T20:18:12.510626] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:12.546066] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:12.626835] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-14T20:18:12.655690] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-14T20:18:12.626754] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-14T20:18:12.696504] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-14T20:18:12.696702] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:12.735599] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-14T20:18:12.728231] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-14T20:18:12.728294] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-14T20:18:12.743571] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-14T20:18:12.744135] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-14T20:18:12.744213] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-14T20:18:12.770427] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-14T20:18:12.858441] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-14T20:18:13.683085] [INFO ] [REMOTE ] TGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:13.779606] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-14T20:18:14.094936] [INFO ] [REMOTE ] THC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:14.217770] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-14T20:18:14.242033] [INFO ] [REMOTE ] TGT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:14.246325] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:14.247216] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-14T20:18:14.249723] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-14T20:18:17.224950] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (2.98 seconds). [2025-09-14T20:18:17.253870] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (3.47 seconds). [2025-09-14T20:18:17.252438] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-14T20:18:17.261971] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-14T20:18:17.331407] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (3.08 seconds). [2025-09-14T20:18:17.341864] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-14T20:18:17.378490] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (3.16 seconds). [2025-09-14T20:18:17.389081] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-14T20:18:18.835852] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T20:18:18.842914] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-14T20:18:19.134854] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T20:18:19.152356] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-14T20:18:19.182476] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T20:18:19.193414] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-14T20:18:19.267583] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T20:18:19.278069] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-14T20:18:20.218954] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T20:18:20.226243] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-14T20:18:20.729138] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T20:18:20.739776] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-14T20:18:21.224120] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T20:18:21.236985] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-14T20:18:21.284210] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T20:18:21.292567] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-14T20:18:21.671945] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-14T20:18:21.684778] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-14T20:18:22.603937] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T20:18:22.617527] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-14T20:18:22.811359] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T20:18:22.826950] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T20:18:22.837452] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-14T20:18:22.958980] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-14T20:18:23.680451] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T20:18:23.759002] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-14T20:18:24.265530] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T20:18:24.328291] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T20:18:24.399766] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T20:18:24.558882] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-14T20:18:25.358877] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-14T20:18:26.049293] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-14T20:18:26.158888] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-14T20:18:26.298495] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T20:18:26.958838] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-14T20:18:27.046346] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T20:18:27.758845] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-14T20:18:28.523621] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-14T20:18:28.564331] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-14T20:18:28.567421] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T20:18:29.358855] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-14T20:18:29.714328] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T20:18:30.158870] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-14T20:18:30.877876] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:18:30.904809] [INFO ] [REMOTE ] TGNA: Full fetch complete (52833 records). [2025-09-14T20:18:30.905719] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-14T20:18:30.906993] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T20:18:30.962980] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-14T20:18:31.316025] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-14T20:18:31.316245] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-14T20:18:31.317657] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-14T20:18:31.317778] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-14T20:18:31.319316] [DEBUG] [LOCAL ] TGNA: Trimmed 52833 records to 36312 (keeping 150 days of data) [2025-09-14T20:18:31.453876] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-14T20:18:31.614428] [DEBUG] [LOCAL ] TGNA: Primary data saved (36312 records). [2025-09-14T20:18:31.614634] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-14T20:18:31.614771] [INFO ] [MAIN ] Update Progress: 2081/2370 symbols completed. TGNA took 20.7s. Estimated remaining: 30m 44s. Rate: 9.4 symbols/min [2025-09-14T20:18:31.764208] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-14T20:18:31.804314] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:31.819387] [DEBUG] [LOCAL ] THG: Loaded 9386 existing records from primary storage. [2025-09-14T20:18:31.819617] [INFO ] [MAIN ] THG: Loaded 9386 existing records. [2025-09-14T20:18:32.012284] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:32.012617] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-14T20:18:32.012717] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-14T20:18:32.013181] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-14T20:18:32.013277] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-14T20:18:32.360972] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T20:18:32.422701] [INFO ] [REMOTE ] THG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:32.435402] [INFO ] [REMOTE ] TGS: Full fetch complete (35109 records). [2025-09-14T20:18:32.446539] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-14T20:18:32.448912] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:18:32.571925] [INFO ] [REMOTE ] TGT: Full fetch complete (58458 records). [2025-09-14T20:18:32.563060] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-14T20:18:32.578210] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-14T20:18:33.198084] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-14T20:18:33.198272] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-14T20:18:33.199499] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-14T20:18:33.210017] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-14T20:18:33.292777] [DEBUG] [LOCAL ] TGS: Trimmed 35109 records to 24046 (keeping 150 days of data) [2025-09-14T20:18:33.293026] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-14T20:18:33.293249] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-14T20:18:33.294543] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-14T20:18:33.295056] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-14T20:18:33.345592] [DEBUG] [LOCAL ] TGT: Trimmed 58458 records to 40518 (keeping 150 days of data) [2025-09-14T20:18:33.383163] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-14T20:18:33.599403] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T20:18:33.641716] [INFO ] [REMOTE ] THC: Full fetch complete (52913 records). [2025-09-14T20:18:33.644942] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-14T20:18:34.092411] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-14T20:18:34.093668] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-14T20:18:34.095196] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-14T20:18:34.096450] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-14T20:18:34.103591] [DEBUG] [LOCAL ] TGS: Primary data saved (24046 records). [2025-09-14T20:18:34.104019] [DEBUG] [LOCAL ] THC: Trimmed 52913 records to 36123 (keeping 150 days of data) [2025-09-14T20:18:34.104414] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-14T20:18:34.105541] [INFO ] [MAIN ] Update Progress: 2082/2370 symbols completed. TGS took 23.2s. Estimated remaining: 30m 37s. Rate: 9.4 symbols/min [2025-09-14T20:18:34.420482] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:34.432878] [DEBUG] [LOCAL ] THIR: Loaded 1237 existing records from primary storage. [2025-09-14T20:18:34.436633] [INFO ] [MAIN ] THIR: Loaded 1237 existing records. [2025-09-14T20:18:34.582204] [DEBUG] [LOCAL ] TGT: Primary data saved (40518 records). [2025-09-14T20:18:34.601774] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-14T20:18:34.612823] [INFO ] [MAIN ] Update Progress: 2083/2370 symbols completed. TGT took 23.7s. Estimated remaining: 30m 30s. Rate: 9.4 symbols/min [2025-09-14T20:18:34.817074] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:34.862119] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-14T20:18:34.865322] [DEBUG] [LOCAL ] THC: Primary data saved (36123 records). [2025-09-14T20:18:34.888277] [INFO ] [MAIN ] THC: Full history saved. [2025-09-14T20:18:34.888134] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-14T20:18:34.910750] [INFO ] [MAIN ] Update Progress: 2084/2370 symbols completed. THC took 24.0s. Estimated remaining: 30m 23s. Rate: 9.4 symbols/min [2025-09-14T20:18:34.914363] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:34.927994] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-14T20:18:34.939424] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-14T20:18:35.027886] [DEBUG] [LOCAL ] THLV: Loaded 526 existing records from primary storage. [2025-09-14T20:18:35.080977] [INFO ] [MAIN ] THLV: Loaded 526 existing records. [2025-09-14T20:18:35.440296] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:35.450907] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T20:18:35.517126] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-14T20:18:35.615503] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:35.695123] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-14T20:18:35.699801] [INFO ] [REMOTE ] THIR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:35.700210] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-14T20:18:35.699933] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-14T20:18:35.701185] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-14T20:18:35.701563] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-14T20:18:35.772274] [DEBUG] [LOCAL ] THO: Loaded 18148 existing records from primary storage. [2025-09-14T20:18:35.784448] [INFO ] [MAIN ] THO: Loaded 18148 existing records. [2025-09-14T20:18:36.170991] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:36.189509] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T20:18:36.242964] [INFO ] [REMOTE ] THLV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:36.244544] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-14T20:18:36.244386] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-14T20:18:36.245060] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-14T20:18:36.246708] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-14T20:18:36.246785] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-14T20:18:36.563887] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-14T20:18:36.615278] [INFO ] [REMOTE ] THO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:36.769206] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T20:18:36.892094] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T20:18:36.969710] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-14T20:18:37.358841] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-14T20:18:38.158851] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-14T20:18:38.669302] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T20:18:38.906211] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T20:18:38.958786] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-14T20:18:39.481673] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T20:18:39.758854] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-14T20:18:40.558839] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-14T20:18:41.190727] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T20:18:41.358812] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-14T20:18:41.543990] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T20:18:41.866429] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T20:18:42.158914] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-14T20:18:42.958858] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-14T20:18:43.442294] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T20:18:43.761541] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-14T20:18:43.765603] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T20:18:44.558881] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-14T20:18:45.358894] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-14T20:18:45.456757] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T20:18:45.504353] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T20:18:45.750347] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-14T20:18:46.158867] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-14T20:18:46.958891] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-14T20:18:47.575821] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T20:18:47.758805] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-14T20:18:47.830345] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T20:18:48.144585] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-14T20:18:48.558878] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-14T20:18:49.187860] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T20:18:49.358837] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-14T20:18:50.158853] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-14T20:18:50.567102] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T20:18:50.958864] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-14T20:18:51.392038] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T20:18:51.392945] [INFO ] [REMOTE ] THIR: Full fetch complete (2205 records). [2025-09-14T20:18:51.393029] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-14T20:18:51.758043] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-14T20:18:51.758309] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-14T20:18:51.758558] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-14T20:18:51.758666] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-14T20:18:51.759169] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-14T20:18:51.759763] [DEBUG] [LOCAL ] THIR: Trimmed 2205 records to 1798 (keeping 150 days of data) [2025-09-14T20:18:51.773167] [DEBUG] [LOCAL ] THIR: Primary data saved (1798 records). [2025-09-14T20:18:51.773347] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-14T20:18:51.773534] [INFO ] [MAIN ] Update Progress: 2085/2370 symbols completed. THIR took 17.7s. Estimated remaining: 30m 18s. Rate: 9.4 symbols/min [2025-09-14T20:18:51.969281] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T20:18:51.995191] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:52.013419] [DEBUG] [LOCAL ] THQ: Loaded 13121 existing records from primary storage. [2025-09-14T20:18:52.013689] [INFO ] [MAIN ] THQ: Loaded 13121 existing records. [2025-09-14T20:18:52.191193] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:52.194691] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T20:18:52.195063] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-14T20:18:52.196391] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-14T20:18:52.196839] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-14T20:18:52.196903] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-14T20:18:52.550144] [INFO ] [REMOTE ] THQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:52.558842] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-14T20:18:53.358864] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-14T20:18:53.866818] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T20:18:54.139313] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T20:18:54.158778] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-14T20:18:54.958873] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-14T20:18:55.763403] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-14T20:18:55.765237] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T20:18:56.156718] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T20:18:56.558858] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-14T20:18:57.358907] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-14T20:18:57.420067] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T20:18:57.595977] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T20:18:57.600375] [INFO ] [REMOTE ] THO: Full fetch complete (45851 records). [2025-09-14T20:18:57.600547] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-14T20:18:57.863449] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T20:18:57.891503] [INFO ] [REMOTE ] THLV: Full fetch complete (1928 records). [2025-09-14T20:18:57.897315] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-14T20:18:58.083417] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-14T20:18:58.089273] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-14T20:18:58.105793] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-14T20:18:58.111028] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-14T20:18:58.173558] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-14T20:18:58.224134] [DEBUG] [LOCAL ] THO: Trimmed 45851 records to 30981 (keeping 150 days of data) [2025-09-14T20:18:58.446981] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-14T20:18:58.447080] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-14T20:18:58.447206] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-14T20:18:58.447298] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-14T20:18:58.448518] [DEBUG] [LOCAL ] THLV: Trimmed 1928 records to 1122 (keeping 150 days of data) [2025-09-14T20:18:58.458181] [DEBUG] [LOCAL ] THLV: Primary data saved (1122 records). [2025-09-14T20:18:58.458521] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-14T20:18:58.458673] [INFO ] [MAIN ] Update Progress: 2086/2370 symbols completed. THLV took 23.8s. Estimated remaining: 30m 12s. Rate: 9.4 symbols/min [2025-09-14T20:18:58.641671] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:58.729024] [DEBUG] [LOCAL ] THR: Loaded 8401 existing records from primary storage. [2025-09-14T20:18:58.731693] [INFO ] [MAIN ] THR: Loaded 8401 existing records. [2025-09-14T20:18:58.960288] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:58.960375] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-14T20:18:58.961917] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-14T20:18:58.963330] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-14T20:18:58.963956] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-14T20:18:58.964665] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-14T20:18:59.136686] [DEBUG] [LOCAL ] THO: Primary data saved (30981 records). [2025-09-14T20:18:59.205181] [INFO ] [MAIN ] THO: Full history saved. [2025-09-14T20:18:59.244558] [INFO ] [MAIN ] Update Progress: 2087/2370 symbols completed. THO took 24.3s. Estimated remaining: 30m 5s. Rate: 9.4 symbols/min [2025-09-14T20:18:59.496373] [INFO ] [REMOTE ] THR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:18:59.528387] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:18:59.544171] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T20:18:59.563494] [DEBUG] [LOCAL ] THS: Loaded 17502 existing records from primary storage. [2025-09-14T20:18:59.563690] [INFO ] [MAIN ] THS: Loaded 17502 existing records. [2025-09-14T20:18:59.739240] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:18:59.739521] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-14T20:18:59.739583] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-14T20:18:59.740053] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-14T20:18:59.740133] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-14T20:18:59.770061] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-14T20:19:00.111978] [INFO ] [REMOTE ] THS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:00.126058] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T20:19:00.147930] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T20:19:00.151234] [INFO ] [REMOTE ] THG: Full fetch complete (24134 records). [2025-09-14T20:19:00.151408] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-14T20:19:00.551161] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-14T20:19:00.551301] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-14T20:19:00.552126] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-14T20:19:00.552221] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-14T20:19:00.553117] [DEBUG] [LOCAL ] THG: Trimmed 24134 records to 16010 (keeping 150 days of data) [2025-09-14T20:19:00.599604] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-14T20:19:00.668195] [DEBUG] [LOCAL ] THG: Primary data saved (16010 records). [2025-09-14T20:19:00.668453] [INFO ] [MAIN ] THG: Full history saved. [2025-09-14T20:19:00.668583] [INFO ] [MAIN ] Update Progress: 2088/2370 symbols completed. THG took 29.1s. Estimated remaining: 29m 57s. Rate: 9.4 symbols/min [2025-09-14T20:19:00.851621] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:00.863935] [DEBUG] [LOCAL ] THW: Loaded 9301 existing records from primary storage. [2025-09-14T20:19:00.864141] [INFO ] [MAIN ] THW: Loaded 9301 existing records. [2025-09-14T20:19:01.048747] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:01.049123] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-14T20:19:01.049197] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-14T20:19:01.049520] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-14T20:19:01.049580] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-14T20:19:01.364070] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-14T20:19:01.441960] [INFO ] [REMOTE ] THW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:02.009543] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T20:19:02.158860] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-14T20:19:02.958871] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-14T20:19:03.758881] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-14T20:19:03.848283] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T20:19:03.874943] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-14T20:19:04.194698] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T20:19:04.558886] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-14T20:19:04.898677] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T20:19:05.358925] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-14T20:19:06.054710] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T20:19:06.158866] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-14T20:19:06.419513] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T20:19:06.958914] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-14T20:19:07.758856] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-14T20:19:07.879901] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T20:19:07.933319] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T20:19:08.558801] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-14T20:19:08.834403] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T20:19:09.358841] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-14T20:19:09.805826] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T20:19:10.158800] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-14T20:19:10.407177] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T20:19:10.958910] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-14T20:19:11.720632] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T20:19:11.758790] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-14T20:19:12.456950] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T20:19:12.558831] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-14T20:19:13.018713] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T20:19:13.358876] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-14T20:19:13.899682] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T20:19:14.158895] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-14T20:19:14.430215] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T20:19:14.958845] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-14T20:19:15.758893] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-14T20:19:16.142381] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T20:19:16.529208] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T20:19:16.558859] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-14T20:19:17.023418] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T20:19:17.358855] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-14T20:19:17.927945] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T20:19:18.158900] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-14T20:19:18.655774] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T20:19:18.958848] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-14T20:19:19.758803] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-14T20:19:19.859749] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T20:19:19.982808] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T20:19:19.986249] [INFO ] [REMOTE ] THR: Full fetch complete (22114 records). [2025-09-14T20:19:19.986378] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-14T20:19:20.390440] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-14T20:19:20.390589] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-14T20:19:20.391234] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-14T20:19:20.391315] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-14T20:19:20.392144] [DEBUG] [LOCAL ] THR: Trimmed 22114 records to 14571 (keeping 150 days of data) [2025-09-14T20:19:20.493198] [DEBUG] [LOCAL ] THR: Primary data saved (14571 records). [2025-09-14T20:19:20.493380] [INFO ] [MAIN ] THR: Full history saved. [2025-09-14T20:19:20.493498] [INFO ] [MAIN ] Update Progress: 2089/2370 symbols completed. THR took 22.0s. Estimated remaining: 29m 53s. Rate: 9.4 symbols/min [2025-09-14T20:19:20.564040] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-14T20:19:20.679777] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:20.701947] [DEBUG] [LOCAL ] TIC: Loaded 21337 existing records from primary storage. [2025-09-14T20:19:20.702137] [INFO ] [MAIN ] TIC: Loaded 21337 existing records. [2025-09-14T20:19:20.883428] [WARN ] [MAIN ] TIC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:20.883780] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-14T20:19:20.883845] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-14T20:19:20.884314] [DEBUG] [LOCAL ] TIC: Deleted primary data file. [2025-09-14T20:19:20.884375] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-14T20:19:21.198833] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T20:19:21.286558] [INFO ] [REMOTE ] TIC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:21.358835] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-14T20:19:22.022884] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T20:19:22.158840] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-14T20:19:22.396147] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T20:19:22.398630] [INFO ] [REMOTE ] THW: Full fetch complete (20952 records). [2025-09-14T20:19:22.398761] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-14T20:19:22.668838] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T20:19:22.774407] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-14T20:19:22.774706] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-14T20:19:22.775398] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-14T20:19:22.775462] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-14T20:19:22.776961] [DEBUG] [LOCAL ] THW: Trimmed 20952 records to 15000 (keeping 150 days of data) [2025-09-14T20:19:22.881122] [DEBUG] [LOCAL ] THW: Primary data saved (15000 records). [2025-09-14T20:19:22.881310] [INFO ] [MAIN ] THW: Full history saved. [2025-09-14T20:19:22.881448] [INFO ] [MAIN ] Update Progress: 2090/2370 symbols completed. THW took 22.2s. Estimated remaining: 29m 46s. Rate: 9.4 symbols/min [2025-09-14T20:19:22.963968] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-14T20:19:23.065470] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:23.083008] [DEBUG] [LOCAL ] TIMB: Loaded 16633 existing records from primary storage. [2025-09-14T20:19:23.083174] [INFO ] [MAIN ] TIMB: Loaded 16633 existing records. [2025-09-14T20:19:23.260220] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:23.260500] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-14T20:19:23.260561] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-14T20:19:23.261033] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-14T20:19:23.261095] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-14T20:19:23.619061] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:23.758849] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-14T20:19:24.004548] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T20:19:24.558890] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-14T20:19:25.341463] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T20:19:25.358763] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-14T20:19:25.667124] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T20:19:25.671245] [INFO ] [REMOTE ] THQ: Full fetch complete (25752 records). [2025-09-14T20:19:25.671365] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-14T20:19:26.048439] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-14T20:19:26.048676] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-14T20:19:26.049313] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-14T20:19:26.049419] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-14T20:19:26.060325] [DEBUG] [LOCAL ] THQ: Trimmed 25752 records to 19489 (keeping 150 days of data) [2025-09-14T20:19:26.061386] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:19:26.066396] [INFO ] [REMOTE ] THS: Full fetch complete (41427 records). [2025-09-14T20:19:26.066592] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-14T20:19:26.172897] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-14T20:19:26.550850] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-14T20:19:26.550945] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-14T20:19:26.551897] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-14T20:19:26.552481] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-14T20:19:26.554228] [DEBUG] [LOCAL ] THS: Trimmed 41427 records to 28643 (keeping 150 days of data) [2025-09-14T20:19:26.688145] [DEBUG] [LOCAL ] THQ: Primary data saved (19489 records). [2025-09-14T20:19:26.688626] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-14T20:19:26.689435] [INFO ] [MAIN ] Update Progress: 2091/2370 symbols completed. THQ took 34.9s. Estimated remaining: 29m 39s. Rate: 9.4 symbols/min [2025-09-14T20:19:26.904555] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:26.909524] [DEBUG] [LOCAL ] TISI: Loaded 971 existing records from primary storage. [2025-09-14T20:19:26.910476] [INFO ] [MAIN ] TISI: Loaded 971 existing records. [2025-09-14T20:19:26.965131] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-14T20:19:27.100927] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:27.102433] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-14T20:19:27.103626] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-14T20:19:27.105345] [DEBUG] [LOCAL ] THS: Primary data saved (28643 records). [2025-09-14T20:19:27.105524] [INFO ] [MAIN ] THS: Full history saved. [2025-09-14T20:19:27.105637] [INFO ] [MAIN ] Update Progress: 2092/2370 symbols completed. THS took 27.8s. Estimated remaining: 29m 32s. Rate: 9.4 symbols/min [2025-09-14T20:19:27.105691] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-14T20:19:27.148622] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-14T20:19:27.439191] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:27.639512] [DEBUG] [LOCAL ] TIXT: Loaded 16002 existing records from primary storage. [2025-09-14T20:19:27.658419] [INFO ] [REMOTE ] TISI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:27.658938] [INFO ] [MAIN ] TIXT: Loaded 16002 existing records. [2025-09-14T20:19:27.761320] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-14T20:19:27.842462] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:27.843002] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-14T20:19:27.843118] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-14T20:19:27.843730] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-14T20:19:27.843801] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-14T20:19:28.027488] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T20:19:28.235734] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T20:19:28.241122] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:28.259116] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T20:19:28.558834] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-14T20:19:29.358846] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-14T20:19:30.054382] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T20:19:30.158842] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-14T20:19:30.266326] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T20:19:30.955356] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T20:19:30.958759] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-14T20:19:31.651947] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T20:19:31.758851] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-14T20:19:32.558838] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-14T20:19:33.292252] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T20:19:33.358779] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-14T20:19:34.158856] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-14T20:19:34.197357] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T20:19:34.812052] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T20:19:34.966805] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-14T20:19:34.986142] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T20:19:35.758873] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-14T20:19:36.436521] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T20:19:36.558817] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-14T20:19:36.998823] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T20:19:37.056551] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-14T20:19:37.358853] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-14T20:19:37.910292] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-14T20:19:38.158849] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-14T20:19:38.958904] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-14T20:19:39.402221] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T20:19:39.403079] [INFO ] [REMOTE ] TISI: Full fetch complete (4047 records). [2025-09-14T20:19:39.403162] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-14T20:19:39.759071] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-14T20:19:39.763981] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-14T20:19:39.765381] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-14T20:19:39.765973] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-14T20:19:39.766144] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-14T20:19:39.767691] [DEBUG] [LOCAL ] TISI: Trimmed 4047 records to 2342 (keeping 150 days of data) [2025-09-14T20:19:39.808870] [DEBUG] [LOCAL ] TISI: Primary data saved (2342 records). [2025-09-14T20:19:39.809068] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-14T20:19:39.809401] [INFO ] [MAIN ] Update Progress: 2093/2370 symbols completed. TISI took 13.1s. Estimated remaining: 29m 27s. Rate: 9.4 symbols/min [2025-09-14T20:19:39.811845] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T20:19:39.992746] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:40.023558] [DEBUG] [LOCAL ] TJX: Loaded 24042 existing records from primary storage. [2025-09-14T20:19:40.023775] [INFO ] [MAIN ] TJX: Loaded 24042 existing records. [2025-09-14T20:19:40.205496] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:40.205828] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-14T20:19:40.205895] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-14T20:19:40.206630] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-14T20:19:40.206734] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-14T20:19:40.564905] [INFO ] [REMOTE ] TJX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:40.565297] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-14T20:19:40.994213] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T20:19:41.358841] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-14T20:19:42.163924] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-14T20:19:42.179606] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T20:19:42.289120] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T20:19:42.958889] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-14T20:19:43.376535] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T20:19:43.758838] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-14T20:19:44.558867] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-14T20:19:44.595833] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T20:19:44.761468] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T20:19:45.358877] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-14T20:19:45.573730] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T20:19:46.158873] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-14T20:19:46.360995] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T20:19:46.958882] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-14T20:19:47.758873] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-14T20:19:47.952159] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T20:19:48.023102] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T20:19:48.558913] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-14T20:19:48.909345] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T20:19:49.358860] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-14T20:19:49.482149] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T20:19:50.158845] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-14T20:19:50.867741] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T20:19:50.872680] [INFO ] [REMOTE ] TIC: Full fetch complete (35386 records). [2025-09-14T20:19:50.872879] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-14T20:19:50.963905] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-14T20:19:51.069537] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 142 unique days, need 150 days [2025-09-14T20:19:51.070016] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:19:51.070090] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:19:51.070167] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-14T20:19:51.070274] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-14T20:19:51.070341] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-14T20:19:51.070438] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-14T20:19:51.070554] [INFO ] [MAIN ] Update Progress: 2094/2370 symbols completed. TIC took 30.6s. Estimated remaining: 29m 21s. Rate: 9.4 symbols/min [2025-09-14T20:19:51.239385] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:51.261315] [DEBUG] [LOCAL ] TK: Loaded 17293 existing records from primary storage. [2025-09-14T20:19:51.261503] [INFO ] [MAIN ] TK: Loaded 17293 existing records. [2025-09-14T20:19:51.443345] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:51.443705] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-14T20:19:51.443780] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-14T20:19:51.444320] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-14T20:19:51.444385] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-14T20:19:51.772848] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-14T20:19:51.814073] [INFO ] [REMOTE ] TK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:51.840984] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T20:19:51.879891] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T20:19:52.558861] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-14T20:19:53.024804] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T20:19:53.029693] [INFO ] [REMOTE ] TIMB: Full fetch complete (41063 records). [2025-09-14T20:19:53.029799] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-14T20:19:53.358843] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-14T20:19:53.401936] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-14T20:19:53.402039] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-14T20:19:53.402940] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-14T20:19:53.402999] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-14T20:19:53.404345] [DEBUG] [LOCAL ] TIMB: Trimmed 41063 records to 27077 (keeping 150 days of data) [2025-09-14T20:19:53.582496] [DEBUG] [LOCAL ] TIMB: Primary data saved (27077 records). [2025-09-14T20:19:53.582690] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-14T20:19:53.582867] [INFO ] [MAIN ] Update Progress: 2095/2370 symbols completed. TIMB took 30.7s. Estimated remaining: 29m 14s. Rate: 9.4 symbols/min [2025-09-14T20:19:53.754047] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:53.773484] [DEBUG] [LOCAL ] TKC: Loaded 17159 existing records from primary storage. [2025-09-14T20:19:53.773729] [INFO ] [MAIN ] TKC: Loaded 17159 existing records. [2025-09-14T20:19:53.952914] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:53.953209] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-14T20:19:53.953272] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-14T20:19:53.953779] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-14T20:19:53.953843] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-14T20:19:54.169306] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-14T20:19:54.344896] [INFO ] [REMOTE ] TKC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:54.341080] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T20:19:54.386771] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T20:19:54.958899] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-14T20:19:55.684859] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T20:19:55.758813] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-14T20:19:56.213799] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T20:19:56.558898] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-14T20:19:57.070403] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T20:19:57.075777] [INFO ] [REMOTE ] TIXT: Full fetch complete (33403 records). [2025-09-14T20:19:57.075961] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-14T20:19:57.360570] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-14T20:19:57.460183] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-14T20:19:57.460352] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-14T20:19:57.461306] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-14T20:19:57.461500] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-14T20:19:57.463018] [DEBUG] [LOCAL ] TIXT: Trimmed 33403 records to 24115 (keeping 150 days of data) [2025-09-14T20:19:57.578453] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T20:19:57.645775] [DEBUG] [LOCAL ] TIXT: Primary data saved (24115 records). [2025-09-14T20:19:57.645968] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-14T20:19:57.646131] [INFO ] [MAIN ] Update Progress: 2096/2370 symbols completed. TIXT took 30.5s. Estimated remaining: 29m 7s. Rate: 9.4 symbols/min [2025-09-14T20:19:57.814163] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:57.834060] [DEBUG] [LOCAL ] TKO: Loaded 18707 existing records from primary storage. [2025-09-14T20:19:57.834221] [INFO ] [MAIN ] TKO: Loaded 18707 existing records. [2025-09-14T20:19:58.010947] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:19:58.011275] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-14T20:19:58.011360] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-14T20:19:58.011990] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-14T20:19:58.012067] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-14T20:19:58.166053] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-14T20:19:58.375960] [INFO ] [REMOTE ] TKO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:19:58.958892] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-14T20:19:59.032152] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T20:19:59.058472] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T20:19:59.065550] [INFO ] [REMOTE ] TJX: Full fetch complete (58350 records). [2025-09-14T20:19:59.065882] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-14T20:19:59.462016] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-14T20:19:59.462165] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-14T20:19:59.463404] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-14T20:19:59.463477] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-14T20:19:59.464955] [DEBUG] [LOCAL ] TJX: Trimmed 58350 records to 40417 (keeping 150 days of data) [2025-09-14T20:19:59.743322] [DEBUG] [LOCAL ] TJX: Primary data saved (40417 records). [2025-09-14T20:19:59.743476] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-14T20:19:59.743575] [INFO ] [MAIN ] Update Progress: 2097/2370 symbols completed. TJX took 19.9s. Estimated remaining: 29m 0s. Rate: 9.4 symbols/min [2025-09-14T20:19:59.764158] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-14T20:19:59.914980] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:19:59.932491] [DEBUG] [LOCAL ] TKR: Loaded 17224 existing records from primary storage. [2025-09-14T20:19:59.932722] [INFO ] [MAIN ] TKR: Loaded 17224 existing records. [2025-09-14T20:20:00.115014] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:00.115324] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-14T20:20:00.115388] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-14T20:20:00.115969] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-14T20:20:00.116038] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-14T20:20:00.488911] [INFO ] [REMOTE ] TKR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:00.558867] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-14T20:20:00.893499] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T20:20:00.936779] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T20:20:01.358851] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-14T20:20:02.158880] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-14T20:20:02.335578] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T20:20:02.958902] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-14T20:20:03.106211] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T20:20:03.764499] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-14T20:20:03.944804] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T20:20:04.558903] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-14T20:20:05.358930] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-14T20:20:05.408800] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-14T20:20:05.462101] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T20:20:06.158864] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-14T20:20:06.958855] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-14T20:20:07.067700] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-14T20:20:07.109473] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T20:20:07.758857] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-14T20:20:07.918991] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T20:20:08.558838] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-14T20:20:08.906352] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T20:20:09.358936] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-14T20:20:09.702398] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T20:20:09.880399] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T20:20:10.158918] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-14T20:20:10.958878] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-14T20:20:11.028563] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T20:20:11.567190] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T20:20:11.759056] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-14T20:20:12.558841] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-14T20:20:12.688678] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T20:20:13.358835] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-14T20:20:13.570446] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T20:20:13.944083] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T20:20:14.158891] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-14T20:20:14.958862] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-14T20:20:15.271985] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T20:20:15.528974] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-14T20:20:15.535573] [INFO ] [REMOTE ] TKC: Full fetch complete (40100 records). [2025-09-14T20:20:15.535888] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-14T20:20:15.764054] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-14T20:20:15.941604] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-14T20:20:15.941753] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-14T20:20:15.942670] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-14T20:20:15.942739] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-14T20:20:15.943790] [DEBUG] [LOCAL ] TKC: Trimmed 40100 records to 28785 (keeping 150 days of data) [2025-09-14T20:20:16.119108] [DEBUG] [LOCAL ] TKC: Primary data saved (28785 records). [2025-09-14T20:20:16.119328] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-14T20:20:16.119510] [INFO ] [MAIN ] Update Progress: 2098/2370 symbols completed. TKC took 22.5s. Estimated remaining: 28m 55s. Rate: 9.4 symbols/min [2025-09-14T20:20:16.289477] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:20:16.307547] [DEBUG] [LOCAL ] TLK: Loaded 17139 existing records from primary storage. [2025-09-14T20:20:16.307742] [INFO ] [MAIN ] TLK: Loaded 17139 existing records. [2025-09-14T20:20:16.483687] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:16.484088] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-14T20:20:16.484268] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-14T20:20:16.484800] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-14T20:20:16.484885] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-14T20:20:16.559901] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-14T20:20:16.672303] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T20:20:16.885281] [INFO ] [REMOTE ] TLK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:17.288079] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T20:20:17.292037] [INFO ] [REMOTE ] TK: Full fetch complete (43235 records). [2025-09-14T20:20:17.292160] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-14T20:20:17.368272] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-14T20:20:17.675569] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-14T20:20:17.675721] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-14T20:20:17.676694] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-14T20:20:17.676751] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-14T20:20:17.677962] [DEBUG] [LOCAL ] TK: Trimmed 43235 records to 30001 (keeping 150 days of data) [2025-09-14T20:20:17.973311] [DEBUG] [LOCAL ] TK: Primary data saved (30001 records). [2025-09-14T20:20:17.973506] [INFO ] [MAIN ] TK: Full history saved. [2025-09-14T20:20:17.973702] [INFO ] [MAIN ] Update Progress: 2099/2370 symbols completed. TK took 26.9s. Estimated remaining: 28m 48s. Rate: 9.4 symbols/min [2025-09-14T20:20:18.149330] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:20:18.159255] [DEBUG] [LOCAL ] TLYS: Loaded 7680 existing records from primary storage. [2025-09-14T20:20:18.159318] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-14T20:20:18.159522] [INFO ] [MAIN ] TLYS: Loaded 7680 existing records. [2025-09-14T20:20:18.344089] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:18.344487] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-14T20:20:18.344596] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-14T20:20:18.344976] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-14T20:20:18.345052] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-14T20:20:18.605157] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-14T20:20:18.737594] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:18.850401] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T20:20:18.958774] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-14T20:20:19.759037] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-14T20:20:19.812156] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T20:20:19.815890] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T20:20:20.558958] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-14T20:20:21.283265] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T20:20:21.358849] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-14T20:20:21.468248] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T20:20:22.077668] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:20:22.082787] [INFO ] [REMOTE ] TKR: Full fetch complete (43459 records). [2025-09-14T20:20:22.083060] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-14T20:20:22.164051] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-14T20:20:22.473068] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-14T20:20:22.473206] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-14T20:20:22.474466] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-14T20:20:22.474555] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-14T20:20:22.476203] [DEBUG] [LOCAL ] TKR: Trimmed 43459 records to 29166 (keeping 150 days of data) [2025-09-14T20:20:22.704449] [DEBUG] [LOCAL ] TKR: Primary data saved (29166 records). [2025-09-14T20:20:22.704669] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-14T20:20:22.704823] [INFO ] [MAIN ] Update Progress: 2100/2370 symbols completed. TKR took 23.0s. Estimated remaining: 28m 42s. Rate: 9.4 symbols/min [2025-09-14T20:20:22.884381] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:20:22.902867] [DEBUG] [LOCAL ] TM: Loaded 16443 existing records from primary storage. [2025-09-14T20:20:22.903064] [INFO ] [MAIN ] TM: Loaded 16443 existing records. [2025-09-14T20:20:22.968563] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-14T20:20:23.094384] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:23.094668] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-14T20:20:23.094742] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-14T20:20:23.095195] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-14T20:20:23.095255] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-14T20:20:23.458492] [INFO ] [REMOTE ] TM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:23.758893] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-14T20:20:23.965278] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T20:20:24.112401] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T20:20:24.558878] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-14T20:20:24.602077] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T20:20:25.358823] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-14T20:20:25.743047] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T20:20:26.158838] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-14T20:20:26.958911] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-14T20:20:27.033497] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T20:20:27.299873] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T20:20:27.758910] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-14T20:20:28.262335] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T20:20:28.559046] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-14T20:20:28.561977] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T20:20:29.358835] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-14T20:20:29.757533] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T20:20:30.158870] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-14T20:20:30.242157] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T20:20:30.958942] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-14T20:20:31.110020] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T20:20:31.767760] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-14T20:20:31.773795] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T20:20:32.558932] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-14T20:20:32.733507] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T20:20:32.736290] [INFO ] [REMOTE ] TLYS: Full fetch complete (17923 records). [2025-09-14T20:20:32.736411] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-14T20:20:33.132944] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-14T20:20:33.133093] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-14T20:20:33.133981] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-14T20:20:33.134064] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-14T20:20:33.134947] [DEBUG] [LOCAL ] TLYS: Trimmed 17923 records to 14208 (keeping 150 days of data) [2025-09-14T20:20:33.230819] [DEBUG] [LOCAL ] TLYS: Primary data saved (14208 records). [2025-09-14T20:20:33.231074] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-14T20:20:33.231210] [INFO ] [MAIN ] Update Progress: 2101/2370 symbols completed. TLYS took 15.3s. Estimated remaining: 28m 36s. Rate: 9.4 symbols/min [2025-09-14T20:20:33.361154] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-14T20:20:33.417969] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:20:33.445387] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T20:20:33.475742] [DEBUG] [LOCAL ] TME: Loaded 23859 existing records from primary storage. [2025-09-14T20:20:33.475983] [INFO ] [MAIN ] TME: Loaded 23859 existing records. [2025-09-14T20:20:33.661667] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:33.661971] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-14T20:20:33.662035] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-14T20:20:33.662634] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-14T20:20:33.662718] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-14T20:20:34.013757] [INFO ] [REMOTE ] TME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:34.158838] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-14T20:20:34.962526] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-14T20:20:34.964178] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T20:20:35.758891] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-14T20:20:35.794519] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T20:20:36.558866] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-14T20:20:36.729500] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T20:20:36.770119] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T20:20:37.358846] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-14T20:20:38.069610] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:20:38.076935] [INFO ] [REMOTE ] TKO: Full fetch complete (48824 records). [2025-09-14T20:20:38.077127] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-14T20:20:38.159677] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-14T20:20:38.507826] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T20:20:38.524909] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-14T20:20:38.533008] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-14T20:20:38.535605] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-14T20:20:38.535739] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-14T20:20:38.537852] [DEBUG] [LOCAL ] TKO: Trimmed 48824 records to 32011 (keeping 150 days of data) [2025-09-14T20:20:38.758816] [DEBUG] [LOCAL ] TKO: Primary data saved (32011 records). [2025-09-14T20:20:38.759031] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-14T20:20:38.759155] [INFO ] [MAIN ] Update Progress: 2102/2370 symbols completed. TKO took 41.1s. Estimated remaining: 28m 29s. Rate: 9.4 symbols/min [2025-09-14T20:20:38.936721] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:20:38.957221] [DEBUG] [LOCAL ] TMHC: Loaded 20555 existing records from primary storage. [2025-09-14T20:20:38.957388] [INFO ] [MAIN ] TMHC: Loaded 20555 existing records. [2025-09-14T20:20:38.968713] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-14T20:20:39.139515] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:39.139846] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-14T20:20:39.139925] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-14T20:20:39.140537] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-14T20:20:39.140598] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-14T20:20:39.493482] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:39.758831] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-14T20:20:40.122801] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T20:20:40.233809] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T20:20:40.558943] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-14T20:20:40.634963] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T20:20:41.358869] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-14T20:20:42.158858] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-14T20:20:42.301635] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T20:20:42.807345] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T20:20:42.811088] [INFO ] [REMOTE ] TM: Full fetch complete (39984 records). [2025-09-14T20:20:42.811219] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-14T20:20:42.960476] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-14T20:20:43.209872] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-14T20:20:43.210118] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-14T20:20:43.211463] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-14T20:20:43.211621] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-14T20:20:43.244860] [DEBUG] [LOCAL ] TM: Trimmed 39984 records to 27875 (keeping 150 days of data) [2025-09-14T20:20:43.247174] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T20:20:43.461974] [DEBUG] [LOCAL ] TM: Primary data saved (27875 records). [2025-09-14T20:20:43.462578] [INFO ] [MAIN ] TM: Full history saved. [2025-09-14T20:20:43.462968] [INFO ] [MAIN ] Update Progress: 2103/2370 symbols completed. TM took 20.8s. Estimated remaining: 28m 23s. Rate: 9.4 symbols/min [2025-09-14T20:20:43.641511] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:20:43.668090] [DEBUG] [LOCAL ] TMO: Loaded 23329 existing records from primary storage. [2025-09-14T20:20:43.668323] [INFO ] [MAIN ] TMO: Loaded 23329 existing records. [2025-09-14T20:20:43.767855] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-14T20:20:43.853940] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:43.854235] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-14T20:20:43.854298] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-14T20:20:43.854875] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-14T20:20:43.854938] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-14T20:20:44.219112] [INFO ] [REMOTE ] TMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:44.416063] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-14T20:20:44.420478] [INFO ] [REMOTE ] TLK: Full fetch complete (43561 records). [2025-09-14T20:20:44.420679] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-14T20:20:44.568784] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-14T20:20:44.811057] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-14T20:20:44.811191] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-14T20:20:44.812273] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-14T20:20:44.812352] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-14T20:20:44.813467] [DEBUG] [LOCAL ] TLK: Trimmed 43561 records to 29077 (keeping 150 days of data) [2025-09-14T20:20:44.996083] [DEBUG] [LOCAL ] TLK: Primary data saved (29077 records). [2025-09-14T20:20:44.996286] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-14T20:20:44.996414] [INFO ] [MAIN ] Update Progress: 2104/2370 symbols completed. TLK took 28.9s. Estimated remaining: 28m 16s. Rate: 9.4 symbols/min [2025-09-14T20:20:45.176378] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:20:45.184507] [DEBUG] [LOCAL ] TNC: Loaded 6068 existing records from primary storage. [2025-09-14T20:20:45.184666] [INFO ] [MAIN ] TNC: Loaded 6068 existing records. [2025-09-14T20:20:45.359727] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-14T20:20:45.363231] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:45.364990] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-14T20:20:45.365072] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-14T20:20:45.365399] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-14T20:20:45.365466] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-14T20:20:45.717813] [INFO ] [REMOTE ] TNC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:45.749740] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T20:20:46.158844] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-14T20:20:46.312511] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T20:20:46.958824] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-14T20:20:47.086675] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T20:20:47.261176] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T20:20:47.758823] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-14T20:20:48.558863] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-14T20:20:48.876074] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T20:20:49.358794] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-14T20:20:49.682269] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T20:20:49.712924] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T20:20:50.158843] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-14T20:20:50.958796] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-14T20:20:51.235122] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T20:20:51.758803] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-14T20:20:51.870481] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T20:20:52.172690] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T20:20:52.558850] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-14T20:20:53.358827] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-14T20:20:53.814415] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T20:20:54.158888] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-14T20:20:54.336107] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T20:20:54.964242] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-14T20:20:54.979468] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T20:20:55.365417] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T20:20:55.374471] [INFO ] [REMOTE ] TME: Full fetch complete (57851 records). [2025-09-14T20:20:55.375100] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-14T20:20:55.759453] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-14T20:20:55.775463] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-14T20:20:55.775584] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-14T20:20:55.776900] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-14T20:20:55.777129] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-14T20:20:55.778584] [DEBUG] [LOCAL ] TME: Trimmed 57851 records to 40007 (keeping 150 days of data) [2025-09-14T20:20:56.031716] [DEBUG] [LOCAL ] TME: Primary data saved (40007 records). [2025-09-14T20:20:56.031900] [INFO ] [MAIN ] TME: Full history saved. [2025-09-14T20:20:56.032056] [INFO ] [MAIN ] Update Progress: 2105/2370 symbols completed. TME took 22.8s. Estimated remaining: 28m 10s. Rate: 9.4 symbols/min [2025-09-14T20:20:56.216543] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:20:56.217985] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T20:20:56.235955] [DEBUG] [LOCAL ] TNET: Loaded 13117 existing records from primary storage. [2025-09-14T20:20:56.236141] [INFO ] [MAIN ] TNET: Loaded 13117 existing records. [2025-09-14T20:20:56.417211] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:20:56.417512] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-14T20:20:56.417576] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-14T20:20:56.418087] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-14T20:20:56.418151] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-14T20:20:56.564024] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-14T20:20:56.784350] [INFO ] [REMOTE ] TNET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:20:57.358836] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-14T20:20:57.740526] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-14T20:20:58.158853] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-14T20:20:58.367326] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T20:20:58.921509] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T20:20:58.958788] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-14T20:20:59.479956] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T20:20:59.758815] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-14T20:21:00.335235] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T20:21:00.558845] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-14T20:21:01.358920] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-14T20:21:02.162073] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-14T20:21:02.174358] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-14T20:21:02.737522] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T20:21:02.958895] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-14T20:21:03.758826] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-14T20:21:04.915792] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (3.56 seconds). [2025-09-14T20:21:04.921178] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-14T20:21:05.594593] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (3.43 seconds). [2025-09-14T20:21:05.601983] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-14T20:21:06.065714] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-14T20:21:06.083742] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T20:21:06.158818] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-14T20:21:06.329938] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-14T20:21:06.668898] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T20:21:06.670837] [INFO ] [REMOTE ] TNC: Full fetch complete (17600 records). [2025-09-14T20:21:06.670953] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-14T20:21:06.959299] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-14T20:21:07.089615] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-14T20:21:07.089770] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-14T20:21:07.090549] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-14T20:21:07.090711] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-14T20:21:07.106913] [DEBUG] [LOCAL ] TNC: Trimmed 17600 records to 10792 (keeping 150 days of data) [2025-09-14T20:21:07.107485] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T20:21:07.192915] [DEBUG] [LOCAL ] TNC: Primary data saved (10792 records). [2025-09-14T20:21:07.193139] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-14T20:21:07.193266] [INFO ] [MAIN ] Update Progress: 2106/2370 symbols completed. TNC took 22.2s. Estimated remaining: 28m 4s. Rate: 9.4 symbols/min [2025-09-14T20:21:07.364081] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:07.368954] [DEBUG] [LOCAL ] TNGY: Loaded 2885 existing records from primary storage. [2025-09-14T20:21:07.369072] [INFO ] [MAIN ] TNGY: Loaded 2885 existing records. [2025-09-14T20:21:07.557508] [WARN ] [MAIN ] TNGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:07.557926] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-14T20:21:07.557998] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-14T20:21:07.558248] [DEBUG] [LOCAL ] TNGY: Deleted primary data file. [2025-09-14T20:21:07.558310] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-14T20:21:07.769084] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-14T20:21:07.917858] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:08.548799] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T20:21:08.555070] [INFO ] [REMOTE ] TMO: Full fetch complete (56891 records). [2025-09-14T20:21:08.555380] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-14T20:21:08.567813] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-14T20:21:08.964164] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T20:21:08.991771] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-14T20:21:08.992032] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-14T20:21:08.993213] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-14T20:21:08.993724] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-14T20:21:08.995028] [DEBUG] [LOCAL ] TMO: Trimmed 56891 records to 39523 (keeping 150 days of data) [2025-09-14T20:21:09.264137] [DEBUG] [LOCAL ] TMO: Primary data saved (39523 records). [2025-09-14T20:21:09.264336] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-14T20:21:09.264455] [INFO ] [MAIN ] Update Progress: 2107/2370 symbols completed. TMO took 25.8s. Estimated remaining: 27m 57s. Rate: 9.4 symbols/min [2025-09-14T20:21:09.364002] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-14T20:21:09.445030] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:09.462220] [DEBUG] [LOCAL ] TNK: Loaded 15207 existing records from primary storage. [2025-09-14T20:21:09.462394] [INFO ] [MAIN ] TNK: Loaded 15207 existing records. [2025-09-14T20:21:09.644951] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:09.645223] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-14T20:21:09.645286] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-14T20:21:09.645854] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-14T20:21:09.645929] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-14T20:21:10.011693] [INFO ] [REMOTE ] TNK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:10.026598] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T20:21:10.158836] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-14T20:21:10.929596] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T20:21:10.958804] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-14T20:21:11.273607] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:21:11.274084] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-14T20:21:11.705078] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T20:21:11.758829] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-14T20:21:12.021981] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:21:12.022437] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-14T20:21:12.558830] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-14T20:21:13.358845] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-14T20:21:13.609261] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:21:13.609700] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-14T20:21:13.959318] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T20:21:14.158855] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-14T20:21:14.487028] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:21:14.487425] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-14T20:21:14.958833] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-14T20:21:15.758834] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-14T20:21:16.558846] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-14T20:21:17.358814] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-14T20:21:17.389551] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-14T20:21:17.684266] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:21:18.056881] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:21:18.062371] [INFO ] [REMOTE ] TMHC: Full fetch complete (49802 records). [2025-09-14T20:21:18.062600] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-14T20:21:18.163663] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-14T20:21:18.459580] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-14T20:21:18.459791] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-14T20:21:18.461328] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-14T20:21:18.461461] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-14T20:21:18.463322] [DEBUG] [LOCAL ] TMHC: Trimmed 49802 records to 34007 (keeping 150 days of data) [2025-09-14T20:21:18.547947] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-14T20:21:18.702923] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T20:21:18.739727] [DEBUG] [LOCAL ] TMHC: Primary data saved (34007 records). [2025-09-14T20:21:18.739998] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-14T20:21:18.740136] [INFO ] [MAIN ] Update Progress: 2108/2370 symbols completed. TMHC took 40.0s. Estimated remaining: 27m 51s. Rate: 9.4 symbols/min [2025-09-14T20:21:18.920470] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:18.941732] [DEBUG] [LOCAL ] TNL: Loaded 18430 existing records from primary storage. [2025-09-14T20:21:18.942008] [INFO ] [MAIN ] TNL: Loaded 18430 existing records. [2025-09-14T20:21:18.964027] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-14T20:21:19.129567] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:19.129968] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-14T20:21:19.130038] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-14T20:21:19.130583] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-14T20:21:19.130708] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-14T20:21:19.499736] [INFO ] [REMOTE ] TNL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:19.758843] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-14T20:21:20.141981] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T20:21:20.145129] [INFO ] [REMOTE ] TNET: Full fetch complete (32677 records). [2025-09-14T20:21:20.145239] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-14T20:21:20.558681] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-14T20:21:20.558888] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-14T20:21:20.558805] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-14T20:21:20.560891] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-14T20:21:20.561061] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-14T20:21:20.562179] [DEBUG] [LOCAL ] TNET: Trimmed 32677 records to 21396 (keeping 150 days of data) [2025-09-14T20:21:20.636794] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T20:21:20.718501] [DEBUG] [LOCAL ] TNET: Primary data saved (21396 records). [2025-09-14T20:21:20.718731] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-14T20:21:20.718876] [INFO ] [MAIN ] Update Progress: 2109/2370 symbols completed. TNET took 24.7s. Estimated remaining: 27m 44s. Rate: 9.4 symbols/min [2025-09-14T20:21:20.908583] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:20.934180] [DEBUG] [LOCAL ] TOL: Loaded 22755 existing records from primary storage. [2025-09-14T20:21:20.934382] [INFO ] [MAIN ] TOL: Loaded 22755 existing records. [2025-09-14T20:21:21.123090] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:21.123387] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-14T20:21:21.123483] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-14T20:21:21.124163] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-14T20:21:21.124243] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-14T20:21:21.364053] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-14T20:21:21.514682] [INFO ] [REMOTE ] TOL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:22.158878] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-14T20:21:22.219492] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T20:21:22.315818] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T20:21:22.317261] [INFO ] [REMOTE ] TNGY: Full fetch complete (2885 records). [2025-09-14T20:21:22.317352] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-14T20:21:22.492818] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 62 unique days, need 150 days [2025-09-14T20:21:22.493066] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:21:22.493120] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:21:22.493171] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-14T20:21:22.493241] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-14T20:21:22.493288] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-14T20:21:22.493346] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-14T20:21:22.493441] [INFO ] [MAIN ] Update Progress: 2110/2370 symbols completed. TNGY took 15.3s. Estimated remaining: 27m 37s. Rate: 9.4 symbols/min [2025-09-14T20:21:22.674250] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:22.700168] [DEBUG] [LOCAL ] TOST: Loaded 24054 existing records from primary storage. [2025-09-14T20:21:22.700371] [INFO ] [MAIN ] TOST: Loaded 24054 existing records. [2025-09-14T20:21:22.884600] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:22.884931] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-14T20:21:22.885008] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-14T20:21:22.885590] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-14T20:21:22.885712] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-14T20:21:22.964023] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-14T20:21:23.270340] [INFO ] [REMOTE ] TOST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:23.485668] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T20:21:23.758844] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-14T20:21:24.248247] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T20:21:24.558847] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-14T20:21:25.083881] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T20:21:25.358858] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-14T20:21:26.011057] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T20:21:26.158866] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-14T20:21:26.958836] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-14T20:21:27.152674] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T20:21:27.664372] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T20:21:27.758841] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-14T20:21:28.558875] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-14T20:21:28.954096] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T20:21:29.358909] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-14T20:21:29.487713] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T20:21:30.158898] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-14T20:21:30.547736] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T20:21:30.958902] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-14T20:21:31.063329] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T20:21:31.586666] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T20:21:31.758817] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-14T20:21:32.558895] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-14T20:21:32.940555] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T20:21:33.014822] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T20:21:33.358854] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-14T20:21:33.824714] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T20:21:33.828594] [INFO ] [REMOTE ] TNK: Full fetch complete (38777 records). [2025-09-14T20:21:33.828751] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-14T20:21:34.173628] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-14T20:21:34.227403] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-14T20:21:34.227527] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-14T20:21:34.228434] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-14T20:21:34.228506] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-14T20:21:34.229625] [DEBUG] [LOCAL ] TNK: Trimmed 38777 records to 26640 (keeping 150 days of data) [2025-09-14T20:21:34.409959] [DEBUG] [LOCAL ] TNK: Primary data saved (26640 records). [2025-09-14T20:21:34.410152] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-14T20:21:34.410299] [INFO ] [MAIN ] Update Progress: 2111/2370 symbols completed. TNK took 25.1s. Estimated remaining: 27m 32s. Rate: 9.4 symbols/min [2025-09-14T20:21:34.578721] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:34.592025] [DEBUG] [LOCAL ] TPB: Loaded 12596 existing records from primary storage. [2025-09-14T20:21:34.592177] [INFO ] [MAIN ] TPB: Loaded 12596 existing records. [2025-09-14T20:21:34.774685] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:34.774968] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-14T20:21:34.775033] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-14T20:21:34.775410] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-14T20:21:34.775476] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-14T20:21:34.970243] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-14T20:21:35.167905] [INFO ] [REMOTE ] TPB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:35.200074] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T20:21:35.758858] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-14T20:21:35.891232] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:21:36.558837] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-14T20:21:36.794267] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T20:21:37.358848] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-14T20:21:37.507300] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T20:21:38.158913] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-14T20:21:38.233803] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T20:21:38.958785] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-14T20:21:39.171537] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T20:21:39.343036] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T20:21:39.758844] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-14T20:21:40.447242] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T20:21:40.452122] [INFO ] [REMOTE ] TNL: Full fetch complete (45662 records). [2025-09-14T20:21:40.452254] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-14T20:21:40.563913] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-14T20:21:40.827538] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-14T20:21:40.827673] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-14T20:21:40.828706] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-14T20:21:40.828774] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-14T20:21:40.829976] [DEBUG] [LOCAL ] TNL: Trimmed 45662 records to 31415 (keeping 150 days of data) [2025-09-14T20:21:41.047155] [DEBUG] [LOCAL ] TNL: Primary data saved (31415 records). [2025-09-14T20:21:41.047349] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-14T20:21:41.047472] [INFO ] [MAIN ] Update Progress: 2112/2370 symbols completed. TNL took 22.3s. Estimated remaining: 27m 25s. Rate: 9.4 symbols/min [2025-09-14T20:21:41.227550] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:41.261800] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-14T20:21:41.287012] [DEBUG] [LOCAL ] TPC: Loaded 17883 existing records from primary storage. [2025-09-14T20:21:41.287182] [INFO ] [MAIN ] TPC: Loaded 17883 existing records. [2025-09-14T20:21:41.363897] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-14T20:21:41.464901] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:41.465278] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-14T20:21:41.465349] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-14T20:21:41.465886] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-14T20:21:41.466015] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-14T20:21:41.609394] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T20:21:41.864226] [INFO ] [REMOTE ] TPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:42.158895] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-14T20:21:42.958909] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-14T20:21:43.522169] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T20:21:43.758796] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-14T20:21:44.175138] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T20:21:44.250606] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-14T20:21:44.558840] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-14T20:21:45.358801] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-14T20:21:45.727225] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T20:21:45.751581] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T20:21:46.158853] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-14T20:21:46.958859] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-14T20:21:47.435905] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T20:21:47.579104] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-14T20:21:47.758832] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-14T20:21:48.034891] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T20:21:48.558846] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-14T20:21:48.853621] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T20:21:49.358902] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-14T20:21:50.028872] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:21:50.036466] [INFO ] [REMOTE ] TOL: Full fetch complete (55736 records). [2025-09-14T20:21:50.036755] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-14T20:21:50.162164] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-14T20:21:50.354067] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T20:21:50.471050] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-14T20:21:50.471165] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-14T20:21:50.472492] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-14T20:21:50.472570] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-14T20:21:50.474690] [DEBUG] [LOCAL ] TOL: Trimmed 55736 records to 38231 (keeping 150 days of data) [2025-09-14T20:21:50.733374] [DEBUG] [LOCAL ] TOL: Primary data saved (38231 records). [2025-09-14T20:21:50.733574] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-14T20:21:50.733770] [INFO ] [MAIN ] Update Progress: 2113/2370 symbols completed. TOL took 30.0s. Estimated remaining: 27m 19s. Rate: 9.4 symbols/min [2025-09-14T20:21:50.901675] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:50.921531] [DEBUG] [LOCAL ] TPH: Loaded 20016 existing records from primary storage. [2025-09-14T20:21:50.921729] [INFO ] [MAIN ] TPH: Loaded 20016 existing records. [2025-09-14T20:21:50.963937] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-14T20:21:51.141693] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:51.141983] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-14T20:21:51.142062] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-14T20:21:51.142510] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-14T20:21:51.142572] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-14T20:21:51.501176] [INFO ] [REMOTE ] TPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:51.700516] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T20:21:51.758837] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-14T20:21:52.563935] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-14T20:21:52.580999] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T20:21:53.358893] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-14T20:21:53.693971] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T20:21:53.697182] [INFO ] [REMOTE ] TPB: Full fetch complete (26694 records). [2025-09-14T20:21:53.697368] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-14T20:21:54.085533] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-14T20:21:54.085763] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-14T20:21:54.086590] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-14T20:21:54.086717] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-14T20:21:54.088410] [DEBUG] [LOCAL ] TPB: Trimmed 26694 records to 19050 (keeping 150 days of data) [2025-09-14T20:21:54.172263] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-14T20:21:54.122897] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-14T20:21:54.259681] [DEBUG] [LOCAL ] TPB: Primary data saved (19050 records). [2025-09-14T20:21:54.259873] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-14T20:21:54.260002] [INFO ] [MAIN ] Update Progress: 2114/2370 symbols completed. TPB took 19.8s. Estimated remaining: 27m 13s. Rate: 9.4 symbols/min [2025-09-14T20:21:54.432121] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:54.441281] [DEBUG] [LOCAL ] TPL: Loaded 5714 existing records from primary storage. [2025-09-14T20:21:54.441467] [INFO ] [MAIN ] TPL: Loaded 5714 existing records. [2025-09-14T20:21:54.626519] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:54.627008] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-14T20:21:54.627105] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-14T20:21:54.627487] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-14T20:21:54.627705] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-14T20:21:54.935857] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T20:21:54.963906] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-14T20:21:55.026918] [INFO ] [REMOTE ] TPL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:55.758869] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-14T20:21:55.807031] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T20:21:56.558884] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-14T20:21:56.722537] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T20:21:57.358845] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-14T20:21:57.568933] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-14T20:21:57.575064] [INFO ] [REMOTE ] TOST: Full fetch complete (58360 records). [2025-09-14T20:21:57.575180] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-14T20:21:57.968690] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-14T20:21:57.968810] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-14T20:21:57.969907] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-14T20:21:57.969965] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-14T20:21:57.971605] [DEBUG] [LOCAL ] TOST: Trimmed 58360 records to 40430 (keeping 150 days of data) [2025-09-14T20:21:58.163793] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-14T20:21:58.249510] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T20:21:58.277253] [DEBUG] [LOCAL ] TOST: Primary data saved (40430 records). [2025-09-14T20:21:58.277450] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-14T20:21:58.277621] [INFO ] [MAIN ] Update Progress: 2115/2370 symbols completed. TOST took 35.8s. Estimated remaining: 27m 6s. Rate: 9.4 symbols/min [2025-09-14T20:21:58.452539] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:21:58.477804] [DEBUG] [LOCAL ] TPR: Loaded 23953 existing records from primary storage. [2025-09-14T20:21:58.477990] [INFO ] [MAIN ] TPR: Loaded 23953 existing records. [2025-09-14T20:21:58.661326] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:21:58.661577] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-14T20:21:58.661638] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-14T20:21:58.662230] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-14T20:21:58.662294] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-14T20:21:58.961267] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-14T20:21:59.034127] [INFO ] [REMOTE ] TPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:21:59.042265] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T20:21:59.074876] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T20:21:59.758822] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-14T20:22:00.558875] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-14T20:22:00.811351] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T20:22:01.358856] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-14T20:22:01.485616] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T20:22:01.562953] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T20:22:02.158839] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-14T20:22:02.467292] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T20:22:02.958857] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-14T20:22:03.397967] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T20:22:03.758807] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-14T20:22:04.558862] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-14T20:22:04.931826] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T20:22:04.951179] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T20:22:05.358841] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-14T20:22:06.158795] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-14T20:22:06.196353] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T20:22:06.919972] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T20:22:06.958776] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-14T20:22:07.104320] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T20:22:07.758863] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-14T20:22:08.419185] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T20:22:08.558857] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-14T20:22:09.119024] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T20:22:09.123307] [INFO ] [REMOTE ] TPC: Full fetch complete (41863 records). [2025-09-14T20:22:09.123475] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-14T20:22:09.363908] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-14T20:22:09.522888] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-14T20:22:09.522999] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-14T20:22:09.523972] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-14T20:22:09.524029] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-14T20:22:09.525128] [DEBUG] [LOCAL ] TPC: Trimmed 41863 records to 29823 (keeping 150 days of data) [2025-09-14T20:22:09.638918] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T20:22:09.751072] [DEBUG] [LOCAL ] TPC: Primary data saved (29823 records). [2025-09-14T20:22:09.751351] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-14T20:22:09.751481] [INFO ] [MAIN ] Update Progress: 2116/2370 symbols completed. TPC took 28.7s. Estimated remaining: 27m 0s. Rate: 9.4 symbols/min [2025-09-14T20:22:09.925526] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:09.940136] [DEBUG] [LOCAL ] TPVG: Loaded 11695 existing records from primary storage. [2025-09-14T20:22:09.940321] [INFO ] [MAIN ] TPVG: Loaded 11695 existing records. [2025-09-14T20:22:10.123379] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:10.123701] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-14T20:22:10.123766] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-14T20:22:10.124151] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-14T20:22:10.124229] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-14T20:22:10.167559] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-14T20:22:10.489254] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:10.536195] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T20:22:10.563223] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T20:22:10.568258] [INFO ] [REMOTE ] TPH: Full fetch complete (49448 records). [2025-09-14T20:22:10.568376] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-14T20:22:10.969286] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-14T20:22:10.989718] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-14T20:22:10.989814] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-14T20:22:10.990889] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-14T20:22:10.990950] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-14T20:22:10.992318] [DEBUG] [LOCAL ] TPH: Trimmed 49448 records to 33799 (keeping 150 days of data) [2025-09-14T20:22:11.217038] [DEBUG] [LOCAL ] TPH: Primary data saved (33799 records). [2025-09-14T20:22:11.217337] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-14T20:22:11.217502] [INFO ] [MAIN ] Update Progress: 2117/2370 symbols completed. TPH took 20.5s. Estimated remaining: 26m 53s. Rate: 9.4 symbols/min [2025-09-14T20:22:11.758855] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-14T20:22:12.305856] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T20:22:12.558843] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-14T20:22:12.642989] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T20:22:13.358831] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-14T20:22:13.667923] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T20:22:14.158820] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-14T20:22:14.259455] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T20:22:14.958859] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-14T20:22:15.254092] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T20:22:15.758828] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-14T20:22:16.340758] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T20:22:16.558882] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-14T20:22:16.800336] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T20:22:17.358814] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-14T20:22:17.580318] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T20:22:18.158852] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-14T20:22:18.377155] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T20:22:18.958869] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-14T20:22:19.430033] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T20:22:19.438808] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T20:22:19.440901] [INFO ] [REMOTE ] TPL: Full fetch complete (13332 records). [2025-09-14T20:22:19.440992] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-14T20:22:19.763880] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-14T20:22:19.821446] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-14T20:22:19.821580] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-14T20:22:19.821960] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-14T20:22:19.822018] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-14T20:22:19.822623] [DEBUG] [LOCAL ] TPL: Trimmed 13332 records to 9241 (keeping 150 days of data) [2025-09-14T20:22:19.887316] [DEBUG] [LOCAL ] TPL: Primary data saved (9241 records). [2025-09-14T20:22:19.887511] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-14T20:22:19.887658] [INFO ] [MAIN ] Update Progress: 2118/2370 symbols completed. TPL took 25.6s. Estimated remaining: 26m 47s. Rate: 9.4 symbols/min [2025-09-14T20:22:20.558878] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-14T20:22:21.228096] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T20:22:21.277172] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:22:21.282835] [INFO ] [REMOTE ] TPR: Full fetch complete (58161 records). [2025-09-14T20:22:21.282996] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-14T20:22:21.363932] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-14T20:22:21.674243] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-14T20:22:21.674380] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-14T20:22:21.675552] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-14T20:22:21.675619] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-14T20:22:21.677249] [DEBUG] [LOCAL ] TPR: Trimmed 58161 records to 40259 (keeping 150 days of data) [2025-09-14T20:22:21.972098] [DEBUG] [LOCAL ] TPR: Primary data saved (40259 records). [2025-09-14T20:22:21.972272] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-14T20:22:21.972381] [INFO ] [MAIN ] Update Progress: 2119/2370 symbols completed. TPR took 23.7s. Estimated remaining: 26m 40s. Rate: 9.4 symbols/min [2025-09-14T20:22:22.680587] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T20:22:22.686312] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-14T20:22:23.938198] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T20:22:23.944533] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-14T20:22:25.068264] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T20:22:25.071397] [INFO ] [REMOTE ] TPVG: Full fetch complete (28776 records). [2025-09-14T20:22:25.071494] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-14T20:22:25.437840] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-14T20:22:25.437966] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-14T20:22:25.438961] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-14T20:22:25.439050] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-14T20:22:25.440134] [DEBUG] [LOCAL ] TPVG: Trimmed 28776 records to 19289 (keeping 150 days of data) [2025-09-14T20:22:25.558417] [DEBUG] [LOCAL ] TPVG: Primary data saved (19289 records). [2025-09-14T20:22:25.558596] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-14T20:22:25.558738] [INFO ] [MAIN ] Update Progress: 2120/2370 symbols completed. TPVG took 15.8s. Estimated remaining: 26m 34s. Rate: 9.4 symbols/min [2025-09-14T20:22:26.053918] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:26.164786] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:26.225901] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:26.243270] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:26.245282] [DEBUG] [LOCAL ] TPZ: Loaded 1943 existing records from primary storage. [2025-09-14T20:22:26.246428] [INFO ] [MAIN ] TPZ: Loaded 1943 existing records. [2025-09-14T20:22:26.316284] [DEBUG] [LOCAL ] TPYP: Loaded 3339 existing records from primary storage. [2025-09-14T20:22:26.352890] [INFO ] [MAIN ] TPYP: Loaded 3339 existing records. [2025-09-14T20:22:26.342582] [DEBUG] [LOCAL ] TRAK: Loaded 4551 existing records from primary storage. [2025-09-14T20:22:26.383082] [INFO ] [MAIN ] TRAK: Loaded 4551 existing records. [2025-09-14T20:22:26.362751] [DEBUG] [LOCAL ] TR: Loaded 9188 existing records from primary storage. [2025-09-14T20:22:26.418077] [INFO ] [MAIN ] TR: Loaded 9188 existing records. [2025-09-14T20:22:26.722318] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:26.770012] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-14T20:22:26.899260] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-14T20:22:26.993983] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-14T20:22:27.058436] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-14T20:22:27.048714] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:27.056360] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:27.058234] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:27.064342] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-14T20:22:27.080191] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-14T20:22:27.102949] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-14T20:22:27.085438] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-14T20:22:27.102744] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-14T20:22:27.117350] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-14T20:22:27.147293] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-14T20:22:27.158425] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-14T20:22:27.183070] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-14T20:22:27.182902] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-14T20:22:27.186190] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-14T20:22:27.184875] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-14T20:22:28.163929] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:28.299593] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-14T20:22:28.635121] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:28.583855] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:28.653184] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-14T20:22:28.657225] [INFO ] [REMOTE ] TR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:28.657452] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-14T20:22:28.659433] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-14T20:22:29.252630] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T20:22:29.255154] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-14T20:22:29.451375] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T20:22:29.453571] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-14T20:22:29.521676] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T20:22:29.524266] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-14T20:22:29.605329] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T20:22:29.608777] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-14T20:22:30.063062] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T20:22:30.139142] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T20:22:30.158784] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-14T20:22:30.340463] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:22:30.354114] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T20:22:30.958847] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-14T20:22:31.027765] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T20:22:31.758824] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-14T20:22:32.085248] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T20:22:32.558799] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-14T20:22:32.727146] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T20:22:33.358858] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-14T20:22:33.507374] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T20:22:33.836571] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T20:22:34.158872] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-14T20:22:34.958850] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-14T20:22:35.348470] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T20:22:35.746531] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T20:22:35.758766] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-14T20:22:36.410792] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T20:22:36.558831] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-14T20:22:37.358800] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-14T20:22:37.729600] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T20:22:37.978068] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T20:22:38.158844] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-14T20:22:38.958824] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-14T20:22:39.309113] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T20:22:39.741773] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-14T20:22:39.758767] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-14T20:22:40.396820] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T20:22:40.558815] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-14T20:22:41.125271] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T20:22:41.127696] [INFO ] [REMOTE ] TR: Full fetch complete (19338 records). [2025-09-14T20:22:41.127783] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-14T20:22:41.368329] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-14T20:22:41.530783] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-14T20:22:41.530893] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-14T20:22:41.531423] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-14T20:22:41.531488] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-14T20:22:41.532179] [DEBUG] [LOCAL ] TR: Trimmed 19338 records to 14756 (keeping 150 days of data) [2025-09-14T20:22:41.627840] [DEBUG] [LOCAL ] TR: Primary data saved (14756 records). [2025-09-14T20:22:41.628017] [INFO ] [MAIN ] TR: Full history saved. [2025-09-14T20:22:41.628131] [INFO ] [MAIN ] Update Progress: 2121/2370 symbols completed. TR took 16.0s. Estimated remaining: 26m 28s. Rate: 9.4 symbols/min [2025-09-14T20:22:41.797776] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:41.806486] [DEBUG] [LOCAL ] TRC: Loaded 6512 existing records from primary storage. [2025-09-14T20:22:41.806629] [INFO ] [MAIN ] TRC: Loaded 6512 existing records. [2025-09-14T20:22:41.981688] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:41.981951] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-14T20:22:41.982010] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-14T20:22:41.982353] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-14T20:22:41.982413] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-14T20:22:42.169534] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-14T20:22:42.342470] [INFO ] [REMOTE ] TRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:42.348523] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T20:22:42.808979] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T20:22:42.810048] [INFO ] [REMOTE ] TPZ: Full fetch complete (6076 records). [2025-09-14T20:22:42.810132] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-14T20:22:42.963920] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-14T20:22:43.175490] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-14T20:22:43.175601] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-14T20:22:43.175852] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-14T20:22:43.175912] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-14T20:22:43.176331] [DEBUG] [LOCAL ] TPZ: Trimmed 6076 records to 3453 (keeping 150 days of data) [2025-09-14T20:22:43.197479] [DEBUG] [LOCAL ] TPZ: Primary data saved (3453 records). [2025-09-14T20:22:43.197588] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-14T20:22:43.197720] [INFO ] [MAIN ] Update Progress: 2122/2370 symbols completed. TPZ took 17.6s. Estimated remaining: 26m 21s. Rate: 9.4 symbols/min [2025-09-14T20:22:43.370359] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:43.393795] [DEBUG] [LOCAL ] TREX: Loaded 22363 existing records from primary storage. [2025-09-14T20:22:43.393983] [INFO ] [MAIN ] TREX: Loaded 22363 existing records. [2025-09-14T20:22:43.566902] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:43.567171] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-14T20:22:43.567232] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-14T20:22:43.567910] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-14T20:22:43.567973] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-14T20:22:43.764180] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-14T20:22:43.939961] [INFO ] [REMOTE ] TREX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:43.948869] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T20:22:44.558831] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-14T20:22:44.710825] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T20:22:45.358848] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-14T20:22:45.388439] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T20:22:46.158892] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-14T20:22:46.830258] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T20:22:46.958856] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-14T20:22:47.034817] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T20:22:47.758841] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-14T20:22:48.068344] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T20:22:48.554081] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T20:22:48.558772] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-14T20:22:49.190491] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T20:22:49.191780] [INFO ] [REMOTE ] TPYP: Full fetch complete (8874 records). [2025-09-14T20:22:49.191861] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-14T20:22:49.366605] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-14T20:22:49.569947] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-14T20:22:49.570086] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-14T20:22:49.570505] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-14T20:22:49.570570] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-14T20:22:49.571076] [DEBUG] [LOCAL ] TPYP: Trimmed 8874 records to 5927 (keeping 150 days of data) [2025-09-14T20:22:49.609384] [DEBUG] [LOCAL ] TPYP: Primary data saved (5927 records). [2025-09-14T20:22:49.609564] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-14T20:22:49.609712] [INFO ] [MAIN ] Update Progress: 2123/2370 symbols completed. TPYP took 24.0s. Estimated remaining: 26m 15s. Rate: 9.4 symbols/min [2025-09-14T20:22:49.778001] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:49.800733] [DEBUG] [LOCAL ] TRGP: Loaded 22376 existing records from primary storage. [2025-09-14T20:22:49.800894] [INFO ] [MAIN ] TRGP: Loaded 22376 existing records. [2025-09-14T20:22:49.976925] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:49.977180] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-14T20:22:49.977240] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-14T20:22:49.977948] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-14T20:22:49.978041] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-14T20:22:50.169315] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-14T20:22:50.343331] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:50.958836] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-14T20:22:51.128859] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T20:22:51.312921] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T20:22:51.758834] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-14T20:22:52.558836] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-14T20:22:52.718625] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T20:22:53.358829] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-14T20:22:53.413607] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T20:22:53.652551] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T20:22:54.158883] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-14T20:22:54.958857] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-14T20:22:55.310569] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T20:22:55.594569] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T20:22:55.758821] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-14T20:22:55.891584] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T20:22:56.558847] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-14T20:22:57.358848] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-14T20:22:57.402174] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T20:22:57.702916] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T20:22:57.885388] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T20:22:57.887156] [INFO ] [REMOTE ] TRAK: Full fetch complete (10148 records). [2025-09-14T20:22:57.887243] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-14T20:22:58.164039] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-14T20:22:58.274009] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-14T20:22:58.274137] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-14T20:22:58.274462] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-14T20:22:58.274516] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-14T20:22:58.275035] [DEBUG] [LOCAL ] TRAK: Trimmed 10148 records to 6788 (keeping 150 days of data) [2025-09-14T20:22:58.322078] [DEBUG] [LOCAL ] TRAK: Primary data saved (6788 records). [2025-09-14T20:22:58.322340] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-14T20:22:58.322491] [INFO ] [MAIN ] Update Progress: 2124/2370 symbols completed. TRAK took 32.8s. Estimated remaining: 26m 9s. Rate: 9.4 symbols/min [2025-09-14T20:22:58.504714] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:22:58.525514] [DEBUG] [LOCAL ] TRN: Loaded 17512 existing records from primary storage. [2025-09-14T20:22:58.525817] [INFO ] [MAIN ] TRN: Loaded 17512 existing records. [2025-09-14T20:22:58.723612] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:22:58.724105] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-14T20:22:58.724196] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-14T20:22:58.724945] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-14T20:22:58.725038] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-14T20:22:58.964064] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-14T20:22:59.120094] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T20:22:59.124299] [INFO ] [REMOTE ] TRN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:22:59.758854] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-14T20:23:00.558859] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-14T20:23:01.358930] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-14T20:23:02.301325] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T20:23:02.312478] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-14T20:23:02.363554] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T20:23:02.958851] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-14T20:23:03.776166] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T20:23:03.779755] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-14T20:23:04.130912] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T20:23:04.531399] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T20:23:04.533408] [INFO ] [REMOTE ] TRC: Full fetch complete (17082 records). [2025-09-14T20:23:04.533511] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-14T20:23:04.565338] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-14T20:23:04.943180] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-14T20:23:04.943298] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-14T20:23:04.943939] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-14T20:23:04.943999] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-14T20:23:04.944669] [DEBUG] [LOCAL ] TRC: Trimmed 17082 records to 11739 (keeping 150 days of data) [2025-09-14T20:23:05.016443] [DEBUG] [LOCAL ] TRC: Primary data saved (11739 records). [2025-09-14T20:23:05.016628] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-14T20:23:05.016833] [INFO ] [MAIN ] Update Progress: 2125/2370 symbols completed. TRC took 23.4s. Estimated remaining: 26m 3s. Rate: 9.4 symbols/min [2025-09-14T20:23:05.192152] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:23:05.214408] [DEBUG] [LOCAL ] TRNO: Loaded 19713 existing records from primary storage. [2025-09-14T20:23:05.214699] [INFO ] [MAIN ] TRNO: Loaded 19713 existing records. [2025-09-14T20:23:05.407334] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:23:05.407747] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-14T20:23:05.407978] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-14T20:23:05.416224] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-14T20:23:05.428494] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-14T20:23:05.453046] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (5.69 seconds). [2025-09-14T20:23:05.513307] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-14T20:23:05.682005] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T20:23:05.740798] [INFO ] [REMOTE ] TREX: Full fetch complete (54126 records). [2025-09-14T20:23:05.782211] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-14T20:23:05.906068] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:23:06.162405] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-14T20:23:06.268479] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-14T20:23:06.268721] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-14T20:23:06.270003] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-14T20:23:06.270170] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-14T20:23:06.299132] [DEBUG] [LOCAL ] TREX: Trimmed 54126 records to 37191 (keeping 150 days of data) [2025-09-14T20:23:06.301076] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (7.34 seconds). [2025-09-14T20:23:06.542014] [DEBUG] [LOCAL ] TREX: Primary data saved (37191 records). [2025-09-14T20:23:06.542210] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-14T20:23:06.542323] [INFO ] [MAIN ] Update Progress: 2126/2370 symbols completed. TREX took 23.3s. Estimated remaining: 25m 56s. Rate: 9.4 symbols/min [2025-09-14T20:23:06.711406] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:23:06.734379] [DEBUG] [LOCAL ] TROX: Loaded 23299 existing records from primary storage. [2025-09-14T20:23:06.734587] [INFO ] [MAIN ] TROX: Loaded 23299 existing records. [2025-09-14T20:23:06.918617] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:23:06.918904] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-14T20:23:06.918972] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-14T20:23:06.919527] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-14T20:23:06.919594] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-14T20:23:06.983154] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-14T20:23:07.360608] [INFO ] [REMOTE ] TROX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:23:07.393934] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T20:23:07.758920] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-14T20:23:07.771053] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T20:23:08.558835] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-14T20:23:08.989416] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T20:23:09.358835] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-14T20:23:09.386553] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T20:23:09.884352] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T20:23:10.158847] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-14T20:23:10.960782] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-14T20:23:10.963551] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T20:23:11.758834] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-14T20:23:11.976253] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T20:23:12.558795] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-14T20:23:12.667444] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T20:23:13.180688] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T20:23:13.358826] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-14T20:23:14.158862] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-14T20:23:14.349617] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T20:23:14.847060] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T20:23:14.958938] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-14T20:23:15.619089] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T20:23:15.758785] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-14T20:23:16.558850] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-14T20:23:16.641048] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T20:23:17.358863] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-14T20:23:17.466661] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T20:23:18.158866] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-14T20:23:18.356426] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T20:23:18.958914] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-14T20:23:19.125572] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T20:23:19.758813] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T20:23:19.758877] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-14T20:23:20.451243] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T20:23:20.456631] [INFO ] [REMOTE ] TRGP: Full fetch complete (55352 records). [2025-09-14T20:23:20.456852] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-14T20:23:20.563096] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-14T20:23:20.852447] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-14T20:23:20.860689] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-14T20:23:20.873289] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-14T20:23:20.875924] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-14T20:23:20.877790] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T20:23:20.887208] [DEBUG] [LOCAL ] TRGP: Trimmed 55352 records to 38197 (keeping 150 days of data) [2025-09-14T20:23:21.137850] [DEBUG] [LOCAL ] TRGP: Primary data saved (38197 records). [2025-09-14T20:23:21.138021] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-14T20:23:21.138185] [INFO ] [MAIN ] Update Progress: 2127/2370 symbols completed. TRGP took 31.5s. Estimated remaining: 25m 50s. Rate: 9.4 symbols/min [2025-09-14T20:23:21.308121] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:23:21.330825] [DEBUG] [LOCAL ] TRP: Loaded 23260 existing records from primary storage. [2025-09-14T20:23:21.331010] [INFO ] [MAIN ] TRP: Loaded 23260 existing records. [2025-09-14T20:23:21.363990] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-14T20:23:21.515126] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:23:21.515397] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-14T20:23:21.515457] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-14T20:23:21.516033] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-14T20:23:21.516098] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-14T20:23:21.875730] [INFO ] [REMOTE ] TRP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:23:22.158850] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-14T20:23:22.218666] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T20:23:22.958882] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-14T20:23:23.270022] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T20:23:23.758916] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-14T20:23:23.957743] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T20:23:24.222988] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T20:23:24.401503] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T20:23:24.405284] [INFO ] [REMOTE ] TRN: Full fetch complete (40742 records). [2025-09-14T20:23:24.405434] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-14T20:23:24.564605] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-14T20:23:24.784104] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-14T20:23:24.784218] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-14T20:23:24.785111] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-14T20:23:24.785179] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-14T20:23:24.786230] [DEBUG] [LOCAL ] TRN: Trimmed 40742 records to 27878 (keeping 150 days of data) [2025-09-14T20:23:24.963588] [DEBUG] [LOCAL ] TRN: Primary data saved (27878 records). [2025-09-14T20:23:24.963839] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-14T20:23:24.964029] [INFO ] [MAIN ] Update Progress: 2128/2370 symbols completed. TRN took 26.6s. Estimated remaining: 25m 44s. Rate: 9.4 symbols/min [2025-09-14T20:23:25.147708] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:23:25.165912] [DEBUG] [LOCAL ] TRTX: Loaded 16038 existing records from primary storage. [2025-09-14T20:23:25.166164] [INFO ] [MAIN ] TRTX: Loaded 16038 existing records. [2025-09-14T20:23:25.355462] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:23:25.355895] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-14T20:23:25.355979] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-14T20:23:25.356411] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-14T20:23:25.356473] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-14T20:23:25.368503] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-14T20:23:25.762659] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:23:26.158848] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-14T20:23:26.458227] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T20:23:26.881365] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T20:23:26.958842] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-14T20:23:27.645565] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T20:23:27.758841] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-14T20:23:28.558852] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-14T20:23:28.955164] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T20:23:29.258499] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T20:23:29.308746] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T20:23:29.313441] [INFO ] [REMOTE ] TRNO: Full fetch complete (47984 records). [2025-09-14T20:23:29.313574] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-14T20:23:29.366509] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-14T20:23:29.695715] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-14T20:23:29.695837] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-14T20:23:29.696857] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-14T20:23:29.696916] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-14T20:23:29.698082] [DEBUG] [LOCAL ] TRNO: Trimmed 47984 records to 33264 (keeping 150 days of data) [2025-09-14T20:23:29.918673] [DEBUG] [LOCAL ] TRNO: Primary data saved (33264 records). [2025-09-14T20:23:29.918888] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-14T20:23:29.919004] [INFO ] [MAIN ] Update Progress: 2129/2370 symbols completed. TRNO took 24.9s. Estimated remaining: 25m 37s. Rate: 9.4 symbols/min [2025-09-14T20:23:30.092047] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:23:30.114460] [DEBUG] [LOCAL ] TRU: Loaded 22771 existing records from primary storage. [2025-09-14T20:23:30.114630] [INFO ] [MAIN ] TRU: Loaded 22771 existing records. [2025-09-14T20:23:30.168742] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-14T20:23:30.292474] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:23:30.292753] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-14T20:23:30.292814] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-14T20:23:30.293365] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-14T20:23:30.293425] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-14T20:23:30.642075] [INFO ] [REMOTE ] TRU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:23:30.958829] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-14T20:23:31.348605] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T20:23:31.603777] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T20:23:31.758889] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-14T20:23:32.558857] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-14T20:23:32.844722] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T20:23:33.181412] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T20:23:33.358878] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-14T20:23:34.158988] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-14T20:23:34.413670] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T20:23:34.958809] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-14T20:23:35.016944] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T20:23:35.692222] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T20:23:35.758856] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-14T20:23:36.558863] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-14T20:23:36.742689] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T20:23:37.358915] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-14T20:23:37.442752] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T20:23:37.448120] [INFO ] [REMOTE ] TROX: Full fetch complete (55925 records). [2025-09-14T20:23:37.448244] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-14T20:23:37.850418] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-14T20:23:37.850623] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-14T20:23:37.853188] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-14T20:23:37.853294] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-14T20:23:37.856373] [DEBUG] [LOCAL ] TROX: Trimmed 55925 records to 39171 (keeping 150 days of data) [2025-09-14T20:23:38.116175] [DEBUG] [LOCAL ] TROX: Primary data saved (39171 records). [2025-09-14T20:23:38.116411] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-14T20:23:38.116557] [INFO ] [MAIN ] Update Progress: 2130/2370 symbols completed. TROX took 31.6s. Estimated remaining: 25m 31s. Rate: 9.4 symbols/min [2025-09-14T20:23:38.165325] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-14T20:23:38.324787] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:23:38.349009] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T20:23:38.378849] [DEBUG] [LOCAL ] TRV: Loaded 21598 existing records from primary storage. [2025-09-14T20:23:38.379086] [INFO ] [MAIN ] TRV: Loaded 21598 existing records. [2025-09-14T20:23:38.578101] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:23:38.578586] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-14T20:23:38.578704] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-14T20:23:38.579406] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-14T20:23:38.579516] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-14T20:23:38.964007] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-14T20:23:38.969310] [INFO ] [REMOTE ] TRV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:23:39.217839] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T20:23:39.758861] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-14T20:23:40.010195] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T20:23:40.101143] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T20:23:40.558857] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-14T20:23:41.318532] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T20:23:41.358777] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-14T20:23:41.743521] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T20:23:41.747465] [INFO ] [REMOTE ] TRTX: Full fetch complete (40370 records). [2025-09-14T20:23:41.747592] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-14T20:23:42.128670] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-14T20:23:42.128812] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-14T20:23:42.129775] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-14T20:23:42.129834] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-14T20:23:42.131121] [DEBUG] [LOCAL ] TRTX: Trimmed 40370 records to 27077 (keeping 150 days of data) [2025-09-14T20:23:42.181231] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-14T20:23:42.292441] [DEBUG] [LOCAL ] TRTX: Primary data saved (27077 records). [2025-09-14T20:23:42.292631] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-14T20:23:42.292757] [INFO ] [MAIN ] Update Progress: 2131/2370 symbols completed. TRTX took 17.3s. Estimated remaining: 25m 24s. Rate: 9.4 symbols/min [2025-09-14T20:23:42.464772] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:23:42.487682] [DEBUG] [LOCAL ] TS: Loaded 23070 existing records from primary storage. [2025-09-14T20:23:42.487854] [INFO ] [MAIN ] TS: Loaded 23070 existing records. [2025-09-14T20:23:42.664197] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:23:42.664461] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-14T20:23:42.664532] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-14T20:23:42.665170] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-14T20:23:42.665234] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-14T20:23:42.961879] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-14T20:23:43.027078] [INFO ] [REMOTE ] TS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:23:43.041456] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T20:23:43.046964] [INFO ] [REMOTE ] TRP: Full fetch complete (56742 records). [2025-09-14T20:23:43.047264] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-14T20:23:43.366275] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T20:23:43.496713] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-14T20:23:43.496849] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-14T20:23:43.498280] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-14T20:23:43.498358] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-14T20:23:43.500472] [DEBUG] [LOCAL ] TRP: Trimmed 56742 records to 39171 (keeping 150 days of data) [2025-09-14T20:23:43.757910] [DEBUG] [LOCAL ] TRP: Primary data saved (39171 records). [2025-09-14T20:23:43.758095] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-14T20:23:43.758256] [INFO ] [MAIN ] Update Progress: 2132/2370 symbols completed. TRP took 22.6s. Estimated remaining: 25m 17s. Rate: 9.4 symbols/min [2025-09-14T20:23:43.764057] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-14T20:23:43.929708] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:23:43.943008] [DEBUG] [LOCAL ] TSE: Loaded 12728 existing records from primary storage. [2025-09-14T20:23:43.943157] [INFO ] [MAIN ] TSE: Loaded 12728 existing records. [2025-09-14T20:23:44.118058] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:23:44.118332] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-14T20:23:44.118395] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-14T20:23:44.118778] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-14T20:23:44.118846] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-14T20:23:44.471106] [INFO ] [REMOTE ] TSE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:23:44.558841] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-14T20:23:44.879060] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T20:23:45.292548] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T20:23:45.358805] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-14T20:23:45.749454] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T20:23:46.158840] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-14T20:23:46.958877] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-14T20:23:47.111955] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T20:23:47.758850] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-14T20:23:47.900449] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T20:23:48.380522] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T20:23:48.558884] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-14T20:23:49.345612] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T20:23:49.358759] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-14T20:23:49.418517] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T20:23:49.846769] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T20:23:50.158851] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-14T20:23:50.958872] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-14T20:23:51.758828] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-14T20:23:51.853314] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T20:23:52.558923] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-14T20:23:52.766433] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T20:23:53.029697] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T20:23:53.358921] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-14T20:23:54.158841] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-14T20:23:54.414790] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T20:23:54.823670] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T20:23:54.958835] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-14T20:23:55.665743] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T20:23:55.758801] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-14T20:23:56.250760] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T20:23:56.558836] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-14T20:23:57.358829] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-14T20:23:57.756809] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T20:23:58.158853] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-14T20:23:58.286944] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T20:23:58.324245] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T20:23:58.958856] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-14T20:23:59.706259] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-14T20:23:59.758909] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-14T20:23:59.960999] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T20:24:00.558909] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-14T20:24:00.631845] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T20:24:01.358882] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-14T20:24:02.158837] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-14T20:24:02.798035] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-14T20:24:02.958869] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-14T20:24:03.758933] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-14T20:24:04.238556] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-14T20:24:04.558870] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-14T20:24:04.697272] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-14T20:24:04.703933] [INFO ] [REMOTE ] TS: Full fetch complete (56291 records). [2025-09-14T20:24:04.704135] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-14T20:24:05.089735] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-14T20:24:05.089848] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-14T20:24:05.090932] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-14T20:24:05.091013] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-14T20:24:05.092225] [DEBUG] [LOCAL ] TS: Trimmed 56291 records to 38831 (keeping 150 days of data) [2025-09-14T20:24:05.350187] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T20:24:05.357469] [INFO ] [REMOTE ] TRV: Full fetch complete (52767 records). [2025-09-14T20:24:05.357589] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-14T20:24:05.631519] [DEBUG] [LOCAL ] TS: Primary data saved (38831 records). [2025-09-14T20:24:05.647766] [INFO ] [MAIN ] TS: Full history saved. [2025-09-14T20:24:05.673327] [INFO ] [MAIN ] Update Progress: 2133/2370 symbols completed. TS took 23.4s. Estimated remaining: 25m 13s. Rate: 9.4 symbols/min [2025-09-14T20:24:05.787247] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-14T20:24:05.888312] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-14T20:24:05.899524] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-14T20:24:05.920143] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-14T20:24:05.922816] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-14T20:24:05.923118] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-14T20:24:06.015924] [DEBUG] [LOCAL ] TRV: Trimmed 52767 records to 35927 (keeping 150 days of data) [2025-09-14T20:24:06.020980] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:06.022706] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-09-14T20:24:06.125281] [INFO ] [REMOTE ] TRU: Full fetch complete (55448 records). [2025-09-14T20:24:06.131037] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-14T20:24:06.134901] [DEBUG] [LOCAL ] TSI: Loaded 4133 existing records from primary storage. [2025-09-14T20:24:06.136314] [INFO ] [MAIN ] TSI: Loaded 4133 existing records. [2025-09-14T20:24:06.504263] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:06.538846] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-14T20:24:06.557948] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-14T20:24:06.592595] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-14T20:24:06.606024] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-14T20:24:06.985991] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-14T20:24:07.076332] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-14T20:24:07.112348] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-14T20:24:07.127121] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-14T20:24:07.186930] [DEBUG] [LOCAL ] TRU: Trimmed 55448 records to 38342 (keeping 150 days of data) [2025-09-14T20:24:07.198129] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T20:24:07.264956] [INFO ] [REMOTE ] TSI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:07.274729] [INFO ] [REMOTE ] TSE: Full fetch complete (31615 records). [2025-09-14T20:24:07.274559] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-14T20:24:07.274873] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-14T20:24:07.747906] [DEBUG] [LOCAL ] TRV: Primary data saved (35927 records). [2025-09-14T20:24:07.776355] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-14T20:24:07.776478] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-14T20:24:07.777329] [INFO ] [MAIN ] Update Progress: 2134/2370 symbols completed. TRV took 29.7s. Estimated remaining: 25m 6s. Rate: 9.4 symbols/min [2025-09-14T20:24:07.778138] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-14T20:24:07.778915] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-14T20:24:07.801421] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-14T20:24:07.889902] [DEBUG] [LOCAL ] TSE: Trimmed 31615 records to 21419 (keeping 150 days of data) [2025-09-14T20:24:08.056140] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:08.168589] [DEBUG] [LOCAL ] TSLX: Loaded 15201 existing records from primary storage. [2025-09-14T20:24:08.169709] [INFO ] [MAIN ] TSLX: Loaded 15201 existing records. [2025-09-14T20:24:08.361759] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:08.364930] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-14T20:24:08.365756] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-14T20:24:08.367865] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-14T20:24:08.368413] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-14T20:24:08.610688] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T20:24:08.650416] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-14T20:24:08.847970] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:08.850204] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-14T20:24:08.868984] [DEBUG] [LOCAL ] TSE: Primary data saved (21419 records). [2025-09-14T20:24:08.869635] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-14T20:24:08.869796] [INFO ] [MAIN ] Update Progress: 2135/2370 symbols completed. TSE took 25.1s. Estimated remaining: 24m 59s. Rate: 9.4 symbols/min [2025-09-14T20:24:08.979932] [DEBUG] [LOCAL ] TRU: Primary data saved (38342 records). [2025-09-14T20:24:08.982447] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-14T20:24:08.988128] [INFO ] [MAIN ] Update Progress: 2136/2370 symbols completed. TRU took 39.1s. Estimated remaining: 24m 52s. Rate: 9.4 symbols/min [2025-09-14T20:24:09.153093] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:09.227717] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:09.249275] [DEBUG] [LOCAL ] TSM: Loaded 24179 existing records from primary storage. [2025-09-14T20:24:09.249620] [INFO ] [MAIN ] TSM: Loaded 24179 existing records. [2025-09-14T20:24:09.405163] [DEBUG] [LOCAL ] TSN: Loaded 23833 existing records from primary storage. [2025-09-14T20:24:09.437949] [INFO ] [MAIN ] TSN: Loaded 23833 existing records. [2025-09-14T20:24:09.501554] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:09.563108] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-14T20:24:09.563589] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-14T20:24:09.580075] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-14T20:24:09.615079] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-14T20:24:09.675932] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:09.747431] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-14T20:24:09.747628] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-14T20:24:09.758966] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-14T20:24:09.793557] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-14T20:24:09.945370] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T20:24:10.031197] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-14T20:24:10.208599] [INFO ] [REMOTE ] TSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:10.240567] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-14T20:24:10.409431] [INFO ] [REMOTE ] TSN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:10.409864] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-14T20:24:10.430922] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T20:24:10.945907] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T20:24:10.958824] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-14T20:24:11.193018] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T20:24:11.598248] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T20:24:11.758842] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-14T20:24:12.333562] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T20:24:12.558840] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-14T20:24:12.707360] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T20:24:13.358834] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-14T20:24:14.158837] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-14T20:24:14.261168] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T20:24:14.335842] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T20:24:14.958892] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-14T20:24:15.322859] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T20:24:15.758882] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-14T20:24:16.002802] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T20:24:16.558890] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-14T20:24:17.041478] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T20:24:17.358875] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-14T20:24:18.158872] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-14T20:24:18.958807] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-14T20:24:19.076543] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T20:24:19.130293] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-14T20:24:19.524687] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T20:24:19.758844] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-14T20:24:19.786845] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T20:24:20.558884] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-14T20:24:20.737143] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T20:24:21.358880] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-14T20:24:22.071844] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T20:24:22.158849] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-14T20:24:22.958819] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-14T20:24:23.035359] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T20:24:23.196205] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T20:24:23.487181] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T20:24:23.758877] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-14T20:24:24.268132] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T20:24:24.558866] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-14T20:24:25.358894] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-14T20:24:26.053809] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T20:24:26.059393] [INFO ] [REMOTE ] TSM: Full fetch complete (58499 records). [2025-09-14T20:24:26.059574] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-14T20:24:26.161188] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-14T20:24:26.469966] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-14T20:24:26.479469] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-14T20:24:26.486052] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-14T20:24:26.486128] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-14T20:24:26.487631] [DEBUG] [LOCAL ] TSM: Trimmed 58499 records to 40559 (keeping 150 days of data) [2025-09-14T20:24:26.503218] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T20:24:26.775095] [DEBUG] [LOCAL ] TSM: Primary data saved (40559 records). [2025-09-14T20:24:26.775261] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-14T20:24:26.775373] [INFO ] [MAIN ] Update Progress: 2137/2370 symbols completed. TSM took 17.9s. Estimated remaining: 24m 47s. Rate: 9.4 symbols/min [2025-09-14T20:24:26.944370] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:26.951327] [DEBUG] [LOCAL ] TSQ: Loaded 5239 existing records from primary storage. [2025-09-14T20:24:26.951466] [INFO ] [MAIN ] TSQ: Loaded 5239 existing records. [2025-09-14T20:24:26.964319] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-14T20:24:27.132382] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:27.132687] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-14T20:24:27.132753] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-14T20:24:27.133045] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-14T20:24:27.133104] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-14T20:24:27.486038] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:27.758895] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-14T20:24:28.178195] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T20:24:28.425148] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T20:24:28.460962] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:24:28.462935] [INFO ] [REMOTE ] TSI: Full fetch complete (10301 records). [2025-09-14T20:24:28.463056] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-14T20:24:28.564073] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-14T20:24:28.857021] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-14T20:24:28.857189] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-14T20:24:28.857622] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-14T20:24:28.857744] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-14T20:24:28.858439] [DEBUG] [LOCAL ] TSI: Trimmed 10301 records to 5477 (keeping 150 days of data) [2025-09-14T20:24:28.893586] [DEBUG] [LOCAL ] TSI: Primary data saved (5477 records). [2025-09-14T20:24:28.893859] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-14T20:24:28.894027] [INFO ] [MAIN ] Update Progress: 2138/2370 symbols completed. TSI took 23.2s. Estimated remaining: 24m 40s. Rate: 9.4 symbols/min [2025-09-14T20:24:29.074109] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:29.097796] [DEBUG] [LOCAL ] TT: Loaded 20648 existing records from primary storage. [2025-09-14T20:24:29.098049] [INFO ] [MAIN ] TT: Loaded 20648 existing records. [2025-09-14T20:24:29.280876] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:29.281218] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-14T20:24:29.281283] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-14T20:24:29.281904] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-14T20:24:29.281970] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-14T20:24:29.364049] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-14T20:24:29.439980] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T20:24:29.676673] [INFO ] [REMOTE ] TT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:30.158887] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-14T20:24:30.550920] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T20:24:30.554160] [INFO ] [REMOTE ] TSLX: Full fetch complete (38527 records). [2025-09-14T20:24:30.554269] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-14T20:24:30.908113] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T20:24:30.943224] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-14T20:24:30.943849] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-14T20:24:30.944856] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-14T20:24:30.944918] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-14T20:24:30.946055] [DEBUG] [LOCAL ] TSLX: Trimmed 38527 records to 25877 (keeping 150 days of data) [2025-09-14T20:24:31.014894] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-14T20:24:31.159276] [DEBUG] [LOCAL ] TSLX: Primary data saved (25877 records). [2025-09-14T20:24:31.159545] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-14T20:24:31.159702] [INFO ] [MAIN ] Update Progress: 2139/2370 symbols completed. TSLX took 23.4s. Estimated remaining: 24m 33s. Rate: 9.4 symbols/min [2025-09-14T20:24:31.335330] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:31.352776] [DEBUG] [LOCAL ] TTAM: Loaded 13998 existing records from primary storage. [2025-09-14T20:24:31.353003] [INFO ] [MAIN ] TTAM: Loaded 13998 existing records. [2025-09-14T20:24:31.536219] [WARN ] [MAIN ] TTAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:31.536588] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-14T20:24:31.536704] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-14T20:24:31.537179] [DEBUG] [LOCAL ] TTAM: Deleted primary data file. [2025-09-14T20:24:31.537243] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-14T20:24:31.765010] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-14T20:24:31.903083] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:32.096879] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T20:24:32.558893] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-14T20:24:33.358832] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-14T20:24:33.838876] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T20:24:34.158849] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-14T20:24:34.381398] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T20:24:34.599324] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T20:24:34.958874] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-14T20:24:35.758896] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-14T20:24:35.981968] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T20:24:36.147958] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T20:24:36.558961] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-14T20:24:37.358898] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-14T20:24:37.573208] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T20:24:37.681191] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T20:24:38.158887] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-14T20:24:38.838590] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T20:24:38.958857] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-14T20:24:39.758834] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-14T20:24:40.208252] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-14T20:24:40.236870] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T20:24:40.558880] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-14T20:24:40.766717] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T20:24:41.358926] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-14T20:24:41.985013] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T20:24:41.990714] [INFO ] [REMOTE ] TSN: Full fetch complete (57413 records). [2025-09-14T20:24:41.990884] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-14T20:24:42.174659] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-14T20:24:42.386029] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-14T20:24:42.386322] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-14T20:24:42.387713] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-14T20:24:42.387918] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-14T20:24:42.389459] [DEBUG] [LOCAL ] TSN: Trimmed 57413 records to 39921 (keeping 150 days of data) [2025-09-14T20:24:42.666810] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-14T20:24:42.698959] [DEBUG] [LOCAL ] TSN: Primary data saved (39921 records). [2025-09-14T20:24:42.699174] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-14T20:24:42.699299] [INFO ] [MAIN ] Update Progress: 2140/2370 symbols completed. TSN took 33.7s. Estimated remaining: 24m 27s. Rate: 9.4 symbols/min [2025-09-14T20:24:42.875300] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:42.900591] [DEBUG] [LOCAL ] TTC: Loaded 18150 existing records from primary storage. [2025-09-14T20:24:42.900880] [INFO ] [MAIN ] TTC: Loaded 18150 existing records. [2025-09-14T20:24:42.966083] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-14T20:24:43.084873] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:43.085254] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-14T20:24:43.085456] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-14T20:24:43.091195] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-14T20:24:43.097083] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-14T20:24:43.129557] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T20:24:43.468211] [INFO ] [REMOTE ] TTC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:43.758838] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-14T20:24:44.558793] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-14T20:24:44.835456] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T20:24:44.893162] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:24:45.356173] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T20:24:45.359108] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-14T20:24:46.158896] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-14T20:24:46.891167] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T20:24:46.893130] [INFO ] [REMOTE ] TSQ: Full fetch complete (12880 records). [2025-09-14T20:24:46.893249] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-14T20:24:46.964036] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-14T20:24:47.264344] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-14T20:24:47.264547] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-14T20:24:47.265005] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-14T20:24:47.265073] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-14T20:24:47.265802] [DEBUG] [LOCAL ] TSQ: Trimmed 12880 records to 9524 (keeping 150 days of data) [2025-09-14T20:24:47.322661] [DEBUG] [LOCAL ] TSQ: Primary data saved (9524 records). [2025-09-14T20:24:47.322949] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-14T20:24:47.323150] [INFO ] [MAIN ] Update Progress: 2141/2370 symbols completed. TSQ took 20.5s. Estimated remaining: 24m 21s. Rate: 9.4 symbols/min [2025-09-14T20:24:47.494463] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:47.525009] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T20:24:47.558753] [DEBUG] [LOCAL ] TTE: Loaded 23014 existing records from primary storage. [2025-09-14T20:24:47.558995] [INFO ] [MAIN ] TTE: Loaded 23014 existing records. [2025-09-14T20:24:47.750731] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:47.751006] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-14T20:24:47.751067] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-14T20:24:47.751601] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-14T20:24:47.751684] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-14T20:24:47.764339] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-14T20:24:48.138240] [INFO ] [REMOTE ] TTE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:48.556618] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T20:24:48.559877] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-14T20:24:49.358875] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-14T20:24:49.682619] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T20:24:50.132139] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T20:24:50.158778] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-14T20:24:50.958908] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-14T20:24:51.109400] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T20:24:51.566211] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T20:24:51.659418] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:24:51.666604] [INFO ] [REMOTE ] TT: Full fetch complete (52624 records). [2025-09-14T20:24:51.666801] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-14T20:24:51.766218] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-14T20:24:52.052841] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-14T20:24:52.052952] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-14T20:24:52.053969] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-14T20:24:52.054031] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-14T20:24:52.055198] [DEBUG] [LOCAL ] TT: Trimmed 52624 records to 35423 (keeping 150 days of data) [2025-09-14T20:24:52.299917] [DEBUG] [LOCAL ] TT: Primary data saved (35423 records). [2025-09-14T20:24:52.300091] [INFO ] [MAIN ] TT: Full history saved. [2025-09-14T20:24:52.300224] [INFO ] [MAIN ] Update Progress: 2142/2370 symbols completed. TT took 23.4s. Estimated remaining: 24m 14s. Rate: 9.4 symbols/min [2025-09-14T20:24:52.468848] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:52.488777] [DEBUG] [LOCAL ] TTI: Loaded 20313 existing records from primary storage. [2025-09-14T20:24:52.488969] [INFO ] [MAIN ] TTI: Loaded 20313 existing records. [2025-09-14T20:24:52.563927] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-14T20:24:52.679219] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:52.679500] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-14T20:24:52.679589] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-14T20:24:52.680260] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-14T20:24:52.680350] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-14T20:24:53.216848] [INFO ] [REMOTE ] TTI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:53.358919] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-14T20:24:53.530183] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T20:24:54.158832] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-14T20:24:54.269434] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T20:24:54.273437] [INFO ] [REMOTE ] TTAM: Full fetch complete (31506 records). [2025-09-14T20:24:54.273739] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-14T20:24:54.673249] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T20:24:54.684368] [DEBUG] [VALIDATOR ] TTAM: All expected trading days are present. [2025-09-14T20:24:54.693552] [DEBUG] [VALIDATOR ] TTAM: Primary data validation passed. [2025-09-14T20:24:54.694708] [INFO ] [MAIN ] TTAM: Fetched primary data is valid. [2025-09-14T20:24:54.694766] [DEBUG] [LOCAL ] TTAM: Saving primary data. [2025-09-14T20:24:54.695546] [DEBUG] [LOCAL ] TTAM: Trimmed 31506 records to 20642 (keeping 150 days of data) [2025-09-14T20:24:54.823721] [DEBUG] [LOCAL ] TTAM: Primary data saved (20642 records). [2025-09-14T20:24:54.823894] [INFO ] [MAIN ] TTAM: Full history saved. [2025-09-14T20:24:54.823998] [INFO ] [MAIN ] Update Progress: 2143/2370 symbols completed. TTAM took 23.7s. Estimated remaining: 24m 7s. Rate: 9.4 symbols/min [2025-09-14T20:24:54.968931] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-14T20:24:54.992828] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:24:55.015848] [DEBUG] [LOCAL ] TU: Loaded 22063 existing records from primary storage. [2025-09-14T20:24:55.016015] [INFO ] [MAIN ] TU: Loaded 22063 existing records. [2025-09-14T20:24:55.189184] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:24:55.189413] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-14T20:24:55.189472] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-14T20:24:55.190073] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-14T20:24:55.190136] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-14T20:24:55.567276] [INFO ] [REMOTE ] TU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:24:55.682339] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T20:24:55.758868] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-14T20:24:56.558849] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-14T20:24:56.958151] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T20:24:57.072784] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T20:24:57.358869] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-14T20:24:58.158837] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-14T20:24:58.276694] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T20:24:58.591970] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T20:24:58.958827] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-14T20:24:59.768800] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-14T20:24:59.775844] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T20:25:00.558837] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-14T20:25:00.656054] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T20:25:01.173334] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T20:25:01.358856] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-14T20:25:02.158853] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-14T20:25:02.266015] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T20:25:02.958960] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-14T20:25:03.239739] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T20:25:03.758849] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-14T20:25:04.056109] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T20:25:04.502501] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T20:25:04.558835] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-14T20:25:04.866076] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T20:25:04.871024] [INFO ] [REMOTE ] TTC: Full fetch complete (47164 records). [2025-09-14T20:25:04.871201] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-14T20:25:05.254678] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-14T20:25:05.254798] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-14T20:25:05.255897] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-14T20:25:05.255963] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-14T20:25:05.257179] [DEBUG] [LOCAL ] TTC: Trimmed 47164 records to 31494 (keeping 150 days of data) [2025-09-14T20:25:05.365714] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-14T20:25:05.420740] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T20:25:05.509249] [DEBUG] [LOCAL ] TTC: Primary data saved (31494 records). [2025-09-14T20:25:05.509466] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-14T20:25:05.509595] [INFO ] [MAIN ] Update Progress: 2144/2370 symbols completed. TTC took 22.8s. Estimated remaining: 24m 1s. Rate: 9.4 symbols/min [2025-09-14T20:25:05.680126] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:05.700368] [DEBUG] [LOCAL ] TUYA: Loaded 20180 existing records from primary storage. [2025-09-14T20:25:05.700563] [INFO ] [MAIN ] TUYA: Loaded 20180 existing records. [2025-09-14T20:25:05.879407] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:05.879699] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-14T20:25:05.879786] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-14T20:25:05.880213] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-14T20:25:05.880271] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-14T20:25:06.164097] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-14T20:25:06.238880] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:06.958836] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-14T20:25:07.007342] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T20:25:07.765254] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-14T20:25:07.797080] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T20:25:08.558847] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-14T20:25:08.617256] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T20:25:09.223191] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T20:25:09.358824] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-14T20:25:10.136197] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T20:25:10.158818] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-14T20:25:10.958899] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-14T20:25:11.156438] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T20:25:11.758855] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-14T20:25:11.875669] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T20:25:12.558818] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-14T20:25:12.612715] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T20:25:13.358809] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-14T20:25:13.783778] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T20:25:14.037362] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T20:25:14.158856] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-14T20:25:14.958846] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-14T20:25:15.066635] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T20:25:15.625371] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T20:25:15.630088] [INFO ] [REMOTE ] TTI: Full fetch complete (49074 records). [2025-09-14T20:25:15.630278] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-14T20:25:15.763986] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-14T20:25:16.028241] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-14T20:25:16.028394] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-14T20:25:16.029500] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-14T20:25:16.029597] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-14T20:25:16.031001] [DEBUG] [LOCAL ] TTI: Trimmed 49074 records to 34355 (keeping 150 days of data) [2025-09-14T20:25:16.236776] [DEBUG] [LOCAL ] TTI: Primary data saved (34355 records). [2025-09-14T20:25:16.236992] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-14T20:25:16.237143] [INFO ] [MAIN ] Update Progress: 2145/2370 symbols completed. TTI took 23.9s. Estimated remaining: 23m 55s. Rate: 9.4 symbols/min [2025-09-14T20:25:16.409666] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:16.427891] [DEBUG] [LOCAL ] TV: Loaded 18104 existing records from primary storage. [2025-09-14T20:25:16.428088] [INFO ] [MAIN ] TV: Loaded 18104 existing records. [2025-09-14T20:25:16.559145] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-14T20:25:16.612510] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:16.612920] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-14T20:25:16.613097] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-14T20:25:16.613694] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-14T20:25:16.613894] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-14T20:25:16.912984] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T20:25:17.040759] [INFO ] [REMOTE ] TV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:17.358831] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-14T20:25:17.604163] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T20:25:18.110099] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T20:25:18.116632] [INFO ] [REMOTE ] TTE: Full fetch complete (56157 records). [2025-09-14T20:25:18.116903] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-14T20:25:18.163957] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-14T20:25:18.524453] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-14T20:25:18.524589] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-14T20:25:18.525845] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-14T20:25:18.525916] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-14T20:25:18.527531] [DEBUG] [LOCAL ] TTE: Trimmed 56157 records to 38684 (keeping 150 days of data) [2025-09-14T20:25:18.778289] [DEBUG] [LOCAL ] TTE: Primary data saved (38684 records). [2025-09-14T20:25:18.778483] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-14T20:25:18.778586] [INFO ] [MAIN ] Update Progress: 2146/2370 symbols completed. TTE took 31.5s. Estimated remaining: 23m 49s. Rate: 9.4 symbols/min [2025-09-14T20:25:18.950857] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:18.954928] [DEBUG] [LOCAL ] TVC: Loaded 1392 existing records from primary storage. [2025-09-14T20:25:18.955068] [INFO ] [MAIN ] TVC: Loaded 1392 existing records. [2025-09-14T20:25:18.986366] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-14T20:25:19.136365] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T20:25:19.169060] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:19.179000] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-14T20:25:19.179091] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-14T20:25:19.179526] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-14T20:25:19.179586] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-14T20:25:19.552185] [INFO ] [REMOTE ] TVC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:19.714253] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T20:25:19.758832] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-14T20:25:20.558906] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-14T20:25:20.827673] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T20:25:21.278551] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T20:25:21.285797] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T20:25:21.358774] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-14T20:25:22.158907] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-14T20:25:22.837725] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T20:25:22.958909] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-14T20:25:23.021554] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T20:25:23.394264] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-14T20:25:23.758884] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-14T20:25:24.558902] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-14T20:25:25.261932] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T20:25:25.267056] [INFO ] [REMOTE ] TU: Full fetch complete (54454 records). [2025-09-14T20:25:25.267186] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-14T20:25:25.366308] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-14T20:25:25.653787] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-14T20:25:25.653907] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-14T20:25:25.654986] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-14T20:25:25.655047] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-14T20:25:25.656273] [DEBUG] [LOCAL ] TU: Trimmed 54454 records to 37254 (keeping 150 days of data) [2025-09-14T20:25:25.916519] [DEBUG] [LOCAL ] TU: Primary data saved (37254 records). [2025-09-14T20:25:25.916773] [INFO ] [MAIN ] TU: Full history saved. [2025-09-14T20:25:25.916900] [INFO ] [MAIN ] Update Progress: 2147/2370 symbols completed. TU took 31.1s. Estimated remaining: 23m 42s. Rate: 9.4 symbols/min [2025-09-14T20:25:26.085565] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:26.088673] [DEBUG] [LOCAL ] TVE: Loaded 1184 existing records from primary storage. [2025-09-14T20:25:26.088766] [INFO ] [MAIN ] TVE: Loaded 1184 existing records. [2025-09-14T20:25:26.163931] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-14T20:25:26.272336] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:26.272676] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-14T20:25:26.272893] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-14T20:25:26.273184] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-14T20:25:26.273279] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-14T20:25:26.513133] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T20:25:26.674214] [INFO ] [REMOTE ] TVE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:26.899460] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T20:25:26.938626] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T20:25:26.958791] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-14T20:25:27.605374] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T20:25:27.758864] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-14T20:25:28.355409] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-14T20:25:28.558861] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-14T20:25:29.358843] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-14T20:25:30.071916] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T20:25:30.106607] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T20:25:30.158783] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-14T20:25:30.958898] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-14T20:25:31.601223] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T20:25:31.711606] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T20:25:31.758858] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-14T20:25:32.271442] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T20:25:32.558830] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-14T20:25:33.184217] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T20:25:33.358865] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-14T20:25:34.158850] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-14T20:25:34.685550] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T20:25:34.703829] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T20:25:34.708744] [INFO ] [REMOTE ] TUYA: Full fetch complete (51267 records). [2025-09-14T20:25:34.708879] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-14T20:25:34.965424] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-14T20:25:35.095827] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-14T20:25:35.095953] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-14T20:25:35.097192] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-14T20:25:35.097289] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-14T20:25:35.098569] [DEBUG] [LOCAL ] TUYA: Trimmed 51267 records to 34593 (keeping 150 days of data) [2025-09-14T20:25:35.315079] [DEBUG] [LOCAL ] TUYA: Primary data saved (34593 records). [2025-09-14T20:25:35.315295] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-14T20:25:35.315448] [INFO ] [MAIN ] Update Progress: 2148/2370 symbols completed. TUYA took 29.8s. Estimated remaining: 23m 36s. Rate: 9.4 symbols/min [2025-09-14T20:25:35.489394] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:35.504346] [DEBUG] [LOCAL ] TWI: Loaded 14336 existing records from primary storage. [2025-09-14T20:25:35.505121] [INFO ] [MAIN ] TWI: Loaded 14336 existing records. [2025-09-14T20:25:35.690054] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:35.690357] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-14T20:25:35.690424] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-14T20:25:35.690824] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-14T20:25:35.690895] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-14T20:25:35.768550] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-14T20:25:36.062994] [INFO ] [REMOTE ] TWI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:36.455427] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T20:25:36.468028] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T20:25:36.558825] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-14T20:25:37.049287] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-14T20:25:37.358835] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-14T20:25:38.158888] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-14T20:25:38.958841] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-14T20:25:38.993839] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T20:25:39.487913] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T20:25:39.488929] [INFO ] [REMOTE ] TVC: Full fetch complete (3973 records). [2025-09-14T20:25:39.489013] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-14T20:25:39.760502] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-14T20:25:39.863116] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-14T20:25:39.863503] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-14T20:25:39.885388] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-14T20:25:39.885585] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-14T20:25:39.887296] [DEBUG] [LOCAL ] TVC: Trimmed 3973 records to 2461 (keeping 150 days of data) [2025-09-14T20:25:39.888070] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T20:25:39.919924] [DEBUG] [LOCAL ] TVC: Primary data saved (2461 records). [2025-09-14T20:25:39.920162] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-14T20:25:39.920379] [INFO ] [MAIN ] Update Progress: 2149/2370 symbols completed. TVC took 21.1s. Estimated remaining: 23m 30s. Rate: 9.4 symbols/min [2025-09-14T20:25:40.103007] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:40.127009] [DEBUG] [LOCAL ] TWLO: Loaded 23557 existing records from primary storage. [2025-09-14T20:25:40.127219] [INFO ] [MAIN ] TWLO: Loaded 23557 existing records. [2025-09-14T20:25:40.309111] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:40.309373] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-14T20:25:40.309436] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-14T20:25:40.310050] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-14T20:25:40.310117] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-14T20:25:40.417066] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T20:25:40.565728] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-14T20:25:40.683709] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:41.358903] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-14T20:25:41.880475] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T20:25:41.881745] [INFO ] [REMOTE ] TVE: Full fetch complete (3177 records). [2025-09-14T20:25:41.881859] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-14T20:25:42.164136] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-14T20:25:42.259300] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-14T20:25:42.259464] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-14T20:25:42.259676] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-14T20:25:42.259762] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-14T20:25:42.260786] [DEBUG] [LOCAL ] TVE: Trimmed 3177 records to 1916 (keeping 150 days of data) [2025-09-14T20:25:42.299395] [DEBUG] [LOCAL ] TVE: Primary data saved (1916 records). [2025-09-14T20:25:42.302093] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-14T20:25:42.302460] [INFO ] [MAIN ] Update Progress: 2150/2370 symbols completed. TVE took 16.4s. Estimated remaining: 23m 23s. Rate: 9.4 symbols/min [2025-09-14T20:25:42.304165] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T20:25:42.489817] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:42.494028] [DEBUG] [LOCAL ] TWN: Loaded 1004 existing records from primary storage. [2025-09-14T20:25:42.494151] [INFO ] [MAIN ] TWN: Loaded 1004 existing records. [2025-09-14T20:25:42.673207] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:42.673478] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-14T20:25:42.673540] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-14T20:25:42.673785] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-14T20:25:42.673865] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-14T20:25:42.963913] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-14T20:25:43.036293] [INFO ] [REMOTE ] TWN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:43.758890] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-14T20:25:43.803839] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T20:25:44.258966] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T20:25:44.558834] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-14T20:25:45.358851] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-14T20:25:45.880414] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-14T20:25:45.945879] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T20:25:46.158885] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-14T20:25:46.771178] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T20:25:46.776681] [INFO ] [REMOTE ] TV: Full fetch complete (46815 records). [2025-09-14T20:25:46.776883] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-14T20:25:46.965384] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-14T20:25:47.261090] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-14T20:25:47.261234] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-14T20:25:47.263419] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-14T20:25:47.263503] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-14T20:25:47.265405] [DEBUG] [LOCAL ] TV: Trimmed 46815 records to 32076 (keeping 150 days of data) [2025-09-14T20:25:47.476069] [DEBUG] [LOCAL ] TV: Primary data saved (32076 records). [2025-09-14T20:25:47.476299] [INFO ] [MAIN ] TV: Full history saved. [2025-09-14T20:25:47.476453] [INFO ] [MAIN ] Update Progress: 2151/2370 symbols completed. TV took 31.2s. Estimated remaining: 23m 16s. Rate: 9.4 symbols/min [2025-09-14T20:25:47.663545] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:47.690301] [DEBUG] [LOCAL ] TWO: Loaded 22025 existing records from primary storage. [2025-09-14T20:25:47.690544] [INFO ] [MAIN ] TWO: Loaded 22025 existing records. [2025-09-14T20:25:47.768301] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-14T20:25:47.885109] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:47.885451] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-14T20:25:47.885517] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-14T20:25:47.886152] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-14T20:25:47.886219] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-14T20:25:48.253120] [INFO ] [REMOTE ] TWO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:48.286056] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T20:25:48.540847] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T20:25:48.558770] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-14T20:25:48.680428] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T20:25:49.358860] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-14T20:25:50.044789] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T20:25:50.056172] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T20:25:50.158814] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-14T20:25:50.958850] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-14T20:25:51.758880] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-14T20:25:51.802718] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T20:25:52.364378] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T20:25:52.558849] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-14T20:25:52.940891] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T20:25:53.218956] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T20:25:53.358851] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-14T20:25:54.158838] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-14T20:25:54.633950] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-14T20:25:54.958852] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-14T20:25:55.273704] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T20:25:55.758902] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-14T20:25:56.430185] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T20:25:56.558819] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-14T20:25:56.774980] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T20:25:57.358843] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-14T20:25:57.923828] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T20:25:57.927373] [INFO ] [REMOTE ] TWI: Full fetch complete (38763 records). [2025-09-14T20:25:57.927551] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-14T20:25:58.164012] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-14T20:25:58.321542] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-14T20:25:58.321772] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-14T20:25:58.322632] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-14T20:25:58.322720] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-14T20:25:58.324849] [DEBUG] [LOCAL ] TWI: Trimmed 38763 records to 24960 (keeping 150 days of data) [2025-09-14T20:25:58.455556] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T20:25:58.537966] [DEBUG] [LOCAL ] TWI: Primary data saved (24960 records). [2025-09-14T20:25:58.538143] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-14T20:25:58.538260] [INFO ] [MAIN ] Update Progress: 2152/2370 symbols completed. TWI took 23.2s. Estimated remaining: 23m 11s. Rate: 9.4 symbols/min [2025-09-14T20:25:58.707459] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:25:58.712045] [DEBUG] [LOCAL ] TWOD: Loaded 2243 existing records from primary storage. [2025-09-14T20:25:58.712176] [INFO ] [MAIN ] TWOD: Loaded 2243 existing records. [2025-09-14T20:25:58.893575] [WARN ] [MAIN ] TWOD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:25:58.893896] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-14T20:25:58.893958] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-14T20:25:58.894201] [DEBUG] [LOCAL ] TWOD: Deleted primary data file. [2025-09-14T20:25:58.894258] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-14T20:25:58.964067] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-14T20:25:59.247320] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:25:59.679105] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T20:25:59.758858] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-14T20:26:00.001470] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:26:00.001873] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-14T20:26:00.033465] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T20:26:00.558835] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-14T20:26:01.358841] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-14T20:26:01.541584] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T20:26:02.158846] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-14T20:26:02.414379] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:26:02.414789] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-14T20:26:02.958822] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-14T20:26:03.056094] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T20:26:03.481165] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T20:26:03.482181] [INFO ] [REMOTE ] TWN: Full fetch complete (3710 records). [2025-09-14T20:26:03.482302] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-14T20:26:03.764448] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-14T20:26:03.842902] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-14T20:26:03.843034] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-14T20:26:03.843212] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-14T20:26:03.843280] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-14T20:26:03.843782] [DEBUG] [LOCAL ] TWN: Trimmed 3710 records to 2087 (keeping 150 days of data) [2025-09-14T20:26:03.857918] [DEBUG] [LOCAL ] TWN: Primary data saved (2087 records). [2025-09-14T20:26:03.858056] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-14T20:26:03.858177] [INFO ] [MAIN ] Update Progress: 2153/2370 symbols completed. TWN took 21.6s. Estimated remaining: 23m 4s. Rate: 9.4 symbols/min [2025-09-14T20:26:04.029356] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:04.044373] [DEBUG] [LOCAL ] TX: Loaded 10672 existing records from primary storage. [2025-09-14T20:26:04.044561] [INFO ] [MAIN ] TX: Loaded 10672 existing records. [2025-09-14T20:26:04.217934] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:04.218223] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-14T20:26:04.218301] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-14T20:26:04.218740] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-14T20:26:04.218818] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-14T20:26:04.567040] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-14T20:26:04.571707] [INFO ] [REMOTE ] TX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:05.358930] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-14T20:26:05.578997] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T20:26:05.637185] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:26:05.637694] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-14T20:26:06.158857] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-14T20:26:06.646937] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T20:26:06.958845] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-14T20:26:06.970441] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T20:26:07.758824] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-14T20:26:08.286677] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T20:26:08.370233] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T20:26:08.558825] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-14T20:26:09.358829] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-14T20:26:09.953513] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T20:26:10.158836] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-14T20:26:10.464965] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T20:26:10.892693] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T20:26:10.958902] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-14T20:26:11.758885] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-14T20:26:12.411285] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T20:26:12.413073] [INFO ] [REMOTE ] TWOD: Full fetch complete (4092 records). [2025-09-14T20:26:12.413184] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-14T20:26:12.564001] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-14T20:26:12.624617] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 82 unique days, need 150 days [2025-09-14T20:26:12.624899] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:26:12.624955] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:26:12.625006] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-14T20:26:12.625107] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-14T20:26:12.625172] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-14T20:26:12.625237] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-14T20:26:12.625322] [INFO ] [MAIN ] Update Progress: 2154/2370 symbols completed. TWOD took 14.1s. Estimated remaining: 22m 58s. Rate: 9.4 symbols/min [2025-09-14T20:26:12.799988] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:12.837812] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T20:26:12.855420] [DEBUG] [LOCAL ] TXNM: Loaded 19090 existing records from primary storage. [2025-09-14T20:26:12.855589] [INFO ] [MAIN ] TXNM: Loaded 19090 existing records. [2025-09-14T20:26:13.029537] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:13.029898] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-14T20:26:13.029962] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-14T20:26:13.030537] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-14T20:26:13.030601] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-14T20:26:13.379098] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-14T20:26:13.384705] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:13.951299] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T20:26:14.158847] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-14T20:26:14.838913] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:26:14.843951] [INFO ] [REMOTE ] TWO: Full fetch complete (51973 records). [2025-09-14T20:26:14.844131] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-14T20:26:14.963965] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-14T20:26:15.229185] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-14T20:26:15.229319] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-14T20:26:15.230390] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-14T20:26:15.230452] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-14T20:26:15.231810] [DEBUG] [LOCAL ] TWO: Trimmed 51973 records to 36371 (keeping 150 days of data) [2025-09-14T20:26:15.488290] [DEBUG] [LOCAL ] TWO: Primary data saved (36371 records). [2025-09-14T20:26:15.488592] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-14T20:26:15.488899] [INFO ] [MAIN ] Update Progress: 2155/2370 symbols completed. TWO took 28.0s. Estimated remaining: 22m 51s. Rate: 9.4 symbols/min [2025-09-14T20:26:15.670484] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:15.703909] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-14T20:26:15.720202] [DEBUG] [LOCAL ] TXO: Loaded 8813 existing records from primary storage. [2025-09-14T20:26:15.720762] [INFO ] [MAIN ] TXO: Loaded 8813 existing records. [2025-09-14T20:26:15.765318] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-14T20:26:15.907710] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:15.908098] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-14T20:26:15.908313] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-14T20:26:15.908727] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-14T20:26:15.908862] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-14T20:26:16.087695] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T20:26:16.297414] [INFO ] [REMOTE ] TXO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:16.558848] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-14T20:26:17.298553] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T20:26:17.358788] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-14T20:26:17.988147] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T20:26:17.994378] [INFO ] [REMOTE ] TWLO: Full fetch complete (57378 records). [2025-09-14T20:26:17.994544] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-14T20:26:18.166118] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-14T20:26:18.383084] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-14T20:26:18.383212] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-14T20:26:18.384870] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-14T20:26:18.384936] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-14T20:26:18.386373] [DEBUG] [LOCAL ] TWLO: Trimmed 57378 records to 39700 (keeping 150 days of data) [2025-09-14T20:26:18.649679] [DEBUG] [LOCAL ] TWLO: Primary data saved (39700 records). [2025-09-14T20:26:18.649889] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-14T20:26:18.650025] [INFO ] [MAIN ] Update Progress: 2156/2370 symbols completed. TWLO took 38.7s. Estimated remaining: 22m 44s. Rate: 9.4 symbols/min [2025-09-14T20:26:18.821875] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:18.843823] [DEBUG] [LOCAL ] TXT: Loaded 21970 existing records from primary storage. [2025-09-14T20:26:18.843993] [INFO ] [MAIN ] TXT: Loaded 21970 existing records. [2025-09-14T20:26:18.962887] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-14T20:26:19.025963] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:19.026343] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-14T20:26:19.026453] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-14T20:26:19.026950] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-14T20:26:19.027035] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-14T20:26:19.217257] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T20:26:19.441589] [INFO ] [REMOTE ] TXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:19.442784] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T20:26:19.758858] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-14T20:26:20.172713] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T20:26:20.558847] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-14T20:26:21.358881] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-14T20:26:21.503417] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T20:26:22.067971] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T20:26:22.158798] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-14T20:26:22.241894] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T20:26:22.958834] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-14T20:26:23.758853] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-14T20:26:23.899784] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T20:26:24.558829] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-14T20:26:24.616034] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T20:26:24.735694] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T20:26:25.358921] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-14T20:26:26.158814] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-14T20:26:26.275370] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T20:26:26.447930] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T20:26:26.791000] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T20:26:26.958812] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-14T20:26:27.758833] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-14T20:26:27.768606] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T20:26:28.558922] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-14T20:26:28.596567] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T20:26:28.599449] [INFO ] [REMOTE ] TX: Full fetch complete (26983 records). [2025-09-14T20:26:28.599555] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-14T20:26:28.980189] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-14T20:26:28.980314] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-14T20:26:28.981058] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-14T20:26:28.981121] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-14T20:26:28.982008] [DEBUG] [LOCAL ] TX: Trimmed 26983 records to 17265 (keeping 150 days of data) [2025-09-14T20:26:29.094474] [DEBUG] [LOCAL ] TX: Primary data saved (17265 records). [2025-09-14T20:26:29.094700] [INFO ] [MAIN ] TX: Full history saved. [2025-09-14T20:26:29.094812] [INFO ] [MAIN ] Update Progress: 2157/2370 symbols completed. TX took 25.2s. Estimated remaining: 22m 39s. Rate: 9.4 symbols/min [2025-09-14T20:26:29.358861] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-14T20:26:30.158858] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-14T20:26:30.213262] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T20:26:30.958808] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-14T20:26:31.180215] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T20:26:31.354128] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T20:26:31.758875] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-14T20:26:32.213749] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T20:26:32.558836] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-14T20:26:33.310004] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T20:26:33.358816] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-14T20:26:34.158895] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-14T20:26:34.297303] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T20:26:34.958884] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-14T20:26:35.150451] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T20:26:35.182139] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T20:26:35.630604] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:26:35.635175] [INFO ] [REMOTE ] TXNM: Full fetch complete (47785 records). [2025-09-14T20:26:35.635361] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-14T20:26:35.764060] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-14T20:26:36.061816] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-14T20:26:36.061936] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-14T20:26:36.062985] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-14T20:26:36.063048] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-14T20:26:36.064294] [DEBUG] [LOCAL ] TXNM: Trimmed 47785 records to 32680 (keeping 150 days of data) [2025-09-14T20:26:36.273856] [DEBUG] [LOCAL ] TXNM: Primary data saved (32680 records). [2025-09-14T20:26:36.274039] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-14T20:26:36.274154] [INFO ] [MAIN ] Update Progress: 2158/2370 symbols completed. TXNM took 23.6s. Estimated remaining: 22m 32s. Rate: 9.4 symbols/min [2025-09-14T20:26:36.558948] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-14T20:26:36.876929] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T20:26:37.358892] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-14T20:26:38.447355] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T20:26:38.467215] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-14T20:26:38.475198] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T20:26:38.958854] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-14T20:26:39.184111] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:26:39.189458] [INFO ] [REMOTE ] TXT: Full fetch complete (54263 records). [2025-09-14T20:26:39.189618] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-14T20:26:39.579674] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-14T20:26:39.579800] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-14T20:26:39.581069] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-14T20:26:39.581135] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-14T20:26:39.582528] [DEBUG] [LOCAL ] TXT: Trimmed 54263 records to 37229 (keeping 150 days of data) [2025-09-14T20:26:39.833391] [DEBUG] [LOCAL ] TXT: Primary data saved (37229 records). [2025-09-14T20:26:39.833576] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-14T20:26:39.833736] [INFO ] [MAIN ] Update Progress: 2159/2370 symbols completed. TXT took 21.2s. Estimated remaining: 22m 26s. Rate: 9.4 symbols/min [2025-09-14T20:26:39.893100] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T20:26:39.895566] [INFO ] [REMOTE ] TXO: Full fetch complete (20665 records). [2025-09-14T20:26:39.895692] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-14T20:26:40.290992] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-14T20:26:40.291140] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-14T20:26:40.292031] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-14T20:26:40.292416] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-14T20:26:40.293973] [DEBUG] [LOCAL ] TXO: Trimmed 20665 records to 15084 (keeping 150 days of data) [2025-09-14T20:26:40.394987] [DEBUG] [LOCAL ] TXO: Primary data saved (15084 records). [2025-09-14T20:26:40.395178] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-14T20:26:40.395282] [INFO ] [MAIN ] Update Progress: 2160/2370 symbols completed. TXO took 24.9s. Estimated remaining: 22m 19s. Rate: 9.4 symbols/min [2025-09-14T20:26:40.964548] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:41.137684] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:41.174449] [DEBUG] [LOCAL ] TY: Loaded 3431 existing records from primary storage. [2025-09-14T20:26:41.195972] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:41.178036] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:41.196631] [INFO ] [MAIN ] TY: Loaded 3431 existing records. [2025-09-14T20:26:41.324849] [DEBUG] [LOCAL ] TYG: Loaded 6618 existing records from primary storage. [2025-09-14T20:26:41.325613] [DEBUG] [LOCAL ] TYL: Loaded 9646 existing records from primary storage. [2025-09-14T20:26:41.326110] [INFO ] [MAIN ] TYG: Loaded 6618 existing records. [2025-09-14T20:26:41.326253] [INFO ] [MAIN ] TYL: Loaded 9646 existing records. [2025-09-14T20:26:41.466899] [DEBUG] [LOCAL ] U: Loaded 24160 existing records from primary storage. [2025-09-14T20:26:41.499259] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:41.558198] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-14T20:26:41.557732] [INFO ] [MAIN ] U: Loaded 24160 existing records. [2025-09-14T20:26:41.677511] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-14T20:26:41.816189] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:41.826597] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-14T20:26:41.826828] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-14T20:26:41.894901] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-14T20:26:41.996396] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:42.001605] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-14T20:26:42.105771] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:42.100501] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-14T20:26:42.100559] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-14T20:26:42.132071] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-14T20:26:42.132471] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-14T20:26:42.155615] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-14T20:26:42.132119] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-14T20:26:42.200364] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-14T20:26:42.179155] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-14T20:26:42.276891] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-14T20:26:42.299295] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-14T20:26:42.979444] [INFO ] [REMOTE ] TY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:43.104933] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-14T20:26:43.403004] [INFO ] [REMOTE ] TYL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:43.428869] [INFO ] [REMOTE ] TYG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:43.458989] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-14T20:26:43.492481] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-14T20:26:43.491975] [INFO ] [REMOTE ] U: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:43.494711] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-14T20:26:44.278494] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T20:26:44.280958] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-14T20:26:44.434624] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T20:26:44.439158] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-14T20:26:44.510766] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T20:26:44.558885] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-14T20:26:44.765313] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-14T20:26:45.177696] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T20:26:45.287371] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T20:26:45.358870] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-14T20:26:45.684104] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T20:26:46.138580] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T20:26:46.158780] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-14T20:26:46.925040] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T20:26:46.958798] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-14T20:26:47.758865] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-14T20:26:48.558830] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-14T20:26:48.770177] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T20:26:49.086984] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T20:26:49.341910] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T20:26:49.358788] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-14T20:26:49.889419] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T20:26:50.158839] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-14T20:26:50.958834] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-14T20:26:51.089402] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T20:26:51.758851] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-14T20:26:52.558849] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-14T20:26:52.579132] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T20:26:53.282940] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T20:26:53.306042] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T20:26:53.358834] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-14T20:26:54.158810] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-14T20:26:54.343890] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-14T20:26:54.958869] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-14T20:26:55.539833] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T20:26:55.541075] [INFO ] [REMOTE ] TY: Full fetch complete (8508 records). [2025-09-14T20:26:55.541158] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-14T20:26:55.764062] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-14T20:26:55.920753] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-14T20:26:55.920877] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-14T20:26:55.921195] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-14T20:26:55.921257] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-14T20:26:55.921757] [DEBUG] [LOCAL ] TY: Trimmed 8508 records to 5557 (keeping 150 days of data) [2025-09-14T20:26:55.957216] [DEBUG] [LOCAL ] TY: Primary data saved (5557 records). [2025-09-14T20:26:55.957363] [INFO ] [MAIN ] TY: Full history saved. [2025-09-14T20:26:55.957484] [INFO ] [MAIN ] Update Progress: 2161/2370 symbols completed. TY took 15.6s. Estimated remaining: 22m 13s. Rate: 9.4 symbols/min [2025-09-14T20:26:56.132150] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:56.155039] [DEBUG] [LOCAL ] UA: Loaded 22402 existing records from primary storage. [2025-09-14T20:26:56.155238] [INFO ] [MAIN ] UA: Loaded 22402 existing records. [2025-09-14T20:26:56.333923] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:56.334209] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-14T20:26:56.334273] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-14T20:26:56.334872] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-14T20:26:56.334933] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-14T20:26:56.574628] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-14T20:26:56.702430] [INFO ] [REMOTE ] UA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:56.735855] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-14T20:26:56.838316] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T20:26:57.358916] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-14T20:26:57.824368] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T20:26:58.064590] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:26:58.068434] [INFO ] [REMOTE ] TYG: Full fetch complete (16100 records). [2025-09-14T20:26:58.068732] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-14T20:26:58.165181] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-14T20:26:58.647454] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-14T20:26:58.647637] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-14T20:26:58.648446] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-14T20:26:58.648519] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-14T20:26:58.649615] [DEBUG] [LOCAL ] TYG: Trimmed 16100 records to 10517 (keeping 150 days of data) [2025-09-14T20:26:58.726522] [DEBUG] [LOCAL ] TYG: Primary data saved (10517 records). [2025-09-14T20:26:58.726814] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-14T20:26:58.726974] [INFO ] [MAIN ] Update Progress: 2162/2370 symbols completed. TYG took 18.3s. Estimated remaining: 22m 6s. Rate: 9.4 symbols/min [2025-09-14T20:26:58.912425] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:26:58.939262] [DEBUG] [LOCAL ] UAA: Loaded 23955 existing records from primary storage. [2025-09-14T20:26:58.939504] [INFO ] [MAIN ] UAA: Loaded 23955 existing records. [2025-09-14T20:26:58.963997] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-14T20:26:59.134832] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:26:59.135170] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-14T20:26:59.135245] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-14T20:26:59.135890] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-14T20:26:59.135962] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-14T20:26:59.507555] [INFO ] [REMOTE ] UAA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:26:59.758896] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-14T20:27:00.326121] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-14T20:27:00.558858] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-14T20:27:00.823698] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T20:27:01.358844] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-14T20:27:02.019731] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-14T20:27:02.158893] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-14T20:27:02.958885] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-14T20:27:03.663236] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (3.10 seconds). [2025-09-14T20:27:03.758878] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-14T20:27:05.442888] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (3.28 seconds). [2025-09-14T20:27:05.450165] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-14T20:27:05.731359] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (4.37 seconds). [2025-09-14T20:27:05.743091] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-14T20:27:05.833731] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-14T20:27:06.158830] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-14T20:27:06.590918] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T20:27:06.958804] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-14T20:27:07.048220] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T20:27:07.362363] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (3.60 seconds). [2025-09-14T20:27:07.758836] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-14T20:27:07.895774] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T20:27:08.106269] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T20:27:08.558842] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-14T20:27:09.249331] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T20:27:09.358823] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-14T20:27:10.158852] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-14T20:27:10.480868] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-14T20:27:10.486337] [INFO ] [REMOTE ] U: Full fetch complete (58479 records). [2025-09-14T20:27:10.486463] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-14T20:27:10.869097] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-14T20:27:10.869271] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-14T20:27:10.870587] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-14T20:27:10.888132] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-14T20:27:10.901226] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T20:27:10.911319] [DEBUG] [LOCAL ] U: Trimmed 58479 records to 40539 (keeping 150 days of data) [2025-09-14T20:27:10.964298] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-14T20:27:11.172234] [DEBUG] [LOCAL ] U: Primary data saved (40539 records). [2025-09-14T20:27:11.172402] [INFO ] [MAIN ] U: Full history saved. [2025-09-14T20:27:11.172508] [INFO ] [MAIN ] Update Progress: 2163/2370 symbols completed. U took 30.8s. Estimated remaining: 22m 1s. Rate: 9.4 symbols/min [2025-09-14T20:27:11.346792] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:11.350759] [DEBUG] [LOCAL ] UAN: Loaded 2097 existing records from primary storage. [2025-09-14T20:27:11.350871] [INFO ] [MAIN ] UAN: Loaded 2097 existing records. [2025-09-14T20:27:11.528140] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:11.528410] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-14T20:27:11.528483] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-14T20:27:11.528785] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-14T20:27:11.528861] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-14T20:27:11.777126] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-14T20:27:11.906526] [INFO ] [REMOTE ] UAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:11.957332] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T20:27:12.558859] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-14T20:27:12.615560] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T20:27:12.766149] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T20:27:13.358852] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-14T20:27:13.860303] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T20:27:14.158928] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-14T20:27:14.808120] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T20:27:14.958854] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-14T20:27:15.159626] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T20:27:15.551562] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T20:27:15.554042] [INFO ] [REMOTE ] TYL: Full fetch complete (24293 records). [2025-09-14T20:27:15.554133] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-14T20:27:15.764007] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-14T20:27:15.920068] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-14T20:27:15.920181] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-14T20:27:15.920752] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-14T20:27:15.920810] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-14T20:27:15.921659] [DEBUG] [LOCAL ] TYL: Trimmed 24293 records to 16551 (keeping 150 days of data) [2025-09-14T20:27:16.027513] [DEBUG] [LOCAL ] TYL: Primary data saved (16551 records). [2025-09-14T20:27:16.027731] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-14T20:27:16.027857] [INFO ] [MAIN ] Update Progress: 2164/2370 symbols completed. TYL took 35.6s. Estimated remaining: 21m 54s. Rate: 9.4 symbols/min [2025-09-14T20:27:16.206663] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:16.229909] [DEBUG] [LOCAL ] UBER: Loaded 24166 existing records from primary storage. [2025-09-14T20:27:16.230098] [INFO ] [MAIN ] UBER: Loaded 24166 existing records. [2025-09-14T20:27:16.405752] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:16.406057] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-14T20:27:16.406124] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-14T20:27:16.406713] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-14T20:27:16.406780] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-14T20:27:16.565758] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-14T20:27:16.761740] [INFO ] [REMOTE ] UBER: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:17.358888] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-14T20:27:18.171032] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-14T20:27:18.179167] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-14T20:27:18.411801] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-14T20:27:18.417128] [INFO ] [REMOTE ] UA: Full fetch complete (54698 records). [2025-09-14T20:27:18.417257] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-14T20:27:18.782856] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T20:27:18.802212] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-14T20:27:18.802320] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-14T20:27:18.803455] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-14T20:27:18.803598] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-14T20:27:18.804881] [DEBUG] [LOCAL ] UA: Trimmed 54698 records to 37590 (keeping 150 days of data) [2025-09-14T20:27:18.924019] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T20:27:18.961178] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-14T20:27:19.073193] [DEBUG] [LOCAL ] UA: Primary data saved (37590 records). [2025-09-14T20:27:19.073460] [INFO ] [MAIN ] UA: Full history saved. [2025-09-14T20:27:19.073596] [INFO ] [MAIN ] Update Progress: 2165/2370 symbols completed. UA took 23.1s. Estimated remaining: 21m 47s. Rate: 9.4 symbols/min [2025-09-14T20:27:19.267213] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:19.293021] [DEBUG] [LOCAL ] UBS: Loaded 23199 existing records from primary storage. [2025-09-14T20:27:19.293290] [INFO ] [MAIN ] UBS: Loaded 23199 existing records. [2025-09-14T20:27:19.475614] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:19.476031] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-14T20:27:19.476103] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-14T20:27:19.476696] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-14T20:27:19.476761] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-14T20:27:19.764068] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-14T20:27:19.870761] [INFO ] [REMOTE ] UBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:19.879043] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T20:27:20.558880] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-14T20:27:21.358859] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-14T20:27:21.476912] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T20:27:21.799572] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T20:27:22.158859] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-14T20:27:22.253787] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T20:27:22.606979] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T20:27:22.612394] [INFO ] [REMOTE ] UAA: Full fetch complete (58191 records). [2025-09-14T20:27:22.612531] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-14T20:27:22.958941] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-14T20:27:23.000560] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-14T20:27:23.000719] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-14T20:27:23.001925] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-14T20:27:23.002085] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-14T20:27:23.003548] [DEBUG] [LOCAL ] UAA: Trimmed 58191 records to 40267 (keeping 150 days of data) [2025-09-14T20:27:23.258579] [DEBUG] [LOCAL ] UAA: Primary data saved (40267 records). [2025-09-14T20:27:23.258766] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-14T20:27:23.258865] [INFO ] [MAIN ] Update Progress: 2166/2370 symbols completed. UAA took 24.5s. Estimated remaining: 21m 41s. Rate: 9.4 symbols/min [2025-09-14T20:27:23.428075] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:23.445027] [DEBUG] [LOCAL ] UCB: Loaded 16672 existing records from primary storage. [2025-09-14T20:27:23.445195] [INFO ] [MAIN ] UCB: Loaded 16672 existing records. [2025-09-14T20:27:23.630308] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:23.630636] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-14T20:27:23.630732] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-14T20:27:23.631187] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-14T20:27:23.631248] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-14T20:27:23.763975] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-14T20:27:23.996237] [INFO ] [REMOTE ] UCB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:24.028517] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T20:27:24.362538] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T20:27:24.558852] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-14T20:27:25.327538] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T20:27:25.358839] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-14T20:27:26.158882] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-14T20:27:26.725519] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T20:27:26.793121] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T20:27:26.958888] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-14T20:27:27.758847] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-14T20:27:27.898481] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T20:27:28.254782] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T20:27:28.558854] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-14T20:27:29.141170] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T20:27:29.358846] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-14T20:27:30.158796] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-14T20:27:30.267210] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T20:27:30.958862] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-14T20:27:31.068566] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T20:27:31.758882] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-14T20:27:31.862988] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T20:27:32.558838] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-14T20:27:33.358821] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-14T20:27:33.439171] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T20:27:33.476456] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T20:27:33.807436] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-14T20:27:34.158894] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-14T20:27:34.958830] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-14T20:27:35.457262] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T20:27:35.458293] [INFO ] [REMOTE ] UAN: Full fetch complete (5997 records). [2025-09-14T20:27:35.458382] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-14T20:27:35.763870] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-14T20:27:35.839723] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-14T20:27:35.839952] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-14T20:27:35.840240] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-14T20:27:35.840416] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-14T20:27:35.841412] [DEBUG] [LOCAL ] UAN: Trimmed 5997 records to 3947 (keeping 150 days of data) [2025-09-14T20:27:35.869951] [DEBUG] [LOCAL ] UAN: Primary data saved (3947 records). [2025-09-14T20:27:35.870255] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-14T20:27:35.870595] [INFO ] [MAIN ] Update Progress: 2167/2370 symbols completed. UAN took 24.7s. Estimated remaining: 21m 35s. Rate: 9.4 symbols/min [2025-09-14T20:27:36.007205] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T20:27:36.082176] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:36.104574] [DEBUG] [LOCAL ] UDR: Loaded 23295 existing records from primary storage. [2025-09-14T20:27:36.104781] [INFO ] [MAIN ] UDR: Loaded 23295 existing records. [2025-09-14T20:27:36.317118] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:36.317412] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-14T20:27:36.317475] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-14T20:27:36.318016] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-14T20:27:36.318093] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-14T20:27:36.559830] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-14T20:27:36.679900] [INFO ] [REMOTE ] UDR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:36.696007] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T20:27:36.701460] [INFO ] [REMOTE ] UBER: Full fetch complete (58486 records). [2025-09-14T20:27:36.701593] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-14T20:27:37.089738] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-14T20:27:37.089909] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-14T20:27:37.091500] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-14T20:27:37.091568] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-14T20:27:37.093424] [DEBUG] [LOCAL ] UBER: Trimmed 58486 records to 40546 (keeping 150 days of data) [2025-09-14T20:27:37.363395] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-14T20:27:37.394115] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T20:27:37.430273] [DEBUG] [LOCAL ] UBER: Primary data saved (40546 records). [2025-09-14T20:27:37.430450] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-14T20:27:37.430569] [INFO ] [MAIN ] Update Progress: 2168/2370 symbols completed. UBER took 21.4s. Estimated remaining: 21m 28s. Rate: 9.4 symbols/min [2025-09-14T20:27:37.600515] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:37.619944] [DEBUG] [LOCAL ] UE: Loaded 19466 existing records from primary storage. [2025-09-14T20:27:37.620140] [INFO ] [MAIN ] UE: Loaded 19466 existing records. [2025-09-14T20:27:37.795427] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:37.795702] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-14T20:27:37.795786] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-14T20:27:37.796276] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-14T20:27:37.796339] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-14T20:27:38.148052] [INFO ] [REMOTE ] UE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:38.158788] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-14T20:27:38.955542] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T20:27:38.962688] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-14T20:27:39.711134] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T20:27:39.758834] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-14T20:27:40.558877] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-14T20:27:40.638211] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T20:27:41.288825] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T20:27:41.358796] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-14T20:27:42.158939] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-14T20:27:42.225614] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T20:27:42.958900] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-14T20:27:43.108957] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T20:27:43.758844] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-14T20:27:43.876467] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T20:27:44.278775] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T20:27:44.558952] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-14T20:27:45.358869] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-14T20:27:45.664220] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T20:27:46.090367] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T20:27:46.158880] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-14T20:27:46.293145] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T20:27:46.958852] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-14T20:27:47.579232] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T20:27:47.758869] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-14T20:27:48.478038] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T20:27:48.558879] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-14T20:27:49.246636] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T20:27:49.250228] [INFO ] [REMOTE ] UCB: Full fetch complete (41021 records). [2025-09-14T20:27:49.250341] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-14T20:27:49.359190] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-14T20:27:49.633166] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-14T20:27:49.633335] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-14T20:27:49.634388] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-14T20:27:49.634569] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-14T20:27:49.662613] [DEBUG] [LOCAL ] UCB: Trimmed 41021 records to 27887 (keeping 150 days of data) [2025-09-14T20:27:49.664679] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T20:27:49.924985] [DEBUG] [LOCAL ] UCB: Primary data saved (27887 records). [2025-09-14T20:27:49.925398] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-14T20:27:49.925666] [INFO ] [MAIN ] Update Progress: 2169/2370 symbols completed. UCB took 26.7s. Estimated remaining: 21m 22s. Rate: 9.4 symbols/min [2025-09-14T20:27:50.131665] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:50.137573] [DEBUG] [LOCAL ] UFI: Loaded 2942 existing records from primary storage. [2025-09-14T20:27:50.137791] [INFO ] [MAIN ] UFI: Loaded 2942 existing records. [2025-09-14T20:27:50.164266] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-14T20:27:50.437634] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:50.438072] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-14T20:27:50.438170] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-14T20:27:50.438527] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-14T20:27:50.438615] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-14T20:27:50.693786] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T20:27:50.958881] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-14T20:27:51.042247] [INFO ] [REMOTE ] UFI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:51.758893] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-14T20:27:52.217687] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-14T20:27:52.283056] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T20:27:52.500809] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T20:27:52.507357] [INFO ] [REMOTE ] UBS: Full fetch complete (57027 records). [2025-09-14T20:27:52.507550] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-14T20:27:52.563964] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-14T20:27:52.900153] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-14T20:27:52.900334] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-14T20:27:52.901845] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-14T20:27:52.901945] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-14T20:27:52.903608] [DEBUG] [LOCAL ] UBS: Trimmed 57027 records to 39338 (keeping 150 days of data) [2025-09-14T20:27:53.179226] [DEBUG] [LOCAL ] UBS: Primary data saved (39338 records). [2025-09-14T20:27:53.179457] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-14T20:27:53.179699] [INFO ] [MAIN ] Update Progress: 2170/2370 symbols completed. UBS took 34.1s. Estimated remaining: 21m 16s. Rate: 9.4 symbols/min [2025-09-14T20:27:53.361114] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-14T20:27:53.364496] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:53.383021] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T20:27:53.389386] [INFO ] [REMOTE ] UE: Full fetch complete (46615 records). [2025-09-14T20:27:53.389668] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-14T20:27:53.541042] [DEBUG] [LOCAL ] UGI: Loaded 22419 existing records from primary storage. [2025-09-14T20:27:53.561739] [INFO ] [MAIN ] UGI: Loaded 22419 existing records. [2025-09-14T20:27:53.945526] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:54.014689] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-14T20:27:54.003238] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-14T20:27:54.014792] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-14T20:27:54.016003] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-14T20:27:54.014853] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-14T20:27:54.016146] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-14T20:27:54.016716] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-14T20:27:54.016877] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-14T20:27:54.082126] [DEBUG] [LOCAL ] UE: Trimmed 46615 records to 32294 (keeping 150 days of data) [2025-09-14T20:27:54.179820] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-14T20:27:54.503437] [INFO ] [REMOTE ] UGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:54.621176] [DEBUG] [LOCAL ] UE: Primary data saved (32294 records). [2025-09-14T20:27:54.621399] [INFO ] [MAIN ] UE: Full history saved. [2025-09-14T20:27:54.621566] [INFO ] [MAIN ] Update Progress: 2171/2370 symbols completed. UE took 17.2s. Estimated remaining: 21m 9s. Rate: 9.4 symbols/min [2025-09-14T20:27:54.790083] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:27:54.810506] [DEBUG] [LOCAL ] UGP: Loaded 19142 existing records from primary storage. [2025-09-14T20:27:54.810731] [INFO ] [MAIN ] UGP: Loaded 19142 existing records. [2025-09-14T20:27:54.966888] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-14T20:27:54.990261] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:27:54.990424] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-14T20:27:54.990479] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-14T20:27:54.991073] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-14T20:27:54.991136] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-14T20:27:55.337423] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T20:27:55.355971] [INFO ] [REMOTE ] UGP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:27:55.390249] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T20:27:55.758856] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-14T20:27:56.558851] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-14T20:27:56.601093] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T20:27:56.831954] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T20:27:57.358878] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-14T20:27:57.792608] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T20:27:58.073636] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T20:27:58.158835] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-14T20:27:58.958841] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-14T20:27:59.758839] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-14T20:27:59.833548] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T20:28:00.558901] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-14T20:28:00.819986] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T20:28:00.821031] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T20:28:01.358898] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-14T20:28:02.158843] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-14T20:28:02.190240] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T20:28:02.216701] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T20:28:02.958836] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-14T20:28:03.758820] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-14T20:28:03.796149] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T20:28:03.814852] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T20:28:04.558827] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-14T20:28:05.082902] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T20:28:05.366818] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-14T20:28:05.386226] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T20:28:06.158836] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-14T20:28:06.958848] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-14T20:28:07.051488] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T20:28:07.052976] [INFO ] [REMOTE ] UFI: Full fetch complete (9248 records). [2025-09-14T20:28:07.053065] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-14T20:28:07.447031] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-14T20:28:07.458016] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T20:28:07.458192] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-14T20:28:07.462401] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-14T20:28:07.468415] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-14T20:28:07.484410] [DEBUG] [LOCAL ] UFI: Trimmed 9248 records to 5775 (keeping 150 days of data) [2025-09-14T20:28:07.486212] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T20:28:07.517243] [INFO ] [REMOTE ] UDR: Full fetch complete (56186 records). [2025-09-14T20:28:07.519048] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-14T20:28:07.593152] [DEBUG] [LOCAL ] UFI: Primary data saved (5775 records). [2025-09-14T20:28:07.618407] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-14T20:28:07.643944] [INFO ] [MAIN ] Update Progress: 2172/2370 symbols completed. UFI took 17.7s. Estimated remaining: 21m 3s. Rate: 9.4 symbols/min [2025-09-14T20:28:07.775525] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-14T20:28:08.020023] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:08.114000] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-14T20:28:08.117435] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-14T20:28:08.118756] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-14T20:28:08.117612] [DEBUG] [LOCAL ] UHAL: Loaded 7933 existing records from primary storage. [2025-09-14T20:28:08.118831] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-14T20:28:08.118907] [INFO ] [MAIN ] UHAL: Loaded 7933 existing records. [2025-09-14T20:28:08.221324] [DEBUG] [LOCAL ] UDR: Trimmed 56186 records to 39067 (keeping 150 days of data) [2025-09-14T20:28:08.395305] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:08.400170] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-14T20:28:08.403395] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-14T20:28:08.409189] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-14T20:28:08.413777] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-14T20:28:08.559154] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-14T20:28:08.944424] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:08.956815] [DEBUG] [LOCAL ] UDR: Primary data saved (39067 records). [2025-09-14T20:28:08.957016] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-14T20:28:08.957138] [INFO ] [MAIN ] Update Progress: 2173/2370 symbols completed. UDR took 33.1s. Estimated remaining: 20m 56s. Rate: 9.4 symbols/min [2025-09-14T20:28:09.124894] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:09.144890] [DEBUG] [LOCAL ] UHS: Loaded 18453 existing records from primary storage. [2025-09-14T20:28:09.145069] [INFO ] [MAIN ] UHS: Loaded 18453 existing records. [2025-09-14T20:28:09.319392] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:09.319697] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-14T20:28:09.319760] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-14T20:28:09.320251] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-14T20:28:09.320312] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-14T20:28:09.383391] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-14T20:28:09.677150] [INFO ] [REMOTE ] UHS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:09.700328] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T20:28:10.158886] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-14T20:28:10.319162] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T20:28:10.420295] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T20:28:10.958915] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-14T20:28:11.758853] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-14T20:28:11.942885] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T20:28:12.559001] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-14T20:28:12.691860] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T20:28:13.358883] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-14T20:28:13.499601] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T20:28:14.158892] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-14T20:28:14.199522] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T20:28:14.958849] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-14T20:28:15.174627] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T20:28:15.264399] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T20:28:15.758868] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-14T20:28:16.335315] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T20:28:16.340187] [INFO ] [REMOTE ] UGP: Full fetch complete (46339 records). [2025-09-14T20:28:16.340349] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-14T20:28:16.563908] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-14T20:28:16.717434] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-14T20:28:16.717541] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-14T20:28:16.718504] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-14T20:28:16.718562] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-14T20:28:16.719577] [DEBUG] [LOCAL ] UGP: Trimmed 46339 records to 32057 (keeping 150 days of data) [2025-09-14T20:28:16.818572] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T20:28:16.935921] [DEBUG] [LOCAL ] UGP: Primary data saved (32057 records). [2025-09-14T20:28:16.936099] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-14T20:28:16.936211] [INFO ] [MAIN ] Update Progress: 2174/2370 symbols completed. UGP took 22.3s. Estimated remaining: 20m 50s. Rate: 9.4 symbols/min [2025-09-14T20:28:17.116351] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:17.123109] [DEBUG] [LOCAL ] UHT: Loaded 4663 existing records from primary storage. [2025-09-14T20:28:17.123257] [INFO ] [MAIN ] UHT: Loaded 4663 existing records. [2025-09-14T20:28:17.312891] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:17.313171] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-14T20:28:17.313248] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-14T20:28:17.313536] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-14T20:28:17.313595] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-14T20:28:17.371054] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-14T20:28:17.673316] [INFO ] [REMOTE ] UHT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:18.142459] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T20:28:18.158788] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-14T20:28:18.455379] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T20:28:18.958845] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-14T20:28:19.758804] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-14T20:28:19.854062] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T20:28:19.890974] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T20:28:20.538477] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T20:28:20.558783] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-14T20:28:21.358877] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-14T20:28:21.417965] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T20:28:22.158835] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-14T20:28:22.745107] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T20:28:22.958926] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-14T20:28:22.967167] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T20:28:23.758842] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-14T20:28:24.568671] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-14T20:28:24.575467] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T20:28:24.754374] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T20:28:25.358856] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-14T20:28:26.038622] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T20:28:26.158837] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-14T20:28:26.190021] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T20:28:26.958843] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-14T20:28:27.558188] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T20:28:27.655878] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:28:27.661010] [INFO ] [REMOTE ] UGI: Full fetch complete (55020 records). [2025-09-14T20:28:27.661174] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-14T20:28:27.764879] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-14T20:28:28.057379] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-14T20:28:28.057531] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-14T20:28:28.058979] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-14T20:28:28.059053] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-14T20:28:28.060605] [DEBUG] [LOCAL ] UGI: Trimmed 55020 records to 37909 (keeping 150 days of data) [2025-09-14T20:28:28.313806] [DEBUG] [LOCAL ] UGI: Primary data saved (37909 records). [2025-09-14T20:28:28.314001] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-14T20:28:28.314129] [INFO ] [MAIN ] Update Progress: 2175/2370 symbols completed. UGI took 35.1s. Estimated remaining: 20m 44s. Rate: 9.4 symbols/min [2025-09-14T20:28:28.524209] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:28.533518] [DEBUG] [LOCAL ] UI: Loaded 6497 existing records from primary storage. [2025-09-14T20:28:28.533688] [INFO ] [MAIN ] UI: Loaded 6497 existing records. [2025-09-14T20:28:28.564220] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-14T20:28:28.719034] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:28.719326] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-14T20:28:28.719394] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-14T20:28:28.719727] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-14T20:28:28.719789] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-14T20:28:29.086164] [INFO ] [REMOTE ] UI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:29.358807] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-14T20:28:29.406244] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T20:28:29.573127] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T20:28:30.158845] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-14T20:28:30.339575] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T20:28:30.958880] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-14T20:28:31.141864] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T20:28:31.758842] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-14T20:28:31.818069] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T20:28:32.558844] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-14T20:28:32.709743] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T20:28:33.358833] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-14T20:28:34.158805] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-14T20:28:34.191987] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T20:28:34.216240] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T20:28:34.958807] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-14T20:28:35.103158] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T20:28:35.105852] [INFO ] [REMOTE ] UHAL: Full fetch complete (17093 records). [2025-09-14T20:28:35.105968] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-14T20:28:35.253140] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T20:28:35.299305] [INFO ] [REMOTE ] UHT: Full fetch complete (10730 records). [2025-09-14T20:28:35.367725] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-14T20:28:35.620480] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-14T20:28:35.650320] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-14T20:28:35.728532] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-14T20:28:35.763908] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-14T20:28:35.764010] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-14T20:28:35.820224] [DEBUG] [LOCAL ] UHAL: Trimmed 17093 records to 12351 (keeping 150 days of data) [2025-09-14T20:28:35.862115] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-14T20:28:35.862416] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-14T20:28:35.862882] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-14T20:28:35.862970] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-14T20:28:35.900068] [DEBUG] [LOCAL ] UHT: Trimmed 10730 records to 7207 (keeping 150 days of data) [2025-09-14T20:28:35.971399] [DEBUG] [LOCAL ] UHAL: Primary data saved (12351 records). [2025-09-14T20:28:35.971844] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-14T20:28:35.971958] [INFO ] [MAIN ] Update Progress: 2176/2370 symbols completed. UHAL took 28.3s. Estimated remaining: 20m 38s. Rate: 9.4 symbols/min [2025-09-14T20:28:36.152768] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:36.157528] [DEBUG] [LOCAL ] UHT: Primary data saved (7207 records). [2025-09-14T20:28:36.157689] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-14T20:28:36.157793] [INFO ] [MAIN ] Update Progress: 2177/2370 symbols completed. UHT took 19.2s. Estimated remaining: 20m 31s. Rate: 9.4 symbols/min [2025-09-14T20:28:36.340259] [DEBUG] [LOCAL ] UIS: Loaded 16621 existing records from primary storage. [2025-09-14T20:28:36.342804] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:36.343021] [INFO ] [MAIN ] UIS: Loaded 16621 existing records. [2025-09-14T20:28:36.533304] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:36.541525] [DEBUG] [LOCAL ] UL: Loaded 23735 existing records from primary storage. [2025-09-14T20:28:36.541703] [INFO ] [MAIN ] UL: Loaded 23735 existing records. [2025-09-14T20:28:36.562198] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-14T20:28:36.541039] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-14T20:28:36.586143] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-14T20:28:36.619830] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-14T20:28:36.654882] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-14T20:28:36.665944] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T20:28:36.807195] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:36.829987] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-14T20:28:36.829924] [INFO ] [REMOTE ] UHS: Full fetch complete (45256 records). [2025-09-14T20:28:36.845975] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-14T20:28:36.846071] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-14T20:28:36.851816] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-14T20:28:36.862208] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-14T20:28:37.505789] [INFO ] [REMOTE ] UIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:37.595471] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-14T20:28:37.860811] [INFO ] [REMOTE ] UL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:37.860875] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-14T20:28:37.868778] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-14T20:28:37.869023] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T20:28:37.870331] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-14T20:28:37.870486] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-14T20:28:37.874563] [DEBUG] [LOCAL ] UHS: Trimmed 45256 records to 30491 (keeping 150 days of data) [2025-09-14T20:28:38.069708] [DEBUG] [LOCAL ] UHS: Primary data saved (30491 records). [2025-09-14T20:28:38.069877] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-14T20:28:38.069979] [INFO ] [MAIN ] Update Progress: 2178/2370 symbols completed. UHS took 29.1s. Estimated remaining: 20m 24s. Rate: 9.4 symbols/min [2025-09-14T20:28:38.166685] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-14T20:28:38.247659] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:38.265212] [DEBUG] [LOCAL ] ULS: Loaded 17435 existing records from primary storage. [2025-09-14T20:28:38.265371] [INFO ] [MAIN ] ULS: Loaded 17435 existing records. [2025-09-14T20:28:38.440457] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:38.440769] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-14T20:28:38.440834] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-14T20:28:38.441342] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-14T20:28:38.441442] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-14T20:28:38.792815] [INFO ] [REMOTE ] ULS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:38.958837] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-14T20:28:39.076398] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T20:28:39.571946] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T20:28:39.758841] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-14T20:28:40.321288] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-14T20:28:40.558842] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-14T20:28:41.358923] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-14T20:28:41.640303] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T20:28:42.049455] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T20:28:42.158801] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-14T20:28:42.829282] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T20:28:42.958912] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-14T20:28:43.161839] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T20:28:43.758909] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-14T20:28:44.540051] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T20:28:44.558788] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-14T20:28:45.358875] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-14T20:28:45.765677] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T20:28:45.815196] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T20:28:46.158880] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-14T20:28:46.291472] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T20:28:46.958921] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-14T20:28:47.658262] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T20:28:47.758925] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-14T20:28:48.425141] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T20:28:48.558941] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-14T20:28:48.644190] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T20:28:49.358890] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-14T20:28:50.033548] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T20:28:50.158795] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-14T20:28:50.502276] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T20:28:50.958898] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-14T20:28:51.728354] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T20:28:51.758857] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-14T20:28:52.351985] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T20:28:52.558910] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-14T20:28:53.358854] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-14T20:28:53.683188] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T20:28:53.725091] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T20:28:54.158854] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-14T20:28:54.720100] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T20:28:54.958859] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-14T20:28:55.758852] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-14T20:28:55.904440] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T20:28:56.170989] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T20:28:56.181768] [INFO ] [REMOTE ] ULS: Full fetch complete (42342 records). [2025-09-14T20:28:56.181990] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T20:28:56.182246] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-14T20:28:56.184373] [INFO ] [REMOTE ] UI: Full fetch complete (13811 records). [2025-09-14T20:28:56.184529] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-14T20:28:56.563973] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-14T20:28:56.926451] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-14T20:28:56.930682] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-14T20:28:56.931131] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-14T20:28:56.942948] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-14T20:28:56.957405] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-14T20:28:56.957724] [DEBUG] [LOCAL ] UI: Trimmed 13811 records to 9559 (keeping 150 days of data) [2025-09-14T20:28:56.957624] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-14T20:28:56.958733] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-14T20:28:56.959127] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-14T20:28:56.991306] [DEBUG] [LOCAL ] ULS: Trimmed 42342 records to 29571 (keeping 150 days of data) [2025-09-14T20:28:57.020408] [DEBUG] [LOCAL ] UI: Primary data saved (9559 records). [2025-09-14T20:28:57.020817] [INFO ] [MAIN ] UI: Full history saved. [2025-09-14T20:28:57.020935] [INFO ] [MAIN ] Update Progress: 2179/2370 symbols completed. UI took 28.7s. Estimated remaining: 20m 19s. Rate: 9.4 symbols/min [2025-09-14T20:28:57.323033] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:57.361262] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-14T20:28:57.399979] [DEBUG] [LOCAL ] ULS: Primary data saved (29571 records). [2025-09-14T20:28:57.400728] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-14T20:28:57.400921] [INFO ] [MAIN ] Update Progress: 2180/2370 symbols completed. ULS took 19.3s. Estimated remaining: 20m 12s. Rate: 9.4 symbols/min [2025-09-14T20:28:57.510112] [DEBUG] [LOCAL ] UMC: Loaded 23464 existing records from primary storage. [2025-09-14T20:28:57.520880] [INFO ] [MAIN ] UMC: Loaded 23464 existing records. [2025-09-14T20:28:57.682601] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:28:57.760970] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:57.761205] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-14T20:28:57.761262] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-14T20:28:57.762096] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-14T20:28:57.762163] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-14T20:28:57.883588] [DEBUG] [LOCAL ] UMH: Loaded 14888 existing records from primary storage. [2025-09-14T20:28:57.899162] [INFO ] [MAIN ] UMH: Loaded 14888 existing records. [2025-09-14T20:28:58.243861] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:28:58.286958] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-14T20:28:58.321030] [INFO ] [REMOTE ] UMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:58.321512] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-14T20:28:58.321603] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-14T20:28:58.322815] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-14T20:28:58.322917] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-14T20:28:58.474363] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T20:28:58.710068] [INFO ] [REMOTE ] UMH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:28:58.850117] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T20:28:58.958833] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-14T20:28:59.758892] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-14T20:29:00.022371] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T20:29:00.286275] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T20:29:00.290164] [INFO ] [REMOTE ] UIS: Full fetch complete (40495 records). [2025-09-14T20:29:00.290270] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-14T20:29:00.567264] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-14T20:29:00.664834] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-14T20:29:00.664943] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-14T20:29:00.665846] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-14T20:29:00.665913] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-14T20:29:00.666927] [DEBUG] [LOCAL ] UIS: Trimmed 40495 records to 27885 (keeping 150 days of data) [2025-09-14T20:29:00.836112] [DEBUG] [LOCAL ] UIS: Primary data saved (27885 records). [2025-09-14T20:29:00.836280] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-14T20:29:00.836386] [INFO ] [MAIN ] Update Progress: 2181/2370 symbols completed. UIS took 24.9s. Estimated remaining: 20m 5s. Rate: 9.4 symbols/min [2025-09-14T20:29:01.008993] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:01.016029] [DEBUG] [LOCAL ] UNF: Loaded 5021 existing records from primary storage. [2025-09-14T20:29:01.016165] [INFO ] [MAIN ] UNF: Loaded 5021 existing records. [2025-09-14T20:29:01.191781] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:01.192094] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-14T20:29:01.192181] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-14T20:29:01.192483] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-14T20:29:01.192558] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-14T20:29:01.360169] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-14T20:29:01.569834] [INFO ] [REMOTE ] UNF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:01.855446] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T20:29:02.158853] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-14T20:29:02.568819] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T20:29:02.617027] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T20:29:02.958870] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-14T20:29:03.728150] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T20:29:03.733713] [INFO ] [REMOTE ] UL: Full fetch complete (57726 records). [2025-09-14T20:29:03.733897] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-14T20:29:03.763883] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-14T20:29:03.796679] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T20:29:04.142801] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-14T20:29:04.142927] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-14T20:29:04.144157] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-14T20:29:04.144219] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-14T20:29:04.145449] [DEBUG] [LOCAL ] UL: Trimmed 57726 records to 39887 (keeping 150 days of data) [2025-09-14T20:29:04.399547] [DEBUG] [LOCAL ] UL: Primary data saved (39887 records). [2025-09-14T20:29:04.399759] [INFO ] [MAIN ] UL: Full history saved. [2025-09-14T20:29:04.399882] [INFO ] [MAIN ] Update Progress: 2182/2370 symbols completed. UL took 28.2s. Estimated remaining: 19m 59s. Rate: 9.4 symbols/min [2025-09-14T20:29:04.567208] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-14T20:29:04.571456] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:04.591629] [DEBUG] [LOCAL ] UNFI: Loaded 19829 existing records from primary storage. [2025-09-14T20:29:04.591807] [INFO ] [MAIN ] UNFI: Loaded 19829 existing records. [2025-09-14T20:29:04.772267] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:04.772552] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-14T20:29:04.772637] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-14T20:29:04.773232] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-14T20:29:04.773300] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-14T20:29:05.150880] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:05.358827] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-14T20:29:05.454846] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:29:05.579004] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T20:29:06.158837] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-14T20:29:06.476543] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T20:29:06.909445] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T20:29:06.958824] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-14T20:29:07.586934] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T20:29:07.758834] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-14T20:29:08.558850] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-14T20:29:08.655218] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T20:29:09.358888] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-14T20:29:09.921582] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T20:29:10.158865] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-14T20:29:10.803565] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T20:29:10.958923] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-14T20:29:11.222019] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T20:29:11.758865] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-14T20:29:12.558853] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-14T20:29:12.694010] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T20:29:13.358958] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-14T20:29:13.752531] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T20:29:14.158896] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-14T20:29:14.343291] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-14T20:29:14.958939] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-14T20:29:15.082951] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T20:29:15.568476] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T20:29:15.758833] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-14T20:29:16.262747] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T20:29:16.558841] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-14T20:29:17.229200] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T20:29:17.358837] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-14T20:29:17.852875] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T20:29:18.158875] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-14T20:29:18.958820] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-14T20:29:19.100040] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T20:29:19.429263] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T20:29:19.430878] [INFO ] [REMOTE ] UNF: Full fetch complete (12523 records). [2025-09-14T20:29:19.430963] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-14T20:29:19.760040] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-14T20:29:19.837827] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T20:29:19.869744] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-14T20:29:19.870220] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-14T20:29:19.871059] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-14T20:29:19.871143] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-14T20:29:19.871688] [DEBUG] [LOCAL ] UNF: Trimmed 12523 records to 7992 (keeping 150 days of data) [2025-09-14T20:29:19.922573] [DEBUG] [LOCAL ] UNF: Primary data saved (7992 records). [2025-09-14T20:29:19.922744] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-14T20:29:19.922860] [INFO ] [MAIN ] Update Progress: 2183/2370 symbols completed. UNF took 19.1s. Estimated remaining: 19m 53s. Rate: 9.4 symbols/min [2025-09-14T20:29:20.091360] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:20.115231] [DEBUG] [LOCAL ] UNH: Loaded 24179 existing records from primary storage. [2025-09-14T20:29:20.115414] [INFO ] [MAIN ] UNH: Loaded 24179 existing records. [2025-09-14T20:29:20.295574] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:20.295974] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-14T20:29:20.296044] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-14T20:29:20.296737] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-14T20:29:20.296809] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-14T20:29:20.564250] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-14T20:29:20.677704] [INFO ] [REMOTE ] UNH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:21.358917] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-14T20:29:21.416270] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:29:22.158853] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-14T20:29:22.284138] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-14T20:29:22.289470] [INFO ] [REMOTE ] UMC: Full fetch complete (57379 records). [2025-09-14T20:29:22.289667] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-14T20:29:22.679801] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-14T20:29:22.679925] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-14T20:29:22.681622] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-14T20:29:22.681708] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-14T20:29:22.683064] [DEBUG] [LOCAL ] UMC: Trimmed 57379 records to 39585 (keeping 150 days of data) [2025-09-14T20:29:22.930514] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T20:29:22.959624] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-14T20:29:22.959801] [DEBUG] [LOCAL ] UMC: Primary data saved (39585 records). [2025-09-14T20:29:22.961030] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-14T20:29:22.961150] [INFO ] [MAIN ] Update Progress: 2184/2370 symbols completed. UMC took 25.9s. Estimated remaining: 19m 46s. Rate: 9.4 symbols/min [2025-09-14T20:29:23.131028] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:23.152633] [DEBUG] [LOCAL ] UNM: Loaded 21773 existing records from primary storage. [2025-09-14T20:29:23.152820] [INFO ] [MAIN ] UNM: Loaded 21773 existing records. [2025-09-14T20:29:23.331936] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:23.332237] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-14T20:29:23.332306] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-14T20:29:23.332926] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-14T20:29:23.332988] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-14T20:29:23.693974] [INFO ] [REMOTE ] UNM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:23.758811] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-14T20:29:23.999691] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T20:29:24.209223] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T20:29:24.213342] [INFO ] [REMOTE ] UMH: Full fetch complete (34910 records). [2025-09-14T20:29:24.213449] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-14T20:29:24.575727] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-14T20:29:24.590071] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-14T20:29:24.590173] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-14T20:29:24.591176] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-14T20:29:24.591255] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-14T20:29:24.592826] [DEBUG] [LOCAL ] UMH: Trimmed 34910 records to 24551 (keeping 150 days of data) [2025-09-14T20:29:24.750413] [DEBUG] [LOCAL ] UMH: Primary data saved (24551 records). [2025-09-14T20:29:24.750576] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-14T20:29:24.750685] [INFO ] [MAIN ] Update Progress: 2185/2370 symbols completed. UMH took 27.3s. Estimated remaining: 19m 40s. Rate: 9.4 symbols/min [2025-09-14T20:29:24.921127] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:24.924598] [DEBUG] [LOCAL ] UNMA: Loaded 1778 existing records from primary storage. [2025-09-14T20:29:24.924706] [INFO ] [MAIN ] UNMA: Loaded 1778 existing records. [2025-09-14T20:29:25.103011] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:25.103325] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-14T20:29:25.103399] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-14T20:29:25.103685] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-14T20:29:25.103746] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-14T20:29:25.363814] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-14T20:29:25.465005] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:25.492283] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T20:29:26.049925] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T20:29:26.158818] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-14T20:29:26.958863] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-14T20:29:27.608567] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-14T20:29:27.625293] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T20:29:27.705509] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T20:29:27.758813] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-14T20:29:28.439521] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:29:28.443847] [INFO ] [REMOTE ] UNFI: Full fetch complete (44972 records). [2025-09-14T20:29:28.443948] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-14T20:29:28.563995] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-14T20:29:28.827693] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-14T20:29:28.827847] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-14T20:29:28.829179] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-14T20:29:28.829247] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-14T20:29:28.830676] [DEBUG] [LOCAL ] UNFI: Trimmed 44972 records to 31533 (keeping 150 days of data) [2025-09-14T20:29:29.030735] [DEBUG] [LOCAL ] UNFI: Primary data saved (31533 records). [2025-09-14T20:29:29.030930] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-14T20:29:29.031039] [INFO ] [MAIN ] Update Progress: 2186/2370 symbols completed. UNFI took 24.6s. Estimated remaining: 19m 33s. Rate: 9.4 symbols/min [2025-09-14T20:29:29.202297] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:29.225187] [DEBUG] [LOCAL ] UNP: Loaded 23902 existing records from primary storage. [2025-09-14T20:29:29.225359] [INFO ] [MAIN ] UNP: Loaded 23902 existing records. [2025-09-14T20:29:29.369366] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-14T20:29:29.409832] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:29.410061] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-14T20:29:29.410119] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-14T20:29:29.410756] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-14T20:29:29.410837] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-14T20:29:29.767510] [INFO ] [REMOTE ] UNP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:30.158846] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-14T20:29:30.786143] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-14T20:29:30.862692] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T20:29:30.958903] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-14T20:29:31.174977] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T20:29:31.364881] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-14T20:29:31.758890] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-14T20:29:32.367164] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T20:29:32.558908] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-14T20:29:33.358891] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-14T20:29:34.158840] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-14T20:29:34.439873] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T20:29:34.958844] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-14T20:29:35.519863] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T20:29:35.564158] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T20:29:35.632892] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T20:29:35.758853] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-14T20:29:36.398598] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T20:29:36.558889] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-14T20:29:37.154695] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T20:29:37.358878] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-14T20:29:38.158860] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-14T20:29:38.627076] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T20:29:38.628186] [INFO ] [REMOTE ] UNMA: Full fetch complete (4076 records). [2025-09-14T20:29:38.628280] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-14T20:29:38.980116] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-14T20:29:38.993260] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-14T20:29:38.994190] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-14T20:29:38.994399] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-14T20:29:38.994460] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-14T20:29:38.994964] [DEBUG] [LOCAL ] UNMA: Trimmed 4076 records to 2618 (keeping 150 days of data) [2025-09-14T20:29:39.012256] [DEBUG] [LOCAL ] UNMA: Primary data saved (2618 records). [2025-09-14T20:29:39.012345] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-14T20:29:39.012501] [INFO ] [MAIN ] Update Progress: 2187/2370 symbols completed. UNMA took 14.3s. Estimated remaining: 19m 27s. Rate: 9.4 symbols/min [2025-09-14T20:29:39.183531] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:39.209069] [DEBUG] [LOCAL ] UP: Loaded 19608 existing records from primary storage. [2025-09-14T20:29:39.209284] [INFO ] [MAIN ] UP: Loaded 19608 existing records. [2025-09-14T20:29:39.392080] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:39.392424] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-14T20:29:39.392500] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-14T20:29:39.393230] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-14T20:29:39.393318] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-14T20:29:39.755911] [INFO ] [REMOTE ] UP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:39.758783] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-14T20:29:39.921696] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-14T20:29:40.558966] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-14T20:29:40.806900] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T20:29:41.116068] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-14T20:29:41.358881] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-14T20:29:42.137032] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T20:29:42.158769] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-14T20:29:42.958870] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-14T20:29:43.758969] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-14T20:29:43.793736] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-14T20:29:43.830330] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T20:29:44.558877] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-14T20:29:44.798451] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T20:29:45.076011] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T20:29:45.358850] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-14T20:29:45.561297] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T20:29:46.158850] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-14T20:29:46.960630] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-14T20:29:46.966757] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T20:29:47.006234] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T20:29:47.758840] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-14T20:29:48.558873] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-14T20:29:49.030357] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T20:29:49.358909] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-14T20:29:49.391352] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T20:29:50.158939] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-14T20:29:50.362867] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T20:29:50.663257] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T20:29:50.668883] [INFO ] [REMOTE ] UNH: Full fetch complete (58467 records). [2025-09-14T20:29:50.669047] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-14T20:29:50.964106] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-14T20:29:51.055935] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-14T20:29:51.056048] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-14T20:29:51.057215] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-14T20:29:51.057280] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-14T20:29:51.058563] [DEBUG] [LOCAL ] UNH: Trimmed 58467 records to 40559 (keeping 150 days of data) [2025-09-14T20:29:51.205424] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T20:29:51.396253] [DEBUG] [LOCAL ] UNH: Primary data saved (40559 records). [2025-09-14T20:29:51.396451] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-14T20:29:51.396621] [INFO ] [MAIN ] Update Progress: 2188/2370 symbols completed. UNH took 31.5s. Estimated remaining: 19m 21s. Rate: 9.4 symbols/min [2025-09-14T20:29:51.577984] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:51.603098] [DEBUG] [LOCAL ] UPS: Loaded 24100 existing records from primary storage. [2025-09-14T20:29:51.603298] [INFO ] [MAIN ] UPS: Loaded 24100 existing records. [2025-09-14T20:29:51.760171] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-14T20:29:51.781231] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:51.781401] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-14T20:29:51.781461] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-14T20:29:51.782041] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-14T20:29:51.782100] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-14T20:29:52.143370] [INFO ] [REMOTE ] UPS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:52.328419] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T20:29:52.558848] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-14T20:29:53.358929] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-14T20:29:53.799552] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T20:29:54.158879] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-14T20:29:54.274595] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T20:29:54.879473] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T20:29:54.958770] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-14T20:29:55.758857] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-14T20:29:55.843438] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T20:29:56.425599] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:29:56.434339] [INFO ] [REMOTE ] UNM: Full fetch complete (52959 records). [2025-09-14T20:29:56.434668] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-14T20:29:56.564145] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-14T20:29:56.932935] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T20:29:57.114039] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-14T20:29:57.114182] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-14T20:29:57.115626] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-14T20:29:57.115758] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-14T20:29:57.117214] [DEBUG] [LOCAL ] UNM: Trimmed 52959 records to 36281 (keeping 150 days of data) [2025-09-14T20:29:57.363721] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-14T20:29:57.399255] [DEBUG] [LOCAL ] UNM: Primary data saved (36281 records). [2025-09-14T20:29:57.399488] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-14T20:29:57.399629] [INFO ] [MAIN ] Update Progress: 2189/2370 symbols completed. UNM took 34.4s. Estimated remaining: 19m 15s. Rate: 9.4 symbols/min [2025-09-14T20:29:57.599386] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:57.617611] [DEBUG] [LOCAL ] URI: Loaded 15540 existing records from primary storage. [2025-09-14T20:29:57.617820] [INFO ] [MAIN ] URI: Loaded 15540 existing records. [2025-09-14T20:29:57.798994] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:29:57.799254] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-14T20:29:57.799316] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-14T20:29:57.799763] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-14T20:29:57.799825] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-14T20:29:58.164372] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-14T20:29:58.169030] [INFO ] [REMOTE ] URI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:29:58.637238] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T20:29:58.958838] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-14T20:29:59.092514] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-14T20:29:59.098736] [INFO ] [REMOTE ] UP: Full fetch complete (45718 records). [2025-09-14T20:29:59.098951] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-14T20:29:59.532782] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-14T20:29:59.532923] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-14T20:29:59.533953] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-14T20:29:59.534014] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-14T20:29:59.536172] [DEBUG] [LOCAL ] UP: Trimmed 45718 records to 32128 (keeping 150 days of data) [2025-09-14T20:29:59.736166] [DEBUG] [LOCAL ] UP: Primary data saved (32128 records). [2025-09-14T20:29:59.736357] [INFO ] [MAIN ] UP: Full history saved. [2025-09-14T20:29:59.736474] [INFO ] [MAIN ] Update Progress: 2190/2370 symbols completed. UP took 20.7s. Estimated remaining: 19m 8s. Rate: 9.4 symbols/min [2025-09-14T20:29:59.767580] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-14T20:29:59.911735] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:29:59.948919] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T20:29:59.975788] [DEBUG] [LOCAL ] USA: Loaded 16423 existing records from primary storage. [2025-09-14T20:29:59.976004] [INFO ] [MAIN ] USA: Loaded 16423 existing records. [2025-09-14T20:30:00.160247] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:30:00.160573] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-14T20:30:00.160638] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-14T20:30:00.161126] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-14T20:30:00.161192] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-14T20:30:00.520833] [INFO ] [REMOTE ] USA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:30:00.541075] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T20:30:00.558768] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-14T20:30:01.358852] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-14T20:30:02.158895] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-14T20:30:02.349274] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-14T20:30:02.859233] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-14T20:30:02.958871] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-14T20:30:03.758976] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-14T20:30:04.991496] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (3.63 seconds). [2025-09-14T20:30:04.998288] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-14T20:30:05.015211] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-14T20:30:05.022130] [INFO ] [REMOTE ] UNP: Full fetch complete (57798 records). [2025-09-14T20:30:05.022305] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-14T20:30:05.413809] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-14T20:30:05.413924] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-14T20:30:05.415006] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-14T20:30:05.415067] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-14T20:30:05.416329] [DEBUG] [LOCAL ] UNP: Trimmed 57798 records to 40169 (keeping 150 days of data) [2025-09-14T20:30:05.701804] [DEBUG] [LOCAL ] UNP: Primary data saved (40169 records). [2025-09-14T20:30:05.701963] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-14T20:30:05.702088] [INFO ] [MAIN ] Update Progress: 2191/2370 symbols completed. UNP took 36.7s. Estimated remaining: 19m 2s. Rate: 9.4 symbols/min [2025-09-14T20:30:05.873460] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:05.883791] [DEBUG] [LOCAL ] USAC: Loaded 8540 existing records from primary storage. [2025-09-14T20:30:05.883932] [INFO ] [MAIN ] USAC: Loaded 8540 existing records. [2025-09-14T20:30:06.062891] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:30:06.063230] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-14T20:30:06.063298] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-14T20:30:06.063673] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-14T20:30:06.063735] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-14T20:30:06.427770] [INFO ] [REMOTE ] USAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:30:06.428218] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-14T20:30:06.696018] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T20:30:06.706076] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-14T20:30:06.796894] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (3.84 seconds). [2025-09-14T20:30:06.958844] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-14T20:30:07.190229] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (3.43 seconds). [2025-09-14T20:30:07.456336] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T20:30:07.758852] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-14T20:30:08.081213] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T20:30:08.179808] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T20:30:08.558860] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-14T20:30:08.813448] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T20:30:09.358857] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-14T20:30:10.158800] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-14T20:30:10.465332] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T20:30:10.533192] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T20:30:10.958825] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-14T20:30:11.622274] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T20:30:11.758811] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-14T20:30:12.558849] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-14T20:30:13.049827] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T20:30:13.141542] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-14T20:30:13.358823] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-14T20:30:13.530949] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T20:30:14.158851] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-14T20:30:14.958840] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-14T20:30:15.449916] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T20:30:15.631288] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-14T20:30:15.758797] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-14T20:30:16.558859] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-14T20:30:16.929400] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T20:30:17.358887] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-14T20:30:17.654255] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-14T20:30:17.661186] [INFO ] [REMOTE ] UPS: Full fetch complete (58386 records). [2025-09-14T20:30:17.661381] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-14T20:30:18.056115] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-14T20:30:18.056250] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-14T20:30:18.057333] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-14T20:30:18.057393] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-14T20:30:18.058732] [DEBUG] [LOCAL ] UPS: Trimmed 58386 records to 40461 (keeping 150 days of data) [2025-09-14T20:30:18.159866] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-14T20:30:18.332909] [DEBUG] [LOCAL ] UPS: Primary data saved (40461 records). [2025-09-14T20:30:18.333068] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-14T20:30:18.333171] [INFO ] [MAIN ] Update Progress: 2192/2370 symbols completed. UPS took 26.9s. Estimated remaining: 18m 56s. Rate: 9.4 symbols/min [2025-09-14T20:30:18.509583] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:18.536918] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T20:30:18.571555] [DEBUG] [LOCAL ] USB: Loaded 24049 existing records from primary storage. [2025-09-14T20:30:18.571780] [INFO ] [MAIN ] USB: Loaded 24049 existing records. [2025-09-14T20:30:18.753073] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:30:18.753635] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-14T20:30:18.753770] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-14T20:30:18.760171] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-14T20:30:18.769783] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-14T20:30:18.776587] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T20:30:18.965159] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-14T20:30:19.139412] [INFO ] [REMOTE ] USB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:30:19.521297] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T20:30:19.758869] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-14T20:30:20.438839] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T20:30:20.476207] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T20:30:20.558881] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-14T20:30:21.358883] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-14T20:30:21.734832] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T20:30:21.739497] [INFO ] [REMOTE ] USA: Full fetch complete (38686 records). [2025-09-14T20:30:21.739721] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-14T20:30:22.098543] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T20:30:22.163798] [INFO ] [REMOTE ] URI: Full fetch complete (40179 records). [2025-09-14T20:30:22.163574] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-14T20:30:22.173546] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-14T20:30:22.174999] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-14T20:30:22.218522] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-14T20:30:22.275034] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-14T20:30:22.277480] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-14T20:30:22.334296] [DEBUG] [LOCAL ] USA: Trimmed 38686 records to 26260 (keeping 150 days of data) [2025-09-14T20:30:22.662535] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-14T20:30:22.677768] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-14T20:30:22.679041] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-14T20:30:22.697559] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-14T20:30:22.717129] [DEBUG] [LOCAL ] URI: Trimmed 40179 records to 26247 (keeping 150 days of data) [2025-09-14T20:30:22.722315] [DEBUG] [LOCAL ] USA: Primary data saved (26260 records). [2025-09-14T20:30:22.789265] [INFO ] [MAIN ] USA: Full history saved. [2025-09-14T20:30:22.789852] [INFO ] [MAIN ] Update Progress: 2193/2370 symbols completed. USA took 23.1s. Estimated remaining: 18m 49s. Rate: 9.4 symbols/min [2025-09-14T20:30:22.959840] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-14T20:30:23.030760] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:23.047343] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T20:30:23.111015] [DEBUG] [LOCAL ] URI: Primary data saved (26247 records). [2025-09-14T20:30:23.108934] [DEBUG] [LOCAL ] USFD: Loaded 22984 existing records from primary storage. [2025-09-14T20:30:23.111145] [INFO ] [MAIN ] URI: Full history saved. [2025-09-14T20:30:23.111295] [INFO ] [MAIN ] Update Progress: 2194/2370 symbols completed. URI took 25.7s. Estimated remaining: 18m 42s. Rate: 9.4 symbols/min [2025-09-14T20:30:23.111357] [INFO ] [MAIN ] USFD: Loaded 22984 existing records. [2025-09-14T20:30:23.461810] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:30:23.465347] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:23.465946] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-14T20:30:23.466020] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-14T20:30:23.466607] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-14T20:30:23.466728] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-14T20:30:23.573756] [DEBUG] [LOCAL ] USNA: Loaded 6919 existing records from primary storage. [2025-09-14T20:30:23.599682] [INFO ] [MAIN ] USNA: Loaded 6919 existing records. [2025-09-14T20:30:23.759749] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-14T20:30:24.010543] [INFO ] [REMOTE ] USFD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:30:24.006673] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:30:24.011303] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-14T20:30:24.011469] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-14T20:30:24.011935] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-14T20:30:24.012132] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-14T20:30:24.377985] [INFO ] [REMOTE ] USNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:30:24.408458] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T20:30:24.558869] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-14T20:30:24.901770] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T20:30:25.358870] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-14T20:30:25.645057] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T20:30:26.037211] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:30:26.040338] [INFO ] [REMOTE ] USAC: Full fetch complete (25497 records). [2025-09-14T20:30:26.040490] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-14T20:30:26.164004] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-14T20:30:26.431855] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-14T20:30:26.432004] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-14T20:30:26.432734] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-14T20:30:26.432817] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-14T20:30:26.433893] [DEBUG] [LOCAL ] USAC: Trimmed 25497 records to 15690 (keeping 150 days of data) [2025-09-14T20:30:26.536001] [DEBUG] [LOCAL ] USAC: Primary data saved (15690 records). [2025-09-14T20:30:26.536197] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-14T20:30:26.536313] [INFO ] [MAIN ] Update Progress: 2195/2370 symbols completed. USAC took 20.8s. Estimated remaining: 18m 36s. Rate: 9.4 symbols/min [2025-09-14T20:30:26.715271] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:26.724952] [DEBUG] [LOCAL ] USPH: Loaded 8104 existing records from primary storage. [2025-09-14T20:30:26.725139] [INFO ] [MAIN ] USPH: Loaded 8104 existing records. [2025-09-14T20:30:26.907755] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:30:26.908231] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-14T20:30:26.908332] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-14T20:30:26.908782] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-14T20:30:26.908888] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-14T20:30:26.963920] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-14T20:30:27.266216] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T20:30:27.337048] [INFO ] [REMOTE ] USPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:30:27.758844] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-14T20:30:28.558812] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-14T20:30:28.822571] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T20:30:28.852500] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T20:30:29.358845] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-14T20:30:29.444215] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:30:30.158856] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-14T20:30:30.410632] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T20:30:30.958896] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-14T20:30:31.369433] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T20:30:31.758848] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-14T20:30:32.558847] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-14T20:30:33.044885] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T20:30:33.358822] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-14T20:30:33.715135] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T20:30:34.102236] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-14T20:30:34.158822] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-14T20:30:34.406823] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T20:30:34.958837] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-14T20:30:35.213995] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T20:30:35.758843] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-14T20:30:36.558810] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-14T20:30:36.665570] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T20:30:36.704784] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T20:30:37.362452] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-14T20:30:37.365804] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T20:30:38.158817] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-14T20:30:38.268553] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T20:30:38.958859] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-14T20:30:39.248831] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T20:30:39.758826] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-14T20:30:39.776979] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T20:30:40.558852] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-14T20:30:40.727776] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T20:30:41.358943] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-14T20:30:41.605914] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T20:30:42.158879] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-14T20:30:42.383254] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T20:30:42.958887] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-14T20:30:43.563513] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T20:30:43.565482] [INFO ] [REMOTE ] USNA: Full fetch complete (20588 records). [2025-09-14T20:30:43.565590] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-14T20:30:43.768094] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-14T20:30:43.936954] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-14T20:30:43.937108] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-14T20:30:43.937738] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-14T20:30:43.937900] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-14T20:30:43.938780] [DEBUG] [LOCAL ] USNA: Trimmed 20588 records to 13115 (keeping 150 days of data) [2025-09-14T20:30:44.026726] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T20:30:44.067743] [DEBUG] [LOCAL ] USNA: Primary data saved (13115 records). [2025-09-14T20:30:44.067993] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-14T20:30:44.068240] [INFO ] [MAIN ] Update Progress: 2196/2370 symbols completed. USNA took 20.9s. Estimated remaining: 18m 30s. Rate: 9.4 symbols/min [2025-09-14T20:30:44.251168] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:44.263960] [DEBUG] [LOCAL ] UTF: Loaded 11621 existing records from primary storage. [2025-09-14T20:30:44.264134] [INFO ] [MAIN ] UTF: Loaded 11621 existing records. [2025-09-14T20:30:44.446859] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:30:44.447136] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-14T20:30:44.447218] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-14T20:30:44.447667] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-14T20:30:44.447732] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-14T20:30:44.563952] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-14T20:30:44.811580] [INFO ] [REMOTE ] UTF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:30:44.857394] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T20:30:45.358838] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-14T20:30:46.158801] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-14T20:30:46.453852] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T20:30:46.537789] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T20:30:46.722098] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T20:30:46.724095] [INFO ] [REMOTE ] USPH: Full fetch complete (17767 records). [2025-09-14T20:30:46.724181] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-14T20:30:46.963950] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-14T20:30:47.091743] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-14T20:30:47.091849] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-14T20:30:47.092257] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-14T20:30:47.092308] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-14T20:30:47.092958] [DEBUG] [LOCAL ] USPH: Trimmed 17767 records to 12705 (keeping 150 days of data) [2025-09-14T20:30:47.174997] [DEBUG] [LOCAL ] USPH: Primary data saved (12705 records). [2025-09-14T20:30:47.175186] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-14T20:30:47.175287] [INFO ] [MAIN ] Update Progress: 2197/2370 symbols completed. USPH took 20.6s. Estimated remaining: 18m 24s. Rate: 9.4 symbols/min [2025-09-14T20:30:47.731109] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T20:30:47.736765] [INFO ] [REMOTE ] USB: Full fetch complete (58367 records). [2025-09-14T20:30:47.736905] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-14T20:30:47.768430] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-14T20:30:48.150246] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-14T20:30:48.150367] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-14T20:30:48.151458] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-14T20:30:48.151516] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-14T20:30:48.152787] [DEBUG] [LOCAL ] USB: Trimmed 58367 records to 40428 (keeping 150 days of data) [2025-09-14T20:30:48.420816] [DEBUG] [LOCAL ] USB: Primary data saved (40428 records). [2025-09-14T20:30:48.421262] [INFO ] [MAIN ] USB: Full history saved. [2025-09-14T20:30:48.421486] [INFO ] [MAIN ] Update Progress: 2198/2370 symbols completed. USB took 30.1s. Estimated remaining: 18m 17s. Rate: 9.4 symbols/min [2025-09-14T20:30:48.558819] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-14T20:30:49.820828] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T20:30:49.835529] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-14T20:30:49.973684] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T20:30:50.158842] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-14T20:30:51.479288] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T20:30:51.486541] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-14T20:30:51.747689] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T20:30:51.759754] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-14T20:30:52.433325] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:30:52.438634] [INFO ] [REMOTE ] USFD: Full fetch complete (55946 records). [2025-09-14T20:30:52.439229] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-14T20:30:52.882067] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-14T20:30:52.882271] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-14T20:30:52.884780] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-14T20:30:52.885005] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-14T20:30:52.887035] [DEBUG] [LOCAL ] USFD: Trimmed 55946 records to 38536 (keeping 150 days of data) [2025-09-14T20:30:52.969909] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T20:30:53.020217] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-14T20:30:53.191410] [DEBUG] [LOCAL ] USFD: Primary data saved (38536 records). [2025-09-14T20:30:53.191941] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-14T20:30:53.192173] [INFO ] [MAIN ] Update Progress: 2199/2370 symbols completed. USFD took 30.4s. Estimated remaining: 18m 10s. Rate: 9.4 symbols/min [2025-09-14T20:30:54.108083] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T20:30:54.114446] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-14T20:30:55.556189] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T20:30:55.562631] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-14T20:30:57.285049] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T20:30:57.292240] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-14T20:30:58.472486] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T20:30:58.477069] [INFO ] [REMOTE ] UTF: Full fetch complete (30152 records). [2025-09-14T20:30:58.477342] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-14T20:30:58.883496] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-14T20:30:58.883609] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-14T20:30:58.884293] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-14T20:30:58.884352] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-14T20:30:58.885185] [DEBUG] [LOCAL ] UTF: Trimmed 30152 records to 20046 (keeping 150 days of data) [2025-09-14T20:30:59.028483] [DEBUG] [LOCAL ] UTF: Primary data saved (20046 records). [2025-09-14T20:30:59.028691] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-14T20:30:59.028827] [INFO ] [MAIN ] Update Progress: 2200/2370 symbols completed. UTF took 15.0s. Estimated remaining: 18m 4s. Rate: 9.4 symbols/min [2025-09-14T20:30:59.708391] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:59.768567] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:59.769880] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:59.742992] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:30:59.780297] [DEBUG] [LOCAL ] UTL: Loaded 5623 existing records from primary storage. [2025-09-14T20:30:59.783619] [INFO ] [MAIN ] UTL: Loaded 5623 existing records. [2025-09-14T20:30:59.839175] [DEBUG] [LOCAL ] UVE: Loaded 9934 existing records from primary storage. [2025-09-14T20:30:59.886746] [INFO ] [MAIN ] UVE: Loaded 9934 existing records. [2025-09-14T20:30:59.920688] [DEBUG] [LOCAL ] UTZ: Loaded 19407 existing records from primary storage. [2025-09-14T20:30:59.943949] [INFO ] [MAIN ] UTZ: Loaded 19407 existing records. [2025-09-14T20:31:00.009606] [DEBUG] [LOCAL ] UTI: Loaded 17235 existing records from primary storage. [2025-09-14T20:31:00.115955] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:00.192438] [INFO ] [MAIN ] UTI: Loaded 17235 existing records. [2025-09-14T20:31:00.197816] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-14T20:31:00.236093] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-14T20:31:00.300296] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-14T20:31:00.438525] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:00.469048] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:00.469139] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-14T20:31:00.495288] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-14T20:31:00.539478] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-14T20:31:00.584454] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-14T20:31:00.639771] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-14T20:31:00.614002] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-14T20:31:00.659215] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-14T20:31:00.659262] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-14T20:31:00.764264] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:00.769549] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-14T20:31:00.799022] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-14T20:31:00.905872] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-14T20:31:00.950273] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-14T20:31:00.980017] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-14T20:31:01.668122] [INFO ] [REMOTE ] UTL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:01.797666] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-14T20:31:01.912334] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:01.961111] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-14T20:31:02.055071] [INFO ] [REMOTE ] UVE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:02.067317] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-14T20:31:02.147740] [INFO ] [REMOTE ] UTI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:02.148092] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-14T20:31:02.845090] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T20:31:02.847901] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-14T20:31:03.073585] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T20:31:03.078188] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-14T20:31:03.598706] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T20:31:03.608060] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-14T20:31:03.741293] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:31:03.743704] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-14T20:31:03.795335] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T20:31:03.803877] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-14T20:31:03.859042] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T20:31:03.863795] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-14T20:31:04.659471] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T20:31:04.662194] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-14T20:31:04.817510] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T20:31:04.822566] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-14T20:31:04.950566] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T20:31:05.358830] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-14T20:31:05.422978] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T20:31:05.551025] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T20:31:05.666975] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T20:31:06.158828] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-14T20:31:06.864761] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T20:31:06.958837] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-14T20:31:06.983431] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T20:31:07.758884] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-14T20:31:08.558881] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-14T20:31:08.642939] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T20:31:08.897025] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T20:31:09.358880] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-14T20:31:10.158843] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-14T20:31:10.243918] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T20:31:10.736080] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T20:31:10.958871] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-14T20:31:11.041811] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T20:31:11.758890] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-14T20:31:11.932942] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T20:31:12.558880] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-14T20:31:13.073833] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T20:31:13.260377] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:31:13.262617] [INFO ] [REMOTE ] UVE: Full fetch complete (23742 records). [2025-09-14T20:31:13.262731] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-14T20:31:13.364595] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-14T20:31:13.659230] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-14T20:31:13.659376] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-14T20:31:13.660195] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-14T20:31:13.660258] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-14T20:31:13.661426] [DEBUG] [LOCAL ] UVE: Trimmed 23742 records to 17083 (keeping 150 days of data) [2025-09-14T20:31:13.779491] [DEBUG] [LOCAL ] UVE: Primary data saved (17083 records). [2025-09-14T20:31:13.779689] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-14T20:31:13.779794] [INFO ] [MAIN ] Update Progress: 2201/2370 symbols completed. UVE took 14.7s. Estimated remaining: 17m 58s. Rate: 9.4 symbols/min [2025-09-14T20:31:13.953923] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:31:13.965959] [DEBUG] [LOCAL ] UVV: Loaded 10549 existing records from primary storage. [2025-09-14T20:31:13.966172] [INFO ] [MAIN ] UVV: Loaded 10549 existing records. [2025-09-14T20:31:14.146403] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:14.146736] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-14T20:31:14.146823] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-14T20:31:14.147238] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-14T20:31:14.147305] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-14T20:31:14.168047] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-14T20:31:14.507972] [INFO ] [REMOTE ] UVV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:14.939201] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T20:31:14.958782] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-14T20:31:15.758881] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-14T20:31:16.098113] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T20:31:16.558794] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-14T20:31:16.593336] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T20:31:16.946123] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T20:31:17.358894] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-14T20:31:17.555383] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T20:31:18.158879] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-14T20:31:18.730535] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T20:31:18.732602] [INFO ] [REMOTE ] UTL: Full fetch complete (11481 records). [2025-09-14T20:31:18.732731] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-14T20:31:18.963958] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-14T20:31:19.134371] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-14T20:31:19.134604] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-14T20:31:19.135068] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-14T20:31:19.135265] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-14T20:31:19.136245] [DEBUG] [LOCAL ] UTL: Trimmed 11481 records to 8454 (keeping 150 days of data) [2025-09-14T20:31:19.205908] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T20:31:19.228752] [DEBUG] [LOCAL ] UTL: Primary data saved (8454 records). [2025-09-14T20:31:19.228978] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-14T20:31:19.229206] [INFO ] [MAIN ] Update Progress: 2202/2370 symbols completed. UTL took 20.2s. Estimated remaining: 17m 52s. Rate: 9.4 symbols/min [2025-09-14T20:31:19.417957] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:31:19.444726] [DEBUG] [LOCAL ] UWMC: Loaded 23877 existing records from primary storage. [2025-09-14T20:31:19.444980] [INFO ] [MAIN ] UWMC: Loaded 23877 existing records. [2025-09-14T20:31:19.636212] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:19.636556] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-14T20:31:19.636748] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-14T20:31:19.637394] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-14T20:31:19.637459] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-14T20:31:19.764159] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-14T20:31:20.020908] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:20.354163] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T20:31:20.359450] [INFO ] [REMOTE ] UTI: Full fetch complete (44497 records). [2025-09-14T20:31:20.359707] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-14T20:31:20.564028] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-14T20:31:20.796283] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-14T20:31:20.796418] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-14T20:31:20.797997] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-14T20:31:20.798097] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-14T20:31:20.799562] [DEBUG] [LOCAL ] UTI: Trimmed 44497 records to 30337 (keeping 150 days of data) [2025-09-14T20:31:21.000551] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T20:31:21.018165] [DEBUG] [LOCAL ] UTI: Primary data saved (30337 records). [2025-09-14T20:31:21.018326] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-14T20:31:21.018459] [INFO ] [MAIN ] Update Progress: 2203/2370 symbols completed. UTI took 22.0s. Estimated remaining: 17m 45s. Rate: 9.4 symbols/min [2025-09-14T20:31:21.209078] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:31:21.214528] [DEBUG] [LOCAL ] UZD: Loaded 2872 existing records from primary storage. [2025-09-14T20:31:21.214701] [INFO ] [MAIN ] UZD: Loaded 2872 existing records. [2025-09-14T20:31:21.367276] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-14T20:31:21.404593] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:21.405064] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-14T20:31:21.405169] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-14T20:31:21.405451] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-14T20:31:21.405532] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-14T20:31:21.820376] [INFO ] [REMOTE ] UZD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:22.158921] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-14T20:31:22.256399] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T20:31:22.958936] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-14T20:31:23.253427] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T20:31:23.442289] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T20:31:23.758854] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-14T20:31:24.480448] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T20:31:24.558861] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-14T20:31:25.333144] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T20:31:25.358809] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-14T20:31:25.645800] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T20:31:26.158844] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-14T20:31:26.529531] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T20:31:26.958787] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-14T20:31:27.358884] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T20:31:27.758880] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-14T20:31:28.558907] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-14T20:31:28.777920] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T20:31:28.964709] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T20:31:29.358877] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-14T20:31:29.583390] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T20:31:29.587819] [INFO ] [REMOTE ] UTZ: Full fetch complete (48652 records). [2025-09-14T20:31:29.588005] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-14T20:31:29.970678] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-14T20:31:29.975776] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-14T20:31:29.976605] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T20:31:29.980163] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-14T20:31:29.980254] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-14T20:31:29.981428] [DEBUG] [LOCAL ] UTZ: Trimmed 48652 records to 33624 (keeping 150 days of data) [2025-09-14T20:31:30.174147] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-14T20:31:30.228238] [DEBUG] [LOCAL ] UTZ: Primary data saved (33624 records). [2025-09-14T20:31:30.228402] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-14T20:31:30.228529] [INFO ] [MAIN ] Update Progress: 2204/2370 symbols completed. UTZ took 31.2s. Estimated remaining: 17m 39s. Rate: 9.4 symbols/min [2025-09-14T20:31:30.397074] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:31:30.402869] [DEBUG] [LOCAL ] UZE: Loaded 3689 existing records from primary storage. [2025-09-14T20:31:30.403018] [INFO ] [MAIN ] UZE: Loaded 3689 existing records. [2025-09-14T20:31:30.577906] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:30.578142] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-14T20:31:30.578202] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-14T20:31:30.578452] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-14T20:31:30.578508] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-14T20:31:30.925971] [INFO ] [REMOTE ] UZE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:30.946970] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T20:31:30.958795] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-14T20:31:31.601147] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T20:31:31.758855] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-14T20:31:32.558908] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-14T20:31:33.018813] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T20:31:33.106751] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T20:31:33.358889] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-14T20:31:34.158865] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-14T20:31:34.339516] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T20:31:34.726000] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T20:31:34.958834] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-14T20:31:35.623439] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T20:31:35.624512] [INFO ] [REMOTE ] UZD: Full fetch complete (7034 records). [2025-09-14T20:31:35.624596] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-14T20:31:35.770239] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-14T20:31:36.015286] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-14T20:31:36.015432] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-14T20:31:36.015845] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-14T20:31:36.015926] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-14T20:31:36.016507] [DEBUG] [LOCAL ] UZD: Trimmed 7034 records to 4769 (keeping 150 days of data) [2025-09-14T20:31:36.051548] [DEBUG] [LOCAL ] UZD: Primary data saved (4769 records). [2025-09-14T20:31:36.051799] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-14T20:31:36.051965] [INFO ] [MAIN ] Update Progress: 2205/2370 symbols completed. UZD took 15.0s. Estimated remaining: 17m 32s. Rate: 9.4 symbols/min [2025-09-14T20:31:36.244302] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:31:36.249766] [DEBUG] [LOCAL ] UZF: Loaded 2960 existing records from primary storage. [2025-09-14T20:31:36.249920] [INFO ] [MAIN ] UZF: Loaded 2960 existing records. [2025-09-14T20:31:36.432875] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:36.433225] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-14T20:31:36.433289] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-14T20:31:36.433587] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-14T20:31:36.433704] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-14T20:31:36.564010] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-14T20:31:36.819784] [INFO ] [REMOTE ] UZF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:37.056591] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T20:31:37.358952] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-14T20:31:37.513877] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T20:31:37.759992] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T20:31:37.762553] [INFO ] [REMOTE ] UVV: Full fetch complete (23377 records). [2025-09-14T20:31:37.762698] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-14T20:31:38.143105] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-14T20:31:38.143246] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-14T20:31:38.143946] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-14T20:31:38.144006] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-14T20:31:38.144989] [DEBUG] [LOCAL ] UVV: Trimmed 23377 records to 17608 (keeping 150 days of data) [2025-09-14T20:31:38.195317] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-14T20:31:38.274934] [DEBUG] [LOCAL ] UVV: Primary data saved (17608 records). [2025-09-14T20:31:38.275182] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-14T20:31:38.275309] [INFO ] [MAIN ] Update Progress: 2206/2370 symbols completed. UVV took 24.5s. Estimated remaining: 17m 26s. Rate: 9.4 symbols/min [2025-09-14T20:31:38.460801] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:31:38.490695] [DEBUG] [LOCAL ] V: Loaded 24134 existing records from primary storage. [2025-09-14T20:31:38.490949] [INFO ] [MAIN ] V: Loaded 24134 existing records. [2025-09-14T20:31:38.674956] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:38.675271] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-14T20:31:38.675334] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-14T20:31:38.676035] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-14T20:31:38.676113] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-14T20:31:38.960275] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-14T20:31:39.046458] [INFO ] [REMOTE ] V: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:39.758832] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-14T20:31:39.807746] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T20:31:40.140696] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T20:31:40.558811] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-14T20:31:40.699608] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T20:31:41.358906] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-14T20:31:42.153128] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T20:31:42.158778] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-14T20:31:42.461034] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T20:31:42.942347] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T20:31:42.958770] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-14T20:31:43.604848] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T20:31:43.758845] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-14T20:31:44.554232] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T20:31:44.558763] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-14T20:31:45.209258] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T20:31:45.358895] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-14T20:31:46.159186] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-14T20:31:46.162368] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T20:31:46.958815] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-14T20:31:47.758824] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-14T20:31:47.876152] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T20:31:48.031022] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T20:31:48.436692] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T20:31:48.558823] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-14T20:31:49.358805] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-14T20:31:49.444225] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T20:31:50.029705] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T20:31:50.158831] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-14T20:31:50.958817] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-14T20:31:51.024997] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T20:31:51.758839] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-14T20:31:52.558828] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-14T20:31:52.686757] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T20:31:52.889121] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T20:31:53.358802] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-14T20:31:53.526003] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T20:31:54.117741] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T20:31:54.119249] [INFO ] [REMOTE ] UZE: Full fetch complete (7807 records). [2025-09-14T20:31:54.119355] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-14T20:31:54.164039] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-14T20:31:54.497174] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-14T20:31:54.497295] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-14T20:31:54.497570] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-14T20:31:54.497636] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-14T20:31:54.498412] [DEBUG] [LOCAL ] UZE: Trimmed 7807 records to 5661 (keeping 150 days of data) [2025-09-14T20:31:54.535982] [DEBUG] [LOCAL ] UZE: Primary data saved (5661 records). [2025-09-14T20:31:54.536164] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-14T20:31:54.536349] [INFO ] [MAIN ] Update Progress: 2207/2370 symbols completed. UZE took 24.3s. Estimated remaining: 17m 20s. Rate: 9.4 symbols/min [2025-09-14T20:31:54.707615] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:31:54.725663] [DEBUG] [LOCAL ] VAC: Loaded 14408 existing records from primary storage. [2025-09-14T20:31:54.725851] [INFO ] [MAIN ] VAC: Loaded 14408 existing records. [2025-09-14T20:31:54.889577] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-14T20:31:54.907877] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:54.911115] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-14T20:31:54.911188] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-14T20:31:54.911573] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-14T20:31:54.911632] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-14T20:31:54.965283] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-14T20:31:55.277168] [INFO ] [REMOTE ] VAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:55.547905] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T20:31:55.758907] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-14T20:31:56.558910] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-14T20:31:56.737921] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T20:31:57.358885] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-14T20:31:58.054221] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:31:58.077412] [INFO ] [REMOTE ] V: Full fetch complete (58442 records). [2025-09-14T20:31:58.077840] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-14T20:31:58.078944] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T20:31:58.163945] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-14T20:31:58.474884] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-14T20:31:58.475004] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-14T20:31:58.476146] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-14T20:31:58.476217] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-14T20:31:58.477530] [DEBUG] [LOCAL ] V: Trimmed 58442 records to 40504 (keeping 150 days of data) [2025-09-14T20:31:58.748505] [DEBUG] [LOCAL ] V: Primary data saved (40504 records). [2025-09-14T20:31:58.748683] [INFO ] [MAIN ] V: Full history saved. [2025-09-14T20:31:58.748803] [INFO ] [MAIN ] Update Progress: 2208/2370 symbols completed. V took 20.5s. Estimated remaining: 17m 14s. Rate: 9.4 symbols/min [2025-09-14T20:31:58.921676] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:31:58.943855] [DEBUG] [LOCAL ] VAL: Loaded 22152 existing records from primary storage. [2025-09-14T20:31:58.944020] [INFO ] [MAIN ] VAL: Loaded 22152 existing records. [2025-09-14T20:31:58.968425] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-14T20:31:59.134771] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:31:59.135145] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-14T20:31:59.135223] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-14T20:31:59.135947] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-14T20:31:59.136028] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-14T20:31:59.495442] [INFO ] [REMOTE ] VAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:31:59.504828] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T20:31:59.758831] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-14T20:32:00.558843] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-14T20:32:00.651706] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T20:32:00.659700] [INFO ] [REMOTE ] UWMC: Full fetch complete (57013 records). [2025-09-14T20:32:00.659914] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-14T20:32:01.049542] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-14T20:32:01.049725] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-14T20:32:01.050842] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-14T20:32:01.050918] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-14T20:32:01.052256] [DEBUG] [LOCAL ] UWMC: Trimmed 57013 records to 39753 (keeping 150 days of data) [2025-09-14T20:32:01.161268] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T20:32:01.177344] [INFO ] [REMOTE ] UZF: Full fetch complete (6857 records). [2025-09-14T20:32:01.178323] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-14T20:32:01.397927] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-14T20:32:01.736034] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-14T20:32:01.738140] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-14T20:32:01.739020] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-14T20:32:01.739239] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-14T20:32:01.742139] [DEBUG] [LOCAL ] UZF: Trimmed 6857 records to 4716 (keeping 150 days of data) [2025-09-14T20:32:01.807277] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-14T20:32:01.808335] [DEBUG] [LOCAL ] UZF: Primary data saved (4716 records). [2025-09-14T20:32:01.821477] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-14T20:32:01.823448] [INFO ] [MAIN ] Update Progress: 2209/2370 symbols completed. UZF took 25.8s. Estimated remaining: 17m 7s. Rate: 9.4 symbols/min [2025-09-14T20:32:02.025431] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:02.036038] [DEBUG] [LOCAL ] UWMC: Primary data saved (39753 records). [2025-09-14T20:32:02.036521] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-14T20:32:02.036729] [INFO ] [MAIN ] Update Progress: 2210/2370 symbols completed. UWMC took 42.8s. Estimated remaining: 17m 0s. Rate: 9.4 symbols/min [2025-09-14T20:32:02.160886] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-14T20:32:02.247156] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:02.249976] [DEBUG] [LOCAL ] VALE: Loaded 24064 existing records from primary storage. [2025-09-14T20:32:02.250336] [INFO ] [MAIN ] VALE: Loaded 24064 existing records. [2025-09-14T20:32:02.363462] [DEBUG] [LOCAL ] VATE: Loaded 1886 existing records from primary storage. [2025-09-14T20:32:02.366634] [INFO ] [MAIN ] VATE: Loaded 1886 existing records. [2025-09-14T20:32:02.592345] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:02.614130] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-14T20:32:02.643016] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-14T20:32:02.672756] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:02.673198] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-14T20:32:02.673274] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-14T20:32:02.673571] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-14T20:32:02.673636] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-14T20:32:02.704988] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-14T20:32:02.748604] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-14T20:32:03.357731] [INFO ] [REMOTE ] VATE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:03.382317] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-14T20:32:03.479241] [INFO ] [REMOTE ] VALE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:03.504978] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T20:32:03.758836] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-14T20:32:04.106914] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T20:32:04.558855] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-14T20:32:04.585170] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T20:32:05.188960] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T20:32:05.358888] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-14T20:32:06.158884] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-14T20:32:06.437256] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T20:32:06.958844] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-14T20:32:07.044431] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T20:32:07.089332] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T20:32:07.758898] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-14T20:32:08.447064] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T20:32:08.558908] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-14T20:32:08.901494] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T20:32:09.358895] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-14T20:32:09.998213] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T20:32:10.158879] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-14T20:32:10.201593] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T20:32:10.958865] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-14T20:32:11.699939] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T20:32:11.700266] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T20:32:11.758830] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-14T20:32:12.230778] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-14T20:32:12.558857] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-14T20:32:13.358876] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-14T20:32:14.158905] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-14T20:32:14.206021] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T20:32:14.958852] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-14T20:32:15.167052] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T20:32:15.645378] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T20:32:15.648707] [INFO ] [REMOTE ] VAC: Full fetch complete (38015 records). [2025-09-14T20:32:15.648843] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-14T20:32:15.764038] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-14T20:32:16.029514] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-14T20:32:16.029630] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-14T20:32:16.030473] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-14T20:32:16.030581] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-14T20:32:16.031496] [DEBUG] [LOCAL ] VAC: Trimmed 38015 records to 25513 (keeping 150 days of data) [2025-09-14T20:32:16.203996] [DEBUG] [LOCAL ] VAC: Primary data saved (25513 records). [2025-09-14T20:32:16.204177] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-14T20:32:16.204285] [INFO ] [MAIN ] Update Progress: 2211/2370 symbols completed. VAC took 21.7s. Estimated remaining: 16m 54s. Rate: 9.4 symbols/min [2025-09-14T20:32:16.381493] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:16.387793] [DEBUG] [LOCAL ] VBF: Loaded 3655 existing records from primary storage. [2025-09-14T20:32:16.387921] [INFO ] [MAIN ] VBF: Loaded 3655 existing records. [2025-09-14T20:32:16.559349] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-14T20:32:16.564233] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:16.570657] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-14T20:32:16.571631] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-14T20:32:16.571333] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T20:32:16.573541] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-14T20:32:16.574465] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-14T20:32:16.824932] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-14T20:32:16.986685] [INFO ] [REMOTE ] VBF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:17.358799] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-14T20:32:18.065445] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:32:18.066776] [INFO ] [REMOTE ] VATE: Full fetch complete (6918 records). [2025-09-14T20:32:18.066858] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-14T20:32:18.166715] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-14T20:32:18.429454] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-14T20:32:18.429672] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-14T20:32:18.429936] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-14T20:32:18.429998] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-14T20:32:18.430466] [DEBUG] [LOCAL ] VATE: Trimmed 6918 records to 3658 (keeping 150 days of data) [2025-09-14T20:32:18.452381] [DEBUG] [LOCAL ] VATE: Primary data saved (3658 records). [2025-09-14T20:32:18.452507] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-14T20:32:18.452621] [INFO ] [MAIN ] Update Progress: 2212/2370 symbols completed. VATE took 16.4s. Estimated remaining: 16m 48s. Rate: 9.4 symbols/min [2025-09-14T20:32:18.626054] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:18.662019] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T20:32:18.678143] [DEBUG] [LOCAL ] VCV: Loaded 6596 existing records from primary storage. [2025-09-14T20:32:18.678416] [INFO ] [MAIN ] VCV: Loaded 6596 existing records. [2025-09-14T20:32:18.867726] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:18.868047] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-14T20:32:18.868115] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-14T20:32:18.868620] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-14T20:32:18.869007] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-14T20:32:18.963970] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-14T20:32:19.265468] [INFO ] [REMOTE ] VCV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:19.758900] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-14T20:32:19.877448] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T20:32:20.124231] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T20:32:20.558864] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-14T20:32:21.043662] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T20:32:21.358947] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-14T20:32:22.158846] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-14T20:32:22.225212] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T20:32:22.474528] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T20:32:22.957812] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T20:32:22.960137] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-14T20:32:23.758941] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-14T20:32:24.558930] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-14T20:32:24.630903] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T20:32:25.087142] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T20:32:25.122570] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-14T20:32:25.358876] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-14T20:32:26.158847] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-14T20:32:26.900434] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T20:32:26.905589] [INFO ] [REMOTE ] VAL: Full fetch complete (55177 records). [2025-09-14T20:32:26.905809] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-14T20:32:26.963933] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-14T20:32:27.338076] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-14T20:32:27.338267] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-14T20:32:27.339349] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-14T20:32:27.339550] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-14T20:32:27.340833] [DEBUG] [LOCAL ] VAL: Trimmed 55177 records to 37832 (keeping 150 days of data) [2025-09-14T20:32:27.478458] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T20:32:27.643191] [DEBUG] [LOCAL ] VAL: Primary data saved (37832 records). [2025-09-14T20:32:27.643383] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-14T20:32:27.643492] [INFO ] [MAIN ] Update Progress: 2213/2370 symbols completed. VAL took 28.9s. Estimated remaining: 16m 41s. Rate: 9.4 symbols/min [2025-09-14T20:32:27.758781] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-14T20:32:27.753618] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T20:32:27.824902] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:27.846105] [DEBUG] [LOCAL ] VEEV: Loaded 20970 existing records from primary storage. [2025-09-14T20:32:27.846270] [INFO ] [MAIN ] VEEV: Loaded 20970 existing records. [2025-09-14T20:32:28.023869] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:28.024118] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-14T20:32:28.024229] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-14T20:32:28.024785] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-14T20:32:28.024849] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-14T20:32:28.381827] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:28.558829] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-14T20:32:28.768174] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T20:32:29.358856] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-14T20:32:30.121231] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T20:32:30.139854] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T20:32:30.158793] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-14T20:32:30.958909] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-14T20:32:31.758928] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-14T20:32:32.014049] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T20:32:32.558887] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-14T20:32:32.617386] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T20:32:33.237969] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-14T20:32:33.358905] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-14T20:32:33.410341] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T20:32:34.158927] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-14T20:32:34.958914] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-14T20:32:35.286132] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T20:32:35.311837] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T20:32:35.528239] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T20:32:35.758845] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-14T20:32:36.558867] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-14T20:32:36.772975] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T20:32:37.358854] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-14T20:32:38.158845] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-14T20:32:38.512674] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T20:32:38.778073] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T20:32:38.779472] [INFO ] [REMOTE ] VBF: Full fetch complete (8104 records). [2025-09-14T20:32:38.779557] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-14T20:32:38.963976] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-14T20:32:39.150793] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-14T20:32:39.150905] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-14T20:32:39.151170] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-14T20:32:39.151224] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-14T20:32:39.151740] [DEBUG] [LOCAL ] VBF: Trimmed 8104 records to 5020 (keeping 150 days of data) [2025-09-14T20:32:39.185721] [DEBUG] [LOCAL ] VBF: Primary data saved (5020 records). [2025-09-14T20:32:39.185894] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-14T20:32:39.186027] [INFO ] [MAIN ] Update Progress: 2214/2370 symbols completed. VBF took 23.0s. Estimated remaining: 16m 35s. Rate: 9.4 symbols/min [2025-09-14T20:32:39.358932] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:39.365936] [DEBUG] [LOCAL ] VEL: Loaded 5069 existing records from primary storage. [2025-09-14T20:32:39.366080] [INFO ] [MAIN ] VEL: Loaded 5069 existing records. [2025-09-14T20:32:39.552174] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:39.552508] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-14T20:32:39.552578] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-14T20:32:39.553067] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-14T20:32:39.553257] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-14T20:32:39.771244] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-14T20:32:39.835349] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T20:32:39.915148] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-14T20:32:40.001219] [INFO ] [REMOTE ] VEL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:40.558839] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-14T20:32:41.358907] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-14T20:32:41.379925] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T20:32:41.382094] [INFO ] [REMOTE ] VCV: Full fetch complete (14176 records). [2025-09-14T20:32:41.382215] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-14T20:32:41.746514] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-14T20:32:41.746655] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-14T20:32:41.747250] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-14T20:32:41.747389] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-14T20:32:41.748185] [DEBUG] [LOCAL ] VCV: Trimmed 14176 records to 10312 (keeping 150 days of data) [2025-09-14T20:32:41.843829] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T20:32:41.862389] [DEBUG] [LOCAL ] VCV: Primary data saved (10312 records). [2025-09-14T20:32:41.862531] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-14T20:32:41.862673] [INFO ] [MAIN ] Update Progress: 2215/2370 symbols completed. VCV took 23.4s. Estimated remaining: 16m 29s. Rate: 9.4 symbols/min [2025-09-14T20:32:42.032473] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:42.050336] [DEBUG] [LOCAL ] VET: Loaded 18716 existing records from primary storage. [2025-09-14T20:32:42.050499] [INFO ] [MAIN ] VET: Loaded 18716 existing records. [2025-09-14T20:32:42.158969] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-14T20:32:42.185345] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T20:32:42.245535] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:42.245813] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-14T20:32:42.245875] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-14T20:32:42.246409] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-14T20:32:42.246472] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-14T20:32:42.597987] [INFO ] [REMOTE ] VET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:42.958840] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-14T20:32:43.758847] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-14T20:32:44.031291] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T20:32:44.202934] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T20:32:44.558843] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-14T20:32:45.358809] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-14T20:32:45.529336] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-14T20:32:45.535182] [INFO ] [REMOTE ] VALE: Full fetch complete (58375 records). [2025-09-14T20:32:45.535309] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-14T20:32:45.917964] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-14T20:32:45.918072] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-14T20:32:45.919318] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-14T20:32:45.919380] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-14T20:32:45.920781] [DEBUG] [LOCAL ] VALE: Trimmed 58375 records to 40435 (keeping 150 days of data) [2025-09-14T20:32:46.159111] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-14T20:32:46.190919] [DEBUG] [LOCAL ] VALE: Primary data saved (40435 records). [2025-09-14T20:32:46.191086] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-14T20:32:46.191199] [INFO ] [MAIN ] Update Progress: 2216/2370 symbols completed. VALE took 44.4s. Estimated remaining: 16m 22s. Rate: 9.4 symbols/min [2025-09-14T20:32:46.370149] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:46.371067] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T20:32:46.400955] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T20:32:46.431909] [DEBUG] [LOCAL ] VFC: Loaded 23989 existing records from primary storage. [2025-09-14T20:32:46.432110] [INFO ] [MAIN ] VFC: Loaded 23989 existing records. [2025-09-14T20:32:46.610097] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:46.610426] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-14T20:32:46.610515] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-14T20:32:46.611238] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-14T20:32:46.611311] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-14T20:32:46.965579] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-14T20:32:46.981384] [INFO ] [REMOTE ] VFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:47.758851] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-14T20:32:47.949622] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T20:32:48.101729] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T20:32:48.558848] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-14T20:32:49.358835] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-14T20:32:49.625341] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T20:32:50.158853] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-14T20:32:50.345274] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T20:32:50.760604] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T20:32:50.766312] [INFO ] [REMOTE ] VEEV: Full fetch complete (51552 records). [2025-09-14T20:32:50.766522] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-14T20:32:50.961239] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-14T20:32:51.168109] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-14T20:32:51.168225] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-14T20:32:51.169275] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-14T20:32:51.169340] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-14T20:32:51.170545] [DEBUG] [LOCAL ] VEEV: Trimmed 51552 records to 35561 (keeping 150 days of data) [2025-09-14T20:32:51.396506] [DEBUG] [LOCAL ] VEEV: Primary data saved (35561 records). [2025-09-14T20:32:51.396694] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-14T20:32:51.396797] [INFO ] [MAIN ] Update Progress: 2217/2370 symbols completed. VEEV took 23.8s. Estimated remaining: 16m 16s. Rate: 9.4 symbols/min [2025-09-14T20:32:51.568567] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:32:51.592831] [DEBUG] [LOCAL ] VG: Loaded 23912 existing records from primary storage. [2025-09-14T20:32:51.593012] [INFO ] [MAIN ] VG: Loaded 23912 existing records. [2025-09-14T20:32:51.768331] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-14T20:32:51.773627] [WARN ] [MAIN ] VG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:32:51.774831] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-14T20:32:51.774903] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-14T20:32:51.775722] [DEBUG] [LOCAL ] VG: Deleted primary data file. [2025-09-14T20:32:51.775793] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-14T20:32:52.139539] [INFO ] [REMOTE ] VG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:32:52.190312] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T20:32:52.215567] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T20:32:52.558828] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-14T20:32:53.358890] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-14T20:32:53.625526] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T20:32:54.158797] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-14T20:32:54.653122] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T20:32:54.958842] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-14T20:32:55.042977] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T20:32:55.113879] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T20:32:55.758855] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-14T20:32:56.558850] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-14T20:32:56.739663] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T20:32:57.358829] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-14T20:32:57.958570] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-14T20:32:58.158847] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-14T20:32:58.652948] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T20:32:58.745197] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-14T20:32:58.958852] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-14T20:32:59.758841] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-14T20:33:00.218983] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T20:33:00.559423] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-14T20:33:00.562514] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T20:33:00.911029] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T20:33:01.358860] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-14T20:33:02.158920] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-14T20:33:02.958843] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-14T20:33:03.210866] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-14T20:33:03.758846] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-14T20:33:04.468401] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-14T20:33:04.470158] [INFO ] [REMOTE ] VEL: Full fetch complete (13591 records). [2025-09-14T20:33:04.470249] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-14T20:33:04.829371] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-14T20:33:04.829498] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-14T20:33:04.829910] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-14T20:33:04.829968] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-14T20:33:04.830508] [DEBUG] [LOCAL ] VEL: Trimmed 13591 records to 9000 (keeping 150 days of data) [2025-09-14T20:33:04.884834] [DEBUG] [LOCAL ] VEL: Primary data saved (9000 records). [2025-09-14T20:33:04.884977] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-14T20:33:04.885111] [INFO ] [MAIN ] Update Progress: 2218/2370 symbols completed. VEL took 25.7s. Estimated remaining: 16m 10s. Rate: 9.4 symbols/min [2025-09-14T20:33:05.053874] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:05.058318] [DEBUG] [LOCAL ] VGI: Loaded 2658 existing records from primary storage. [2025-09-14T20:33:05.058452] [INFO ] [MAIN ] VGI: Loaded 2658 existing records. [2025-09-14T20:33:05.232070] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:05.232318] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-14T20:33:05.232389] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-14T20:33:05.232638] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-14T20:33:05.232720] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-14T20:33:05.594407] [INFO ] [REMOTE ] VGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:05.594943] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-14T20:33:05.620057] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-14T20:33:05.629729] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-14T20:33:05.659770] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (4.30 seconds). [2025-09-14T20:33:06.158799] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-14T20:33:06.277265] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-14T20:33:06.935849] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-09-14T20:33:06.958882] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-14T20:33:06.961476] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T20:33:06.966462] [INFO ] [REMOTE ] VET: Full fetch complete (48194 records). [2025-09-14T20:33:06.966590] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-14T20:33:07.360829] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-14T20:33:07.361006] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-14T20:33:07.362294] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-14T20:33:07.362361] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-14T20:33:07.363625] [DEBUG] [LOCAL ] VET: Trimmed 48194 records to 32812 (keeping 150 days of data) [2025-09-14T20:33:07.588624] [DEBUG] [LOCAL ] VET: Primary data saved (32812 records). [2025-09-14T20:33:07.588879] [INFO ] [MAIN ] VET: Full history saved. [2025-09-14T20:33:07.589035] [INFO ] [MAIN ] Update Progress: 2219/2370 symbols completed. VET took 25.7s. Estimated remaining: 16m 3s. Rate: 9.4 symbols/min [2025-09-14T20:33:07.703453] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T20:33:07.761051] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-14T20:33:07.776439] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:07.788563] [DEBUG] [LOCAL ] VGM: Loaded 8805 existing records from primary storage. [2025-09-14T20:33:07.788752] [INFO ] [MAIN ] VGM: Loaded 8805 existing records. [2025-09-14T20:33:07.966876] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:07.967140] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-14T20:33:07.967200] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-14T20:33:07.967584] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-14T20:33:07.967671] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-14T20:33:08.346452] [INFO ] [REMOTE ] VGM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:08.381595] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-14T20:33:08.558890] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-14T20:33:09.358908] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-14T20:33:09.750613] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T20:33:09.775044] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T20:33:10.085027] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T20:33:10.159026] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-14T20:33:10.958878] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-14T20:33:11.216561] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T20:33:11.758855] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-14T20:33:12.558797] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-14T20:33:12.783819] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T20:33:13.296458] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T20:33:13.302166] [INFO ] [REMOTE ] VFC: Full fetch complete (58269 records). [2025-09-14T20:33:13.332612] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-14T20:33:13.342018] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-14T20:33:13.373138] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-14T20:33:13.767871] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-14T20:33:13.768020] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-14T20:33:13.769559] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-14T20:33:13.769659] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-14T20:33:13.771234] [DEBUG] [LOCAL ] VFC: Trimmed 58269 records to 40360 (keeping 150 days of data) [2025-09-14T20:33:14.051786] [DEBUG] [LOCAL ] VFC: Primary data saved (40360 records). [2025-09-14T20:33:14.052005] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-14T20:33:14.052174] [INFO ] [MAIN ] Update Progress: 2220/2370 symbols completed. VFC took 27.9s. Estimated remaining: 15m 57s. Rate: 9.4 symbols/min [2025-09-14T20:33:14.161777] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-14T20:33:14.239878] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:14.244286] [DEBUG] [LOCAL ] VHC: Loaded 1453 existing records from primary storage. [2025-09-14T20:33:14.244441] [INFO ] [MAIN ] VHC: Loaded 1453 existing records. [2025-09-14T20:33:14.489743] [WARN ] [MAIN ] VHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:14.490108] [INFO ] [MAIN ] VHC: Wiping existing primary data before full refresh. [2025-09-14T20:33:14.490172] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-14T20:33:14.490450] [DEBUG] [LOCAL ] VHC: Deleted primary data file. [2025-09-14T20:33:14.490512] [INFO ] [MAIN ] VHC: Starting full primary refresh. [2025-09-14T20:33:14.873538] [INFO ] [REMOTE ] VHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:14.889888] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T20:33:14.958803] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-02. [2025-09-14T20:33:15.758919] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-14T20:33:15.844743] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T20:33:16.558810] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-03. [2025-09-14T20:33:16.659876] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-14T20:33:17.117870] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T20:33:17.116725] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-14T20:33:17.358866] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-14T20:33:17.972469] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T20:33:18.158924] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-14T20:33:18.798223] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T20:33:18.958915] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-04. [2025-09-14T20:33:19.451954] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T20:33:19.758885] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-14T20:33:20.558878] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-14T20:33:20.870983] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T20:33:21.358923] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-14T20:33:22.158940] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-05. [2025-09-14T20:33:22.352556] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-14T20:33:22.372134] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T20:33:22.371110] [INFO ] [REMOTE ] VG: Full fetch complete (58085 records). [2025-09-14T20:33:22.376139] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-14T20:33:22.568952] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-14T20:33:22.804253] [DEBUG] [VALIDATOR ] VG: All expected trading days are present. [2025-09-14T20:33:22.804396] [DEBUG] [VALIDATOR ] VG: Primary data validation passed. [2025-09-14T20:33:22.805962] [INFO ] [MAIN ] VG: Fetched primary data is valid. [2025-09-14T20:33:22.806030] [DEBUG] [LOCAL ] VG: Saving primary data. [2025-09-14T20:33:22.807802] [DEBUG] [LOCAL ] VG: Trimmed 58085 records to 40214 (keeping 150 days of data) [2025-09-14T20:33:23.007278] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-06. [2025-09-14T20:33:23.104459] [DEBUG] [LOCAL ] VG: Primary data saved (40214 records). [2025-09-14T20:33:23.104735] [INFO ] [MAIN ] VG: Full history saved. [2025-09-14T20:33:23.104893] [INFO ] [MAIN ] Update Progress: 2221/2370 symbols completed. VG took 31.7s. Estimated remaining: 15m 51s. Rate: 9.4 symbols/min [2025-09-14T20:33:23.291888] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:23.296351] [DEBUG] [LOCAL ] VHI: Loaded 1287 existing records from primary storage. [2025-09-14T20:33:23.296489] [INFO ] [MAIN ] VHI: Loaded 1287 existing records. [2025-09-14T20:33:23.499724] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:23.500076] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-14T20:33:23.500163] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-14T20:33:23.500563] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-14T20:33:23.500639] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-14T20:33:23.734898] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-14T20:33:23.763004] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-14T20:33:23.884923] [INFO ] [REMOTE ] VHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:24.527273] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T20:33:24.558845] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-14T20:33:25.299615] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T20:33:25.358827] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-07. [2025-09-14T20:33:26.044825] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T20:33:26.158913] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-08. [2025-09-14T20:33:26.661624] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T20:33:26.958856] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-14T20:33:27.539173] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T20:33:27.758889] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-14T20:33:28.558904] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-14T20:33:28.738661] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T20:33:28.741857] [INFO ] [REMOTE ] VGM: Full fetch complete (19790 records). [2025-09-14T20:33:28.741968] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-14T20:33:29.140809] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-14T20:33:29.140997] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-14T20:33:29.141586] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-14T20:33:29.141863] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-14T20:33:29.142772] [DEBUG] [LOCAL ] VGM: Trimmed 19790 records to 14522 (keeping 150 days of data) [2025-09-14T20:33:29.242355] [DEBUG] [LOCAL ] VGM: Primary data saved (14522 records). [2025-09-14T20:33:29.242601] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-14T20:33:29.242764] [INFO ] [MAIN ] Update Progress: 2222/2370 symbols completed. VGM took 21.7s. Estimated remaining: 15m 44s. Rate: 9.4 symbols/min [2025-09-14T20:33:29.363455] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-14T20:33:29.358234] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T20:33:29.432179] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:29.436034] [DEBUG] [LOCAL ] VIA: Loaded 117 existing records from primary storage. [2025-09-14T20:33:29.436248] [INFO ] [MAIN ] VIA: Loaded 117 existing records. [2025-09-14T20:33:29.630280] [WARN ] [MAIN ] VIA: Insufficient historical data. Have data from 2025-09-12, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:29.630729] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-14T20:33:29.630798] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-14T20:33:29.631234] [DEBUG] [LOCAL ] VIA: Deleted primary data file. [2025-09-14T20:33:29.631311] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-14T20:33:30.001796] [INFO ] [REMOTE ] VIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:30.158918] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-14T20:33:30.243321] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T20:33:30.245424] [INFO ] [REMOTE ] VGI: Full fetch complete (5596 records). [2025-09-14T20:33:30.245521] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-14T20:33:30.631480] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T20:33:30.637070] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-14T20:33:30.638331] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-14T20:33:30.638449] [INFO ] [REMOTE ] VHC: Full fetch complete (2544 records). [2025-09-14T20:33:30.638779] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-14T20:33:30.638904] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-14T20:33:30.638955] [DEBUG] [VALIDATOR ] VHC: Validating primary data. [2025-09-14T20:33:30.672229] [DEBUG] [LOCAL ] VGI: Trimmed 5596 records to 3911 (keeping 150 days of data) [2025-09-14T20:33:30.856445] [WARN ] [VALIDATOR ] VHC: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T20:33:30.860185] [FATAL] [MAIN ] VHC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:33:30.859900] [DEBUG] [LOCAL ] VGI: Primary data saved (3911 records). [2025-09-14T20:33:30.860480] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-14T20:33:30.860393] [WARN ] [MAIN ] VHC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:33:30.860685] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-14T20:33:30.860829] [INFO ] [MAIN ] Update Progress: 2223/2370 symbols completed. VGI took 26.0s. Estimated remaining: 15m 38s. Rate: 9.4 symbols/min [2025-09-14T20:33:30.861045] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-14T20:33:30.861507] [INFO ] [LOCAL ] VHC: Starting deletion of derivative data. [2025-09-14T20:33:30.942460] [DEBUG] [LOCAL ] VHC: No derivative data file found to delete. [2025-09-14T20:33:30.959990] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-14T20:33:30.971992] [INFO ] [MAIN ] Update Progress: 2224/2370 symbols completed. VHC took 16.9s. Estimated remaining: 15m 31s. Rate: 9.4 symbols/min [2025-09-14T20:33:31.121130] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:31.232585] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:31.245380] [DEBUG] [LOCAL ] VICI: Loaded 24030 existing records from primary storage. [2025-09-14T20:33:31.245621] [INFO ] [MAIN ] VICI: Loaded 24030 existing records. [2025-09-14T20:33:31.311142] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:33:31.369880] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-14T20:33:31.370449] [DEBUG] [LOCAL ] VIK: Loaded 23600 existing records from primary storage. [2025-09-14T20:33:31.392831] [INFO ] [MAIN ] VIK: Loaded 23600 existing records. [2025-09-14T20:33:31.547948] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:31.574708] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-14T20:33:31.596565] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-14T20:33:31.635346] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-14T20:33:31.654266] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:31.654426] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-14T20:33:31.654916] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-14T20:33:31.691055] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-14T20:33:31.745821] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-14T20:33:31.765925] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-14T20:33:31.766265] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-14T20:33:32.142776] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:33:32.217917] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-14T20:33:32.352124] [INFO ] [REMOTE ] VICI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:32.429951] [INFO ] [REMOTE ] VIK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:32.558876] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-14T20:33:33.358860] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-14T20:33:33.998975] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T20:33:34.158876] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-14T20:33:34.422111] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:33:34.423023] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-14T20:33:34.424615] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T20:33:34.958856] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-14T20:33:35.219015] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:33:35.219476] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-14T20:33:35.758860] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-14T20:33:36.563996] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-14T20:33:36.581862] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T20:33:37.062105] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-14T20:33:37.358864] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-14T20:33:37.604758] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:33:37.605157] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-14T20:33:38.158833] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-14T20:33:38.437764] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:33:38.438135] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-14T20:33:38.958831] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-14T20:33:39.217575] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:33:39.218098] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-14T20:33:39.758870] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-14T20:33:40.417135] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T20:33:40.558820] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-14T20:33:41.280394] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T20:33:41.358859] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-14T20:33:41.928999] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T20:33:42.158929] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-14T20:33:42.958861] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-14T20:33:43.101011] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T20:33:43.362979] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T20:33:43.363839] [INFO ] [REMOTE ] VIA: Full fetch complete (117 records). [2025-09-14T20:33:43.363933] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-14T20:33:43.556446] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 1 unique days, need 150 days [2025-09-14T20:33:43.556680] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:33:43.556737] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:33:43.556786] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-14T20:33:43.556863] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-14T20:33:43.556957] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-14T20:33:43.557025] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-14T20:33:43.557140] [INFO ] [MAIN ] Update Progress: 2225/2370 symbols completed. VIA took 14.3s. Estimated remaining: 15m 25s. Rate: 9.4 symbols/min [2025-09-14T20:33:43.733531] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:43.759811] [DEBUG] [LOCAL ] VIPS: Loaded 22567 existing records from primary storage. [2025-09-14T20:33:43.759206] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-14T20:33:43.760770] [INFO ] [MAIN ] VIPS: Loaded 22567 existing records. [2025-09-14T20:33:43.960039] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:43.960406] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-14T20:33:43.960474] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-14T20:33:43.961080] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-14T20:33:43.961142] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-14T20:33:44.310575] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T20:33:44.313930] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:44.315048] [INFO ] [REMOTE ] VHI: Full fetch complete (3241 records). [2025-09-14T20:33:44.315147] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-14T20:33:44.563897] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-14T20:33:44.665671] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-14T20:33:44.665783] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-14T20:33:44.665910] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-14T20:33:44.665960] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-14T20:33:44.666346] [DEBUG] [LOCAL ] VHI: Trimmed 3241 records to 2034 (keeping 150 days of data) [2025-09-14T20:33:44.680771] [DEBUG] [LOCAL ] VHI: Primary data saved (2034 records). [2025-09-14T20:33:44.680845] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-14T20:33:44.680955] [INFO ] [MAIN ] Update Progress: 2226/2370 symbols completed. VHI took 21.6s. Estimated remaining: 15m 18s. Rate: 9.4 symbols/min [2025-09-14T20:33:44.847229] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:33:44.874027] [DEBUG] [LOCAL ] VIRT: Loaded 20655 existing records from primary storage. [2025-09-14T20:33:44.874194] [INFO ] [MAIN ] VIRT: Loaded 20655 existing records. [2025-09-14T20:33:45.052579] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:33:45.052917] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-14T20:33:45.052978] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-14T20:33:45.053580] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-14T20:33:45.053663] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-14T20:33:45.363999] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-14T20:33:45.451988] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:33:46.159034] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-14T20:33:46.475116] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T20:33:46.726626] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-14T20:33:46.958881] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-14T20:33:47.527299] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T20:33:47.758851] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-14T20:33:48.558886] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-14T20:33:48.781449] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T20:33:49.175630] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T20:33:49.358908] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-14T20:33:50.008183] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-14T20:33:50.158835] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-14T20:33:50.266407] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T20:33:50.958849] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-14T20:33:51.758833] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-14T20:33:51.956370] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T20:33:52.021138] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T20:33:52.558833] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-14T20:33:53.368420] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-14T20:33:53.371332] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T20:33:54.158791] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-14T20:33:54.709906] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T20:33:54.958889] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-14T20:33:55.103029] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T20:33:55.758919] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-14T20:33:56.091253] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T20:33:56.558848] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-14T20:33:56.726344] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T20:33:56.815573] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T20:33:57.358847] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-14T20:33:58.158806] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-14T20:33:58.261509] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T20:33:58.958825] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-14T20:33:59.450199] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T20:33:59.480169] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T20:33:59.486994] [INFO ] [REMOTE ] VIK: Full fetch complete (57068 records). [2025-09-14T20:33:59.487225] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-14T20:33:59.761030] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-14T20:33:59.813082] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T20:33:59.944066] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-14T20:33:59.944244] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-14T20:33:59.946349] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-14T20:33:59.946432] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-14T20:33:59.948360] [DEBUG] [LOCAL ] VIK: Trimmed 57068 records to 39526 (keeping 150 days of data) [2025-09-14T20:34:00.227337] [DEBUG] [LOCAL ] VIK: Primary data saved (39526 records). [2025-09-14T20:34:00.227613] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-14T20:34:00.227932] [INFO ] [MAIN ] Update Progress: 2227/2370 symbols completed. VIK took 29.3s. Estimated remaining: 15m 12s. Rate: 9.4 symbols/min [2025-09-14T20:34:00.410954] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:00.435454] [DEBUG] [LOCAL ] VIST: Loaded 20584 existing records from primary storage. [2025-09-14T20:34:00.435718] [INFO ] [MAIN ] VIST: Loaded 20584 existing records. [2025-09-14T20:34:00.564014] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-14T20:34:00.620757] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:00.622424] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-14T20:34:00.622494] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-14T20:34:00.623156] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-14T20:34:00.623230] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-14T20:34:01.021740] [INFO ] [REMOTE ] VIST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:01.358941] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-14T20:34:02.158872] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-14T20:34:02.266530] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-14T20:34:02.608313] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T20:34:02.958854] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-14T20:34:03.671333] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:34:03.678335] [INFO ] [REMOTE ] VICI: Full fetch complete (58321 records). [2025-09-14T20:34:03.678591] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-14T20:34:03.764690] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-14T20:34:04.094307] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-14T20:34:04.094536] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-14T20:34:04.096064] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-14T20:34:04.096413] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-14T20:34:04.113018] [DEBUG] [LOCAL ] VICI: Trimmed 58321 records to 40397 (keeping 150 days of data) [2025-09-14T20:34:04.136872] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-09-14T20:34:04.304945] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-14T20:34:04.460043] [DEBUG] [LOCAL ] VICI: Primary data saved (40397 records). [2025-09-14T20:34:04.460233] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-14T20:34:04.460367] [INFO ] [MAIN ] Update Progress: 2228/2370 symbols completed. VICI took 33.6s. Estimated remaining: 15m 6s. Rate: 9.4 symbols/min [2025-09-14T20:34:04.559588] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-14T20:34:04.630539] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:04.652035] [DEBUG] [LOCAL ] VIV: Loaded 20185 existing records from primary storage. [2025-09-14T20:34:04.652264] [INFO ] [MAIN ] VIV: Loaded 20185 existing records. [2025-09-14T20:34:04.825601] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:04.825983] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-14T20:34:04.826061] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-14T20:34:04.826627] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-14T20:34:04.826728] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-14T20:34:05.193544] [INFO ] [REMOTE ] VIV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:05.358853] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-14T20:34:05.614262] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T20:34:06.158852] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-14T20:34:06.232102] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T20:34:06.968433] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-14T20:34:06.971617] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T20:34:07.548515] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T20:34:07.758868] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-14T20:34:08.558934] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-14T20:34:08.806823] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T20:34:08.958629] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T20:34:08.964026] [INFO ] [REMOTE ] VIPS: Full fetch complete (56074 records). [2025-09-14T20:34:08.964251] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-14T20:34:09.345879] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-14T20:34:09.346010] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-14T20:34:09.347304] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-14T20:34:09.347401] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-14T20:34:09.348852] [DEBUG] [LOCAL ] VIPS: Trimmed 56074 records to 38450 (keeping 150 days of data) [2025-09-14T20:34:09.403492] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-14T20:34:09.617812] [DEBUG] [LOCAL ] VIPS: Primary data saved (38450 records). [2025-09-14T20:34:09.618004] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-14T20:34:09.618113] [INFO ] [MAIN ] Update Progress: 2229/2370 symbols completed. VIPS took 26.1s. Estimated remaining: 14m 59s. Rate: 9.4 symbols/min [2025-09-14T20:34:09.791235] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:09.800592] [DEBUG] [LOCAL ] VKQ: Loaded 8354 existing records from primary storage. [2025-09-14T20:34:09.800755] [INFO ] [MAIN ] VKQ: Loaded 8354 existing records. [2025-09-14T20:34:09.979604] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:09.979907] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-14T20:34:09.979967] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-14T20:34:09.980322] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-14T20:34:09.980379] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-14T20:34:10.177099] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-14T20:34:10.340110] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:10.367162] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T20:34:10.958855] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-14T20:34:11.093764] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T20:34:11.306220] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T20:34:11.313538] [INFO ] [REMOTE ] VIRT: Full fetch complete (51141 records). [2025-09-14T20:34:11.313788] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-14T20:34:11.726032] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-14T20:34:11.726186] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-14T20:34:11.727430] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-14T20:34:11.727511] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-14T20:34:11.728932] [DEBUG] [LOCAL ] VIRT: Trimmed 51141 records to 35002 (keeping 150 days of data) [2025-09-14T20:34:11.787374] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-14T20:34:11.965439] [DEBUG] [LOCAL ] VIRT: Primary data saved (35002 records). [2025-09-14T20:34:11.965664] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-14T20:34:11.965808] [INFO ] [MAIN ] Update Progress: 2230/2370 symbols completed. VIRT took 27.3s. Estimated remaining: 14m 53s. Rate: 9.4 symbols/min [2025-09-14T20:34:12.138906] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:12.174884] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T20:34:12.191148] [DEBUG] [LOCAL ] VLN: Loaded 15043 existing records from primary storage. [2025-09-14T20:34:12.191318] [INFO ] [MAIN ] VLN: Loaded 15043 existing records. [2025-09-14T20:34:12.368943] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:12.369307] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-14T20:34:12.369387] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-14T20:34:12.369836] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-14T20:34:12.369912] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-14T20:34:12.563922] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-14T20:34:12.731486] [INFO ] [REMOTE ] VLN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:13.358877] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-14T20:34:13.541264] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T20:34:13.589995] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T20:34:14.158833] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-14T20:34:14.958861] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-14T20:34:15.092193] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T20:34:15.758829] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-14T20:34:15.984483] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T20:34:16.555335] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T20:34:16.560538] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-14T20:34:16.931171] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T20:34:17.358847] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-14T20:34:18.013410] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T20:34:18.158883] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-14T20:34:18.961263] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T20:34:18.958839] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-14T20:34:19.758862] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-14T20:34:20.044692] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T20:34:20.066375] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T20:34:20.558859] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-14T20:34:20.578485] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T20:34:21.358880] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-14T20:34:22.162696] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-14T20:34:22.166008] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T20:34:22.587373] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T20:34:22.958869] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-14T20:34:23.765951] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-14T20:34:23.771182] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T20:34:23.826855] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T20:34:24.558843] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-14T20:34:24.753430] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T20:34:25.358866] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-14T20:34:26.158817] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-14T20:34:26.186621] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T20:34:26.293198] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T20:34:26.958918] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-14T20:34:27.592215] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T20:34:27.597921] [INFO ] [REMOTE ] VIST: Full fetch complete (50113 records). [2025-09-14T20:34:27.598135] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-14T20:34:27.758889] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-14T20:34:27.984315] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-14T20:34:27.984437] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-14T20:34:27.985673] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-14T20:34:27.985759] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-14T20:34:27.987087] [DEBUG] [LOCAL ] VIST: Trimmed 50113 records to 34464 (keeping 150 days of data) [2025-09-14T20:34:28.194497] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T20:34:28.222628] [DEBUG] [LOCAL ] VIST: Primary data saved (34464 records). [2025-09-14T20:34:28.222777] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-14T20:34:28.222872] [INFO ] [MAIN ] Update Progress: 2231/2370 symbols completed. VIST took 28.0s. Estimated remaining: 14m 47s. Rate: 9.4 symbols/min [2025-09-14T20:34:28.393335] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:28.417541] [DEBUG] [LOCAL ] VLO: Loaded 23700 existing records from primary storage. [2025-09-14T20:34:28.417733] [INFO ] [MAIN ] VLO: Loaded 23700 existing records. [2025-09-14T20:34:28.566706] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-14T20:34:28.595945] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:28.596134] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-14T20:34:28.596193] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-14T20:34:28.596860] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-14T20:34:28.596923] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-14T20:34:28.944133] [INFO ] [REMOTE ] VLO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:28.965026] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T20:34:29.358889] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-14T20:34:29.977082] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T20:34:30.158836] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-14T20:34:30.958811] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-14T20:34:31.420998] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T20:34:31.758880] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-14T20:34:31.874700] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T20:34:32.015872] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T20:34:32.558832] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-14T20:34:33.358903] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-14T20:34:33.487863] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T20:34:33.491837] [INFO ] [REMOTE ] VKQ: Full fetch complete (18641 records). [2025-09-14T20:34:33.492037] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-14T20:34:33.875038] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-14T20:34:33.875304] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-14T20:34:33.876202] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-14T20:34:33.876322] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-14T20:34:33.877174] [DEBUG] [LOCAL ] VKQ: Trimmed 18641 records to 13602 (keeping 150 days of data) [2025-09-14T20:34:33.964157] [DEBUG] [LOCAL ] VKQ: Primary data saved (13602 records). [2025-09-14T20:34:33.964543] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-14T20:34:33.964717] [INFO ] [MAIN ] Update Progress: 2232/2370 symbols completed. VKQ took 24.3s. Estimated remaining: 14m 41s. Rate: 9.4 symbols/min [2025-09-14T20:34:34.159244] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-14T20:34:34.161726] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-14T20:34:34.179680] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:34.211541] [DEBUG] [LOCAL ] VLRS: Loaded 16592 existing records from primary storage. [2025-09-14T20:34:34.211792] [INFO ] [MAIN ] VLRS: Loaded 16592 existing records. [2025-09-14T20:34:34.399492] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:34.399850] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-14T20:34:34.399914] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-14T20:34:34.401307] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-14T20:34:34.401377] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-14T20:34:34.717116] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T20:34:34.788877] [INFO ] [REMOTE ] VLN: Full fetch complete (30073 records). [2025-09-14T20:34:34.788769] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:34.789366] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-14T20:34:34.966195] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-14T20:34:35.168880] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-14T20:34:35.168999] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-14T20:34:35.169730] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-14T20:34:35.169790] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-14T20:34:35.170585] [DEBUG] [LOCAL ] VLN: Trimmed 30073 records to 22236 (keeping 150 days of data) [2025-09-14T20:34:35.314584] [DEBUG] [LOCAL ] VLN: Primary data saved (22236 records). [2025-09-14T20:34:35.314789] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-14T20:34:35.314912] [INFO ] [MAIN ] Update Progress: 2233/2370 symbols completed. VLN took 23.3s. Estimated remaining: 14m 34s. Rate: 9.4 symbols/min [2025-09-14T20:34:35.483763] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:35.487466] [DEBUG] [LOCAL ] VLT: Loaded 1803 existing records from primary storage. [2025-09-14T20:34:35.487573] [INFO ] [MAIN ] VLT: Loaded 1803 existing records. [2025-09-14T20:34:35.667622] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:35.678457] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-14T20:34:35.680578] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-14T20:34:35.681549] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-14T20:34:35.681681] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-14T20:34:35.714856] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-14T20:34:35.763452] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-14T20:34:35.792582] [INFO ] [REMOTE ] VIV: Full fetch complete (49189 records). [2025-09-14T20:34:35.819560] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-14T20:34:36.268361] [INFO ] [REMOTE ] VLT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:36.489934] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-14T20:34:36.490090] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-14T20:34:36.491829] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-14T20:34:36.491910] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-14T20:34:36.493595] [DEBUG] [LOCAL ] VIV: Trimmed 49189 records to 34128 (keeping 150 days of data) [2025-09-14T20:34:36.562263] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-14T20:34:36.728803] [DEBUG] [LOCAL ] VIV: Primary data saved (34128 records). [2025-09-14T20:34:36.729038] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-14T20:34:36.729202] [INFO ] [MAIN ] Update Progress: 2234/2370 symbols completed. VIV took 32.3s. Estimated remaining: 14m 27s. Rate: 9.4 symbols/min [2025-09-14T20:34:36.907871] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:36.932122] [DEBUG] [LOCAL ] VLTO: Loaded 20189 existing records from primary storage. [2025-09-14T20:34:36.932349] [INFO ] [MAIN ] VLTO: Loaded 20189 existing records. [2025-09-14T20:34:37.130363] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:37.130804] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-14T20:34:37.130954] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-14T20:34:37.131594] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-14T20:34:37.131694] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-14T20:34:37.295430] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T20:34:37.379803] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-14T20:34:37.575556] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:37.613082] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T20:34:37.610987] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T20:34:38.158926] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-14T20:34:38.958996] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-14T20:34:39.436754] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T20:34:39.758876] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-14T20:34:40.043918] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T20:34:40.480412] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-14T20:34:40.558869] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-14T20:34:40.678481] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T20:34:41.355555] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T20:34:41.358771] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-14T20:34:42.014296] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T20:34:42.158837] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-14T20:34:42.958859] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-14T20:34:43.758911] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-14T20:34:43.854195] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T20:34:44.410250] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T20:34:44.558836] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-14T20:34:44.925626] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T20:34:45.358857] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-14T20:34:45.828607] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-14T20:34:46.158852] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-14T20:34:46.249321] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T20:34:46.958883] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-14T20:34:47.758804] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-14T20:34:48.238438] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T20:34:48.378199] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T20:34:48.558846] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-14T20:34:48.643340] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T20:34:49.358839] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-14T20:34:50.158800] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-14T20:34:50.711282] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T20:34:50.798662] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T20:34:50.958811] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-14T20:34:51.758841] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-14T20:34:52.038522] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T20:34:52.475617] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:34:52.482245] [INFO ] [REMOTE ] VLO: Full fetch complete (57728 records). [2025-09-14T20:34:52.482508] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-14T20:34:52.560628] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-14T20:34:52.735026] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T20:34:52.937662] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-14T20:34:52.937789] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-14T20:34:52.939094] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-14T20:34:52.939162] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-14T20:34:52.940574] [DEBUG] [LOCAL ] VLO: Trimmed 57728 records to 39975 (keeping 150 days of data) [2025-09-14T20:34:53.198036] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T20:34:53.200892] [INFO ] [REMOTE ] VLT: Full fetch complete (5125 records). [2025-09-14T20:34:53.200996] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-14T20:34:53.359859] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-14T20:34:53.590839] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-14T20:34:53.591873] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-14T20:34:53.596037] [DEBUG] [LOCAL ] VLO: Primary data saved (39975 records). [2025-09-14T20:34:53.596306] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-14T20:34:53.596464] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-14T20:34:53.596569] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-14T20:34:53.596764] [INFO ] [MAIN ] Update Progress: 2235/2370 symbols completed. VLO took 25.4s. Estimated remaining: 14m 21s. Rate: 9.4 symbols/min [2025-09-14T20:34:53.597694] [DEBUG] [LOCAL ] VLT: Trimmed 5125 records to 3117 (keeping 150 days of data) [2025-09-14T20:34:53.739988] [DEBUG] [LOCAL ] VLT: Primary data saved (3117 records). [2025-09-14T20:34:53.762355] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-14T20:34:53.774904] [INFO ] [MAIN ] Update Progress: 2236/2370 symbols completed. VLT took 18.5s. Estimated remaining: 14m 15s. Rate: 9.4 symbols/min [2025-09-14T20:34:53.798901] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:53.974600] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:34:53.981568] [DEBUG] [LOCAL ] VMC: Loaded 18887 existing records from primary storage. [2025-09-14T20:34:53.981758] [INFO ] [MAIN ] VMC: Loaded 18887 existing records. [2025-09-14T20:34:54.088209] [DEBUG] [LOCAL ] VMI: Loaded 7126 existing records from primary storage. [2025-09-14T20:34:54.093948] [INFO ] [MAIN ] VMI: Loaded 7126 existing records. [2025-09-14T20:34:54.190715] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-14T20:34:54.256834] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:54.268677] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-14T20:34:54.274507] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-14T20:34:54.329331] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-14T20:34:54.343765] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-14T20:34:54.379845] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:34:54.447765] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-14T20:34:54.450527] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-14T20:34:54.450916] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-14T20:34:54.466549] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-14T20:34:54.941039] [INFO ] [REMOTE ] VMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:54.966685] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-14T20:34:55.073492] [INFO ] [REMOTE ] VMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:34:55.093836] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T20:34:55.758845] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-14T20:34:56.080673] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T20:34:56.478466] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T20:34:56.558796] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-14T20:34:56.908794] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T20:34:56.912623] [INFO ] [REMOTE ] VLRS: Full fetch complete (44976 records). [2025-09-14T20:34:56.912763] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-14T20:34:57.301292] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-14T20:34:57.301424] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-14T20:34:57.302568] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-14T20:34:57.302673] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-14T20:34:57.303909] [DEBUG] [LOCAL ] VLRS: Trimmed 44976 records to 30025 (keeping 150 days of data) [2025-09-14T20:34:57.358981] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-14T20:34:57.498941] [DEBUG] [LOCAL ] VLRS: Primary data saved (30025 records). [2025-09-14T20:34:57.499168] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-14T20:34:57.499313] [INFO ] [MAIN ] Update Progress: 2237/2370 symbols completed. VLRS took 23.5s. Estimated remaining: 14m 8s. Rate: 9.4 symbols/min [2025-09-14T20:34:58.036567] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T20:34:58.158841] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-14T20:34:58.958857] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-14T20:34:59.156986] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T20:34:59.494390] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T20:34:59.654705] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T20:34:59.758888] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-14T20:35:00.558882] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-14T20:35:01.122399] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T20:35:01.358900] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-14T20:35:02.158843] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-14T20:35:02.405154] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T20:35:02.958784] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-14T20:35:03.353327] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T20:35:03.435406] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T20:35:03.441370] [INFO ] [REMOTE ] VLTO: Full fetch complete (50159 records). [2025-09-14T20:35:03.441660] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-14T20:35:03.772680] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-14T20:35:03.823802] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-14T20:35:03.823934] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-14T20:35:03.825263] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-14T20:35:03.825328] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-14T20:35:03.826629] [DEBUG] [LOCAL ] VLTO: Trimmed 50159 records to 34339 (keeping 150 days of data) [2025-09-14T20:35:04.147956] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-14T20:35:04.231106] [DEBUG] [LOCAL ] VLTO: Primary data saved (34339 records). [2025-09-14T20:35:04.231378] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-14T20:35:04.231531] [INFO ] [MAIN ] Update Progress: 2238/2370 symbols completed. VLTO took 27.5s. Estimated remaining: 14m 2s. Rate: 9.4 symbols/min [2025-09-14T20:35:04.558872] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-14T20:35:04.790789] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T20:35:05.358907] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-14T20:35:06.425442] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T20:35:06.435818] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-14T20:35:06.567580] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T20:35:06.958893] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-14T20:35:08.061775] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T20:35:08.066072] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-14T20:35:08.272390] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T20:35:08.558915] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-14T20:35:09.250471] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T20:35:09.358892] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-14T20:35:09.914332] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T20:35:09.917071] [INFO ] [REMOTE ] VMI: Full fetch complete (16774 records). [2025-09-14T20:35:09.917188] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-14T20:35:10.315778] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-14T20:35:10.316028] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-14T20:35:10.316625] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-14T20:35:10.316795] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-14T20:35:10.317700] [DEBUG] [LOCAL ] VMI: Trimmed 16774 records to 11398 (keeping 150 days of data) [2025-09-14T20:35:10.399742] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T20:35:10.412670] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-14T20:35:10.437126] [DEBUG] [LOCAL ] VMI: Primary data saved (11398 records). [2025-09-14T20:35:10.437326] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-14T20:35:10.437444] [INFO ] [MAIN ] Update Progress: 2239/2370 symbols completed. VMI took 16.7s. Estimated remaining: 13m 55s. Rate: 9.4 symbols/min [2025-09-14T20:35:12.013194] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T20:35:12.022371] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-14T20:35:12.689376] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:35:12.693951] [INFO ] [REMOTE ] VMC: Full fetch complete (48150 records). [2025-09-14T20:35:12.694122] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-14T20:35:13.133060] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-14T20:35:13.133214] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-14T20:35:13.134405] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-14T20:35:13.134508] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-14T20:35:13.136063] [DEBUG] [LOCAL ] VMC: Trimmed 48150 records to 32290 (keeping 150 days of data) [2025-09-14T20:35:13.373781] [DEBUG] [LOCAL ] VMC: Primary data saved (32290 records). [2025-09-14T20:35:13.373975] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-14T20:35:13.374081] [INFO ] [MAIN ] Update Progress: 2240/2370 symbols completed. VMC took 19.8s. Estimated remaining: 13m 49s. Rate: 9.4 symbols/min [2025-09-14T20:35:14.090611] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:14.110075] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:14.144220] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:14.145279] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:14.153142] [DEBUG] [LOCAL ] VNCE: Loaded 2973 existing records from primary storage. [2025-09-14T20:35:14.153633] [INFO ] [MAIN ] VNCE: Loaded 2973 existing records. [2025-09-14T20:35:14.291121] [DEBUG] [LOCAL ] VMO: Loaded 9259 existing records from primary storage. [2025-09-14T20:35:14.312353] [DEBUG] [LOCAL ] VNT: Loaded 19594 existing records from primary storage. [2025-09-14T20:35:14.305070] [INFO ] [MAIN ] VMO: Loaded 9259 existing records. [2025-09-14T20:35:14.339021] [DEBUG] [LOCAL ] VNO: Loaded 22391 existing records from primary storage. [2025-09-14T20:35:14.352110] [INFO ] [MAIN ] VNT: Loaded 19594 existing records. [2025-09-14T20:35:14.373172] [INFO ] [MAIN ] VNO: Loaded 22391 existing records. [2025-09-14T20:35:14.398078] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:14.565150] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-14T20:35:14.624347] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-14T20:35:14.691889] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-14T20:35:14.715280] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-14T20:35:14.937609] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:15.050390] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:15.050711] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:15.051241] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-14T20:35:15.051340] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-14T20:35:15.061846] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-14T20:35:15.095771] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-14T20:35:15.077273] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-14T20:35:15.095845] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-14T20:35:15.096269] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-14T20:35:15.096345] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-14T20:35:15.101878] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-14T20:35:15.112464] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-14T20:35:15.161902] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-14T20:35:15.153073] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-14T20:35:15.838577] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:15.925138] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-14T20:35:16.334240] [INFO ] [REMOTE ] VMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:16.395631] [INFO ] [REMOTE ] VNO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:16.451862] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-14T20:35:16.395935] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-14T20:35:16.455166] [INFO ] [REMOTE ] VNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:16.457222] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-14T20:35:17.417255] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T20:35:17.420171] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-14T20:35:17.945401] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T20:35:17.951412] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-14T20:35:18.100978] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T20:35:18.102777] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-14T20:35:18.327250] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T20:35:18.336059] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-14T20:35:18.412917] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T20:35:18.422204] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-14T20:35:18.731480] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T20:35:18.958887] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-14T20:35:19.135748] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T20:35:19.475540] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T20:35:19.758847] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-14T20:35:20.029318] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T20:35:20.145221] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:35:20.558887] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-14T20:35:20.686372] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T20:35:21.358899] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-14T20:35:22.164363] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-14T20:35:22.190253] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T20:35:22.524074] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T20:35:22.871799] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T20:35:22.958896] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-14T20:35:23.511332] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-14T20:35:23.758903] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-14T20:35:24.558902] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-14T20:35:24.736703] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T20:35:25.358840] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-14T20:35:26.158928] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-14T20:35:26.219025] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:35:26.963915] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-14T20:35:26.985382] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T20:35:27.105475] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T20:35:27.107576] [INFO ] [REMOTE ] VNCE: Full fetch complete (6701 records). [2025-09-14T20:35:27.107683] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-14T20:35:27.462936] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-14T20:35:27.463058] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-14T20:35:27.463289] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-14T20:35:27.463344] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-14T20:35:27.463792] [DEBUG] [LOCAL ] VNCE: Trimmed 6701 records to 4525 (keeping 150 days of data) [2025-09-14T20:35:27.490317] [DEBUG] [LOCAL ] VNCE: Primary data saved (4525 records). [2025-09-14T20:35:27.490419] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-14T20:35:27.490517] [INFO ] [MAIN ] Update Progress: 2241/2370 symbols completed. VNCE took 14.1s. Estimated remaining: 13m 43s. Rate: 9.4 symbols/min [2025-09-14T20:35:27.671536] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:27.678211] [DEBUG] [LOCAL ] VOC: Loaded 4153 existing records from primary storage. [2025-09-14T20:35:27.678374] [INFO ] [MAIN ] VOC: Loaded 4153 existing records. [2025-09-14T20:35:27.763941] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-14T20:35:27.870324] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:27.870640] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-14T20:35:27.870788] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-14T20:35:27.871087] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-14T20:35:27.871149] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-14T20:35:28.150763] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T20:35:28.271166] [INFO ] [REMOTE ] VOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:28.558864] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-14T20:35:29.156851] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T20:35:29.358854] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-14T20:35:29.382752] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T20:35:30.158932] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-14T20:35:30.643493] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T20:35:30.958951] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-14T20:35:31.758933] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-14T20:35:31.856779] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T20:35:32.463914] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T20:35:32.566052] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-14T20:35:32.571963] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T20:35:33.358894] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-14T20:35:33.606536] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T20:35:33.610291] [INFO ] [REMOTE ] VMO: Full fetch complete (23054 records). [2025-09-14T20:35:33.610423] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-14T20:35:33.987115] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-14T20:35:33.987248] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-14T20:35:33.987823] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-14T20:35:33.987888] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-14T20:35:33.988916] [DEBUG] [LOCAL ] VMO: Trimmed 23054 records to 15554 (keeping 150 days of data) [2025-09-14T20:35:34.091892] [DEBUG] [LOCAL ] VMO: Primary data saved (15554 records). [2025-09-14T20:35:34.092080] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-14T20:35:34.092204] [INFO ] [MAIN ] Update Progress: 2242/2370 symbols completed. VMO took 20.7s. Estimated remaining: 13m 37s. Rate: 9.4 symbols/min [2025-09-14T20:35:34.167006] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-14T20:35:34.268127] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:34.287218] [DEBUG] [LOCAL ] VOYA: Loaded 18666 existing records from primary storage. [2025-09-14T20:35:34.287423] [INFO ] [MAIN ] VOYA: Loaded 18666 existing records. [2025-09-14T20:35:34.469196] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:34.469448] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-14T20:35:34.469507] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-14T20:35:34.469964] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-14T20:35:34.470033] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-14T20:35:34.826876] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:34.904546] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T20:35:34.958776] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-14T20:35:35.023802] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T20:35:35.758827] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-14T20:35:36.425565] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:35:36.430100] [INFO ] [REMOTE ] VNT: Full fetch complete (48601 records). [2025-09-14T20:35:36.430226] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-14T20:35:36.571567] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-14T20:35:36.831497] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-14T20:35:36.831690] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-14T20:35:36.832893] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-14T20:35:36.832986] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-14T20:35:36.834380] [DEBUG] [LOCAL ] VNT: Trimmed 48601 records to 32897 (keeping 150 days of data) [2025-09-14T20:35:36.857112] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T20:35:37.090359] [DEBUG] [LOCAL ] VNT: Primary data saved (32897 records). [2025-09-14T20:35:37.090576] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-14T20:35:37.090763] [INFO ] [MAIN ] Update Progress: 2243/2370 symbols completed. VNT took 23.7s. Estimated remaining: 13m 30s. Rate: 9.4 symbols/min [2025-09-14T20:35:37.261069] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:37.281289] [DEBUG] [LOCAL ] VOYG: Loaded 20457 existing records from primary storage. [2025-09-14T20:35:37.281481] [INFO ] [MAIN ] VOYG: Loaded 20457 existing records. [2025-09-14T20:35:37.363954] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-14T20:35:37.462921] [WARN ] [MAIN ] VOYG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:37.463167] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-14T20:35:37.463249] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-14T20:35:37.463771] [DEBUG] [LOCAL ] VOYG: Deleted primary data file. [2025-09-14T20:35:37.463850] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-14T20:35:37.821543] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:38.158843] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-14T20:35:38.356196] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T20:35:38.391414] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T20:35:38.398474] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:35:38.398748] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-14T20:35:38.958816] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-14T20:35:39.758890] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-14T20:35:40.018604] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:35:40.018998] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-14T20:35:40.558824] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-14T20:35:40.626121] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T20:35:40.825280] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:35:40.825664] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-14T20:35:41.358920] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-14T20:35:42.158896] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-14T20:35:42.185674] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T20:35:42.958826] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-14T20:35:43.758865] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-14T20:35:43.811776] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T20:35:44.558914] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-14T20:35:44.729908] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T20:35:44.757179] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T20:35:45.358862] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-14T20:35:46.158899] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-14T20:35:46.188520] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T20:35:46.318880] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T20:35:46.432855] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T20:35:46.433202] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-14T20:35:46.958829] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-14T20:35:47.758894] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-14T20:35:48.483168] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T20:35:48.558788] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-14T20:35:48.681250] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T20:35:49.358850] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-14T20:35:50.158846] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-14T20:35:50.212413] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T20:35:50.958855] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-14T20:35:51.081638] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T20:35:51.083401] [INFO ] [REMOTE ] VOC: Full fetch complete (9935 records). [2025-09-14T20:35:51.083584] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-14T20:35:51.223895] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T20:35:51.505958] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-14T20:35:51.506077] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-14T20:35:51.506390] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-14T20:35:51.506454] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-14T20:35:51.507028] [DEBUG] [LOCAL ] VOC: Trimmed 9935 records to 6988 (keeping 150 days of data) [2025-09-14T20:35:51.552253] [DEBUG] [LOCAL ] VOC: Primary data saved (6988 records). [2025-09-14T20:35:51.552435] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-14T20:35:51.552590] [INFO ] [MAIN ] Update Progress: 2244/2370 symbols completed. VOC took 24.1s. Estimated remaining: 13m 24s. Rate: 9.4 symbols/min [2025-09-14T20:35:51.728539] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:51.739161] [DEBUG] [LOCAL ] VPG: Loaded 6544 existing records from primary storage. [2025-09-14T20:35:51.739355] [INFO ] [MAIN ] VPG: Loaded 6544 existing records. [2025-09-14T20:35:51.764310] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-14T20:35:51.937292] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:51.937672] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-14T20:35:51.937740] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-14T20:35:51.938157] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-14T20:35:51.938225] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-14T20:35:52.318095] [INFO ] [REMOTE ] VPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:52.569052] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-14T20:35:52.575176] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T20:35:53.358855] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-14T20:35:53.649166] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T20:35:53.817076] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T20:35:54.158786] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-14T20:35:54.462293] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T20:35:54.831592] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:35:54.837557] [INFO ] [REMOTE ] VNO: Full fetch complete (53191 records). [2025-09-14T20:35:54.837700] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-14T20:35:54.963875] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-14T20:35:55.224716] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-14T20:35:55.224850] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-14T20:35:55.226062] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-14T20:35:55.226214] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-14T20:35:55.227588] [DEBUG] [LOCAL ] VNO: Trimmed 53191 records to 36851 (keeping 150 days of data) [2025-09-14T20:35:55.480950] [DEBUG] [LOCAL ] VNO: Primary data saved (36851 records). [2025-09-14T20:35:55.481132] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-14T20:35:55.481292] [INFO ] [MAIN ] Update Progress: 2245/2370 symbols completed. VNO took 42.1s. Estimated remaining: 13m 18s. Rate: 9.4 symbols/min [2025-09-14T20:35:55.657400] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:55.661301] [DEBUG] [LOCAL ] VPV: Loaded 2063 existing records from primary storage. [2025-09-14T20:35:55.661404] [INFO ] [MAIN ] VPV: Loaded 2063 existing records. [2025-09-14T20:35:55.760509] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-14T20:35:55.845549] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:55.845866] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-14T20:35:55.845938] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-14T20:35:55.846219] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-14T20:35:55.856475] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-14T20:35:55.909910] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T20:35:55.969264] [INFO ] [REMOTE ] VOYA: Full fetch complete (46645 records). [2025-09-14T20:35:55.969475] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-14T20:35:56.449515] [INFO ] [REMOTE ] VPV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:56.568937] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-14T20:35:56.610328] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-14T20:35:56.610512] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-14T20:35:56.611720] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-14T20:35:56.611819] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-14T20:35:56.613872] [DEBUG] [LOCAL ] VOYA: Trimmed 46645 records to 31474 (keeping 150 days of data) [2025-09-14T20:35:56.850917] [DEBUG] [LOCAL ] VOYA: Primary data saved (31474 records). [2025-09-14T20:35:56.851111] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-14T20:35:56.851232] [INFO ] [MAIN ] Update Progress: 2246/2370 symbols completed. VOYA took 22.8s. Estimated remaining: 13m 11s. Rate: 9.4 symbols/min [2025-09-14T20:35:57.071246] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:35:57.089321] [DEBUG] [LOCAL ] VRE: Loaded 15852 existing records from primary storage. [2025-09-14T20:35:57.089508] [INFO ] [MAIN ] VRE: Loaded 15852 existing records. [2025-09-14T20:35:57.268956] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:35:57.269196] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-14T20:35:57.269262] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-14T20:35:57.269677] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-14T20:35:57.269739] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-14T20:35:57.368877] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-14T20:35:57.639456] [INFO ] [REMOTE ] VRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:35:57.649782] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T20:35:57.689553] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T20:35:58.158889] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-14T20:35:58.179274] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T20:35:58.958848] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-14T20:35:59.574748] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T20:35:59.719261] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-14T20:35:59.723944] [INFO ] [REMOTE ] VOYG: Full fetch complete (21407 records). [2025-09-14T20:35:59.724111] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-14T20:35:59.764087] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-14T20:35:59.914606] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 65 unique days, need 150 days [2025-09-14T20:35:59.914998] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:35:59.915050] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:35:59.915090] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-14T20:35:59.915160] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-14T20:35:59.915209] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-14T20:35:59.915269] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-14T20:35:59.915365] [INFO ] [MAIN ] Update Progress: 2247/2370 symbols completed. VOYG took 22.8s. Estimated remaining: 13m 4s. Rate: 9.4 symbols/min [2025-09-14T20:36:00.089202] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:00.115742] [DEBUG] [LOCAL ] VRT: Loaded 24116 existing records from primary storage. [2025-09-14T20:36:00.115926] [INFO ] [MAIN ] VRT: Loaded 24116 existing records. [2025-09-14T20:36:00.299879] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:00.300258] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-14T20:36:00.300322] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-14T20:36:00.301047] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-14T20:36:00.301113] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-14T20:36:00.566109] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-14T20:36:00.655781] [INFO ] [REMOTE ] VRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:01.358887] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-14T20:36:01.509217] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T20:36:01.915138] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T20:36:02.158902] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-14T20:36:02.958830] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-14T20:36:03.758905] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-14T20:36:07.357574] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (5.20 seconds). [2025-09-14T20:36:07.362699] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-14T20:36:08.132496] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (4.37 seconds). [2025-09-14T20:36:08.135053] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-14T20:36:08.524596] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (5.57 seconds). [2025-09-14T20:36:08.532778] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-14T20:36:09.052664] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (7.69 seconds). [2025-09-14T20:36:09.063432] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-14T20:36:09.486718] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T20:36:09.491505] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-14T20:36:09.677988] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T20:36:09.679900] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-14T20:36:10.169976] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T20:36:10.178425] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-14T20:36:10.636075] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T20:36:10.637821] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-14T20:36:11.132072] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T20:36:11.136543] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-14T20:36:11.393755] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T20:36:11.543628] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T20:36:11.758808] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-14T20:36:12.000865] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-09-14T20:36:12.132446] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T20:36:12.479407] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T20:36:12.558873] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-14T20:36:13.240002] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:36:13.241298] [INFO ] [REMOTE ] VPV: Full fetch complete (6028 records). [2025-09-14T20:36:13.241382] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-14T20:36:13.363997] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-14T20:36:13.610504] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-14T20:36:13.610657] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-14T20:36:13.610883] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-14T20:36:13.610937] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-14T20:36:13.611359] [DEBUG] [LOCAL ] VPV: Trimmed 6028 records to 3672 (keeping 150 days of data) [2025-09-14T20:36:13.634554] [DEBUG] [LOCAL ] VPV: Primary data saved (3672 records). [2025-09-14T20:36:13.634713] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-14T20:36:13.634814] [INFO ] [MAIN ] Update Progress: 2248/2370 symbols completed. VPV took 18.2s. Estimated remaining: 12m 58s. Rate: 9.4 symbols/min [2025-09-14T20:36:13.811928] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:13.819227] [DEBUG] [LOCAL ] VRTS: Loaded 5021 existing records from primary storage. [2025-09-14T20:36:13.819399] [INFO ] [MAIN ] VRTS: Loaded 5021 existing records. [2025-09-14T20:36:14.014445] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:14.014791] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-14T20:36:14.014856] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-14T20:36:14.015120] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-14T20:36:14.015178] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-14T20:36:14.164018] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-14T20:36:14.368600] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:14.958874] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-14T20:36:15.683972] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T20:36:15.758843] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-14T20:36:15.924860] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T20:36:16.101126] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-14T20:36:16.558882] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-14T20:36:17.288222] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T20:36:17.303149] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T20:36:17.358803] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-14T20:36:18.158892] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-14T20:36:18.178183] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T20:36:18.958832] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-14T20:36:19.717856] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T20:36:19.758847] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-14T20:36:20.558823] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-14T20:36:20.784663] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T20:36:20.842994] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-14T20:36:21.358871] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-14T20:36:21.906415] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T20:36:22.158885] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-14T20:36:22.287404] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T20:36:22.958887] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-14T20:36:23.758920] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-14T20:36:24.558997] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-14T20:36:24.875909] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-14T20:36:24.881315] [INFO ] [REMOTE ] VRE: Full fetch complete (36944 records). [2025-09-14T20:36:24.881536] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-14T20:36:25.264782] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-14T20:36:25.264909] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-14T20:36:25.265729] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-14T20:36:25.265791] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-14T20:36:25.267036] [DEBUG] [LOCAL ] VRE: Trimmed 36944 records to 26058 (keeping 150 days of data) [2025-09-14T20:36:25.409837] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (3.25 seconds). [2025-09-14T20:36:25.426138] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-14T20:36:25.439690] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T20:36:25.487398] [DEBUG] [LOCAL ] VRE: Primary data saved (26058 records). [2025-09-14T20:36:25.487546] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-14T20:36:25.487670] [INFO ] [MAIN ] Update Progress: 2249/2370 symbols completed. VRE took 28.6s. Estimated remaining: 12m 52s. Rate: 9.4 symbols/min [2025-09-14T20:36:25.656472] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:25.678681] [DEBUG] [LOCAL ] VSCO: Loaded 23579 existing records from primary storage. [2025-09-14T20:36:25.678845] [INFO ] [MAIN ] VSCO: Loaded 23579 existing records. [2025-09-14T20:36:25.855501] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:25.859925] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T20:36:25.861407] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-14T20:36:25.861828] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-14T20:36:25.862334] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-14T20:36:25.862482] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-14T20:36:25.862430] [INFO ] [REMOTE ] VPG: Full fetch complete (18397 records). [2025-09-14T20:36:25.893831] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-14T20:36:26.163635] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-14T20:36:26.562425] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:26.633058] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-14T20:36:26.633204] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-14T20:36:26.634066] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-14T20:36:26.634153] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-14T20:36:26.635052] [DEBUG] [LOCAL ] VPG: Trimmed 18397 records to 12834 (keeping 150 days of data) [2025-09-14T20:36:26.717681] [DEBUG] [LOCAL ] VPG: Primary data saved (12834 records). [2025-09-14T20:36:26.717900] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-14T20:36:26.718042] [INFO ] [MAIN ] Update Progress: 2250/2370 symbols completed. VPG took 35.2s. Estimated remaining: 12m 46s. Rate: 9.4 symbols/min [2025-09-14T20:36:26.864319] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:36:26.898006] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:26.898156] [INFO ] [REMOTE ] VRTS: Full fetch complete (9487 records). [2025-09-14T20:36:26.898375] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-14T20:36:26.963395] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-14T20:36:27.210789] [DEBUG] [LOCAL ] VSH: Loaded 21510 existing records from primary storage. [2025-09-14T20:36:27.227113] [INFO ] [MAIN ] VSH: Loaded 21510 existing records. [2025-09-14T20:36:27.381502] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-14T20:36:27.405961] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-14T20:36:27.406443] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-14T20:36:27.406904] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-14T20:36:27.428907] [DEBUG] [LOCAL ] VRTS: Trimmed 9487 records to 7402 (keeping 150 days of data) [2025-09-14T20:36:27.534750] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:27.538892] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-14T20:36:27.546868] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-14T20:36:27.549162] [DEBUG] [LOCAL ] VRTS: Primary data saved (7402 records). [2025-09-14T20:36:27.549412] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-14T20:36:27.549575] [INFO ] [MAIN ] Update Progress: 2251/2370 symbols completed. VRTS took 13.9s. Estimated remaining: 12m 39s. Rate: 9.4 symbols/min [2025-09-14T20:36:27.581161] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-14T20:36:27.624113] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-14T20:36:27.844106] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:28.102593] [DEBUG] [LOCAL ] VST: Loaded 24091 existing records from primary storage. [2025-09-14T20:36:28.106461] [INFO ] [REMOTE ] VSH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:28.107192] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-14T20:36:28.106875] [INFO ] [MAIN ] VST: Loaded 24091 existing records. [2025-09-14T20:36:28.293168] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:28.293493] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-14T20:36:28.293574] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-14T20:36:28.305208] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-14T20:36:28.323456] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-14T20:36:28.368989] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-14T20:36:28.581574] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-14T20:36:28.698410] [INFO ] [REMOTE ] VST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:28.922709] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T20:36:29.358841] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-14T20:36:30.158923] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-14T20:36:30.195312] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T20:36:30.868762] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-14T20:36:30.958798] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-14T20:36:31.756280] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-14T20:36:31.770253] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-14T20:36:32.249308] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T20:36:32.558862] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-14T20:36:32.667332] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-14T20:36:32.672893] [INFO ] [REMOTE ] VRT: Full fetch complete (58434 records). [2025-09-14T20:36:32.673036] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-14T20:36:33.052006] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-14T20:36:33.052113] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-14T20:36:33.053206] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-14T20:36:33.053262] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-14T20:36:33.054484] [DEBUG] [LOCAL ] VRT: Trimmed 58434 records to 40495 (keeping 150 days of data) [2025-09-14T20:36:33.345959] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T20:36:33.358880] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-14T20:36:33.370540] [DEBUG] [LOCAL ] VRT: Primary data saved (40495 records). [2025-09-14T20:36:33.370693] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-14T20:36:33.370798] [INFO ] [MAIN ] Update Progress: 2252/2370 symbols completed. VRT took 33.5s. Estimated remaining: 12m 33s. Rate: 9.4 symbols/min [2025-09-14T20:36:33.539997] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:33.560895] [DEBUG] [LOCAL ] VSTS: Loaded 21803 existing records from primary storage. [2025-09-14T20:36:33.561070] [INFO ] [MAIN ] VSTS: Loaded 21803 existing records. [2025-09-14T20:36:33.736297] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:33.736574] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-14T20:36:33.736634] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-14T20:36:33.737166] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-14T20:36:33.737230] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-14T20:36:34.097003] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:34.151001] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T20:36:34.162700] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-14T20:36:34.958858] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-14T20:36:35.203911] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T20:36:35.758899] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-14T20:36:35.842164] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T20:36:36.334381] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T20:36:36.558896] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-14T20:36:37.358821] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-14T20:36:37.435084] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T20:36:38.158839] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-14T20:36:38.299141] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T20:36:38.958845] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-14T20:36:39.758894] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-14T20:36:39.908228] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T20:36:40.003406] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-14T20:36:40.099474] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T20:36:40.558839] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-14T20:36:41.358852] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-14T20:36:41.591714] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T20:36:41.983246] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T20:36:42.158858] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-14T20:36:42.958810] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-14T20:36:43.102504] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T20:36:43.742419] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T20:36:43.758793] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-14T20:36:44.558845] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-14T20:36:45.282814] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T20:36:45.358886] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-14T20:36:45.577300] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T20:36:45.784588] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T20:36:46.158840] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-14T20:36:46.958885] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-14T20:36:47.628794] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:36:47.634057] [INFO ] [REMOTE ] VSH: Full fetch complete (53361 records). [2025-09-14T20:36:47.634299] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-14T20:36:47.760858] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-14T20:36:48.041957] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-14T20:36:48.042169] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-14T20:36:48.043449] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-14T20:36:48.043599] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-14T20:36:48.045263] [DEBUG] [LOCAL ] VSH: Trimmed 53361 records to 36374 (keeping 150 days of data) [2025-09-14T20:36:48.076089] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T20:36:48.225006] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-09-14T20:36:48.365332] [DEBUG] [LOCAL ] VSH: Primary data saved (36374 records). [2025-09-14T20:36:48.365524] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-14T20:36:48.365659] [INFO ] [MAIN ] Update Progress: 2253/2370 symbols completed. VSH took 21.6s. Estimated remaining: 12m 27s. Rate: 9.4 symbols/min [2025-09-14T20:36:48.539789] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:48.558813] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-14T20:36:48.558911] [DEBUG] [LOCAL ] VTEX: Loaded 19551 existing records from primary storage. [2025-09-14T20:36:48.559205] [INFO ] [MAIN ] VTEX: Loaded 19551 existing records. [2025-09-14T20:36:48.736791] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:48.737103] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-14T20:36:48.737163] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-14T20:36:48.737557] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-14T20:36:48.737613] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-14T20:36:49.126833] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:49.358838] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-14T20:36:50.158849] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-14T20:36:50.369831] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-14T20:36:50.958839] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-14T20:36:51.009228] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T20:36:51.049737] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-14T20:36:51.636574] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:36:51.642079] [INFO ] [REMOTE ] VSCO: Full fetch complete (57437 records). [2025-09-14T20:36:51.642211] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-14T20:36:51.763393] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-14T20:36:52.037764] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-14T20:36:52.038034] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-14T20:36:52.039228] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-14T20:36:52.039299] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-14T20:36:52.040636] [DEBUG] [LOCAL ] VSCO: Trimmed 57437 records to 39691 (keeping 150 days of data) [2025-09-14T20:36:52.179934] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T20:36:52.355392] [DEBUG] [LOCAL ] VSCO: Primary data saved (39691 records). [2025-09-14T20:36:52.355707] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-14T20:36:52.355955] [INFO ] [MAIN ] Update Progress: 2254/2370 symbols completed. VSCO took 26.9s. Estimated remaining: 12m 20s. Rate: 9.4 symbols/min [2025-09-14T20:36:52.544632] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:52.558863] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-14T20:36:52.569608] [DEBUG] [LOCAL ] VTLE: Loaded 21659 existing records from primary storage. [2025-09-14T20:36:52.569988] [INFO ] [MAIN ] VTLE: Loaded 21659 existing records. [2025-09-14T20:36:52.753994] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:52.754290] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-14T20:36:52.754356] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-14T20:36:52.755023] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-14T20:36:52.755091] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-14T20:36:53.135614] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:53.271751] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:36:53.276868] [INFO ] [REMOTE ] VSTS: Full fetch complete (52687 records). [2025-09-14T20:36:53.277002] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-14T20:36:53.367962] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-14T20:36:53.694546] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-14T20:36:53.694738] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-14T20:36:53.695885] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-14T20:36:53.695949] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-14T20:36:53.697322] [DEBUG] [LOCAL ] VSTS: Trimmed 52687 records to 36722 (keeping 150 days of data) [2025-09-14T20:36:53.920483] [DEBUG] [LOCAL ] VSTS: Primary data saved (36722 records). [2025-09-14T20:36:53.920704] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-14T20:36:53.920817] [INFO ] [MAIN ] Update Progress: 2255/2370 symbols completed. VSTS took 20.5s. Estimated remaining: 12m 13s. Rate: 9.4 symbols/min [2025-09-14T20:36:54.090200] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:36:54.098723] [DEBUG] [LOCAL ] VTMX: Loaded 6878 existing records from primary storage. [2025-09-14T20:36:54.098874] [INFO ] [MAIN ] VTMX: Loaded 6878 existing records. [2025-09-14T20:36:54.167667] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-14T20:36:54.284766] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:36:54.285721] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-14T20:36:54.285823] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-14T20:36:54.286510] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-14T20:36:54.286579] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-14T20:36:54.644565] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:36:54.675862] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-14T20:36:54.897876] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T20:36:54.958848] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-14T20:36:55.735590] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T20:36:55.758786] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-14T20:36:56.558931] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-14T20:36:56.739392] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T20:36:57.350493] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T20:36:57.359066] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-14T20:36:57.803356] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T20:36:58.158872] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-14T20:36:58.958928] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-14T20:36:59.153216] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T20:36:59.758943] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-14T20:37:00.465233] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T20:37:00.561879] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-14T20:37:00.568676] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-14T20:37:01.231993] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T20:37:01.358835] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-14T20:37:02.158890] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-14T20:37:02.344435] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T20:37:02.958948] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-14T20:37:03.148942] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T20:37:03.185276] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T20:37:03.630678] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:37:03.636404] [INFO ] [REMOTE ] VST: Full fetch complete (58404 records). [2025-09-14T20:37:03.636580] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-14T20:37:03.764057] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-14T20:37:04.057291] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-14T20:37:04.057399] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-14T20:37:04.058634] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-14T20:37:04.058707] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-14T20:37:04.059985] [DEBUG] [LOCAL ] VST: Trimmed 58404 records to 40466 (keeping 150 days of data) [2025-09-14T20:37:04.316930] [DEBUG] [LOCAL ] VST: Primary data saved (40466 records). [2025-09-14T20:37:04.317102] [INFO ] [MAIN ] VST: Full history saved. [2025-09-14T20:37:04.317200] [INFO ] [MAIN ] Update Progress: 2256/2370 symbols completed. VST took 36.8s. Estimated remaining: 12m 7s. Rate: 9.4 symbols/min [2025-09-14T20:37:04.484130] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:04.489135] [DEBUG] [LOCAL ] VTN: Loaded 3204 existing records from primary storage. [2025-09-14T20:37:04.489243] [INFO ] [MAIN ] VTN: Loaded 3204 existing records. [2025-09-14T20:37:04.563882] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-14T20:37:04.664813] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:04.665025] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-14T20:37:04.665085] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-14T20:37:04.665351] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-14T20:37:04.665412] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-14T20:37:05.016520] [INFO ] [REMOTE ] VTN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:05.358841] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-14T20:37:05.515169] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T20:37:05.573016] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T20:37:06.158807] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-14T20:37:06.406216] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T20:37:06.958854] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-14T20:37:07.758919] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-14T20:37:07.984958] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T20:37:08.558895] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-14T20:37:08.616755] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T20:37:08.616961] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T20:37:09.358822] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-14T20:37:10.158876] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-14T20:37:10.343547] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T20:37:10.782456] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T20:37:10.787472] [INFO ] [REMOTE ] VTEX: Full fetch complete (46855 records). [2025-09-14T20:37:10.787660] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-14T20:37:10.960263] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-14T20:37:11.096516] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T20:37:11.199828] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-14T20:37:11.199946] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-14T20:37:11.201056] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-14T20:37:11.201125] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-14T20:37:11.202264] [DEBUG] [LOCAL ] VTEX: Trimmed 46855 records to 32608 (keeping 150 days of data) [2025-09-14T20:37:11.396465] [DEBUG] [LOCAL ] VTEX: Primary data saved (32608 records). [2025-09-14T20:37:11.396688] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-14T20:37:11.396822] [INFO ] [MAIN ] Update Progress: 2257/2370 symbols completed. VTEX took 23.0s. Estimated remaining: 12m 1s. Rate: 9.4 symbols/min [2025-09-14T20:37:11.570985] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:11.581268] [DEBUG] [LOCAL ] VTOL: Loaded 8325 existing records from primary storage. [2025-09-14T20:37:11.581447] [INFO ] [MAIN ] VTOL: Loaded 8325 existing records. [2025-09-14T20:37:11.763443] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-14T20:37:11.767043] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:11.768453] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-14T20:37:11.768531] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-14T20:37:11.768880] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-14T20:37:11.768946] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-14T20:37:12.129222] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:12.381915] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T20:37:12.558888] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-14T20:37:12.722904] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T20:37:13.358871] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-14T20:37:13.873298] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T20:37:14.158898] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-14T20:37:14.554870] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T20:37:14.559745] [INFO ] [REMOTE ] VTLE: Full fetch complete (52608 records). [2025-09-14T20:37:14.559864] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-14T20:37:14.677218] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T20:37:14.950723] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-14T20:37:14.950862] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-14T20:37:14.951981] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-14T20:37:14.952042] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-14T20:37:14.953518] [DEBUG] [LOCAL ] VTLE: Trimmed 52608 records to 36568 (keeping 150 days of data) [2025-09-14T20:37:15.005322] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-14T20:37:15.191484] [DEBUG] [LOCAL ] VTLE: Primary data saved (36568 records). [2025-09-14T20:37:15.191740] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-14T20:37:15.191909] [INFO ] [MAIN ] Update Progress: 2258/2370 symbols completed. VTLE took 22.8s. Estimated remaining: 11m 54s. Rate: 9.4 symbols/min [2025-09-14T20:37:15.367302] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:15.390858] [DEBUG] [LOCAL ] VTR: Loaded 23588 existing records from primary storage. [2025-09-14T20:37:15.391062] [INFO ] [MAIN ] VTR: Loaded 23588 existing records. [2025-09-14T20:37:15.573337] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:15.573608] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-14T20:37:15.573690] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-14T20:37:15.574268] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-14T20:37:15.574337] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-14T20:37:15.768771] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-14T20:37:15.940903] [INFO ] [REMOTE ] VTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:15.949815] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T20:37:16.558891] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-14T20:37:17.145544] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T20:37:17.358957] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-14T20:37:17.680873] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T20:37:18.158899] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-14T20:37:18.922417] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T20:37:18.958854] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-14T20:37:19.092699] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T20:37:19.721902] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T20:37:19.723555] [INFO ] [REMOTE ] VTN: Full fetch complete (7716 records). [2025-09-14T20:37:19.723679] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-14T20:37:19.763955] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-14T20:37:20.090950] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-14T20:37:20.091066] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-14T20:37:20.091300] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-14T20:37:20.091359] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-14T20:37:20.091826] [DEBUG] [LOCAL ] VTN: Trimmed 7716 records to 5097 (keeping 150 days of data) [2025-09-14T20:37:20.122773] [DEBUG] [LOCAL ] VTN: Primary data saved (5097 records). [2025-09-14T20:37:20.122880] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-14T20:37:20.122996] [INFO ] [MAIN ] Update Progress: 2259/2370 symbols completed. VTN took 15.8s. Estimated remaining: 11m 48s. Rate: 9.4 symbols/min [2025-09-14T20:37:20.290754] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:20.305256] [DEBUG] [LOCAL ] VTS: Loaded 13075 existing records from primary storage. [2025-09-14T20:37:20.305411] [INFO ] [MAIN ] VTS: Loaded 13075 existing records. [2025-09-14T20:37:20.479822] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:20.480061] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-14T20:37:20.480129] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-14T20:37:20.480498] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-14T20:37:20.480555] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-14T20:37:20.564019] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-14T20:37:20.845234] [INFO ] [REMOTE ] VTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:20.846317] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T20:37:21.358952] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-14T20:37:22.060030] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:37:22.062332] [INFO ] [REMOTE ] VTMX: Full fetch complete (19065 records). [2025-09-14T20:37:22.062445] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-14T20:37:22.167432] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-14T20:37:22.456124] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-14T20:37:22.456255] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-14T20:37:22.456919] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-14T20:37:22.456982] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-14T20:37:22.457723] [DEBUG] [LOCAL ] VTMX: Trimmed 19065 records to 13126 (keeping 150 days of data) [2025-09-14T20:37:22.553091] [DEBUG] [LOCAL ] VTMX: Primary data saved (13126 records). [2025-09-14T20:37:22.553330] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-14T20:37:22.553473] [INFO ] [MAIN ] Update Progress: 2260/2370 symbols completed. VTMX took 28.6s. Estimated remaining: 11m 41s. Rate: 9.4 symbols/min [2025-09-14T20:37:22.732175] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:22.777420] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T20:37:22.794362] [DEBUG] [LOCAL ] VVR: Loaded 13230 existing records from primary storage. [2025-09-14T20:37:22.794982] [INFO ] [MAIN ] VVR: Loaded 13230 existing records. [2025-09-14T20:37:22.960323] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-14T20:37:22.983866] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:22.984075] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-14T20:37:22.984130] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-14T20:37:22.984519] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-14T20:37:22.984591] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-14T20:37:23.334375] [INFO ] [REMOTE ] VVR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:23.346816] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T20:37:23.758874] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-14T20:37:24.235265] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T20:37:24.558841] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-14T20:37:25.358891] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-14T20:37:25.794502] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T20:37:26.169880] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-14T20:37:26.171520] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T20:37:26.840839] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T20:37:26.958797] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-14T20:37:27.758878] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-14T20:37:27.998753] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T20:37:28.424783] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T20:37:28.558879] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-14T20:37:28.813083] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T20:37:29.358796] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-14T20:37:29.674752] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T20:37:30.158913] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-14T20:37:30.859015] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T20:37:30.937599] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T20:37:30.958782] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-14T20:37:31.758807] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-14T20:37:32.078594] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T20:37:32.558842] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-14T20:37:33.129512] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T20:37:33.358886] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-14T20:37:33.874310] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T20:37:34.158867] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-14T20:37:34.958885] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-14T20:37:35.150557] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T20:37:35.210159] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T20:37:35.758928] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-14T20:37:36.422239] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T20:37:36.558929] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-14T20:37:37.358870] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-14T20:37:37.378529] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T20:37:38.158882] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-14T20:37:38.331710] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T20:37:38.444230] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T20:37:38.958822] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-14T20:37:39.295154] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T20:37:39.758865] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-14T20:37:40.558876] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-14T20:37:40.698486] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T20:37:40.887826] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T20:37:41.358848] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-14T20:37:41.770896] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T20:37:41.774854] [INFO ] [REMOTE ] VVR: Full fetch complete (33115 records). [2025-09-14T20:37:41.774952] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-14T20:37:42.163007] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-14T20:37:42.191368] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-14T20:37:42.192311] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-14T20:37:42.193125] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-14T20:37:42.193272] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-14T20:37:42.194254] [DEBUG] [LOCAL ] VVR: Trimmed 33115 records to 21767 (keeping 150 days of data) [2025-09-14T20:37:42.329773] [DEBUG] [LOCAL ] VVR: Primary data saved (21767 records). [2025-09-14T20:37:42.329937] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-14T20:37:42.330036] [INFO ] [MAIN ] Update Progress: 2261/2370 symbols completed. VVR took 19.8s. Estimated remaining: 11m 36s. Rate: 9.4 symbols/min [2025-09-14T20:37:42.500664] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:42.522112] [DEBUG] [LOCAL ] VVV: Loaded 22455 existing records from primary storage. [2025-09-14T20:37:42.522286] [INFO ] [MAIN ] VVV: Loaded 22455 existing records. [2025-09-14T20:37:42.705254] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:42.705592] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-14T20:37:42.705695] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-14T20:37:42.706508] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-14T20:37:42.707036] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-14T20:37:42.967590] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-14T20:37:43.077173] [INFO ] [REMOTE ] VVV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:43.216392] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T20:37:43.277787] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T20:37:43.597596] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T20:37:43.599773] [INFO ] [REMOTE ] VTOL: Full fetch complete (21159 records). [2025-09-14T20:37:43.599953] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-14T20:37:43.770948] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-14T20:37:43.981724] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-14T20:37:43.981869] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-14T20:37:43.982962] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-14T20:37:43.983037] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-14T20:37:43.983988] [DEBUG] [LOCAL ] VTOL: Trimmed 21159 records to 14897 (keeping 150 days of data) [2025-09-14T20:37:44.084442] [DEBUG] [LOCAL ] VTOL: Primary data saved (14897 records). [2025-09-14T20:37:44.084735] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-14T20:37:44.084914] [INFO ] [MAIN ] Update Progress: 2262/2370 symbols completed. VTOL took 32.7s. Estimated remaining: 11m 29s. Rate: 9.4 symbols/min [2025-09-14T20:37:44.280671] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:44.294540] [DEBUG] [LOCAL ] VVX: Loaded 11332 existing records from primary storage. [2025-09-14T20:37:44.294790] [INFO ] [MAIN ] VVX: Loaded 11332 existing records. [2025-09-14T20:37:44.479412] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:44.479762] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-14T20:37:44.479829] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-14T20:37:44.480278] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-14T20:37:44.480357] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-14T20:37:44.564082] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-14T20:37:44.853336] [INFO ] [REMOTE ] VVX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:45.358818] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-14T20:37:45.756319] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T20:37:45.854828] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T20:37:45.858719] [INFO ] [REMOTE ] VTS: Full fetch complete (31732 records). [2025-09-14T20:37:45.858818] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-14T20:37:46.163994] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-14T20:37:46.240454] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-14T20:37:46.240586] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-14T20:37:46.241383] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-14T20:37:46.241444] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-14T20:37:46.242616] [DEBUG] [LOCAL ] VTS: Trimmed 31732 records to 21907 (keeping 150 days of data) [2025-09-14T20:37:46.402359] [DEBUG] [LOCAL ] VTS: Primary data saved (21907 records). [2025-09-14T20:37:46.402548] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-14T20:37:46.402718] [INFO ] [MAIN ] Update Progress: 2263/2370 symbols completed. VTS took 26.3s. Estimated remaining: 11m 23s. Rate: 9.4 symbols/min [2025-09-14T20:37:46.571593] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:46.594183] [DEBUG] [LOCAL ] VYX: Loaded 21676 existing records from primary storage. [2025-09-14T20:37:46.594394] [INFO ] [MAIN ] VYX: Loaded 21676 existing records. [2025-09-14T20:37:46.771746] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:46.772239] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-14T20:37:46.772323] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-14T20:37:46.778162] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-14T20:37:46.785975] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-14T20:37:46.851754] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T20:37:46.958855] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-14T20:37:47.165308] [INFO ] [REMOTE ] VYX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:47.186325] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T20:37:47.192729] [INFO ] [REMOTE ] VTR: Full fetch complete (57459 records). [2025-09-14T20:37:47.193005] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-14T20:37:47.591801] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-14T20:37:47.591957] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-14T20:37:47.593546] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-14T20:37:47.593628] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-14T20:37:47.595807] [DEBUG] [LOCAL ] VTR: Trimmed 57459 records to 39710 (keeping 150 days of data) [2025-09-14T20:37:47.796871] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-14T20:37:47.879916] [DEBUG] [LOCAL ] VTR: Primary data saved (39710 records). [2025-09-14T20:37:47.880170] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-14T20:37:47.880379] [INFO ] [MAIN ] Update Progress: 2264/2370 symbols completed. VTR took 32.7s. Estimated remaining: 11m 16s. Rate: 9.4 symbols/min [2025-09-14T20:37:48.053873] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:37:48.081006] [DEBUG] [LOCAL ] VZ: Loaded 24151 existing records from primary storage. [2025-09-14T20:37:48.081235] [INFO ] [MAIN ] VZ: Loaded 24151 existing records. [2025-09-14T20:37:48.260882] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:37:48.261830] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-14T20:37:48.262036] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-14T20:37:48.268535] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-14T20:37:48.277974] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-14T20:37:48.284538] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T20:37:48.567444] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-14T20:37:48.707209] [INFO ] [REMOTE ] VZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:37:49.358853] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-14T20:37:49.750132] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T20:37:49.775197] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T20:37:50.158853] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-14T20:37:50.958848] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-14T20:37:51.723301] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-14T20:37:51.758787] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-14T20:37:51.932408] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T20:37:52.469597] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T20:37:52.558859] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-14T20:37:53.358857] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-14T20:37:54.015459] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T20:37:54.158884] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-14T20:37:54.381247] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T20:37:54.614230] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T20:37:54.958848] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-14T20:37:55.758862] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-14T20:37:56.189910] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T20:37:56.558917] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-14T20:37:56.675577] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-14T20:37:57.118094] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T20:37:57.364053] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-14T20:37:57.379147] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T20:37:58.158902] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-14T20:37:58.958905] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-14T20:37:59.100054] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T20:37:59.758933] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-14T20:38:00.558889] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-14T20:38:00.635531] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-14T20:38:00.764017] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T20:38:01.358888] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-14T20:38:01.694506] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T20:38:02.158928] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-14T20:38:02.259471] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T20:38:02.958837] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-14T20:38:03.758805] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-14T20:38:04.062166] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T20:38:04.237297] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-09-14T20:38:04.272109] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T20:38:04.275203] [INFO ] [REMOTE ] VVX: Full fetch complete (25368 records). [2025-09-14T20:38:04.275326] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-14T20:38:04.560267] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-14T20:38:04.673021] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-14T20:38:04.673214] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-14T20:38:04.674262] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-14T20:38:04.674384] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-14T20:38:04.675910] [DEBUG] [LOCAL ] VVX: Trimmed 25368 records to 17239 (keeping 150 days of data) [2025-09-14T20:38:04.796795] [DEBUG] [LOCAL ] VVX: Primary data saved (17239 records). [2025-09-14T20:38:04.797006] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-14T20:38:04.797209] [INFO ] [MAIN ] Update Progress: 2265/2370 symbols completed. VVX took 20.7s. Estimated remaining: 11m 10s. Rate: 9.4 symbols/min [2025-09-14T20:38:04.970629] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:04.998416] [DEBUG] [LOCAL ] W: Loaded 23948 existing records from primary storage. [2025-09-14T20:38:04.998678] [INFO ] [MAIN ] W: Loaded 23948 existing records. [2025-09-14T20:38:05.200985] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:05.213859] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-14T20:38:05.214520] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-14T20:38:05.215067] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T20:38:05.219765] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-14T20:38:05.220226] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-14T20:38:05.256663] [INFO ] [REMOTE ] VVV: Full fetch complete (54466 records). [2025-09-14T20:38:05.263844] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-14T20:38:05.359697] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-14T20:38:05.912733] [INFO ] [REMOTE ] W: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:06.079138] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-14T20:38:06.079596] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-14T20:38:06.081083] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-14T20:38:06.081609] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-14T20:38:06.084577] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-14T20:38:06.097105] [DEBUG] [LOCAL ] VVV: Trimmed 54466 records to 37851 (keeping 150 days of data) [2025-09-14T20:38:06.162888] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-14T20:38:06.349294] [DEBUG] [LOCAL ] VVV: Primary data saved (37851 records). [2025-09-14T20:38:06.349556] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-14T20:38:06.349775] [INFO ] [MAIN ] Update Progress: 2266/2370 symbols completed. VVV took 24.0s. Estimated remaining: 11m 3s. Rate: 9.4 symbols/min [2025-09-14T20:38:06.522465] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:06.547235] [DEBUG] [LOCAL ] WAB: Loaded 20120 existing records from primary storage. [2025-09-14T20:38:06.547445] [INFO ] [MAIN ] WAB: Loaded 20120 existing records. [2025-09-14T20:38:06.722460] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:06.722804] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-14T20:38:06.722870] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-14T20:38:06.723535] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-14T20:38:06.723598] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-14T20:38:06.969917] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-14T20:38:07.094208] [INFO ] [REMOTE ] WAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:07.758808] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-14T20:38:08.042382] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-14T20:38:08.260119] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T20:38:08.558892] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-14T20:38:08.757684] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T20:38:09.312461] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T20:38:09.358872] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-14T20:38:10.158861] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-14T20:38:10.467426] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T20:38:10.958794] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-14T20:38:11.443062] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T20:38:11.758895] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-14T20:38:11.882370] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:38:12.558850] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-14T20:38:13.069957] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T20:38:13.358831] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-14T20:38:14.164791] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-14T20:38:14.180218] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-14T20:38:14.290568] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T20:38:14.958855] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-14T20:38:15.143990] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T20:38:15.759411] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-14T20:38:15.761527] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T20:38:15.768024] [INFO ] [REMOTE ] VZ: Full fetch complete (58471 records). [2025-09-14T20:38:15.768166] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-14T20:38:16.162344] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-14T20:38:16.162589] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-14T20:38:16.163801] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-14T20:38:16.163905] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-14T20:38:16.165906] [DEBUG] [LOCAL ] VZ: Trimmed 58471 records to 40531 (keeping 150 days of data) [2025-09-14T20:38:16.292289] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-14T20:38:16.474659] [DEBUG] [LOCAL ] VZ: Primary data saved (40531 records). [2025-09-14T20:38:16.474862] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-14T20:38:16.474984] [INFO ] [MAIN ] Update Progress: 2267/2370 symbols completed. VZ took 28.6s. Estimated remaining: 10m 57s. Rate: 9.4 symbols/min [2025-09-14T20:38:16.564026] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-14T20:38:16.651190] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:16.670900] [DEBUG] [LOCAL ] WAL: Loaded 20261 existing records from primary storage. [2025-09-14T20:38:16.671076] [INFO ] [MAIN ] WAL: Loaded 20261 existing records. [2025-09-14T20:38:16.849235] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:16.849499] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-14T20:38:16.849560] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-14T20:38:16.850170] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-14T20:38:16.850233] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-14T20:38:17.253843] [INFO ] [REMOTE ] WAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:17.325734] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T20:38:17.331172] [INFO ] [REMOTE ] VYX: Full fetch complete (53375 records). [2025-09-14T20:38:17.331341] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-14T20:38:17.363899] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-14T20:38:17.723121] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-14T20:38:17.723308] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-14T20:38:17.724465] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-14T20:38:17.724540] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-14T20:38:17.726269] [DEBUG] [LOCAL ] VYX: Trimmed 53375 records to 36678 (keeping 150 days of data) [2025-09-14T20:38:17.967305] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-14T20:38:18.005308] [DEBUG] [LOCAL ] VYX: Primary data saved (36678 records). [2025-09-14T20:38:18.005508] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-14T20:38:18.005636] [INFO ] [MAIN ] Update Progress: 2268/2370 symbols completed. VYX took 31.6s. Estimated remaining: 10m 51s. Rate: 9.4 symbols/min [2025-09-14T20:38:18.159844] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-14T20:38:18.177573] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:18.196790] [DEBUG] [LOCAL ] WAT: Loaded 16664 existing records from primary storage. [2025-09-14T20:38:18.196981] [INFO ] [MAIN ] WAT: Loaded 16664 existing records. [2025-09-14T20:38:18.382269] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:18.382603] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-14T20:38:18.382682] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-14T20:38:18.383140] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-14T20:38:18.383198] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-14T20:38:18.745093] [INFO ] [REMOTE ] WAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:18.958819] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-14T20:38:19.419797] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T20:38:19.758861] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-14T20:38:19.823481] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:38:20.491354] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T20:38:20.558923] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-14T20:38:21.358873] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-14T20:38:21.802224] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T20:38:22.153450] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T20:38:22.161514] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-14T20:38:22.958840] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-14T20:38:23.174005] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T20:38:23.651605] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T20:38:23.758880] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-14T20:38:24.558813] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-14T20:38:25.084212] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-14T20:38:25.124519] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T20:38:25.358914] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-14T20:38:26.158870] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-14T20:38:26.330477] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T20:38:26.882387] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T20:38:26.958829] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-14T20:38:27.758868] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-14T20:38:28.043860] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T20:38:28.558948] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-14T20:38:28.701378] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T20:38:29.358875] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-14T20:38:29.479756] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-14T20:38:29.485222] [INFO ] [REMOTE ] W: Full fetch complete (58213 records). [2025-09-14T20:38:29.485351] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-14T20:38:29.865036] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-14T20:38:29.865149] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-14T20:38:29.866277] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-14T20:38:29.866341] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-14T20:38:29.867607] [DEBUG] [LOCAL ] W: Trimmed 58213 records to 40310 (keeping 150 days of data) [2025-09-14T20:38:30.115524] [DEBUG] [LOCAL ] W: Primary data saved (40310 records). [2025-09-14T20:38:30.115732] [INFO ] [MAIN ] W: Full history saved. [2025-09-14T20:38:30.115858] [INFO ] [MAIN ] Update Progress: 2269/2370 symbols completed. W took 25.3s. Estimated remaining: 10m 44s. Rate: 9.4 symbols/min [2025-09-14T20:38:30.159370] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-14T20:38:30.297464] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:30.327751] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T20:38:30.352275] [DEBUG] [LOCAL ] WBS: Loaded 21930 existing records from primary storage. [2025-09-14T20:38:30.352485] [INFO ] [MAIN ] WBS: Loaded 21930 existing records. [2025-09-14T20:38:30.537613] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:30.537940] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-14T20:38:30.538076] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-14T20:38:30.538608] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-14T20:38:30.538703] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-14T20:38:30.898951] [INFO ] [REMOTE ] WBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:30.920061] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T20:38:30.956760] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T20:38:30.960921] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-14T20:38:30.962587] [INFO ] [REMOTE ] WAB: Full fetch complete (48678 records). [2025-09-14T20:38:30.962702] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-14T20:38:31.340813] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-14T20:38:31.340932] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-14T20:38:31.341946] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-14T20:38:31.342002] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-14T20:38:31.343104] [DEBUG] [LOCAL ] WAB: Trimmed 48678 records to 32859 (keeping 150 days of data) [2025-09-14T20:38:31.561989] [DEBUG] [LOCAL ] WAB: Primary data saved (32859 records). [2025-09-14T20:38:31.562179] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-14T20:38:31.562321] [INFO ] [MAIN ] Update Progress: 2270/2370 symbols completed. WAB took 25.2s. Estimated remaining: 10m 38s. Rate: 9.4 symbols/min [2025-09-14T20:38:31.732398] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:31.736873] [DEBUG] [LOCAL ] WBX: Loaded 2971 existing records from primary storage. [2025-09-14T20:38:31.736975] [INFO ] [MAIN ] WBX: Loaded 2971 existing records. [2025-09-14T20:38:31.767283] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-14T20:38:31.915972] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:31.916271] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-14T20:38:31.916358] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-14T20:38:31.916672] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-14T20:38:31.916751] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-14T20:38:32.267057] [INFO ] [REMOTE ] WBX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:32.558811] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-14T20:38:32.951635] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T20:38:33.358892] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-14T20:38:33.682932] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T20:38:34.158858] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-14T20:38:34.198276] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T20:38:34.709511] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T20:38:34.958830] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-14T20:38:35.758840] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-14T20:38:36.083581] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T20:38:36.238195] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T20:38:36.558911] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-14T20:38:37.358859] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-14T20:38:37.497049] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T20:38:37.540086] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T20:38:38.158855] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-14T20:38:38.958799] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-14T20:38:39.146656] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T20:38:39.263607] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T20:38:39.758867] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-14T20:38:40.558846] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-14T20:38:40.676281] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T20:38:41.358906] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-14T20:38:41.482542] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T20:38:41.669825] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T20:38:41.675245] [INFO ] [REMOTE ] WAL: Full fetch complete (49455 records). [2025-09-14T20:38:41.685565] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-14T20:38:41.686687] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:38:42.091393] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-14T20:38:42.091559] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-14T20:38:42.093422] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-14T20:38:42.093496] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-14T20:38:42.095053] [DEBUG] [LOCAL ] WAL: Trimmed 49455 records to 33483 (keeping 150 days of data) [2025-09-14T20:38:42.163325] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-14T20:38:42.330346] [DEBUG] [LOCAL ] WAL: Primary data saved (33483 records). [2025-09-14T20:38:42.330559] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-14T20:38:42.330689] [INFO ] [MAIN ] Update Progress: 2271/2370 symbols completed. WAL took 25.9s. Estimated remaining: 10m 32s. Rate: 9.4 symbols/min [2025-09-14T20:38:42.502594] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:42.520487] [DEBUG] [LOCAL ] WCC: Loaded 17100 existing records from primary storage. [2025-09-14T20:38:42.520726] [INFO ] [MAIN ] WCC: Loaded 17100 existing records. [2025-09-14T20:38:42.711814] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:42.712149] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-14T20:38:42.712229] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-14T20:38:42.712832] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-14T20:38:42.712927] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-14T20:38:42.967710] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-14T20:38:43.076628] [INFO ] [REMOTE ] WCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:43.699722] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T20:38:43.703588] [INFO ] [REMOTE ] WAT: Full fetch complete (38256 records). [2025-09-14T20:38:43.703721] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-14T20:38:43.767107] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-14T20:38:44.078342] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-14T20:38:44.078519] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-14T20:38:44.079511] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-14T20:38:44.079601] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-14T20:38:44.106635] [DEBUG] [LOCAL ] WAT: Trimmed 38256 records to 26456 (keeping 150 days of data) [2025-09-14T20:38:44.108788] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T20:38:44.303851] [DEBUG] [LOCAL ] WAT: Primary data saved (26456 records). [2025-09-14T20:38:44.304099] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-14T20:38:44.304243] [INFO ] [MAIN ] Update Progress: 2272/2370 symbols completed. WAT took 26.3s. Estimated remaining: 10m 25s. Rate: 9.4 symbols/min [2025-09-14T20:38:44.481884] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:44.504843] [DEBUG] [LOCAL ] WCN: Loaded 21390 existing records from primary storage. [2025-09-14T20:38:44.505046] [INFO ] [MAIN ] WCN: Loaded 21390 existing records. [2025-09-14T20:38:44.570247] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-14T20:38:44.691489] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:44.691771] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-14T20:38:44.691833] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-14T20:38:44.692562] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-14T20:38:44.692624] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-14T20:38:45.044533] [INFO ] [REMOTE ] WCN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:45.351926] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-14T20:38:45.358763] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-14T20:38:45.698192] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T20:38:46.010914] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T20:38:46.158859] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-14T20:38:46.707983] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T20:38:46.709100] [INFO ] [REMOTE ] WBX: Full fetch complete (16210 records). [2025-09-14T20:38:46.709196] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-14T20:38:46.963923] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-14T20:38:47.077047] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-14T20:38:47.077161] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-14T20:38:47.077579] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-14T20:38:47.077632] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-14T20:38:47.078187] [DEBUG] [LOCAL ] WBX: Trimmed 16210 records to 7656 (keeping 150 days of data) [2025-09-14T20:38:47.126132] [DEBUG] [LOCAL ] WBX: Primary data saved (7656 records). [2025-09-14T20:38:47.126636] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-14T20:38:47.126862] [INFO ] [MAIN ] Update Progress: 2273/2370 symbols completed. WBX took 15.6s. Estimated remaining: 10m 19s. Rate: 9.4 symbols/min [2025-09-14T20:38:47.298667] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:47.310510] [DEBUG] [LOCAL ] WD: Loaded 10414 existing records from primary storage. [2025-09-14T20:38:47.310684] [INFO ] [MAIN ] WD: Loaded 10414 existing records. [2025-09-14T20:38:47.489249] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:47.489543] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-14T20:38:47.489665] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-14T20:38:47.490093] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-14T20:38:47.490156] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-14T20:38:47.767202] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-14T20:38:47.863614] [INFO ] [REMOTE ] WD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:48.558784] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-14T20:38:49.050392] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T20:38:49.358805] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-14T20:38:49.608824] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T20:38:49.777681] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T20:38:50.158856] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-14T20:38:50.958810] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-14T20:38:51.234987] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T20:38:51.758882] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-14T20:38:51.929622] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T20:38:51.991442] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T20:38:52.558872] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-14T20:38:53.358893] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-14T20:38:53.528250] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T20:38:53.704577] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T20:38:54.158880] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-14T20:38:54.958894] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-14T20:38:55.163817] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T20:38:55.758848] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-14T20:38:55.832790] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T20:38:55.895388] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T20:38:56.558855] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-14T20:38:57.255936] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:38:57.261246] [INFO ] [REMOTE ] WBS: Full fetch complete (52476 records). [2025-09-14T20:38:57.261377] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-14T20:38:57.359874] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-14T20:38:57.642531] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-14T20:38:57.642691] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-14T20:38:57.643826] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-14T20:38:57.643969] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-14T20:38:57.645347] [DEBUG] [LOCAL ] WBS: Trimmed 52476 records to 36429 (keeping 150 days of data) [2025-09-14T20:38:57.771593] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T20:38:57.930568] [DEBUG] [LOCAL ] WBS: Primary data saved (36429 records). [2025-09-14T20:38:57.930792] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-14T20:38:57.930901] [INFO ] [MAIN ] Update Progress: 2274/2370 symbols completed. WBS took 27.8s. Estimated remaining: 10m 12s. Rate: 9.4 symbols/min [2025-09-14T20:38:58.105808] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:38:58.117394] [DEBUG] [LOCAL ] WDH: Loaded 8978 existing records from primary storage. [2025-09-14T20:38:58.117566] [INFO ] [MAIN ] WDH: Loaded 8978 existing records. [2025-09-14T20:38:58.163997] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-14T20:38:58.302032] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:38:58.302431] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-14T20:38:58.302621] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-14T20:38:58.308119] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-14T20:38:58.315270] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-14T20:38:58.348396] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T20:38:58.685595] [INFO ] [REMOTE ] WDH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:38:58.958844] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-14T20:38:59.758855] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-14T20:38:59.843374] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T20:38:59.907316] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T20:39:00.558853] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-14T20:39:01.175260] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T20:39:01.358853] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-14T20:39:02.158868] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-14T20:39:02.883157] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-14T20:39:02.958790] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-14T20:39:03.758910] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-14T20:39:04.456021] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (3.10 seconds). [2025-09-14T20:39:04.558916] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-14T20:39:05.081363] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-09-14T20:39:05.117396] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T20:39:05.119985] [INFO ] [REMOTE ] WD: Full fetch complete (25815 records). [2025-09-14T20:39:05.120112] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-14T20:39:05.372939] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-14T20:39:05.570090] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-14T20:39:05.570270] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-14T20:39:05.571037] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-14T20:39:05.571119] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-14T20:39:05.572418] [DEBUG] [LOCAL ] WD: Trimmed 25815 records to 17418 (keeping 150 days of data) [2025-09-14T20:39:05.690940] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T20:39:05.710497] [DEBUG] [LOCAL ] WD: Primary data saved (17418 records). [2025-09-14T20:39:05.710802] [INFO ] [MAIN ] WD: Full history saved. [2025-09-14T20:39:05.710945] [INFO ] [MAIN ] Update Progress: 2275/2370 symbols completed. WD took 18.6s. Estimated remaining: 10m 6s. Rate: 9.4 symbols/min [2025-09-14T20:39:05.893614] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:05.905622] [DEBUG] [LOCAL ] WDI: Loaded 9258 existing records from primary storage. [2025-09-14T20:39:05.905886] [INFO ] [MAIN ] WDI: Loaded 9258 existing records. [2025-09-14T20:39:06.095887] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:06.096317] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-14T20:39:06.096457] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-14T20:39:06.096972] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-14T20:39:06.097146] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-14T20:39:06.165185] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-14T20:39:06.361947] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (3.40 seconds). [2025-09-14T20:39:06.532031] [INFO ] [REMOTE ] WDI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:06.958883] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-14T20:39:07.151748] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T20:39:07.307690] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T20:39:07.758805] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-14T20:39:08.111484] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T20:39:08.558865] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-14T20:39:08.593692] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T20:39:09.358923] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-14T20:39:09.683004] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T20:39:10.158853] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-14T20:39:10.296375] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T20:39:10.958897] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-14T20:39:11.730972] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T20:39:11.758779] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-14T20:39:12.086365] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T20:39:12.091387] [INFO ] [REMOTE ] WCN: Full fetch complete (52286 records). [2025-09-14T20:39:12.091522] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-14T20:39:12.483472] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-14T20:39:12.483630] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-14T20:39:12.484909] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-14T20:39:12.484990] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-14T20:39:12.486541] [DEBUG] [LOCAL ] WCN: Trimmed 52286 records to 35964 (keeping 150 days of data) [2025-09-14T20:39:12.560812] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-14T20:39:12.731728] [DEBUG] [LOCAL ] WCN: Primary data saved (35964 records). [2025-09-14T20:39:12.731914] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-14T20:39:12.732025] [INFO ] [MAIN ] Update Progress: 2276/2370 symbols completed. WCN took 28.4s. Estimated remaining: 9m 60s. Rate: 9.4 symbols/min [2025-09-14T20:39:12.916897] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:12.932841] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T20:39:12.953401] [DEBUG] [LOCAL ] WDS: Loaded 18706 existing records from primary storage. [2025-09-14T20:39:12.953568] [INFO ] [MAIN ] WDS: Loaded 18706 existing records. [2025-09-14T20:39:13.128326] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:13.128630] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-14T20:39:13.128735] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-14T20:39:13.129179] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-14T20:39:13.129238] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-14T20:39:13.364074] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-14T20:39:13.503704] [INFO ] [REMOTE ] WDS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:14.072794] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T20:39:14.158838] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-14T20:39:14.669602] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T20:39:14.958925] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-14T20:39:15.758889] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-14T20:39:15.859737] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T20:39:16.093300] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:39:16.522940] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T20:39:16.558817] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-14T20:39:17.358910] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-14T20:39:17.795378] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-14T20:39:17.799388] [INFO ] [REMOTE ] WDH: Full fetch complete (16869 records). [2025-09-14T20:39:17.799560] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-14T20:39:18.168174] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-14T20:39:18.178437] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-14T20:39:18.179606] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-14T20:39:18.180134] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-14T20:39:18.180205] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-14T20:39:18.181200] [DEBUG] [LOCAL ] WDH: Trimmed 16869 records to 11802 (keeping 150 days of data) [2025-09-14T20:39:18.254878] [DEBUG] [LOCAL ] WDH: Primary data saved (11802 records). [2025-09-14T20:39:18.255091] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-14T20:39:18.255216] [INFO ] [MAIN ] Update Progress: 2277/2370 symbols completed. WDH took 20.3s. Estimated remaining: 9m 53s. Rate: 9.4 symbols/min [2025-09-14T20:39:18.958865] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-14T20:39:19.463900] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T20:39:19.758859] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-14T20:39:20.416632] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T20:39:20.420875] [INFO ] [REMOTE ] WCC: Full fetch complete (43951 records). [2025-09-14T20:39:20.421026] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-14T20:39:20.809944] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-14T20:39:20.823264] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-14T20:39:20.824880] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-14T20:39:20.825728] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-14T20:39:20.825575] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T20:39:20.832076] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-14T20:39:20.833334] [DEBUG] [LOCAL ] WCC: Trimmed 43951 records to 29398 (keeping 150 days of data) [2025-09-14T20:39:21.062510] [DEBUG] [LOCAL ] WCC: Primary data saved (29398 records). [2025-09-14T20:39:21.062800] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-14T20:39:21.063017] [INFO ] [MAIN ] Update Progress: 2278/2370 symbols completed. WCC took 38.7s. Estimated remaining: 9m 47s. Rate: 9.4 symbols/min [2025-09-14T20:39:21.231260] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (3.06 seconds). [2025-09-14T20:39:21.359096] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-14T20:39:22.024981] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T20:39:22.158919] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-14T20:39:23.076021] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:39:23.087149] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-14T20:39:23.160758] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T20:39:23.163004] [INFO ] [REMOTE ] WDI: Full fetch complete (22904 records). [2025-09-14T20:39:23.163091] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-14T20:39:23.525072] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-14T20:39:23.525179] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-14T20:39:23.525750] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-14T20:39:23.525813] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-14T20:39:23.526565] [DEBUG] [LOCAL ] WDI: Trimmed 22904 records to 15725 (keeping 150 days of data) [2025-09-14T20:39:23.639363] [DEBUG] [LOCAL ] WDI: Primary data saved (15725 records). [2025-09-14T20:39:23.639616] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-14T20:39:23.639800] [INFO ] [MAIN ] Update Progress: 2279/2370 symbols completed. WDI took 17.9s. Estimated remaining: 9m 40s. Rate: 9.4 symbols/min [2025-09-14T20:39:24.903047] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T20:39:24.913944] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-14T20:39:26.622554] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T20:39:26.632337] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-14T20:39:28.268252] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T20:39:28.278408] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-14T20:39:29.991896] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T20:39:30.001403] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-14T20:39:31.811599] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T20:39:31.821940] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-14T20:39:33.226219] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T20:39:33.230514] [INFO ] [REMOTE ] WDS: Full fetch complete (47924 records). [2025-09-14T20:39:33.230633] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-14T20:39:33.609601] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-14T20:39:33.609787] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-14T20:39:33.610844] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-14T20:39:33.610926] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-14T20:39:33.612573] [DEBUG] [LOCAL ] WDS: Trimmed 47924 records to 32037 (keeping 150 days of data) [2025-09-14T20:39:33.813858] [DEBUG] [LOCAL ] WDS: Primary data saved (32037 records). [2025-09-14T20:39:33.814047] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-14T20:39:33.814167] [INFO ] [MAIN ] Update Progress: 2280/2370 symbols completed. WDS took 21.1s. Estimated remaining: 9m 34s. Rate: 9.4 symbols/min [2025-09-14T20:39:34.512468] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:34.517596] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:34.538180] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:34.519079] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:34.547711] [DEBUG] [LOCAL ] WEA: Loaded 3944 existing records from primary storage. [2025-09-14T20:39:34.548862] [INFO ] [MAIN ] WEA: Loaded 3944 existing records. [2025-09-14T20:39:34.683024] [DEBUG] [LOCAL ] WEAV: Loaded 18922 existing records from primary storage. [2025-09-14T20:39:34.742679] [DEBUG] [LOCAL ] WEC: Loaded 23405 existing records from primary storage. [2025-09-14T20:39:34.768335] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:34.742776] [INFO ] [MAIN ] WEAV: Loaded 18922 existing records. [2025-09-14T20:39:34.774420] [INFO ] [MAIN ] WEC: Loaded 23405 existing records. [2025-09-14T20:39:34.876029] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-14T20:39:34.928402] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-14T20:39:34.917920] [DEBUG] [LOCAL ] WELL: Loaded 23292 existing records from primary storage. [2025-09-14T20:39:34.991503] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-14T20:39:34.986217] [INFO ] [MAIN ] WELL: Loaded 23292 existing records. [2025-09-14T20:39:34.997107] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-14T20:39:35.337721] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:35.398398] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-14T20:39:35.456794] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:35.515465] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-14T20:39:35.556936] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-14T20:39:35.571804] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:35.596400] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-14T20:39:35.596757] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-14T20:39:35.606111] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-14T20:39:35.606307] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-14T20:39:35.596592] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-14T20:39:35.659368] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-14T20:39:35.622561] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-14T20:39:35.659512] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-14T20:39:35.713169] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-14T20:39:36.091789] [INFO ] [REMOTE ] WEA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:36.117869] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-14T20:39:36.800531] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:36.866082] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-14T20:39:36.944180] [INFO ] [REMOTE ] WELL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:36.965691] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-14T20:39:36.964985] [INFO ] [REMOTE ] WEC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:36.967606] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-14T20:39:37.350194] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T20:39:37.351967] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-14T20:39:38.036387] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T20:39:38.038361] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-14T20:39:38.622008] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T20:39:38.636123] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-14T20:39:38.652624] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T20:39:38.654957] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-14T20:39:38.748894] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T20:39:38.759588] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-14T20:39:38.834021] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T20:39:38.842842] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-14T20:39:39.482510] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T20:39:39.485380] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-14T20:39:40.277054] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T20:39:40.280813] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-14T20:39:40.366905] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T20:39:40.378327] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-14T20:39:40.528723] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T20:39:40.539530] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-14T20:39:40.804925] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-14T20:39:40.816172] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-14T20:39:40.862968] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T20:39:40.866150] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-14T20:39:41.588303] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T20:39:41.590756] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-14T20:39:41.849442] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T20:39:41.858585] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-14T20:39:42.466125] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T20:39:42.467561] [INFO ] [REMOTE ] WEA: Full fetch complete (7696 records). [2025-09-14T20:39:42.467667] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-14T20:39:42.743273] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-14T20:39:42.796004] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-14T20:39:42.909853] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-14T20:39:42.910089] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-14T20:39:42.910578] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-14T20:39:42.910693] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-14T20:39:42.911627] [DEBUG] [LOCAL ] WEA: Trimmed 7696 records to 6074 (keeping 150 days of data) [2025-09-14T20:39:42.993181] [DEBUG] [LOCAL ] WEA: Primary data saved (6074 records). [2025-09-14T20:39:42.997066] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-14T20:39:42.996895] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-14T20:39:42.997387] [INFO ] [MAIN ] Update Progress: 2281/2370 symbols completed. WEA took 9.2s. Estimated remaining: 9m 28s. Rate: 9.4 symbols/min [2025-09-14T20:39:43.063934] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-14T20:39:43.201932] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:43.237084] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T20:39:43.264805] [DEBUG] [LOCAL ] WES: Loaded 21501 existing records from primary storage. [2025-09-14T20:39:43.265046] [INFO ] [MAIN ] WES: Loaded 21501 existing records. [2025-09-14T20:39:43.452106] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:43.452449] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-14T20:39:43.452515] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-14T20:39:43.453104] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-14T20:39:43.453175] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-14T20:39:43.764087] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-14T20:39:43.834974] [INFO ] [REMOTE ] WES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:44.558834] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-14T20:39:44.773381] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T20:39:44.973516] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T20:39:45.364336] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-14T20:39:45.381183] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T20:39:46.158845] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-14T20:39:46.427230] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T20:39:46.958858] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-14T20:39:47.255097] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T20:39:47.330313] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T20:39:47.758825] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-14T20:39:48.558878] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-14T20:39:48.681534] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:39:49.358820] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-14T20:39:49.784666] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T20:39:50.158863] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-14T20:39:50.224004] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T20:39:50.831909] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T20:39:50.958894] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-14T20:39:51.746744] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T20:39:51.762672] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-14T20:39:52.548435] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T20:39:52.559036] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-14T20:39:53.088149] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T20:39:53.092785] [INFO ] [REMOTE ] WEAV: Full fetch complete (45920 records). [2025-09-14T20:39:53.092944] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-14T20:39:53.363928] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-14T20:39:53.530114] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-14T20:39:53.530351] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-14T20:39:53.532134] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-14T20:39:53.546630] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-14T20:39:53.547886] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T20:39:53.554553] [INFO ] [REMOTE ] WEC: Full fetch complete (56881 records). [2025-09-14T20:39:53.554837] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-14T20:39:53.587992] [DEBUG] [LOCAL ] WEAV: Trimmed 45920 records to 31291 (keeping 150 days of data) [2025-09-14T20:39:54.065713] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-14T20:39:54.066486] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-14T20:39:54.067780] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-14T20:39:54.068278] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-14T20:39:54.077804] [DEBUG] [LOCAL ] WEC: Trimmed 56881 records to 39283 (keeping 150 days of data) [2025-09-14T20:39:54.187439] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-14T20:39:54.281667] [DEBUG] [LOCAL ] WEAV: Primary data saved (31291 records). [2025-09-14T20:39:54.282752] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-14T20:39:54.283577] [INFO ] [MAIN ] Update Progress: 2282/2370 symbols completed. WEAV took 20.5s. Estimated remaining: 9m 22s. Rate: 9.4 symbols/min [2025-09-14T20:39:54.475767] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:54.494445] [DEBUG] [LOCAL ] WEX: Loaded 13881 existing records from primary storage. [2025-09-14T20:39:54.495630] [INFO ] [MAIN ] WEX: Loaded 13881 existing records. [2025-09-14T20:39:54.794300] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:54.794916] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-14T20:39:54.795257] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-14T20:39:54.796681] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-14T20:39:54.796777] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-14T20:39:55.228466] [INFO ] [REMOTE ] WEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:55.229340] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-14T20:39:55.248701] [DEBUG] [LOCAL ] WEC: Primary data saved (39283 records). [2025-09-14T20:39:55.248856] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-14T20:39:55.248996] [INFO ] [MAIN ] Update Progress: 2283/2370 symbols completed. WEC took 21.4s. Estimated remaining: 9m 15s. Rate: 9.4 symbols/min [2025-09-14T20:39:55.425899] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:39:55.461589] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T20:39:55.464869] [DEBUG] [LOCAL ] WF: Loaded 4999 existing records from primary storage. [2025-09-14T20:39:55.475910] [INFO ] [MAIN ] WF: Loaded 4999 existing records. [2025-09-14T20:39:55.659188] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:39:55.659766] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-14T20:39:55.659843] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-14T20:39:55.660196] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-14T20:39:55.660305] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-14T20:39:55.759983] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-14T20:39:56.001844] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T20:39:56.065033] [INFO ] [REMOTE ] WF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:39:56.558850] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-14T20:39:57.001141] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T20:39:57.358303] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T20:39:57.368206] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-14T20:39:57.696066] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T20:39:58.158882] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-14T20:39:58.958853] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-14T20:39:59.033594] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T20:39:59.155786] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T20:39:59.758843] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-14T20:40:00.558821] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-14T20:40:00.645252] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T20:40:00.835310] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T20:40:01.358842] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-14T20:40:02.163906] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-14T20:40:02.178508] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T20:40:02.958893] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-14T20:40:03.174926] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T20:40:03.528087] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T20:40:03.758915] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-14T20:40:04.254132] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T20:40:04.558889] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-14T20:40:05.267009] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:40:05.273124] [INFO ] [REMOTE ] WELL: Full fetch complete (56957 records). [2025-09-14T20:40:05.273344] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-14T20:40:05.364020] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-14T20:40:05.735469] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-14T20:40:05.735695] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-14T20:40:05.737491] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-14T20:40:05.737624] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-14T20:40:05.776232] [DEBUG] [LOCAL ] WELL: Trimmed 56957 records to 39252 (keeping 150 days of data) [2025-09-14T20:40:05.779914] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T20:40:06.055024] [DEBUG] [LOCAL ] WELL: Primary data saved (39252 records). [2025-09-14T20:40:06.055240] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-14T20:40:06.055379] [INFO ] [MAIN ] Update Progress: 2284/2370 symbols completed. WELL took 32.2s. Estimated remaining: 9m 9s. Rate: 9.4 symbols/min [2025-09-14T20:40:06.163994] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-14T20:40:06.229342] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:06.253798] [DEBUG] [LOCAL ] WFC: Loaded 24110 existing records from primary storage. [2025-09-14T20:40:06.253998] [INFO ] [MAIN ] WFC: Loaded 24110 existing records. [2025-09-14T20:40:06.435823] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:06.436133] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-14T20:40:06.436200] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-14T20:40:06.436910] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-14T20:40:06.436977] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-14T20:40:06.799315] [INFO ] [REMOTE ] WFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:06.958901] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-14T20:40:07.059352] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T20:40:07.174740] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T20:40:07.496671] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T20:40:07.758844] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-14T20:40:08.439021] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T20:40:08.558867] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-14T20:40:09.358864] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-14T20:40:09.681228] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T20:40:10.158873] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-14T20:40:10.260461] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T20:40:10.958842] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-14T20:40:11.727319] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T20:40:11.736949] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T20:40:11.739061] [INFO ] [REMOTE ] WES: Full fetch complete (52258 records). [2025-09-14T20:40:11.739431] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-14T20:40:11.763886] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-14T20:40:12.124950] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-14T20:40:12.125066] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-14T20:40:12.126307] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-14T20:40:12.126387] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-14T20:40:12.127697] [DEBUG] [LOCAL ] WES: Trimmed 52258 records to 36046 (keeping 150 days of data) [2025-09-14T20:40:12.371839] [DEBUG] [LOCAL ] WES: Primary data saved (36046 records). [2025-09-14T20:40:12.372036] [INFO ] [MAIN ] WES: Full history saved. [2025-09-14T20:40:12.372161] [INFO ] [MAIN ] Update Progress: 2285/2370 symbols completed. WES took 29.4s. Estimated remaining: 9m 2s. Rate: 9.4 symbols/min [2025-09-14T20:40:12.542971] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:12.555628] [DEBUG] [LOCAL ] WFG: Loaded 11453 existing records from primary storage. [2025-09-14T20:40:12.555832] [INFO ] [MAIN ] WFG: Loaded 11453 existing records. [2025-09-14T20:40:12.567236] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-14T20:40:12.744965] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:12.745520] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-14T20:40:12.745591] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-14T20:40:12.746365] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-14T20:40:12.746708] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-14T20:40:13.098300] [INFO ] [REMOTE ] WFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:13.309074] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T20:40:13.358804] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-14T20:40:13.562768] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T20:40:14.158932] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-14T20:40:14.868588] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T20:40:14.958925] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-14T20:40:14.970681] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T20:40:14.974129] [INFO ] [REMOTE ] WF: Full fetch complete (12267 records). [2025-09-14T20:40:14.974442] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-14T20:40:15.402257] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-14T20:40:15.402408] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-14T20:40:15.402871] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-14T20:40:15.402953] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-14T20:40:15.403810] [DEBUG] [LOCAL ] WF: Trimmed 12267 records to 8185 (keeping 150 days of data) [2025-09-14T20:40:15.459356] [DEBUG] [LOCAL ] WF: Primary data saved (8185 records). [2025-09-14T20:40:15.459574] [INFO ] [MAIN ] WF: Full history saved. [2025-09-14T20:40:15.459718] [INFO ] [MAIN ] Update Progress: 2286/2370 symbols completed. WF took 20.2s. Estimated remaining: 8m 56s. Rate: 9.4 symbols/min [2025-09-14T20:40:15.639065] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:15.659992] [DEBUG] [LOCAL ] WGO: Loaded 17096 existing records from primary storage. [2025-09-14T20:40:15.660182] [INFO ] [MAIN ] WGO: Loaded 17096 existing records. [2025-09-14T20:40:15.769182] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-14T20:40:15.865875] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:15.866967] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-14T20:40:15.867036] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-14T20:40:15.867541] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-14T20:40:15.867614] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-14T20:40:16.234007] [INFO ] [REMOTE ] WGO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:16.263473] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T20:40:16.404075] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T20:40:16.407501] [INFO ] [REMOTE ] WEX: Full fetch complete (39404 records). [2025-09-14T20:40:16.407618] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-14T20:40:16.568041] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-14T20:40:16.784513] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-14T20:40:16.784629] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-14T20:40:16.785461] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-14T20:40:16.785517] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-14T20:40:16.786543] [DEBUG] [LOCAL ] WEX: Trimmed 39404 records to 24622 (keeping 150 days of data) [2025-09-14T20:40:16.937775] [DEBUG] [LOCAL ] WEX: Primary data saved (24622 records). [2025-09-14T20:40:16.937966] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-14T20:40:16.938097] [INFO ] [MAIN ] Update Progress: 2287/2370 symbols completed. WEX took 22.7s. Estimated remaining: 8m 49s. Rate: 9.4 symbols/min [2025-09-14T20:40:17.121139] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:17.143090] [DEBUG] [LOCAL ] WH: Loaded 20395 existing records from primary storage. [2025-09-14T20:40:17.143309] [INFO ] [MAIN ] WH: Loaded 20395 existing records. [2025-09-14T20:40:17.324013] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:17.324298] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-14T20:40:17.324361] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-14T20:40:17.324910] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-14T20:40:17.324974] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-14T20:40:17.367123] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-14T20:40:17.682939] [INFO ] [REMOTE ] WH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:18.158956] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-14T20:40:18.292211] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T20:40:18.476090] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T20:40:18.958864] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-14T20:40:19.268447] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T20:40:19.758846] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-14T20:40:20.360096] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T20:40:20.433130] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T20:40:20.558815] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-14T20:40:21.358866] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-14T20:40:21.980464] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T20:40:22.158823] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-14T20:40:22.958870] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-14T20:40:23.143429] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T20:40:23.360029] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T20:40:23.559615] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T20:40:23.758862] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-14T20:40:24.558892] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-14T20:40:24.910710] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T20:40:25.358869] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-14T20:40:26.158898] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-14T20:40:26.388704] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T20:40:26.465707] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T20:40:26.471830] [INFO ] [REMOTE ] WFC: Full fetch complete (58428 records). [2025-09-14T20:40:26.472078] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-14T20:40:26.862331] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-14T20:40:26.862444] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-14T20:40:26.863565] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-14T20:40:26.863626] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-14T20:40:26.864925] [DEBUG] [LOCAL ] WFC: Trimmed 58428 records to 40488 (keeping 150 days of data) [2025-09-14T20:40:26.964782] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-14T20:40:27.029106] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T20:40:27.201316] [DEBUG] [LOCAL ] WFC: Primary data saved (40488 records). [2025-09-14T20:40:27.201526] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-14T20:40:27.201673] [INFO ] [MAIN ] Update Progress: 2288/2370 symbols completed. WFC took 21.1s. Estimated remaining: 8m 43s. Rate: 9.4 symbols/min [2025-09-14T20:40:27.380525] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:27.400532] [DEBUG] [LOCAL ] WHD: Loaded 17217 existing records from primary storage. [2025-09-14T20:40:27.400816] [INFO ] [MAIN ] WHD: Loaded 17217 existing records. [2025-09-14T20:40:27.591362] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:27.591740] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-14T20:40:27.591818] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-14T20:40:27.592340] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-14T20:40:27.592411] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-14T20:40:27.767197] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-14T20:40:27.967810] [INFO ] [REMOTE ] WHD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:27.984742] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T20:40:28.558901] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-14T20:40:29.358868] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-14T20:40:29.595445] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T20:40:30.067450] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T20:40:30.158868] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-14T20:40:30.459841] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T20:40:30.958855] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-14T20:40:31.758897] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-14T20:40:31.866574] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T20:40:31.918100] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T20:40:32.558895] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-14T20:40:33.358821] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-14T20:40:33.399811] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T20:40:33.593696] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T20:40:33.596735] [INFO ] [REMOTE ] WFG: Full fetch complete (27409 records). [2025-09-14T20:40:33.596854] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-14T20:40:33.964623] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-14T20:40:33.964791] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-14T20:40:33.965498] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-14T20:40:33.965570] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-14T20:40:33.966415] [DEBUG] [LOCAL ] WFG: Trimmed 27409 records to 18099 (keeping 150 days of data) [2025-09-14T20:40:34.082422] [DEBUG] [LOCAL ] WFG: Primary data saved (18099 records). [2025-09-14T20:40:34.082633] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-14T20:40:34.082775] [INFO ] [MAIN ] Update Progress: 2289/2370 symbols completed. WFG took 21.7s. Estimated remaining: 8m 37s. Rate: 9.4 symbols/min [2025-09-14T20:40:34.163977] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-14T20:40:34.255174] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:34.258464] [DEBUG] [LOCAL ] WHG: Loaded 1520 existing records from primary storage. [2025-09-14T20:40:34.258565] [INFO ] [MAIN ] WHG: Loaded 1520 existing records. [2025-09-14T20:40:34.432428] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:34.432760] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-14T20:40:34.432828] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-14T20:40:34.433038] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-14T20:40:34.433094] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-14T20:40:34.791250] [INFO ] [REMOTE ] WHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:34.857411] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T20:40:34.958836] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-14T20:40:35.758831] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-14T20:40:35.912674] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T20:40:36.558912] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-14T20:40:36.690772] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T20:40:37.363964] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-14T20:40:37.382975] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T20:40:38.158840] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-14T20:40:38.226462] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T20:40:38.958856] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-14T20:40:39.025244] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:40:39.700283] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T20:40:39.758804] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-14T20:40:40.432432] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:40:40.436376] [INFO ] [REMOTE ] WGO: Full fetch complete (42972 records). [2025-09-14T20:40:40.436498] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-14T20:40:40.561840] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-14T20:40:40.829243] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-14T20:40:40.829454] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-14T20:40:40.830487] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-14T20:40:40.830660] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-14T20:40:40.854508] [DEBUG] [LOCAL ] WGO: Trimmed 42972 records to 28363 (keeping 150 days of data) [2025-09-14T20:40:40.855706] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T20:40:41.045088] [DEBUG] [LOCAL ] WGO: Primary data saved (28363 records). [2025-09-14T20:40:41.045276] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-14T20:40:41.045384] [INFO ] [MAIN ] Update Progress: 2290/2370 symbols completed. WGO took 25.6s. Estimated remaining: 8m 30s. Rate: 9.4 symbols/min [2025-09-14T20:40:41.213991] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:41.235511] [DEBUG] [LOCAL ] WHR: Loaded 21846 existing records from primary storage. [2025-09-14T20:40:41.235707] [INFO ] [MAIN ] WHR: Loaded 21846 existing records. [2025-09-14T20:40:41.364016] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-14T20:40:41.421033] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:41.422145] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-14T20:40:41.422208] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-14T20:40:41.422859] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-14T20:40:41.422924] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-14T20:40:41.780083] [INFO ] [REMOTE ] WHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:42.191364] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-14T20:40:42.208835] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T20:40:42.229743] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T20:40:42.234875] [INFO ] [REMOTE ] WH: Full fetch complete (50079 records). [2025-09-14T20:40:42.235105] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-14T20:40:42.628349] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-14T20:40:42.628549] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-14T20:40:42.630456] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-14T20:40:42.630532] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-14T20:40:42.632183] [DEBUG] [LOCAL ] WH: Trimmed 50079 records to 34303 (keeping 150 days of data) [2025-09-14T20:40:42.857876] [DEBUG] [LOCAL ] WH: Primary data saved (34303 records). [2025-09-14T20:40:42.858067] [INFO ] [MAIN ] WH: Full history saved. [2025-09-14T20:40:42.858209] [INFO ] [MAIN ] Update Progress: 2291/2370 symbols completed. WH took 25.9s. Estimated remaining: 8m 24s. Rate: 9.4 symbols/min [2025-09-14T20:40:42.959348] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-14T20:40:43.031564] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:43.037720] [DEBUG] [LOCAL ] WIA: Loaded 2362 existing records from primary storage. [2025-09-14T20:40:43.037990] [INFO ] [MAIN ] WIA: Loaded 2362 existing records. [2025-09-14T20:40:43.132833] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T20:40:43.244815] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:43.245181] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-14T20:40:43.245254] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-14T20:40:43.245562] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-14T20:40:43.245631] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-14T20:40:43.620684] [INFO ] [REMOTE ] WIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:43.758857] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-14T20:40:44.558814] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-14T20:40:44.614416] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T20:40:44.644528] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T20:40:45.227002] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T20:40:45.358834] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-14T20:40:46.012015] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T20:40:46.158835] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-14T20:40:46.787089] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T20:40:46.958832] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-14T20:40:47.758935] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-14T20:40:48.558856] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-14T20:40:49.027783] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T20:40:49.234731] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T20:40:49.358839] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-14T20:40:49.423215] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T20:40:50.068830] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T20:40:50.158845] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-14T20:40:50.707327] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T20:40:50.958900] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-14T20:40:51.758914] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-14T20:40:52.425233] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T20:40:52.558902] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-14T20:40:52.803579] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T20:40:53.237514] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:40:53.241893] [INFO ] [REMOTE ] WHD: Full fetch complete (43943 records). [2025-09-14T20:40:53.242017] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-14T20:40:53.364076] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-14T20:40:53.648878] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-14T20:40:53.649240] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-14T20:40:53.650481] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-14T20:40:53.650544] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-14T20:40:53.652045] [DEBUG] [LOCAL ] WHD: Trimmed 43943 records to 29778 (keeping 150 days of data) [2025-09-14T20:40:53.854089] [DEBUG] [LOCAL ] WHD: Primary data saved (29778 records). [2025-09-14T20:40:53.854271] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-14T20:40:53.854375] [INFO ] [MAIN ] Update Progress: 2292/2370 symbols completed. WHD took 26.7s. Estimated remaining: 8m 18s. Rate: 9.4 symbols/min [2025-09-14T20:40:54.024482] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:40:54.031481] [DEBUG] [LOCAL ] WINN: Loaded 4698 existing records from primary storage. [2025-09-14T20:40:54.031617] [INFO ] [MAIN ] WINN: Loaded 4698 existing records. [2025-09-14T20:40:54.173151] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-14T20:40:54.217437] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:40:54.218020] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-14T20:40:54.218084] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-14T20:40:54.218459] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-14T20:40:54.218520] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-14T20:40:54.573897] [INFO ] [REMOTE ] WINN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:40:54.941456] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T20:40:54.958777] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-14T20:40:55.367196] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T20:40:55.580052] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T20:40:55.758885] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-14T20:40:56.558847] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-14T20:40:57.225585] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T20:40:57.358829] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-14T20:40:57.673209] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T20:40:58.041305] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T20:40:58.158892] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-14T20:40:58.701661] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-14T20:40:58.958853] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-14T20:40:59.758879] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-14T20:41:00.558810] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-14T20:41:00.715813] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T20:41:00.760141] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T20:41:01.358888] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-14T20:41:01.473713] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T20:41:01.475070] [INFO ] [REMOTE ] WIA: Full fetch complete (5191 records). [2025-09-14T20:41:01.475165] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-14T20:41:01.845386] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-14T20:41:01.845509] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-14T20:41:01.845736] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-14T20:41:01.845807] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-14T20:41:01.846244] [DEBUG] [LOCAL ] WIA: Trimmed 5191 records to 3550 (keeping 150 days of data) [2025-09-14T20:41:01.868882] [DEBUG] [LOCAL ] WIA: Primary data saved (3550 records). [2025-09-14T20:41:01.868982] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-14T20:41:01.869087] [INFO ] [MAIN ] Update Progress: 2293/2370 symbols completed. WIA took 19.0s. Estimated remaining: 8m 11s. Rate: 9.4 symbols/min [2025-09-14T20:41:02.037039] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:02.062446] [DEBUG] [LOCAL ] WIT: Loaded 23694 existing records from primary storage. [2025-09-14T20:41:02.062659] [INFO ] [MAIN ] WIT: Loaded 23694 existing records. [2025-09-14T20:41:02.162977] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-14T20:41:02.240279] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:02.240537] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-14T20:41:02.240598] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-14T20:41:02.241208] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-14T20:41:02.241273] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-14T20:41:02.525608] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T20:41:02.604079] [INFO ] [REMOTE ] WIT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:02.958883] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-14T20:41:03.758810] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-14T20:41:04.220286] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T20:41:04.222504] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T20:41:04.234701] [INFO ] [REMOTE ] WHG: Full fetch complete (3741 records). [2025-09-14T20:41:04.235334] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-14T20:41:04.567813] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-14T20:41:04.596492] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-14T20:41:04.596569] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-14T20:41:04.596712] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-14T20:41:04.596764] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-14T20:41:04.597159] [DEBUG] [LOCAL ] WHG: Trimmed 3741 records to 2644 (keeping 150 days of data) [2025-09-14T20:41:04.614160] [DEBUG] [LOCAL ] WHG: Primary data saved (2644 records). [2025-09-14T20:41:04.614315] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-14T20:41:04.614420] [INFO ] [MAIN ] Update Progress: 2294/2370 symbols completed. WHG took 30.5s. Estimated remaining: 8m 5s. Rate: 9.4 symbols/min [2025-09-14T20:41:04.790397] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:04.825042] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T20:41:04.829965] [DEBUG] [LOCAL ] WIW: Loaded 9560 existing records from primary storage. [2025-09-14T20:41:04.839748] [INFO ] [MAIN ] WIW: Loaded 9560 existing records. [2025-09-14T20:41:05.017463] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:05.017807] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-14T20:41:05.017901] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-14T20:41:05.018200] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-14T20:41:05.018258] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-14T20:41:05.365808] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-14T20:41:05.396572] [INFO ] [REMOTE ] WIW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:06.158905] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-14T20:41:06.499508] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T20:41:06.611430] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T20:41:06.958921] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-14T20:41:07.506868] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T20:41:07.594008] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T20:41:07.603146] [INFO ] [REMOTE ] WHR: Full fetch complete (52085 records). [2025-09-14T20:41:07.603395] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-14T20:41:07.767980] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-14T20:41:07.992799] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-14T20:41:07.992925] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-14T20:41:07.994139] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-14T20:41:07.994221] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-14T20:41:07.995476] [DEBUG] [LOCAL ] WHR: Trimmed 52085 records to 36666 (keeping 150 days of data) [2025-09-14T20:41:08.255761] [DEBUG] [LOCAL ] WHR: Primary data saved (36666 records). [2025-09-14T20:41:08.255984] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-14T20:41:08.256127] [INFO ] [MAIN ] Update Progress: 2295/2370 symbols completed. WHR took 27.2s. Estimated remaining: 7m 58s. Rate: 9.4 symbols/min [2025-09-14T20:41:08.448744] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:08.467660] [DEBUG] [LOCAL ] WK: Loaded 16635 existing records from primary storage. [2025-09-14T20:41:08.467908] [INFO ] [MAIN ] WK: Loaded 16635 existing records. [2025-09-14T20:41:08.564073] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-14T20:41:08.671622] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:08.672043] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-14T20:41:08.672166] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-14T20:41:08.680576] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-14T20:41:08.680988] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T20:41:08.684061] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-14T20:41:09.056730] [INFO ] [REMOTE ] WK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:09.358866] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-14T20:41:09.760819] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T20:41:10.158872] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-14T20:41:10.849840] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T20:41:10.958880] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-14T20:41:11.039521] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T20:41:11.758906] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-14T20:41:12.558835] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-14T20:41:12.638128] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T20:41:12.752402] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T20:41:13.358830] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-14T20:41:13.694768] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T20:41:14.158903] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-14T20:41:14.898436] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T20:41:14.958921] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-14T20:41:15.720479] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T20:41:15.758798] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-14T20:41:16.491667] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T20:41:16.558800] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-14T20:41:17.358822] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-14T20:41:17.437925] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T20:41:17.789729] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T20:41:18.158861] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-14T20:41:18.398026] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T20:41:18.958939] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-14T20:41:18.998403] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T20:41:19.758897] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-14T20:41:20.157676] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T20:41:20.484871] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T20:41:20.486549] [INFO ] [REMOTE ] WINN: Full fetch complete (13118 records). [2025-09-14T20:41:20.486640] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-14T20:41:20.564049] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-14T20:41:20.915558] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-14T20:41:20.915741] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-14T20:41:20.916247] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-14T20:41:20.916325] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-14T20:41:20.917064] [DEBUG] [LOCAL ] WINN: Trimmed 13118 records to 8241 (keeping 150 days of data) [2025-09-14T20:41:20.981337] [DEBUG] [LOCAL ] WINN: Primary data saved (8241 records). [2025-09-14T20:41:20.981599] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-14T20:41:20.981800] [INFO ] [MAIN ] Update Progress: 2296/2370 symbols completed. WINN took 27.1s. Estimated remaining: 7m 52s. Rate: 9.4 symbols/min [2025-09-14T20:41:21.164508] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:21.183523] [DEBUG] [LOCAL ] WKC: Loaded 15482 existing records from primary storage. [2025-09-14T20:41:21.183773] [INFO ] [MAIN ] WKC: Loaded 15482 existing records. [2025-09-14T20:41:21.367840] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:21.367539] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-14T20:41:21.368323] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-14T20:41:21.368793] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-14T20:41:21.370141] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-14T20:41:21.370221] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-14T20:41:21.793935] [INFO ] [REMOTE ] WKC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:21.853033] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T20:41:22.158911] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-14T20:41:22.881131] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T20:41:22.958860] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-14T20:41:23.323191] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T20:41:23.758856] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-14T20:41:24.521597] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T20:41:24.558784] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-14T20:41:24.779273] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T20:41:24.782167] [INFO ] [REMOTE ] WIW: Full fetch complete (22283 records). [2025-09-14T20:41:24.782283] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-14T20:41:25.163741] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-14T20:41:25.163867] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-14T20:41:25.164395] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-14T20:41:25.164457] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-14T20:41:25.165400] [DEBUG] [LOCAL ] WIW: Trimmed 22283 records to 15541 (keeping 150 days of data) [2025-09-14T20:41:25.264872] [DEBUG] [LOCAL ] WIW: Primary data saved (15541 records). [2025-09-14T20:41:25.265081] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-14T20:41:25.265202] [INFO ] [MAIN ] Update Progress: 2297/2370 symbols completed. WIW took 20.7s. Estimated remaining: 7m 46s. Rate: 9.4 symbols/min [2025-09-14T20:41:25.363969] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-14T20:41:25.442872] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:25.464195] [DEBUG] [LOCAL ] WLK: Loaded 20675 existing records from primary storage. [2025-09-14T20:41:25.464420] [INFO ] [MAIN ] WLK: Loaded 20675 existing records. [2025-09-14T20:41:25.675378] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:25.675772] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-14T20:41:25.675866] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-14T20:41:25.676421] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-14T20:41:25.676492] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-14T20:41:26.124038] [INFO ] [REMOTE ] WLK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:26.142082] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T20:41:26.151706] [INFO ] [REMOTE ] WK: Full fetch complete (39613 records). [2025-09-14T20:41:26.151996] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-14T20:41:26.171443] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-14T20:41:26.723293] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-14T20:41:26.723489] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-14T20:41:26.725635] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-14T20:41:26.725792] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-14T20:41:26.728603] [DEBUG] [LOCAL ] WK: Trimmed 39613 records to 26892 (keeping 150 days of data) [2025-09-14T20:41:26.959810] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-14T20:41:26.976582] [DEBUG] [LOCAL ] WK: Primary data saved (26892 records). [2025-09-14T20:41:26.976821] [INFO ] [MAIN ] WK: Full history saved. [2025-09-14T20:41:26.976958] [INFO ] [MAIN ] Update Progress: 2298/2370 symbols completed. WK took 18.7s. Estimated remaining: 7m 39s. Rate: 9.4 symbols/min [2025-09-14T20:41:27.155975] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:27.161315] [DEBUG] [LOCAL ] WLKP: Loaded 3099 existing records from primary storage. [2025-09-14T20:41:27.161479] [INFO ] [MAIN ] WLKP: Loaded 3099 existing records. [2025-09-14T20:41:27.345939] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:27.346303] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-14T20:41:27.346551] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-14T20:41:27.346887] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-14T20:41:27.347007] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-14T20:41:27.492584] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-14T20:41:27.763949] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-14T20:41:27.768470] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:28.091935] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T20:41:28.461535] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T20:41:28.558867] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-14T20:41:29.358868] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-14T20:41:29.540551] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T20:41:29.994814] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T20:41:30.158842] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-14T20:41:30.958902] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-14T20:41:31.079869] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:41:31.758885] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-14T20:41:31.900038] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T20:41:32.148814] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T20:41:32.558850] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-14T20:41:33.200516] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T20:41:33.281817] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T20:41:33.358778] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-14T20:41:34.158843] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-14T20:41:34.958853] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-14T20:41:35.110522] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T20:41:35.758833] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-14T20:41:35.865601] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T20:41:36.563896] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-14T20:41:36.576135] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T20:41:37.335565] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T20:41:37.340582] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T20:41:37.358772] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-14T20:41:38.138163] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T20:41:38.158850] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-14T20:41:38.958850] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-14T20:41:39.561495] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T20:41:39.567024] [INFO ] [REMOTE ] WIT: Full fetch complete (56724 records). [2025-09-14T20:41:39.567198] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-14T20:41:39.762361] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-14T20:41:39.903215] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T20:41:40.001036] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-14T20:41:40.001175] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-14T20:41:40.002582] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-14T20:41:40.002692] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-14T20:41:40.004285] [DEBUG] [LOCAL ] WIT: Trimmed 56724 records to 39402 (keeping 150 days of data) [2025-09-14T20:41:40.259419] [DEBUG] [LOCAL ] WIT: Primary data saved (39402 records). [2025-09-14T20:41:40.259633] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-14T20:41:40.259829] [INFO ] [MAIN ] Update Progress: 2299/2370 symbols completed. WIT took 38.4s. Estimated remaining: 7m 33s. Rate: 9.4 symbols/min [2025-09-14T20:41:40.431273] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:40.433900] [DEBUG] [LOCAL ] WLTG: Loaded 578 existing records from primary storage. [2025-09-14T20:41:40.433992] [INFO ] [MAIN ] WLTG: Loaded 578 existing records. [2025-09-14T20:41:40.574903] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-14T20:41:40.616414] [WARN ] [MAIN ] WLTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:40.616736] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-14T20:41:40.616814] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-14T20:41:40.617044] [DEBUG] [LOCAL ] WLTG: Deleted primary data file. [2025-09-14T20:41:40.617118] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-14T20:41:40.972075] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:41.355624] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T20:41:41.362821] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-14T20:41:41.846498] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T20:41:41.905980] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T20:41:42.158831] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-14T20:41:42.629172] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T20:41:42.958843] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-14T20:41:43.439458] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T20:41:43.758860] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-14T20:41:44.468220] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T20:41:44.558867] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-14T20:41:45.358876] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-14T20:41:46.158869] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-14T20:41:46.462654] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T20:41:46.574066] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-14T20:41:46.818236] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T20:41:46.958900] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-14T20:41:47.758891] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-14T20:41:48.052504] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T20:41:48.070990] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T20:41:48.075495] [INFO ] [REMOTE ] WLK: Full fetch complete (48748 records). [2025-09-14T20:41:48.075627] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-14T20:41:48.481889] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-14T20:41:48.482012] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-14T20:41:48.483022] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-14T20:41:48.483086] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-14T20:41:48.484199] [DEBUG] [LOCAL ] WLK: Trimmed 48748 records to 34554 (keeping 150 days of data) [2025-09-14T20:41:48.584223] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-14T20:41:48.718999] [DEBUG] [LOCAL ] WLK: Primary data saved (34554 records). [2025-09-14T20:41:48.719192] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-14T20:41:48.719351] [INFO ] [MAIN ] Update Progress: 2300/2370 symbols completed. WLK took 23.5s. Estimated remaining: 7m 27s. Rate: 9.4 symbols/min [2025-09-14T20:41:48.889497] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:48.904755] [DEBUG] [LOCAL ] WLY: Loaded 13846 existing records from primary storage. [2025-09-14T20:41:48.904919] [INFO ] [MAIN ] WLY: Loaded 13846 existing records. [2025-09-14T20:41:49.086443] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:49.086717] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-14T20:41:49.086776] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-14T20:41:49.087183] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-14T20:41:49.087243] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-14T20:41:49.360007] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-14T20:41:49.446230] [INFO ] [REMOTE ] WLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:49.447201] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T20:41:49.871708] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T20:41:50.158872] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-14T20:41:50.639762] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T20:41:50.958871] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-14T20:41:51.346661] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-14T20:41:51.758838] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-14T20:41:52.177098] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T20:41:52.177941] [INFO ] [REMOTE ] WLTG: Full fetch complete (1294 records). [2025-09-14T20:41:52.178035] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-14T20:41:52.531934] [DEBUG] [VALIDATOR ] WLTG: All expected trading days are present. [2025-09-14T20:41:52.532048] [DEBUG] [VALIDATOR ] WLTG: Primary data validation passed. [2025-09-14T20:41:52.532142] [INFO ] [MAIN ] WLTG: Fetched primary data is valid. [2025-09-14T20:41:52.532195] [DEBUG] [LOCAL ] WLTG: Saving primary data. [2025-09-14T20:41:52.532538] [DEBUG] [LOCAL ] WLTG: Trimmed 1294 records to 898 (keeping 150 days of data) [2025-09-14T20:41:52.542951] [DEBUG] [LOCAL ] WLTG: Primary data saved (898 records). [2025-09-14T20:41:52.543054] [INFO ] [MAIN ] WLTG: Full history saved. [2025-09-14T20:41:52.543183] [INFO ] [MAIN ] Update Progress: 2301/2370 symbols completed. WLTG took 12.3s. Estimated remaining: 7m 20s. Rate: 9.4 symbols/min [2025-09-14T20:41:52.564179] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-14T20:41:52.724315] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:52.750112] [DEBUG] [LOCAL ] WM: Loaded 22818 existing records from primary storage. [2025-09-14T20:41:52.750292] [INFO ] [MAIN ] WM: Loaded 22818 existing records. [2025-09-14T20:41:52.928150] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:52.928417] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-14T20:41:52.928477] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-14T20:41:52.929019] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-14T20:41:52.929079] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-14T20:41:53.290968] [INFO ] [REMOTE ] WM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:53.358886] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-14T20:41:53.983557] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T20:41:53.997887] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T20:41:53.999269] [INFO ] [REMOTE ] WLKP: Full fetch complete (7181 records). [2025-09-14T20:41:53.999361] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-14T20:41:54.172059] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-14T20:41:54.379702] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-14T20:41:54.379832] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-14T20:41:54.380131] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-14T20:41:54.380189] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-14T20:41:54.380665] [DEBUG] [LOCAL ] WLKP: Trimmed 7181 records to 4996 (keeping 150 days of data) [2025-09-14T20:41:54.414546] [DEBUG] [LOCAL ] WLKP: Primary data saved (4996 records). [2025-09-14T20:41:54.414759] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-14T20:41:54.414891] [INFO ] [MAIN ] Update Progress: 2302/2370 symbols completed. WLKP took 27.4s. Estimated remaining: 7m 14s. Rate: 9.4 symbols/min [2025-09-14T20:41:54.597590] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:54.627137] [DEBUG] [LOCAL ] WMB: Loaded 24037 existing records from primary storage. [2025-09-14T20:41:54.627328] [INFO ] [MAIN ] WMB: Loaded 24037 existing records. [2025-09-14T20:41:54.808485] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:54.808771] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-14T20:41:54.808832] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-14T20:41:54.809371] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-14T20:41:54.809430] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-14T20:41:54.964081] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-14T20:41:55.180360] [INFO ] [REMOTE ] WMB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:55.722368] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T20:41:55.741314] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T20:41:55.745575] [INFO ] [REMOTE ] WKC: Full fetch complete (38533 records). [2025-09-14T20:41:55.745776] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-14T20:41:55.766711] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-14T20:41:56.118518] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-14T20:41:56.118636] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-14T20:41:56.119499] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-14T20:41:56.119557] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-14T20:41:56.120541] [DEBUG] [LOCAL ] WKC: Trimmed 38533 records to 26041 (keeping 150 days of data) [2025-09-14T20:41:56.297228] [DEBUG] [LOCAL ] WKC: Primary data saved (26041 records). [2025-09-14T20:41:56.297415] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-14T20:41:56.297543] [INFO ] [MAIN ] Update Progress: 2303/2370 symbols completed. WKC took 35.3s. Estimated remaining: 7m 7s. Rate: 9.4 symbols/min [2025-09-14T20:41:56.467095] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:41:56.475442] [DEBUG] [LOCAL ] WMK: Loaded 5861 existing records from primary storage. [2025-09-14T20:41:56.475622] [INFO ] [MAIN ] WMK: Loaded 5861 existing records. [2025-09-14T20:41:56.565283] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-14T20:41:56.656955] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:41:56.657232] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-14T20:41:56.657296] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-14T20:41:56.657597] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-14T20:41:56.657684] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-14T20:41:57.008296] [INFO ] [REMOTE ] WMK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:41:57.358870] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-14T20:41:57.625568] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T20:41:58.158848] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-14T20:41:58.261703] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T20:41:58.479785] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T20:41:58.958870] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-14T20:41:59.758797] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-14T20:41:59.862338] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T20:42:00.548177] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T20:42:00.558775] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-14T20:42:00.763411] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T20:42:01.358889] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-14T20:42:02.068981] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T20:42:02.158859] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-14T20:42:02.958921] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-14T20:42:03.758871] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-14T20:42:04.810986] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T20:42:04.815326] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-14T20:42:04.993352] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (3.63 seconds). [2025-09-14T20:42:05.025572] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-14T20:42:05.358864] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-14T20:42:06.062516] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T20:42:06.158821] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-14T20:42:06.258969] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-14T20:42:06.958845] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-14T20:42:07.049272] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T20:42:07.368305] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T20:42:07.758873] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-14T20:42:08.558850] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-14T20:42:09.053232] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T20:42:09.358894] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-14T20:42:09.563577] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T20:42:09.592826] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T20:42:10.158847] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-14T20:42:10.958848] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-14T20:42:11.279775] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T20:42:11.576997] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T20:42:11.758818] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-14T20:42:11.904603] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T20:42:11.907355] [INFO ] [REMOTE ] WMK: Full fetch complete (15338 records). [2025-09-14T20:42:11.907464] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-14T20:42:12.282625] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-14T20:42:12.282761] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-14T20:42:12.283157] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-14T20:42:12.283218] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-14T20:42:12.283802] [DEBUG] [LOCAL ] WMK: Trimmed 15338 records to 10865 (keeping 150 days of data) [2025-09-14T20:42:12.351872] [DEBUG] [LOCAL ] WMK: Primary data saved (10865 records). [2025-09-14T20:42:12.352056] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-14T20:42:12.352175] [INFO ] [MAIN ] Update Progress: 2304/2370 symbols completed. WMK took 16.1s. Estimated remaining: 7m 1s. Rate: 9.4 symbols/min [2025-09-14T20:42:12.520861] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:42:12.540002] [DEBUG] [LOCAL ] WMS: Loaded 18352 existing records from primary storage. [2025-09-14T20:42:12.540178] [INFO ] [MAIN ] WMS: Loaded 18352 existing records. [2025-09-14T20:42:12.570546] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-14T20:42:12.717367] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:42:12.717633] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-14T20:42:12.717714] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-14T20:42:12.718216] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-14T20:42:12.718307] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-14T20:42:13.077177] [INFO ] [REMOTE ] WMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:42:13.194500] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T20:42:13.358858] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-14T20:42:14.158891] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-14T20:42:14.958868] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-14T20:42:15.078261] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-14T20:42:15.151333] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T20:42:15.342534] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T20:42:15.758853] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-14T20:42:16.515909] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T20:42:16.558787] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-14T20:42:17.358844] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-14T20:42:18.158932] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-14T20:42:18.244443] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-14T20:42:18.304576] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T20:42:18.958923] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-14T20:42:19.630480] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-14T20:42:19.658626] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:42:19.664775] [INFO ] [REMOTE ] WMB: Full fetch complete (58352 records). [2025-09-14T20:42:19.664999] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-14T20:42:19.763359] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-14T20:42:20.088947] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-14T20:42:20.089144] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-14T20:42:20.090888] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-14T20:42:20.091000] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-14T20:42:20.122208] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T20:42:20.120209] [DEBUG] [LOCAL ] WMB: Trimmed 58352 records to 40413 (keeping 150 days of data) [2025-09-14T20:42:20.425097] [DEBUG] [LOCAL ] WMB: Primary data saved (40413 records). [2025-09-14T20:42:20.425295] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-14T20:42:20.425429] [INFO ] [MAIN ] Update Progress: 2305/2370 symbols completed. WMB took 26.0s. Estimated remaining: 6m 55s. Rate: 9.4 symbols/min [2025-09-14T20:42:20.563252] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-14T20:42:20.623557] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:42:20.640708] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T20:42:20.646289] [INFO ] [REMOTE ] WM: Full fetch complete (55397 records). [2025-09-14T20:42:20.646474] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-14T20:42:20.779904] [DEBUG] [LOCAL ] WMT: Loaded 24160 existing records from primary storage. [2025-09-14T20:42:20.820163] [INFO ] [MAIN ] WMT: Loaded 24160 existing records. [2025-09-14T20:42:21.224204] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:42:21.258826] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-14T20:42:21.276062] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-14T20:42:21.276305] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-14T20:42:21.276424] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-14T20:42:21.277630] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-14T20:42:21.277763] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-14T20:42:21.277591] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-14T20:42:21.321273] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-14T20:42:21.358862] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-14T20:42:21.432579] [DEBUG] [LOCAL ] WM: Trimmed 55397 records to 38369 (keeping 150 days of data) [2025-09-14T20:42:21.776126] [INFO ] [REMOTE ] WMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:42:21.925268] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T20:42:21.970970] [DEBUG] [LOCAL ] WM: Primary data saved (38369 records). [2025-09-14T20:42:21.971190] [INFO ] [MAIN ] WM: Full history saved. [2025-09-14T20:42:21.971313] [INFO ] [MAIN ] Update Progress: 2306/2370 symbols completed. WM took 29.4s. Estimated remaining: 6m 48s. Rate: 9.4 symbols/min [2025-09-14T20:42:22.152184] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:42:22.162791] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-14T20:42:22.174426] [DEBUG] [LOCAL ] WNC: Loaded 16615 existing records from primary storage. [2025-09-14T20:42:22.174624] [INFO ] [MAIN ] WNC: Loaded 16615 existing records. [2025-09-14T20:42:22.352564] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:42:22.352886] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-14T20:42:22.352958] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-14T20:42:22.353410] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-14T20:42:22.353474] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-14T20:42:22.715592] [INFO ] [REMOTE ] WNC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:42:22.859485] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:42:22.863300] [INFO ] [REMOTE ] WLY: Full fetch complete (32961 records). [2025-09-14T20:42:22.863463] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-14T20:42:22.965723] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-14T20:42:23.284606] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-14T20:42:23.285492] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T20:42:23.285825] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-14T20:42:23.293834] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-14T20:42:23.294014] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-14T20:42:23.295426] [DEBUG] [LOCAL ] WLY: Trimmed 32961 records to 22672 (keeping 150 days of data) [2025-09-14T20:42:23.433912] [DEBUG] [LOCAL ] WLY: Primary data saved (22672 records). [2025-09-14T20:42:23.434103] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-14T20:42:23.434230] [INFO ] [MAIN ] Update Progress: 2307/2370 symbols completed. WLY took 34.7s. Estimated remaining: 6m 42s. Rate: 9.4 symbols/min [2025-09-14T20:42:23.603050] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:42:23.621891] [DEBUG] [LOCAL ] WNS: Loaded 18908 existing records from primary storage. [2025-09-14T20:42:23.622066] [INFO ] [MAIN ] WNS: Loaded 18908 existing records. [2025-09-14T20:42:23.764592] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-14T20:42:23.803051] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:42:23.803267] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-14T20:42:23.803345] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-14T20:42:23.803891] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-14T20:42:23.803975] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-14T20:42:24.155216] [INFO ] [REMOTE ] WNS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:42:24.558883] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-14T20:42:25.310343] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-14T20:42:25.358822] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-14T20:42:25.386923] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T20:42:26.158853] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-14T20:42:26.301397] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T20:42:26.827363] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T20:42:26.958822] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-14T20:42:27.758901] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-14T20:42:28.446816] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T20:42:28.558831] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-14T20:42:28.832942] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-14T20:42:28.995434] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T20:42:29.358918] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-14T20:42:30.158869] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-14T20:42:30.498411] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T20:42:30.958850] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-14T20:42:31.758875] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-14T20:42:31.799110] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T20:42:32.056307] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-14T20:42:32.225913] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T20:42:32.558907] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-14T20:42:33.364029] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-14T20:42:33.393635] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T20:42:34.061095] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:42:34.065952] [INFO ] [REMOTE ] WMS: Full fetch complete (43016 records). [2025-09-14T20:42:34.066142] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-14T20:42:34.167476] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-14T20:42:34.472935] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-14T20:42:34.473101] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-14T20:42:34.474367] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-14T20:42:34.474460] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-14T20:42:34.476216] [DEBUG] [LOCAL ] WMS: Trimmed 43016 records to 29750 (keeping 150 days of data) [2025-09-14T20:42:34.711839] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T20:42:34.734928] [DEBUG] [LOCAL ] WMS: Primary data saved (29750 records). [2025-09-14T20:42:34.735154] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-14T20:42:34.735278] [INFO ] [MAIN ] Update Progress: 2308/2370 symbols completed. WMS took 22.4s. Estimated remaining: 6m 36s. Rate: 9.4 symbols/min [2025-09-14T20:42:34.914857] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:42:34.941400] [DEBUG] [LOCAL ] WOLF: Loaded 23959 existing records from primary storage. [2025-09-14T20:42:34.941628] [INFO ] [MAIN ] WOLF: Loaded 23959 existing records. [2025-09-14T20:42:34.964023] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-14T20:42:35.146247] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:42:35.146587] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-14T20:42:35.146677] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-14T20:42:35.147427] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-14T20:42:35.147806] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-14T20:42:35.513353] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:42:35.694974] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T20:42:35.758839] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-14T20:42:36.558857] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-14T20:42:36.753083] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T20:42:36.830887] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T20:42:37.358869] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-14T20:42:38.158875] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-14T20:42:38.857684] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T20:42:38.958781] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-14T20:42:39.569724] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-14T20:42:39.758812] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-14T20:42:39.857979] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T20:42:40.558832] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-14T20:42:40.770273] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T20:42:41.358931] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-14T20:42:41.648339] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T20:42:42.158972] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-14T20:42:42.811455] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T20:42:42.924069] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-14T20:42:42.958820] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-14T20:42:43.758890] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-14T20:42:44.537628] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-14T20:42:44.558907] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-14T20:42:44.729096] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T20:42:45.358888] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-14T20:42:45.555632] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-14T20:42:46.139529] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T20:42:46.158825] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-14T20:42:46.778832] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T20:42:46.958871] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-14T20:42:47.184966] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T20:42:47.189374] [INFO ] [REMOTE ] WNS: Full fetch complete (42377 records). [2025-09-14T20:42:47.189557] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-14T20:42:47.584277] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-14T20:42:47.584534] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-14T20:42:47.586186] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-14T20:42:47.586263] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-14T20:42:47.587751] [DEBUG] [LOCAL ] WNS: Trimmed 42377 records to 30428 (keeping 150 days of data) [2025-09-14T20:42:47.771884] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-14T20:42:47.795853] [DEBUG] [LOCAL ] WNS: Primary data saved (30428 records). [2025-09-14T20:42:47.796409] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-14T20:42:47.796678] [INFO ] [MAIN ] Update Progress: 2309/2370 symbols completed. WNS took 24.4s. Estimated remaining: 6m 29s. Rate: 9.4 symbols/min [2025-09-14T20:42:47.981142] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:42:47.995183] [DEBUG] [LOCAL ] WOR: Loaded 10141 existing records from primary storage. [2025-09-14T20:42:47.995458] [INFO ] [MAIN ] WOR: Loaded 10141 existing records. [2025-09-14T20:42:48.188321] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:42:48.188709] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-14T20:42:48.188781] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-14T20:42:48.189256] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-14T20:42:48.189346] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-14T20:42:48.500515] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T20:42:48.562774] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-14T20:42:48.568876] [INFO ] [REMOTE ] WNC: Full fetch complete (44689 records). [2025-09-14T20:42:48.588527] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-14T20:42:48.595188] [INFO ] [REMOTE ] WOR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:42:48.974561] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-14T20:42:48.974760] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-14T20:42:48.975841] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-14T20:42:48.975936] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-14T20:42:48.977385] [DEBUG] [LOCAL ] WNC: Trimmed 44689 records to 29515 (keeping 150 days of data) [2025-09-14T20:42:49.165595] [DEBUG] [LOCAL ] WNC: Primary data saved (29515 records). [2025-09-14T20:42:49.165926] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-14T20:42:49.166119] [INFO ] [MAIN ] Update Progress: 2310/2370 symbols completed. WNC took 27.2s. Estimated remaining: 6m 23s. Rate: 9.4 symbols/min [2025-09-14T20:42:49.326258] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-14T20:42:49.358972] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-14T20:42:49.418420] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:42:49.439669] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T20:42:49.451179] [INFO ] [REMOTE ] WMT: Full fetch complete (58480 records). [2025-09-14T20:42:49.451435] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-14T20:42:49.556777] [DEBUG] [LOCAL ] WOW: Loaded 14494 existing records from primary storage. [2025-09-14T20:42:49.568252] [INFO ] [MAIN ] WOW: Loaded 14494 existing records. [2025-09-14T20:42:49.996074] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:42:50.047633] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-14T20:42:50.083275] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-14T20:42:50.083610] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-14T20:42:50.086250] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-14T20:42:50.083453] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-14T20:42:50.086447] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-14T20:42:50.087578] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-14T20:42:50.088082] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-14T20:42:50.109499] [DEBUG] [LOCAL ] WMT: Trimmed 58480 records to 40540 (keeping 150 days of data) [2025-09-14T20:42:50.160254] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-14T20:42:50.637575] [INFO ] [REMOTE ] WOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:42:50.819829] [DEBUG] [LOCAL ] WMT: Primary data saved (40540 records). [2025-09-14T20:42:50.832956] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-14T20:42:50.833156] [INFO ] [MAIN ] Update Progress: 2311/2370 symbols completed. WMT took 30.4s. Estimated remaining: 6m 16s. Rate: 9.4 symbols/min [2025-09-14T20:42:50.834358] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T20:42:50.963902] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-14T20:42:51.008709] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:42:51.030997] [DEBUG] [LOCAL ] WPC: Loaded 21588 existing records from primary storage. [2025-09-14T20:42:51.031163] [INFO ] [MAIN ] WPC: Loaded 21588 existing records. [2025-09-14T20:42:51.208581] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:42:51.208922] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-14T20:42:51.208996] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-14T20:42:51.209730] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-14T20:42:51.209800] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-14T20:42:51.565808] [INFO ] [REMOTE ] WPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:42:51.758849] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-14T20:42:52.475935] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T20:42:52.558831] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-14T20:42:52.622086] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-14T20:42:53.018909] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T20:42:53.358891] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-14T20:42:53.913759] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T20:42:54.158862] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-14T20:42:54.958852] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-14T20:42:55.218481] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T20:42:55.433082] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T20:42:55.758835] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-14T20:42:56.558855] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-14T20:42:57.358860] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-14T20:42:57.485206] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T20:42:57.698873] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-14T20:42:57.843894] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T20:42:58.158810] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-14T20:42:58.246668] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T20:42:58.910110] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T20:42:58.958873] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-14T20:42:59.758895] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-14T20:43:00.190363] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T20:43:00.558906] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-14T20:43:01.358878] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-14T20:43:02.100466] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-14T20:43:02.158833] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-14T20:43:02.661080] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T20:43:02.882058] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T20:43:02.906946] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T20:43:02.912802] [INFO ] [REMOTE ] WOLF: Full fetch complete (58210 records). [2025-09-14T20:43:02.913012] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-14T20:43:02.968799] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-14T20:43:03.312682] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-14T20:43:03.312831] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-14T20:43:03.314885] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-14T20:43:03.314966] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-14T20:43:03.316931] [DEBUG] [LOCAL ] WOLF: Trimmed 58210 records to 40278 (keeping 150 days of data) [2025-09-14T20:43:03.629690] [DEBUG] [LOCAL ] WOLF: Primary data saved (40278 records). [2025-09-14T20:43:03.629987] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-14T20:43:03.630169] [INFO ] [MAIN ] Update Progress: 2312/2370 symbols completed. WOLF took 28.9s. Estimated remaining: 6m 10s. Rate: 9.4 symbols/min [2025-09-14T20:43:03.764046] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-14T20:43:03.837177] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:03.862129] [DEBUG] [LOCAL ] WPM: Loaded 23481 existing records from primary storage. [2025-09-14T20:43:03.862360] [INFO ] [MAIN ] WPM: Loaded 23481 existing records. [2025-09-14T20:43:04.045023] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:04.045334] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-14T20:43:04.045410] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-14T20:43:04.046155] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-14T20:43:04.046227] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-14T20:43:04.425044] [INFO ] [REMOTE ] WPM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:04.451119] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T20:43:04.558860] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-14T20:43:05.358838] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-14T20:43:05.729982] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T20:43:05.877091] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T20:43:06.158893] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-14T20:43:06.871195] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T20:43:06.958864] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-14T20:43:07.758851] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-14T20:43:08.080871] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T20:43:08.201362] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T20:43:08.558903] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-14T20:43:08.684301] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T20:43:08.688213] [INFO ] [REMOTE ] WOW: Full fetch complete (31661 records). [2025-09-14T20:43:08.688338] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-14T20:43:09.057060] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-14T20:43:09.057191] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-14T20:43:09.057957] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-14T20:43:09.058018] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-14T20:43:09.059053] [DEBUG] [LOCAL ] WOW: Trimmed 31661 records to 21967 (keeping 150 days of data) [2025-09-14T20:43:09.189326] [DEBUG] [LOCAL ] WOW: Primary data saved (21967 records). [2025-09-14T20:43:09.189503] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-14T20:43:09.189621] [INFO ] [MAIN ] Update Progress: 2313/2370 symbols completed. WOW took 20.0s. Estimated remaining: 6m 4s. Rate: 9.4 symbols/min [2025-09-14T20:43:09.360522] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:09.360582] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-14T20:43:09.379077] [DEBUG] [LOCAL ] WPP: Loaded 16130 existing records from primary storage. [2025-09-14T20:43:09.379320] [INFO ] [MAIN ] WPP: Loaded 16130 existing records. [2025-09-14T20:43:09.556725] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:09.556983] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-14T20:43:09.557044] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-14T20:43:09.557434] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-14T20:43:09.557495] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-14T20:43:09.909861] [INFO ] [REMOTE ] WPP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:10.158829] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-14T20:43:10.299597] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T20:43:10.958879] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-14T20:43:11.157672] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T20:43:11.206407] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T20:43:11.215014] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-14T20:43:11.221711] [INFO ] [REMOTE ] WOR: Full fetch complete (27175 records). [2025-09-14T20:43:11.221848] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-14T20:43:11.771014] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-14T20:43:11.799006] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-14T20:43:11.799189] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-14T20:43:11.800867] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-14T20:43:11.801025] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-14T20:43:11.802823] [DEBUG] [LOCAL ] WOR: Trimmed 27175 records to 16996 (keeping 150 days of data) [2025-09-14T20:43:11.980295] [DEBUG] [LOCAL ] WOR: Primary data saved (16996 records). [2025-09-14T20:43:11.980569] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-14T20:43:11.980792] [INFO ] [MAIN ] Update Progress: 2314/2370 symbols completed. WOR took 24.2s. Estimated remaining: 5m 57s. Rate: 9.4 symbols/min [2025-09-14T20:43:12.230881] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:12.264503] [DEBUG] [LOCAL ] WRB: Loaded 22628 existing records from primary storage. [2025-09-14T20:43:12.264776] [INFO ] [MAIN ] WRB: Loaded 22628 existing records. [2025-09-14T20:43:12.532264] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:12.532700] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-14T20:43:12.532789] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-14T20:43:12.533382] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-14T20:43:12.533455] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-14T20:43:12.567417] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-14T20:43:12.930447] [INFO ] [REMOTE ] WRB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:13.293616] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T20:43:13.358816] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-14T20:43:14.158803] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-14T20:43:14.667714] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T20:43:14.888075] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T20:43:14.958861] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-14T20:43:15.758891] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-14T20:43:16.156548] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T20:43:16.221706] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T20:43:16.558909] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-14T20:43:17.358854] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-14T20:43:17.907791] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T20:43:17.962280] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T20:43:18.158850] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-14T20:43:18.958885] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-14T20:43:19.108351] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T20:43:19.758885] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-14T20:43:19.873156] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T20:43:20.558908] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-14T20:43:20.889366] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T20:43:21.358814] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-14T20:43:21.528043] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T20:43:21.808694] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T20:43:22.158885] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-14T20:43:22.958883] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-14T20:43:23.325451] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T20:43:23.510177] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T20:43:23.513737] [INFO ] [REMOTE ] WPP: Full fetch complete (35288 records). [2025-09-14T20:43:23.513836] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-14T20:43:23.764046] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-14T20:43:23.883178] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-14T20:43:23.883291] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-14T20:43:23.884154] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-14T20:43:23.884223] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-14T20:43:23.885204] [DEBUG] [LOCAL ] WPP: Trimmed 35288 records to 24946 (keeping 150 days of data) [2025-09-14T20:43:24.036191] [DEBUG] [LOCAL ] WPP: Primary data saved (24946 records). [2025-09-14T20:43:24.036360] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-14T20:43:24.036478] [INFO ] [MAIN ] Update Progress: 2315/2370 symbols completed. WPP took 14.8s. Estimated remaining: 5m 51s. Rate: 9.4 symbols/min [2025-09-14T20:43:24.203812] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:24.225899] [DEBUG] [LOCAL ] WRBY: Loaded 22266 existing records from primary storage. [2025-09-14T20:43:24.226075] [INFO ] [MAIN ] WRBY: Loaded 22266 existing records. [2025-09-14T20:43:24.410607] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:24.410967] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-14T20:43:24.411052] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-14T20:43:24.411538] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-14T20:43:24.411599] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-14T20:43:24.563959] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-14T20:43:24.778242] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:24.877855] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T20:43:25.328235] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T20:43:25.333228] [INFO ] [REMOTE ] WPC: Full fetch complete (53218 records). [2025-09-14T20:43:25.333352] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-14T20:43:25.364010] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-14T20:43:25.718818] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-14T20:43:25.718944] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-14T20:43:25.720198] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-14T20:43:25.720265] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-14T20:43:25.721548] [DEBUG] [LOCAL ] WPC: Trimmed 53218 records to 36364 (keeping 150 days of data) [2025-09-14T20:43:25.968411] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-14T20:43:26.002869] [DEBUG] [LOCAL ] WPC: Primary data saved (36364 records). [2025-09-14T20:43:26.003083] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-14T20:43:26.003204] [INFO ] [MAIN ] Update Progress: 2316/2370 symbols completed. WPC took 35.2s. Estimated remaining: 5m 44s. Rate: 9.4 symbols/min [2025-09-14T20:43:26.172417] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-14T20:43:26.175810] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:26.188571] [DEBUG] [LOCAL ] WS: Loaded 10483 existing records from primary storage. [2025-09-14T20:43:26.188740] [INFO ] [MAIN ] WS: Loaded 10483 existing records. [2025-09-14T20:43:26.380298] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:26.380579] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-14T20:43:26.380657] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-14T20:43:26.381026] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-14T20:43:26.381087] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-14T20:43:26.767449] [INFO ] [REMOTE ] WS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:26.958800] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-14T20:43:27.288697] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T20:43:27.758865] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-14T20:43:28.174774] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T20:43:28.300424] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T20:43:28.558849] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-14T20:43:29.358868] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-14T20:43:29.535602] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T20:43:29.792769] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T20:43:30.158861] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-14T20:43:30.966780] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-14T20:43:30.993176] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T20:43:31.323921] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T20:43:31.758854] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-14T20:43:32.558873] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-14T20:43:32.650264] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T20:43:32.655603] [INFO ] [REMOTE ] WPM: Full fetch complete (57298 records). [2025-09-14T20:43:32.655793] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-14T20:43:33.038472] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-14T20:43:33.038594] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-14T20:43:33.039728] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-14T20:43:33.039801] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-14T20:43:33.041764] [DEBUG] [LOCAL ] WPM: Trimmed 57298 records to 39617 (keeping 150 days of data) [2025-09-14T20:43:33.321428] [DEBUG] [LOCAL ] WPM: Primary data saved (39617 records). [2025-09-14T20:43:33.321627] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-14T20:43:33.321767] [INFO ] [MAIN ] Update Progress: 2317/2370 symbols completed. WPM took 29.7s. Estimated remaining: 5m 38s. Rate: 9.4 symbols/min [2025-09-14T20:43:33.358829] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-14T20:43:33.450100] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T20:43:34.158792] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-14T20:43:34.409853] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T20:43:34.462716] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T20:43:34.958846] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-14T20:43:35.758928] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-14T20:43:35.897153] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T20:43:36.290609] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T20:43:36.558834] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-14T20:43:37.358862] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-14T20:43:37.542143] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T20:43:37.572756] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T20:43:38.158838] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-14T20:43:38.958824] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-14T20:43:39.232547] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T20:43:39.278741] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T20:43:39.625191] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:43:39.630910] [INFO ] [REMOTE ] WRB: Full fetch complete (54992 records). [2025-09-14T20:43:39.631139] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-14T20:43:39.764044] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-14T20:43:40.049118] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-14T20:43:40.049259] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-14T20:43:40.050713] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-14T20:43:40.050791] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-14T20:43:40.052258] [DEBUG] [LOCAL ] WRB: Trimmed 54992 records to 37918 (keeping 150 days of data) [2025-09-14T20:43:40.314888] [DEBUG] [LOCAL ] WRB: Primary data saved (37918 records). [2025-09-14T20:43:40.315098] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-14T20:43:40.315212] [INFO ] [MAIN ] Update Progress: 2318/2370 symbols completed. WRB took 28.3s. Estimated remaining: 5m 32s. Rate: 9.4 symbols/min [2025-09-14T20:43:40.558875] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-14T20:43:41.048399] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T20:43:41.052399] [INFO ] [REMOTE ] WS: Full fetch complete (26395 records). [2025-09-14T20:43:41.052610] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-14T20:43:41.435628] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-14T20:43:41.435849] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-14T20:43:41.436608] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-14T20:43:41.436694] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-14T20:43:41.438074] [DEBUG] [LOCAL ] WS: Trimmed 26395 records to 16988 (keeping 150 days of data) [2025-09-14T20:43:41.568999] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T20:43:41.584729] [DEBUG] [LOCAL ] WS: Primary data saved (16988 records). [2025-09-14T20:43:41.585136] [INFO ] [MAIN ] WS: Full history saved. [2025-09-14T20:43:41.600349] [INFO ] [MAIN ] Update Progress: 2319/2370 symbols completed. WS took 15.6s. Estimated remaining: 5m 25s. Rate: 9.4 symbols/min [2025-09-14T20:43:41.602861] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-14T20:43:43.405414] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T20:43:43.417677] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-14T20:43:45.731762] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-14T20:43:45.742548] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-14T20:43:46.853089] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T20:43:46.858306] [INFO ] [REMOTE ] WRBY: Full fetch complete (55256 records). [2025-09-14T20:43:46.858501] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-14T20:43:47.247733] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-14T20:43:47.247861] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-14T20:43:47.249079] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-14T20:43:47.249145] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-14T20:43:47.250967] [DEBUG] [LOCAL ] WRBY: Trimmed 55256 records to 38047 (keeping 150 days of data) [2025-09-14T20:43:47.491814] [DEBUG] [LOCAL ] WRBY: Primary data saved (38047 records). [2025-09-14T20:43:47.492028] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-14T20:43:47.492138] [INFO ] [MAIN ] Update Progress: 2320/2370 symbols completed. WRBY took 23.5s. Estimated remaining: 5m 19s. Rate: 9.4 symbols/min [2025-09-14T20:43:48.115892] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:48.168844] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:48.175857] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:48.233784] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:43:48.247842] [DEBUG] [LOCAL ] WSR: Loaded 9739 existing records from primary storage. [2025-09-14T20:43:48.248170] [INFO ] [MAIN ] WSR: Loaded 9739 existing records. [2025-09-14T20:43:48.373818] [DEBUG] [LOCAL ] WSO: Loaded 11524 existing records from primary storage. [2025-09-14T20:43:48.374212] [DEBUG] [LOCAL ] WST: Loaded 15658 existing records from primary storage. [2025-09-14T20:43:48.385413] [INFO ] [MAIN ] WST: Loaded 15658 existing records. [2025-09-14T20:43:48.385481] [INFO ] [MAIN ] WSO: Loaded 11524 existing records. [2025-09-14T20:43:48.426522] [DEBUG] [LOCAL ] WSM: Loaded 21830 existing records from primary storage. [2025-09-14T20:43:48.471266] [INFO ] [MAIN ] WSM: Loaded 21830 existing records. [2025-09-14T20:43:48.619049] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:48.706957] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-14T20:43:48.779998] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-14T20:43:48.961687] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:48.967029] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:49.019148] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-14T20:43:49.019222] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-14T20:43:49.019449] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:43:49.019901] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-14T20:43:49.020031] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-14T20:43:49.020216] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-14T20:43:49.031471] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-14T20:43:49.020277] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-14T20:43:49.020455] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-14T20:43:49.073917] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-14T20:43:49.089748] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-14T20:43:49.107231] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-14T20:43:49.158948] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-14T20:43:49.169759] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-14T20:43:49.234232] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-14T20:43:50.323956] [INFO ] [REMOTE ] WST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:50.272317] [INFO ] [REMOTE ] WSR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:50.349935] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-14T20:43:50.350137] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-14T20:43:50.406669] [INFO ] [REMOTE ] WSO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:50.429722] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-14T20:43:50.489673] [INFO ] [REMOTE ] WSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:43:50.490044] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-14T20:43:51.360196] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T20:43:51.370791] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-14T20:43:51.754825] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T20:43:51.760498] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-14T20:43:51.990489] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T20:43:51.995572] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-14T20:43:52.247962] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T20:43:52.256307] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-14T20:43:52.291849] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T20:43:52.303300] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-14T20:43:52.813634] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T20:43:52.824905] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-14T20:43:52.986425] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T20:43:52.992214] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-14T20:43:53.286175] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T20:43:53.292325] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-14T20:43:53.361604] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T20:43:53.372532] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-14T20:43:53.631258] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T20:43:53.849067] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T20:43:54.056610] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T20:43:54.158897] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-14T20:43:54.578957] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T20:43:54.746458] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T20:43:54.958867] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-14T20:43:55.758922] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-14T20:43:56.551699] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T20:43:56.561131] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-14T20:43:56.915415] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T20:43:57.358863] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-14T20:43:57.445194] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T20:43:58.158929] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-14T20:43:58.958862] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-14T20:43:59.258536] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T20:43:59.338072] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T20:43:59.758816] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-14T20:44:00.086434] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T20:44:00.164294] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T20:44:00.171438] [INFO ] [REMOTE ] WSM: Full fetch complete (54326 records). [2025-09-14T20:44:00.171604] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-14T20:44:00.556458] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-14T20:44:00.556587] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-14T20:44:00.557698] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-14T20:44:00.557769] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-14T20:44:00.558790] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-14T20:44:00.560046] [DEBUG] [LOCAL ] WSM: Trimmed 54326 records to 37328 (keeping 150 days of data) [2025-09-14T20:44:00.824714] [DEBUG] [LOCAL ] WSM: Primary data saved (37328 records). [2025-09-14T20:44:00.824940] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-14T20:44:00.825115] [INFO ] [MAIN ] Update Progress: 2321/2370 symbols completed. WSM took 13.3s. Estimated remaining: 5m 13s. Rate: 9.4 symbols/min [2025-09-14T20:44:01.001310] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:01.024528] [DEBUG] [LOCAL ] WT: Loaded 22327 existing records from primary storage. [2025-09-14T20:44:01.024853] [INFO ] [MAIN ] WT: Loaded 22327 existing records. [2025-09-14T20:44:01.201183] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:01.201459] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-14T20:44:01.201518] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-14T20:44:01.202034] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-14T20:44:01.202095] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-14T20:44:01.369952] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-14T20:44:01.588887] [INFO ] [REMOTE ] WT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:01.911613] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T20:44:02.158941] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-14T20:44:02.547491] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T20:44:02.958806] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-14T20:44:03.008287] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T20:44:03.758813] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-14T20:44:04.150524] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T20:44:04.558933] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-14T20:44:05.358898] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-14T20:44:05.620492] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T20:44:06.031617] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T20:44:06.048923] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T20:44:06.052972] [INFO ] [REMOTE ] WSO: Full fetch complete (26790 records). [2025-09-14T20:44:06.053096] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-14T20:44:06.163909] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-14T20:44:06.424911] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-14T20:44:06.425023] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-14T20:44:06.425689] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-14T20:44:06.425749] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-14T20:44:06.426844] [DEBUG] [LOCAL ] WSO: Trimmed 26790 records to 18603 (keeping 150 days of data) [2025-09-14T20:44:06.554704] [DEBUG] [LOCAL ] WSO: Primary data saved (18603 records). [2025-09-14T20:44:06.554916] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-14T20:44:06.555071] [INFO ] [MAIN ] Update Progress: 2322/2370 symbols completed. WSO took 19.1s. Estimated remaining: 5m 6s. Rate: 9.4 symbols/min [2025-09-14T20:44:06.735545] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:06.757398] [DEBUG] [LOCAL ] WTI: Loaded 19357 existing records from primary storage. [2025-09-14T20:44:06.757577] [INFO ] [MAIN ] WTI: Loaded 19357 existing records. [2025-09-14T20:44:06.942525] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:06.942842] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-14T20:44:06.942905] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-14T20:44:06.943536] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-14T20:44:06.943601] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-14T20:44:06.964508] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-14T20:44:07.296995] [INFO ] [REMOTE ] WTI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:07.758856] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-14T20:44:08.003485] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T20:44:08.558887] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-14T20:44:08.855420] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T20:44:08.921764] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T20:44:09.358848] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-14T20:44:10.158841] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-14T20:44:10.387613] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T20:44:10.830377] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T20:44:10.958852] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-14T20:44:11.758899] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-14T20:44:12.055746] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T20:44:12.198849] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T20:44:12.216827] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T20:44:12.220432] [INFO ] [REMOTE ] WST: Full fetch complete (42279 records). [2025-09-14T20:44:12.220544] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-14T20:44:12.567161] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-14T20:44:12.601933] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-14T20:44:12.602038] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-14T20:44:12.603063] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-14T20:44:12.603218] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-14T20:44:12.604674] [DEBUG] [LOCAL ] WST: Trimmed 42279 records to 27474 (keeping 150 days of data) [2025-09-14T20:44:12.797294] [DEBUG] [LOCAL ] WST: Primary data saved (27474 records). [2025-09-14T20:44:12.797520] [INFO ] [MAIN ] WST: Full history saved. [2025-09-14T20:44:12.797709] [INFO ] [MAIN ] Update Progress: 2323/2370 symbols completed. WST took 25.3s. Estimated remaining: 4m 60s. Rate: 9.4 symbols/min [2025-09-14T20:44:12.966729] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:12.970041] [DEBUG] [LOCAL ] WTM: Loaded 956 existing records from primary storage. [2025-09-14T20:44:12.970168] [INFO ] [MAIN ] WTM: Loaded 956 existing records. [2025-09-14T20:44:13.147092] [WARN ] [MAIN ] WTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:13.147401] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-14T20:44:13.147486] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-14T20:44:13.147762] [DEBUG] [LOCAL ] WTM: Deleted primary data file. [2025-09-14T20:44:13.147839] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-14T20:44:13.364068] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-14T20:44:13.518613] [INFO ] [REMOTE ] WTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:13.992424] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T20:44:13.994800] [INFO ] [REMOTE ] WSR: Full fetch complete (25127 records). [2025-09-14T20:44:13.994886] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-14T20:44:14.166365] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-14T20:44:14.371409] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-14T20:44:14.371547] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-14T20:44:14.372387] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-14T20:44:14.372494] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-14T20:44:14.373734] [DEBUG] [LOCAL ] WSR: Trimmed 25127 records to 16972 (keeping 150 days of data) [2025-09-14T20:44:14.478055] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T20:44:14.523444] [DEBUG] [LOCAL ] WSR: Primary data saved (16972 records). [2025-09-14T20:44:14.523632] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-14T20:44:14.523758] [INFO ] [MAIN ] Update Progress: 2324/2370 symbols completed. WSR took 27.0s. Estimated remaining: 4m 53s. Rate: 9.4 symbols/min [2025-09-14T20:44:14.692174] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:14.715110] [DEBUG] [LOCAL ] WTRG: Loaded 23114 existing records from primary storage. [2025-09-14T20:44:14.715288] [INFO ] [MAIN ] WTRG: Loaded 23114 existing records. [2025-09-14T20:44:14.891914] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:14.892245] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-14T20:44:14.892305] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-14T20:44:14.892955] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-14T20:44:14.893018] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-14T20:44:14.967620] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-14T20:44:15.311827] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:15.543926] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T20:44:15.758844] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-14T20:44:15.996634] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T20:44:16.558872] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-14T20:44:17.358916] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-14T20:44:17.796984] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T20:44:17.808163] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T20:44:18.158875] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-14T20:44:18.303203] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T20:44:18.666400] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T20:44:18.958845] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-14T20:44:19.758848] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-14T20:44:20.201109] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T20:44:20.558856] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-14T20:44:20.676482] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T20:44:21.358863] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-14T20:44:22.132571] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T20:44:22.158803] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-14T20:44:22.873188] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T20:44:22.958799] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-14T20:44:23.341874] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T20:44:23.516730] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T20:44:23.758846] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-14T20:44:24.279794] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T20:44:24.558843] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-14T20:44:25.358838] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-14T20:44:25.903491] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-14T20:44:26.158866] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-14T20:44:26.466367] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T20:44:26.958850] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-14T20:44:27.758850] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-14T20:44:28.363788] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T20:44:28.368957] [INFO ] [REMOTE ] WTM: Full fetch complete (1711 records). [2025-09-14T20:44:28.369256] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-14T20:44:28.550166] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T20:44:28.550588] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:44:28.550861] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:44:28.560971] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-14T20:44:28.578891] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-14T20:44:28.579033] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-14T20:44:28.580865] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-14T20:44:28.579670] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-14T20:44:28.590847] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-14T20:44:28.591768] [INFO ] [MAIN ] Update Progress: 2325/2370 symbols completed. WTM took 15.8s. Estimated remaining: 4m 47s. Rate: 9.4 symbols/min [2025-09-14T20:44:28.764985] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:28.798328] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T20:44:28.811366] [DEBUG] [LOCAL ] WTS: Loaded 7996 existing records from primary storage. [2025-09-14T20:44:28.811924] [INFO ] [MAIN ] WTS: Loaded 7996 existing records. [2025-09-14T20:44:28.988878] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:28.989163] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-14T20:44:28.989227] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-14T20:44:28.989623] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-14T20:44:28.989720] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-14T20:44:29.349370] [INFO ] [REMOTE ] WTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:29.358787] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-14T20:44:30.158841] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-14T20:44:30.228673] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T20:44:30.968171] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-14T20:44:30.974358] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T20:44:31.025134] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T20:44:31.651730] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:44:31.657288] [INFO ] [REMOTE ] WT: Full fetch complete (51443 records). [2025-09-14T20:44:31.657501] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-14T20:44:31.763923] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-14T20:44:32.048003] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-14T20:44:32.048117] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-14T20:44:32.049346] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-14T20:44:32.049407] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-14T20:44:32.050693] [DEBUG] [LOCAL ] WT: Trimmed 51443 records to 35535 (keeping 150 days of data) [2025-09-14T20:44:32.276263] [DEBUG] [LOCAL ] WT: Primary data saved (35535 records). [2025-09-14T20:44:32.276456] [INFO ] [MAIN ] WT: Full history saved. [2025-09-14T20:44:32.276565] [INFO ] [MAIN ] Update Progress: 2326/2370 symbols completed. WT took 31.5s. Estimated remaining: 4m 41s. Rate: 9.4 symbols/min [2025-09-14T20:44:32.447074] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:32.467050] [DEBUG] [LOCAL ] WTTR: Loaded 19354 existing records from primary storage. [2025-09-14T20:44:32.467247] [INFO ] [MAIN ] WTTR: Loaded 19354 existing records. [2025-09-14T20:44:32.568931] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-14T20:44:32.659160] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:32.659483] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-14T20:44:32.659550] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-14T20:44:32.660405] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-14T20:44:32.660695] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-14T20:44:33.020093] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:33.358894] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-14T20:44:33.855408] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-14T20:44:34.158852] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-14T20:44:34.571258] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T20:44:34.899458] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-14T20:44:34.958798] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-14T20:44:35.148022] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T20:44:35.153045] [INFO ] [REMOTE ] WTI: Full fetch complete (47103 records). [2025-09-14T20:44:35.153324] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-14T20:44:35.556467] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-14T20:44:35.556624] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-14T20:44:35.557786] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-14T20:44:35.557849] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-14T20:44:35.559184] [DEBUG] [LOCAL ] WTI: Trimmed 47103 records to 33126 (keeping 150 days of data) [2025-09-14T20:44:35.761275] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-14T20:44:35.761372] [DEBUG] [LOCAL ] WTI: Primary data saved (33126 records). [2025-09-14T20:44:35.762527] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-14T20:44:35.762677] [INFO ] [MAIN ] Update Progress: 2327/2370 symbols completed. WTI took 29.2s. Estimated remaining: 4m 34s. Rate: 9.4 symbols/min [2025-09-14T20:44:35.953882] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:35.977295] [DEBUG] [LOCAL ] WU: Loaded 23971 existing records from primary storage. [2025-09-14T20:44:35.977499] [INFO ] [MAIN ] WU: Loaded 23971 existing records. [2025-09-14T20:44:36.151790] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:36.152063] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-14T20:44:36.152124] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-14T20:44:36.152623] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-14T20:44:36.152712] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-14T20:44:36.506625] [INFO ] [REMOTE ] WU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:36.558801] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-14T20:44:36.736279] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T20:44:37.037966] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T20:44:37.358899] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-14T20:44:38.158868] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-14T20:44:38.515968] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T20:44:38.644492] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T20:44:38.958870] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-14T20:44:39.758854] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-14T20:44:39.949052] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T20:44:40.005257] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T20:44:40.558915] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-14T20:44:41.239760] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:44:41.245092] [INFO ] [REMOTE ] WTRG: Full fetch complete (55365 records). [2025-09-14T20:44:41.245229] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-14T20:44:41.359689] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-14T20:44:41.638916] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-14T20:44:41.639089] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-14T20:44:41.640542] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-14T20:44:41.640686] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-14T20:44:41.653074] [DEBUG] [LOCAL ] WTRG: Trimmed 55365 records to 38237 (keeping 150 days of data) [2025-09-14T20:44:41.678455] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T20:44:41.935281] [DEBUG] [LOCAL ] WTRG: Primary data saved (38237 records). [2025-09-14T20:44:41.935493] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-14T20:44:41.935620] [INFO ] [MAIN ] Update Progress: 2328/2370 symbols completed. WTRG took 27.4s. Estimated remaining: 4m 28s. Rate: 9.4 symbols/min [2025-09-14T20:44:42.104771] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:42.129027] [DEBUG] [LOCAL ] WWW: Loaded 21969 existing records from primary storage. [2025-09-14T20:44:42.129202] [INFO ] [MAIN ] WWW: Loaded 21969 existing records. [2025-09-14T20:44:42.163911] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-14T20:44:42.307436] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:42.307732] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-14T20:44:42.307796] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-14T20:44:42.308305] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-14T20:44:42.308362] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-14T20:44:42.654427] [INFO ] [REMOTE ] WWW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:42.958812] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-14T20:44:43.318051] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T20:44:43.396231] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T20:44:43.758846] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-14T20:44:44.558855] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-14T20:44:44.711466] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T20:44:44.912599] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T20:44:45.358877] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-14T20:44:46.158890] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-14T20:44:46.958904] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-14T20:44:47.021932] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-14T20:44:47.079098] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T20:44:47.444743] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T20:44:47.448001] [INFO ] [REMOTE ] WTS: Full fetch complete (20632 records). [2025-09-14T20:44:47.448150] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-14T20:44:47.764137] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-14T20:44:47.834979] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-14T20:44:47.835133] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-14T20:44:47.835925] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-14T20:44:47.836008] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-14T20:44:47.837767] [DEBUG] [LOCAL ] WTS: Trimmed 20632 records to 13781 (keeping 150 days of data) [2025-09-14T20:44:47.968716] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T20:44:47.983432] [DEBUG] [LOCAL ] WTS: Primary data saved (13781 records). [2025-09-14T20:44:47.984496] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-14T20:44:47.985110] [INFO ] [MAIN ] Update Progress: 2329/2370 symbols completed. WTS took 19.4s. Estimated remaining: 4m 22s. Rate: 9.4 symbols/min [2025-09-14T20:44:48.163014] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:44:48.185699] [DEBUG] [LOCAL ] WY: Loaded 23807 existing records from primary storage. [2025-09-14T20:44:48.185899] [INFO ] [MAIN ] WY: Loaded 23807 existing records. [2025-09-14T20:44:48.381289] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:44:48.381594] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-14T20:44:48.381677] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-14T20:44:48.382331] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-14T20:44:48.382396] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-14T20:44:48.558956] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-14T20:44:48.765011] [INFO ] [REMOTE ] WY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:44:49.358869] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-14T20:44:49.855533] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T20:44:50.158891] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-14T20:44:50.768293] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T20:44:50.958943] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-14T20:44:51.569044] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-14T20:44:51.758992] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-14T20:44:51.761790] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T20:44:52.168761] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T20:44:52.558868] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-14T20:44:53.358800] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-14T20:44:53.611732] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T20:44:54.039195] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T20:44:54.158834] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-14T20:44:54.958813] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-14T20:44:55.064964] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T20:44:55.758843] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-14T20:44:55.817514] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:44:56.458767] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T20:44:56.558861] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-14T20:44:57.358870] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-14T20:44:57.634208] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T20:44:58.098010] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T20:44:58.158833] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-14T20:44:58.958901] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-14T20:44:59.275377] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T20:44:59.758880] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-14T20:44:59.925574] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T20:44:59.961945] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T20:44:59.966781] [INFO ] [REMOTE ] WTTR: Full fetch complete (49146 records). [2025-09-14T20:44:59.966936] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-14T20:45:00.347013] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-14T20:45:00.347123] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-14T20:45:00.348142] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-14T20:45:00.348199] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-14T20:45:00.349241] [DEBUG] [LOCAL ] WTTR: Trimmed 49146 records to 32906 (keeping 150 days of data) [2025-09-14T20:45:00.474583] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T20:45:00.481872] [INFO ] [REMOTE ] WU: Full fetch complete (58099 records). [2025-09-14T20:45:00.482979] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-14T20:45:00.562439] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-14T20:45:00.982064] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-14T20:45:00.982183] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-14T20:45:00.983327] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-14T20:45:00.983791] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-14T20:45:00.987378] [DEBUG] [LOCAL ] WU: Trimmed 58099 records to 40254 (keeping 150 days of data) [2025-09-14T20:45:01.238848] [DEBUG] [LOCAL ] WTTR: Primary data saved (32906 records). [2025-09-14T20:45:01.239859] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-14T20:45:01.240035] [INFO ] [MAIN ] Update Progress: 2330/2370 symbols completed. WTTR took 29.0s. Estimated remaining: 4m 15s. Rate: 9.4 symbols/min [2025-09-14T20:45:01.360098] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-14T20:45:01.451286] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:01.478357] [DEBUG] [LOCAL ] WU: Primary data saved (40254 records). [2025-09-14T20:45:01.479179] [INFO ] [MAIN ] WU: Full history saved. [2025-09-14T20:45:01.479111] [DEBUG] [LOCAL ] XFLT: Loaded 13673 existing records from primary storage. [2025-09-14T20:45:01.479411] [INFO ] [MAIN ] XFLT: Loaded 13673 existing records. [2025-09-14T20:45:01.479310] [INFO ] [MAIN ] Update Progress: 2331/2370 symbols completed. WU took 25.7s. Estimated remaining: 4m 9s. Rate: 9.4 symbols/min [2025-09-14T20:45:01.866925] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:01.873302] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:01.874166] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-14T20:45:01.874258] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-14T20:45:01.874976] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-14T20:45:01.875066] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-14T20:45:02.031799] [DEBUG] [LOCAL ] XHR: Loaded 19720 existing records from primary storage. [2025-09-14T20:45:02.053491] [INFO ] [MAIN ] XHR: Loaded 19720 existing records. [2025-09-14T20:45:02.506577] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:02.527217] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:02.527731] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-14T20:45:02.527950] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-14T20:45:02.528872] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-14T20:45:02.529626] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-14T20:45:02.529740] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-14T20:45:02.895369] [INFO ] [REMOTE ] XHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:02.958872] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-14T20:45:03.371564] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-14T20:45:03.758895] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-14T20:45:05.624689] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-14T20:45:05.633042] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-14T20:45:05.651615] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (3.12 seconds). [2025-09-14T20:45:05.657954] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-14T20:45:05.792566] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (4.43 seconds). [2025-09-14T20:45:06.158852] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-14T20:45:06.411541] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-14T20:45:06.835284] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T20:45:06.965132] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-14T20:45:06.967998] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T20:45:07.758887] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-14T20:45:08.026858] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T20:45:08.435902] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:45:08.441018] [INFO ] [REMOTE ] WWW: Full fetch complete (53392 records). [2025-09-14T20:45:08.441142] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-14T20:45:08.563053] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-14T20:45:08.848573] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-14T20:45:08.849841] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T20:45:08.849906] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-14T20:45:08.857780] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-14T20:45:08.858180] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-14T20:45:08.859297] [DEBUG] [LOCAL ] WWW: Trimmed 53392 records to 36903 (keeping 150 days of data) [2025-09-14T20:45:09.112465] [DEBUG] [LOCAL ] WWW: Primary data saved (36903 records). [2025-09-14T20:45:09.112678] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-14T20:45:09.112811] [INFO ] [MAIN ] Update Progress: 2332/2370 symbols completed. WWW took 27.2s. Estimated remaining: 4m 2s. Rate: 9.4 symbols/min [2025-09-14T20:45:09.280770] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:09.300073] [DEBUG] [LOCAL ] XIFR: Loaded 19620 existing records from primary storage. [2025-09-14T20:45:09.300246] [INFO ] [MAIN ] XIFR: Loaded 19620 existing records. [2025-09-14T20:45:09.363946] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-14T20:45:09.483204] [WARN ] [MAIN ] XIFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:09.483511] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-14T20:45:09.483588] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-14T20:45:09.484125] [DEBUG] [LOCAL ] XIFR: Deleted primary data file. [2025-09-14T20:45:09.484224] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-14T20:45:09.847155] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:10.158855] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-14T20:45:10.297435] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T20:45:10.892024] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T20:45:10.958882] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-14T20:45:11.758857] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-14T20:45:12.289975] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-14T20:45:12.558846] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-14T20:45:12.836446] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T20:45:13.358956] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-14T20:45:13.965687] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T20:45:14.158847] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-14T20:45:14.648798] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T20:45:14.958842] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-14T20:45:14.985142] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T20:45:15.758798] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-14T20:45:16.264745] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-14T20:45:16.558951] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-14T20:45:17.358897] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-14T20:45:17.441841] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-14T20:45:18.064070] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-14T20:45:18.158852] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-14T20:45:18.780671] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-14T20:45:18.958859] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-14T20:45:19.189629] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T20:45:19.758800] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-14T20:45:19.954174] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T20:45:20.053118] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T20:45:20.056224] [INFO ] [REMOTE ] XFLT: Full fetch complete (32361 records). [2025-09-14T20:45:20.056323] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-14T20:45:20.427213] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-14T20:45:20.427345] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-14T20:45:20.428228] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-14T20:45:20.428304] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-14T20:45:20.429326] [DEBUG] [LOCAL ] XFLT: Trimmed 32361 records to 21846 (keeping 150 days of data) [2025-09-14T20:45:20.561988] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-14T20:45:20.568403] [DEBUG] [LOCAL ] XFLT: Primary data saved (21846 records). [2025-09-14T20:45:20.568561] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-14T20:45:20.568702] [INFO ] [MAIN ] Update Progress: 2333/2370 symbols completed. XFLT took 19.3s. Estimated remaining: 3m 56s. Rate: 9.4 symbols/min [2025-09-14T20:45:20.738373] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:20.762992] [DEBUG] [LOCAL ] XOM: Loaded 24153 existing records from primary storage. [2025-09-14T20:45:20.763202] [INFO ] [MAIN ] XOM: Loaded 24153 existing records. [2025-09-14T20:45:20.939410] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:20.939734] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-14T20:45:20.939819] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-14T20:45:20.940417] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-14T20:45:20.940475] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-14T20:45:21.295494] [INFO ] [REMOTE ] XOM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:21.358801] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-14T20:45:21.482525] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T20:45:22.158918] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-14T20:45:22.222592] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T20:45:22.958864] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-14T20:45:23.758937] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-14T20:45:23.765352] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-14T20:45:23.822662] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T20:45:24.464876] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:45:24.470355] [INFO ] [REMOTE ] WY: Full fetch complete (57669 records). [2025-09-14T20:45:24.470468] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-14T20:45:24.566330] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-14T20:45:24.863003] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-14T20:45:24.863250] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-14T20:45:24.864439] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-14T20:45:24.864510] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-14T20:45:24.891442] [DEBUG] [LOCAL ] WY: Trimmed 57669 records to 40009 (keeping 150 days of data) [2025-09-14T20:45:24.893337] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T20:45:25.160509] [DEBUG] [LOCAL ] WY: Primary data saved (40009 records). [2025-09-14T20:45:25.160719] [INFO ] [MAIN ] WY: Full history saved. [2025-09-14T20:45:25.160841] [INFO ] [MAIN ] Update Progress: 2334/2370 symbols completed. WY took 37.2s. Estimated remaining: 3m 50s. Rate: 9.4 symbols/min [2025-09-14T20:45:25.334191] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:25.348462] [DEBUG] [LOCAL ] XPER: Loaded 13369 existing records from primary storage. [2025-09-14T20:45:25.348657] [INFO ] [MAIN ] XPER: Loaded 13369 existing records. [2025-09-14T20:45:25.369001] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-14T20:45:25.524429] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:25.524672] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-14T20:45:25.524732] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-14T20:45:25.525059] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-14T20:45:25.525115] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-14T20:45:25.874029] [INFO ] [REMOTE ] XPER: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:26.112136] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T20:45:26.116525] [INFO ] [REMOTE ] XHR: Full fetch complete (47927 records). [2025-09-14T20:45:26.116663] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-14T20:45:26.164001] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-14T20:45:26.497317] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-14T20:45:26.497422] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-14T20:45:26.498392] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-14T20:45:26.498474] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-14T20:45:26.499580] [DEBUG] [LOCAL ] XHR: Trimmed 47927 records to 33041 (keeping 150 days of data) [2025-09-14T20:45:26.702744] [DEBUG] [LOCAL ] XHR: Primary data saved (33041 records). [2025-09-14T20:45:26.702936] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-14T20:45:26.703076] [INFO ] [MAIN ] Update Progress: 2335/2370 symbols completed. XHR took 25.2s. Estimated remaining: 3m 43s. Rate: 9.4 symbols/min [2025-09-14T20:45:26.887326] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:26.921787] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-14T20:45:26.946987] [DEBUG] [LOCAL ] XPEV: Loaded 24054 existing records from primary storage. [2025-09-14T20:45:26.947159] [INFO ] [MAIN ] XPEV: Loaded 24054 existing records. [2025-09-14T20:45:26.967453] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-14T20:45:27.124389] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:27.124707] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-14T20:45:27.124777] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-14T20:45:27.125401] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-14T20:45:27.125462] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-14T20:45:27.483422] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:27.501207] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T20:45:27.758875] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-14T20:45:28.558881] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-14T20:45:28.855923] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T20:45:29.243634] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T20:45:29.358851] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-14T20:45:29.509728] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T20:45:30.158852] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-14T20:45:30.888527] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T20:45:30.893238] [INFO ] [REMOTE ] XIFR: Full fetch complete (50461 records). [2025-09-14T20:45:30.893398] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-14T20:45:30.963951] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-14T20:45:31.288251] [DEBUG] [VALIDATOR ] XIFR: All expected trading days are present. [2025-09-14T20:45:31.288385] [DEBUG] [VALIDATOR ] XIFR: Primary data validation passed. [2025-09-14T20:45:31.289459] [INFO ] [MAIN ] XIFR: Fetched primary data is valid. [2025-09-14T20:45:31.289523] [DEBUG] [LOCAL ] XIFR: Saving primary data. [2025-09-14T20:45:31.290955] [DEBUG] [LOCAL ] XIFR: Trimmed 50461 records to 33416 (keeping 150 days of data) [2025-09-14T20:45:31.539022] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T20:45:31.554606] [DEBUG] [LOCAL ] XIFR: Primary data saved (33416 records). [2025-09-14T20:45:31.554850] [INFO ] [MAIN ] XIFR: Full history saved. [2025-09-14T20:45:31.555012] [INFO ] [MAIN ] Update Progress: 2336/2370 symbols completed. XIFR took 22.4s. Estimated remaining: 3m 37s. Rate: 9.4 symbols/min [2025-09-14T20:45:31.738129] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:31.759902] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-14T20:45:31.790102] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T20:45:31.810663] [DEBUG] [LOCAL ] XPO: Loaded 20808 existing records from primary storage. [2025-09-14T20:45:31.810873] [INFO ] [MAIN ] XPO: Loaded 20808 existing records. [2025-09-14T20:45:31.991738] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:31.992041] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-14T20:45:31.992124] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-14T20:45:31.992698] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-14T20:45:31.992813] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-14T20:45:32.343719] [INFO ] [REMOTE ] XPO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:32.558846] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-14T20:45:33.347603] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T20:45:33.358778] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-14T20:45:33.500575] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T20:45:34.158850] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-14T20:45:34.958813] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-14T20:45:35.263907] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T20:45:35.758870] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-14T20:45:35.921020] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T20:45:36.558867] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-14T20:45:36.787133] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-14T20:45:36.996017] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T20:45:37.358853] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-14T20:45:37.906738] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T20:45:38.158882] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-14T20:45:38.285250] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T20:45:38.958860] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-14T20:45:39.495158] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T20:45:39.758920] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-14T20:45:40.558856] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-14T20:45:40.834352] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T20:45:40.908675] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T20:45:41.358851] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-14T20:45:42.158863] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-14T20:45:42.947401] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-14T20:45:42.959447] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-14T20:45:43.175248] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T20:45:43.509856] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T20:45:43.758856] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-14T20:45:44.371876] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T20:45:44.487759] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T20:45:44.493790] [INFO ] [REMOTE ] XPEV: Full fetch complete (58325 records). [2025-09-14T20:45:44.493950] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-14T20:45:44.563923] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-14T20:45:44.891972] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-14T20:45:44.892092] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-14T20:45:44.893222] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-14T20:45:44.893282] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-14T20:45:44.894627] [DEBUG] [LOCAL ] XPEV: Trimmed 58325 records to 40389 (keeping 150 days of data) [2025-09-14T20:45:45.154542] [DEBUG] [LOCAL ] XPEV: Primary data saved (40389 records). [2025-09-14T20:45:45.154765] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-14T20:45:45.154875] [INFO ] [MAIN ] Update Progress: 2337/2370 symbols completed. XPEV took 18.5s. Estimated remaining: 3m 31s. Rate: 9.4 symbols/min [2025-09-14T20:45:45.324934] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:45.342778] [DEBUG] [LOCAL ] XPOF: Loaded 17527 existing records from primary storage. [2025-09-14T20:45:45.342952] [INFO ] [MAIN ] XPOF: Loaded 17527 existing records. [2025-09-14T20:45:45.363909] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-14T20:45:45.522012] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:45.522273] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-14T20:45:45.522340] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-14T20:45:45.522801] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-14T20:45:45.522867] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-14T20:45:45.877605] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:45.886500] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T20:45:45.889842] [INFO ] [REMOTE ] XPER: Full fetch complete (32364 records). [2025-09-14T20:45:45.889952] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-14T20:45:46.164967] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-14T20:45:46.266323] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-14T20:45:46.266456] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-14T20:45:46.267265] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-14T20:45:46.267333] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-14T20:45:46.268403] [DEBUG] [LOCAL ] XPER: Trimmed 32364 records to 22174 (keeping 150 days of data) [2025-09-14T20:45:46.411372] [DEBUG] [LOCAL ] XPER: Primary data saved (22174 records). [2025-09-14T20:45:46.411564] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-14T20:45:46.411729] [INFO ] [MAIN ] Update Progress: 2338/2370 symbols completed. XPER took 21.3s. Estimated remaining: 3m 24s. Rate: 9.4 symbols/min [2025-09-14T20:45:46.584074] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:46.604566] [DEBUG] [LOCAL ] XPRO: Loaded 20412 existing records from primary storage. [2025-09-14T20:45:46.604770] [INFO ] [MAIN ] XPRO: Loaded 20412 existing records. [2025-09-14T20:45:46.782131] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:46.782442] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-14T20:45:46.782509] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-14T20:45:46.783117] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-14T20:45:46.783205] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-14T20:45:46.970171] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-14T20:45:47.146808] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:47.624239] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-14T20:45:47.653379] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T20:45:47.758879] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-14T20:45:48.558903] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-14T20:45:48.758009] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T20:45:49.358914] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-14T20:45:49.962003] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T20:45:50.158868] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-14T20:45:50.480591] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-14T20:45:50.746132] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T20:45:50.958917] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-14T20:45:51.488240] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T20:45:51.758856] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-14T20:45:52.558940] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-14T20:45:53.295935] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-14T20:45:53.358794] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-14T20:45:53.416004] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:45:54.158886] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-14T20:45:54.344238] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T20:45:54.793328] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T20:45:54.867993] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:45:54.874583] [INFO ] [REMOTE ] XOM: Full fetch complete (58473 records). [2025-09-14T20:45:54.874805] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-14T20:45:54.963970] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-14T20:45:55.262954] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-14T20:45:55.263078] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-14T20:45:55.264208] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-14T20:45:55.264267] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-14T20:45:55.265593] [DEBUG] [LOCAL ] XOM: Trimmed 58473 records to 40533 (keeping 150 days of data) [2025-09-14T20:45:55.539874] [DEBUG] [LOCAL ] XOM: Primary data saved (40533 records). [2025-09-14T20:45:55.540111] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-14T20:45:55.540261] [INFO ] [MAIN ] Update Progress: 2339/2370 symbols completed. XOM took 35.0s. Estimated remaining: 3m 18s. Rate: 9.4 symbols/min [2025-09-14T20:45:55.713285] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:55.729206] [DEBUG] [LOCAL ] XYF: Loaded 13799 existing records from primary storage. [2025-09-14T20:45:55.729403] [INFO ] [MAIN ] XYF: Loaded 13799 existing records. [2025-09-14T20:45:55.764026] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-14T20:45:55.912098] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:55.912377] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-14T20:45:55.912438] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-14T20:45:55.912932] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-14T20:45:55.912997] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-14T20:45:56.279460] [INFO ] [REMOTE ] XYF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:45:56.558830] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-14T20:45:56.602791] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T20:45:57.337515] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T20:45:57.358779] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-14T20:45:57.947830] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T20:45:58.158896] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-14T20:45:58.866939] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T20:45:58.871785] [INFO ] [REMOTE ] XPO: Full fetch complete (52566 records). [2025-09-14T20:45:58.871903] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-14T20:45:58.964004] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-14T20:45:59.263302] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-14T20:45:59.263705] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-14T20:45:59.265207] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-14T20:45:59.265326] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-14T20:45:59.324787] [DEBUG] [LOCAL ] XPO: Trimmed 52566 records to 35942 (keeping 150 days of data) [2025-09-14T20:45:59.344981] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T20:45:59.601018] [DEBUG] [LOCAL ] XPO: Primary data saved (35942 records). [2025-09-14T20:45:59.601242] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-14T20:45:59.601389] [INFO ] [MAIN ] Update Progress: 2340/2370 symbols completed. XPO took 28.0s. Estimated remaining: 3m 11s. Rate: 9.4 symbols/min [2025-09-14T20:45:59.759962] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-14T20:45:59.782289] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:45:59.805315] [DEBUG] [LOCAL ] XYL: Loaded 20766 existing records from primary storage. [2025-09-14T20:45:59.805506] [INFO ] [MAIN ] XYL: Loaded 20766 existing records. [2025-09-14T20:45:59.984324] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:45:59.984613] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-14T20:45:59.984694] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-14T20:45:59.985237] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-14T20:45:59.985312] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-14T20:46:00.344751] [INFO ] [REMOTE ] XYL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:00.384281] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T20:46:00.558896] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-14T20:46:01.358906] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-14T20:46:01.529997] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T20:46:02.159061] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-14T20:46:02.251447] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T20:46:02.958859] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-14T20:46:02.989031] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T20:46:03.287028] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T20:46:03.758887] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-14T20:46:04.558848] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-14T20:46:04.893767] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T20:46:04.945482] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T20:46:05.358871] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-14T20:46:05.976724] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T20:46:05.980988] [INFO ] [REMOTE ] XPOF: Full fetch complete (41710 records). [2025-09-14T20:46:05.981126] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-14T20:46:06.168610] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-14T20:46:06.360374] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-14T20:46:06.360484] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-14T20:46:06.361356] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-14T20:46:06.361414] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-14T20:46:06.362399] [DEBUG] [LOCAL ] XPOF: Trimmed 41710 records to 28475 (keeping 150 days of data) [2025-09-14T20:46:06.555857] [DEBUG] [LOCAL ] XPOF: Primary data saved (28475 records). [2025-09-14T20:46:06.556059] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-14T20:46:06.556213] [INFO ] [MAIN ] Update Progress: 2341/2370 symbols completed. XPOF took 21.4s. Estimated remaining: 3m 5s. Rate: 9.4 symbols/min [2025-09-14T20:46:06.730393] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:46:06.754514] [DEBUG] [LOCAL ] XYZ: Loaded 24116 existing records from primary storage. [2025-09-14T20:46:06.754722] [INFO ] [MAIN ] XYZ: Loaded 24116 existing records. [2025-09-14T20:46:06.938823] [WARN ] [MAIN ] XYZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:46:06.939132] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-14T20:46:06.939209] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-14T20:46:06.939799] [DEBUG] [LOCAL ] XYZ: Deleted primary data file. [2025-09-14T20:46:06.939874] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-14T20:46:06.970538] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-14T20:46:07.313422] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:07.355254] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T20:46:07.509116] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T20:46:07.758868] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-14T20:46:08.558826] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-14T20:46:08.598503] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T20:46:08.692696] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T20:46:09.358933] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-14T20:46:10.159175] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-14T20:46:10.799446] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-14T20:46:10.826630] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T20:46:10.832013] [INFO ] [REMOTE ] XPRO: Full fetch complete (49822 records). [2025-09-14T20:46:10.832160] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-14T20:46:10.961494] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-14T20:46:11.245134] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-14T20:46:11.245294] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-14T20:46:11.248637] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-14T20:46:11.248830] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-14T20:46:11.264073] [DEBUG] [LOCAL ] XPRO: Trimmed 49822 records to 34357 (keeping 150 days of data) [2025-09-14T20:46:11.289749] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T20:46:11.527038] [DEBUG] [LOCAL ] XPRO: Primary data saved (34357 records). [2025-09-14T20:46:11.527271] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-14T20:46:11.527443] [INFO ] [MAIN ] Update Progress: 2342/2370 symbols completed. XPRO took 25.1s. Estimated remaining: 2m 59s. Rate: 9.4 symbols/min [2025-09-14T20:46:11.706951] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:46:11.725089] [DEBUG] [LOCAL ] YALA: Loaded 15238 existing records from primary storage. [2025-09-14T20:46:11.725310] [INFO ] [MAIN ] YALA: Loaded 15238 existing records. [2025-09-14T20:46:11.764000] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-14T20:46:11.916196] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:46:11.916523] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-14T20:46:11.916712] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-14T20:46:11.917248] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-14T20:46:11.917317] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-14T20:46:12.300089] [INFO ] [REMOTE ] YALA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:12.558876] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-14T20:46:13.074538] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T20:46:13.164331] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T20:46:13.358863] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-14T20:46:14.158855] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-14T20:46:14.348611] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T20:46:14.599012] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T20:46:14.958846] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-14T20:46:15.759623] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-14T20:46:15.764891] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T20:46:16.477614] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T20:46:16.558860] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-14T20:46:16.846971] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T20:46:17.358845] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-14T20:46:18.158869] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-14T20:46:18.355449] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T20:46:18.437486] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T20:46:18.958916] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-14T20:46:19.550158] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T20:46:19.758896] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-14T20:46:20.421933] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T20:46:20.558812] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-14T20:46:20.679752] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T20:46:21.358867] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-14T20:46:22.025040] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T20:46:22.031294] [INFO ] [REMOTE ] XYL: Full fetch complete (52517 records). [2025-09-14T20:46:22.031518] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-14T20:46:22.161034] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-14T20:46:22.380411] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T20:46:22.482359] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-14T20:46:22.482531] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-14T20:46:22.484400] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-14T20:46:22.484486] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-14T20:46:22.486187] [DEBUG] [LOCAL ] XYL: Trimmed 52517 records to 35621 (keeping 150 days of data) [2025-09-14T20:46:22.733888] [DEBUG] [LOCAL ] XYL: Primary data saved (35621 records). [2025-09-14T20:46:22.734131] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-14T20:46:22.734280] [INFO ] [MAIN ] Update Progress: 2343/2370 symbols completed. XYL took 23.1s. Estimated remaining: 2m 52s. Rate: 9.4 symbols/min [2025-09-14T20:46:22.903078] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:46:22.923469] [DEBUG] [LOCAL ] YELP: Loaded 20245 existing records from primary storage. [2025-09-14T20:46:22.923667] [INFO ] [MAIN ] YELP: Loaded 20245 existing records. [2025-09-14T20:46:22.966162] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-14T20:46:23.105675] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:46:23.105972] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-14T20:46:23.106032] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-14T20:46:23.106558] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-14T20:46:23.106626] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-14T20:46:23.463146] [INFO ] [REMOTE ] YELP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:23.758853] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-14T20:46:24.009174] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T20:46:24.227934] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T20:46:24.545928] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T20:46:24.558775] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-14T20:46:25.358887] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-14T20:46:25.768539] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T20:46:25.771589] [INFO ] [REMOTE ] XYF: Full fetch complete (28699 records). [2025-09-14T20:46:25.771727] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-14T20:46:26.149028] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-14T20:46:26.149150] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-14T20:46:26.149881] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-14T20:46:26.149966] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-14T20:46:26.151293] [DEBUG] [LOCAL ] XYF: Trimmed 28699 records to 21847 (keeping 150 days of data) [2025-09-14T20:46:26.206852] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-14T20:46:26.293284] [DEBUG] [LOCAL ] XYF: Primary data saved (21847 records). [2025-09-14T20:46:26.293476] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-14T20:46:26.293595] [INFO ] [MAIN ] Update Progress: 2344/2370 symbols completed. XYF took 30.8s. Estimated remaining: 2m 46s. Rate: 9.4 symbols/min [2025-09-14T20:46:26.464115] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:46:26.487555] [DEBUG] [LOCAL ] YETI: Loaded 23760 existing records from primary storage. [2025-09-14T20:46:26.487758] [INFO ] [MAIN ] YETI: Loaded 23760 existing records. [2025-09-14T20:46:26.667210] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:46:26.667484] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-14T20:46:26.667545] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-14T20:46:26.668207] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-14T20:46:26.668279] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-14T20:46:26.960584] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-14T20:46:27.036900] [INFO ] [REMOTE ] YETI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:27.054597] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T20:46:27.082598] [INFO ] [REMOTE ] XYZ: Full fetch complete (58431 records). [2025-09-14T20:46:27.084123] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T20:46:27.084215] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-14T20:46:27.482238] [DEBUG] [VALIDATOR ] XYZ: All expected trading days are present. [2025-09-14T20:46:27.482369] [DEBUG] [VALIDATOR ] XYZ: Primary data validation passed. [2025-09-14T20:46:27.483542] [INFO ] [MAIN ] XYZ: Fetched primary data is valid. [2025-09-14T20:46:27.483605] [DEBUG] [LOCAL ] XYZ: Saving primary data. [2025-09-14T20:46:27.485008] [DEBUG] [LOCAL ] XYZ: Trimmed 58431 records to 40494 (keeping 150 days of data) [2025-09-14T20:46:27.733980] [DEBUG] [LOCAL ] XYZ: Primary data saved (40494 records). [2025-09-14T20:46:27.734155] [INFO ] [MAIN ] XYZ: Full history saved. [2025-09-14T20:46:27.734259] [INFO ] [MAIN ] Update Progress: 2345/2370 symbols completed. XYZ took 21.2s. Estimated remaining: 2m 39s. Rate: 9.4 symbols/min [2025-09-14T20:46:27.765195] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-14T20:46:27.908302] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:46:27.927526] [DEBUG] [LOCAL ] YEXT: Loaded 19188 existing records from primary storage. [2025-09-14T20:46:27.927756] [INFO ] [MAIN ] YEXT: Loaded 19188 existing records. [2025-09-14T20:46:28.102523] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:46:28.102781] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-14T20:46:28.102842] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-14T20:46:28.103354] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-14T20:46:28.103416] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-14T20:46:28.477476] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:28.558844] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-14T20:46:28.712620] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T20:46:29.035119] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T20:46:29.358835] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-14T20:46:30.041625] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T20:46:30.158833] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-14T20:46:30.380873] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T20:46:30.958852] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-14T20:46:31.758850] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-14T20:46:32.035073] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T20:46:32.558887] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-14T20:46:32.753192] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T20:46:33.253755] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T20:46:33.358887] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-14T20:46:34.158797] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-14T20:46:34.242381] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T20:46:34.582703] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T20:46:34.586307] [INFO ] [REMOTE ] YALA: Full fetch complete (39143 records). [2025-09-14T20:46:34.586466] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-14T20:46:34.964063] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-14T20:46:34.974433] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-14T20:46:34.975843] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-14T20:46:34.977113] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-14T20:46:34.977292] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-14T20:46:34.978568] [DEBUG] [LOCAL ] YALA: Trimmed 39143 records to 29139 (keeping 150 days of data) [2025-09-14T20:46:35.157886] [DEBUG] [LOCAL ] YALA: Primary data saved (29139 records). [2025-09-14T20:46:35.158079] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-14T20:46:35.158203] [INFO ] [MAIN ] Update Progress: 2346/2370 symbols completed. YALA took 23.6s. Estimated remaining: 2m 33s. Rate: 9.4 symbols/min [2025-09-14T20:46:35.368432] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:46:35.393818] [DEBUG] [LOCAL ] YMM: Loaded 23580 existing records from primary storage. [2025-09-14T20:46:35.394023] [INFO ] [MAIN ] YMM: Loaded 23580 existing records. [2025-09-14T20:46:35.572002] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:46:35.572330] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-14T20:46:35.572396] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-14T20:46:35.573095] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-14T20:46:35.573165] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-14T20:46:35.781031] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-14T20:46:35.933330] [INFO ] [REMOTE ] YMM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:35.960575] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T20:46:36.302568] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T20:46:36.558842] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-14T20:46:37.358904] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-14T20:46:37.631089] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T20:46:38.158918] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-14T20:46:38.339836] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T20:46:38.633174] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T20:46:38.958901] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-14T20:46:39.684100] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T20:46:39.758854] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-14T20:46:40.558935] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-14T20:46:40.924809] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T20:46:41.367894] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-14T20:46:41.391597] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T20:46:41.824922] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T20:46:42.158815] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-14T20:46:42.958801] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-14T20:46:43.472075] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T20:46:43.758904] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-14T20:46:43.794986] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T20:46:44.558897] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-14T20:46:44.646203] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T20:46:45.358889] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-14T20:46:45.417939] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T20:46:46.158902] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-14T20:46:46.276464] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T20:46:46.698024] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T20:46:46.958866] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-14T20:46:47.758958] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-14T20:46:47.978965] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T20:46:48.520367] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T20:46:48.558829] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-14T20:46:49.277107] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T20:46:49.358918] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-14T20:46:50.040148] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T20:46:50.044893] [INFO ] [REMOTE ] YELP: Full fetch complete (48948 records). [2025-09-14T20:46:50.045009] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-14T20:46:50.162027] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-14T20:46:50.426798] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-14T20:46:50.427040] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-14T20:46:50.428114] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-14T20:46:50.450666] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-14T20:46:50.452672] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T20:46:50.462520] [DEBUG] [LOCAL ] YELP: Trimmed 48948 records to 33791 (keeping 150 days of data) [2025-09-14T20:46:50.666319] [DEBUG] [LOCAL ] YELP: Primary data saved (33791 records). [2025-09-14T20:46:50.666506] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-14T20:46:50.666627] [INFO ] [MAIN ] Update Progress: 2347/2370 symbols completed. YELP took 27.9s. Estimated remaining: 2m 27s. Rate: 9.4 symbols/min [2025-09-14T20:46:50.840754] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:46:50.861997] [DEBUG] [LOCAL ] YOU: Loaded 22046 existing records from primary storage. [2025-09-14T20:46:50.862166] [INFO ] [MAIN ] YOU: Loaded 22046 existing records. [2025-09-14T20:46:50.962755] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-14T20:46:51.043902] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:46:51.044220] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-14T20:46:51.044305] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-14T20:46:51.044980] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-14T20:46:51.045062] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-14T20:46:51.416385] [INFO ] [REMOTE ] YOU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:51.758873] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-14T20:46:52.140176] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T20:46:52.389853] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T20:46:52.394663] [INFO ] [REMOTE ] YEXT: Full fetch complete (46937 records). [2025-09-14T20:46:52.394815] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-14T20:46:52.578487] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-14T20:46:52.798125] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-14T20:46:52.798247] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-14T20:46:52.799310] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-14T20:46:52.799368] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-14T20:46:52.800425] [DEBUG] [LOCAL ] YEXT: Trimmed 46937 records to 31890 (keeping 150 days of data) [2025-09-14T20:46:52.987779] [DEBUG] [LOCAL ] YEXT: Primary data saved (31890 records). [2025-09-14T20:46:52.987967] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-14T20:46:52.988069] [INFO ] [MAIN ] Update Progress: 2348/2370 symbols completed. YEXT took 25.3s. Estimated remaining: 2m 20s. Rate: 9.4 symbols/min [2025-09-14T20:46:53.158211] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:46:53.180189] [DEBUG] [LOCAL ] YPF: Loaded 22105 existing records from primary storage. [2025-09-14T20:46:53.180421] [INFO ] [MAIN ] YPF: Loaded 22105 existing records. [2025-09-14T20:46:53.354886] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:46:53.355163] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-14T20:46:53.355224] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-14T20:46:53.355902] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-14T20:46:53.355975] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-14T20:46:53.386671] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-14T20:46:53.709856] [INFO ] [REMOTE ] YPF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:46:53.747200] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T20:46:54.158834] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-14T20:46:54.608025] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-14T20:46:54.958948] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-14T20:46:55.158317] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T20:46:55.758827] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-14T20:46:55.840566] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T20:46:56.558920] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-14T20:46:56.898731] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T20:46:57.358852] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-14T20:46:58.158980] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-14T20:46:58.328945] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T20:46:58.385764] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-14T20:46:58.901693] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T20:46:58.920856] [INFO ] [REMOTE ] YMM: Full fetch complete (57380 records). [2025-09-14T20:46:58.931941] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-14T20:46:58.935478] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T20:46:58.965696] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-14T20:46:58.997867] [INFO ] [REMOTE ] YETI: Full fetch complete (57052 records). [2025-09-14T20:46:59.030332] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-14T20:46:59.725059] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-14T20:46:59.735487] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-14T20:46:59.767942] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-14T20:46:59.791487] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-14T20:46:59.809587] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-14T20:46:59.809746] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-14T20:46:59.810092] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-14T20:46:59.811263] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-14T20:46:59.812083] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-14T20:46:59.813396] [DEBUG] [LOCAL ] YMM: Trimmed 57380 records to 39592 (keeping 150 days of data) [2025-09-14T20:46:59.815166] [DEBUG] [LOCAL ] YETI: Trimmed 57052 records to 39768 (keeping 150 days of data) [2025-09-14T20:47:00.288067] [DEBUG] [LOCAL ] YETI: Primary data saved (39768 records). [2025-09-14T20:47:00.288588] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-14T20:47:00.288807] [INFO ] [MAIN ] Update Progress: 2349/2370 symbols completed. YETI took 34.0s. Estimated remaining: 2m 14s. Rate: 9.4 symbols/min [2025-09-14T20:47:00.483681] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:47:00.496100] [DEBUG] [LOCAL ] YRD: Loaded 4611 existing records from primary storage. [2025-09-14T20:47:00.496874] [INFO ] [MAIN ] YRD: Loaded 4611 existing records. [2025-09-14T20:47:00.691379] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:47:00.692573] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-14T20:47:00.692661] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-14T20:47:00.693355] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-14T20:47:00.693429] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-14T20:47:00.904015] [DEBUG] [LOCAL ] YMM: Primary data saved (39592 records). [2025-09-14T20:47:00.974468] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-14T20:47:00.997802] [INFO ] [MAIN ] Update Progress: 2350/2370 symbols completed. YMM took 25.8s. Estimated remaining: 2m 8s. Rate: 9.4 symbols/min [2025-09-14T20:47:01.232483] [INFO ] [REMOTE ] YRD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:47:01.259791] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-14T20:47:01.314246] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:47:01.378608] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-14T20:47:01.410460] [DEBUG] [LOCAL ] YSG: Loaded 14406 existing records from primary storage. [2025-09-14T20:47:01.409958] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-14T20:47:01.410625] [INFO ] [MAIN ] YSG: Loaded 14406 existing records. [2025-09-14T20:47:01.682896] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:47:01.683573] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-14T20:47:01.683723] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-14T20:47:01.684485] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-14T20:47:01.684575] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-14T20:47:01.864292] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T20:47:02.166625] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-14T20:47:02.342469] [INFO ] [REMOTE ] YSG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:47:02.389866] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T20:47:02.958856] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-14T20:47:03.251324] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T20:47:03.758898] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-14T20:47:04.025994] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T20:47:04.176869] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T20:47:04.558859] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-14T20:47:05.358910] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-14T20:47:05.490679] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T20:47:05.614496] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T20:47:06.144392] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T20:47:06.158779] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-14T20:47:06.958845] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-14T20:47:07.285515] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T20:47:07.758908] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-14T20:47:08.558922] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-14T20:47:08.909872] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T20:47:08.943759] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T20:47:09.358849] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-14T20:47:10.131883] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T20:47:10.158780] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-14T20:47:10.280416] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T20:47:10.958850] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-14T20:47:11.758855] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-14T20:47:11.816790] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T20:47:11.923075] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T20:47:12.558846] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-14T20:47:13.358860] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-14T20:47:13.768596] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T20:47:14.158826] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-14T20:47:14.669295] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-14T20:47:14.909170] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T20:47:14.930933] [INFO ] [REMOTE ] YOU: Full fetch complete (54433 records). [2025-09-14T20:47:14.933479] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-14T20:47:14.935061] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T20:47:14.963905] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-14T20:47:15.339255] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-14T20:47:15.339408] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-14T20:47:15.340886] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-14T20:47:15.340946] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-14T20:47:15.342359] [DEBUG] [LOCAL ] YOU: Trimmed 54433 records to 37275 (keeping 150 days of data) [2025-09-14T20:47:15.635980] [DEBUG] [LOCAL ] YOU: Primary data saved (37275 records). [2025-09-14T20:47:15.636207] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-14T20:47:15.636333] [INFO ] [MAIN ] Update Progress: 2351/2370 symbols completed. YOU took 25.0s. Estimated remaining: 2m 1s. Rate: 9.4 symbols/min [2025-09-14T20:47:15.763978] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-14T20:47:15.819709] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:47:15.845353] [DEBUG] [LOCAL ] YUM: Loaded 22808 existing records from primary storage. [2025-09-14T20:47:15.845577] [INFO ] [MAIN ] YUM: Loaded 22808 existing records. [2025-09-14T20:47:16.027775] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:47:16.028138] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-14T20:47:16.028387] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-14T20:47:16.037772] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-14T20:47:16.038153] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T20:47:16.038256] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-14T20:47:16.402489] [INFO ] [REMOTE ] YUM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:47:16.558875] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-14T20:47:17.064093] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T20:47:17.181422] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T20:47:17.358903] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-14T20:47:18.158902] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-14T20:47:18.295154] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T20:47:18.729674] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T20:47:18.958851] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-14T20:47:19.731115] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T20:47:19.732847] [INFO ] [REMOTE ] YRD: Full fetch complete (14636 records). [2025-09-14T20:47:19.732939] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-14T20:47:19.764041] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-14T20:47:20.123533] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-14T20:47:20.123687] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-14T20:47:20.124308] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-14T20:47:20.124373] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-14T20:47:20.125079] [DEBUG] [LOCAL ] YRD: Trimmed 14636 records to 8071 (keeping 150 days of data) [2025-09-14T20:47:20.173989] [DEBUG] [LOCAL ] YRD: Primary data saved (8071 records). [2025-09-14T20:47:20.174189] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-14T20:47:20.174331] [INFO ] [MAIN ] Update Progress: 2352/2370 symbols completed. YRD took 19.9s. Estimated remaining: 1m 55s. Rate: 9.4 symbols/min [2025-09-14T20:47:20.351825] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:47:20.381698] [DEBUG] [LOCAL ] YUMC: Loaded 23487 existing records from primary storage. [2025-09-14T20:47:20.381981] [INFO ] [MAIN ] YUMC: Loaded 23487 existing records. [2025-09-14T20:47:20.566723] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-14T20:47:20.566986] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:47:20.568911] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-14T20:47:20.568982] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-14T20:47:20.569799] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-14T20:47:20.569880] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-14T20:47:20.962192] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:47:21.180440] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T20:47:21.358849] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-14T20:47:22.158910] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-14T20:47:22.245050] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T20:47:22.252092] [INFO ] [REMOTE ] YPF: Full fetch complete (54899 records). [2025-09-14T20:47:22.252315] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-14T20:47:22.532240] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T20:47:22.708464] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-14T20:47:22.708607] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-14T20:47:22.710798] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-14T20:47:22.710883] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-14T20:47:22.712445] [DEBUG] [LOCAL ] YPF: Trimmed 54899 records to 37780 (keeping 150 days of data) [2025-09-14T20:47:22.959734] [DEBUG] [LOCAL ] YPF: Primary data saved (37780 records). [2025-09-14T20:47:22.959924] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-14T20:47:22.960286] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-14T20:47:22.960621] [INFO ] [MAIN ] Update Progress: 2353/2370 symbols completed. YPF took 30.0s. Estimated remaining: 1m 48s. Rate: 9.4 symbols/min [2025-09-14T20:47:23.143107] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:47:23.168416] [DEBUG] [LOCAL ] ZBH: Loaded 22713 existing records from primary storage. [2025-09-14T20:47:23.168669] [INFO ] [MAIN ] ZBH: Loaded 22713 existing records. [2025-09-14T20:47:23.371297] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T20:47:23.371492] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:47:23.375390] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-14T20:47:23.375500] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-14T20:47:23.375591] [INFO ] [REMOTE ] YSG: Full fetch complete (25480 records). [2025-09-14T20:47:23.375913] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-14T20:47:23.408320] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-14T20:47:23.456857] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-14T20:47:23.773339] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-14T20:47:24.121822] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-14T20:47:24.148378] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-14T20:47:24.174885] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-14T20:47:24.179839] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-14T20:47:24.179715] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:47:24.182093] [DEBUG] [LOCAL ] YSG: Trimmed 25480 records to 19819 (keeping 150 days of data) [2025-09-14T20:47:24.331522] [DEBUG] [LOCAL ] YSG: Primary data saved (19819 records). [2025-09-14T20:47:24.333975] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T20:47:24.344859] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-14T20:47:24.345763] [INFO ] [MAIN ] Update Progress: 2354/2370 symbols completed. YSG took 23.3s. Estimated remaining: 1m 42s. Rate: 9.4 symbols/min [2025-09-14T20:47:24.530204] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:47:24.546824] [DEBUG] [LOCAL ] ZEPP: Loaded 12870 existing records from primary storage. [2025-09-14T20:47:24.547087] [INFO ] [MAIN ] ZEPP: Loaded 12870 existing records. [2025-09-14T20:47:24.569322] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-14T20:47:24.739302] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:47:24.739588] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-14T20:47:24.739678] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-14T20:47:24.740080] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-14T20:47:24.740166] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-14T20:47:25.093416] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:47:25.358842] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-14T20:47:25.537382] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T20:47:25.634212] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T20:47:25.891905] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T20:47:26.158841] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-14T20:47:26.958881] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-14T20:47:27.758844] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-14T20:47:27.993970] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T20:47:28.039176] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T20:47:28.558858] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-14T20:47:29.358860] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-14T20:47:29.751539] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T20:47:30.158845] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-14T20:47:30.201083] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T20:47:30.351255] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T20:47:30.837298] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T20:47:30.958911] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-14T20:47:31.758858] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-14T20:47:31.836719] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T20:47:32.558890] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-14T20:47:33.144677] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T20:47:33.358902] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-14T20:47:33.721477] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T20:47:34.064788] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-14T20:47:34.158847] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-14T20:47:34.835392] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T20:47:34.958840] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-14T20:47:35.758903] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-14T20:47:36.558892] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-14T20:47:36.815266] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T20:47:36.973026] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T20:47:37.358898] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-14T20:47:37.374740] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T20:47:37.380156] [INFO ] [REMOTE ] YUM: Full fetch complete (55857 records). [2025-09-14T20:47:37.380290] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-14T20:47:37.777096] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-14T20:47:37.777242] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-14T20:47:37.779040] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-14T20:47:37.779168] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-14T20:47:37.780732] [DEBUG] [LOCAL ] YUM: Trimmed 55857 records to 38411 (keeping 150 days of data) [2025-09-14T20:47:38.055027] [DEBUG] [LOCAL ] YUM: Primary data saved (38411 records). [2025-09-14T20:47:38.055281] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-14T20:47:38.055428] [INFO ] [MAIN ] Update Progress: 2355/2370 symbols completed. YUM took 22.4s. Estimated remaining: 1m 36s. Rate: 9.4 symbols/min [2025-09-14T20:47:38.163555] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-14T20:47:38.240802] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:47:38.268442] [DEBUG] [LOCAL ] ZETA: Loaded 24120 existing records from primary storage. [2025-09-14T20:47:38.268721] [INFO ] [MAIN ] ZETA: Loaded 24120 existing records. [2025-09-14T20:47:38.454194] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:47:38.454528] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-14T20:47:38.454596] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-14T20:47:38.455263] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-14T20:47:38.455344] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-14T20:47:38.831112] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:47:38.958857] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-14T20:47:39.116417] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T20:47:39.758904] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-14T20:47:40.139928] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T20:47:40.558867] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-14T20:47:40.818340] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T20:47:40.935495] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T20:47:40.939474] [INFO ] [REMOTE ] ZEPP: Full fetch complete (15669 records). [2025-09-14T20:47:40.939573] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-14T20:47:41.321233] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-14T20:47:41.321358] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-14T20:47:41.321832] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-14T20:47:41.321904] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-14T20:47:41.322583] [DEBUG] [LOCAL ] ZEPP: Trimmed 15669 records to 14319 (keeping 150 days of data) [2025-09-14T20:47:41.359021] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-14T20:47:41.417724] [DEBUG] [LOCAL ] ZEPP: Primary data saved (14319 records). [2025-09-14T20:47:41.417941] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-14T20:47:41.418057] [INFO ] [MAIN ] Update Progress: 2356/2370 symbols completed. ZEPP took 17.1s. Estimated remaining: 1m 29s. Rate: 9.4 symbols/min [2025-09-14T20:47:41.614093] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:47:41.633823] [DEBUG] [LOCAL ] ZGN: Loaded 18261 existing records from primary storage. [2025-09-14T20:47:41.634021] [INFO ] [MAIN ] ZGN: Loaded 18261 existing records. [2025-09-14T20:47:41.810362] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:47:41.810677] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-14T20:47:41.810743] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-14T20:47:41.811280] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-14T20:47:41.811350] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-14T20:47:42.162491] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-14T20:47:42.165993] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:47:42.363306] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T20:47:42.958932] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-14T20:47:43.300330] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T20:47:43.758906] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-14T20:47:44.118582] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T20:47:44.558897] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-14T20:47:44.999747] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T20:47:45.358878] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-14T20:47:45.411340] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T20:47:46.158913] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-14T20:47:46.841436] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-14T20:47:46.958870] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-14T20:47:47.155006] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T20:47:47.683518] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T20:47:47.758821] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-14T20:47:48.558936] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-14T20:47:48.816959] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T20:47:48.914415] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-14T20:47:48.920919] [INFO ] [REMOTE ] YUMC: Full fetch complete (57387 records). [2025-09-14T20:47:48.921086] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-14T20:47:49.332120] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-14T20:47:49.332272] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-14T20:47:49.334439] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-14T20:47:49.334505] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-14T20:47:49.336331] [DEBUG] [LOCAL ] YUMC: Trimmed 57387 records to 39581 (keeping 150 days of data) [2025-09-14T20:47:49.405297] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-14T20:47:49.645740] [DEBUG] [LOCAL ] YUMC: Primary data saved (39581 records). [2025-09-14T20:47:49.646000] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-14T20:47:49.646364] [INFO ] [MAIN ] Update Progress: 2357/2370 symbols completed. YUMC took 29.5s. Estimated remaining: 1m 23s. Rate: 9.4 symbols/min [2025-09-14T20:47:50.158895] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-14T20:47:50.295205] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T20:47:50.958908] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-14T20:47:51.597659] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-14T20:47:51.758890] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-14T20:47:51.790598] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T20:47:52.558857] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-14T20:47:52.728006] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T20:47:53.358916] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-14T20:47:54.109367] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T20:47:54.115031] [INFO ] [REMOTE ] ZBH: Full fetch complete (55752 records). [2025-09-14T20:47:54.156748] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-14T20:47:54.161445] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-14T20:47:54.294754] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-14T20:47:54.650711] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-14T20:47:54.674183] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-14T20:47:54.678086] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-14T20:47:54.683114] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T20:47:54.698180] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-14T20:47:54.702868] [DEBUG] [LOCAL ] ZBH: Trimmed 55752 records to 38460 (keeping 150 days of data) [2025-09-14T20:47:54.993858] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-14T20:47:55.123739] [DEBUG] [LOCAL ] ZBH: Primary data saved (38460 records). [2025-09-14T20:47:55.124039] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-14T20:47:55.124231] [INFO ] [MAIN ] Update Progress: 2358/2370 symbols completed. ZBH took 32.2s. Estimated remaining: 1m 17s. Rate: 9.4 symbols/min [2025-09-14T20:47:56.519986] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T20:47:56.529062] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-14T20:47:57.024335] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-14T20:47:57.037212] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-14T20:47:57.712982] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T20:47:57.722327] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-14T20:47:58.961596] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-14T20:47:58.967149] [INFO ] [REMOTE ] ZETA: Full fetch complete (58275 records). [2025-09-14T20:47:58.967306] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-14T20:47:59.362316] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-14T20:47:59.362669] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-14T20:47:59.365160] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-14T20:47:59.365313] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-14T20:47:59.367704] [DEBUG] [LOCAL ] ZETA: Trimmed 58275 records to 40363 (keeping 150 days of data) [2025-09-14T20:47:59.498030] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T20:47:59.511444] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-14T20:47:59.683309] [DEBUG] [LOCAL ] ZETA: Primary data saved (40363 records). [2025-09-14T20:47:59.683525] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-14T20:47:59.683744] [INFO ] [MAIN ] Update Progress: 2359/2370 symbols completed. ZETA took 21.6s. Estimated remaining: 1m 10s. Rate: 9.4 symbols/min [2025-09-14T20:48:01.176381] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T20:48:01.185058] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-14T20:48:03.792277] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-14T20:48:03.796846] [INFO ] [REMOTE ] ZGN: Full fetch complete (43932 records). [2025-09-14T20:48:03.797024] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-14T20:48:04.211768] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-14T20:48:04.211899] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-14T20:48:04.212915] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-14T20:48:04.212978] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-14T20:48:04.214299] [DEBUG] [LOCAL ] ZGN: Trimmed 43932 records to 30541 (keeping 150 days of data) [2025-09-14T20:48:04.418871] [DEBUG] [LOCAL ] ZGN: Primary data saved (30541 records). [2025-09-14T20:48:04.419063] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-14T20:48:04.419180] [INFO ] [MAIN ] Update Progress: 2360/2370 symbols completed. ZGN took 23.0s. Estimated remaining: 1m 4s. Rate: 9.4 symbols/min [2025-09-14T20:48:05.101303] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:05.128495] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:05.166511] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:05.147489] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:05.214921] [DEBUG] [LOCAL ] ZIM: Loaded 23983 existing records from primary storage. [2025-09-14T20:48:05.215418] [INFO ] [MAIN ] ZIM: Loaded 23983 existing records. [2025-09-14T20:48:05.282990] [DEBUG] [LOCAL ] ZH: Loaded 12007 existing records from primary storage. [2025-09-14T20:48:05.340986] [DEBUG] [LOCAL ] ZK: Loaded 16120 existing records from primary storage. [2025-09-14T20:48:05.329286] [INFO ] [MAIN ] ZH: Loaded 12007 existing records. [2025-09-14T20:48:05.340873] [DEBUG] [LOCAL ] ZIP: Loaded 18999 existing records from primary storage. [2025-09-14T20:48:05.341315] [INFO ] [MAIN ] ZK: Loaded 16120 existing records. [2025-09-14T20:48:05.352178] [INFO ] [MAIN ] ZIP: Loaded 18999 existing records. [2025-09-14T20:48:05.666767] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:05.734631] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-14T20:48:05.790128] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-14T20:48:05.842917] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:05.950173] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-14T20:48:05.922632] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-14T20:48:05.961823] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:05.982266] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-14T20:48:05.982208] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-14T20:48:05.982028] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:05.982761] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-14T20:48:05.988123] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-14T20:48:05.994131] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-14T20:48:05.994237] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-14T20:48:06.024512] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-14T20:48:06.019223] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-14T20:48:06.029746] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-14T20:48:06.053248] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-14T20:48:06.064916] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-14T20:48:06.180965] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-14T20:48:07.248168] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:07.344603] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-14T20:48:07.366935] [INFO ] [REMOTE ] ZH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:07.418928] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-14T20:48:07.550759] [INFO ] [REMOTE ] ZK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:07.555822] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:07.557418] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-14T20:48:07.557146] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-14T20:48:09.035242] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T20:48:09.042909] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-14T20:48:09.097884] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T20:48:09.106194] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-14T20:48:09.192265] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T20:48:09.201453] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-14T20:48:09.796180] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-14T20:48:09.806801] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-14T20:48:10.954534] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T20:48:10.963121] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-14T20:48:11.189861] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T20:48:11.201097] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-14T20:48:11.277338] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-14T20:48:11.287137] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-14T20:48:12.239900] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T20:48:12.247513] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-14T20:48:12.448271] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-14T20:48:12.461553] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-14T20:48:12.770995] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T20:48:12.780846] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-14T20:48:13.083627] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T20:48:13.093951] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-14T20:48:13.587855] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T20:48:13.592470] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-14T20:48:14.534744] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T20:48:14.544574] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-14T20:48:14.587198] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T20:48:14.593813] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-14T20:48:14.780215] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T20:48:14.790169] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-14T20:48:14.910024] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-14T20:48:14.958836] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-14T20:48:15.920893] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T20:48:15.927573] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-14T20:48:16.014536] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T20:48:16.158179] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T20:48:16.558850] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-14T20:48:17.358878] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-14T20:48:17.532102] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-14T20:48:18.158877] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-14T20:48:18.584764] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T20:48:18.792990] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T20:48:18.852212] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-14T20:48:18.958855] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-14T20:48:19.758880] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-14T20:48:20.127004] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T20:48:20.391704] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T20:48:20.558863] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-14T20:48:21.358855] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-14T20:48:21.407911] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T20:48:21.465602] [DEBUG] [REMOTE ] ZH: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-14T20:48:21.466150] [WARN ] [REMOTE ] ZH: No data returned for month 2025-09 [2025-09-14T20:48:21.466256] [INFO ] [REMOTE ] ZH: Full fetch complete (29776 records). [2025-09-14T20:48:21.466351] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-14T20:48:21.467523] [FATAL] [VALIDATOR ] ZH: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T20:48:21.467621] [FATAL] [MAIN ] ZH: Fetched primary data is invalid. Refusing to save it. [2025-09-14T20:48:21.467703] [WARN ] [MAIN ] ZH: Deleting existing primary and derivative data due to validation failure. [2025-09-14T20:48:21.467767] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-14T20:48:21.468096] [DEBUG] [LOCAL ] ZH: No primary data file found to delete. [2025-09-14T20:48:21.468408] [INFO ] [LOCAL ] ZH: Starting deletion of derivative data. [2025-09-14T20:48:21.468513] [DEBUG] [LOCAL ] ZH: No derivative data file found to delete. [2025-09-14T20:48:21.468745] [INFO ] [MAIN ] Update Progress: 2361/2370 symbols completed. ZH took 17.0s. Estimated remaining: 57.4s. Rate: 9.4 symbols/min [2025-09-14T20:48:21.652270] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:21.659190] [DEBUG] [LOCAL ] ZKH: Loaded 4633 existing records from primary storage. [2025-09-14T20:48:21.659400] [INFO ] [MAIN ] ZKH: Loaded 4633 existing records. [2025-09-14T20:48:21.849245] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:21.849599] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-14T20:48:21.849684] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-14T20:48:21.850022] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-14T20:48:21.850088] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-14T20:48:22.159844] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-14T20:48:22.214514] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:22.230902] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-14T20:48:22.235999] [INFO ] [REMOTE ] ZK: Full fetch complete (43648 records). [2025-09-14T20:48:22.236192] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-14T20:48:22.621676] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-14T20:48:22.621836] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-14T20:48:22.623064] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-14T20:48:22.623164] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-14T20:48:22.624482] [DEBUG] [LOCAL ] ZK: Trimmed 43648 records to 28834 (keeping 150 days of data) [2025-09-14T20:48:22.820394] [DEBUG] [LOCAL ] ZK: Primary data saved (28834 records). [2025-09-14T20:48:22.820623] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-14T20:48:22.820775] [INFO ] [MAIN ] Update Progress: 2362/2370 symbols completed. ZK took 18.4s. Estimated remaining: 51.0s. Rate: 9.4 symbols/min [2025-09-14T20:48:22.961351] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-14T20:48:22.994284] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:23.021607] [DEBUG] [LOCAL ] ZTO: Loaded 21798 existing records from primary storage. [2025-09-14T20:48:23.021831] [INFO ] [MAIN ] ZTO: Loaded 21798 existing records. [2025-09-14T20:48:23.214673] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:23.215112] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-14T20:48:23.215186] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-14T20:48:23.215956] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-14T20:48:23.216066] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-14T20:48:23.586133] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:23.758856] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-14T20:48:23.813483] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T20:48:24.558833] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-14T20:48:24.638525] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-14T20:48:25.358832] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-14T20:48:25.396579] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T20:48:25.563206] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T20:48:26.158908] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-14T20:48:26.502277] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-14T20:48:26.506497] [INFO ] [REMOTE ] ZIP: Full fetch complete (47459 records). [2025-09-14T20:48:26.506613] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-14T20:48:26.879065] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-14T20:48:26.879191] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-14T20:48:26.880164] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-14T20:48:26.880222] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-14T20:48:26.881316] [DEBUG] [LOCAL ] ZIP: Trimmed 47459 records to 32834 (keeping 150 days of data) [2025-09-14T20:48:26.971807] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-14T20:48:27.107175] [DEBUG] [LOCAL ] ZIP: Primary data saved (32834 records). [2025-09-14T20:48:27.107445] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-14T20:48:27.107581] [INFO ] [MAIN ] Update Progress: 2363/2370 symbols completed. ZIP took 22.7s. Estimated remaining: 44.7s. Rate: 9.4 symbols/min [2025-09-14T20:48:27.287046] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:27.298209] [DEBUG] [LOCAL ] ZTR: Loaded 8486 existing records from primary storage. [2025-09-14T20:48:27.298416] [INFO ] [MAIN ] ZTR: Loaded 8486 existing records. [2025-09-14T20:48:27.483022] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:27.483343] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-14T20:48:27.483418] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-14T20:48:27.483830] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-14T20:48:27.483899] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-14T20:48:27.769592] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-14T20:48:27.862553] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:28.551536] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T20:48:28.554147] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-14T20:48:28.567634] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-14T20:48:28.783160] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T20:48:29.358796] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-14T20:48:29.731320] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T20:48:30.158858] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-14T20:48:30.958875] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-14T20:48:31.171375] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T20:48:31.588057] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T20:48:31.758859] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-14T20:48:32.199249] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-14T20:48:32.205495] [INFO ] [REMOTE ] ZIM: Full fetch complete (58212 records). [2025-09-14T20:48:32.205731] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-14T20:48:32.495028] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T20:48:32.560181] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-14T20:48:32.597794] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-14T20:48:32.597920] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-14T20:48:32.599090] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-14T20:48:32.599157] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-14T20:48:32.600608] [DEBUG] [LOCAL ] ZIM: Trimmed 58212 records to 40307 (keeping 150 days of data) [2025-09-14T20:48:32.892443] [DEBUG] [LOCAL ] ZIM: Primary data saved (40307 records). [2025-09-14T20:48:32.892619] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-14T20:48:32.892743] [INFO ] [MAIN ] Update Progress: 2364/2370 symbols completed. ZIM took 28.5s. Estimated remaining: 38.3s. Rate: 9.4 symbols/min [2025-09-14T20:48:33.061722] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:33.086036] [DEBUG] [LOCAL ] ZTS: Loaded 23796 existing records from primary storage. [2025-09-14T20:48:33.086248] [INFO ] [MAIN ] ZTS: Loaded 23796 existing records. [2025-09-14T20:48:33.263495] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:33.263779] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-14T20:48:33.263842] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-14T20:48:33.264418] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-14T20:48:33.264478] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-14T20:48:33.363725] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-14T20:48:33.624271] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:33.635248] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T20:48:34.158834] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-14T20:48:34.958904] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-14T20:48:35.263928] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T20:48:35.285905] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T20:48:35.758894] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-14T20:48:35.911098] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T20:48:36.558856] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-14T20:48:36.579788] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T20:48:37.358846] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-14T20:48:38.158811] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-14T20:48:38.214426] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T20:48:38.356967] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T20:48:38.735992] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T20:48:38.958908] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-14T20:48:39.758857] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-14T20:48:39.882394] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T20:48:40.558909] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-14T20:48:41.241310] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T20:48:41.358863] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-14T20:48:42.158901] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-14T20:48:42.395750] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T20:48:42.958845] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-14T20:48:43.148178] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T20:48:43.194845] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T20:48:43.758842] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-14T20:48:44.456719] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T20:48:44.458955] [INFO ] [REMOTE ] ZTR: Full fetch complete (19243 records). [2025-09-14T20:48:44.459043] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-14T20:48:44.558847] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-14T20:48:44.823943] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-14T20:48:44.824238] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-14T20:48:44.825522] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-14T20:48:44.825797] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-14T20:48:44.827538] [DEBUG] [LOCAL ] ZTR: Trimmed 19243 records to 12420 (keeping 150 days of data) [2025-09-14T20:48:44.918393] [DEBUG] [LOCAL ] ZTR: Primary data saved (12420 records). [2025-09-14T20:48:44.918769] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-14T20:48:44.918919] [INFO ] [MAIN ] Update Progress: 2365/2370 symbols completed. ZTR took 17.8s. Estimated remaining: 31.9s. Rate: 9.4 symbols/min [2025-09-14T20:48:45.153717] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:45.178014] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T20:48:45.207612] [DEBUG] [LOCAL ] ZVIA: Loaded 17253 existing records from primary storage. [2025-09-14T20:48:45.207862] [INFO ] [MAIN ] ZVIA: Loaded 17253 existing records. [2025-09-14T20:48:45.334473] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T20:48:45.362865] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-14T20:48:45.363236] [INFO ] [REMOTE ] ZKH: Full fetch complete (9325 records). [2025-09-14T20:48:45.420129] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:45.421344] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-14T20:48:45.422434] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-14T20:48:45.422534] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-14T20:48:45.428464] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-14T20:48:45.435622] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-14T20:48:46.159265] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-14T20:48:46.201814] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:46.251301] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-14T20:48:46.251445] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-14T20:48:46.251966] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-14T20:48:46.252038] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-14T20:48:46.252809] [DEBUG] [LOCAL ] ZKH: Trimmed 9325 records to 5850 (keeping 150 days of data) [2025-09-14T20:48:46.290100] [DEBUG] [LOCAL ] ZKH: Primary data saved (5850 records). [2025-09-14T20:48:46.290342] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-14T20:48:46.290588] [INFO ] [MAIN ] Update Progress: 2366/2370 symbols completed. ZKH took 24.8s. Estimated remaining: 25.5s. Rate: 9.4 symbols/min [2025-09-14T20:48:46.480769] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T20:48:46.502939] [DEBUG] [LOCAL ] ZWS: Loaded 19140 existing records from primary storage. [2025-09-14T20:48:46.503208] [INFO ] [MAIN ] ZWS: Loaded 19140 existing records. [2025-09-14T20:48:46.714149] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T20:48:46.714700] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-14T20:48:46.714825] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-14T20:48:46.715434] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-14T20:48:46.715510] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-14T20:48:46.967092] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-14T20:48:47.083334] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T20:48:47.124952] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T20:48:47.758891] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-14T20:48:48.107087] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T20:48:48.489911] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T20:48:48.558899] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-14T20:48:49.358898] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-14T20:48:49.509230] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T20:48:50.021876] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T20:48:50.158851] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-14T20:48:50.765146] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T20:48:50.771131] [INFO ] [REMOTE ] ZTO: Full fetch complete (54919 records). [2025-09-14T20:48:50.771276] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-14T20:48:50.969440] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-14T20:48:51.175023] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-14T20:48:51.175169] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-14T20:48:51.176989] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-14T20:48:51.177058] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-14T20:48:51.178675] [DEBUG] [LOCAL ] ZTO: Trimmed 54919 records to 37359 (keeping 150 days of data) [2025-09-14T20:48:51.419495] [DEBUG] [LOCAL ] ZTO: Primary data saved (37359 records). [2025-09-14T20:48:51.419736] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-14T20:48:51.419859] [INFO ] [MAIN ] Update Progress: 2367/2370 symbols completed. ZTO took 28.6s. Estimated remaining: 19.1s. Rate: 9.4 symbols/min [2025-09-14T20:48:51.758908] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-14T20:48:52.078813] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T20:48:52.163666] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T20:48:52.558896] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-14T20:48:53.037833] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T20:48:53.358849] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-14T20:48:54.060662] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T20:48:54.158819] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-14T20:48:54.863806] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T20:48:54.958840] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-14T20:48:55.318628] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T20:48:55.758845] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-14T20:48:56.558900] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-14T20:48:56.747428] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T20:48:57.176474] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T20:48:57.358882] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-14T20:48:57.907729] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T20:48:58.158873] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-14T20:48:58.714632] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T20:48:58.958903] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-14T20:48:59.758877] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-14T20:48:59.854064] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T20:49:00.541293] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T20:49:00.558774] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-14T20:49:01.359008] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-14T20:49:01.756041] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T20:49:01.987498] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T20:49:01.991897] [INFO ] [REMOTE ] ZVIA: Full fetch complete (38657 records). [2025-09-14T20:49:01.992138] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-14T20:49:02.163631] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-14T20:49:02.396668] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-14T20:49:02.396824] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-14T20:49:02.398128] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-14T20:49:02.398203] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-14T20:49:02.399816] [DEBUG] [LOCAL ] ZVIA: Trimmed 38657 records to 27034 (keeping 150 days of data) [2025-09-14T20:49:02.570880] [DEBUG] [LOCAL ] ZVIA: Primary data saved (27034 records). [2025-09-14T20:49:02.571100] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-14T20:49:02.571229] [INFO ] [MAIN ] Update Progress: 2368/2370 symbols completed. ZVIA took 17.7s. Estimated remaining: 12.8s. Rate: 9.4 symbols/min [2025-09-14T20:49:02.961431] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T20:49:02.968950] [INFO ] [REMOTE ] ZTS: Full fetch complete (57663 records). [2025-09-14T20:49:02.969247] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-14T20:49:03.217399] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T20:49:03.327803] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-14T20:49:03.461231] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-14T20:49:03.461376] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-14T20:49:03.463025] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-14T20:49:03.463092] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-14T20:49:03.465072] [DEBUG] [LOCAL ] ZTS: Trimmed 57663 records to 39998 (keeping 150 days of data) [2025-09-14T20:49:03.771134] [DEBUG] [LOCAL ] ZTS: Primary data saved (39998 records). [2025-09-14T20:49:03.771423] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-14T20:49:03.771621] [INFO ] [MAIN ] Update Progress: 2369/2370 symbols completed. ZTS took 30.9s. Estimated remaining: 6.4s. Rate: 9.4 symbols/min [2025-09-14T20:49:04.100211] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T20:49:04.104817] [INFO ] [REMOTE ] ZWS: Full fetch complete (46440 records). [2025-09-14T20:49:04.104957] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-14T20:49:04.492918] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-14T20:49:04.493061] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-14T20:49:04.494859] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-14T20:49:04.494931] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-14T20:49:04.496454] [DEBUG] [LOCAL ] ZWS: Trimmed 46440 records to 31369 (keeping 150 days of data) [2025-09-14T20:49:04.711703] [DEBUG] [LOCAL ] ZWS: Primary data saved (31369 records). [2025-09-14T20:49:04.711940] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-14T20:49:04.712085] [INFO ] [MAIN ] Update Progress: 2370/2370 symbols completed. ZWS took 18.4s. Estimated remaining: 0.0s. Rate: 9.4 symbols/min [2025-09-14T20:49:04.713923] [INFO ] [MAIN ] Parallel update completed in 4h 11m 53s [2025-09-14T20:49:04.714217] [WARN ] [MAIN ] Failed symbols (144): AAM, AAUC, AD, AHL, AII, AJG, AKR, AL, AKA, AMBQ... [2025-09-14T20:49:04.714370] [INFO ] [MAIN ] Update success rate: 93.9% (2226/2370 symbols) [2025-09-14T20:49:05.259187] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2226/2370 @ 93.92%)' [2025-09-14T20:49:05.261100] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-14T20:49:05.261346] [INFO ] [STATE ] Last completion updated: 2025-09-14T20:49:05.261175 [2025-09-14T20:49:05.261720] [WARN ] [STATE ] State set to: RUNNING [2025-09-14T20:49:05.261790] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-14T20:49:05.261936] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-14T20:49:05.261997] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-14T20:49:05.262358] [INFO ] [LOCAL ] Deleted 0 derivative data files. [2025-09-14T20:49:05.262429] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-14T20:49:05.265056] [INFO ] [LOCAL ] Found 2226 symbols with primary data. [2025-09-14T20:49:05.265342] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2226 symbols [2025-09-14T20:49:05.266334] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:05.266593] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:05.268667] [INFO ] [MAIN ] AACT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:05.282980] [DEBUG] [LOCAL ] AACT: Loaded 8258 existing records from primary storage. [2025-09-14T20:49:05.283186] [INFO ] [MAIN ] AACT: Loaded 8258 primary data records. [2025-09-14T20:49:05.529181] [DEBUG] [LOCAL ] A: Loaded 38079 existing records from primary storage. [2025-09-14T20:49:05.619032] [DEBUG] [LOCAL ] AA: Loaded 40362 existing records from primary storage. [2025-09-14T20:49:05.619284] [INFO ] [MAIN ] A: Loaded 38079 primary data records. [2025-09-14T20:49:05.619687] [INFO ] [MAIN ] AA: Loaded 40362 primary data records. [2025-09-14T20:49:06.250595] [DEBUG] [MAIN ] AACT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:06.252080] [INFO ] [MAIN ] AACT: Generated 1352 derivative records from 8258 primary records. [2025-09-14T20:49:06.252382] [DEBUG] [LOCAL ] AACT: Saving derivative data. [2025-09-14T20:49:06.275357] [DEBUG] [LOCAL ] AACT: Derivative data saved (1352 records). [2025-09-14T20:49:06.282432] [INFO ] [MAIN ] AACT: Successfully saved derivative data. [2025-09-14T20:49:06.288340] [INFO ] [MAIN ] Derivative Progress: 1/2226 symbols completed. AACT took 1.0s. Estimated remaining: 37m 57s. Rate: 58.6 symbols/min [2025-09-14T20:49:06.289124] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:06.289793] [DEBUG] [MAIN ] A: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:06.291739] [INFO ] [MAIN ] A: Generated 1352 derivative records from 38079 primary records. [2025-09-14T20:49:06.294173] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-14T20:49:06.307187] [DEBUG] [MAIN ] AA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:06.324051] [INFO ] [MAIN ] AA: Generated 1352 derivative records from 40362 primary records. [2025-09-14T20:49:06.327463] [DEBUG] [LOCAL ] A: Derivative data saved (1352 records). [2025-09-14T20:49:06.327676] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-14T20:49:06.327922] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-14T20:49:06.330358] [INFO ] [MAIN ] Derivative Progress: 2/2226 symbols completed. A took 1.1s. Estimated remaining: 19m 45s. Rate: 112.7 symbols/min [2025-09-14T20:49:06.331467] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:06.355071] [DEBUG] [LOCAL ] AAMI: Loaded 18336 existing records from primary storage. [2025-09-14T20:49:06.357385] [INFO ] [MAIN ] AAMI: Loaded 18336 primary data records. [2025-09-14T20:49:06.358359] [DEBUG] [LOCAL ] AA: Derivative data saved (1352 records). [2025-09-14T20:49:06.399527] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-14T20:49:06.439287] [INFO ] [MAIN ] Derivative Progress: 3/2226 symbols completed. AA took 1.2s. Estimated remaining: 14m 30s. Rate: 153.3 symbols/min [2025-09-14T20:49:06.456480] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:06.742203] [DEBUG] [LOCAL ] AAP: Loaded 39164 existing records from primary storage. [2025-09-14T20:49:06.748557] [INFO ] [MAIN ] AAP: Loaded 39164 primary data records. [2025-09-14T20:49:06.899889] [DEBUG] [LOCAL ] AAT: Loaded 22768 existing records from primary storage. [2025-09-14T20:49:06.939406] [INFO ] [MAIN ] AAT: Loaded 22768 primary data records. [2025-09-14T20:49:07.249509] [DEBUG] [MAIN ] AAMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:07.382998] [INFO ] [MAIN ] AAMI: Generated 1352 derivative records from 18336 primary records. [2025-09-14T20:49:07.394562] [DEBUG] [LOCAL ] AAMI: Saving derivative data. [2025-09-14T20:49:07.412817] [DEBUG] [LOCAL ] AAMI: Derivative data saved (1352 records). [2025-09-14T20:49:07.415026] [INFO ] [MAIN ] AAMI: Successfully saved derivative data. [2025-09-14T20:49:07.417852] [INFO ] [MAIN ] Derivative Progress: 4/2226 symbols completed. AAMI took 1.1s. Estimated remaining: 19m 56s. Rate: 111.5 symbols/min [2025-09-14T20:49:07.420147] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:07.432032] [DEBUG] [MAIN ] AAP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:07.433400] [INFO ] [MAIN ] AAP: Generated 1352 derivative records from 39164 primary records. [2025-09-14T20:49:07.433892] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-14T20:49:07.465075] [DEBUG] [MAIN ] AAT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:07.467263] [INFO ] [MAIN ] AAT: Generated 1352 derivative records from 22768 primary records. [2025-09-14T20:49:07.468431] [DEBUG] [LOCAL ] AAP: Derivative data saved (1352 records). [2025-09-14T20:49:07.468720] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-14T20:49:07.468547] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-14T20:49:07.470855] [INFO ] [MAIN ] Derivative Progress: 5/2226 symbols completed. AAP took 1.1s. Estimated remaining: 16m 20s. Rate: 136.0 symbols/min [2025-09-14T20:49:07.472376] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:07.487560] [DEBUG] [LOCAL ] AB: Loaded 18396 existing records from primary storage. [2025-09-14T20:49:07.490392] [INFO ] [MAIN ] AB: Loaded 18396 primary data records. [2025-09-14T20:49:07.603364] [DEBUG] [LOCAL ] AAT: Derivative data saved (1352 records). [2025-09-14T20:49:07.625039] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-14T20:49:07.632051] [INFO ] [MAIN ] Derivative Progress: 6/2226 symbols completed. AAT took 1.2s. Estimated remaining: 14m 36s. Rate: 152.1 symbols/min [2025-09-14T20:49:07.677297] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:07.804797] [DEBUG] [LOCAL ] ABBV: Loaded 40433 existing records from primary storage. [2025-09-14T20:49:07.806797] [INFO ] [MAIN ] ABBV: Loaded 40433 primary data records. [2025-09-14T20:49:07.943516] [DEBUG] [LOCAL ] ABCB: Loaded 22109 existing records from primary storage. [2025-09-14T20:49:07.971271] [INFO ] [MAIN ] ABCB: Loaded 22109 primary data records. [2025-09-14T20:49:08.297334] [DEBUG] [MAIN ] AB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:08.354969] [INFO ] [MAIN ] AB: Generated 1352 derivative records from 18396 primary records. [2025-09-14T20:49:08.361603] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-14T20:49:08.496230] [DEBUG] [LOCAL ] AB: Derivative data saved (1352 records). [2025-09-14T20:49:08.497730] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-14T20:49:08.500863] [INFO ] [MAIN ] Derivative Progress: 7/2226 symbols completed. AB took 1.1s. Estimated remaining: 17m 6s. Rate: 129.8 symbols/min [2025-09-14T20:49:08.504421] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:08.533210] [DEBUG] [MAIN ] ABBV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:08.534400] [INFO ] [MAIN ] ABBV: Generated 1352 derivative records from 40433 primary records. [2025-09-14T20:49:08.534823] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-14T20:49:08.563294] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1352 records). [2025-09-14T20:49:08.564505] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-14T20:49:08.566460] [INFO ] [MAIN ] Derivative Progress: 8/2226 symbols completed. ABBV took 1.1s. Estimated remaining: 15m 15s. Rate: 145.4 symbols/min [2025-09-14T20:49:08.567013] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:08.598375] [DEBUG] [MAIN ] ABCB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:08.599844] [INFO ] [MAIN ] ABCB: Generated 1352 derivative records from 22109 primary records. [2025-09-14T20:49:08.600449] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-14T20:49:08.639587] [DEBUG] [LOCAL ] ABEV: Loaded 40061 existing records from primary storage. [2025-09-14T20:49:08.648636] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1352 records). [2025-09-14T20:49:08.649682] [INFO ] [MAIN ] ABEV: Loaded 40061 primary data records. [2025-09-14T20:49:08.650060] [DEBUG] [LOCAL ] ABG: Loaded 13231 existing records from primary storage. [2025-09-14T20:49:08.650483] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-14T20:49:08.650404] [INFO ] [MAIN ] ABG: Loaded 13231 primary data records. [2025-09-14T20:49:08.652826] [INFO ] [MAIN ] Derivative Progress: 9/2226 symbols completed. ABCB took 1.0s. Estimated remaining: 13m 54s. Rate: 159.4 symbols/min [2025-09-14T20:49:08.699469] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:09.220166] [DEBUG] [LOCAL ] ABM: Loaded 23534 existing records from primary storage. [2025-09-14T20:49:09.313763] [INFO ] [MAIN ] ABM: Loaded 23534 primary data records. [2025-09-14T20:49:09.807236] [DEBUG] [MAIN ] ABEV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:09.810045] [INFO ] [MAIN ] ABEV: Generated 1352 derivative records from 40061 primary records. [2025-09-14T20:49:09.810434] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-14T20:49:09.823506] [DEBUG] [MAIN ] ABG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:09.834616] [INFO ] [MAIN ] ABG: Generated 1352 derivative records from 13231 primary records. [2025-09-14T20:49:09.838562] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1352 records). [2025-09-14T20:49:09.836721] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-14T20:49:09.839124] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-14T20:49:09.841253] [INFO ] [MAIN ] Derivative Progress: 10/2226 symbols completed. ABEV took 1.3s. Estimated remaining: 16m 54s. Rate: 131.1 symbols/min [2025-09-14T20:49:09.843048] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:09.859245] [DEBUG] [LOCAL ] ABG: Derivative data saved (1352 records). [2025-09-14T20:49:09.859512] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-14T20:49:09.862162] [INFO ] [MAIN ] Derivative Progress: 11/2226 symbols completed. ABG took 1.3s. Estimated remaining: 15m 26s. Rate: 143.6 symbols/min [2025-09-14T20:49:09.862869] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:09.880824] [DEBUG] [MAIN ] ABM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:09.882050] [INFO ] [MAIN ] ABM: Generated 1352 derivative records from 23534 primary records. [2025-09-14T20:49:09.882337] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-14T20:49:09.901002] [DEBUG] [LOCAL ] ABM: Derivative data saved (1352 records). [2025-09-14T20:49:09.901889] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-14T20:49:09.915525] [INFO ] [MAIN ] Derivative Progress: 12/2226 symbols completed. ABM took 1.2s. Estimated remaining: 14m 18s. Rate: 154.8 symbols/min [2025-09-14T20:49:09.916227] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:09.944237] [DEBUG] [LOCAL ] ABR: Loaded 39178 existing records from primary storage. [2025-09-14T20:49:09.944740] [INFO ] [MAIN ] ABR: Loaded 39178 primary data records. [2025-09-14T20:49:10.083734] [DEBUG] [LOCAL ] ABT: Loaded 40373 existing records from primary storage. [2025-09-14T20:49:10.084669] [DEBUG] [LOCAL ] ACA: Loaded 17137 existing records from primary storage. [2025-09-14T20:49:10.110864] [INFO ] [MAIN ] ACA: Loaded 17137 primary data records. [2025-09-14T20:49:10.100469] [INFO ] [MAIN ] ABT: Loaded 40373 primary data records. [2025-09-14T20:49:10.895321] [DEBUG] [MAIN ] ABR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:10.897098] [INFO ] [MAIN ] ABR: Generated 1352 derivative records from 39178 primary records. [2025-09-14T20:49:10.897336] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-14T20:49:10.912141] [DEBUG] [LOCAL ] ABR: Derivative data saved (1352 records). [2025-09-14T20:49:10.915330] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-14T20:49:10.925361] [INFO ] [MAIN ] Derivative Progress: 13/2226 symbols completed. ABR took 1.1s. Estimated remaining: 16m 4s. Rate: 137.8 symbols/min [2025-09-14T20:49:10.930553] [DEBUG] [MAIN ] ABT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:10.941024] [INFO ] [MAIN ] ABT: Generated 1352 derivative records from 40373 primary records. [2025-09-14T20:49:10.941340] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-14T20:49:10.941249] [DEBUG] [MAIN ] ACA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:10.942756] [INFO ] [MAIN ] ACA: Generated 1352 derivative records from 17137 primary records. [2025-09-14T20:49:10.943030] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-14T20:49:10.969345] [DEBUG] [LOCAL ] ACA: Derivative data saved (1352 records). [2025-09-14T20:49:10.969271] [DEBUG] [LOCAL ] ABT: Derivative data saved (1352 records). [2025-09-14T20:49:10.969628] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-14T20:49:10.969561] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-14T20:49:10.971280] [INFO ] [MAIN ] Derivative Progress: 14/2226 symbols completed. ABT took 1.1s. Estimated remaining: 15m 2s. Rate: 147.2 symbols/min [2025-09-14T20:49:10.973439] [INFO ] [MAIN ] Derivative Progress: 15/2226 symbols completed. ACA took 1.1s. Estimated remaining: 14m 1s. Rate: 157.7 symbols/min [2025-09-14T20:49:10.973966] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:10.974254] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:10.974120] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:11.031093] [DEBUG] [LOCAL ] ACCO: Loaded 27964 existing records from primary storage. [2025-09-14T20:49:11.031747] [DEBUG] [LOCAL ] ACEL: Loaded 19768 existing records from primary storage. [2025-09-14T20:49:11.032217] [INFO ] [MAIN ] ACCO: Loaded 27964 primary data records. [2025-09-14T20:49:11.032319] [INFO ] [MAIN ] ACEL: Loaded 19768 primary data records. [2025-09-14T20:49:11.263110] [DEBUG] [LOCAL ] ACHR: Loaded 40558 existing records from primary storage. [2025-09-14T20:49:11.283700] [INFO ] [MAIN ] ACHR: Loaded 40558 primary data records. [2025-09-14T20:49:12.042758] [DEBUG] [MAIN ] ACCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:12.044169] [INFO ] [MAIN ] ACCO: Generated 1352 derivative records from 27964 primary records. [2025-09-14T20:49:12.054235] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-14T20:49:12.054567] [DEBUG] [MAIN ] ACEL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:12.056466] [INFO ] [MAIN ] ACEL: Generated 1352 derivative records from 19768 primary records. [2025-09-14T20:49:12.056944] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-14T20:49:12.069562] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1352 records). [2025-09-14T20:49:12.078437] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-14T20:49:12.081739] [INFO ] [MAIN ] Derivative Progress: 16/2226 symbols completed. ACCO took 1.1s. Estimated remaining: 15m 42s. Rate: 140.8 symbols/min [2025-09-14T20:49:12.085890] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:12.087044] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1352 records). [2025-09-14T20:49:12.087893] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-14T20:49:12.100092] [INFO ] [MAIN ] Derivative Progress: 17/2226 symbols completed. ACEL took 1.1s. Estimated remaining: 14m 48s. Rate: 149.2 symbols/min [2025-09-14T20:49:12.101296] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:12.101103] [DEBUG] [MAIN ] ACHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:12.102597] [INFO ] [MAIN ] ACHR: Generated 1352 derivative records from 40558 primary records. [2025-09-14T20:49:12.102923] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-14T20:49:12.119123] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1352 records). [2025-09-14T20:49:12.119534] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-14T20:49:12.121542] [INFO ] [MAIN ] Derivative Progress: 18/2226 symbols completed. ACHR took 1.1s. Estimated remaining: 14m 1s. Rate: 157.5 symbols/min [2025-09-14T20:49:12.121907] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:12.165423] [DEBUG] [LOCAL ] ACM: Loaded 31709 existing records from primary storage. [2025-09-14T20:49:12.165816] [INFO ] [MAIN ] ACM: Loaded 31709 primary data records. [2025-09-14T20:49:12.297833] [DEBUG] [LOCAL ] ACI: Loaded 40065 existing records from primary storage. [2025-09-14T20:49:12.320692] [INFO ] [MAIN ] ACI: Loaded 40065 primary data records. [2025-09-14T20:49:12.349006] [DEBUG] [LOCAL ] ACN: Loaded 40185 existing records from primary storage. [2025-09-14T20:49:12.412487] [INFO ] [MAIN ] ACN: Loaded 40185 primary data records. [2025-09-14T20:49:13.091482] [DEBUG] [MAIN ] ACM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:13.093049] [INFO ] [MAIN ] ACM: Generated 1352 derivative records from 31709 primary records. [2025-09-14T20:49:13.093899] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-14T20:49:13.109371] [DEBUG] [LOCAL ] ACM: Derivative data saved (1352 records). [2025-09-14T20:49:13.110266] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-14T20:49:13.112425] [INFO ] [MAIN ] Derivative Progress: 19/2226 symbols completed. ACM took 1.0s. Estimated remaining: 15m 12s. Rate: 145.3 symbols/min [2025-09-14T20:49:13.114690] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:13.126397] [DEBUG] [MAIN ] ACI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:13.127427] [INFO ] [MAIN ] ACI: Generated 1352 derivative records from 40065 primary records. [2025-09-14T20:49:13.127733] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-14T20:49:13.159317] [DEBUG] [LOCAL ] ACI: Derivative data saved (1352 records). [2025-09-14T20:49:13.159778] [DEBUG] [MAIN ] ACN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:13.160849] [INFO ] [MAIN ] ACN: Generated 1352 derivative records from 40185 primary records. [2025-09-14T20:49:13.160992] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-14T20:49:13.161125] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-14T20:49:13.164875] [INFO ] [MAIN ] Derivative Progress: 20/2226 symbols completed. ACI took 1.1s. Estimated remaining: 14m 31s. Rate: 151.9 symbols/min [2025-09-14T20:49:13.166291] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:13.190083] [DEBUG] [LOCAL ] ACP: Loaded 23365 existing records from primary storage. [2025-09-14T20:49:13.189426] [DEBUG] [LOCAL ] ACN: Derivative data saved (1352 records). [2025-09-14T20:49:13.190422] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-14T20:49:13.190370] [INFO ] [MAIN ] ACP: Loaded 23365 primary data records. [2025-09-14T20:49:13.195041] [INFO ] [MAIN ] Derivative Progress: 21/2226 symbols completed. ACN took 1.1s. Estimated remaining: 13m 53s. Rate: 158.9 symbols/min [2025-09-14T20:49:13.206958] [DEBUG] [LOCAL ] ACR: Loaded 4230 existing records from primary storage. [2025-09-14T20:49:13.233044] [INFO ] [MAIN ] ACR: Loaded 4230 primary data records. [2025-09-14T20:49:13.216857] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:13.693033] [DEBUG] [LOCAL ] ACRE: Loaded 24833 existing records from primary storage. [2025-09-14T20:49:13.783599] [INFO ] [MAIN ] ACRE: Loaded 24833 primary data records. [2025-09-14T20:49:14.084082] [DEBUG] [MAIN ] ACP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:14.086275] [INFO ] [MAIN ] ACP: Generated 1352 derivative records from 23365 primary records. [2025-09-14T20:49:14.087266] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-14T20:49:14.106426] [DEBUG] [MAIN ] ACR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:14.111499] [INFO ] [MAIN ] ACR: Generated 1352 derivative records from 4230 primary records. [2025-09-14T20:49:14.113811] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-14T20:49:14.114507] [DEBUG] [LOCAL ] ACP: Derivative data saved (1352 records). [2025-09-14T20:49:14.115982] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-14T20:49:14.128104] [INFO ] [MAIN ] Derivative Progress: 22/2226 symbols completed. ACP took 1.0s. Estimated remaining: 14m 48s. Rate: 148.9 symbols/min [2025-09-14T20:49:14.132052] [DEBUG] [LOCAL ] ACR: Derivative data saved (1352 records). [2025-09-14T20:49:14.133298] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:14.133622] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-14T20:49:14.145864] [INFO ] [MAIN ] Derivative Progress: 23/2226 symbols completed. ACR took 1.0s. Estimated remaining: 14m 11s. Rate: 155.4 symbols/min [2025-09-14T20:49:14.146610] [DEBUG] [MAIN ] ACRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:14.147091] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:14.148381] [INFO ] [MAIN ] ACRE: Generated 1352 derivative records from 24833 primary records. [2025-09-14T20:49:14.149019] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-14T20:49:14.165407] [DEBUG] [LOCAL ] ACV: Loaded 4645 existing records from primary storage. [2025-09-14T20:49:14.169744] [INFO ] [MAIN ] ACV: Loaded 4645 primary data records. [2025-09-14T20:49:14.173265] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1352 records). [2025-09-14T20:49:14.173504] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-14T20:49:14.197224] [INFO ] [MAIN ] Derivative Progress: 24/2226 symbols completed. ACRE took 1.0s. Estimated remaining: 13m 40s. Rate: 161.2 symbols/min [2025-09-14T20:49:14.208023] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:14.531202] [DEBUG] [LOCAL ] ACVA: Loaded 36553 existing records from primary storage. [2025-09-14T20:49:14.532109] [INFO ] [MAIN ] ACVA: Loaded 36553 primary data records. [2025-09-14T20:49:14.643748] [DEBUG] [LOCAL ] ADC: Loaded 35023 existing records from primary storage. [2025-09-14T20:49:14.655557] [INFO ] [MAIN ] ADC: Loaded 35023 primary data records. [2025-09-14T20:49:15.157153] [DEBUG] [MAIN ] ACV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:15.158361] [INFO ] [MAIN ] ACV: Generated 1352 derivative records from 4645 primary records. [2025-09-14T20:49:15.159827] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-14T20:49:15.178414] [DEBUG] [LOCAL ] ACV: Derivative data saved (1352 records). [2025-09-14T20:49:15.180568] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-14T20:49:15.183845] [INFO ] [MAIN ] Derivative Progress: 25/2226 symbols completed. ACV took 1.1s. Estimated remaining: 14m 33s. Rate: 151.2 symbols/min [2025-09-14T20:49:15.184672] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:15.196774] [DEBUG] [MAIN ] ACVA: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:49:15.198712] [INFO ] [MAIN ] ACVA: Generated 1351 derivative records from 36553 primary records. [2025-09-14T20:49:15.199602] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-14T20:49:15.214455] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1351 records). [2025-09-14T20:49:15.217764] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-14T20:49:15.220095] [INFO ] [MAIN ] Derivative Progress: 26/2226 symbols completed. ACVA took 1.1s. Estimated remaining: 14m 2s. Rate: 156.7 symbols/min [2025-09-14T20:49:15.230862] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:15.231469] [DEBUG] [MAIN ] ADC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:15.241539] [INFO ] [MAIN ] ADC: Generated 1352 derivative records from 35023 primary records. [2025-09-14T20:49:15.241842] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-14T20:49:15.255133] [DEBUG] [LOCAL ] ADC: Derivative data saved (1352 records). [2025-09-14T20:49:15.255898] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-14T20:49:15.266147] [INFO ] [MAIN ] Derivative Progress: 27/2226 symbols completed. ADC took 1.1s. Estimated remaining: 13m 35s. Rate: 162.0 symbols/min [2025-09-14T20:49:15.268796] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:15.268560] [DEBUG] [LOCAL ] ADCT: Loaded 25869 existing records from primary storage. [2025-09-14T20:49:15.269440] [INFO ] [MAIN ] ADCT: Loaded 25869 primary data records. [2025-09-14T20:49:15.599942] [DEBUG] [LOCAL ] ADM: Loaded 40170 existing records from primary storage. [2025-09-14T20:49:15.607025] [INFO ] [MAIN ] ADM: Loaded 40170 primary data records. [2025-09-14T20:49:15.613137] [DEBUG] [LOCAL ] ADNT: Loaded 35484 existing records from primary storage. [2025-09-14T20:49:15.630548] [INFO ] [MAIN ] ADNT: Loaded 35484 primary data records. [2025-09-14T20:49:16.221276] [DEBUG] [MAIN ] ADCT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:16.223996] [INFO ] [MAIN ] ADCT: Generated 1352 derivative records from 25869 primary records. [2025-09-14T20:49:16.224493] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-14T20:49:16.239952] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1352 records). [2025-09-14T20:49:16.241277] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-14T20:49:16.243450] [INFO ] [MAIN ] Derivative Progress: 28/2226 symbols completed. ADCT took 1.1s. Estimated remaining: 14m 22s. Rate: 153.0 symbols/min [2025-09-14T20:49:16.257594] [DEBUG] [MAIN ] ADM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:16.258411] [INFO ] [MAIN ] ADM: Generated 1352 derivative records from 40170 primary records. [2025-09-14T20:49:16.258683] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-14T20:49:16.282594] [DEBUG] [LOCAL ] ADM: Derivative data saved (1352 records). [2025-09-14T20:49:16.282862] [DEBUG] [MAIN ] ADNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:16.283626] [INFO ] [MAIN ] ADNT: Generated 1352 derivative records from 35484 primary records. [2025-09-14T20:49:16.283710] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-14T20:49:16.283826] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-14T20:49:16.285737] [INFO ] [MAIN ] Derivative Progress: 29/2226 symbols completed. ADM took 1.1s. Estimated remaining: 13m 55s. Rate: 157.9 symbols/min [2025-09-14T20:49:16.298297] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1352 records). [2025-09-14T20:49:16.298381] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-14T20:49:16.300302] [INFO ] [MAIN ] Derivative Progress: 30/2226 symbols completed. ADNT took 1.0s. Estimated remaining: 13m 28s. Rate: 163.1 symbols/min [2025-09-14T20:49:16.300811] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:16.300844] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:16.300979] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:16.346793] [DEBUG] [LOCAL ] ADX: Loaded 20648 existing records from primary storage. [2025-09-14T20:49:16.347034] [INFO ] [MAIN ] ADX: Loaded 20648 primary data records. [2025-09-14T20:49:16.465666] [DEBUG] [LOCAL ] ADT: Loaded 40255 existing records from primary storage. [2025-09-14T20:49:16.484559] [DEBUG] [LOCAL ] AEE: Loaded 37637 existing records from primary storage. [2025-09-14T20:49:16.490488] [INFO ] [MAIN ] AEE: Loaded 37637 primary data records. [2025-09-14T20:49:16.490381] [INFO ] [MAIN ] ADT: Loaded 40255 primary data records. [2025-09-14T20:49:17.329376] [DEBUG] [MAIN ] ADX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:17.331019] [INFO ] [MAIN ] ADX: Generated 1352 derivative records from 20648 primary records. [2025-09-14T20:49:17.331327] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-14T20:49:17.347105] [DEBUG] [LOCAL ] ADX: Derivative data saved (1352 records). [2025-09-14T20:49:17.347589] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-14T20:49:17.351074] [INFO ] [MAIN ] Derivative Progress: 31/2226 symbols completed. ADX took 1.1s. Estimated remaining: 14m 16s. Rate: 153.9 symbols/min [2025-09-14T20:49:17.352468] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:17.382466] [DEBUG] [MAIN ] ADT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:17.382741] [DEBUG] [MAIN ] AEE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:17.383698] [INFO ] [MAIN ] ADT: Generated 1352 derivative records from 40255 primary records. [2025-09-14T20:49:17.389495] [DEBUG] [LOCAL ] AEFC: Loaded 5954 existing records from primary storage. [2025-09-14T20:49:17.390397] [INFO ] [MAIN ] AEE: Generated 1352 derivative records from 37637 primary records. [2025-09-14T20:49:17.390725] [INFO ] [MAIN ] AEFC: Loaded 5954 primary data records. [2025-09-14T20:49:17.390928] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-14T20:49:17.413895] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-14T20:49:17.554951] [DEBUG] [LOCAL ] ADT: Derivative data saved (1352 records). [2025-09-14T20:49:17.568113] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-14T20:49:17.608473] [DEBUG] [LOCAL ] AEE: Derivative data saved (1352 records). [2025-09-14T20:49:17.638762] [INFO ] [MAIN ] Derivative Progress: 32/2226 symbols completed. ADT took 1.3s. Estimated remaining: 14m 8s. Rate: 155.2 symbols/min [2025-09-14T20:49:17.633751] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-14T20:49:17.740093] [INFO ] [MAIN ] Derivative Progress: 33/2226 symbols completed. AEE took 1.4s. Estimated remaining: 13m 49s. Rate: 158.7 symbols/min [2025-09-14T20:49:17.740917] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:17.740278] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:17.775942] [DEBUG] [MAIN ] AEFC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:17.777626] [INFO ] [MAIN ] AEFC: Generated 1352 derivative records from 5954 primary records. [2025-09-14T20:49:17.777945] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-14T20:49:17.818033] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1352 records). [2025-09-14T20:49:17.818286] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-14T20:49:17.820965] [INFO ] [MAIN ] Derivative Progress: 34/2226 symbols completed. AEFC took 0.5s. Estimated remaining: 13m 29s. Rate: 162.5 symbols/min [2025-09-14T20:49:17.821815] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:17.858243] [DEBUG] [LOCAL ] AEM: Loaded 40246 existing records from primary storage. [2025-09-14T20:49:17.858836] [INFO ] [MAIN ] AEM: Loaded 40246 primary data records. [2025-09-14T20:49:17.861578] [DEBUG] [LOCAL ] AEG: Loaded 37400 existing records from primary storage. [2025-09-14T20:49:17.882899] [INFO ] [MAIN ] AEG: Loaded 37400 primary data records. [2025-09-14T20:49:18.341345] [DEBUG] [LOCAL ] AEO: Loaded 40310 existing records from primary storage. [2025-09-14T20:49:18.473877] [INFO ] [MAIN ] AEO: Loaded 40310 primary data records. [2025-09-14T20:49:18.837019] [DEBUG] [MAIN ] AEG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:18.836739] [DEBUG] [MAIN ] AEM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:18.838128] [INFO ] [MAIN ] AEM: Generated 1352 derivative records from 40246 primary records. [2025-09-14T20:49:18.838803] [INFO ] [MAIN ] AEG: Generated 1352 derivative records from 37400 primary records. [2025-09-14T20:49:18.838925] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-14T20:49:18.839344] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-14T20:49:18.867744] [DEBUG] [LOCAL ] AEM: Derivative data saved (1352 records). [2025-09-14T20:49:18.867817] [DEBUG] [LOCAL ] AEG: Derivative data saved (1352 records). [2025-09-14T20:49:18.868422] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-14T20:49:18.868502] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-14T20:49:18.870313] [INFO ] [MAIN ] Derivative Progress: 35/2226 symbols completed. AEG took 1.1s. Estimated remaining: 14m 12s. Rate: 154.4 symbols/min [2025-09-14T20:49:18.872781] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:18.873376] [INFO ] [MAIN ] Derivative Progress: 36/2226 symbols completed. AEM took 1.1s. Estimated remaining: 13m 48s. Rate: 158.7 symbols/min [2025-09-14T20:49:18.874310] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:18.890249] [DEBUG] [MAIN ] AEO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:18.891296] [INFO ] [MAIN ] AEO: Generated 1352 derivative records from 40310 primary records. [2025-09-14T20:49:18.891413] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-14T20:49:18.905623] [DEBUG] [LOCAL ] AEO: Derivative data saved (1352 records). [2025-09-14T20:49:18.905945] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-14T20:49:18.909107] [INFO ] [MAIN ] Derivative Progress: 37/2226 symbols completed. AEO took 1.1s. Estimated remaining: 13m 27s. Rate: 162.7 symbols/min [2025-09-14T20:49:18.909471] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:18.948796] [DEBUG] [LOCAL ] AER: Loaded 36323 existing records from primary storage. [2025-09-14T20:49:18.948998] [INFO ] [MAIN ] AER: Loaded 36323 primary data records. [2025-09-14T20:49:19.078426] [DEBUG] [LOCAL ] AES: Loaded 40415 existing records from primary storage. [2025-09-14T20:49:19.083215] [INFO ] [MAIN ] AES: Loaded 40415 primary data records. [2025-09-14T20:49:19.272690] [DEBUG] [LOCAL ] AESI: Loaded 37122 existing records from primary storage. [2025-09-14T20:49:19.381405] [INFO ] [MAIN ] AESI: Loaded 37122 primary data records. [2025-09-14T20:49:19.933112] [DEBUG] [MAIN ] AER: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:19.934774] [INFO ] [MAIN ] AER: Generated 1352 derivative records from 36323 primary records. [2025-09-14T20:49:19.936035] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-14T20:49:19.951412] [DEBUG] [LOCAL ] AER: Derivative data saved (1352 records). [2025-09-14T20:49:19.952161] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-14T20:49:19.955350] [INFO ] [MAIN ] Derivative Progress: 38/2226 symbols completed. AER took 1.1s. Estimated remaining: 14m 6s. Rate: 155.2 symbols/min [2025-09-14T20:49:19.957598] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:19.971554] [DEBUG] [MAIN ] AES: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:19.972582] [INFO ] [MAIN ] AES: Generated 1352 derivative records from 40415 primary records. [2025-09-14T20:49:19.985193] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-14T20:49:19.990422] [DEBUG] [LOCAL ] AFB: Loaded 8175 existing records from primary storage. [2025-09-14T20:49:19.985770] [DEBUG] [MAIN ] AESI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:19.999745] [INFO ] [MAIN ] AESI: Generated 1352 derivative records from 37122 primary records. [2025-09-14T20:49:19.999991] [INFO ] [MAIN ] AFB: Loaded 8175 primary data records. [2025-09-14T20:49:20.002953] [DEBUG] [LOCAL ] AES: Derivative data saved (1352 records). [2025-09-14T20:49:20.078339] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-14T20:49:20.003004] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-14T20:49:20.096161] [INFO ] [MAIN ] Derivative Progress: 39/2226 symbols completed. AES took 1.2s. Estimated remaining: 13m 52s. Rate: 157.8 symbols/min [2025-09-14T20:49:20.104177] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:20.298603] [DEBUG] [LOCAL ] AESI: Derivative data saved (1352 records). [2025-09-14T20:49:20.298851] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-14T20:49:20.301737] [INFO ] [MAIN ] Derivative Progress: 40/2226 symbols completed. AESI took 1.4s. Estimated remaining: 13m 42s. Rate: 159.6 symbols/min [2025-09-14T20:49:20.302733] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:20.320054] [DEBUG] [LOCAL ] AFGB: Loaded 1672 existing records from primary storage. [2025-09-14T20:49:20.320150] [DEBUG] [LOCAL ] AFG: Loaded 23793 existing records from primary storage. [2025-09-14T20:49:20.321586] [INFO ] [MAIN ] AFG: Loaded 23793 primary data records. [2025-09-14T20:49:20.321528] [INFO ] [MAIN ] AFGB: Loaded 1672 primary data records. [2025-09-14T20:49:20.695245] [DEBUG] [MAIN ] AFB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:20.883174] [INFO ] [MAIN ] AFB: Generated 1352 derivative records from 8175 primary records. [2025-09-14T20:49:20.883926] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-14T20:49:20.902585] [DEBUG] [LOCAL ] AFB: Derivative data saved (1352 records). [2025-09-14T20:49:20.903129] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-14T20:49:20.905219] [INFO ] [MAIN ] Derivative Progress: 41/2226 symbols completed. AFB took 0.9s. Estimated remaining: 13m 54s. Rate: 157.3 symbols/min [2025-09-14T20:49:20.906840] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:20.913676] [DEBUG] [LOCAL ] AFGC: Loaded 2041 existing records from primary storage. [2025-09-14T20:49:20.914390] [INFO ] [MAIN ] AFGC: Loaded 2041 primary data records. [2025-09-14T20:49:21.037483] [DEBUG] [MAIN ] AFG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:21.059618] [INFO ] [MAIN ] AFG: Generated 1352 derivative records from 23793 primary records. [2025-09-14T20:49:21.053087] [DEBUG] [MAIN ] AFGB: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:49:21.075288] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-14T20:49:21.091941] [INFO ] [MAIN ] AFGB: Generated 1351 derivative records from 1672 primary records. [2025-09-14T20:49:21.095459] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-14T20:49:21.155917] [DEBUG] [LOCAL ] AFG: Derivative data saved (1352 records). [2025-09-14T20:49:21.245071] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1351 records). [2025-09-14T20:49:21.246627] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-14T20:49:21.246395] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-14T20:49:21.248700] [INFO ] [MAIN ] Derivative Progress: 42/2226 symbols completed. AFGB took 0.9s. Estimated remaining: 13m 51s. Rate: 157.7 symbols/min [2025-09-14T20:49:21.252219] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:21.252102] [INFO ] [MAIN ] Derivative Progress: 43/2226 symbols completed. AFG took 1.1s. Estimated remaining: 13m 32s. Rate: 161.4 symbols/min [2025-09-14T20:49:21.257003] [DEBUG] [LOCAL ] AFGD: Loaded 1355 existing records from primary storage. [2025-09-14T20:49:21.257591] [INFO ] [MAIN ] AFGD: Loaded 1355 primary data records. [2025-09-14T20:49:21.577791] [DEBUG] [MAIN ] AFGC: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:49:21.579633] [INFO ] [MAIN ] AFGC: Generated 1351 derivative records from 2041 primary records. [2025-09-14T20:49:21.580300] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-14T20:49:21.593494] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1351 records). [2025-09-14T20:49:21.594563] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-14T20:49:21.597160] [INFO ] [MAIN ] Derivative Progress: 44/2226 symbols completed. AFGC took 0.7s. Estimated remaining: 13m 30s. Rate: 161.6 symbols/min [2025-09-14T20:49:21.613360] [DEBUG] [MAIN ] AFGD: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T20:49:21.614207] [INFO ] [MAIN ] AFGD: Generated 1349 derivative records from 1355 primary records. [2025-09-14T20:49:21.614292] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-14T20:49:21.626393] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1349 records). [2025-09-14T20:49:21.626498] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-14T20:49:21.628723] [INFO ] [MAIN ] Derivative Progress: 45/2226 symbols completed. AFGD took 0.4s. Estimated remaining: 13m 13s. Rate: 165.0 symbols/min [2025-09-14T20:49:21.629614] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:21.629349] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:21.629719] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:21.637141] [DEBUG] [LOCAL ] AFGE: Loaded 1893 existing records from primary storage. [2025-09-14T20:49:21.637336] [INFO ] [MAIN ] AFGE: Loaded 1893 primary data records. [2025-09-14T20:49:22.026451] [DEBUG] [LOCAL ] AG: Loaded 40385 existing records from primary storage. [2025-09-14T20:49:22.026897] [INFO ] [MAIN ] AG: Loaded 40385 primary data records. [2025-09-14T20:49:22.027668] [DEBUG] [LOCAL ] AFL: Loaded 39995 existing records from primary storage. [2025-09-14T20:49:22.051463] [INFO ] [MAIN ] AFL: Loaded 39995 primary data records. [2025-09-14T20:49:22.662076] [DEBUG] [MAIN ] AFGE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:22.663618] [INFO ] [MAIN ] AFGE: Generated 1352 derivative records from 1893 primary records. [2025-09-14T20:49:22.665680] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-14T20:49:22.680222] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1352 records). [2025-09-14T20:49:22.680661] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-14T20:49:22.683054] [INFO ] [MAIN ] Derivative Progress: 46/2226 symbols completed. AFGE took 1.1s. Estimated remaining: 13m 45s. Rate: 158.5 symbols/min [2025-09-14T20:49:22.683396] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:22.699910] [DEBUG] [MAIN ] AG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:22.701431] [INFO ] [MAIN ] AG: Generated 1352 derivative records from 40385 primary records. [2025-09-14T20:49:22.702373] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-14T20:49:22.734882] [DEBUG] [LOCAL ] AG: Derivative data saved (1352 records). [2025-09-14T20:49:22.732000] [DEBUG] [MAIN ] AFL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:22.736716] [INFO ] [MAIN ] AFL: Generated 1352 derivative records from 39995 primary records. [2025-09-14T20:49:22.736802] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-14T20:49:22.736964] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-14T20:49:22.741419] [INFO ] [MAIN ] Derivative Progress: 47/2226 symbols completed. AG took 1.1s. Estimated remaining: 13m 30s. Rate: 161.4 symbols/min [2025-09-14T20:49:22.742114] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:22.769014] [DEBUG] [LOCAL ] AFL: Derivative data saved (1352 records). [2025-09-14T20:49:22.769256] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-14T20:49:22.771755] [INFO ] [MAIN ] Derivative Progress: 48/2226 symbols completed. AFL took 1.1s. Estimated remaining: 13m 14s. Rate: 164.5 symbols/min [2025-09-14T20:49:22.772391] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:22.795531] [DEBUG] [LOCAL ] AGCO: Loaded 31794 existing records from primary storage. [2025-09-14T20:49:22.796071] [DEBUG] [LOCAL ] AGD: Loaded 13696 existing records from primary storage. [2025-09-14T20:49:22.796457] [INFO ] [MAIN ] AGCO: Loaded 31794 primary data records. [2025-09-14T20:49:22.796542] [INFO ] [MAIN ] AGD: Loaded 13696 primary data records. [2025-09-14T20:49:23.288734] [DEBUG] [LOCAL ] AGI: Loaded 40181 existing records from primary storage. [2025-09-14T20:49:23.387833] [INFO ] [MAIN ] AGI: Loaded 40181 primary data records. [2025-09-14T20:49:23.702482] [DEBUG] [MAIN ] AGCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:23.720957] [INFO ] [MAIN ] AGCO: Generated 1352 derivative records from 31794 primary records. [2025-09-14T20:49:23.721619] [DEBUG] [MAIN ] AGD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:23.722917] [INFO ] [MAIN ] AGD: Generated 1352 derivative records from 13696 primary records. [2025-09-14T20:49:23.722995] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-14T20:49:23.723298] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-14T20:49:23.751512] [DEBUG] [LOCAL ] AGD: Derivative data saved (1352 records). [2025-09-14T20:49:23.751633] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1352 records). [2025-09-14T20:49:23.751840] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-14T20:49:23.751891] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-14T20:49:23.754408] [INFO ] [MAIN ] Derivative Progress: 49/2226 symbols completed. AGCO took 1.1s. Estimated remaining: 13m 41s. Rate: 159.0 symbols/min [2025-09-14T20:49:23.757535] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:23.757856] [INFO ] [MAIN ] Derivative Progress: 50/2226 symbols completed. AGD took 1.0s. Estimated remaining: 13m 25s. Rate: 162.2 symbols/min [2025-09-14T20:49:23.759228] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:23.777931] [DEBUG] [MAIN ] AGI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:23.779115] [INFO ] [MAIN ] AGI: Generated 1352 derivative records from 40181 primary records. [2025-09-14T20:49:23.781962] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-14T20:49:23.801558] [DEBUG] [LOCAL ] AGI: Derivative data saved (1352 records). [2025-09-14T20:49:23.802103] [DEBUG] [LOCAL ] AGM: Loaded 8023 existing records from primary storage. [2025-09-14T20:49:23.802306] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-14T20:49:23.804593] [INFO ] [MAIN ] Derivative Progress: 51/2226 symbols completed. AGI took 1.0s. Estimated remaining: 13m 11s. Rate: 165.1 symbols/min [2025-09-14T20:49:23.805262] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:23.804817] [INFO ] [MAIN ] AGM: Loaded 8023 primary data records. [2025-09-14T20:49:24.003489] [DEBUG] [LOCAL ] AGL: Loaded 39444 existing records from primary storage. [2025-09-14T20:49:24.037603] [INFO ] [MAIN ] AGL: Loaded 39444 primary data records. [2025-09-14T20:49:24.174476] [DEBUG] [LOCAL ] AGO: Loaded 20744 existing records from primary storage. [2025-09-14T20:49:24.213125] [INFO ] [MAIN ] AGO: Loaded 20744 primary data records. [2025-09-14T20:49:24.799609] [DEBUG] [MAIN ] AGM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:24.802379] [INFO ] [MAIN ] AGM: Generated 1352 derivative records from 8023 primary records. [2025-09-14T20:49:24.802489] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-14T20:49:24.817402] [DEBUG] [LOCAL ] AGM: Derivative data saved (1352 records). [2025-09-14T20:49:24.817727] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-14T20:49:24.819741] [INFO ] [MAIN ] Derivative Progress: 52/2226 symbols completed. AGM took 1.1s. Estimated remaining: 13m 38s. Rate: 159.6 symbols/min [2025-09-14T20:49:24.820065] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:24.836859] [DEBUG] [MAIN ] AGL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:24.837706] [INFO ] [MAIN ] AGL: Generated 1352 derivative records from 39444 primary records. [2025-09-14T20:49:24.837986] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-14T20:49:24.862224] [DEBUG] [LOCAL ] AGL: Derivative data saved (1352 records). [2025-09-14T20:49:24.862475] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-14T20:49:24.864811] [INFO ] [MAIN ] Derivative Progress: 53/2226 symbols completed. AGL took 1.1s. Estimated remaining: 13m 24s. Rate: 162.2 symbols/min [2025-09-14T20:49:24.871465] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:24.876419] [DEBUG] [MAIN ] AGO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:24.877735] [INFO ] [MAIN ] AGO: Generated 1352 derivative records from 20744 primary records. [2025-09-14T20:49:24.878433] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-14T20:49:24.888293] [DEBUG] [LOCAL ] AGRO: Loaded 24450 existing records from primary storage. [2025-09-14T20:49:24.897210] [INFO ] [MAIN ] AGRO: Loaded 24450 primary data records. [2025-09-14T20:49:24.967956] [DEBUG] [LOCAL ] AGO: Derivative data saved (1352 records). [2025-09-14T20:49:25.010999] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-14T20:49:25.017076] [INFO ] [MAIN ] Derivative Progress: 54/2226 symbols completed. AGO took 1.2s. Estimated remaining: 13m 14s. Rate: 164.0 symbols/min [2025-09-14T20:49:25.059817] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:25.107910] [DEBUG] [LOCAL ] AGX: Loaded 25055 existing records from primary storage. [2025-09-14T20:49:25.199671] [INFO ] [MAIN ] AGX: Loaded 25055 primary data records. [2025-09-14T20:49:25.502001] [DEBUG] [LOCAL ] AHH: Loaded 30344 existing records from primary storage. [2025-09-14T20:49:25.502703] [INFO ] [MAIN ] AHH: Loaded 30344 primary data records. [2025-09-14T20:49:25.673948] [DEBUG] [MAIN ] AGRO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:25.720526] [INFO ] [MAIN ] AGRO: Generated 1352 derivative records from 24450 primary records. [2025-09-14T20:49:25.748301] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-14T20:49:25.870449] [DEBUG] [MAIN ] AGX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:25.870129] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1352 records). [2025-09-14T20:49:25.871666] [INFO ] [MAIN ] AGX: Generated 1352 derivative records from 25055 primary records. [2025-09-14T20:49:25.872211] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-14T20:49:25.872077] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-14T20:49:25.875436] [INFO ] [MAIN ] Derivative Progress: 55/2226 symbols completed. AGRO took 1.1s. Estimated remaining: 13m 34s. Rate: 160.1 symbols/min [2025-09-14T20:49:25.882258] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:25.889221] [DEBUG] [LOCAL ] AGX: Derivative data saved (1352 records). [2025-09-14T20:49:25.891023] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-14T20:49:25.893887] [INFO ] [MAIN ] Derivative Progress: 56/2226 symbols completed. AGX took 1.0s. Estimated remaining: 13m 19s. Rate: 162.9 symbols/min [2025-09-14T20:49:25.894620] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:25.915847] [DEBUG] [LOCAL ] AHT: Loaded 4581 existing records from primary storage. [2025-09-14T20:49:25.920535] [INFO ] [MAIN ] AHT: Loaded 4581 primary data records. [2025-09-14T20:49:25.920445] [DEBUG] [MAIN ] AHH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:25.944924] [INFO ] [MAIN ] AHH: Generated 1352 derivative records from 30344 primary records. [2025-09-14T20:49:25.983440] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-14T20:49:26.089634] [DEBUG] [LOCAL ] AHR: Loaded 37011 existing records from primary storage. [2025-09-14T20:49:26.131202] [DEBUG] [LOCAL ] AHH: Derivative data saved (1352 records). [2025-09-14T20:49:26.132963] [INFO ] [MAIN ] AHR: Loaded 37011 primary data records. [2025-09-14T20:49:26.152109] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-14T20:49:26.181797] [INFO ] [MAIN ] Derivative Progress: 57/2226 symbols completed. AHH took 1.1s. Estimated remaining: 13m 16s. Rate: 163.5 symbols/min [2025-09-14T20:49:26.182178] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:26.630460] [DEBUG] [LOCAL ] AI: Loaded 40507 existing records from primary storage. [2025-09-14T20:49:26.631792] [INFO ] [MAIN ] AI: Loaded 40507 primary data records. [2025-09-14T20:49:26.720714] [DEBUG] [MAIN ] AHT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:26.760183] [INFO ] [MAIN ] AHT: Generated 1352 derivative records from 4581 primary records. [2025-09-14T20:49:26.760668] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-14T20:49:26.800463] [DEBUG] [LOCAL ] AHT: Derivative data saved (1352 records). [2025-09-14T20:49:26.806045] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-14T20:49:26.841937] [INFO ] [MAIN ] Derivative Progress: 58/2226 symbols completed. AHT took 0.9s. Estimated remaining: 13m 27s. Rate: 161.3 symbols/min [2025-09-14T20:49:26.976368] [DEBUG] [MAIN ] AHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:26.978264] [INFO ] [MAIN ] AHR: Generated 1352 derivative records from 37011 primary records. [2025-09-14T20:49:26.979258] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-14T20:49:26.995153] [DEBUG] [LOCAL ] AHR: Derivative data saved (1352 records). [2025-09-14T20:49:26.995370] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-14T20:49:26.997747] [INFO ] [MAIN ] Derivative Progress: 59/2226 symbols completed. AHR took 1.1s. Estimated remaining: 13m 18s. Rate: 162.9 symbols/min [2025-09-14T20:49:27.015165] [DEBUG] [MAIN ] AI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:27.016100] [INFO ] [MAIN ] AI: Generated 1352 derivative records from 40507 primary records. [2025-09-14T20:49:27.016187] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-14T20:49:27.028758] [DEBUG] [LOCAL ] AI: Derivative data saved (1352 records). [2025-09-14T20:49:27.028864] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-14T20:49:27.030894] [INFO ] [MAIN ] Derivative Progress: 60/2226 symbols completed. AI took 0.8s. Estimated remaining: 13m 6s. Rate: 165.4 symbols/min [2025-09-14T20:49:27.032183] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:27.031919] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:27.032345] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:27.049675] [DEBUG] [LOCAL ] AIO: Loaded 9333 existing records from primary storage. [2025-09-14T20:49:27.049935] [INFO ] [MAIN ] AIO: Loaded 9333 primary data records. [2025-09-14T20:49:27.190235] [DEBUG] [LOCAL ] AIN: Loaded 18249 existing records from primary storage. [2025-09-14T20:49:27.241506] [DEBUG] [LOCAL ] AIG: Loaded 40230 existing records from primary storage. [2025-09-14T20:49:27.241608] [INFO ] [MAIN ] AIN: Loaded 18249 primary data records. [2025-09-14T20:49:27.270055] [INFO ] [MAIN ] AIG: Loaded 40230 primary data records. [2025-09-14T20:49:27.933392] [DEBUG] [MAIN ] AIO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:27.934740] [INFO ] [MAIN ] AIO: Generated 1352 derivative records from 9333 primary records. [2025-09-14T20:49:27.935168] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-14T20:49:27.955001] [DEBUG] [LOCAL ] AIO: Derivative data saved (1352 records). [2025-09-14T20:49:27.966242] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-14T20:49:27.966581] [DEBUG] [MAIN ] AIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:27.978154] [INFO ] [MAIN ] Derivative Progress: 61/2226 symbols completed. AIO took 0.9s. Estimated remaining: 13m 26s. Rate: 161.1 symbols/min [2025-09-14T20:49:27.979106] [INFO ] [MAIN ] AIN: Generated 1352 derivative records from 18249 primary records. [2025-09-14T20:49:27.979541] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:27.980073] [DEBUG] [MAIN ] AIG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:27.979505] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-14T20:49:27.981677] [INFO ] [MAIN ] AIG: Generated 1352 derivative records from 40230 primary records. [2025-09-14T20:49:27.982108] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-14T20:49:28.006104] [DEBUG] [LOCAL ] AIN: Derivative data saved (1352 records). [2025-09-14T20:49:28.007219] [DEBUG] [LOCAL ] AIG: Derivative data saved (1352 records). [2025-09-14T20:49:28.007619] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-14T20:49:28.007529] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-14T20:49:28.009923] [INFO ] [MAIN ] Derivative Progress: 62/2226 symbols completed. AIN took 1.0s. Estimated remaining: 13m 14s. Rate: 163.6 symbols/min [2025-09-14T20:49:28.012301] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:28.012553] [INFO ] [MAIN ] Derivative Progress: 63/2226 symbols completed. AIG took 1.0s. Estimated remaining: 13m 1s. Rate: 166.2 symbols/min [2025-09-14T20:49:28.012842] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:28.031198] [DEBUG] [LOCAL ] AIR: Loaded 19592 existing records from primary storage. [2025-09-14T20:49:28.031778] [INFO ] [MAIN ] AIR: Loaded 19592 primary data records. [2025-09-14T20:49:28.257462] [DEBUG] [LOCAL ] AIV: Loaded 30028 existing records from primary storage. [2025-09-14T20:49:28.230670] [DEBUG] [LOCAL ] AIT: Loaded 20843 existing records from primary storage. [2025-09-14T20:49:28.263343] [INFO ] [MAIN ] AIV: Loaded 30028 primary data records. [2025-09-14T20:49:28.263428] [INFO ] [MAIN ] AIT: Loaded 20843 primary data records. [2025-09-14T20:49:28.984455] [DEBUG] [MAIN ] AIR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:28.986664] [INFO ] [MAIN ] AIR: Generated 1352 derivative records from 19592 primary records. [2025-09-14T20:49:28.987053] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-14T20:49:29.010330] [DEBUG] [LOCAL ] AIR: Derivative data saved (1352 records). [2025-09-14T20:49:29.015100] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-14T20:49:29.015406] [DEBUG] [MAIN ] AIT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:29.017783] [INFO ] [MAIN ] Derivative Progress: 64/2226 symbols completed. AIR took 1.0s. Estimated remaining: 13m 22s. Rate: 161.7 symbols/min [2025-09-14T20:49:29.018811] [INFO ] [MAIN ] AIT: Generated 1352 derivative records from 20843 primary records. [2025-09-14T20:49:29.020829] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:29.021555] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-14T20:49:29.045933] [DEBUG] [LOCAL ] AIT: Derivative data saved (1352 records). [2025-09-14T20:49:29.046403] [DEBUG] [MAIN ] AIV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:29.047233] [INFO ] [MAIN ] AIV: Generated 1352 derivative records from 30028 primary records. [2025-09-14T20:49:29.047525] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-14T20:49:29.047354] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-14T20:49:29.050807] [INFO ] [MAIN ] Derivative Progress: 65/2226 symbols completed. AIT took 1.0s. Estimated remaining: 13m 11s. Rate: 164.0 symbols/min [2025-09-14T20:49:29.051410] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:29.072342] [DEBUG] [LOCAL ] AIV: Derivative data saved (1352 records). [2025-09-14T20:49:29.072521] [DEBUG] [LOCAL ] AIZN: Loaded 2657 existing records from primary storage. [2025-09-14T20:49:29.072878] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-14T20:49:29.072823] [INFO ] [MAIN ] AIZN: Loaded 2657 primary data records. [2025-09-14T20:49:29.074915] [INFO ] [MAIN ] Derivative Progress: 66/2226 symbols completed. AIV took 1.1s. Estimated remaining: 12m 59s. Rate: 166.3 symbols/min [2025-09-14T20:49:29.119186] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:29.161818] [DEBUG] [LOCAL ] AIZ: Loaded 22672 existing records from primary storage. [2025-09-14T20:49:29.190380] [INFO ] [MAIN ] AIZ: Loaded 22672 primary data records. [2025-09-14T20:49:29.707500] [DEBUG] [LOCAL ] ALB: Loaded 40199 existing records from primary storage. [2025-09-14T20:49:29.708902] [INFO ] [MAIN ] ALB: Loaded 40199 primary data records. [2025-09-14T20:49:30.015564] [DEBUG] [MAIN ] AIZN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:30.017002] [INFO ] [MAIN ] AIZN: Generated 1352 derivative records from 2657 primary records. [2025-09-14T20:49:30.018103] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-14T20:49:30.034337] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1352 records). [2025-09-14T20:49:30.035237] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-14T20:49:30.045670] [DEBUG] [MAIN ] AIZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:30.047992] [INFO ] [MAIN ] Derivative Progress: 67/2226 symbols completed. AIZN took 1.0s. Estimated remaining: 13m 19s. Rate: 162.2 symbols/min [2025-09-14T20:49:30.048859] [INFO ] [MAIN ] AIZ: Generated 1352 derivative records from 22672 primary records. [2025-09-14T20:49:30.050726] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-14T20:49:30.049754] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:30.065753] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1352 records). [2025-09-14T20:49:30.066117] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-14T20:49:30.068340] [INFO ] [MAIN ] Derivative Progress: 68/2226 symbols completed. AIZ took 1.0s. Estimated remaining: 13m 7s. Rate: 164.5 symbols/min [2025-09-14T20:49:30.069041] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:30.088006] [DEBUG] [MAIN ] ALB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:30.089078] [INFO ] [MAIN ] ALB: Generated 1352 derivative records from 40199 primary records. [2025-09-14T20:49:30.089177] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-14T20:49:30.127813] [DEBUG] [LOCAL ] ALB: Derivative data saved (1352 records). [2025-09-14T20:49:30.128112] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-14T20:49:30.130144] [INFO ] [MAIN ] Derivative Progress: 69/2226 symbols completed. ALB took 1.0s. Estimated remaining: 12m 57s. Rate: 166.5 symbols/min [2025-09-14T20:49:30.131043] [DEBUG] [LOCAL ] ALE: Loaded 22557 existing records from primary storage. [2025-09-14T20:49:30.142787] [INFO ] [MAIN ] ALE: Loaded 22557 primary data records. [2025-09-14T20:49:30.130952] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:30.175516] [DEBUG] [LOCAL ] ALC: Loaded 38195 existing records from primary storage. [2025-09-14T20:49:30.195347] [INFO ] [MAIN ] ALC: Loaded 38195 primary data records. [2025-09-14T20:49:30.483476] [DEBUG] [LOCAL ] ALEX: Loaded 22143 existing records from primary storage. [2025-09-14T20:49:30.504199] [INFO ] [MAIN ] ALEX: Loaded 22143 primary data records. [2025-09-14T20:49:31.071811] [DEBUG] [MAIN ] ALE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:31.074066] [INFO ] [MAIN ] ALE: Generated 1352 derivative records from 22557 primary records. [2025-09-14T20:49:31.074270] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-14T20:49:31.098670] [DEBUG] [LOCAL ] ALE: Derivative data saved (1352 records). [2025-09-14T20:49:31.099390] [DEBUG] [MAIN ] ALC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:31.099487] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-14T20:49:31.102490] [INFO ] [MAIN ] Derivative Progress: 70/2226 symbols completed. ALE took 1.0s. Estimated remaining: 13m 16s. Rate: 162.6 symbols/min [2025-09-14T20:49:31.100356] [INFO ] [MAIN ] ALC: Generated 1352 derivative records from 38195 primary records. [2025-09-14T20:49:31.102886] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-14T20:49:31.102824] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:31.121304] [DEBUG] [LOCAL ] ALC: Derivative data saved (1352 records). [2025-09-14T20:49:31.121676] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-14T20:49:31.138837] [DEBUG] [LOCAL ] ALG: Loaded 7527 existing records from primary storage. [2025-09-14T20:49:31.138581] [DEBUG] [MAIN ] ALEX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:31.133777] [INFO ] [MAIN ] Derivative Progress: 71/2226 symbols completed. ALC took 1.1s. Estimated remaining: 13m 5s. Rate: 164.7 symbols/min [2025-09-14T20:49:31.139014] [INFO ] [MAIN ] ALG: Loaded 7527 primary data records. [2025-09-14T20:49:31.139246] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:31.139879] [INFO ] [MAIN ] ALEX: Generated 1352 derivative records from 22143 primary records. [2025-09-14T20:49:31.162151] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-14T20:49:31.366789] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1352 records). [2025-09-14T20:49:31.492397] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-14T20:49:31.521017] [INFO ] [MAIN ] Derivative Progress: 72/2226 symbols completed. ALEX took 1.4s. Estimated remaining: 13m 5s. Rate: 164.5 symbols/min [2025-09-14T20:49:31.534010] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:31.535824] [DEBUG] [LOCAL ] ALIT: Loaded 39630 existing records from primary storage. [2025-09-14T20:49:31.536985] [INFO ] [MAIN ] ALIT: Loaded 39630 primary data records. [2025-09-14T20:49:31.856164] [DEBUG] [LOCAL ] ALK: Loaded 39879 existing records from primary storage. [2025-09-14T20:49:31.867174] [DEBUG] [MAIN ] ALG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:31.867750] [INFO ] [MAIN ] ALK: Loaded 39879 primary data records. [2025-09-14T20:49:31.869786] [INFO ] [MAIN ] ALG: Generated 1352 derivative records from 7527 primary records. [2025-09-14T20:49:31.870445] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-14T20:49:32.040017] [DEBUG] [LOCAL ] ALG: Derivative data saved (1352 records). [2025-09-14T20:49:32.064119] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-14T20:49:32.160205] [INFO ] [MAIN ] Derivative Progress: 73/2226 symbols completed. ALG took 1.1s. Estimated remaining: 13m 13s. Rate: 162.9 symbols/min [2025-09-14T20:49:32.175051] [DEBUG] [MAIN ] ALIT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:32.176997] [INFO ] [MAIN ] ALIT: Generated 1352 derivative records from 39630 primary records. [2025-09-14T20:49:32.177808] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-14T20:49:32.193798] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1352 records). [2025-09-14T20:49:32.194016] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-14T20:49:32.196573] [INFO ] [MAIN ] Derivative Progress: 74/2226 symbols completed. ALIT took 1.1s. Estimated remaining: 13m 3s. Rate: 164.9 symbols/min [2025-09-14T20:49:32.209922] [DEBUG] [MAIN ] ALK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:32.210776] [INFO ] [MAIN ] ALK: Generated 1352 derivative records from 39879 primary records. [2025-09-14T20:49:32.210858] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-14T20:49:32.223354] [DEBUG] [LOCAL ] ALK: Derivative data saved (1352 records). [2025-09-14T20:49:32.223431] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-14T20:49:32.225621] [INFO ] [MAIN ] Derivative Progress: 75/2226 symbols completed. ALK took 0.7s. Estimated remaining: 12m 53s. Rate: 166.9 symbols/min [2025-09-14T20:49:32.226501] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:32.226586] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:32.226943] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:32.311562] [DEBUG] [LOCAL ] ALLY: Loaded 40000 existing records from primary storage. [2025-09-14T20:49:32.311803] [INFO ] [MAIN ] ALLY: Loaded 40000 primary data records. [2025-09-14T20:49:32.417282] [DEBUG] [LOCAL ] ALL: Loaded 37481 existing records from primary storage. [2025-09-14T20:49:32.441704] [DEBUG] [LOCAL ] ALLE: Loaded 33449 existing records from primary storage. [2025-09-14T20:49:32.444213] [INFO ] [MAIN ] ALLE: Loaded 33449 primary data records. [2025-09-14T20:49:32.444365] [INFO ] [MAIN ] ALL: Loaded 37481 primary data records. [2025-09-14T20:49:33.227393] [DEBUG] [MAIN ] ALLY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:33.231599] [INFO ] [MAIN ] ALLY: Generated 1352 derivative records from 40000 primary records. [2025-09-14T20:49:33.232287] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-14T20:49:33.270884] [DEBUG] [MAIN ] ALL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:33.271776] [DEBUG] [MAIN ] ALLE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:33.273240] [INFO ] [MAIN ] ALL: Generated 1352 derivative records from 37481 primary records. [2025-09-14T20:49:33.275049] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-14T20:49:33.274699] [INFO ] [MAIN ] ALLE: Generated 1352 derivative records from 33449 primary records. [2025-09-14T20:49:33.275232] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-14T20:49:33.301874] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1352 records). [2025-09-14T20:49:33.303085] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-14T20:49:33.301997] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1352 records). [2025-09-14T20:49:33.309588] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-14T20:49:33.309327] [INFO ] [MAIN ] Derivative Progress: 76/2226 symbols completed. ALLY took 1.1s. Estimated remaining: 13m 13s. Rate: 162.6 symbols/min [2025-09-14T20:49:33.313000] [INFO ] [MAIN ] Derivative Progress: 77/2226 symbols completed. ALLE took 1.1s. Estimated remaining: 13m 3s. Rate: 164.7 symbols/min [2025-09-14T20:49:33.315043] [DEBUG] [LOCAL ] ALL: Derivative data saved (1352 records). [2025-09-14T20:49:33.315864] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:33.315534] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-14T20:49:33.315703] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:33.318584] [INFO ] [MAIN ] Derivative Progress: 78/2226 symbols completed. ALL took 1.1s. Estimated remaining: 12m 53s. Rate: 166.8 symbols/min [2025-09-14T20:49:33.320031] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:33.333356] [DEBUG] [LOCAL ] ALUR: Loaded 7481 existing records from primary storage. [2025-09-14T20:49:33.333670] [INFO ] [MAIN ] ALUR: Loaded 7481 primary data records. [2025-09-14T20:49:33.461457] [DEBUG] [LOCAL ] ALTG: Loaded 17492 existing records from primary storage. [2025-09-14T20:49:33.462143] [INFO ] [MAIN ] ALTG: Loaded 17492 primary data records. [2025-09-14T20:49:33.577556] [DEBUG] [LOCAL ] ALSN: Loaded 32125 existing records from primary storage. [2025-09-14T20:49:33.622051] [INFO ] [MAIN ] ALSN: Loaded 32125 primary data records. [2025-09-14T20:49:34.340116] [DEBUG] [MAIN ] ALUR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:34.341414] [INFO ] [MAIN ] ALUR: Generated 1352 derivative records from 7481 primary records. [2025-09-14T20:49:34.341784] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-14T20:49:34.366809] [DEBUG] [MAIN ] ALTG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:34.368154] [INFO ] [MAIN ] ALTG: Generated 1352 derivative records from 17492 primary records. [2025-09-14T20:49:34.368751] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-14T20:49:34.369636] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1352 records). [2025-09-14T20:49:34.370595] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-14T20:49:34.380496] [INFO ] [MAIN ] Derivative Progress: 79/2226 symbols completed. ALUR took 1.1s. Estimated remaining: 13m 11s. Rate: 162.8 symbols/min [2025-09-14T20:49:34.380962] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:34.389472] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1352 records). [2025-09-14T20:49:34.389654] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-14T20:49:34.392044] [INFO ] [MAIN ] Derivative Progress: 80/2226 symbols completed. ALTG took 1.1s. Estimated remaining: 13m 1s. Rate: 164.8 symbols/min [2025-09-14T20:49:34.403584] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:34.404286] [DEBUG] [MAIN ] ALSN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:34.405825] [INFO ] [MAIN ] ALSN: Generated 1352 derivative records from 32125 primary records. [2025-09-14T20:49:34.406085] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-14T20:49:34.421220] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1352 records). [2025-09-14T20:49:34.421472] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-14T20:49:34.424363] [INFO ] [MAIN ] Derivative Progress: 81/2226 symbols completed. ALSN took 1.1s. Estimated remaining: 12m 52s. Rate: 166.7 symbols/min [2025-09-14T20:49:34.429024] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:34.428770] [DEBUG] [LOCAL ] ALX: Loaded 5134 existing records from primary storage. [2025-09-14T20:49:34.429475] [INFO ] [MAIN ] ALX: Loaded 5134 primary data records. [2025-09-14T20:49:34.596178] [DEBUG] [LOCAL ] ALV: Loaded 31582 existing records from primary storage. [2025-09-14T20:49:34.615859] [INFO ] [MAIN ] ALV: Loaded 31582 primary data records. [2025-09-14T20:49:34.914817] [DEBUG] [LOCAL ] AM: Loaded 39021 existing records from primary storage. [2025-09-14T20:49:34.948604] [INFO ] [MAIN ] AM: Loaded 39021 primary data records. [2025-09-14T20:49:35.365589] [DEBUG] [MAIN ] ALX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:35.368946] [INFO ] [MAIN ] ALX: Generated 1352 derivative records from 5134 primary records. [2025-09-14T20:49:35.369427] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-14T20:49:35.385343] [DEBUG] [LOCAL ] ALX: Derivative data saved (1352 records). [2025-09-14T20:49:35.387494] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-14T20:49:35.389445] [INFO ] [MAIN ] Derivative Progress: 82/2226 symbols completed. ALX took 1.0s. Estimated remaining: 13m 8s. Rate: 163.3 symbols/min [2025-09-14T20:49:35.390240] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:35.401218] [DEBUG] [MAIN ] ALV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:35.402173] [INFO ] [MAIN ] ALV: Generated 1352 derivative records from 31582 primary records. [2025-09-14T20:49:35.402463] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-14T20:49:35.416145] [DEBUG] [LOCAL ] ALV: Derivative data saved (1352 records). [2025-09-14T20:49:35.416338] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-14T20:49:35.418811] [INFO ] [MAIN ] Derivative Progress: 83/2226 symbols completed. ALV took 1.0s. Estimated remaining: 12m 59s. Rate: 165.2 symbols/min [2025-09-14T20:49:35.420343] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:35.443335] [DEBUG] [MAIN ] AM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:35.444872] [INFO ] [MAIN ] AM: Generated 1352 derivative records from 39021 primary records. [2025-09-14T20:49:35.445001] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-14T20:49:35.459901] [DEBUG] [LOCAL ] AM: Derivative data saved (1352 records). [2025-09-14T20:49:35.470371] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-14T20:49:35.474432] [INFO ] [MAIN ] Derivative Progress: 84/2226 symbols completed. AM took 1.0s. Estimated remaining: 12m 50s. Rate: 166.8 symbols/min [2025-09-14T20:49:35.475901] [DEBUG] [LOCAL ] AMBC: Loaded 27132 existing records from primary storage. [2025-09-14T20:49:35.476413] [INFO ] [MAIN ] AMBC: Loaded 27132 primary data records. [2025-09-14T20:49:35.476562] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:35.633252] [DEBUG] [LOCAL ] AMBP: Loaded 34048 existing records from primary storage. [2025-09-14T20:49:35.696722] [INFO ] [MAIN ] AMBP: Loaded 34048 primary data records. [2025-09-14T20:49:35.873565] [DEBUG] [LOCAL ] AMC: Loaded 40510 existing records from primary storage. [2025-09-14T20:49:35.918188] [INFO ] [MAIN ] AMC: Loaded 40510 primary data records. [2025-09-14T20:49:36.463788] [DEBUG] [MAIN ] AMBC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:36.477875] [INFO ] [MAIN ] AMBC: Generated 1352 derivative records from 27132 primary records. [2025-09-14T20:49:36.478470] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-14T20:49:36.493000] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1352 records). [2025-09-14T20:49:36.493583] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-14T20:49:36.495682] [INFO ] [MAIN ] Derivative Progress: 85/2226 symbols completed. AMBC took 1.1s. Estimated remaining: 13m 7s. Rate: 163.3 symbols/min [2025-09-14T20:49:36.496472] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:36.511840] [DEBUG] [MAIN ] AMBP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:36.512608] [INFO ] [MAIN ] AMBP: Generated 1352 derivative records from 34048 primary records. [2025-09-14T20:49:36.512962] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-14T20:49:36.526734] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1352 records). [2025-09-14T20:49:36.527090] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-14T20:49:36.529503] [INFO ] [MAIN ] Derivative Progress: 86/2226 symbols completed. AMBP took 1.1s. Estimated remaining: 12m 58s. Rate: 165.0 symbols/min [2025-09-14T20:49:36.529807] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:36.548210] [DEBUG] [MAIN ] AMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:36.549311] [INFO ] [MAIN ] AMC: Generated 1352 derivative records from 40510 primary records. [2025-09-14T20:49:36.549439] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-14T20:49:36.572426] [DEBUG] [LOCAL ] AMC: Derivative data saved (1352 records). [2025-09-14T20:49:36.572717] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-14T20:49:36.575178] [INFO ] [MAIN ] Derivative Progress: 87/2226 symbols completed. AMC took 1.1s. Estimated remaining: 12m 50s. Rate: 166.7 symbols/min [2025-09-14T20:49:36.575996] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:36.603479] [DEBUG] [LOCAL ] AMCR: Loaded 40412 existing records from primary storage. [2025-09-14T20:49:36.603831] [INFO ] [MAIN ] AMCR: Loaded 40412 primary data records. [2025-09-14T20:49:36.736544] [DEBUG] [LOCAL ] AME: Loaded 36349 existing records from primary storage. [2025-09-14T20:49:36.741102] [INFO ] [MAIN ] AME: Loaded 36349 primary data records. [2025-09-14T20:49:36.740838] [DEBUG] [LOCAL ] AMG: Loaded 14731 existing records from primary storage. [2025-09-14T20:49:36.741226] [INFO ] [MAIN ] AMG: Loaded 14731 primary data records. [2025-09-14T20:49:37.488697] [DEBUG] [MAIN ] AMCR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:37.490626] [INFO ] [MAIN ] AMCR: Generated 1352 derivative records from 40412 primary records. [2025-09-14T20:49:37.491033] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-14T20:49:37.510144] [DEBUG] [MAIN ] AMG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:37.524474] [INFO ] [MAIN ] AMG: Generated 1352 derivative records from 14731 primary records. [2025-09-14T20:49:37.525855] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-14T20:49:37.525441] [DEBUG] [MAIN ] AME: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:37.528141] [INFO ] [MAIN ] AME: Generated 1352 derivative records from 36349 primary records. [2025-09-14T20:49:37.534561] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-14T20:49:37.542750] [DEBUG] [LOCAL ] AMG: Derivative data saved (1352 records). [2025-09-14T20:49:37.543546] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-14T20:49:37.543843] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1352 records). [2025-09-14T20:49:37.554454] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-14T20:49:37.554368] [INFO ] [MAIN ] Derivative Progress: 88/2226 symbols completed. AMG took 1.0s. Estimated remaining: 13m 4s. Rate: 163.5 symbols/min [2025-09-14T20:49:37.557017] [INFO ] [MAIN ] Derivative Progress: 89/2226 symbols completed. AMCR took 1.1s. Estimated remaining: 12m 55s. Rate: 165.4 symbols/min [2025-09-14T20:49:37.560709] [DEBUG] [LOCAL ] AME: Derivative data saved (1352 records). [2025-09-14T20:49:37.560906] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-14T20:49:37.563276] [INFO ] [MAIN ] Derivative Progress: 90/2226 symbols completed. AME took 1.0s. Estimated remaining: 12m 47s. Rate: 167.2 symbols/min [2025-09-14T20:49:37.563912] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:37.563973] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:37.564058] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:37.598413] [DEBUG] [LOCAL ] AMP: Loaded 23565 existing records from primary storage. [2025-09-14T20:49:37.598601] [INFO ] [MAIN ] AMP: Loaded 23565 primary data records. [2025-09-14T20:49:37.774130] [DEBUG] [LOCAL ] AMH: Loaded 38783 existing records from primary storage. [2025-09-14T20:49:37.781481] [DEBUG] [LOCAL ] AMN: Loaded 31538 existing records from primary storage. [2025-09-14T20:49:37.835443] [INFO ] [MAIN ] AMH: Loaded 38783 primary data records. [2025-09-14T20:49:37.835900] [INFO ] [MAIN ] AMN: Loaded 31538 primary data records. [2025-09-14T20:49:38.514580] [DEBUG] [MAIN ] AMP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:38.516943] [INFO ] [MAIN ] AMP: Generated 1352 derivative records from 23565 primary records. [2025-09-14T20:49:38.517199] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-14T20:49:38.534218] [DEBUG] [LOCAL ] AMP: Derivative data saved (1352 records). [2025-09-14T20:49:38.534633] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-14T20:49:38.536537] [INFO ] [MAIN ] Derivative Progress: 91/2226 symbols completed. AMP took 1.0s. Estimated remaining: 13m 1s. Rate: 164.1 symbols/min [2025-09-14T20:49:38.537011] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:38.551334] [DEBUG] [MAIN ] AMH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:38.552723] [INFO ] [MAIN ] AMH: Generated 1352 derivative records from 38783 primary records. [2025-09-14T20:49:38.552977] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-14T20:49:38.569445] [DEBUG] [LOCAL ] AMH: Derivative data saved (1352 records). [2025-09-14T20:49:38.579628] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-14T20:49:38.582334] [INFO ] [MAIN ] Derivative Progress: 92/2226 symbols completed. AMH took 1.0s. Estimated remaining: 12m 53s. Rate: 165.7 symbols/min [2025-09-14T20:49:38.583121] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:38.583047] [DEBUG] [MAIN ] AMN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:38.584411] [INFO ] [MAIN ] AMN: Generated 1352 derivative records from 31538 primary records. [2025-09-14T20:49:38.584623] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-14T20:49:38.629696] [DEBUG] [LOCAL ] AMPX: Loaded 39319 existing records from primary storage. [2025-09-14T20:49:38.637736] [DEBUG] [LOCAL ] AMN: Derivative data saved (1352 records). [2025-09-14T20:49:38.638122] [INFO ] [MAIN ] AMPX: Loaded 39319 primary data records. [2025-09-14T20:49:38.638424] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-14T20:49:38.661840] [INFO ] [MAIN ] Derivative Progress: 93/2226 symbols completed. AMN took 1.1s. Estimated remaining: 12m 46s. Rate: 167.1 symbols/min [2025-09-14T20:49:38.733362] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:38.780467] [DEBUG] [LOCAL ] AMPY: Loaded 28357 existing records from primary storage. [2025-09-14T20:49:38.828149] [INFO ] [MAIN ] AMPY: Loaded 28357 primary data records. [2025-09-14T20:49:39.065092] [DEBUG] [LOCAL ] AMR: Loaded 21672 existing records from primary storage. [2025-09-14T20:49:39.140326] [INFO ] [MAIN ] AMR: Loaded 21672 primary data records. [2025-09-14T20:49:39.530043] [DEBUG] [MAIN ] AMPX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:39.532351] [INFO ] [MAIN ] AMPX: Generated 1352 derivative records from 39319 primary records. [2025-09-14T20:49:39.532674] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-14T20:49:39.549775] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1352 records). [2025-09-14T20:49:39.551477] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-14T20:49:39.554873] [INFO ] [MAIN ] Derivative Progress: 94/2226 symbols completed. AMPX took 1.0s. Estimated remaining: 12m 58s. Rate: 164.5 symbols/min [2025-09-14T20:49:39.565501] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:39.566824] [DEBUG] [MAIN ] AMPY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:39.568542] [INFO ] [MAIN ] AMPY: Generated 1352 derivative records from 28357 primary records. [2025-09-14T20:49:39.568970] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-14T20:49:39.586677] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1352 records). [2025-09-14T20:49:39.586927] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-14T20:49:39.599632] [INFO ] [MAIN ] Derivative Progress: 95/2226 symbols completed. AMPY took 1.0s. Estimated remaining: 12m 50s. Rate: 166.0 symbols/min [2025-09-14T20:49:39.600379] [DEBUG] [MAIN ] AMR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:39.610355] [INFO ] [MAIN ] AMR: Generated 1352 derivative records from 21672 primary records. [2025-09-14T20:49:39.610493] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:39.610874] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-14T20:49:39.626169] [DEBUG] [LOCAL ] AMR: Derivative data saved (1352 records). [2025-09-14T20:49:39.635018] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-14T20:49:39.638551] [DEBUG] [LOCAL ] AMRC: Loaded 28206 existing records from primary storage. [2025-09-14T20:49:39.637696] [INFO ] [MAIN ] Derivative Progress: 96/2226 symbols completed. AMR took 0.9s. Estimated remaining: 12m 43s. Rate: 167.6 symbols/min [2025-09-14T20:49:39.638864] [INFO ] [MAIN ] AMRC: Loaded 28206 primary data records. [2025-09-14T20:49:39.639096] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:39.953514] [DEBUG] [LOCAL ] AMTB: Loaded 15567 existing records from primary storage. [2025-09-14T20:49:39.953397] [DEBUG] [LOCAL ] AMT: Loaded 39337 existing records from primary storage. [2025-09-14T20:49:39.960142] [INFO ] [MAIN ] AMT: Loaded 39337 primary data records. [2025-09-14T20:49:39.960210] [INFO ] [MAIN ] AMTB: Loaded 15567 primary data records. [2025-09-14T20:49:40.548008] [DEBUG] [MAIN ] AMRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:40.549244] [INFO ] [MAIN ] AMRC: Generated 1352 derivative records from 28206 primary records. [2025-09-14T20:49:40.549515] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-14T20:49:40.563965] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1352 records). [2025-09-14T20:49:40.564454] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-14T20:49:40.566594] [INFO ] [MAIN ] Derivative Progress: 97/2226 symbols completed. AMRC took 1.0s. Estimated remaining: 12m 55s. Rate: 164.9 symbols/min [2025-09-14T20:49:40.567044] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:40.574852] [DEBUG] [LOCAL ] AMTD: Loaded 2827 existing records from primary storage. [2025-09-14T20:49:40.585372] [INFO ] [MAIN ] AMTD: Loaded 2827 primary data records. [2025-09-14T20:49:40.585862] [DEBUG] [MAIN ] AMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:40.628061] [INFO ] [MAIN ] AMT: Generated 1352 derivative records from 39337 primary records. [2025-09-14T20:49:40.674817] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-14T20:49:40.687384] [DEBUG] [MAIN ] AMTB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:40.699231] [INFO ] [MAIN ] AMTB: Generated 1352 derivative records from 15567 primary records. [2025-09-14T20:49:40.710994] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-14T20:49:40.800575] [DEBUG] [LOCAL ] AMT: Derivative data saved (1352 records). [2025-09-14T20:49:40.820428] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-14T20:49:40.826563] [INFO ] [MAIN ] Derivative Progress: 98/2226 symbols completed. AMT took 1.2s. Estimated remaining: 12m 52s. Rate: 165.3 symbols/min [2025-09-14T20:49:40.838793] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:40.917804] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1352 records). [2025-09-14T20:49:40.918885] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-14T20:49:40.921663] [INFO ] [MAIN ] Derivative Progress: 99/2226 symbols completed. AMTB took 1.3s. Estimated remaining: 12m 46s. Rate: 166.6 symbols/min [2025-09-14T20:49:40.922125] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:40.936467] [DEBUG] [LOCAL ] AMWL: Loaded 6581 existing records from primary storage. [2025-09-14T20:49:40.937065] [INFO ] [MAIN ] AMWL: Loaded 6581 primary data records. [2025-09-14T20:49:41.150284] [DEBUG] [MAIN ] AMTD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:41.168033] [DEBUG] [LOCAL ] AMTM: Loaded 37905 existing records from primary storage. [2025-09-14T20:49:41.184084] [INFO ] [MAIN ] AMTD: Generated 1352 derivative records from 2827 primary records. [2025-09-14T20:49:41.198284] [INFO ] [MAIN ] AMTM: Loaded 37905 primary data records. [2025-09-14T20:49:41.223358] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-14T20:49:41.427574] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1352 records). [2025-09-14T20:49:41.443466] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-14T20:49:41.491496] [INFO ] [MAIN ] Derivative Progress: 100/2226 symbols completed. AMTD took 0.9s. Estimated remaining: 12m 50s. Rate: 165.6 symbols/min [2025-09-14T20:49:41.533088] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:41.645859] [DEBUG] [MAIN ] AMWL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:41.647044] [INFO ] [MAIN ] AMWL: Generated 1352 derivative records from 6581 primary records. [2025-09-14T20:49:41.647243] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-14T20:49:41.663823] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1352 records). [2025-09-14T20:49:41.664217] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-14T20:49:41.666689] [INFO ] [MAIN ] Derivative Progress: 101/2226 symbols completed. AMWL took 0.7s. Estimated remaining: 12m 46s. Rate: 166.5 symbols/min [2025-09-14T20:49:41.667568] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:41.694905] [DEBUG] [MAIN ] AMTM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:41.707851] [INFO ] [MAIN ] AMTM: Generated 1352 derivative records from 37905 primary records. [2025-09-14T20:49:41.708211] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-14T20:49:41.708990] [DEBUG] [LOCAL ] AMX: Loaded 36855 existing records from primary storage. [2025-09-14T20:49:41.710668] [INFO ] [MAIN ] AMX: Loaded 36855 primary data records. [2025-09-14T20:49:41.766129] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1352 records). [2025-09-14T20:49:41.793860] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-14T20:49:41.823603] [INFO ] [MAIN ] Derivative Progress: 102/2226 symbols completed. AMTM took 1.0s. Estimated remaining: 12m 41s. Rate: 167.4 symbols/min [2025-09-14T20:49:41.839104] [DEBUG] [LOCAL ] AN: Loaded 23541 existing records from primary storage. [2025-09-14T20:49:41.851683] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:41.851776] [INFO ] [MAIN ] AN: Loaded 23541 primary data records. [2025-09-14T20:49:42.368445] [DEBUG] [LOCAL ] ANET: Loaded 40506 existing records from primary storage. [2025-09-14T20:49:42.369821] [INFO ] [MAIN ] ANET: Loaded 40506 primary data records. [2025-09-14T20:49:42.673619] [DEBUG] [MAIN ] AMX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:42.675576] [INFO ] [MAIN ] AMX: Generated 1352 derivative records from 36855 primary records. [2025-09-14T20:49:42.679264] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-14T20:49:42.706022] [DEBUG] [MAIN ] AN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:42.709042] [INFO ] [MAIN ] AN: Generated 1352 derivative records from 23541 primary records. [2025-09-14T20:49:42.708243] [DEBUG] [LOCAL ] AMX: Derivative data saved (1352 records). [2025-09-14T20:49:42.709250] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-14T20:49:42.711553] [INFO ] [MAIN ] Derivative Progress: 103/2226 symbols completed. AMX took 1.2s. Estimated remaining: 12m 52s. Rate: 165.0 symbols/min [2025-09-14T20:49:42.709455] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-14T20:49:42.731183] [DEBUG] [LOCAL ] AN: Derivative data saved (1352 records). [2025-09-14T20:49:42.731389] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-14T20:49:42.733910] [INFO ] [MAIN ] Derivative Progress: 104/2226 symbols completed. AN took 1.1s. Estimated remaining: 12m 45s. Rate: 166.5 symbols/min [2025-09-14T20:49:42.747217] [DEBUG] [MAIN ] ANET: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:42.747915] [INFO ] [MAIN ] ANET: Generated 1352 derivative records from 40506 primary records. [2025-09-14T20:49:42.747992] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-14T20:49:42.760237] [DEBUG] [LOCAL ] ANET: Derivative data saved (1352 records). [2025-09-14T20:49:42.760330] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-14T20:49:42.762553] [INFO ] [MAIN ] Derivative Progress: 105/2226 symbols completed. ANET took 0.9s. Estimated remaining: 12m 37s. Rate: 168.0 symbols/min [2025-09-14T20:49:42.763169] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:42.763384] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:42.763496] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:42.786624] [DEBUG] [LOCAL ] ANRO: Loaded 13852 existing records from primary storage. [2025-09-14T20:49:42.786949] [INFO ] [MAIN ] ANRO: Loaded 13852 primary data records. [2025-09-14T20:49:42.860430] [DEBUG] [LOCAL ] ANVS: Loaded 17780 existing records from primary storage. [2025-09-14T20:49:42.893854] [INFO ] [MAIN ] ANVS: Loaded 17780 primary data records. [2025-09-14T20:49:42.970219] [DEBUG] [LOCAL ] ANF: Loaded 39151 existing records from primary storage. [2025-09-14T20:49:43.046163] [INFO ] [MAIN ] ANF: Loaded 39151 primary data records. [2025-09-14T20:49:43.751175] [DEBUG] [MAIN ] ANRO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:43.752767] [INFO ] [MAIN ] ANRO: Generated 1352 derivative records from 13852 primary records. [2025-09-14T20:49:43.752935] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-14T20:49:43.769882] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1352 records). [2025-09-14T20:49:43.772009] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-14T20:49:43.773976] [INFO ] [MAIN ] Derivative Progress: 106/2226 symbols completed. ANRO took 1.0s. Estimated remaining: 12m 50s. Rate: 165.2 symbols/min [2025-09-14T20:49:43.775033] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:43.786805] [DEBUG] [MAIN ] ANVS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:43.788402] [INFO ] [MAIN ] ANVS: Generated 1352 derivative records from 17780 primary records. [2025-09-14T20:49:43.789963] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-14T20:49:43.812550] [DEBUG] [MAIN ] ANF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:43.812785] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1352 records). [2025-09-14T20:49:43.818995] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-14T20:49:43.820399] [INFO ] [MAIN ] ANF: Generated 1352 derivative records from 39151 primary records. [2025-09-14T20:49:43.823005] [INFO ] [MAIN ] Derivative Progress: 107/2226 symbols completed. ANVS took 1.1s. Estimated remaining: 12m 44s. Rate: 166.5 symbols/min [2025-09-14T20:49:43.823336] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:43.823421] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-14T20:49:43.849144] [DEBUG] [LOCAL ] ANF: Derivative data saved (1352 records). [2025-09-14T20:49:43.849822] [DEBUG] [LOCAL ] AOD: Loaded 22575 existing records from primary storage. [2025-09-14T20:49:43.850082] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-14T20:49:43.850134] [INFO ] [MAIN ] AOD: Loaded 22575 primary data records. [2025-09-14T20:49:43.852584] [INFO ] [MAIN ] Derivative Progress: 108/2226 symbols completed. ANF took 1.1s. Estimated remaining: 12m 37s. Rate: 167.9 symbols/min [2025-09-14T20:49:43.920668] [DEBUG] [LOCAL ] AOMR: Loaded 12788 existing records from primary storage. [2025-09-14T20:49:43.920822] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:43.948248] [INFO ] [MAIN ] AOMR: Loaded 12788 primary data records. [2025-09-14T20:49:44.425438] [DEBUG] [LOCAL ] AON: Loaded 34078 existing records from primary storage. [2025-09-14T20:49:44.426467] [INFO ] [MAIN ] AON: Loaded 34078 primary data records. [2025-09-14T20:49:44.626712] [DEBUG] [MAIN ] AOD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:44.649635] [INFO ] [MAIN ] AOD: Generated 1352 derivative records from 22575 primary records. [2025-09-14T20:49:44.736285] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-14T20:49:44.764530] [DEBUG] [MAIN ] AOMR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:44.767615] [INFO ] [MAIN ] AOMR: Generated 1352 derivative records from 12788 primary records. [2025-09-14T20:49:44.769368] [DEBUG] [LOCAL ] AOD: Derivative data saved (1352 records). [2025-09-14T20:49:44.770939] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-14T20:49:44.773187] [INFO ] [MAIN ] Derivative Progress: 109/2226 symbols completed. AOD took 1.0s. Estimated remaining: 12m 47s. Rate: 165.5 symbols/min [2025-09-14T20:49:44.770140] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-14T20:49:44.774381] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:44.789003] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1352 records). [2025-09-14T20:49:44.789113] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-14T20:49:44.791665] [INFO ] [MAIN ] Derivative Progress: 110/2226 symbols completed. AOMR took 1.0s. Estimated remaining: 12m 40s. Rate: 167.0 symbols/min [2025-09-14T20:49:44.792453] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:44.817486] [DEBUG] [MAIN ] AON: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:44.819230] [INFO ] [MAIN ] AON: Generated 1352 derivative records from 34078 primary records. [2025-09-14T20:49:44.819421] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-14T20:49:44.831181] [DEBUG] [LOCAL ] AORT: Loaded 21896 existing records from primary storage. [2025-09-14T20:49:44.843475] [INFO ] [MAIN ] AORT: Loaded 21896 primary data records. [2025-09-14T20:49:44.909278] [DEBUG] [LOCAL ] AON: Derivative data saved (1352 records). [2025-09-14T20:49:44.956478] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-14T20:49:44.985073] [INFO ] [MAIN ] Derivative Progress: 111/2226 symbols completed. AON took 1.1s. Estimated remaining: 12m 37s. Rate: 167.7 symbols/min [2025-09-14T20:49:45.029358] [DEBUG] [LOCAL ] AOS: Loaded 37044 existing records from primary storage. [2025-09-14T20:49:45.028141] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:45.065138] [INFO ] [MAIN ] AOS: Loaded 37044 primary data records. [2025-09-14T20:49:45.194153] [DEBUG] [LOCAL ] AP: Loaded 5808 existing records from primary storage. [2025-09-14T20:49:45.225358] [INFO ] [MAIN ] AP: Loaded 5808 primary data records. [2025-09-14T20:49:45.845529] [DEBUG] [MAIN ] AORT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:45.848326] [INFO ] [MAIN ] AORT: Generated 1352 derivative records from 21896 primary records. [2025-09-14T20:49:45.850702] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-14T20:49:45.869205] [DEBUG] [LOCAL ] AORT: Derivative data saved (1352 records). [2025-09-14T20:49:45.870524] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-14T20:49:45.874257] [INFO ] [MAIN ] Derivative Progress: 112/2226 symbols completed. AORT took 1.1s. Estimated remaining: 12m 46s. Rate: 165.5 symbols/min [2025-09-14T20:49:45.874846] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:45.889628] [DEBUG] [MAIN ] AOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:45.890900] [INFO ] [MAIN ] AOS: Generated 1352 derivative records from 37044 primary records. [2025-09-14T20:49:45.891456] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-14T20:49:45.913331] [DEBUG] [LOCAL ] AOS: Derivative data saved (1352 records). [2025-09-14T20:49:45.926143] [DEBUG] [MAIN ] AP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:45.927077] [INFO ] [MAIN ] AP: Generated 1352 derivative records from 5808 primary records. [2025-09-14T20:49:45.927147] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-14T20:49:45.927266] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-14T20:49:45.929580] [INFO ] [MAIN ] Derivative Progress: 113/2226 symbols completed. AOS took 1.1s. Estimated remaining: 12m 40s. Rate: 166.7 symbols/min [2025-09-14T20:49:45.929923] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:45.944734] [DEBUG] [LOCAL ] AP: Derivative data saved (1352 records). [2025-09-14T20:49:45.953812] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-14T20:49:45.956278] [INFO ] [MAIN ] Derivative Progress: 114/2226 symbols completed. AP took 0.9s. Estimated remaining: 12m 34s. Rate: 168.1 symbols/min [2025-09-14T20:49:45.957059] [DEBUG] [LOCAL ] APAM: Loaded 27241 existing records from primary storage. [2025-09-14T20:49:45.957543] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:45.957756] [INFO ] [MAIN ] APAM: Loaded 27241 primary data records. [2025-09-14T20:49:46.279378] [DEBUG] [LOCAL ] APD: Loaded 33825 existing records from primary storage. [2025-09-14T20:49:46.290828] [INFO ] [MAIN ] APD: Loaded 33825 primary data records. [2025-09-14T20:49:46.297679] [DEBUG] [LOCAL ] APG: Loaded 38148 existing records from primary storage. [2025-09-14T20:49:46.337999] [INFO ] [MAIN ] APG: Loaded 38148 primary data records. [2025-09-14T20:49:46.888090] [DEBUG] [MAIN ] APAM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:46.890891] [INFO ] [MAIN ] APAM: Generated 1352 derivative records from 27241 primary records. [2025-09-14T20:49:46.891586] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-14T20:49:46.911478] [DEBUG] [LOCAL ] APAM: Derivative data saved (1352 records). [2025-09-14T20:49:46.912421] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-14T20:49:46.915259] [INFO ] [MAIN ] Derivative Progress: 115/2226 symbols completed. APAM took 1.0s. Estimated remaining: 12m 45s. Rate: 165.7 symbols/min [2025-09-14T20:49:46.915973] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:46.942311] [DEBUG] [MAIN ] APD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:46.943258] [DEBUG] [MAIN ] APG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:46.944471] [INFO ] [MAIN ] APD: Generated 1352 derivative records from 33825 primary records. [2025-09-14T20:49:46.945722] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-14T20:49:46.945515] [INFO ] [MAIN ] APG: Generated 1352 derivative records from 38148 primary records. [2025-09-14T20:49:46.947315] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-14T20:49:46.971288] [DEBUG] [LOCAL ] APD: Derivative data saved (1352 records). [2025-09-14T20:49:46.972881] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-14T20:49:46.976308] [INFO ] [MAIN ] Derivative Progress: 116/2226 symbols completed. APD took 1.0s. Estimated remaining: 12m 39s. Rate: 166.9 symbols/min [2025-09-14T20:49:46.979555] [DEBUG] [LOCAL ] APG: Derivative data saved (1352 records). [2025-09-14T20:49:46.979725] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:46.980037] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-14T20:49:46.982846] [INFO ] [MAIN ] Derivative Progress: 117/2226 symbols completed. APG took 1.0s. Estimated remaining: 12m 32s. Rate: 168.3 symbols/min [2025-09-14T20:49:46.983161] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:47.013113] [DEBUG] [LOCAL ] APH: Loaded 40431 existing records from primary storage. [2025-09-14T20:49:47.013864] [INFO ] [MAIN ] APH: Loaded 40431 primary data records. [2025-09-14T20:49:47.334216] [DEBUG] [LOCAL ] APO: Loaded 40146 existing records from primary storage. [2025-09-14T20:49:47.335467] [DEBUG] [LOCAL ] APLE: Loaded 39120 existing records from primary storage. [2025-09-14T20:49:47.336110] [INFO ] [MAIN ] APLE: Loaded 39120 primary data records. [2025-09-14T20:49:47.335969] [INFO ] [MAIN ] APO: Loaded 40146 primary data records. [2025-09-14T20:49:47.913670] [DEBUG] [MAIN ] APH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:47.914627] [INFO ] [MAIN ] APH: Generated 1352 derivative records from 40431 primary records. [2025-09-14T20:49:47.914812] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-14T20:49:47.930511] [DEBUG] [LOCAL ] APH: Derivative data saved (1352 records). [2025-09-14T20:49:47.931164] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-14T20:49:47.935420] [INFO ] [MAIN ] Derivative Progress: 118/2226 symbols completed. APH took 1.0s. Estimated remaining: 12m 42s. Rate: 165.9 symbols/min [2025-09-14T20:49:47.961068] [DEBUG] [MAIN ] APO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:47.960869] [DEBUG] [MAIN ] APLE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:47.962357] [INFO ] [MAIN ] APO: Generated 1352 derivative records from 40146 primary records. [2025-09-14T20:49:47.961855] [INFO ] [MAIN ] APLE: Generated 1352 derivative records from 39120 primary records. [2025-09-14T20:49:47.962482] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-14T20:49:47.962527] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-14T20:49:47.985962] [DEBUG] [LOCAL ] APO: Derivative data saved (1352 records). [2025-09-14T20:49:47.987628] [DEBUG] [LOCAL ] APLE: Derivative data saved (1352 records). [2025-09-14T20:49:47.987799] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-14T20:49:47.987858] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-14T20:49:47.989739] [INFO ] [MAIN ] Derivative Progress: 119/2226 symbols completed. APO took 1.0s. Estimated remaining: 12m 36s. Rate: 167.1 symbols/min [2025-09-14T20:49:47.991946] [INFO ] [MAIN ] Derivative Progress: 120/2226 symbols completed. APLE took 1.0s. Estimated remaining: 12m 30s. Rate: 168.5 symbols/min [2025-09-14T20:49:47.992506] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:47.992618] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:47.992749] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:48.003832] [DEBUG] [LOCAL ] APOS: Loaded 5346 existing records from primary storage. [2025-09-14T20:49:48.004023] [INFO ] [MAIN ] APOS: Loaded 5346 primary data records. [2025-09-14T20:49:48.321508] [DEBUG] [LOCAL ] AQN: Loaded 38906 existing records from primary storage. [2025-09-14T20:49:48.365354] [DEBUG] [LOCAL ] APTV: Loaded 39109 existing records from primary storage. [2025-09-14T20:49:48.365572] [INFO ] [MAIN ] AQN: Loaded 38906 primary data records. [2025-09-14T20:49:48.365912] [INFO ] [MAIN ] APTV: Loaded 39109 primary data records. [2025-09-14T20:49:48.951482] [DEBUG] [MAIN ] APOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:48.953292] [INFO ] [MAIN ] APOS: Generated 1352 derivative records from 5346 primary records. [2025-09-14T20:49:48.953738] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-14T20:49:48.970802] [DEBUG] [LOCAL ] APOS: Derivative data saved (1352 records). [2025-09-14T20:49:48.971500] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-14T20:49:48.973913] [INFO ] [MAIN ] Derivative Progress: 121/2226 symbols completed. APOS took 1.0s. Estimated remaining: 12m 40s. Rate: 166.1 symbols/min [2025-09-14T20:49:48.974606] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:48.984092] [DEBUG] [LOCAL ] AQNB: Loaded 2963 existing records from primary storage. [2025-09-14T20:49:48.996137] [INFO ] [MAIN ] AQNB: Loaded 2963 primary data records. [2025-09-14T20:49:48.996572] [DEBUG] [MAIN ] AQN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:49.064579] [INFO ] [MAIN ] AQN: Generated 1352 derivative records from 38906 primary records. [2025-09-14T20:49:49.085970] [DEBUG] [MAIN ] APTV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:49.091183] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-14T20:49:49.129991] [INFO ] [MAIN ] APTV: Generated 1352 derivative records from 39109 primary records. [2025-09-14T20:49:49.155145] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-14T20:49:49.306630] [DEBUG] [LOCAL ] AQN: Derivative data saved (1352 records). [2025-09-14T20:49:49.310522] [DEBUG] [LOCAL ] APTV: Derivative data saved (1352 records). [2025-09-14T20:49:49.310722] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-14T20:49:49.313189] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-14T20:49:49.313104] [INFO ] [MAIN ] Derivative Progress: 122/2226 symbols completed. APTV took 1.3s. Estimated remaining: 12m 40s. Rate: 166.2 symbols/min [2025-09-14T20:49:49.313770] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:49.315812] [INFO ] [MAIN ] Derivative Progress: 123/2226 symbols completed. AQN took 1.3s. Estimated remaining: 12m 33s. Rate: 167.5 symbols/min [2025-09-14T20:49:49.316777] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:49.337167] [DEBUG] [MAIN ] AQNB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:49.338073] [INFO ] [MAIN ] AQNB: Generated 1352 derivative records from 2963 primary records. [2025-09-14T20:49:49.338212] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-14T20:49:49.359966] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1352 records). [2025-09-14T20:49:49.360193] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-14T20:49:49.363226] [INFO ] [MAIN ] Derivative Progress: 124/2226 symbols completed. AQNB took 0.4s. Estimated remaining: 12m 28s. Rate: 168.7 symbols/min [2025-09-14T20:49:49.363583] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:49.392601] [DEBUG] [LOCAL ] ARCO: Loaded 33598 existing records from primary storage. [2025-09-14T20:49:49.407555] [DEBUG] [LOCAL ] AR: Loaded 40342 existing records from primary storage. [2025-09-14T20:49:49.407844] [INFO ] [MAIN ] AR: Loaded 40342 primary data records. [2025-09-14T20:49:49.407742] [INFO ] [MAIN ] ARCO: Loaded 33598 primary data records. [2025-09-14T20:49:49.513143] [DEBUG] [LOCAL ] ARDC: Loaded 10479 existing records from primary storage. [2025-09-14T20:49:49.606183] [INFO ] [MAIN ] ARDC: Loaded 10479 primary data records. [2025-09-14T20:49:50.285913] [DEBUG] [MAIN ] AR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:50.286335] [DEBUG] [MAIN ] ARCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:50.287341] [INFO ] [MAIN ] AR: Generated 1352 derivative records from 40342 primary records. [2025-09-14T20:49:50.288070] [INFO ] [MAIN ] ARCO: Generated 1352 derivative records from 33598 primary records. [2025-09-14T20:49:50.288269] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-14T20:49:50.288637] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-14T20:49:50.316997] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1352 records). [2025-09-14T20:49:50.316919] [DEBUG] [LOCAL ] AR: Derivative data saved (1352 records). [2025-09-14T20:49:50.317198] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-14T20:49:50.319254] [INFO ] [MAIN ] Derivative Progress: 125/2226 symbols completed. AR took 1.0s. Estimated remaining: 12m 37s. Rate: 166.5 symbols/min [2025-09-14T20:49:50.317244] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-14T20:49:50.322343] [INFO ] [MAIN ] Derivative Progress: 126/2226 symbols completed. ARCO took 1.0s. Estimated remaining: 12m 31s. Rate: 167.8 symbols/min [2025-09-14T20:49:50.322686] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:50.319721] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:50.334374] [DEBUG] [MAIN ] ARDC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:50.335679] [INFO ] [MAIN ] ARDC: Generated 1352 derivative records from 10479 primary records. [2025-09-14T20:49:50.335986] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-14T20:49:50.354803] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1352 records). [2025-09-14T20:49:50.355000] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-14T20:49:50.359079] [INFO ] [MAIN ] Derivative Progress: 127/2226 symbols completed. ARDC took 1.0s. Estimated remaining: 12m 25s. Rate: 169.0 symbols/min [2025-09-14T20:49:50.359923] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:50.369294] [DEBUG] [LOCAL ] ARDT: Loaded 20242 existing records from primary storage. [2025-09-14T20:49:50.378092] [INFO ] [MAIN ] ARDT: Loaded 20242 primary data records. [2025-09-14T20:49:50.513560] [DEBUG] [LOCAL ] ARE: Loaded 38314 existing records from primary storage. [2025-09-14T20:49:50.523448] [INFO ] [MAIN ] ARE: Loaded 38314 primary data records. [2025-09-14T20:49:50.732007] [DEBUG] [LOCAL ] ARES: Loaded 36960 existing records from primary storage. [2025-09-14T20:49:50.896421] [INFO ] [MAIN ] ARES: Loaded 36960 primary data records. [2025-09-14T20:49:51.358529] [DEBUG] [MAIN ] ARDT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:51.359474] [INFO ] [MAIN ] ARDT: Generated 1352 derivative records from 20242 primary records. [2025-09-14T20:49:51.360071] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-14T20:49:51.377768] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1352 records). [2025-09-14T20:49:51.378157] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-14T20:49:51.389184] [DEBUG] [MAIN ] ARE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:51.391469] [INFO ] [MAIN ] Derivative Progress: 128/2226 symbols completed. ARDT took 1.1s. Estimated remaining: 12m 36s. Rate: 166.5 symbols/min [2025-09-14T20:49:51.393256] [INFO ] [MAIN ] ARE: Generated 1352 derivative records from 38314 primary records. [2025-09-14T20:49:51.394129] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-14T20:49:51.393689] [INFO ] [MAIN ] ARGD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:51.412877] [DEBUG] [LOCAL ] ARGD: Loaded 1963 existing records from primary storage. [2025-09-14T20:49:51.413555] [INFO ] [MAIN ] ARGD: Loaded 1963 primary data records. [2025-09-14T20:49:51.414461] [DEBUG] [LOCAL ] ARE: Derivative data saved (1352 records). [2025-09-14T20:49:51.446718] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-14T20:49:51.457807] [DEBUG] [MAIN ] ARES: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:51.494950] [INFO ] [MAIN ] Derivative Progress: 129/2226 symbols completed. ARE took 1.2s. Estimated remaining: 12m 32s. Rate: 167.4 symbols/min [2025-09-14T20:49:51.500953] [INFO ] [MAIN ] ARES: Generated 1352 derivative records from 36960 primary records. [2025-09-14T20:49:51.536238] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-14T20:49:51.536099] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:51.631290] [DEBUG] [LOCAL ] ARES: Derivative data saved (1352 records). [2025-09-14T20:49:51.718678] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-14T20:49:51.720779] [INFO ] [MAIN ] Derivative Progress: 130/2226 symbols completed. ARES took 1.4s. Estimated remaining: 12m 29s. Rate: 167.9 symbols/min [2025-09-14T20:49:51.721226] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:51.751474] [DEBUG] [LOCAL ] ARI: Loaded 32487 existing records from primary storage. [2025-09-14T20:49:51.751961] [INFO ] [MAIN ] ARI: Loaded 32487 primary data records. [2025-09-14T20:49:51.883601] [DEBUG] [MAIN ] ARGD: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T20:49:51.909570] [INFO ] [MAIN ] ARGD: Generated 1349 derivative records from 1963 primary records. [2025-09-14T20:49:51.971671] [DEBUG] [LOCAL ] ARGD: Saving derivative data. [2025-09-14T20:49:51.972892] [DEBUG] [LOCAL ] ARIS: Loaded 31143 existing records from primary storage. [2025-09-14T20:49:52.061937] [INFO ] [MAIN ] ARIS: Loaded 31143 primary data records. [2025-09-14T20:49:52.170359] [DEBUG] [LOCAL ] ARGD: Derivative data saved (1349 records). [2025-09-14T20:49:52.181978] [INFO ] [MAIN ] ARGD: Successfully saved derivative data. [2025-09-14T20:49:52.184256] [INFO ] [MAIN ] Derivative Progress: 131/2226 symbols completed. ARGD took 0.8s. Estimated remaining: 12m 30s. Rate: 167.5 symbols/min [2025-09-14T20:49:52.211914] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:52.371382] [DEBUG] [MAIN ] ARI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:52.372597] [INFO ] [MAIN ] ARI: Generated 1352 derivative records from 32487 primary records. [2025-09-14T20:49:52.378768] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-14T20:49:52.403457] [DEBUG] [LOCAL ] ARI: Derivative data saved (1352 records). [2025-09-14T20:49:52.403688] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-14T20:49:52.406050] [INFO ] [MAIN ] Derivative Progress: 132/2226 symbols completed. ARI took 0.9s. Estimated remaining: 12m 28s. Rate: 168.0 symbols/min [2025-09-14T20:49:52.406840] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:52.419694] [DEBUG] [LOCAL ] ARLO: Loaded 32823 existing records from primary storage. [2025-09-14T20:49:52.419912] [INFO ] [MAIN ] ARLO: Loaded 32823 primary data records. [2025-09-14T20:49:52.543950] [DEBUG] [MAIN ] ARIS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:52.575993] [INFO ] [MAIN ] ARIS: Generated 1352 derivative records from 31143 primary records. [2025-09-14T20:49:52.616695] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-14T20:49:52.651378] [DEBUG] [LOCAL ] ARMK: Loaded 37720 existing records from primary storage. [2025-09-14T20:49:52.651579] [INFO ] [MAIN ] ARMK: Loaded 37720 primary data records. [2025-09-14T20:49:52.812528] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1352 records). [2025-09-14T20:49:52.851245] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-14T20:49:52.864373] [INFO ] [MAIN ] Derivative Progress: 133/2226 symbols completed. ARIS took 1.1s. Estimated remaining: 12m 29s. Rate: 167.6 symbols/min [2025-09-14T20:49:53.102563] [DEBUG] [MAIN ] ARLO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:53.103854] [INFO ] [MAIN ] ARLO: Generated 1352 derivative records from 32823 primary records. [2025-09-14T20:49:53.104074] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-14T20:49:53.127860] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1352 records). [2025-09-14T20:49:53.137374] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-14T20:49:53.140072] [INFO ] [MAIN ] Derivative Progress: 134/2226 symbols completed. ARLO took 0.9s. Estimated remaining: 12m 27s. Rate: 167.9 symbols/min [2025-09-14T20:49:53.140293] [DEBUG] [MAIN ] ARMK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:53.141244] [INFO ] [MAIN ] ARMK: Generated 1352 derivative records from 37720 primary records. [2025-09-14T20:49:53.141326] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-14T20:49:53.158964] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1352 records). [2025-09-14T20:49:53.159187] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-14T20:49:53.162123] [INFO ] [MAIN ] Derivative Progress: 135/2226 symbols completed. ARMK took 0.8s. Estimated remaining: 12m 22s. Rate: 169.1 symbols/min [2025-09-14T20:49:53.162807] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:53.162875] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:53.163593] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:53.200937] [DEBUG] [LOCAL ] ARW: Loaded 24276 existing records from primary storage. [2025-09-14T20:49:53.201212] [INFO ] [MAIN ] ARW: Loaded 24276 primary data records. [2025-09-14T20:49:53.388377] [DEBUG] [LOCAL ] AROC: Loaded 36498 existing records from primary storage. [2025-09-14T20:49:53.387206] [DEBUG] [LOCAL ] ARR: Loaded 39076 existing records from primary storage. [2025-09-14T20:49:53.414173] [INFO ] [MAIN ] AROC: Loaded 36498 primary data records. [2025-09-14T20:49:53.436929] [INFO ] [MAIN ] ARR: Loaded 39076 primary data records. [2025-09-14T20:49:54.121380] [DEBUG] [MAIN ] ARW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:54.123412] [INFO ] [MAIN ] ARW: Generated 1352 derivative records from 24276 primary records. [2025-09-14T20:49:54.123535] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-14T20:49:54.140343] [DEBUG] [LOCAL ] ARW: Derivative data saved (1352 records). [2025-09-14T20:49:54.141045] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-14T20:49:54.142978] [INFO ] [MAIN ] Derivative Progress: 136/2226 symbols completed. ARW took 1.0s. Estimated remaining: 12m 31s. Rate: 166.9 symbols/min [2025-09-14T20:49:54.143847] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:54.163020] [DEBUG] [MAIN ] AROC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:54.164839] [INFO ] [MAIN ] AROC: Generated 1352 derivative records from 36498 primary records. [2025-09-14T20:49:54.165000] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-14T20:49:54.185944] [DEBUG] [MAIN ] ARR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:54.188623] [INFO ] [MAIN ] ARR: Generated 1352 derivative records from 39076 primary records. [2025-09-14T20:49:54.189459] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-14T20:49:54.192198] [DEBUG] [LOCAL ] AROC: Derivative data saved (1352 records). [2025-09-14T20:49:54.198221] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-14T20:49:54.205571] [INFO ] [MAIN ] Derivative Progress: 137/2226 symbols completed. AROC took 1.0s. Estimated remaining: 12m 26s. Rate: 168.0 symbols/min [2025-09-14T20:49:54.206344] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:54.224024] [DEBUG] [LOCAL ] ARR: Derivative data saved (1352 records). [2025-09-14T20:49:54.224290] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-14T20:49:54.229255] [INFO ] [MAIN ] Derivative Progress: 138/2226 symbols completed. ARR took 1.1s. Estimated remaining: 12m 21s. Rate: 169.1 symbols/min [2025-09-14T20:49:54.229825] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:54.236285] [DEBUG] [LOCAL ] ASA: Loaded 10448 existing records from primary storage. [2025-09-14T20:49:54.237181] [INFO ] [MAIN ] ASA: Loaded 10448 primary data records. [2025-09-14T20:49:54.321023] [DEBUG] [LOCAL ] AS: Loaded 39972 existing records from primary storage. [2025-09-14T20:49:54.338829] [INFO ] [MAIN ] AS: Loaded 39972 primary data records. [2025-09-14T20:49:54.746444] [DEBUG] [LOCAL ] ASAN: Loaded 39578 existing records from primary storage. [2025-09-14T20:49:54.750073] [INFO ] [MAIN ] ASAN: Loaded 39578 primary data records. [2025-09-14T20:49:55.140101] [DEBUG] [MAIN ] ASA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:55.142248] [INFO ] [MAIN ] ASA: Generated 1352 derivative records from 10448 primary records. [2025-09-14T20:49:55.142516] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-14T20:49:55.172682] [DEBUG] [LOCAL ] ASA: Derivative data saved (1352 records). [2025-09-14T20:49:55.170483] [DEBUG] [MAIN ] AS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:55.173037] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-14T20:49:55.175269] [INFO ] [MAIN ] Derivative Progress: 139/2226 symbols completed. ASA took 1.0s. Estimated remaining: 12m 29s. Rate: 167.1 symbols/min [2025-09-14T20:49:55.176498] [INFO ] [MAIN ] AS: Generated 1352 derivative records from 39972 primary records. [2025-09-14T20:49:55.177277] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-14T20:49:55.177429] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:55.204729] [DEBUG] [MAIN ] ASAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:55.206465] [INFO ] [MAIN ] ASAN: Generated 1352 derivative records from 39578 primary records. [2025-09-14T20:49:55.207113] [DEBUG] [LOCAL ] AS: Derivative data saved (1352 records). [2025-09-14T20:49:55.207216] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-14T20:49:55.207490] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-14T20:49:55.211453] [INFO ] [MAIN ] Derivative Progress: 140/2226 symbols completed. AS took 1.1s. Estimated remaining: 12m 24s. Rate: 168.2 symbols/min [2025-09-14T20:49:55.222814] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:55.226837] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1352 records). [2025-09-14T20:49:55.227153] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-14T20:49:55.229371] [INFO ] [MAIN ] Derivative Progress: 141/2226 symbols completed. ASAN took 1.0s. Estimated remaining: 12m 19s. Rate: 169.3 symbols/min [2025-09-14T20:49:55.230539] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:55.243685] [DEBUG] [LOCAL ] ASBA: Loaded 2556 existing records from primary storage. [2025-09-14T20:49:55.244242] [INFO ] [MAIN ] ASBA: Loaded 2556 primary data records. [2025-09-14T20:49:55.364420] [DEBUG] [LOCAL ] ASB: Loaded 36945 existing records from primary storage. [2025-09-14T20:49:55.395058] [INFO ] [MAIN ] ASB: Loaded 36945 primary data records. [2025-09-14T20:49:55.639985] [DEBUG] [LOCAL ] ASC: Loaded 28033 existing records from primary storage. [2025-09-14T20:49:55.716237] [INFO ] [MAIN ] ASC: Loaded 28033 primary data records. [2025-09-14T20:49:56.246974] [DEBUG] [MAIN ] ASBA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:56.250687] [INFO ] [MAIN ] ASBA: Generated 1352 derivative records from 2556 primary records. [2025-09-14T20:49:56.252180] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-14T20:49:56.264099] [DEBUG] [MAIN ] ASB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:56.273549] [INFO ] [MAIN ] ASB: Generated 1352 derivative records from 36945 primary records. [2025-09-14T20:49:56.275356] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-14T20:49:56.278369] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1352 records). [2025-09-14T20:49:56.278712] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-14T20:49:56.287081] [INFO ] [MAIN ] Derivative Progress: 142/2226 symbols completed. ASBA took 1.1s. Estimated remaining: 12m 29s. Rate: 167.0 symbols/min [2025-09-14T20:49:56.294948] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:56.295023] [DEBUG] [LOCAL ] ASB: Derivative data saved (1352 records). [2025-09-14T20:49:56.296557] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-14T20:49:56.299888] [INFO ] [MAIN ] Derivative Progress: 143/2226 symbols completed. ASB took 1.1s. Estimated remaining: 12m 23s. Rate: 168.1 symbols/min [2025-09-14T20:49:56.300469] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:56.320437] [DEBUG] [MAIN ] ASC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:56.321479] [INFO ] [MAIN ] ASC: Generated 1352 derivative records from 28033 primary records. [2025-09-14T20:49:56.321765] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-14T20:49:56.344096] [DEBUG] [LOCAL ] ASG: Loaded 14539 existing records from primary storage. [2025-09-14T20:49:56.351589] [INFO ] [MAIN ] ASG: Loaded 14539 primary data records. [2025-09-14T20:49:56.386739] [DEBUG] [LOCAL ] ASC: Derivative data saved (1352 records). [2025-09-14T20:49:56.437390] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-14T20:49:56.465868] [DEBUG] [LOCAL ] ASGI: Loaded 16822 existing records from primary storage. [2025-09-14T20:49:56.468497] [INFO ] [MAIN ] Derivative Progress: 144/2226 symbols completed. ASC took 1.2s. Estimated remaining: 12m 20s. Rate: 168.7 symbols/min [2025-09-14T20:49:56.484786] [INFO ] [MAIN ] ASGI: Loaded 16822 primary data records. [2025-09-14T20:49:56.510090] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:56.945044] [DEBUG] [LOCAL ] ASGN: Loaded 26592 existing records from primary storage. [2025-09-14T20:49:56.949609] [INFO ] [MAIN ] ASGN: Loaded 26592 primary data records. [2025-09-14T20:49:57.254012] [DEBUG] [MAIN ] ASG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:57.267553] [INFO ] [MAIN ] ASG: Generated 1352 derivative records from 14539 primary records. [2025-09-14T20:49:57.269175] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-14T20:49:57.287838] [DEBUG] [LOCAL ] ASG: Derivative data saved (1352 records). [2025-09-14T20:49:57.288529] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-14T20:49:57.301940] [INFO ] [MAIN ] Derivative Progress: 145/2226 symbols completed. ASG took 1.0s. Estimated remaining: 12m 27s. Rate: 167.2 symbols/min [2025-09-14T20:49:57.302377] [DEBUG] [MAIN ] ASGI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:57.303041] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:57.304362] [INFO ] [MAIN ] ASGI: Generated 1352 derivative records from 16822 primary records. [2025-09-14T20:49:57.306052] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-14T20:49:57.322061] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1352 records). [2025-09-14T20:49:57.322356] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-14T20:49:57.326120] [INFO ] [MAIN ] Derivative Progress: 146/2226 symbols completed. ASGI took 1.0s. Estimated remaining: 12m 22s. Rate: 168.3 symbols/min [2025-09-14T20:49:57.327300] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:57.345173] [DEBUG] [MAIN ] ASGN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:57.360805] [INFO ] [MAIN ] ASGN: Generated 1352 derivative records from 26592 primary records. [2025-09-14T20:49:57.361136] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-14T20:49:57.388720] [DEBUG] [LOCAL ] ASIX: Loaded 17222 existing records from primary storage. [2025-09-14T20:49:57.389378] [INFO ] [MAIN ] ASIX: Loaded 17222 primary data records. [2025-09-14T20:49:57.413571] [DEBUG] [LOCAL ] ASH: Loaded 27620 existing records from primary storage. [2025-09-14T20:49:57.448875] [INFO ] [MAIN ] ASH: Loaded 27620 primary data records. [2025-09-14T20:49:57.470592] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1352 records). [2025-09-14T20:49:57.500223] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-14T20:49:57.546257] [INFO ] [MAIN ] Derivative Progress: 147/2226 symbols completed. ASGN took 1.1s. Estimated remaining: 12m 19s. Rate: 168.7 symbols/min [2025-09-14T20:49:57.616720] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:58.071020] [DEBUG] [LOCAL ] ASPN: Loaded 37369 existing records from primary storage. [2025-09-14T20:49:58.071851] [INFO ] [MAIN ] ASPN: Loaded 37369 primary data records. [2025-09-14T20:49:58.214293] [DEBUG] [MAIN ] ASIX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:58.266254] [INFO ] [MAIN ] ASIX: Generated 1352 derivative records from 17222 primary records. [2025-09-14T20:49:58.356635] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-14T20:49:58.366914] [DEBUG] [MAIN ] ASH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:58.369572] [INFO ] [MAIN ] ASH: Generated 1352 derivative records from 27620 primary records. [2025-09-14T20:49:58.376615] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-14T20:49:58.383448] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1352 records). [2025-09-14T20:49:58.390394] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-14T20:49:58.394581] [INFO ] [MAIN ] Derivative Progress: 148/2226 symbols completed. ASIX took 1.1s. Estimated remaining: 12m 26s. Rate: 167.1 symbols/min [2025-09-14T20:49:58.397619] [DEBUG] [LOCAL ] ASH: Derivative data saved (1352 records). [2025-09-14T20:49:58.397847] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-14T20:49:58.400563] [INFO ] [MAIN ] Derivative Progress: 149/2226 symbols completed. ASH took 1.1s. Estimated remaining: 12m 21s. Rate: 168.2 symbols/min [2025-09-14T20:49:58.416320] [DEBUG] [MAIN ] ASPN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:58.416957] [INFO ] [MAIN ] ASPN: Generated 1352 derivative records from 37369 primary records. [2025-09-14T20:49:58.417033] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-14T20:49:58.428654] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1352 records). [2025-09-14T20:49:58.428732] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-14T20:49:58.430811] [INFO ] [MAIN ] Derivative Progress: 150/2226 symbols completed. ASPN took 0.8s. Estimated remaining: 12m 16s. Rate: 169.3 symbols/min [2025-09-14T20:49:58.431518] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:58.431336] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:58.431626] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:58.443610] [DEBUG] [LOCAL ] ASR: Loaded 7112 existing records from primary storage. [2025-09-14T20:49:58.443942] [INFO ] [MAIN ] ASR: Loaded 7112 primary data records. [2025-09-14T20:49:58.639520] [DEBUG] [LOCAL ] ATEN: Loaded 29040 existing records from primary storage. [2025-09-14T20:49:58.650479] [INFO ] [MAIN ] ATEN: Loaded 29040 primary data records. [2025-09-14T20:49:58.860566] [DEBUG] [LOCAL ] ASX: Loaded 39787 existing records from primary storage. [2025-09-14T20:49:58.861170] [INFO ] [MAIN ] ASX: Loaded 39787 primary data records. [2025-09-14T20:49:59.237123] [DEBUG] [MAIN ] ASR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:59.336826] [INFO ] [MAIN ] ASR: Generated 1352 derivative records from 7112 primary records. [2025-09-14T20:49:59.337727] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-14T20:49:59.355002] [DEBUG] [LOCAL ] ASR: Derivative data saved (1352 records). [2025-09-14T20:49:59.355618] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-14T20:49:59.358521] [INFO ] [MAIN ] Derivative Progress: 151/2226 symbols completed. ASR took 0.9s. Estimated remaining: 12m 23s. Rate: 167.5 symbols/min [2025-09-14T20:49:59.359785] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:59.378608] [DEBUG] [MAIN ] ATEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:59.380041] [INFO ] [MAIN ] ATEN: Generated 1352 derivative records from 29040 primary records. [2025-09-14T20:49:59.382244] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-14T20:49:59.421992] [DEBUG] [MAIN ] ASX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:49:59.423762] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1352 records). [2025-09-14T20:49:59.424031] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-14T20:49:59.424857] [INFO ] [MAIN ] ASX: Generated 1352 derivative records from 39787 primary records. [2025-09-14T20:49:59.426603] [DEBUG] [LOCAL ] ATGE: Loaded 23587 existing records from primary storage. [2025-09-14T20:49:59.429421] [INFO ] [MAIN ] Derivative Progress: 152/2226 symbols completed. ATEN took 1.0s. Estimated remaining: 12m 19s. Rate: 168.4 symbols/min [2025-09-14T20:49:59.429761] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-14T20:49:59.430042] [INFO ] [MAIN ] ATGE: Loaded 23587 primary data records. [2025-09-14T20:49:59.430347] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:59.485108] [DEBUG] [LOCAL ] ASX: Derivative data saved (1352 records). [2025-09-14T20:49:59.505368] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-14T20:49:59.528379] [INFO ] [MAIN ] Derivative Progress: 153/2226 symbols completed. ASX took 1.1s. Estimated remaining: 12m 15s. Rate: 169.2 symbols/min [2025-09-14T20:49:59.569098] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:49:59.750632] [DEBUG] [LOCAL ] ATHS: Loaded 5007 existing records from primary storage. [2025-09-14T20:49:59.753577] [INFO ] [MAIN ] ATHS: Loaded 5007 primary data records. [2025-09-14T20:49:59.752245] [DEBUG] [LOCAL ] ATHM: Loaded 23577 existing records from primary storage. [2025-09-14T20:49:59.784678] [INFO ] [MAIN ] ATHM: Loaded 23577 primary data records. [2025-09-14T20:50:00.404217] [DEBUG] [MAIN ] ATGE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:00.406332] [INFO ] [MAIN ] ATGE: Generated 1352 derivative records from 23587 primary records. [2025-09-14T20:50:00.406735] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-14T20:50:00.420470] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1352 records). [2025-09-14T20:50:00.420819] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-14T20:50:00.423181] [INFO ] [MAIN ] Derivative Progress: 154/2226 symbols completed. ATGE took 1.1s. Estimated remaining: 12m 22s. Rate: 167.5 symbols/min [2025-09-14T20:50:00.423862] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:00.453435] [DEBUG] [MAIN ] ATHM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:00.453881] [DEBUG] [MAIN ] ATHS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:00.455226] [INFO ] [MAIN ] ATHM: Generated 1352 derivative records from 23577 primary records. [2025-09-14T20:50:00.456125] [INFO ] [MAIN ] ATHS: Generated 1352 derivative records from 5007 primary records. [2025-09-14T20:50:00.456582] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-14T20:50:00.456447] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-14T20:50:00.470010] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1352 records). [2025-09-14T20:50:00.478503] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-14T20:50:00.481402] [INFO ] [MAIN ] Derivative Progress: 155/2226 symbols completed. ATHS took 0.9s. Estimated remaining: 12m 18s. Rate: 168.4 symbols/min [2025-09-14T20:50:00.493957] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:00.494934] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1352 records). [2025-09-14T20:50:00.495028] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-14T20:50:00.497753] [INFO ] [MAIN ] Derivative Progress: 156/2226 symbols completed. ATHM took 1.1s. Estimated remaining: 12m 13s. Rate: 169.5 symbols/min [2025-09-14T20:50:00.498191] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:00.521368] [DEBUG] [LOCAL ] ATI: Loaded 39009 existing records from primary storage. [2025-09-14T20:50:00.521705] [INFO ] [MAIN ] ATI: Loaded 39009 primary data records. [2025-09-14T20:50:00.654465] [DEBUG] [LOCAL ] ATKR: Loaded 25920 existing records from primary storage. [2025-09-14T20:50:00.655137] [INFO ] [MAIN ] ATKR: Loaded 25920 primary data records. [2025-09-14T20:50:00.744858] [DEBUG] [LOCAL ] ATMU: Loaded 28868 existing records from primary storage. [2025-09-14T20:50:00.801128] [INFO ] [MAIN ] ATMU: Loaded 28868 primary data records. [2025-09-14T20:50:01.576684] [DEBUG] [MAIN ] ATI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:01.621089] [INFO ] [MAIN ] ATI: Generated 1352 derivative records from 39009 primary records. [2025-09-14T20:50:01.640058] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-14T20:50:01.705160] [DEBUG] [MAIN ] ATKR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:01.706827] [DEBUG] [LOCAL ] ATI: Derivative data saved (1352 records). [2025-09-14T20:50:01.708410] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-14T20:50:01.706976] [INFO ] [MAIN ] ATKR: Generated 1352 derivative records from 25920 primary records. [2025-09-14T20:50:01.711377] [INFO ] [MAIN ] Derivative Progress: 157/2226 symbols completed. ATI took 1.3s. Estimated remaining: 12m 24s. Rate: 166.9 symbols/min [2025-09-14T20:50:01.715128] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-14T20:50:01.716421] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:01.755329] [DEBUG] [MAIN ] ATMU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:01.756384] [INFO ] [MAIN ] ATMU: Generated 1352 derivative records from 28868 primary records. [2025-09-14T20:50:01.756485] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-14T20:50:01.783053] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1352 records). [2025-09-14T20:50:01.789623] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1352 records). [2025-09-14T20:50:01.811820] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-14T20:50:01.814833] [INFO ] [MAIN ] Derivative Progress: 158/2226 symbols completed. ATMU took 1.3s. Estimated remaining: 12m 20s. Rate: 167.6 symbols/min [2025-09-14T20:50:01.815271] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:01.789974] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-14T20:50:01.821476] [INFO ] [MAIN ] Derivative Progress: 159/2226 symbols completed. ATKR took 1.3s. Estimated remaining: 12m 15s. Rate: 168.7 symbols/min [2025-09-14T20:50:01.822022] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:01.844207] [DEBUG] [LOCAL ] ATS: Loaded 13232 existing records from primary storage. [2025-09-14T20:50:01.844672] [INFO ] [MAIN ] ATS: Loaded 13232 primary data records. [2025-09-14T20:50:01.935579] [DEBUG] [LOCAL ] ATO: Loaded 31430 existing records from primary storage. [2025-09-14T20:50:01.935998] [INFO ] [MAIN ] ATO: Loaded 31430 primary data records. [2025-09-14T20:50:02.130541] [DEBUG] [LOCAL ] ATR: Loaded 23237 existing records from primary storage. [2025-09-14T20:50:02.184867] [INFO ] [MAIN ] ATR: Loaded 23237 primary data records. [2025-09-14T20:50:03.081737] [DEBUG] [MAIN ] ATO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:03.082690] [INFO ] [MAIN ] ATO: Generated 1352 derivative records from 31430 primary records. [2025-09-14T20:50:03.082972] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-14T20:50:03.106455] [DEBUG] [MAIN ] ATS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:03.112257] [INFO ] [MAIN ] ATS: Generated 1352 derivative records from 13232 primary records. [2025-09-14T20:50:03.113727] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-14T20:50:03.115447] [DEBUG] [LOCAL ] ATO: Derivative data saved (1352 records). [2025-09-14T20:50:03.117853] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-14T20:50:03.129216] [INFO ] [MAIN ] Derivative Progress: 160/2226 symbols completed. ATO took 1.4s. Estimated remaining: 12m 27s. Rate: 165.9 symbols/min [2025-09-14T20:50:03.141100] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:03.142057] [DEBUG] [MAIN ] ATR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:03.143807] [INFO ] [MAIN ] ATR: Generated 1352 derivative records from 23237 primary records. [2025-09-14T20:50:03.145597] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-14T20:50:03.145921] [DEBUG] [LOCAL ] ATS: Derivative data saved (1352 records). [2025-09-14T20:50:03.147420] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-14T20:50:03.156233] [INFO ] [MAIN ] Derivative Progress: 161/2226 symbols completed. ATS took 1.3s. Estimated remaining: 12m 23s. Rate: 166.9 symbols/min [2025-09-14T20:50:03.160224] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:03.165177] [DEBUG] [LOCAL ] ATR: Derivative data saved (1352 records). [2025-09-14T20:50:03.165534] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-14T20:50:03.168251] [INFO ] [MAIN ] Derivative Progress: 162/2226 symbols completed. ATR took 1.4s. Estimated remaining: 12m 18s. Rate: 167.9 symbols/min [2025-09-14T20:50:03.168622] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:03.208054] [DEBUG] [LOCAL ] ATUS: Loaded 37778 existing records from primary storage. [2025-09-14T20:50:03.217982] [INFO ] [MAIN ] ATUS: Loaded 37778 primary data records. [2025-09-14T20:50:03.370850] [DEBUG] [LOCAL ] AU: Loaded 39866 existing records from primary storage. [2025-09-14T20:50:03.371575] [DEBUG] [LOCAL ] AUB: Loaded 34357 existing records from primary storage. [2025-09-14T20:50:03.372827] [INFO ] [MAIN ] AU: Loaded 39866 primary data records. [2025-09-14T20:50:03.399620] [INFO ] [MAIN ] AUB: Loaded 34357 primary data records. [2025-09-14T20:50:04.156436] [DEBUG] [MAIN ] ATUS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:04.158369] [INFO ] [MAIN ] ATUS: Generated 1352 derivative records from 37778 primary records. [2025-09-14T20:50:04.158590] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-14T20:50:04.175056] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1352 records). [2025-09-14T20:50:04.175674] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-14T20:50:04.188380] [INFO ] [MAIN ] Derivative Progress: 163/2226 symbols completed. ATUS took 1.0s. Estimated remaining: 12m 26s. Rate: 166.0 symbols/min [2025-09-14T20:50:04.189197] [DEBUG] [MAIN ] AU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:04.190169] [INFO ] [MAIN ] AU: Generated 1352 derivative records from 39866 primary records. [2025-09-14T20:50:04.192133] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-14T20:50:04.215410] [DEBUG] [MAIN ] AUB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:04.217150] [INFO ] [MAIN ] AUB: Generated 1352 derivative records from 34357 primary records. [2025-09-14T20:50:04.217693] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-14T20:50:04.219463] [DEBUG] [LOCAL ] AU: Derivative data saved (1352 records). [2025-09-14T20:50:04.219810] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-14T20:50:04.229176] [INFO ] [MAIN ] Derivative Progress: 164/2226 symbols completed. AU took 1.1s. Estimated remaining: 12m 21s. Rate: 166.9 symbols/min [2025-09-14T20:50:04.235784] [DEBUG] [LOCAL ] AUB: Derivative data saved (1352 records). [2025-09-14T20:50:04.236212] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-14T20:50:04.238805] [INFO ] [MAIN ] Derivative Progress: 165/2226 symbols completed. AUB took 1.1s. Estimated remaining: 12m 17s. Rate: 167.9 symbols/min [2025-09-14T20:50:04.239544] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:04.239927] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:04.239780] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:04.249564] [DEBUG] [LOCAL ] AUNA: Loaded 3632 existing records from primary storage. [2025-09-14T20:50:04.250056] [INFO ] [MAIN ] AUNA: Loaded 3632 primary data records. [2025-09-14T20:50:04.303705] [DEBUG] [LOCAL ] AVAL: Loaded 6001 existing records from primary storage. [2025-09-14T20:50:04.343568] [INFO ] [MAIN ] AVAL: Loaded 6001 primary data records. [2025-09-14T20:50:04.683008] [DEBUG] [LOCAL ] AVA: Loaded 29173 existing records from primary storage. [2025-09-14T20:50:04.700139] [INFO ] [MAIN ] AVA: Loaded 29173 primary data records. [2025-09-14T20:50:05.190791] [DEBUG] [MAIN ] AUNA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:05.193753] [INFO ] [MAIN ] AUNA: Generated 1352 derivative records from 3632 primary records. [2025-09-14T20:50:05.194197] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-14T20:50:05.214487] [DEBUG] [MAIN ] AVAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:05.219548] [INFO ] [MAIN ] AVAL: Generated 1352 derivative records from 6001 primary records. [2025-09-14T20:50:05.220157] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-14T20:50:05.225044] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1352 records). [2025-09-14T20:50:05.237560] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-14T20:50:05.240463] [INFO ] [MAIN ] Derivative Progress: 166/2226 symbols completed. AUNA took 1.0s. Estimated remaining: 12m 24s. Rate: 166.1 symbols/min [2025-09-14T20:50:05.243561] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1352 records). [2025-09-14T20:50:05.244448] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:05.245300] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-14T20:50:05.249909] [INFO ] [MAIN ] Derivative Progress: 167/2226 symbols completed. AVAL took 1.0s. Estimated remaining: 12m 20s. Rate: 167.0 symbols/min [2025-09-14T20:50:05.252749] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:05.264509] [DEBUG] [MAIN ] AVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:05.265343] [INFO ] [MAIN ] AVA: Generated 1352 derivative records from 29173 primary records. [2025-09-14T20:50:05.265521] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-14T20:50:05.284201] [DEBUG] [LOCAL ] AVA: Derivative data saved (1352 records). [2025-09-14T20:50:05.284661] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-14T20:50:05.287430] [INFO ] [MAIN ] Derivative Progress: 168/2226 symbols completed. AVA took 1.0s. Estimated remaining: 12m 15s. Rate: 167.9 symbols/min [2025-09-14T20:50:05.288307] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:05.307015] [DEBUG] [LOCAL ] AVD: Loaded 16581 existing records from primary storage. [2025-09-14T20:50:05.307395] [INFO ] [MAIN ] AVD: Loaded 16581 primary data records. [2025-09-14T20:50:05.420807] [DEBUG] [LOCAL ] AVK: Loaded 13507 existing records from primary storage. [2025-09-14T20:50:05.441409] [INFO ] [MAIN ] AVK: Loaded 13507 primary data records. [2025-09-14T20:50:05.442372] [DEBUG] [LOCAL ] AVB: Loaded 31412 existing records from primary storage. [2025-09-14T20:50:05.453435] [INFO ] [MAIN ] AVB: Loaded 31412 primary data records. [2025-09-14T20:50:06.250694] [DEBUG] [MAIN ] AVD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:06.254268] [INFO ] [MAIN ] AVD: Generated 1352 derivative records from 16581 primary records. [2025-09-14T20:50:06.255087] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-14T20:50:06.266409] [DEBUG] [MAIN ] AVB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:06.267677] [INFO ] [MAIN ] AVB: Generated 1352 derivative records from 31412 primary records. [2025-09-14T20:50:06.274575] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-14T20:50:06.289319] [DEBUG] [LOCAL ] AVD: Derivative data saved (1352 records). [2025-09-14T20:50:06.295383] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-14T20:50:06.302064] [INFO ] [MAIN ] Derivative Progress: 169/2226 symbols completed. AVD took 1.0s. Estimated remaining: 12m 23s. Rate: 166.1 symbols/min [2025-09-14T20:50:06.302946] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:06.305664] [DEBUG] [MAIN ] AVK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:06.307753] [DEBUG] [LOCAL ] AVB: Derivative data saved (1352 records). [2025-09-14T20:50:06.308065] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-14T20:50:06.312143] [INFO ] [MAIN ] Derivative Progress: 170/2226 symbols completed. AVB took 1.1s. Estimated remaining: 12m 18s. Rate: 167.1 symbols/min [2025-09-14T20:50:06.309098] [INFO ] [MAIN ] AVK: Generated 1352 derivative records from 13507 primary records. [2025-09-14T20:50:06.312617] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:06.312719] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-14T20:50:06.335256] [DEBUG] [LOCAL ] AVK: Derivative data saved (1352 records). [2025-09-14T20:50:06.335529] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-14T20:50:06.337874] [INFO ] [MAIN ] Derivative Progress: 171/2226 symbols completed. AVK took 1.0s. Estimated remaining: 12m 14s. Rate: 168.0 symbols/min [2025-09-14T20:50:06.338284] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:06.348682] [DEBUG] [LOCAL ] AVNS: Loaded 25223 existing records from primary storage. [2025-09-14T20:50:06.348995] [INFO ] [MAIN ] AVNS: Loaded 25223 primary data records. [2025-09-14T20:50:06.478243] [DEBUG] [LOCAL ] AVNT: Loaded 29154 existing records from primary storage. [2025-09-14T20:50:06.489263] [INFO ] [MAIN ] AVNT: Loaded 29154 primary data records. [2025-09-14T20:50:06.772416] [DEBUG] [LOCAL ] AVTR: Loaded 40334 existing records from primary storage. [2025-09-14T20:50:06.779249] [INFO ] [MAIN ] AVTR: Loaded 40334 primary data records. [2025-09-14T20:50:07.250218] [DEBUG] [MAIN ] AVNS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:07.252306] [INFO ] [MAIN ] AVNS: Generated 1352 derivative records from 25223 primary records. [2025-09-14T20:50:07.253315] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-14T20:50:07.269994] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1352 records). [2025-09-14T20:50:07.270406] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-14T20:50:07.279126] [INFO ] [MAIN ] Derivative Progress: 172/2226 symbols completed. AVNS took 1.0s. Estimated remaining: 12m 21s. Rate: 166.4 symbols/min [2025-09-14T20:50:07.284731] [DEBUG] [MAIN ] AVNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:07.284261] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:07.285943] [INFO ] [MAIN ] AVNT: Generated 1352 derivative records from 29154 primary records. [2025-09-14T20:50:07.286337] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-14T20:50:07.310310] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1352 records). [2025-09-14T20:50:07.315207] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-14T20:50:07.318114] [INFO ] [MAIN ] Derivative Progress: 173/2226 symbols completed. AVNT took 1.0s. Estimated remaining: 12m 16s. Rate: 167.3 symbols/min [2025-09-14T20:50:07.314958] [DEBUG] [MAIN ] AVTR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:07.320047] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:07.320542] [INFO ] [MAIN ] AVTR: Generated 1352 derivative records from 40334 primary records. [2025-09-14T20:50:07.321021] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-14T20:50:07.345814] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1352 records). [2025-09-14T20:50:07.346070] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-14T20:50:07.348485] [INFO ] [MAIN ] Derivative Progress: 174/2226 symbols completed. AVTR took 1.0s. Estimated remaining: 12m 12s. Rate: 168.2 symbols/min [2025-09-14T20:50:07.349039] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:07.372755] [DEBUG] [LOCAL ] AVY: Loaded 27556 existing records from primary storage. [2025-09-14T20:50:07.373347] [DEBUG] [LOCAL ] AWF: Loaded 17314 existing records from primary storage. [2025-09-14T20:50:07.373845] [INFO ] [MAIN ] AWF: Loaded 17314 primary data records. [2025-09-14T20:50:07.373723] [INFO ] [MAIN ] AVY: Loaded 27556 primary data records. [2025-09-14T20:50:07.659138] [DEBUG] [LOCAL ] AWI: Loaded 19432 existing records from primary storage. [2025-09-14T20:50:07.701053] [INFO ] [MAIN ] AWI: Loaded 19432 primary data records. [2025-09-14T20:50:08.314035] [DEBUG] [MAIN ] AWF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:08.317176] [INFO ] [MAIN ] AWF: Generated 1352 derivative records from 17314 primary records. [2025-09-14T20:50:08.317600] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-14T20:50:08.338280] [DEBUG] [MAIN ] AVY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:08.340077] [INFO ] [MAIN ] AVY: Generated 1352 derivative records from 27556 primary records. [2025-09-14T20:50:08.341318] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-14T20:50:08.343907] [DEBUG] [LOCAL ] AWF: Derivative data saved (1352 records). [2025-09-14T20:50:08.344309] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-14T20:50:08.365343] [DEBUG] [LOCAL ] AVY: Derivative data saved (1352 records). [2025-09-14T20:50:08.362959] [DEBUG] [MAIN ] AWI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:08.368043] [INFO ] [MAIN ] Derivative Progress: 175/2226 symbols completed. AWF took 1.0s. Estimated remaining: 12m 20s. Rate: 166.4 symbols/min [2025-09-14T20:50:08.368947] [INFO ] [MAIN ] AWI: Generated 1352 derivative records from 19432 primary records. [2025-09-14T20:50:08.369130] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:08.369196] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-14T20:50:08.369349] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-14T20:50:08.372677] [INFO ] [MAIN ] Derivative Progress: 176/2226 symbols completed. AVY took 1.1s. Estimated remaining: 12m 15s. Rate: 167.3 symbols/min [2025-09-14T20:50:08.372888] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:08.388467] [DEBUG] [LOCAL ] AWI: Derivative data saved (1352 records). [2025-09-14T20:50:08.388808] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-14T20:50:08.391357] [INFO ] [MAIN ] Derivative Progress: 177/2226 symbols completed. AWI took 1.0s. Estimated remaining: 12m 11s. Rate: 168.2 symbols/min [2025-09-14T20:50:08.391769] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:08.428035] [DEBUG] [LOCAL ] AWR: Loaded 16385 existing records from primary storage. [2025-09-14T20:50:08.428339] [INFO ] [MAIN ] AWR: Loaded 16385 primary data records. [2025-09-14T20:50:08.428122] [DEBUG] [LOCAL ] AWP: Loaded 16752 existing records from primary storage. [2025-09-14T20:50:08.428421] [INFO ] [MAIN ] AWP: Loaded 16752 primary data records. [2025-09-14T20:50:08.596532] [DEBUG] [LOCAL ] AWK: Loaded 36312 existing records from primary storage. [2025-09-14T20:50:08.639378] [INFO ] [MAIN ] AWK: Loaded 36312 primary data records. [2025-09-14T20:50:09.321310] [DEBUG] [MAIN ] AWR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:09.322362] [INFO ] [MAIN ] AWR: Generated 1352 derivative records from 16385 primary records. [2025-09-14T20:50:09.323993] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-14T20:50:09.342131] [DEBUG] [MAIN ] AWP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:09.347251] [INFO ] [MAIN ] AWP: Generated 1352 derivative records from 16752 primary records. [2025-09-14T20:50:09.348780] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-14T20:50:09.348849] [DEBUG] [LOCAL ] AWR: Derivative data saved (1352 records). [2025-09-14T20:50:09.350915] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-14T20:50:09.359503] [INFO ] [MAIN ] Derivative Progress: 178/2226 symbols completed. AWR took 1.0s. Estimated remaining: 12m 17s. Rate: 166.6 symbols/min [2025-09-14T20:50:09.374948] [DEBUG] [MAIN ] AWK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:09.376379] [INFO ] [MAIN ] AWK: Generated 1352 derivative records from 36312 primary records. [2025-09-14T20:50:09.376864] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-14T20:50:09.377615] [DEBUG] [LOCAL ] AWP: Derivative data saved (1352 records). [2025-09-14T20:50:09.378367] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-14T20:50:09.381332] [INFO ] [MAIN ] Derivative Progress: 179/2226 symbols completed. AWP took 1.0s. Estimated remaining: 12m 13s. Rate: 167.5 symbols/min [2025-09-14T20:50:09.393570] [DEBUG] [LOCAL ] AWK: Derivative data saved (1352 records). [2025-09-14T20:50:09.393674] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-14T20:50:09.395973] [INFO ] [MAIN ] Derivative Progress: 180/2226 symbols completed. AWK took 1.0s. Estimated remaining: 12m 9s. Rate: 168.4 symbols/min [2025-09-14T20:50:09.396499] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:09.396675] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:09.397273] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:09.426836] [DEBUG] [LOCAL ] AX: Loaded 20596 existing records from primary storage. [2025-09-14T20:50:09.427065] [INFO ] [MAIN ] AX: Loaded 20596 primary data records. [2025-09-14T20:50:09.651358] [DEBUG] [LOCAL ] AXP: Loaded 40062 existing records from primary storage. [2025-09-14T20:50:09.651440] [DEBUG] [LOCAL ] AXL: Loaded 37892 existing records from primary storage. [2025-09-14T20:50:09.734545] [INFO ] [MAIN ] AXP: Loaded 40062 primary data records. [2025-09-14T20:50:09.734761] [INFO ] [MAIN ] AXL: Loaded 37892 primary data records. [2025-09-14T20:50:10.365609] [DEBUG] [MAIN ] AX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:10.373765] [INFO ] [MAIN ] AX: Generated 1352 derivative records from 20596 primary records. [2025-09-14T20:50:10.374595] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-14T20:50:10.390882] [DEBUG] [LOCAL ] AX: Derivative data saved (1352 records). [2025-09-14T20:50:10.391418] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-14T20:50:10.394652] [INFO ] [MAIN ] Derivative Progress: 181/2226 symbols completed. AX took 1.0s. Estimated remaining: 12m 16s. Rate: 166.7 symbols/min [2025-09-14T20:50:10.395621] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:10.411017] [DEBUG] [LOCAL ] AXR: Loaded 2176 existing records from primary storage. [2025-09-14T20:50:10.424360] [INFO ] [MAIN ] AXR: Loaded 2176 primary data records. [2025-09-14T20:50:10.424876] [DEBUG] [MAIN ] AXL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:10.436429] [DEBUG] [MAIN ] AXP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:10.437208] [INFO ] [MAIN ] AXL: Generated 1352 derivative records from 37892 primary records. [2025-09-14T20:50:10.437400] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-14T20:50:10.437979] [INFO ] [MAIN ] AXP: Generated 1352 derivative records from 40062 primary records. [2025-09-14T20:50:10.501759] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-14T20:50:10.574534] [DEBUG] [LOCAL ] AXL: Derivative data saved (1352 records). [2025-09-14T20:50:10.611923] [DEBUG] [LOCAL ] AXP: Derivative data saved (1352 records). [2025-09-14T20:50:10.604380] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-14T20:50:10.631971] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-14T20:50:10.732157] [INFO ] [MAIN ] Derivative Progress: 182/2226 symbols completed. AXL took 1.3s. Estimated remaining: 12m 15s. Rate: 166.8 symbols/min [2025-09-14T20:50:10.736962] [INFO ] [MAIN ] Derivative Progress: 183/2226 symbols completed. AXP took 1.3s. Estimated remaining: 12m 11s. Rate: 167.7 symbols/min [2025-09-14T20:50:10.737073] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:10.738916] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:10.762137] [DEBUG] [MAIN ] AXR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:10.763324] [INFO ] [MAIN ] AXR: Generated 1352 derivative records from 2176 primary records. [2025-09-14T20:50:10.763537] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-14T20:50:10.776623] [DEBUG] [LOCAL ] AXR: Derivative data saved (1352 records). [2025-09-14T20:50:10.777040] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-14T20:50:10.788188] [INFO ] [MAIN ] Derivative Progress: 184/2226 symbols completed. AXR took 0.4s. Estimated remaining: 12m 7s. Rate: 168.5 symbols/min [2025-09-14T20:50:10.788844] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:10.812262] [DEBUG] [LOCAL ] AXS: Loaded 28568 existing records from primary storage. [2025-09-14T20:50:10.813005] [INFO ] [MAIN ] AXS: Loaded 28568 primary data records. [2025-09-14T20:50:10.894444] [DEBUG] [LOCAL ] AXTA: Loaded 39189 existing records from primary storage. [2025-09-14T20:50:10.917161] [INFO ] [MAIN ] AXTA: Loaded 39189 primary data records. [2025-09-14T20:50:10.941274] [DEBUG] [LOCAL ] AYI: Loaded 17957 existing records from primary storage. [2025-09-14T20:50:10.999508] [INFO ] [MAIN ] AYI: Loaded 17957 primary data records. [2025-09-14T20:50:11.699988] [DEBUG] [MAIN ] AXS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:11.704314] [INFO ] [MAIN ] AXS: Generated 1352 derivative records from 28568 primary records. [2025-09-14T20:50:11.705375] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-14T20:50:11.723716] [DEBUG] [MAIN ] AXTA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:11.730849] [INFO ] [MAIN ] AXTA: Generated 1352 derivative records from 39189 primary records. [2025-09-14T20:50:11.731776] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-14T20:50:11.730107] [DEBUG] [LOCAL ] AXS: Derivative data saved (1352 records). [2025-09-14T20:50:11.732607] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-14T20:50:11.734682] [INFO ] [MAIN ] Derivative Progress: 185/2226 symbols completed. AXS took 1.0s. Estimated remaining: 12m 13s. Rate: 167.0 symbols/min [2025-09-14T20:50:11.741552] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:11.749465] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1352 records). [2025-09-14T20:50:11.759736] [DEBUG] [MAIN ] AYI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:11.759854] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-14T20:50:11.766189] [INFO ] [MAIN ] Derivative Progress: 186/2226 symbols completed. AXTA took 1.0s. Estimated remaining: 12m 9s. Rate: 167.8 symbols/min [2025-09-14T20:50:11.760588] [INFO ] [MAIN ] AYI: Generated 1352 derivative records from 17957 primary records. [2025-09-14T20:50:11.766531] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:11.766664] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-14T20:50:11.785836] [DEBUG] [LOCAL ] AYI: Derivative data saved (1352 records). [2025-09-14T20:50:11.786068] [DEBUG] [LOCAL ] AZO: Loaded 7902 existing records from primary storage. [2025-09-14T20:50:11.786251] [INFO ] [MAIN ] AZO: Loaded 7902 primary data records. [2025-09-14T20:50:11.786299] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-14T20:50:11.801434] [INFO ] [MAIN ] Derivative Progress: 187/2226 symbols completed. AYI took 1.0s. Estimated remaining: 12m 5s. Rate: 168.6 symbols/min [2025-09-14T20:50:11.893773] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:11.903528] [DEBUG] [LOCAL ] AZZ: Loaded 16871 existing records from primary storage. [2025-09-14T20:50:11.909470] [INFO ] [MAIN ] AZZ: Loaded 16871 primary data records. [2025-09-14T20:50:12.379247] [DEBUG] [LOCAL ] BABA: Loaded 40560 existing records from primary storage. [2025-09-14T20:50:12.379524] [INFO ] [MAIN ] BABA: Loaded 40560 primary data records. [2025-09-14T20:50:12.725459] [DEBUG] [MAIN ] AZO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:12.726357] [INFO ] [MAIN ] AZO: Generated 1352 derivative records from 7902 primary records. [2025-09-14T20:50:12.726557] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-14T20:50:12.742847] [DEBUG] [LOCAL ] AZO: Derivative data saved (1352 records). [2025-09-14T20:50:12.753786] [DEBUG] [MAIN ] AZZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:12.753291] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-14T20:50:12.754549] [INFO ] [MAIN ] AZZ: Generated 1352 derivative records from 16871 primary records. [2025-09-14T20:50:12.756683] [INFO ] [MAIN ] Derivative Progress: 188/2226 symbols completed. AZO took 1.0s. Estimated remaining: 12m 12s. Rate: 167.1 symbols/min [2025-09-14T20:50:12.757220] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:12.757272] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-14T20:50:12.771269] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1352 records). [2025-09-14T20:50:12.771654] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-14T20:50:12.774601] [INFO ] [MAIN ] Derivative Progress: 189/2226 symbols completed. AZZ took 1.0s. Estimated remaining: 12m 8s. Rate: 168.0 symbols/min [2025-09-14T20:50:12.775135] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:12.788553] [DEBUG] [MAIN ] BABA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:12.790067] [INFO ] [MAIN ] BABA: Generated 1352 derivative records from 40560 primary records. [2025-09-14T20:50:12.790292] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-14T20:50:12.804463] [DEBUG] [LOCAL ] BABA: Derivative data saved (1352 records). [2025-09-14T20:50:12.804667] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-14T20:50:12.806780] [INFO ] [MAIN ] Derivative Progress: 190/2226 symbols completed. BABA took 0.9s. Estimated remaining: 12m 4s. Rate: 168.8 symbols/min [2025-09-14T20:50:12.817310] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:12.843533] [DEBUG] [LOCAL ] BAC: Loaded 40548 existing records from primary storage. [2025-09-14T20:50:12.843953] [INFO ] [MAIN ] BAC: Loaded 40548 primary data records. [2025-09-14T20:50:12.965906] [DEBUG] [LOCAL ] BAH: Loaded 38796 existing records from primary storage. [2025-09-14T20:50:12.971719] [INFO ] [MAIN ] BAH: Loaded 38796 primary data records. [2025-09-14T20:50:13.224124] [DEBUG] [LOCAL ] BAK: Loaded 29310 existing records from primary storage. [2025-09-14T20:50:13.240076] [INFO ] [MAIN ] BAK: Loaded 29310 primary data records. [2025-09-14T20:50:13.772310] [DEBUG] [MAIN ] BAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:13.773412] [INFO ] [MAIN ] BAC: Generated 1352 derivative records from 40548 primary records. [2025-09-14T20:50:13.773687] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-14T20:50:13.790589] [DEBUG] [LOCAL ] BAC: Derivative data saved (1352 records). [2025-09-14T20:50:13.794081] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-14T20:50:13.796936] [INFO ] [MAIN ] Derivative Progress: 191/2226 symbols completed. BAC took 1.0s. Estimated remaining: 12m 10s. Rate: 167.2 symbols/min [2025-09-14T20:50:13.797941] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:13.811339] [DEBUG] [MAIN ] BAH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:13.813125] [INFO ] [MAIN ] BAH: Generated 1352 derivative records from 38796 primary records. [2025-09-14T20:50:13.813399] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-14T20:50:13.830102] [DEBUG] [LOCAL ] BAH: Derivative data saved (1352 records). [2025-09-14T20:50:13.831142] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-14T20:50:13.833609] [INFO ] [MAIN ] Derivative Progress: 192/2226 symbols completed. BAH took 1.1s. Estimated remaining: 12m 6s. Rate: 168.0 symbols/min [2025-09-14T20:50:13.833954] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:13.846423] [DEBUG] [MAIN ] BAK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:13.847410] [INFO ] [MAIN ] BAK: Generated 1352 derivative records from 29310 primary records. [2025-09-14T20:50:13.847732] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-14T20:50:13.870826] [DEBUG] [LOCAL ] BAK: Derivative data saved (1352 records). [2025-09-14T20:50:13.880452] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-14T20:50:13.883722] [INFO ] [MAIN ] Derivative Progress: 193/2226 symbols completed. BAK took 1.1s. Estimated remaining: 12m 3s. Rate: 168.8 symbols/min [2025-09-14T20:50:13.909509] [DEBUG] [LOCAL ] BALL: Loaded 38898 existing records from primary storage. [2025-09-14T20:50:13.909852] [INFO ] [MAIN ] BALL: Loaded 38898 primary data records. [2025-09-14T20:50:14.051511] [DEBUG] [LOCAL ] BAM: Loaded 38990 existing records from primary storage. [2025-09-14T20:50:14.107366] [INFO ] [MAIN ] BAM: Loaded 38990 primary data records. [2025-09-14T20:50:14.506997] [DEBUG] [MAIN ] BALL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:14.508173] [INFO ] [MAIN ] BALL: Generated 1352 derivative records from 38898 primary records. [2025-09-14T20:50:14.508766] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-14T20:50:14.524995] [DEBUG] [LOCAL ] BALL: Derivative data saved (1352 records). [2025-09-14T20:50:14.525536] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-14T20:50:14.527821] [INFO ] [MAIN ] Derivative Progress: 194/2226 symbols completed. BALL took 0.7s. Estimated remaining: 12m 5s. Rate: 168.1 symbols/min [2025-09-14T20:50:14.543760] [DEBUG] [MAIN ] BAM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:14.544613] [INFO ] [MAIN ] BAM: Generated 1352 derivative records from 38990 primary records. [2025-09-14T20:50:14.544719] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-14T20:50:14.557759] [DEBUG] [LOCAL ] BAM: Derivative data saved (1352 records). [2025-09-14T20:50:14.557910] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-14T20:50:14.561309] [INFO ] [MAIN ] Derivative Progress: 195/2226 symbols completed. BAM took 0.7s. Estimated remaining: 12m 2s. Rate: 168.8 symbols/min [2025-09-14T20:50:14.562042] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:14.562462] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:14.562864] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:14.597788] [DEBUG] [LOCAL ] BAP: Loaded 19263 existing records from primary storage. [2025-09-14T20:50:14.598004] [INFO ] [MAIN ] BAP: Loaded 19263 primary data records. [2025-09-14T20:50:14.741367] [DEBUG] [LOCAL ] BARK: Loaded 28961 existing records from primary storage. [2025-09-14T20:50:14.759501] [DEBUG] [LOCAL ] BANC: Loaded 38316 existing records from primary storage. [2025-09-14T20:50:14.764877] [INFO ] [MAIN ] BARK: Loaded 28961 primary data records. [2025-09-14T20:50:14.822119] [INFO ] [MAIN ] BANC: Loaded 38316 primary data records. [2025-09-14T20:50:15.564956] [DEBUG] [MAIN ] BAP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:15.566468] [INFO ] [MAIN ] BAP: Generated 1352 derivative records from 19263 primary records. [2025-09-14T20:50:15.566870] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-14T20:50:15.583442] [DEBUG] [LOCAL ] BAP: Derivative data saved (1352 records). [2025-09-14T20:50:15.585468] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-14T20:50:15.588087] [INFO ] [MAIN ] Derivative Progress: 196/2226 symbols completed. BAP took 1.0s. Estimated remaining: 12m 8s. Rate: 167.2 symbols/min [2025-09-14T20:50:15.600377] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:15.600705] [DEBUG] [MAIN ] BARK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:15.601936] [INFO ] [MAIN ] BARK: Generated 1352 derivative records from 28961 primary records. [2025-09-14T20:50:15.602187] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-14T20:50:15.614030] [DEBUG] [MAIN ] BANC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:15.620725] [INFO ] [MAIN ] BANC: Generated 1352 derivative records from 38316 primary records. [2025-09-14T20:50:15.627536] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-14T20:50:15.627912] [DEBUG] [LOCAL ] BARK: Derivative data saved (1352 records). [2025-09-14T20:50:15.629068] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-14T20:50:15.645243] [INFO ] [MAIN ] Derivative Progress: 197/2226 symbols completed. BARK took 1.1s. Estimated remaining: 12m 5s. Rate: 167.9 symbols/min [2025-09-14T20:50:15.645501] [DEBUG] [LOCAL ] BANC: Derivative data saved (1352 records). [2025-09-14T20:50:15.645968] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:15.646213] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-14T20:50:15.648833] [INFO ] [MAIN ] Derivative Progress: 198/2226 symbols completed. BANC took 1.1s. Estimated remaining: 12m 1s. Rate: 168.8 symbols/min [2025-09-14T20:50:15.649543] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:15.686328] [DEBUG] [LOCAL ] BAX: Loaded 40292 existing records from primary storage. [2025-09-14T20:50:15.686816] [INFO ] [MAIN ] BAX: Loaded 40292 primary data records. [2025-09-14T20:50:15.875446] [DEBUG] [LOCAL ] BB: Loaded 39734 existing records from primary storage. [2025-09-14T20:50:15.923787] [INFO ] [MAIN ] BB: Loaded 39734 primary data records. [2025-09-14T20:50:15.930482] [DEBUG] [LOCAL ] BBAI: Loaded 40560 existing records from primary storage. [2025-09-14T20:50:16.034216] [INFO ] [MAIN ] BBAI: Loaded 40560 primary data records. [2025-09-14T20:50:16.573402] [DEBUG] [MAIN ] BAX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:16.575236] [INFO ] [MAIN ] BAX: Generated 1352 derivative records from 40292 primary records. [2025-09-14T20:50:16.576208] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-14T20:50:16.597746] [DEBUG] [LOCAL ] BAX: Derivative data saved (1352 records). [2025-09-14T20:50:16.598347] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-14T20:50:16.601485] [INFO ] [MAIN ] Derivative Progress: 199/2226 symbols completed. BAX took 1.0s. Estimated remaining: 12m 7s. Rate: 167.4 symbols/min [2025-09-14T20:50:16.602145] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:16.620040] [DEBUG] [MAIN ] BB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:16.621269] [INFO ] [MAIN ] BB: Generated 1352 derivative records from 39734 primary records. [2025-09-14T20:50:16.631237] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-14T20:50:16.632067] [DEBUG] [MAIN ] BBAI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:16.633605] [INFO ] [MAIN ] BBAI: Generated 1352 derivative records from 40560 primary records. [2025-09-14T20:50:16.633922] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-14T20:50:16.646184] [DEBUG] [LOCAL ] BB: Derivative data saved (1352 records). [2025-09-14T20:50:16.646437] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-14T20:50:16.649918] [INFO ] [MAIN ] Derivative Progress: 200/2226 symbols completed. BB took 1.0s. Estimated remaining: 12m 3s. Rate: 168.1 symbols/min [2025-09-14T20:50:16.668769] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:16.674074] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1352 records). [2025-09-14T20:50:16.674990] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-14T20:50:16.686892] [INFO ] [MAIN ] Derivative Progress: 201/2226 symbols completed. BBAI took 1.0s. Estimated remaining: 11m 60s. Rate: 168.9 symbols/min [2025-09-14T20:50:16.688062] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:16.687907] [DEBUG] [LOCAL ] BBAR: Loaded 31093 existing records from primary storage. [2025-09-14T20:50:16.688314] [INFO ] [MAIN ] BBAR: Loaded 31093 primary data records. [2025-09-14T20:50:16.931888] [DEBUG] [LOCAL ] BBD: Loaded 40069 existing records from primary storage. [2025-09-14T20:50:17.029065] [DEBUG] [LOCAL ] BBDC: Loaded 23732 existing records from primary storage. [2025-09-14T20:50:17.029191] [INFO ] [MAIN ] BBD: Loaded 40069 primary data records. [2025-09-14T20:50:17.029883] [INFO ] [MAIN ] BBDC: Loaded 23732 primary data records. [2025-09-14T20:50:17.662948] [DEBUG] [MAIN ] BBAR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:17.664077] [INFO ] [MAIN ] BBAR: Generated 1352 derivative records from 31093 primary records. [2025-09-14T20:50:17.664990] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-14T20:50:17.682765] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1352 records). [2025-09-14T20:50:17.683223] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-14T20:50:17.685786] [INFO ] [MAIN ] Derivative Progress: 202/2226 symbols completed. BBAR took 1.1s. Estimated remaining: 12m 6s. Rate: 167.4 symbols/min [2025-09-14T20:50:17.686406] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:17.696758] [DEBUG] [LOCAL ] BBDO: Loaded 3603 existing records from primary storage. [2025-09-14T20:50:17.703017] [INFO ] [MAIN ] BBDO: Loaded 3603 primary data records. [2025-09-14T20:50:17.754153] [DEBUG] [MAIN ] BBD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:17.783390] [INFO ] [MAIN ] BBD: Generated 1352 derivative records from 40069 primary records. [2025-09-14T20:50:17.748320] [DEBUG] [MAIN ] BBDC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:17.788683] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-14T20:50:17.797111] [INFO ] [MAIN ] BBDC: Generated 1352 derivative records from 23732 primary records. [2025-09-14T20:50:17.808088] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-14T20:50:17.872412] [DEBUG] [LOCAL ] BBD: Derivative data saved (1352 records). [2025-09-14T20:50:17.879630] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1352 records). [2025-09-14T20:50:17.931380] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-14T20:50:17.931257] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-14T20:50:17.934137] [INFO ] [MAIN ] Derivative Progress: 203/2226 symbols completed. BBDC took 1.2s. Estimated remaining: 12m 4s. Rate: 167.6 symbols/min [2025-09-14T20:50:17.937997] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:17.940797] [INFO ] [MAIN ] Derivative Progress: 204/2226 symbols completed. BBD took 1.3s. Estimated remaining: 12m 0s. Rate: 168.4 symbols/min [2025-09-14T20:50:18.029421] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:18.042553] [DEBUG] [LOCAL ] BBU: Loaded 3202 existing records from primary storage. [2025-09-14T20:50:18.043939] [INFO ] [MAIN ] BBU: Loaded 3202 primary data records. [2025-09-14T20:50:18.150740] [DEBUG] [LOCAL ] BBN: Loaded 13604 existing records from primary storage. [2025-09-14T20:50:18.166683] [INFO ] [MAIN ] BBN: Loaded 13604 primary data records. [2025-09-14T20:50:18.518040] [DEBUG] [MAIN ] BBDO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:18.536083] [INFO ] [MAIN ] BBDO: Generated 1352 derivative records from 3603 primary records. [2025-09-14T20:50:18.625020] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-14T20:50:18.643018] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1352 records). [2025-09-14T20:50:18.643598] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-14T20:50:18.645835] [INFO ] [MAIN ] Derivative Progress: 205/2226 symbols completed. BBDO took 1.0s. Estimated remaining: 12m 3s. Rate: 167.6 symbols/min [2025-09-14T20:50:18.646960] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:18.666121] [DEBUG] [MAIN ] BBU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:18.670511] [DEBUG] [LOCAL ] BBUC: Loaded 9469 existing records from primary storage. [2025-09-14T20:50:18.671029] [INFO ] [MAIN ] BBU: Generated 1352 derivative records from 3202 primary records. [2025-09-14T20:50:18.671907] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-14T20:50:18.671146] [INFO ] [MAIN ] BBUC: Loaded 9469 primary data records. [2025-09-14T20:50:18.747759] [DEBUG] [MAIN ] BBN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:18.770828] [INFO ] [MAIN ] BBN: Generated 1352 derivative records from 13604 primary records. [2025-09-14T20:50:18.747843] [DEBUG] [LOCAL ] BBU: Derivative data saved (1352 records). [2025-09-14T20:50:18.781706] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-14T20:50:18.786945] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-14T20:50:18.806059] [INFO ] [MAIN ] Derivative Progress: 206/2226 symbols completed. BBU took 0.8s. Estimated remaining: 12m 1s. Rate: 168.1 symbols/min [2025-09-14T20:50:18.824674] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:18.897550] [DEBUG] [LOCAL ] BBN: Derivative data saved (1352 records). [2025-09-14T20:50:18.903391] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-14T20:50:18.906122] [INFO ] [MAIN ] Derivative Progress: 207/2226 symbols completed. BBN took 1.0s. Estimated remaining: 11m 58s. Rate: 168.7 symbols/min [2025-09-14T20:50:18.988696] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:19.032003] [DEBUG] [LOCAL ] BBW: Loaded 19034 existing records from primary storage. [2025-09-14T20:50:19.033268] [INFO ] [MAIN ] BBW: Loaded 19034 primary data records. [2025-09-14T20:50:19.148326] [DEBUG] [MAIN ] BBUC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:19.160478] [INFO ] [MAIN ] BBUC: Generated 1352 derivative records from 9469 primary records. [2025-09-14T20:50:19.167776] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-14T20:50:19.162084] [DEBUG] [LOCAL ] BBVA: Loaded 36749 existing records from primary storage. [2025-09-14T20:50:19.190512] [INFO ] [MAIN ] BBVA: Loaded 36749 primary data records. [2025-09-14T20:50:19.317461] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1352 records). [2025-09-14T20:50:19.345299] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-14T20:50:19.386011] [INFO ] [MAIN ] Derivative Progress: 208/2226 symbols completed. BBUC took 0.7s. Estimated remaining: 11m 59s. Rate: 168.4 symbols/min [2025-09-14T20:50:19.677101] [DEBUG] [MAIN ] BBW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:19.680114] [INFO ] [MAIN ] BBW: Generated 1352 derivative records from 19034 primary records. [2025-09-14T20:50:19.680466] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-14T20:50:19.695132] [DEBUG] [LOCAL ] BBW: Derivative data saved (1352 records). [2025-09-14T20:50:19.697289] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-14T20:50:19.699849] [INFO ] [MAIN ] Derivative Progress: 209/2226 symbols completed. BBW took 0.7s. Estimated remaining: 11m 58s. Rate: 168.5 symbols/min [2025-09-14T20:50:19.710764] [DEBUG] [MAIN ] BBVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:19.711988] [INFO ] [MAIN ] BBVA: Generated 1352 derivative records from 36749 primary records. [2025-09-14T20:50:19.712077] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-14T20:50:19.725373] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1352 records). [2025-09-14T20:50:19.725590] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-14T20:50:19.728731] [INFO ] [MAIN ] Derivative Progress: 210/2226 symbols completed. BBVA took 0.9s. Estimated remaining: 11m 55s. Rate: 169.2 symbols/min [2025-09-14T20:50:19.729409] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:19.729480] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:19.729827] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:19.785465] [DEBUG] [LOCAL ] BC: Loaded 33445 existing records from primary storage. [2025-09-14T20:50:19.798537] [INFO ] [MAIN ] BC: Loaded 33445 primary data records. [2025-09-14T20:50:19.922996] [DEBUG] [LOCAL ] BBWI: Loaded 40331 existing records from primary storage. [2025-09-14T20:50:19.937167] [DEBUG] [LOCAL ] BBY: Loaded 40251 existing records from primary storage. [2025-09-14T20:50:19.937718] [INFO ] [MAIN ] BBWI: Loaded 40331 primary data records. [2025-09-14T20:50:19.959134] [INFO ] [MAIN ] BBY: Loaded 40251 primary data records. [2025-09-14T20:50:20.753542] [DEBUG] [MAIN ] BC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:20.755555] [INFO ] [MAIN ] BC: Generated 1352 derivative records from 33445 primary records. [2025-09-14T20:50:20.755700] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-14T20:50:20.769857] [DEBUG] [LOCAL ] BC: Derivative data saved (1352 records). [2025-09-14T20:50:20.770092] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-14T20:50:20.771779] [INFO ] [MAIN ] Derivative Progress: 211/2226 symbols completed. BC took 1.0s. Estimated remaining: 12m 1s. Rate: 167.7 symbols/min [2025-09-14T20:50:20.772722] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:20.790211] [DEBUG] [MAIN ] BBY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:20.801539] [INFO ] [MAIN ] BBY: Generated 1352 derivative records from 40251 primary records. [2025-09-14T20:50:20.802098] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-14T20:50:20.801896] [DEBUG] [MAIN ] BBWI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:20.804118] [INFO ] [MAIN ] BBWI: Generated 1352 derivative records from 40331 primary records. [2025-09-14T20:50:20.804513] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-14T20:50:20.833075] [DEBUG] [LOCAL ] BBY: Derivative data saved (1352 records). [2025-09-14T20:50:20.833731] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-14T20:50:20.836846] [INFO ] [MAIN ] Derivative Progress: 212/2226 symbols completed. BBY took 1.1s. Estimated remaining: 11m 58s. Rate: 168.3 symbols/min [2025-09-14T20:50:20.839368] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1352 records). [2025-09-14T20:50:20.839691] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:20.840037] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-14T20:50:20.842938] [INFO ] [MAIN ] Derivative Progress: 213/2226 symbols completed. BBWI took 1.1s. Estimated remaining: 11m 54s. Rate: 169.1 symbols/min [2025-09-14T20:50:20.843879] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:20.854106] [DEBUG] [LOCAL ] BCAT: Loaded 25422 existing records from primary storage. [2025-09-14T20:50:20.854301] [INFO ] [MAIN ] BCAT: Loaded 25422 primary data records. [2025-09-14T20:50:20.989799] [DEBUG] [LOCAL ] BCC: Loaded 20555 existing records from primary storage. [2025-09-14T20:50:21.015720] [INFO ] [MAIN ] BCC: Loaded 20555 primary data records. [2025-09-14T20:50:21.287500] [DEBUG] [LOCAL ] BCE: Loaded 39338 existing records from primary storage. [2025-09-14T20:50:21.304572] [INFO ] [MAIN ] BCE: Loaded 39338 primary data records. [2025-09-14T20:50:21.769599] [DEBUG] [MAIN ] BCAT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:21.771171] [INFO ] [MAIN ] BCAT: Generated 1352 derivative records from 25422 primary records. [2025-09-14T20:50:21.771728] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-14T20:50:21.788269] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1352 records). [2025-09-14T20:50:21.789290] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-14T20:50:21.791158] [INFO ] [MAIN ] Derivative Progress: 214/2226 symbols completed. BCAT took 1.0s. Estimated remaining: 11m 59s. Rate: 167.8 symbols/min [2025-09-14T20:50:21.791747] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:21.803199] [DEBUG] [MAIN ] BCC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:21.805088] [INFO ] [MAIN ] BCC: Generated 1352 derivative records from 20555 primary records. [2025-09-14T20:50:21.805307] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-14T20:50:21.823477] [DEBUG] [LOCAL ] BCC: Derivative data saved (1352 records). [2025-09-14T20:50:21.823741] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-14T20:50:21.832721] [INFO ] [MAIN ] Derivative Progress: 215/2226 symbols completed. BCC took 1.0s. Estimated remaining: 11m 56s. Rate: 168.5 symbols/min [2025-09-14T20:50:21.843625] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:21.843540] [DEBUG] [MAIN ] BCE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:21.845136] [INFO ] [MAIN ] BCE: Generated 1352 derivative records from 39338 primary records. [2025-09-14T20:50:21.845382] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-14T20:50:21.867773] [DEBUG] [LOCAL ] BCE: Derivative data saved (1352 records). [2025-09-14T20:50:21.867953] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-14T20:50:21.865145] [DEBUG] [LOCAL ] BCH: Loaded 21766 existing records from primary storage. [2025-09-14T20:50:21.870195] [INFO ] [MAIN ] Derivative Progress: 216/2226 symbols completed. BCE took 1.0s. Estimated remaining: 11m 53s. Rate: 169.2 symbols/min [2025-09-14T20:50:21.870419] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:21.868069] [INFO ] [MAIN ] BCH: Loaded 21766 primary data records. [2025-09-14T20:50:21.992285] [DEBUG] [LOCAL ] BCO: Loaded 19472 existing records from primary storage. [2025-09-14T20:50:22.014151] [INFO ] [MAIN ] BCO: Loaded 19472 primary data records. [2025-09-14T20:50:22.379359] [DEBUG] [LOCAL ] BCS: Loaded 40235 existing records from primary storage. [2025-09-14T20:50:22.453814] [INFO ] [MAIN ] BCS: Loaded 40235 primary data records. [2025-09-14T20:50:22.767144] [DEBUG] [MAIN ] BCH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:22.860001] [INFO ] [MAIN ] BCH: Generated 1352 derivative records from 21766 primary records. [2025-09-14T20:50:22.881594] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-14T20:50:22.904766] [DEBUG] [LOCAL ] BCH: Derivative data saved (1352 records). [2025-09-14T20:50:22.907056] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-14T20:50:22.910925] [INFO ] [MAIN ] Derivative Progress: 217/2226 symbols completed. BCH took 1.1s. Estimated remaining: 11m 59s. Rate: 167.7 symbols/min [2025-09-14T20:50:22.912088] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:22.924885] [DEBUG] [MAIN ] BCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:22.926860] [INFO ] [MAIN ] BCO: Generated 1352 derivative records from 19472 primary records. [2025-09-14T20:50:22.927420] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-14T20:50:22.944603] [DEBUG] [LOCAL ] BCO: Derivative data saved (1352 records). [2025-09-14T20:50:22.950911] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-14T20:50:22.954157] [INFO ] [MAIN ] Derivative Progress: 218/2226 symbols completed. BCO took 1.1s. Estimated remaining: 11m 56s. Rate: 168.4 symbols/min [2025-09-14T20:50:22.954569] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:22.976010] [DEBUG] [MAIN ] BCS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:22.976509] [DEBUG] [LOCAL ] BCSF: Loaded 19447 existing records from primary storage. [2025-09-14T20:50:22.977626] [INFO ] [MAIN ] BCS: Generated 1352 derivative records from 40235 primary records. [2025-09-14T20:50:22.977752] [INFO ] [MAIN ] BCSF: Loaded 19447 primary data records. [2025-09-14T20:50:22.977880] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-14T20:50:23.108783] [DEBUG] [LOCAL ] BCX: Loaded 15656 existing records from primary storage. [2025-09-14T20:50:23.112274] [DEBUG] [LOCAL ] BCS: Derivative data saved (1352 records). [2025-09-14T20:50:23.118082] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-14T20:50:23.117891] [INFO ] [MAIN ] BCX: Loaded 15656 primary data records. [2025-09-14T20:50:23.131017] [INFO ] [MAIN ] Derivative Progress: 219/2226 symbols completed. BCS took 1.3s. Estimated remaining: 11m 54s. Rate: 168.8 symbols/min [2025-09-14T20:50:23.231839] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:23.597671] [DEBUG] [LOCAL ] BDC: Loaded 17994 existing records from primary storage. [2025-09-14T20:50:23.598851] [INFO ] [MAIN ] BDC: Loaded 17994 primary data records. [2025-09-14T20:50:23.695538] [DEBUG] [MAIN ] BCSF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:23.731476] [INFO ] [MAIN ] BCSF: Generated 1352 derivative records from 19447 primary records. [2025-09-14T20:50:23.763782] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-14T20:50:23.809620] [DEBUG] [MAIN ] BCX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:23.865352] [INFO ] [MAIN ] BCX: Generated 1352 derivative records from 15656 primary records. [2025-09-14T20:50:23.869848] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-14T20:50:23.871076] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1352 records). [2025-09-14T20:50:23.964124] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-14T20:50:23.975295] [INFO ] [MAIN ] Derivative Progress: 220/2226 symbols completed. BCSF took 1.1s. Estimated remaining: 11m 58s. Rate: 167.7 symbols/min [2025-09-14T20:50:23.977346] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:23.982874] [DEBUG] [LOCAL ] BCX: Derivative data saved (1352 records). [2025-09-14T20:50:23.983377] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-14T20:50:23.986384] [INFO ] [MAIN ] Derivative Progress: 221/2226 symbols completed. BCX took 1.0s. Estimated remaining: 11m 54s. Rate: 168.4 symbols/min [2025-09-14T20:50:23.986767] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:24.011559] [DEBUG] [MAIN ] BDC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:24.012437] [INFO ] [MAIN ] BDC: Generated 1352 derivative records from 17994 primary records. [2025-09-14T20:50:24.019242] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-14T20:50:24.022428] [DEBUG] [LOCAL ] BDJ: Loaded 21798 existing records from primary storage. [2025-09-14T20:50:24.022787] [INFO ] [MAIN ] BDJ: Loaded 21798 primary data records. [2025-09-14T20:50:24.140666] [DEBUG] [LOCAL ] BDC: Derivative data saved (1352 records). [2025-09-14T20:50:24.158529] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-14T20:50:24.160884] [INFO ] [MAIN ] Derivative Progress: 222/2226 symbols completed. BDC took 1.0s. Estimated remaining: 11m 52s. Rate: 168.8 symbols/min [2025-09-14T20:50:24.167239] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:24.310384] [DEBUG] [LOCAL ] BDN: Loaded 35556 existing records from primary storage. [2025-09-14T20:50:24.355272] [INFO ] [MAIN ] BDN: Loaded 35556 primary data records. [2025-09-14T20:50:24.752252] [DEBUG] [LOCAL ] BDX: Loaded 39715 existing records from primary storage. [2025-09-14T20:50:24.752986] [INFO ] [MAIN ] BDX: Loaded 39715 primary data records. [2025-09-14T20:50:24.827094] [DEBUG] [MAIN ] BDJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:24.871731] [INFO ] [MAIN ] BDJ: Generated 1352 derivative records from 21798 primary records. [2025-09-14T20:50:24.883448] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-14T20:50:25.063457] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1352 records). [2025-09-14T20:50:25.064161] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-14T20:50:25.066176] [INFO ] [MAIN ] Derivative Progress: 223/2226 symbols completed. BDJ took 1.1s. Estimated remaining: 11m 57s. Rate: 167.7 symbols/min [2025-09-14T20:50:25.083196] [DEBUG] [MAIN ] BDN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:25.084129] [INFO ] [MAIN ] BDN: Generated 1352 derivative records from 35556 primary records. [2025-09-14T20:50:25.085244] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-14T20:50:25.102137] [DEBUG] [LOCAL ] BDN: Derivative data saved (1352 records). [2025-09-14T20:50:25.102306] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-14T20:50:25.114744] [INFO ] [MAIN ] Derivative Progress: 224/2226 symbols completed. BDN took 1.1s. Estimated remaining: 11m 54s. Rate: 168.3 symbols/min [2025-09-14T20:50:25.115600] [DEBUG] [MAIN ] BDX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:25.116664] [INFO ] [MAIN ] BDX: Generated 1352 derivative records from 39715 primary records. [2025-09-14T20:50:25.116750] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-14T20:50:25.128947] [DEBUG] [LOCAL ] BDX: Derivative data saved (1352 records). [2025-09-14T20:50:25.129031] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-14T20:50:25.131342] [INFO ] [MAIN ] Derivative Progress: 225/2226 symbols completed. BDX took 1.0s. Estimated remaining: 11m 50s. Rate: 169.0 symbols/min [2025-09-14T20:50:25.131828] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:25.132052] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:25.132141] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:25.195955] [DEBUG] [LOCAL ] BE: Loaded 40401 existing records from primary storage. [2025-09-14T20:50:25.208001] [INFO ] [MAIN ] BE: Loaded 40401 primary data records. [2025-09-14T20:50:25.230836] [DEBUG] [LOCAL ] BEKE: Loaded 40023 existing records from primary storage. [2025-09-14T20:50:25.241370] [INFO ] [MAIN ] BEKE: Loaded 40023 primary data records. [2025-09-14T20:50:25.321341] [DEBUG] [LOCAL ] BEN: Loaded 39969 existing records from primary storage. [2025-09-14T20:50:25.354804] [INFO ] [MAIN ] BEN: Loaded 39969 primary data records. [2025-09-14T20:50:26.104667] [DEBUG] [MAIN ] BE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:26.107015] [INFO ] [MAIN ] BE: Generated 1352 derivative records from 40401 primary records. [2025-09-14T20:50:26.108145] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-14T20:50:26.119582] [DEBUG] [MAIN ] BEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:26.130549] [INFO ] [MAIN ] BEN: Generated 1352 derivative records from 39969 primary records. [2025-09-14T20:50:26.139239] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-14T20:50:26.139023] [DEBUG] [LOCAL ] BE: Derivative data saved (1352 records). [2025-09-14T20:50:26.145230] [DEBUG] [MAIN ] BEKE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:26.145575] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-14T20:50:26.157404] [INFO ] [MAIN ] BEKE: Generated 1352 derivative records from 40023 primary records. [2025-09-14T20:50:26.161035] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-14T20:50:26.160516] [INFO ] [MAIN ] Derivative Progress: 226/2226 symbols completed. BE took 1.0s. Estimated remaining: 11m 56s. Rate: 167.6 symbols/min [2025-09-14T20:50:26.160698] [DEBUG] [LOCAL ] BEN: Derivative data saved (1352 records). [2025-09-14T20:50:26.162811] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-14T20:50:26.163133] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:26.175343] [INFO ] [MAIN ] Derivative Progress: 227/2226 symbols completed. BEN took 1.0s. Estimated remaining: 11m 53s. Rate: 168.3 symbols/min [2025-09-14T20:50:26.176583] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:26.181253] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1352 records). [2025-09-14T20:50:26.181555] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-14T20:50:26.184636] [INFO ] [MAIN ] Derivative Progress: 228/2226 symbols completed. BEKE took 1.1s. Estimated remaining: 11m 49s. Rate: 169.1 symbols/min [2025-09-14T20:50:26.185270] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:26.192904] [DEBUG] [LOCAL ] BEPH: Loaded 3539 existing records from primary storage. [2025-09-14T20:50:26.193167] [INFO ] [MAIN ] BEPH: Loaded 3539 primary data records. [2025-09-14T20:50:26.400308] [DEBUG] [LOCAL ] BEP: Loaded 28134 existing records from primary storage. [2025-09-14T20:50:26.405023] [INFO ] [MAIN ] BEP: Loaded 28134 primary data records. [2025-09-14T20:50:26.570464] [DEBUG] [LOCAL ] BEPC: Loaded 34353 existing records from primary storage. [2025-09-14T20:50:26.611571] [INFO ] [MAIN ] BEPC: Loaded 34353 primary data records. [2025-09-14T20:50:27.154409] [DEBUG] [MAIN ] BEPH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:27.156906] [INFO ] [MAIN ] BEPH: Generated 1352 derivative records from 3539 primary records. [2025-09-14T20:50:27.157144] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-14T20:50:27.172491] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1352 records). [2025-09-14T20:50:27.173594] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-14T20:50:27.176448] [INFO ] [MAIN ] Derivative Progress: 229/2226 symbols completed. BEPH took 1.0s. Estimated remaining: 11m 54s. Rate: 167.7 symbols/min [2025-09-14T20:50:27.177110] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:27.185760] [DEBUG] [LOCAL ] BEPI: Loaded 2735 existing records from primary storage. [2025-09-14T20:50:27.195782] [INFO ] [MAIN ] BEPI: Loaded 2735 primary data records. [2025-09-14T20:50:27.232308] [DEBUG] [MAIN ] BEP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:27.300320] [INFO ] [MAIN ] BEP: Generated 1352 derivative records from 28134 primary records. [2025-09-14T20:50:27.304027] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-14T20:50:27.491101] [DEBUG] [MAIN ] BEPC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:27.503161] [DEBUG] [LOCAL ] BEP: Derivative data saved (1352 records). [2025-09-14T20:50:27.505682] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-14T20:50:27.504769] [INFO ] [MAIN ] BEPC: Generated 1352 derivative records from 34353 primary records. [2025-09-14T20:50:27.508358] [INFO ] [MAIN ] Derivative Progress: 230/2226 symbols completed. BEP took 1.3s. Estimated remaining: 11m 54s. Rate: 167.8 symbols/min [2025-09-14T20:50:27.508520] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-14T20:50:27.509825] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:27.524391] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1352 records). [2025-09-14T20:50:27.524519] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-14T20:50:27.527922] [INFO ] [MAIN ] Derivative Progress: 231/2226 symbols completed. BEPC took 1.4s. Estimated remaining: 11m 50s. Rate: 168.5 symbols/min [2025-09-14T20:50:27.530663] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:27.534377] [DEBUG] [LOCAL ] BEPJ: Loaded 2618 existing records from primary storage. [2025-09-14T20:50:27.534678] [INFO ] [MAIN ] BEPJ: Loaded 2618 primary data records. [2025-09-14T20:50:27.722228] [DEBUG] [MAIN ] BEPI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:27.753728] [INFO ] [MAIN ] BEPI: Generated 1352 derivative records from 2735 primary records. [2025-09-14T20:50:27.840126] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-14T20:50:27.841518] [DEBUG] [LOCAL ] BFAM: Loaded 24802 existing records from primary storage. [2025-09-14T20:50:27.843887] [INFO ] [MAIN ] BFAM: Loaded 24802 primary data records. [2025-09-14T20:50:27.901612] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1352 records). [2025-09-14T20:50:27.937077] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-14T20:50:27.957060] [INFO ] [MAIN ] Derivative Progress: 232/2226 symbols completed. BEPI took 0.8s. Estimated remaining: 11m 51s. Rate: 168.3 symbols/min [2025-09-14T20:50:27.970685] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:28.161743] [DEBUG] [MAIN ] BEPJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:28.173449] [INFO ] [MAIN ] BEPJ: Generated 1352 derivative records from 2618 primary records. [2025-09-14T20:50:28.174141] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-14T20:50:28.197707] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1352 records). [2025-09-14T20:50:28.199994] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-14T20:50:28.201945] [INFO ] [MAIN ] Derivative Progress: 233/2226 symbols completed. BEPJ took 0.7s. Estimated remaining: 11m 49s. Rate: 168.6 symbols/min [2025-09-14T20:50:28.202364] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:28.203907] [DEBUG] [LOCAL ] BFH: Loaded 30776 existing records from primary storage. [2025-09-14T20:50:28.204961] [INFO ] [MAIN ] BFH: Loaded 30776 primary data records. [2025-09-14T20:50:28.322175] [DEBUG] [LOCAL ] BFK: Loaded 10011 existing records from primary storage. [2025-09-14T20:50:28.338686] [INFO ] [MAIN ] BFK: Loaded 10011 primary data records. [2025-09-14T20:50:28.595302] [DEBUG] [MAIN ] BFAM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:28.599455] [INFO ] [MAIN ] BFAM: Generated 1352 derivative records from 24802 primary records. [2025-09-14T20:50:28.627190] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-14T20:50:28.776073] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1352 records). [2025-09-14T20:50:28.778426] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-14T20:50:28.781098] [INFO ] [MAIN ] Derivative Progress: 234/2226 symbols completed. BFAM took 1.3s. Estimated remaining: 11m 51s. Rate: 168.1 symbols/min [2025-09-14T20:50:28.781833] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:28.800437] [DEBUG] [MAIN ] BFK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:28.801284] [INFO ] [MAIN ] BFK: Generated 1352 derivative records from 10011 primary records. [2025-09-14T20:50:28.801466] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-14T20:50:28.835768] [DEBUG] [MAIN ] BFH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:28.837926] [DEBUG] [LOCAL ] BFK: Derivative data saved (1352 records). [2025-09-14T20:50:28.838728] [INFO ] [MAIN ] BFH: Generated 1352 derivative records from 30776 primary records. [2025-09-14T20:50:28.838856] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-14T20:50:28.841556] [INFO ] [MAIN ] Derivative Progress: 235/2226 symbols completed. BFK took 0.6s. Estimated remaining: 11m 48s. Rate: 168.7 symbols/min [2025-09-14T20:50:28.838959] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-14T20:50:28.842749] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:28.869795] [DEBUG] [LOCAL ] BFLY: Loaded 38899 existing records from primary storage. [2025-09-14T20:50:28.869087] [DEBUG] [LOCAL ] BFH: Derivative data saved (1352 records). [2025-09-14T20:50:28.870007] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-14T20:50:28.872187] [INFO ] [MAIN ] Derivative Progress: 236/2226 symbols completed. BFH took 0.9s. Estimated remaining: 11m 45s. Rate: 169.4 symbols/min [2025-09-14T20:50:28.870079] [INFO ] [MAIN ] BFLY: Loaded 38899 primary data records. [2025-09-14T20:50:28.872837] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:28.876378] [DEBUG] [LOCAL ] BFS: Loaded 6805 existing records from primary storage. [2025-09-14T20:50:28.931689] [INFO ] [MAIN ] BFS: Loaded 6805 primary data records. [2025-09-14T20:50:29.121709] [DEBUG] [LOCAL ] BFZ: Loaded 8286 existing records from primary storage. [2025-09-14T20:50:29.152152] [INFO ] [MAIN ] BFZ: Loaded 8286 primary data records. [2025-09-14T20:50:29.782912] [DEBUG] [MAIN ] BFLY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:29.783866] [INFO ] [MAIN ] BFLY: Generated 1352 derivative records from 38899 primary records. [2025-09-14T20:50:29.784378] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-14T20:50:29.813604] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1352 records). [2025-09-14T20:50:29.814476] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-14T20:50:29.817470] [INFO ] [MAIN ] Derivative Progress: 237/2226 symbols completed. BFLY took 1.0s. Estimated remaining: 11m 50s. Rate: 168.2 symbols/min [2025-09-14T20:50:29.814392] [DEBUG] [MAIN ] BFS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:29.817967] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:29.819503] [INFO ] [MAIN ] BFS: Generated 1352 derivative records from 6805 primary records. [2025-09-14T20:50:29.821430] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-14T20:50:29.845403] [DEBUG] [LOCAL ] BFS: Derivative data saved (1352 records). [2025-09-14T20:50:29.845550] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-14T20:50:29.842569] [DEBUG] [MAIN ] BFZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:29.849034] [INFO ] [MAIN ] BFZ: Generated 1352 derivative records from 8286 primary records. [2025-09-14T20:50:29.848937] [INFO ] [MAIN ] Derivative Progress: 238/2226 symbols completed. BFS took 1.0s. Estimated remaining: 11m 47s. Rate: 168.8 symbols/min [2025-09-14T20:50:29.849235] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-14T20:50:29.861324] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1352 records). [2025-09-14T20:50:29.861401] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-14T20:50:29.864876] [INFO ] [MAIN ] Derivative Progress: 239/2226 symbols completed. BFZ took 1.0s. Estimated remaining: 11m 43s. Rate: 169.5 symbols/min [2025-09-14T20:50:29.897508] [DEBUG] [LOCAL ] BG: Loaded 37983 existing records from primary storage. [2025-09-14T20:50:29.897793] [INFO ] [MAIN ] BG: Loaded 37983 primary data records. [2025-09-14T20:50:30.204903] [DEBUG] [MAIN ] BG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:30.205877] [INFO ] [MAIN ] BG: Generated 1352 derivative records from 37983 primary records. [2025-09-14T20:50:30.205963] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-14T20:50:30.218702] [DEBUG] [LOCAL ] BG: Derivative data saved (1352 records). [2025-09-14T20:50:30.218789] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-14T20:50:30.220904] [INFO ] [MAIN ] Derivative Progress: 240/2226 symbols completed. BG took 0.4s. Estimated remaining: 11m 43s. Rate: 169.5 symbols/min [2025-09-14T20:50:30.221586] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:30.221997] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:30.222352] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:30.243045] [DEBUG] [LOCAL ] BGR: Loaded 9858 existing records from primary storage. [2025-09-14T20:50:30.243217] [INFO ] [MAIN ] BGR: Loaded 9858 primary data records. [2025-09-14T20:50:30.317118] [DEBUG] [LOCAL ] BGH: Loaded 12346 existing records from primary storage. [2025-09-14T20:50:30.340377] [INFO ] [MAIN ] BGH: Loaded 12346 primary data records. [2025-09-14T20:50:30.340257] [DEBUG] [LOCAL ] BGB: Loaded 12790 existing records from primary storage. [2025-09-14T20:50:30.376757] [INFO ] [MAIN ] BGB: Loaded 12790 primary data records. [2025-09-14T20:50:31.143837] [DEBUG] [MAIN ] BGR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:31.145181] [INFO ] [MAIN ] BGR: Generated 1352 derivative records from 9858 primary records. [2025-09-14T20:50:31.145678] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-14T20:50:31.166032] [DEBUG] [LOCAL ] BGR: Derivative data saved (1352 records). [2025-09-14T20:50:31.166603] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-14T20:50:31.184901] [INFO ] [MAIN ] Derivative Progress: 241/2226 symbols completed. BGR took 1.0s. Estimated remaining: 11m 48s. Rate: 168.3 symbols/min [2025-09-14T20:50:31.189918] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:31.190718] [DEBUG] [MAIN ] BGH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:31.189429] [DEBUG] [MAIN ] BGB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:31.192329] [INFO ] [MAIN ] BGB: Generated 1352 derivative records from 12790 primary records. [2025-09-14T20:50:31.191772] [INFO ] [MAIN ] BGH: Generated 1352 derivative records from 12346 primary records. [2025-09-14T20:50:31.192668] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-14T20:50:31.192733] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-14T20:50:31.213575] [DEBUG] [LOCAL ] BGB: Derivative data saved (1352 records). [2025-09-14T20:50:31.220281] [DEBUG] [LOCAL ] BGH: Derivative data saved (1352 records). [2025-09-14T20:50:31.220195] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-14T20:50:31.223121] [INFO ] [MAIN ] Derivative Progress: 242/2226 symbols completed. BGB took 1.0s. Estimated remaining: 11m 45s. Rate: 168.9 symbols/min [2025-09-14T20:50:31.223378] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-14T20:50:31.223694] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:31.226534] [INFO ] [MAIN ] Derivative Progress: 243/2226 symbols completed. BGH took 1.0s. Estimated remaining: 11m 41s. Rate: 169.6 symbols/min [2025-09-14T20:50:31.227387] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:31.236677] [DEBUG] [LOCAL ] BGSF: Loaded 4332 existing records from primary storage. [2025-09-14T20:50:31.236967] [INFO ] [MAIN ] BGSF: Loaded 4332 primary data records. [2025-09-14T20:50:31.360166] [DEBUG] [LOCAL ] BGT: Loaded 12374 existing records from primary storage. [2025-09-14T20:50:31.423554] [INFO ] [MAIN ] BGT: Loaded 12374 primary data records. [2025-09-14T20:50:31.451088] [DEBUG] [LOCAL ] BGS: Loaded 37999 existing records from primary storage. [2025-09-14T20:50:31.464840] [INFO ] [MAIN ] BGS: Loaded 37999 primary data records. [2025-09-14T20:50:32.184728] [DEBUG] [MAIN ] BGSF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:32.185723] [INFO ] [MAIN ] BGSF: Generated 1352 derivative records from 4332 primary records. [2025-09-14T20:50:32.187901] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-14T20:50:32.200163] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1352 records). [2025-09-14T20:50:32.200309] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-14T20:50:32.202891] [INFO ] [MAIN ] Derivative Progress: 244/2226 symbols completed. BGSF took 1.0s. Estimated remaining: 11m 46s. Rate: 168.4 symbols/min [2025-09-14T20:50:32.203779] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:32.226791] [DEBUG] [LOCAL ] BGX: Loaded 7740 existing records from primary storage. [2025-09-14T20:50:32.233308] [INFO ] [MAIN ] BGX: Loaded 7740 primary data records. [2025-09-14T20:50:32.238845] [DEBUG] [MAIN ] BGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:32.260011] [INFO ] [MAIN ] BGS: Generated 1352 derivative records from 37999 primary records. [2025-09-14T20:50:32.274277] [DEBUG] [MAIN ] BGT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:32.279589] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-14T20:50:32.299725] [INFO ] [MAIN ] BGT: Generated 1352 derivative records from 12374 primary records. [2025-09-14T20:50:32.350316] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-14T20:50:32.361293] [DEBUG] [LOCAL ] BGS: Derivative data saved (1352 records). [2025-09-14T20:50:32.366760] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-14T20:50:32.399946] [INFO ] [MAIN ] Derivative Progress: 245/2226 symbols completed. BGS took 1.2s. Estimated remaining: 11m 45s. Rate: 168.7 symbols/min [2025-09-14T20:50:32.448308] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:32.551306] [DEBUG] [LOCAL ] BGT: Derivative data saved (1352 records). [2025-09-14T20:50:32.559965] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-14T20:50:32.563565] [INFO ] [MAIN ] Derivative Progress: 246/2226 symbols completed. BGT took 1.3s. Estimated remaining: 11m 43s. Rate: 169.1 symbols/min [2025-09-14T20:50:32.564215] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:32.597336] [DEBUG] [LOCAL ] BGY: Loaded 16485 existing records from primary storage. [2025-09-14T20:50:32.595775] [DEBUG] [LOCAL ] BH: Loaded 13143 existing records from primary storage. [2025-09-14T20:50:32.598106] [INFO ] [MAIN ] BH: Loaded 13143 primary data records. [2025-09-14T20:50:32.597974] [INFO ] [MAIN ] BGY: Loaded 16485 primary data records. [2025-09-14T20:50:32.821337] [DEBUG] [MAIN ] BGX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:32.844034] [INFO ] [MAIN ] BGX: Generated 1352 derivative records from 7740 primary records. [2025-09-14T20:50:32.864711] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-14T20:50:32.998745] [DEBUG] [LOCAL ] BGX: Derivative data saved (1352 records). [2025-09-14T20:50:33.002083] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-14T20:50:33.004290] [INFO ] [MAIN ] Derivative Progress: 247/2226 symbols completed. BGX took 0.8s. Estimated remaining: 11m 43s. Rate: 168.9 symbols/min [2025-09-14T20:50:33.180911] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:33.249580] [DEBUG] [MAIN ] BH: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:50:33.250387] [DEBUG] [MAIN ] BGY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:33.251809] [INFO ] [MAIN ] BH: Generated 1351 derivative records from 13143 primary records. [2025-09-14T20:50:33.253453] [DEBUG] [LOCAL ] BHC: Loaded 34955 existing records from primary storage. [2025-09-14T20:50:33.254310] [INFO ] [MAIN ] BGY: Generated 1352 derivative records from 16485 primary records. [2025-09-14T20:50:33.254362] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-14T20:50:33.254729] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-14T20:50:33.254793] [INFO ] [MAIN ] BHC: Loaded 34955 primary data records. [2025-09-14T20:50:33.317330] [DEBUG] [LOCAL ] BGY: Derivative data saved (1352 records). [2025-09-14T20:50:33.340837] [DEBUG] [LOCAL ] BH: Derivative data saved (1351 records). [2025-09-14T20:50:33.341096] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-14T20:50:33.352453] [INFO ] [MAIN ] Derivative Progress: 248/2226 symbols completed. BGY took 0.9s. Estimated remaining: 11m 43s. Rate: 168.9 symbols/min [2025-09-14T20:50:33.363183] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:33.373851] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-14T20:50:33.395869] [INFO ] [MAIN ] Derivative Progress: 249/2226 symbols completed. BH took 0.8s. Estimated remaining: 11m 40s. Rate: 169.5 symbols/min [2025-09-14T20:50:33.436783] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:33.571946] [DEBUG] [LOCAL ] BHE: Loaded 17884 existing records from primary storage. [2025-09-14T20:50:33.572462] [INFO ] [MAIN ] BHE: Loaded 17884 primary data records. [2025-09-14T20:50:33.699415] [DEBUG] [LOCAL ] BHK: Loaded 18380 existing records from primary storage. [2025-09-14T20:50:33.705532] [INFO ] [MAIN ] BHK: Loaded 18380 primary data records. [2025-09-14T20:50:34.195480] [DEBUG] [MAIN ] BHC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:34.207481] [INFO ] [MAIN ] BHC: Generated 1352 derivative records from 34955 primary records. [2025-09-14T20:50:34.207872] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-14T20:50:34.222816] [DEBUG] [LOCAL ] BHC: Derivative data saved (1352 records). [2025-09-14T20:50:34.224285] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-14T20:50:34.227212] [INFO ] [MAIN ] Derivative Progress: 250/2226 symbols completed. BHC took 1.1s. Estimated remaining: 11m 43s. Rate: 168.6 symbols/min [2025-09-14T20:50:34.228155] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:34.249165] [DEBUG] [MAIN ] BHE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:34.250281] [INFO ] [MAIN ] BHE: Generated 1352 derivative records from 17884 primary records. [2025-09-14T20:50:34.256433] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-14T20:50:34.261202] [DEBUG] [MAIN ] BHK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:34.262585] [INFO ] [MAIN ] BHK: Generated 1352 derivative records from 18380 primary records. [2025-09-14T20:50:34.268273] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-14T20:50:34.276015] [DEBUG] [LOCAL ] BHE: Derivative data saved (1352 records). [2025-09-14T20:50:34.276451] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-14T20:50:34.295392] [INFO ] [MAIN ] Derivative Progress: 251/2226 symbols completed. BHE took 0.9s. Estimated remaining: 11m 41s. Rate: 169.2 symbols/min [2025-09-14T20:50:34.307199] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:34.308033] [DEBUG] [LOCAL ] BHK: Derivative data saved (1352 records). [2025-09-14T20:50:34.308294] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-14T20:50:34.311248] [INFO ] [MAIN ] Derivative Progress: 252/2226 symbols completed. BHK took 0.9s. Estimated remaining: 11m 38s. Rate: 169.8 symbols/min [2025-09-14T20:50:34.311793] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:34.328068] [DEBUG] [LOCAL ] BHP: Loaded 40153 existing records from primary storage. [2025-09-14T20:50:34.328322] [INFO ] [MAIN ] BHP: Loaded 40153 primary data records. [2025-09-14T20:50:34.461267] [DEBUG] [LOCAL ] BHR: Loaded 15557 existing records from primary storage. [2025-09-14T20:50:34.467018] [INFO ] [MAIN ] BHR: Loaded 15557 primary data records. [2025-09-14T20:50:34.760770] [DEBUG] [LOCAL ] BHVN: Loaded 37833 existing records from primary storage. [2025-09-14T20:50:34.771724] [INFO ] [MAIN ] BHVN: Loaded 37833 primary data records. [2025-09-14T20:50:35.238035] [DEBUG] [MAIN ] BHP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:35.240373] [INFO ] [MAIN ] BHP: Generated 1352 derivative records from 40153 primary records. [2025-09-14T20:50:35.240802] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-14T20:50:35.257190] [DEBUG] [LOCAL ] BHP: Derivative data saved (1352 records). [2025-09-14T20:50:35.268157] [DEBUG] [MAIN ] BHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:35.269527] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-14T20:50:35.270393] [INFO ] [MAIN ] BHR: Generated 1352 derivative records from 15557 primary records. [2025-09-14T20:50:35.282401] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-14T20:50:35.278707] [INFO ] [MAIN ] Derivative Progress: 253/2226 symbols completed. BHP took 1.1s. Estimated remaining: 11m 42s. Rate: 168.6 symbols/min [2025-09-14T20:50:35.284166] [DEBUG] [MAIN ] BHVN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:35.293037] [INFO ] [MAIN ] BHVN: Generated 1352 derivative records from 37833 primary records. [2025-09-14T20:50:35.294489] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-14T20:50:35.296533] [DEBUG] [LOCAL ] BHR: Derivative data saved (1352 records). [2025-09-14T20:50:35.296791] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-14T20:50:35.307137] [INFO ] [MAIN ] Derivative Progress: 254/2226 symbols completed. BHR took 1.0s. Estimated remaining: 11m 39s. Rate: 169.3 symbols/min [2025-09-14T20:50:35.313126] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1352 records). [2025-09-14T20:50:35.313364] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-14T20:50:35.315602] [INFO ] [MAIN ] Derivative Progress: 255/2226 symbols completed. BHVN took 1.0s. Estimated remaining: 11m 36s. Rate: 169.9 symbols/min [2025-09-14T20:50:35.316417] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:35.316297] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:35.317350] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:35.351418] [DEBUG] [LOCAL ] BIO: Loaded 18672 existing records from primary storage. [2025-09-14T20:50:35.351701] [INFO ] [MAIN ] BIO: Loaded 18672 primary data records. [2025-09-14T20:50:35.485549] [DEBUG] [LOCAL ] BIP: Loaded 28380 existing records from primary storage. [2025-09-14T20:50:35.497674] [INFO ] [MAIN ] BIP: Loaded 28380 primary data records. [2025-09-14T20:50:35.529736] [DEBUG] [LOCAL ] BILL: Loaded 39323 existing records from primary storage. [2025-09-14T20:50:35.544749] [INFO ] [MAIN ] BILL: Loaded 39323 primary data records. [2025-09-14T20:50:36.275286] [DEBUG] [MAIN ] BIO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:36.277198] [INFO ] [MAIN ] BIO: Generated 1352 derivative records from 18672 primary records. [2025-09-14T20:50:36.277605] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-14T20:50:36.312581] [DEBUG] [MAIN ] BIP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:36.319338] [DEBUG] [MAIN ] BILL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:36.319445] [DEBUG] [LOCAL ] BIO: Derivative data saved (1352 records). [2025-09-14T20:50:36.320560] [INFO ] [MAIN ] BIP: Generated 1352 derivative records from 28380 primary records. [2025-09-14T20:50:36.321387] [INFO ] [MAIN ] BILL: Generated 1352 derivative records from 39323 primary records. [2025-09-14T20:50:36.321804] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-14T20:50:36.321472] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-14T20:50:36.321758] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-14T20:50:36.324059] [INFO ] [MAIN ] Derivative Progress: 256/2226 symbols completed. BIO took 1.0s. Estimated remaining: 11m 41s. Rate: 168.7 symbols/min [2025-09-14T20:50:36.326248] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:36.349298] [DEBUG] [LOCAL ] BILL: Derivative data saved (1352 records). [2025-09-14T20:50:36.352107] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-14T20:50:36.354679] [INFO ] [MAIN ] Derivative Progress: 257/2226 symbols completed. BILL took 1.0s. Estimated remaining: 11m 38s. Rate: 169.3 symbols/min [2025-09-14T20:50:36.355476] [DEBUG] [LOCAL ] BIP: Derivative data saved (1352 records). [2025-09-14T20:50:36.355693] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:36.356057] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-14T20:50:36.359255] [INFO ] [MAIN ] Derivative Progress: 258/2226 symbols completed. BIP took 1.0s. Estimated remaining: 11m 35s. Rate: 169.9 symbols/min [2025-09-14T20:50:36.359579] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:36.368723] [DEBUG] [LOCAL ] BIPH: Loaded 1599 existing records from primary storage. [2025-09-14T20:50:36.371015] [DEBUG] [LOCAL ] BIPI: Loaded 2075 existing records from primary storage. [2025-09-14T20:50:36.379694] [INFO ] [MAIN ] BIPH: Loaded 1599 primary data records. [2025-09-14T20:50:36.385390] [INFO ] [MAIN ] BIPI: Loaded 2075 primary data records. [2025-09-14T20:50:36.602497] [DEBUG] [LOCAL ] BIPC: Loaded 30547 existing records from primary storage. [2025-09-14T20:50:36.613067] [INFO ] [MAIN ] BIPC: Loaded 30547 primary data records. [2025-09-14T20:50:37.314126] [DEBUG] [MAIN ] BIPH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:37.315836] [INFO ] [MAIN ] BIPH: Generated 1352 derivative records from 1599 primary records. [2025-09-14T20:50:37.318823] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-14T20:50:37.343004] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1352 records). [2025-09-14T20:50:37.344095] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-14T20:50:37.344558] [DEBUG] [MAIN ] BIPI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:37.346669] [INFO ] [MAIN ] Derivative Progress: 259/2226 symbols completed. BIPH took 1.0s. Estimated remaining: 11m 39s. Rate: 168.8 symbols/min [2025-09-14T20:50:37.347669] [INFO ] [MAIN ] BIPI: Generated 1352 derivative records from 2075 primary records. [2025-09-14T20:50:37.349374] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-14T20:50:37.349618] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:37.371479] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1352 records). [2025-09-14T20:50:37.377013] [DEBUG] [MAIN ] BIPC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:37.380315] [DEBUG] [LOCAL ] BIPJ: Loaded 2122 existing records from primary storage. [2025-09-14T20:50:37.381793] [INFO ] [MAIN ] BIPJ: Loaded 2122 primary data records. [2025-09-14T20:50:37.381586] [INFO ] [MAIN ] BIPC: Generated 1352 derivative records from 30547 primary records. [2025-09-14T20:50:37.380446] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-14T20:50:37.418672] [INFO ] [MAIN ] Derivative Progress: 260/2226 symbols completed. BIPI took 1.1s. Estimated remaining: 11m 37s. Rate: 169.3 symbols/min [2025-09-14T20:50:37.394388] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-14T20:50:37.445679] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:37.509269] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1352 records). [2025-09-14T20:50:37.509516] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-14T20:50:37.511984] [INFO ] [MAIN ] Derivative Progress: 261/2226 symbols completed. BIPC took 1.2s. Estimated remaining: 11m 35s. Rate: 169.8 symbols/min [2025-09-14T20:50:37.512793] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:37.713574] [DEBUG] [LOCAL ] BIT: Loaded 16547 existing records from primary storage. [2025-09-14T20:50:37.714860] [INFO ] [MAIN ] BIT: Loaded 16547 primary data records. [2025-09-14T20:50:37.775342] [DEBUG] [LOCAL ] BIRK: Loaded 38281 existing records from primary storage. [2025-09-14T20:50:37.799012] [INFO ] [MAIN ] BIRK: Loaded 38281 primary data records. [2025-09-14T20:50:38.293633] [DEBUG] [MAIN ] BIPJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:38.305904] [INFO ] [MAIN ] BIPJ: Generated 1352 derivative records from 2122 primary records. [2025-09-14T20:50:38.306612] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-14T20:50:38.321475] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1352 records). [2025-09-14T20:50:38.322364] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-14T20:50:38.324628] [INFO ] [MAIN ] Derivative Progress: 262/2226 symbols completed. BIPJ took 1.0s. Estimated remaining: 11m 38s. Rate: 168.9 symbols/min [2025-09-14T20:50:38.325874] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:38.360616] [DEBUG] [MAIN ] BIRK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:38.360841] [DEBUG] [MAIN ] BIT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:38.361760] [INFO ] [MAIN ] BIT: Generated 1352 derivative records from 16547 primary records. [2025-09-14T20:50:38.362315] [INFO ] [MAIN ] BIRK: Generated 1352 derivative records from 38281 primary records. [2025-09-14T20:50:38.362400] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-14T20:50:38.362542] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-14T20:50:38.396048] [DEBUG] [LOCAL ] BIT: Derivative data saved (1352 records). [2025-09-14T20:50:38.397448] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-14T20:50:38.399733] [INFO ] [MAIN ] Derivative Progress: 263/2226 symbols completed. BIT took 0.9s. Estimated remaining: 11m 35s. Rate: 169.4 symbols/min [2025-09-14T20:50:38.397290] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1352 records). [2025-09-14T20:50:38.400051] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:38.400173] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-14T20:50:38.403156] [INFO ] [MAIN ] Derivative Progress: 264/2226 symbols completed. BIRK took 1.0s. Estimated remaining: 11m 32s. Rate: 170.1 symbols/min [2025-09-14T20:50:38.404054] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:38.420693] [DEBUG] [LOCAL ] BJ: Loaded 38619 existing records from primary storage. [2025-09-14T20:50:38.421030] [INFO ] [MAIN ] BJ: Loaded 38619 primary data records. [2025-09-14T20:50:38.740386] [DEBUG] [LOCAL ] BK: Loaded 40340 existing records from primary storage. [2025-09-14T20:50:38.742025] [DEBUG] [LOCAL ] BKD: Loaded 37868 existing records from primary storage. [2025-09-14T20:50:38.742496] [INFO ] [MAIN ] BK: Loaded 40340 primary data records. [2025-09-14T20:50:38.742600] [INFO ] [MAIN ] BKD: Loaded 37868 primary data records. [2025-09-14T20:50:39.385614] [DEBUG] [MAIN ] BJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:39.388594] [INFO ] [MAIN ] BJ: Generated 1352 derivative records from 38619 primary records. [2025-09-14T20:50:39.388972] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-14T20:50:39.405039] [DEBUG] [LOCAL ] BJ: Derivative data saved (1352 records). [2025-09-14T20:50:39.407937] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-14T20:50:39.410605] [INFO ] [MAIN ] Derivative Progress: 265/2226 symbols completed. BJ took 1.1s. Estimated remaining: 11m 37s. Rate: 168.9 symbols/min [2025-09-14T20:50:39.411222] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:39.424810] [DEBUG] [MAIN ] BK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:39.435343] [DEBUG] [MAIN ] BKD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:39.436565] [INFO ] [MAIN ] BK: Generated 1352 derivative records from 40340 primary records. [2025-09-14T20:50:39.437584] [INFO ] [MAIN ] BKD: Generated 1352 derivative records from 37868 primary records. [2025-09-14T20:50:39.437933] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-14T20:50:39.438004] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-14T20:50:39.457849] [DEBUG] [LOCAL ] BK: Derivative data saved (1352 records). [2025-09-14T20:50:39.461424] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-14T20:50:39.464727] [INFO ] [MAIN ] Derivative Progress: 266/2226 symbols completed. BK took 1.1s. Estimated remaining: 11m 34s. Rate: 169.4 symbols/min [2025-09-14T20:50:39.473041] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:39.474342] [DEBUG] [LOCAL ] BKD: Derivative data saved (1352 records). [2025-09-14T20:50:39.474970] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-14T20:50:39.477705] [INFO ] [MAIN ] Derivative Progress: 267/2226 symbols completed. BKD took 1.1s. Estimated remaining: 11m 31s. Rate: 170.0 symbols/min [2025-09-14T20:50:39.478083] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:39.489558] [DEBUG] [LOCAL ] BKE: Loaded 25219 existing records from primary storage. [2025-09-14T20:50:39.490017] [INFO ] [MAIN ] BKE: Loaded 25219 primary data records. [2025-09-14T20:50:39.653782] [DEBUG] [LOCAL ] BKKT: Loaded 25840 existing records from primary storage. [2025-09-14T20:50:39.690154] [DEBUG] [LOCAL ] BKH: Loaded 27760 existing records from primary storage. [2025-09-14T20:50:39.683997] [INFO ] [MAIN ] BKKT: Loaded 25840 primary data records. [2025-09-14T20:50:39.713752] [INFO ] [MAIN ] BKH: Loaded 27760 primary data records. [2025-09-14T20:50:40.430352] [DEBUG] [MAIN ] BKE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:40.431915] [INFO ] [MAIN ] BKE: Generated 1352 derivative records from 25219 primary records. [2025-09-14T20:50:40.432510] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-14T20:50:40.456208] [DEBUG] [LOCAL ] BKE: Derivative data saved (1352 records). [2025-09-14T20:50:40.460224] [DEBUG] [MAIN ] BKKT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:40.460486] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-14T20:50:40.471549] [INFO ] [MAIN ] Derivative Progress: 268/2226 symbols completed. BKE took 1.1s. Estimated remaining: 11m 36s. Rate: 168.9 symbols/min [2025-09-14T20:50:40.472795] [DEBUG] [MAIN ] BKH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:40.472517] [INFO ] [MAIN ] BKKT: Generated 1352 derivative records from 25840 primary records. [2025-09-14T20:50:40.473446] [INFO ] [MAIN ] BKH: Generated 1352 derivative records from 27760 primary records. [2025-09-14T20:50:40.473917] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-14T20:50:40.473776] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-14T20:50:40.499268] [DEBUG] [LOCAL ] BKH: Derivative data saved (1352 records). [2025-09-14T20:50:40.499448] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1352 records). [2025-09-14T20:50:40.499601] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-14T20:50:40.499697] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-14T20:50:40.502326] [INFO ] [MAIN ] Derivative Progress: 269/2226 symbols completed. BKKT took 1.0s. Estimated remaining: 11m 33s. Rate: 169.5 symbols/min [2025-09-14T20:50:40.504967] [INFO ] [MAIN ] Derivative Progress: 270/2226 symbols completed. BKH took 1.0s. Estimated remaining: 11m 30s. Rate: 170.1 symbols/min [2025-09-14T20:50:40.506028] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:40.506126] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:40.505848] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:40.518509] [DEBUG] [LOCAL ] BKN: Loaded 5520 existing records from primary storage. [2025-09-14T20:50:40.521977] [INFO ] [MAIN ] BKN: Loaded 5520 primary data records. [2025-09-14T20:50:40.521896] [DEBUG] [LOCAL ] BKT: Loaded 7512 existing records from primary storage. [2025-09-14T20:50:40.553452] [INFO ] [MAIN ] BKT: Loaded 7512 primary data records. [2025-09-14T20:50:40.827238] [DEBUG] [LOCAL ] BKSY: Loaded 36355 existing records from primary storage. [2025-09-14T20:50:40.861870] [INFO ] [MAIN ] BKSY: Loaded 36355 primary data records. [2025-09-14T20:50:41.472596] [DEBUG] [MAIN ] BKN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:41.473480] [INFO ] [MAIN ] BKN: Generated 1352 derivative records from 5520 primary records. [2025-09-14T20:50:41.475031] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-14T20:50:41.496011] [DEBUG] [MAIN ] BKT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:41.498583] [INFO ] [MAIN ] BKT: Generated 1352 derivative records from 7512 primary records. [2025-09-14T20:50:41.499001] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-14T20:50:41.503193] [DEBUG] [LOCAL ] BKN: Derivative data saved (1352 records). [2025-09-14T20:50:41.509397] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-14T20:50:41.513443] [INFO ] [MAIN ] Derivative Progress: 271/2226 symbols completed. BKN took 1.0s. Estimated remaining: 11m 34s. Rate: 168.9 symbols/min [2025-09-14T20:50:41.514422] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:41.525666] [DEBUG] [MAIN ] BKSY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:41.527599] [DEBUG] [LOCAL ] BKT: Derivative data saved (1352 records). [2025-09-14T20:50:41.528801] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-14T20:50:41.528537] [INFO ] [MAIN ] BKSY: Generated 1352 derivative records from 36355 primary records. [2025-09-14T20:50:41.528913] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-14T20:50:41.531964] [INFO ] [MAIN ] Derivative Progress: 272/2226 symbols completed. BKT took 1.0s. Estimated remaining: 11m 32s. Rate: 169.5 symbols/min [2025-09-14T20:50:41.533457] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:41.546020] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1352 records). [2025-09-14T20:50:41.546202] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-14T20:50:41.548727] [INFO ] [MAIN ] Derivative Progress: 273/2226 symbols completed. BKSY took 1.0s. Estimated remaining: 11m 29s. Rate: 170.1 symbols/min [2025-09-14T20:50:41.549156] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:41.575675] [DEBUG] [LOCAL ] BKV: Loaded 21330 existing records from primary storage. [2025-09-14T20:50:41.585404] [INFO ] [MAIN ] BKV: Loaded 21330 primary data records. [2025-09-14T20:50:41.597511] [DEBUG] [LOCAL ] BKU: Loaded 31235 existing records from primary storage. [2025-09-14T20:50:41.637748] [INFO ] [MAIN ] BKU: Loaded 31235 primary data records. [2025-09-14T20:50:41.799471] [DEBUG] [LOCAL ] BLCO: Loaded 26908 existing records from primary storage. [2025-09-14T20:50:41.888601] [INFO ] [MAIN ] BLCO: Loaded 26908 primary data records. [2025-09-14T20:50:42.443933] [DEBUG] [MAIN ] BKV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:42.453935] [INFO ] [MAIN ] BKV: Generated 1352 derivative records from 21330 primary records. [2025-09-14T20:50:42.454551] [DEBUG] [MAIN ] BKU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:42.454686] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-14T20:50:42.455224] [INFO ] [MAIN ] BKU: Generated 1352 derivative records from 31235 primary records. [2025-09-14T20:50:42.456065] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-14T20:50:42.480053] [DEBUG] [LOCAL ] BKV: Derivative data saved (1352 records). [2025-09-14T20:50:42.481978] [DEBUG] [LOCAL ] BKU: Derivative data saved (1352 records). [2025-09-14T20:50:42.487881] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-14T20:50:42.487825] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-14T20:50:42.493432] [INFO ] [MAIN ] Derivative Progress: 274/2226 symbols completed. BKV took 1.0s. Estimated remaining: 11m 33s. Rate: 169.1 symbols/min [2025-09-14T20:50:42.496350] [INFO ] [MAIN ] Derivative Progress: 275/2226 symbols completed. BKU took 1.0s. Estimated remaining: 11m 30s. Rate: 169.7 symbols/min [2025-09-14T20:50:42.493813] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:42.496580] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:42.497214] [DEBUG] [MAIN ] BLCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:42.498567] [INFO ] [MAIN ] BLCO: Generated 1352 derivative records from 26908 primary records. [2025-09-14T20:50:42.498835] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-14T20:50:42.513928] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1352 records). [2025-09-14T20:50:42.514114] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-14T20:50:42.520529] [INFO ] [MAIN ] Derivative Progress: 276/2226 symbols completed. BLCO took 1.0s. Estimated remaining: 11m 27s. Rate: 170.3 symbols/min [2025-09-14T20:50:42.520948] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:42.542451] [DEBUG] [LOCAL ] BLD: Loaded 20705 existing records from primary storage. [2025-09-14T20:50:42.546898] [DEBUG] [LOCAL ] BLE: Loaded 10534 existing records from primary storage. [2025-09-14T20:50:42.546677] [INFO ] [MAIN ] BLD: Loaded 20705 primary data records. [2025-09-14T20:50:42.547143] [INFO ] [MAIN ] BLE: Loaded 10534 primary data records. [2025-09-14T20:50:42.860345] [DEBUG] [LOCAL ] BLDR: Loaded 39059 existing records from primary storage. [2025-09-14T20:50:42.997719] [INFO ] [MAIN ] BLDR: Loaded 39059 primary data records. [2025-09-14T20:50:43.451367] [DEBUG] [MAIN ] BLD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:43.453439] [INFO ] [MAIN ] BLD: Generated 1352 derivative records from 20705 primary records. [2025-09-14T20:50:43.464715] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-14T20:50:43.466287] [DEBUG] [MAIN ] BLE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:43.468702] [INFO ] [MAIN ] BLE: Generated 1352 derivative records from 10534 primary records. [2025-09-14T20:50:43.469350] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-14T20:50:43.489956] [DEBUG] [LOCAL ] BLD: Derivative data saved (1352 records). [2025-09-14T20:50:43.492325] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-14T20:50:43.496765] [INFO ] [MAIN ] Derivative Progress: 277/2226 symbols completed. BLD took 1.0s. Estimated remaining: 11m 31s. Rate: 169.2 symbols/min [2025-09-14T20:50:43.498596] [DEBUG] [LOCAL ] BLE: Derivative data saved (1352 records). [2025-09-14T20:50:43.497985] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:43.498996] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-14T20:50:43.505005] [INFO ] [MAIN ] Derivative Progress: 278/2226 symbols completed. BLE took 1.0s. Estimated remaining: 11m 28s. Rate: 169.8 symbols/min [2025-09-14T20:50:43.506368] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:43.517878] [DEBUG] [MAIN ] BLDR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:43.518843] [INFO ] [MAIN ] BLDR: Generated 1352 derivative records from 39059 primary records. [2025-09-14T20:50:43.519378] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-14T20:50:43.541239] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1352 records). [2025-09-14T20:50:43.541478] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-14T20:50:43.543841] [INFO ] [MAIN ] Derivative Progress: 279/2226 symbols completed. BLDR took 1.0s. Estimated remaining: 11m 26s. Rate: 170.3 symbols/min [2025-09-14T20:50:43.544256] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:43.554897] [DEBUG] [LOCAL ] BLK: Loaded 24978 existing records from primary storage. [2025-09-14T20:50:43.555330] [INFO ] [MAIN ] BLK: Loaded 24978 primary data records. [2025-09-14T20:50:43.707433] [DEBUG] [LOCAL ] BLW: Loaded 9026 existing records from primary storage. [2025-09-14T20:50:43.708884] [DEBUG] [LOCAL ] BLND: Loaded 36755 existing records from primary storage. [2025-09-14T20:50:43.709527] [INFO ] [MAIN ] BLW: Loaded 9026 primary data records. [2025-09-14T20:50:43.709594] [INFO ] [MAIN ] BLND: Loaded 36755 primary data records. [2025-09-14T20:50:44.530627] [DEBUG] [MAIN ] BLK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:44.532771] [INFO ] [MAIN ] BLK: Generated 1352 derivative records from 24978 primary records. [2025-09-14T20:50:44.533060] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-14T20:50:44.571222] [DEBUG] [MAIN ] BLW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:44.573220] [DEBUG] [MAIN ] BLND: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:44.575250] [INFO ] [MAIN ] BLW: Generated 1352 derivative records from 9026 primary records. [2025-09-14T20:50:44.576039] [DEBUG] [LOCAL ] BLK: Derivative data saved (1352 records). [2025-09-14T20:50:44.576145] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-14T20:50:44.577881] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-14T20:50:44.577758] [INFO ] [MAIN ] BLND: Generated 1352 derivative records from 36755 primary records. [2025-09-14T20:50:44.579256] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-14T20:50:44.581583] [INFO ] [MAIN ] Derivative Progress: 280/2226 symbols completed. BLK took 1.1s. Estimated remaining: 11m 30s. Rate: 169.2 symbols/min [2025-09-14T20:50:44.598010] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:44.603378] [DEBUG] [LOCAL ] BLW: Derivative data saved (1352 records). [2025-09-14T20:50:44.611285] [DEBUG] [LOCAL ] BLND: Derivative data saved (1352 records). [2025-09-14T20:50:44.611452] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-14T20:50:44.611966] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-14T20:50:44.615021] [INFO ] [MAIN ] Derivative Progress: 281/2226 symbols completed. BLW took 1.1s. Estimated remaining: 11m 28s. Rate: 169.7 symbols/min [2025-09-14T20:50:44.618349] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:44.618529] [INFO ] [MAIN ] Derivative Progress: 282/2226 symbols completed. BLND took 1.1s. Estimated remaining: 11m 25s. Rate: 170.3 symbols/min [2025-09-14T20:50:44.619542] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:44.634293] [DEBUG] [LOCAL ] BLX: Loaded 11179 existing records from primary storage. [2025-09-14T20:50:44.634619] [INFO ] [MAIN ] BLX: Loaded 11179 primary data records. [2025-09-14T20:50:44.708528] [DEBUG] [LOCAL ] BME: Loaded 8191 existing records from primary storage. [2025-09-14T20:50:44.741337] [INFO ] [MAIN ] BME: Loaded 8191 primary data records. [2025-09-14T20:50:44.849579] [DEBUG] [LOCAL ] BMA: Loaded 25819 existing records from primary storage. [2025-09-14T20:50:44.921739] [INFO ] [MAIN ] BMA: Loaded 25819 primary data records. [2025-09-14T20:50:45.557172] [DEBUG] [MAIN ] BLX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:45.559504] [INFO ] [MAIN ] BLX: Generated 1352 derivative records from 11179 primary records. [2025-09-14T20:50:45.561366] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-14T20:50:45.583937] [DEBUG] [MAIN ] BME: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:45.587122] [DEBUG] [LOCAL ] BLX: Derivative data saved (1352 records). [2025-09-14T20:50:45.588455] [INFO ] [MAIN ] BME: Generated 1352 derivative records from 8191 primary records. [2025-09-14T20:50:45.587411] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-14T20:50:45.588755] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-14T20:50:45.590978] [INFO ] [MAIN ] Derivative Progress: 283/2226 symbols completed. BLX took 1.0s. Estimated remaining: 11m 29s. Rate: 169.2 symbols/min [2025-09-14T20:50:45.607067] [DEBUG] [LOCAL ] BME: Derivative data saved (1352 records). [2025-09-14T20:50:45.607186] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-14T20:50:45.611066] [INFO ] [MAIN ] Derivative Progress: 284/2226 symbols completed. BME took 1.0s. Estimated remaining: 11m 26s. Rate: 169.8 symbols/min [2025-09-14T20:50:45.622153] [DEBUG] [MAIN ] BMA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:45.622952] [INFO ] [MAIN ] BMA: Generated 1352 derivative records from 25819 primary records. [2025-09-14T20:50:45.623049] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-14T20:50:45.635730] [DEBUG] [LOCAL ] BMA: Derivative data saved (1352 records). [2025-09-14T20:50:45.635809] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-14T20:50:45.638087] [INFO ] [MAIN ] Derivative Progress: 285/2226 symbols completed. BMA took 1.0s. Estimated remaining: 11m 24s. Rate: 170.4 symbols/min [2025-09-14T20:50:45.639035] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:45.639156] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:45.639211] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:45.646717] [DEBUG] [LOCAL ] BMN: Loaded 1921 existing records from primary storage. [2025-09-14T20:50:45.646943] [INFO ] [MAIN ] BMN: Loaded 1921 primary data records. [2025-09-14T20:50:45.826299] [DEBUG] [LOCAL ] BMEZ: Loaded 18009 existing records from primary storage. [2025-09-14T20:50:45.862431] [INFO ] [MAIN ] BMEZ: Loaded 18009 primary data records. [2025-09-14T20:50:45.835822] [DEBUG] [LOCAL ] BMI: Loaded 17696 existing records from primary storage. [2025-09-14T20:50:46.025430] [INFO ] [MAIN ] BMI: Loaded 17696 primary data records. [2025-09-14T20:50:46.594776] [DEBUG] [MAIN ] BMN: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:50:46.597837] [INFO ] [MAIN ] BMN: Generated 1351 derivative records from 1921 primary records. [2025-09-14T20:50:46.598736] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-14T20:50:46.613491] [DEBUG] [LOCAL ] BMN: Derivative data saved (1351 records). [2025-09-14T20:50:46.615212] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-14T20:50:46.619196] [INFO ] [MAIN ] Derivative Progress: 286/2226 symbols completed. BMN took 1.0s. Estimated remaining: 11m 28s. Rate: 169.3 symbols/min [2025-09-14T20:50:46.619851] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:46.633612] [DEBUG] [MAIN ] BMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:46.636558] [INFO ] [MAIN ] BMI: Generated 1352 derivative records from 17696 primary records. [2025-09-14T20:50:46.636706] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-14T20:50:46.665029] [DEBUG] [LOCAL ] BMI: Derivative data saved (1352 records). [2025-09-14T20:50:46.661835] [DEBUG] [MAIN ] BMEZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:46.665267] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-14T20:50:46.666368] [INFO ] [MAIN ] BMEZ: Generated 1352 derivative records from 18009 primary records. [2025-09-14T20:50:46.669087] [INFO ] [MAIN ] Derivative Progress: 287/2226 symbols completed. BMI took 1.0s. Estimated remaining: 11m 25s. Rate: 169.8 symbols/min [2025-09-14T20:50:46.669348] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-14T20:50:46.669624] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:46.693698] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1352 records). [2025-09-14T20:50:46.694032] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-14T20:50:46.696772] [INFO ] [MAIN ] Derivative Progress: 288/2226 symbols completed. BMEZ took 1.1s. Estimated remaining: 11m 23s. Rate: 170.4 symbols/min [2025-09-14T20:50:46.697318] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:46.709900] [DEBUG] [LOCAL ] BMO: Loaded 30336 existing records from primary storage. [2025-09-14T20:50:46.710145] [INFO ] [MAIN ] BMO: Loaded 30336 primary data records. [2025-09-14T20:50:46.954553] [DEBUG] [LOCAL ] BMY: Loaded 40497 existing records from primary storage. [2025-09-14T20:50:47.032757] [INFO ] [MAIN ] BMY: Loaded 40497 primary data records. [2025-09-14T20:50:47.066008] [DEBUG] [LOCAL ] BN: Loaded 39788 existing records from primary storage. [2025-09-14T20:50:47.120453] [INFO ] [MAIN ] BN: Loaded 39788 primary data records. [2025-09-14T20:50:47.539849] [DEBUG] [MAIN ] BMO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:47.599565] [INFO ] [MAIN ] BMO: Generated 1352 derivative records from 30336 primary records. [2025-09-14T20:50:47.656858] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-14T20:50:47.680805] [DEBUG] [LOCAL ] BMO: Derivative data saved (1352 records). [2025-09-14T20:50:47.681493] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-14T20:50:47.695164] [INFO ] [MAIN ] Derivative Progress: 289/2226 symbols completed. BMO took 1.1s. Estimated remaining: 11m 27s. Rate: 169.3 symbols/min [2025-09-14T20:50:47.696063] [DEBUG] [MAIN ] BMY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:47.696604] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:47.697677] [INFO ] [MAIN ] BMY: Generated 1352 derivative records from 40497 primary records. [2025-09-14T20:50:47.697996] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-14T20:50:47.714134] [DEBUG] [LOCAL ] BMY: Derivative data saved (1352 records). [2025-09-14T20:50:47.714389] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-14T20:50:47.716905] [INFO ] [MAIN ] Derivative Progress: 290/2226 symbols completed. BMY took 1.0s. Estimated remaining: 11m 24s. Rate: 169.8 symbols/min [2025-09-14T20:50:47.717420] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:47.728986] [DEBUG] [MAIN ] BN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:47.738299] [INFO ] [MAIN ] BN: Generated 1352 derivative records from 39788 primary records. [2025-09-14T20:50:47.738517] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-14T20:50:47.749419] [DEBUG] [LOCAL ] BNH: Loaded 3202 existing records from primary storage. [2025-09-14T20:50:47.753107] [INFO ] [MAIN ] BNH: Loaded 3202 primary data records. [2025-09-14T20:50:47.776169] [DEBUG] [LOCAL ] BN: Derivative data saved (1352 records). [2025-09-14T20:50:47.809936] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-14T20:50:47.797737] [DEBUG] [LOCAL ] BNED: Loaded 22113 existing records from primary storage. [2025-09-14T20:50:47.817556] [INFO ] [MAIN ] Derivative Progress: 291/2226 symbols completed. BN took 1.1s. Estimated remaining: 11m 22s. Rate: 170.3 symbols/min [2025-09-14T20:50:47.826479] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:47.826547] [INFO ] [MAIN ] BNED: Loaded 22113 primary data records. [2025-09-14T20:50:47.957523] [DEBUG] [LOCAL ] BNJ: Loaded 1751 existing records from primary storage. [2025-09-14T20:50:48.000755] [INFO ] [MAIN ] BNJ: Loaded 1751 primary data records. [2025-09-14T20:50:48.722258] [DEBUG] [MAIN ] BNH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:48.734102] [INFO ] [MAIN ] BNH: Generated 1352 derivative records from 3202 primary records. [2025-09-14T20:50:48.735186] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-14T20:50:48.734699] [DEBUG] [MAIN ] BNED: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:48.737344] [INFO ] [MAIN ] BNED: Generated 1352 derivative records from 22113 primary records. [2025-09-14T20:50:48.749166] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-14T20:50:48.752535] [DEBUG] [LOCAL ] BNH: Derivative data saved (1352 records). [2025-09-14T20:50:48.763865] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-14T20:50:48.767143] [DEBUG] [MAIN ] BNJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:48.768232] [INFO ] [MAIN ] BNJ: Generated 1352 derivative records from 1751 primary records. [2025-09-14T20:50:48.766760] [INFO ] [MAIN ] Derivative Progress: 292/2226 symbols completed. BNH took 1.0s. Estimated remaining: 11m 26s. Rate: 169.3 symbols/min [2025-09-14T20:50:48.775157] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:48.775292] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-14T20:50:48.793372] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1352 records). [2025-09-14T20:50:48.793563] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-14T20:50:48.795976] [INFO ] [MAIN ] Derivative Progress: 293/2226 symbols completed. BNJ took 1.0s. Estimated remaining: 11m 23s. Rate: 169.8 symbols/min [2025-09-14T20:50:48.796373] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:48.828788] [DEBUG] [LOCAL ] BNL: Loaded 35098 existing records from primary storage. [2025-09-14T20:50:48.829026] [INFO ] [MAIN ] BNL: Loaded 35098 primary data records. [2025-09-14T20:50:49.019241] [DEBUG] [LOCAL ] BNED: Derivative data saved (1352 records). [2025-09-14T20:50:49.117808] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-14T20:50:49.119305] [DEBUG] [LOCAL ] BNS: Loaded 38577 existing records from primary storage. [2025-09-14T20:50:49.129676] [INFO ] [MAIN ] Derivative Progress: 294/2226 symbols completed. BNED took 1.4s. Estimated remaining: 11m 23s. Rate: 169.8 symbols/min [2025-09-14T20:50:49.130000] [INFO ] [MAIN ] BNS: Loaded 38577 primary data records. [2025-09-14T20:50:49.130520] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:49.272375] [DEBUG] [LOCAL ] BNT: Loaded 2113 existing records from primary storage. [2025-09-14T20:50:49.313678] [INFO ] [MAIN ] BNT: Loaded 2113 primary data records. [2025-09-14T20:50:49.603929] [DEBUG] [MAIN ] BNL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:49.644894] [INFO ] [MAIN ] BNL: Generated 1352 derivative records from 35098 primary records. [2025-09-14T20:50:49.676940] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-14T20:50:49.789321] [DEBUG] [LOCAL ] BNL: Derivative data saved (1352 records). [2025-09-14T20:50:49.788993] [DEBUG] [MAIN ] BNS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:49.791018] [INFO ] [MAIN ] BNS: Generated 1352 derivative records from 38577 primary records. [2025-09-14T20:50:49.791097] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-14T20:50:49.791310] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-14T20:50:49.793868] [INFO ] [MAIN ] Derivative Progress: 295/2226 symbols completed. BNL took 1.0s. Estimated remaining: 11m 24s. Rate: 169.3 symbols/min [2025-09-14T20:50:49.794511] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:49.815230] [DEBUG] [LOCAL ] BNS: Derivative data saved (1352 records). [2025-09-14T20:50:49.819740] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-14T20:50:49.825415] [DEBUG] [LOCAL ] BNY: Loaded 5302 existing records from primary storage. [2025-09-14T20:50:49.832339] [INFO ] [MAIN ] BNY: Loaded 5302 primary data records. [2025-09-14T20:50:49.825042] [INFO ] [MAIN ] Derivative Progress: 296/2226 symbols completed. BNS took 1.0s. Estimated remaining: 11m 22s. Rate: 169.9 symbols/min [2025-09-14T20:50:49.856487] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:49.872887] [DEBUG] [MAIN ] BNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:49.901586] [INFO ] [MAIN ] BNT: Generated 1352 derivative records from 2113 primary records. [2025-09-14T20:50:49.924588] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-14T20:50:50.031072] [DEBUG] [LOCAL ] BNT: Derivative data saved (1352 records). [2025-09-14T20:50:50.059422] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-14T20:50:50.060028] [DEBUG] [LOCAL ] BOC: Loaded 13587 existing records from primary storage. [2025-09-14T20:50:50.062754] [INFO ] [MAIN ] Derivative Progress: 297/2226 symbols completed. BNT took 0.9s. Estimated remaining: 11m 21s. Rate: 170.0 symbols/min [2025-09-14T20:50:50.149129] [INFO ] [MAIN ] BOC: Loaded 13587 primary data records. [2025-09-14T20:50:50.149525] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:50.335280] [DEBUG] [LOCAL ] BOE: Loaded 12245 existing records from primary storage. [2025-09-14T20:50:50.364856] [INFO ] [MAIN ] BOE: Loaded 12245 primary data records. [2025-09-14T20:50:50.672125] [DEBUG] [MAIN ] BNY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:50.834929] [INFO ] [MAIN ] BNY: Generated 1352 derivative records from 5302 primary records. [2025-09-14T20:50:50.835580] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-14T20:50:50.852549] [DEBUG] [LOCAL ] BNY: Derivative data saved (1352 records). [2025-09-14T20:50:50.854629] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-14T20:50:50.857930] [INFO ] [MAIN ] Derivative Progress: 298/2226 symbols completed. BNY took 1.1s. Estimated remaining: 11m 23s. Rate: 169.3 symbols/min [2025-09-14T20:50:50.869549] [DEBUG] [MAIN ] BOC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:50.871445] [INFO ] [MAIN ] BOC: Generated 1352 derivative records from 13587 primary records. [2025-09-14T20:50:50.871655] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-14T20:50:50.885209] [DEBUG] [LOCAL ] BOC: Derivative data saved (1352 records). [2025-09-14T20:50:50.885382] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-14T20:50:50.888101] [INFO ] [MAIN ] Derivative Progress: 299/2226 symbols completed. BOC took 1.1s. Estimated remaining: 11m 21s. Rate: 169.8 symbols/min [2025-09-14T20:50:50.901900] [DEBUG] [MAIN ] BOE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:50.902819] [INFO ] [MAIN ] BOE: Generated 1352 derivative records from 12245 primary records. [2025-09-14T20:50:50.902900] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-14T20:50:50.915431] [DEBUG] [LOCAL ] BOE: Derivative data saved (1352 records). [2025-09-14T20:50:50.915662] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-14T20:50:50.917755] [INFO ] [MAIN ] Derivative Progress: 300/2226 symbols completed. BOE took 0.8s. Estimated remaining: 11m 18s. Rate: 170.4 symbols/min [2025-09-14T20:50:50.918716] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:50.919384] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:50.918854] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:50.967934] [DEBUG] [LOCAL ] BOND: Loaded 23942 existing records from primary storage. [2025-09-14T20:50:50.967195] [DEBUG] [LOCAL ] BOH: Loaded 22443 existing records from primary storage. [2025-09-14T20:50:50.968380] [INFO ] [MAIN ] BOND: Loaded 23942 primary data records. [2025-09-14T20:50:50.968471] [INFO ] [MAIN ] BOH: Loaded 22443 primary data records. [2025-09-14T20:50:51.197578] [DEBUG] [LOCAL ] BOOT: Loaded 30125 existing records from primary storage. [2025-09-14T20:50:51.215532] [INFO ] [MAIN ] BOOT: Loaded 30125 primary data records. [2025-09-14T20:50:51.893002] [DEBUG] [MAIN ] BOND: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:51.894991] [INFO ] [MAIN ] BOND: Generated 1352 derivative records from 23942 primary records. [2025-09-14T20:50:51.895277] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-14T20:50:51.910830] [DEBUG] [MAIN ] BOH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:51.920819] [INFO ] [MAIN ] BOH: Generated 1352 derivative records from 22443 primary records. [2025-09-14T20:50:51.922439] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-14T20:50:51.926560] [DEBUG] [LOCAL ] BOND: Derivative data saved (1352 records). [2025-09-14T20:50:51.935381] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-14T20:50:51.937596] [INFO ] [MAIN ] Derivative Progress: 301/2226 symbols completed. BOND took 1.0s. Estimated remaining: 11m 22s. Rate: 169.3 symbols/min [2025-09-14T20:50:51.938610] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:51.950765] [DEBUG] [MAIN ] BOOT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:51.953185] [DEBUG] [LOCAL ] BOH: Derivative data saved (1352 records). [2025-09-14T20:50:51.952429] [INFO ] [MAIN ] BOOT: Generated 1352 derivative records from 30125 primary records. [2025-09-14T20:50:51.953397] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-14T20:50:51.955914] [INFO ] [MAIN ] Derivative Progress: 302/2226 symbols completed. BOH took 1.0s. Estimated remaining: 11m 20s. Rate: 169.8 symbols/min [2025-09-14T20:50:51.953484] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-14T20:50:51.956242] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:51.977789] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1352 records). [2025-09-14T20:50:51.982885] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-14T20:50:51.985573] [INFO ] [MAIN ] Derivative Progress: 303/2226 symbols completed. BOOT took 1.1s. Estimated remaining: 11m 17s. Rate: 170.4 symbols/min [2025-09-14T20:50:51.986610] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:52.005362] [DEBUG] [LOCAL ] BOW: Loaded 16592 existing records from primary storage. [2025-09-14T20:50:52.005575] [INFO ] [MAIN ] BOW: Loaded 16592 primary data records. [2025-09-14T20:50:52.129931] [DEBUG] [LOCAL ] BORR: Loaded 38458 existing records from primary storage. [2025-09-14T20:50:52.167451] [INFO ] [MAIN ] BORR: Loaded 38458 primary data records. [2025-09-14T20:50:52.450544] [DEBUG] [LOCAL ] BOX: Loaded 37722 existing records from primary storage. [2025-09-14T20:50:52.473327] [INFO ] [MAIN ] BOX: Loaded 37722 primary data records. [2025-09-14T20:50:52.926858] [DEBUG] [MAIN ] BOW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:52.930079] [INFO ] [MAIN ] BOW: Generated 1352 derivative records from 16592 primary records. [2025-09-14T20:50:52.932009] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-14T20:50:52.955532] [DEBUG] [MAIN ] BORR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:52.959585] [DEBUG] [LOCAL ] BOW: Derivative data saved (1352 records). [2025-09-14T20:50:52.960584] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-14T20:50:52.960520] [INFO ] [MAIN ] BORR: Generated 1352 derivative records from 38458 primary records. [2025-09-14T20:50:52.963102] [INFO ] [MAIN ] Derivative Progress: 304/2226 symbols completed. BOW took 1.0s. Estimated remaining: 11m 21s. Rate: 169.4 symbols/min [2025-09-14T20:50:52.963216] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-14T20:50:52.963733] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:52.991151] [DEBUG] [MAIN ] BOX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:52.992553] [INFO ] [MAIN ] BOX: Generated 1352 derivative records from 37722 primary records. [2025-09-14T20:50:52.993345] [DEBUG] [LOCAL ] BORR: Derivative data saved (1352 records). [2025-09-14T20:50:52.993812] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-14T20:50:52.993701] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-14T20:50:52.997604] [INFO ] [MAIN ] Derivative Progress: 305/2226 symbols completed. BORR took 1.1s. Estimated remaining: 11m 19s. Rate: 169.9 symbols/min [2025-09-14T20:50:53.003984] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:53.032276] [DEBUG] [LOCAL ] BOX: Derivative data saved (1352 records). [2025-09-14T20:50:53.032543] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-14T20:50:53.036126] [INFO ] [MAIN ] Derivative Progress: 306/2226 symbols completed. BOX took 1.0s. Estimated remaining: 11m 16s. Rate: 170.4 symbols/min [2025-09-14T20:50:53.036681] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:53.052251] [DEBUG] [LOCAL ] BP: Loaded 40451 existing records from primary storage. [2025-09-14T20:50:53.052806] [INFO ] [MAIN ] BP: Loaded 40451 primary data records. [2025-09-14T20:50:53.240540] [DEBUG] [LOCAL ] BR: Loaded 25468 existing records from primary storage. [2025-09-14T20:50:53.278761] [INFO ] [MAIN ] BR: Loaded 25468 primary data records. [2025-09-14T20:50:53.406268] [DEBUG] [LOCAL ] BRBR: Loaded 39015 existing records from primary storage. [2025-09-14T20:50:53.444885] [INFO ] [MAIN ] BRBR: Loaded 39015 primary data records. [2025-09-14T20:50:54.001046] [DEBUG] [MAIN ] BP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:54.002599] [INFO ] [MAIN ] BP: Generated 1352 derivative records from 40451 primary records. [2025-09-14T20:50:54.002779] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-14T20:50:54.024419] [DEBUG] [LOCAL ] BP: Derivative data saved (1352 records). [2025-09-14T20:50:54.024675] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-14T20:50:54.028395] [INFO ] [MAIN ] Derivative Progress: 307/2226 symbols completed. BP took 1.1s. Estimated remaining: 11m 20s. Rate: 169.4 symbols/min [2025-09-14T20:50:54.030428] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:54.057774] [DEBUG] [MAIN ] BRBR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:54.059227] [INFO ] [MAIN ] BRBR: Generated 1352 derivative records from 39015 primary records. [2025-09-14T20:50:54.071079] [DEBUG] [MAIN ] BR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:54.070426] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-14T20:50:54.076372] [DEBUG] [LOCAL ] BRC: Loaded 13569 existing records from primary storage. [2025-09-14T20:50:54.077366] [INFO ] [MAIN ] BR: Generated 1352 derivative records from 25468 primary records. [2025-09-14T20:50:54.078438] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-14T20:50:54.078567] [INFO ] [MAIN ] BRC: Loaded 13569 primary data records. [2025-09-14T20:50:54.185595] [DEBUG] [LOCAL ] BR: Derivative data saved (1352 records). [2025-09-14T20:50:54.185691] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1352 records). [2025-09-14T20:50:54.208845] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-14T20:50:54.208785] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-14T20:50:54.222105] [INFO ] [MAIN ] Derivative Progress: 308/2226 symbols completed. BR took 1.2s. Estimated remaining: 11m 19s. Rate: 169.6 symbols/min [2025-09-14T20:50:54.268324] [INFO ] [MAIN ] Derivative Progress: 309/2226 symbols completed. BRBR took 1.2s. Estimated remaining: 11m 16s. Rate: 170.1 symbols/min [2025-09-14T20:50:54.290227] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:54.297987] [INFO ] [MAIN ] BRFS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:54.429197] [DEBUG] [MAIN ] BRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:54.430274] [INFO ] [MAIN ] BRC: Generated 1352 derivative records from 13569 primary records. [2025-09-14T20:50:54.430952] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-14T20:50:54.441796] [DEBUG] [LOCAL ] BRFS: Loaded 30661 existing records from primary storage. [2025-09-14T20:50:54.456869] [INFO ] [MAIN ] BRFS: Loaded 30661 primary data records. [2025-09-14T20:50:54.460589] [DEBUG] [LOCAL ] BRCC: Loaded 30415 existing records from primary storage. [2025-09-14T20:50:54.467612] [INFO ] [MAIN ] BRCC: Loaded 30415 primary data records. [2025-09-14T20:50:54.566433] [DEBUG] [LOCAL ] BRC: Derivative data saved (1352 records). [2025-09-14T20:50:54.605823] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-14T20:50:54.685364] [INFO ] [MAIN ] Derivative Progress: 310/2226 symbols completed. BRC took 0.7s. Estimated remaining: 11m 16s. Rate: 170.0 symbols/min [2025-09-14T20:50:54.787408] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:55.112900] [DEBUG] [MAIN ] BRFS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:55.115229] [INFO ] [MAIN ] BRFS: Generated 1352 derivative records from 30661 primary records. [2025-09-14T20:50:55.154483] [DEBUG] [LOCAL ] BRO: Loaded 39113 existing records from primary storage. [2025-09-14T20:50:55.152089] [DEBUG] [LOCAL ] BRFS: Saving derivative data. [2025-09-14T20:50:55.155510] [DEBUG] [MAIN ] BRCC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:55.157666] [INFO ] [MAIN ] BRCC: Generated 1352 derivative records from 30415 primary records. [2025-09-14T20:50:55.156816] [INFO ] [MAIN ] BRO: Loaded 39113 primary data records. [2025-09-14T20:50:55.168427] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-14T20:50:55.172260] [DEBUG] [LOCAL ] BRFS: Derivative data saved (1352 records). [2025-09-14T20:50:55.246377] [INFO ] [MAIN ] BRFS: Successfully saved derivative data. [2025-09-14T20:50:55.261420] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1352 records). [2025-09-14T20:50:55.289534] [INFO ] [MAIN ] Derivative Progress: 311/2226 symbols completed. BRFS took 1.0s. Estimated remaining: 11m 17s. Rate: 169.6 symbols/min [2025-09-14T20:50:55.335041] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-14T20:50:55.351957] [INFO ] [MAIN ] Derivative Progress: 312/2226 symbols completed. BRCC took 1.1s. Estimated remaining: 11m 15s. Rate: 170.0 symbols/min [2025-09-14T20:50:55.352536] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:55.353472] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:55.650539] [DEBUG] [LOCAL ] BRSP: Loaded 26840 existing records from primary storage. [2025-09-14T20:50:55.651363] [INFO ] [MAIN ] BRSP: Loaded 26840 primary data records. [2025-09-14T20:50:55.686503] [DEBUG] [LOCAL ] BROS: Loaded 40080 existing records from primary storage. [2025-09-14T20:50:55.710491] [INFO ] [MAIN ] BROS: Loaded 40080 primary data records. [2025-09-14T20:50:56.278243] [DEBUG] [MAIN ] BRO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:56.316575] [INFO ] [MAIN ] BRO: Generated 1352 derivative records from 39113 primary records. [2025-09-14T20:50:56.326975] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-14T20:50:56.431822] [DEBUG] [LOCAL ] BRO: Derivative data saved (1352 records). [2025-09-14T20:50:56.433815] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-14T20:50:56.436203] [INFO ] [MAIN ] Derivative Progress: 313/2226 symbols completed. BRO took 1.7s. Estimated remaining: 11m 19s. Rate: 168.9 symbols/min [2025-09-14T20:50:56.453809] [DEBUG] [MAIN ] BRSP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:56.454681] [INFO ] [MAIN ] BRSP: Generated 1352 derivative records from 26840 primary records. [2025-09-14T20:50:56.454993] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-14T20:50:56.470245] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1352 records). [2025-09-14T20:50:56.470987] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-14T20:50:56.472949] [INFO ] [MAIN ] Derivative Progress: 314/2226 symbols completed. BRSP took 1.1s. Estimated remaining: 11m 17s. Rate: 169.4 symbols/min [2025-09-14T20:50:56.483579] [DEBUG] [MAIN ] BROS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:56.484527] [INFO ] [MAIN ] BROS: Generated 1352 derivative records from 40080 primary records. [2025-09-14T20:50:56.484613] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-14T20:50:56.498072] [DEBUG] [LOCAL ] BROS: Derivative data saved (1352 records). [2025-09-14T20:50:56.498218] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-14T20:50:56.500761] [INFO ] [MAIN ] Derivative Progress: 315/2226 symbols completed. BROS took 1.2s. Estimated remaining: 11m 15s. Rate: 169.9 symbols/min [2025-09-14T20:50:56.501501] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:56.501762] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:56.502787] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:56.509937] [DEBUG] [LOCAL ] BRT: Loaded 3527 existing records from primary storage. [2025-09-14T20:50:56.510201] [INFO ] [MAIN ] BRT: Loaded 3527 primary data records. [2025-09-14T20:50:56.626803] [DEBUG] [LOCAL ] BRW: Loaded 14128 existing records from primary storage. [2025-09-14T20:50:56.643139] [INFO ] [MAIN ] BRW: Loaded 14128 primary data records. [2025-09-14T20:50:56.777821] [DEBUG] [LOCAL ] BRX: Loaded 39074 existing records from primary storage. [2025-09-14T20:50:56.929687] [INFO ] [MAIN ] BRX: Loaded 39074 primary data records. [2025-09-14T20:50:57.412609] [DEBUG] [MAIN ] BRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:57.413849] [INFO ] [MAIN ] BRT: Generated 1352 derivative records from 3527 primary records. [2025-09-14T20:50:57.414239] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-14T20:50:57.429827] [DEBUG] [LOCAL ] BRT: Derivative data saved (1352 records). [2025-09-14T20:50:57.430816] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-14T20:50:57.432844] [INFO ] [MAIN ] Derivative Progress: 316/2226 symbols completed. BRT took 0.9s. Estimated remaining: 11m 18s. Rate: 169.0 symbols/min [2025-09-14T20:50:57.433566] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:57.451376] [DEBUG] [MAIN ] BRW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:57.454491] [INFO ] [MAIN ] BRW: Generated 1352 derivative records from 14128 primary records. [2025-09-14T20:50:57.454815] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-14T20:50:57.466893] [DEBUG] [MAIN ] BRX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:57.483798] [INFO ] [MAIN ] BRX: Generated 1352 derivative records from 39074 primary records. [2025-09-14T20:50:57.485115] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-14T20:50:57.487024] [DEBUG] [LOCAL ] BRW: Derivative data saved (1352 records). [2025-09-14T20:50:57.487485] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-14T20:50:57.491282] [INFO ] [MAIN ] Derivative Progress: 317/2226 symbols completed. BRW took 1.0s. Estimated remaining: 11m 16s. Rate: 169.5 symbols/min [2025-09-14T20:50:57.497879] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:57.506559] [DEBUG] [LOCAL ] BRX: Derivative data saved (1352 records). [2025-09-14T20:50:57.506986] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-14T20:50:57.518690] [INFO ] [MAIN ] Derivative Progress: 318/2226 symbols completed. BRX took 1.0s. Estimated remaining: 11m 14s. Rate: 170.0 symbols/min [2025-09-14T20:50:57.521027] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:57.521836] [DEBUG] [LOCAL ] BSAC: Loaded 24764 existing records from primary storage. [2025-09-14T20:50:57.522749] [INFO ] [MAIN ] BSAC: Loaded 24764 primary data records. [2025-09-14T20:50:57.640104] [DEBUG] [LOCAL ] BSL: Loaded 5222 existing records from primary storage. [2025-09-14T20:50:57.657134] [INFO ] [MAIN ] BSL: Loaded 5222 primary data records. [2025-09-14T20:50:57.760122] [DEBUG] [LOCAL ] BSBR: Loaded 26870 existing records from primary storage. [2025-09-14T20:50:57.895188] [INFO ] [MAIN ] BSBR: Loaded 26870 primary data records. [2025-09-14T20:50:58.503312] [DEBUG] [MAIN ] BSAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:58.505750] [INFO ] [MAIN ] BSAC: Generated 1352 derivative records from 24764 primary records. [2025-09-14T20:50:58.506265] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-14T20:50:58.522713] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1352 records). [2025-09-14T20:50:58.523062] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-14T20:50:58.525200] [INFO ] [MAIN ] Derivative Progress: 319/2226 symbols completed. BSAC took 1.1s. Estimated remaining: 11m 17s. Rate: 169.0 symbols/min [2025-09-14T20:50:58.525608] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:58.545135] [DEBUG] [MAIN ] BSL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:58.552192] [INFO ] [MAIN ] BSL: Generated 1352 derivative records from 5222 primary records. [2025-09-14T20:50:58.570914] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-14T20:50:58.572075] [DEBUG] [MAIN ] BSBR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:58.573800] [INFO ] [MAIN ] BSBR: Generated 1352 derivative records from 26870 primary records. [2025-09-14T20:50:58.575421] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-14T20:50:58.599254] [DEBUG] [LOCAL ] BSL: Derivative data saved (1352 records). [2025-09-14T20:50:58.605121] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-14T20:50:58.612608] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1352 records). [2025-09-14T20:50:58.609494] [DEBUG] [LOCAL ] BSM: Loaded 24437 existing records from primary storage. [2025-09-14T20:50:58.615038] [INFO ] [MAIN ] Derivative Progress: 320/2226 symbols completed. BSL took 1.1s. Estimated remaining: 11m 15s. Rate: 169.4 symbols/min [2025-09-14T20:50:58.615311] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-14T20:50:58.615379] [INFO ] [MAIN ] BSM: Loaded 24437 primary data records. [2025-09-14T20:50:58.618319] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:58.618447] [INFO ] [MAIN ] Derivative Progress: 321/2226 symbols completed. BSBR took 1.1s. Estimated remaining: 11m 13s. Rate: 169.9 symbols/min [2025-09-14T20:50:58.683735] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:58.910973] [DEBUG] [LOCAL ] BST: Loaded 13627 existing records from primary storage. [2025-09-14T20:50:58.923346] [INFO ] [MAIN ] BST: Loaded 13627 primary data records. [2025-09-14T20:50:58.975786] [DEBUG] [LOCAL ] BSTZ: Loaded 18235 existing records from primary storage. [2025-09-14T20:50:59.016060] [INFO ] [MAIN ] BSTZ: Loaded 18235 primary data records. [2025-09-14T20:50:59.528893] [DEBUG] [MAIN ] BSM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:59.532594] [INFO ] [MAIN ] BSM: Generated 1352 derivative records from 24437 primary records. [2025-09-14T20:50:59.534261] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-14T20:50:59.551277] [DEBUG] [LOCAL ] BSM: Derivative data saved (1352 records). [2025-09-14T20:50:59.551488] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-14T20:50:59.553869] [INFO ] [MAIN ] Derivative Progress: 322/2226 symbols completed. BSM took 1.0s. Estimated remaining: 11m 16s. Rate: 169.0 symbols/min [2025-09-14T20:50:59.554500] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:59.571507] [DEBUG] [MAIN ] BST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:59.572722] [INFO ] [MAIN ] BST: Generated 1352 derivative records from 13627 primary records. [2025-09-14T20:50:59.573079] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-14T20:50:59.588426] [DEBUG] [LOCAL ] BST: Derivative data saved (1352 records). [2025-09-14T20:50:59.588940] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-14T20:50:59.591849] [INFO ] [MAIN ] Derivative Progress: 323/2226 symbols completed. BST took 1.0s. Estimated remaining: 11m 14s. Rate: 169.5 symbols/min [2025-09-14T20:50:59.595721] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:59.608121] [DEBUG] [MAIN ] BSTZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:50:59.609239] [INFO ] [MAIN ] BSTZ: Generated 1352 derivative records from 18235 primary records. [2025-09-14T20:50:59.609401] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-14T20:50:59.636779] [DEBUG] [LOCAL ] BTA: Loaded 4083 existing records from primary storage. [2025-09-14T20:50:59.639520] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1352 records). [2025-09-14T20:50:59.639822] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-14T20:50:59.639877] [INFO ] [MAIN ] BTA: Loaded 4083 primary data records. [2025-09-14T20:50:59.654532] [INFO ] [MAIN ] Derivative Progress: 324/2226 symbols completed. BSTZ took 1.0s. Estimated remaining: 11m 12s. Rate: 169.9 symbols/min [2025-09-14T20:50:59.713160] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:50:59.767369] [DEBUG] [LOCAL ] BSX: Loaded 40428 existing records from primary storage. [2025-09-14T20:50:59.767657] [INFO ] [MAIN ] BSX: Loaded 40428 primary data records. [2025-09-14T20:51:00.085957] [DEBUG] [LOCAL ] BTCM: Loaded 12647 existing records from primary storage. [2025-09-14T20:51:00.108320] [INFO ] [MAIN ] BTCM: Loaded 12647 primary data records. [2025-09-14T20:51:00.647677] [DEBUG] [MAIN ] BTA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:00.650440] [INFO ] [MAIN ] BTA: Generated 1352 derivative records from 4083 primary records. [2025-09-14T20:51:00.651838] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-14T20:51:00.667442] [DEBUG] [LOCAL ] BTA: Derivative data saved (1352 records). [2025-09-14T20:51:00.667661] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-14T20:51:00.669844] [INFO ] [MAIN ] Derivative Progress: 325/2226 symbols completed. BTA took 1.1s. Estimated remaining: 11m 15s. Rate: 169.0 symbols/min [2025-09-14T20:51:00.677407] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:00.683622] [DEBUG] [MAIN ] BSX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:00.684986] [INFO ] [MAIN ] BSX: Generated 1352 derivative records from 40428 primary records. [2025-09-14T20:51:00.685448] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-14T20:51:00.703689] [DEBUG] [LOCAL ] BSX: Derivative data saved (1352 records). [2025-09-14T20:51:00.704071] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-14T20:51:00.706504] [INFO ] [MAIN ] Derivative Progress: 326/2226 symbols completed. BSX took 1.2s. Estimated remaining: 11m 13s. Rate: 169.4 symbols/min [2025-09-14T20:51:00.717669] [DEBUG] [MAIN ] BTCM: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:51:00.717210] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:00.718857] [INFO ] [MAIN ] BTCM: Generated 1351 derivative records from 12647 primary records. [2025-09-14T20:51:00.719521] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-14T20:51:00.733918] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1351 records). [2025-09-14T20:51:00.734137] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-14T20:51:00.736038] [INFO ] [MAIN ] Derivative Progress: 327/2226 symbols completed. BTCM took 1.0s. Estimated remaining: 11m 11s. Rate: 169.9 symbols/min [2025-09-14T20:51:00.736502] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:00.759835] [DEBUG] [LOCAL ] BTO: Loaded 6230 existing records from primary storage. [2025-09-14T20:51:00.761313] [INFO ] [MAIN ] BTO: Loaded 6230 primary data records. [2025-09-14T20:51:00.815960] [DEBUG] [LOCAL ] BTE: Loaded 39642 existing records from primary storage. [2025-09-14T20:51:00.851721] [INFO ] [MAIN ] BTE: Loaded 39642 primary data records. [2025-09-14T20:51:01.094620] [DEBUG] [LOCAL ] BTI: Loaded 40349 existing records from primary storage. [2025-09-14T20:51:01.210448] [INFO ] [MAIN ] BTI: Loaded 40349 primary data records. [2025-09-14T20:51:01.645560] [DEBUG] [MAIN ] BTO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:01.647386] [INFO ] [MAIN ] BTO: Generated 1352 derivative records from 6230 primary records. [2025-09-14T20:51:01.648497] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-14T20:51:01.661909] [DEBUG] [MAIN ] BTE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:01.671983] [INFO ] [MAIN ] BTE: Generated 1352 derivative records from 39642 primary records. [2025-09-14T20:51:01.674502] [DEBUG] [LOCAL ] BTO: Derivative data saved (1352 records). [2025-09-14T20:51:01.674801] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-14T20:51:01.675481] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-14T20:51:01.678633] [INFO ] [MAIN ] Derivative Progress: 328/2226 symbols completed. BTO took 0.9s. Estimated remaining: 11m 14s. Rate: 169.1 symbols/min [2025-09-14T20:51:01.692003] [DEBUG] [LOCAL ] BTE: Derivative data saved (1352 records). [2025-09-14T20:51:01.693543] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-14T20:51:01.695975] [INFO ] [MAIN ] Derivative Progress: 329/2226 symbols completed. BTE took 1.0s. Estimated remaining: 11m 11s. Rate: 169.5 symbols/min [2025-09-14T20:51:01.706159] [DEBUG] [MAIN ] BTI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:01.706900] [INFO ] [MAIN ] BTI: Generated 1352 derivative records from 40349 primary records. [2025-09-14T20:51:01.706986] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-14T20:51:01.719127] [DEBUG] [LOCAL ] BTI: Derivative data saved (1352 records). [2025-09-14T20:51:01.719224] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-14T20:51:01.721361] [INFO ] [MAIN ] Derivative Progress: 330/2226 symbols completed. BTI took 1.0s. Estimated remaining: 11m 9s. Rate: 170.0 symbols/min [2025-09-14T20:51:01.722329] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:01.722948] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:01.723003] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:01.739909] [DEBUG] [LOCAL ] BTT: Loaded 11736 existing records from primary storage. [2025-09-14T20:51:01.740358] [INFO ] [MAIN ] BTT: Loaded 11736 primary data records. [2025-09-14T20:51:01.886032] [DEBUG] [LOCAL ] BTZ: Loaded 16645 existing records from primary storage. [2025-09-14T20:51:01.933797] [INFO ] [MAIN ] BTZ: Loaded 16645 primary data records. [2025-09-14T20:51:02.114562] [DEBUG] [LOCAL ] BTU: Loaded 40092 existing records from primary storage. [2025-09-14T20:51:02.140895] [INFO ] [MAIN ] BTU: Loaded 40092 primary data records. [2025-09-14T20:51:02.664523] [DEBUG] [MAIN ] BTT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:02.666071] [INFO ] [MAIN ] BTT: Generated 1352 derivative records from 11736 primary records. [2025-09-14T20:51:02.666338] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-14T20:51:02.682630] [DEBUG] [LOCAL ] BTT: Derivative data saved (1352 records). [2025-09-14T20:51:02.685426] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-14T20:51:02.689206] [INFO ] [MAIN ] Derivative Progress: 331/2226 symbols completed. BTT took 1.0s. Estimated remaining: 11m 12s. Rate: 169.1 symbols/min [2025-09-14T20:51:02.689811] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:02.702173] [DEBUG] [MAIN ] BTZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:02.703879] [INFO ] [MAIN ] BTZ: Generated 1352 derivative records from 16645 primary records. [2025-09-14T20:51:02.704073] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-14T20:51:02.719499] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1352 records). [2025-09-14T20:51:02.719716] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-14T20:51:02.722152] [INFO ] [MAIN ] Derivative Progress: 332/2226 symbols completed. BTZ took 1.0s. Estimated remaining: 11m 10s. Rate: 169.6 symbols/min [2025-09-14T20:51:02.732923] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:02.733442] [DEBUG] [MAIN ] BTU: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:51:02.735449] [INFO ] [MAIN ] BTU: Generated 1351 derivative records from 40092 primary records. [2025-09-14T20:51:02.735723] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-14T20:51:02.749104] [DEBUG] [LOCAL ] BTU: Derivative data saved (1351 records). [2025-09-14T20:51:02.749388] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-14T20:51:02.751776] [INFO ] [MAIN ] Derivative Progress: 333/2226 symbols completed. BTU took 1.0s. Estimated remaining: 11m 8s. Rate: 170.1 symbols/min [2025-09-14T20:51:02.752266] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:02.772065] [DEBUG] [LOCAL ] BUI: Loaded 8643 existing records from primary storage. [2025-09-14T20:51:02.772450] [INFO ] [MAIN ] BUI: Loaded 8643 primary data records. [2025-09-14T20:51:02.902586] [DEBUG] [LOCAL ] BUD: Loaded 39588 existing records from primary storage. [2025-09-14T20:51:02.929402] [INFO ] [MAIN ] BUD: Loaded 39588 primary data records. [2025-09-14T20:51:03.157032] [DEBUG] [LOCAL ] BUR: Loaded 34135 existing records from primary storage. [2025-09-14T20:51:03.185742] [INFO ] [MAIN ] BUR: Loaded 34135 primary data records. [2025-09-14T20:51:03.701521] [DEBUG] [MAIN ] BUI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:03.705291] [INFO ] [MAIN ] BUI: Generated 1352 derivative records from 8643 primary records. [2025-09-14T20:51:03.706341] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-14T20:51:03.729967] [DEBUG] [LOCAL ] BUI: Derivative data saved (1352 records). [2025-09-14T20:51:03.735401] [DEBUG] [MAIN ] BUD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:03.736383] [INFO ] [MAIN ] BUD: Generated 1352 derivative records from 39588 primary records. [2025-09-14T20:51:03.734770] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-14T20:51:03.738800] [INFO ] [MAIN ] Derivative Progress: 334/2226 symbols completed. BUI took 1.0s. Estimated remaining: 11m 11s. Rate: 169.2 symbols/min [2025-09-14T20:51:03.739304] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-14T20:51:03.739401] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:03.757781] [DEBUG] [LOCAL ] BUD: Derivative data saved (1352 records). [2025-09-14T20:51:03.767828] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-14T20:51:03.770205] [INFO ] [MAIN ] Derivative Progress: 335/2226 symbols completed. BUD took 1.1s. Estimated remaining: 11m 9s. Rate: 169.6 symbols/min [2025-09-14T20:51:03.770959] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:03.770685] [DEBUG] [MAIN ] BUR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:03.772154] [INFO ] [MAIN ] BUR: Generated 1352 derivative records from 34135 primary records. [2025-09-14T20:51:03.772387] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-14T20:51:03.787437] [DEBUG] [LOCAL ] BUR: Derivative data saved (1352 records). [2025-09-14T20:51:03.798236] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-14T20:51:03.800741] [INFO ] [MAIN ] Derivative Progress: 336/2226 symbols completed. BUR took 1.0s. Estimated remaining: 11m 7s. Rate: 170.1 symbols/min [2025-09-14T20:51:03.801168] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:03.808525] [DEBUG] [LOCAL ] BUXX: Loaded 11633 existing records from primary storage. [2025-09-14T20:51:03.808747] [INFO ] [MAIN ] BUXX: Loaded 11633 primary data records. [2025-09-14T20:51:03.931312] [DEBUG] [LOCAL ] BURL: Loaded 34400 existing records from primary storage. [2025-09-14T20:51:03.958355] [INFO ] [MAIN ] BURL: Loaded 34400 primary data records. [2025-09-14T20:51:04.166321] [DEBUG] [LOCAL ] BV: Loaded 28695 existing records from primary storage. [2025-09-14T20:51:04.200007] [INFO ] [MAIN ] BV: Loaded 28695 primary data records. [2025-09-14T20:51:04.663489] [DEBUG] [MAIN ] BUXX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:04.666379] [INFO ] [MAIN ] BUXX: Generated 1352 derivative records from 11633 primary records. [2025-09-14T20:51:04.667327] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-14T20:51:04.690166] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1352 records). [2025-09-14T20:51:04.688704] [DEBUG] [MAIN ] BURL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:04.690333] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-14T20:51:04.691447] [INFO ] [MAIN ] BURL: Generated 1352 derivative records from 34400 primary records. [2025-09-14T20:51:04.693856] [INFO ] [MAIN ] Derivative Progress: 337/2226 symbols completed. BUXX took 0.9s. Estimated remaining: 11m 9s. Rate: 169.3 symbols/min [2025-09-14T20:51:04.694794] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-14T20:51:04.695026] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:04.716396] [DEBUG] [MAIN ] BV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:04.719613] [INFO ] [MAIN ] BV: Generated 1352 derivative records from 28695 primary records. [2025-09-14T20:51:04.718843] [DEBUG] [LOCAL ] BURL: Derivative data saved (1352 records). [2025-09-14T20:51:04.719789] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-14T20:51:04.719882] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-14T20:51:04.722771] [INFO ] [MAIN ] Derivative Progress: 338/2226 symbols completed. BURL took 1.0s. Estimated remaining: 11m 7s. Rate: 169.8 symbols/min [2025-09-14T20:51:04.729966] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:04.736491] [DEBUG] [LOCAL ] BV: Derivative data saved (1352 records). [2025-09-14T20:51:04.736704] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-14T20:51:04.739513] [INFO ] [MAIN ] Derivative Progress: 339/2226 symbols completed. BV took 0.9s. Estimated remaining: 11m 5s. Rate: 170.2 symbols/min [2025-09-14T20:51:04.740232] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:04.785062] [DEBUG] [LOCAL ] BW: Loaded 28564 existing records from primary storage. [2025-09-14T20:51:04.787078] [INFO ] [MAIN ] BW: Loaded 28564 primary data records. [2025-09-14T20:51:04.786718] [DEBUG] [LOCAL ] BVN: Loaded 32333 existing records from primary storage. [2025-09-14T20:51:04.818290] [INFO ] [MAIN ] BVN: Loaded 32333 primary data records. [2025-09-14T20:51:05.094320] [DEBUG] [LOCAL ] BWA: Loaded 39146 existing records from primary storage. [2025-09-14T20:51:05.215702] [INFO ] [MAIN ] BWA: Loaded 39146 primary data records. [2025-09-14T20:51:05.673438] [DEBUG] [MAIN ] BW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:05.675802] [INFO ] [MAIN ] BW: Generated 1352 derivative records from 28564 primary records. [2025-09-14T20:51:05.677082] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-14T20:51:05.689320] [DEBUG] [MAIN ] BVN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:05.700578] [INFO ] [MAIN ] BVN: Generated 1352 derivative records from 32333 primary records. [2025-09-14T20:51:05.702185] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-14T20:51:05.702450] [DEBUG] [LOCAL ] BW: Derivative data saved (1352 records). [2025-09-14T20:51:05.703542] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-14T20:51:05.711173] [INFO ] [MAIN ] Derivative Progress: 340/2226 symbols completed. BW took 1.0s. Estimated remaining: 11m 8s. Rate: 169.4 symbols/min [2025-09-14T20:51:05.714304] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:05.723148] [DEBUG] [LOCAL ] BVN: Derivative data saved (1352 records). [2025-09-14T20:51:05.732837] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-14T20:51:05.736074] [INFO ] [MAIN ] Derivative Progress: 341/2226 symbols completed. BVN took 1.0s. Estimated remaining: 11m 6s. Rate: 169.8 symbols/min [2025-09-14T20:51:05.733606] [DEBUG] [MAIN ] BWA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:05.741871] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:05.742604] [INFO ] [MAIN ] BWA: Generated 1352 derivative records from 39146 primary records. [2025-09-14T20:51:05.742943] [DEBUG] [LOCAL ] BWG: Loaded 9612 existing records from primary storage. [2025-09-14T20:51:05.743097] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-14T20:51:05.744154] [INFO ] [MAIN ] BWG: Loaded 9612 primary data records. [2025-09-14T20:51:05.875935] [DEBUG] [LOCAL ] BWA: Derivative data saved (1352 records). [2025-09-14T20:51:05.906222] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-14T20:51:05.988860] [INFO ] [MAIN ] Derivative Progress: 342/2226 symbols completed. BWA took 1.2s. Estimated remaining: 11m 5s. Rate: 170.0 symbols/min [2025-09-14T20:51:06.028759] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:06.038606] [DEBUG] [LOCAL ] BWLP: Loaded 24114 existing records from primary storage. [2025-09-14T20:51:06.039674] [INFO ] [MAIN ] BWLP: Loaded 24114 primary data records. [2025-09-14T20:51:06.153873] [DEBUG] [LOCAL ] BWMX: Loaded 6394 existing records from primary storage. [2025-09-14T20:51:06.188570] [INFO ] [MAIN ] BWMX: Loaded 6394 primary data records. [2025-09-14T20:51:06.460829] [DEBUG] [MAIN ] BWG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:06.482437] [INFO ] [MAIN ] BWG: Generated 1352 derivative records from 9612 primary records. [2025-09-14T20:51:06.613999] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-14T20:51:06.642927] [DEBUG] [LOCAL ] BWG: Derivative data saved (1352 records). [2025-09-14T20:51:06.643484] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-14T20:51:06.645729] [INFO ] [MAIN ] Derivative Progress: 343/2226 symbols completed. BWG took 0.9s. Estimated remaining: 11m 6s. Rate: 169.5 symbols/min [2025-09-14T20:51:06.660525] [DEBUG] [MAIN ] BWLP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:06.661341] [INFO ] [MAIN ] BWLP: Generated 1352 derivative records from 24114 primary records. [2025-09-14T20:51:06.661626] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-14T20:51:06.677996] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1352 records). [2025-09-14T20:51:06.680255] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-14T20:51:06.683007] [INFO ] [MAIN ] Derivative Progress: 344/2226 symbols completed. BWLP took 0.9s. Estimated remaining: 11m 4s. Rate: 170.0 symbols/min [2025-09-14T20:51:06.698121] [DEBUG] [MAIN ] BWMX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:06.699217] [INFO ] [MAIN ] BWMX: Generated 1352 derivative records from 6394 primary records. [2025-09-14T20:51:06.699320] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-14T20:51:06.717070] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1352 records). [2025-09-14T20:51:06.717265] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-14T20:51:06.720177] [INFO ] [MAIN ] Derivative Progress: 345/2226 symbols completed. BWMX took 0.7s. Estimated remaining: 11m 2s. Rate: 170.4 symbols/min [2025-09-14T20:51:06.720790] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:06.721090] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:06.721691] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:06.731187] [DEBUG] [LOCAL ] BWSN: Loaded 4133 existing records from primary storage. [2025-09-14T20:51:06.731623] [INFO ] [MAIN ] BWSN: Loaded 4133 primary data records. [2025-09-14T20:51:06.746552] [DEBUG] [LOCAL ] BWNB: Loaded 3446 existing records from primary storage. [2025-09-14T20:51:06.790847] [INFO ] [MAIN ] BWNB: Loaded 3446 primary data records. [2025-09-14T20:51:07.128979] [DEBUG] [LOCAL ] BWXT: Loaded 35100 existing records from primary storage. [2025-09-14T20:51:07.181404] [INFO ] [MAIN ] BWXT: Loaded 35100 primary data records. [2025-09-14T20:51:07.655989] [DEBUG] [MAIN ] BWSN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:07.657356] [INFO ] [MAIN ] BWSN: Generated 1352 derivative records from 4133 primary records. [2025-09-14T20:51:07.657795] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-14T20:51:07.681406] [DEBUG] [MAIN ] BWNB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:07.683347] [INFO ] [MAIN ] BWNB: Generated 1352 derivative records from 3446 primary records. [2025-09-14T20:51:07.684143] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-14T20:51:07.684381] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1352 records). [2025-09-14T20:51:07.685181] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-14T20:51:07.688124] [INFO ] [MAIN ] Derivative Progress: 346/2226 symbols completed. BWSN took 1.0s. Estimated remaining: 11m 5s. Rate: 169.6 symbols/min [2025-09-14T20:51:07.696942] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:07.699003] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1352 records). [2025-09-14T20:51:07.699683] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-14T20:51:07.702269] [INFO ] [MAIN ] Derivative Progress: 347/2226 symbols completed. BWNB took 1.0s. Estimated remaining: 11m 3s. Rate: 170.0 symbols/min [2025-09-14T20:51:07.702815] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:07.718192] [DEBUG] [MAIN ] BWXT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:07.719104] [INFO ] [MAIN ] BWXT: Generated 1352 derivative records from 35100 primary records. [2025-09-14T20:51:07.722073] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-14T20:51:07.741402] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1352 records). [2025-09-14T20:51:07.741559] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-14T20:51:07.738863] [DEBUG] [LOCAL ] BXC: Loaded 10237 existing records from primary storage. [2025-09-14T20:51:07.744203] [INFO ] [MAIN ] BXC: Loaded 10237 primary data records. [2025-09-14T20:51:07.744113] [INFO ] [MAIN ] Derivative Progress: 348/2226 symbols completed. BWXT took 1.0s. Estimated remaining: 11m 1s. Rate: 170.5 symbols/min [2025-09-14T20:51:07.744704] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:07.934589] [DEBUG] [LOCAL ] BX: Loaded 40257 existing records from primary storage. [2025-09-14T20:51:07.964704] [INFO ] [MAIN ] BX: Loaded 40257 primary data records. [2025-09-14T20:51:08.116615] [DEBUG] [LOCAL ] BXMT: Loaded 34780 existing records from primary storage. [2025-09-14T20:51:08.149514] [INFO ] [MAIN ] BXMT: Loaded 34780 primary data records. [2025-09-14T20:51:08.626110] [DEBUG] [MAIN ] BXC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:08.627583] [INFO ] [MAIN ] BXC: Generated 1352 derivative records from 10237 primary records. [2025-09-14T20:51:08.628945] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-14T20:51:08.643024] [DEBUG] [LOCAL ] BXC: Derivative data saved (1352 records). [2025-09-14T20:51:08.643463] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-14T20:51:08.646722] [INFO ] [MAIN ] Derivative Progress: 349/2226 symbols completed. BXC took 0.9s. Estimated remaining: 11m 4s. Rate: 169.7 symbols/min [2025-09-14T20:51:08.648017] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:08.665246] [DEBUG] [MAIN ] BX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:08.671685] [INFO ] [MAIN ] BX: Generated 1352 derivative records from 40257 primary records. [2025-09-14T20:51:08.671934] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-14T20:51:08.700445] [DEBUG] [MAIN ] BXMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:08.703666] [DEBUG] [LOCAL ] BX: Derivative data saved (1352 records). [2025-09-14T20:51:08.704944] [INFO ] [MAIN ] BXMT: Generated 1352 derivative records from 34780 primary records. [2025-09-14T20:51:08.704015] [DEBUG] [LOCAL ] BXMX: Loaded 13751 existing records from primary storage. [2025-09-14T20:51:08.705004] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-14T20:51:08.707182] [INFO ] [MAIN ] Derivative Progress: 350/2226 symbols completed. BX took 1.0s. Estimated remaining: 11m 2s. Rate: 170.1 symbols/min [2025-09-14T20:51:08.705183] [INFO ] [MAIN ] BXMX: Loaded 13751 primary data records. [2025-09-14T20:51:08.707484] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:08.707653] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-14T20:51:08.824929] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1352 records). [2025-09-14T20:51:08.851366] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-14T20:51:08.899043] [INFO ] [MAIN ] Derivative Progress: 351/2226 symbols completed. BXMT took 1.2s. Estimated remaining: 11m 0s. Rate: 170.3 symbols/min [2025-09-14T20:51:08.904265] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:09.017721] [DEBUG] [LOCAL ] BXP: Loaded 37306 existing records from primary storage. [2025-09-14T20:51:09.018165] [INFO ] [MAIN ] BXP: Loaded 37306 primary data records. [2025-09-14T20:51:09.200933] [DEBUG] [LOCAL ] BXSL: Loaded 35067 existing records from primary storage. [2025-09-14T20:51:09.203301] [INFO ] [MAIN ] BXSL: Loaded 35067 primary data records. [2025-09-14T20:51:09.240249] [DEBUG] [MAIN ] BXMX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:09.286015] [INFO ] [MAIN ] BXMX: Generated 1352 derivative records from 13751 primary records. [2025-09-14T20:51:09.404225] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-14T20:51:09.613475] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1352 records). [2025-09-14T20:51:09.614173] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-14T20:51:09.616432] [INFO ] [MAIN ] Derivative Progress: 352/2226 symbols completed. BXMX took 1.0s. Estimated remaining: 11m 2s. Rate: 169.8 symbols/min [2025-09-14T20:51:09.616713] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:09.635005] [DEBUG] [MAIN ] BXP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:09.636439] [INFO ] [MAIN ] BXP: Generated 1352 derivative records from 37306 primary records. [2025-09-14T20:51:09.637570] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-14T20:51:09.661928] [DEBUG] [LOCAL ] BXP: Derivative data saved (1352 records). [2025-09-14T20:51:09.662750] [DEBUG] [LOCAL ] BY: Loaded 16124 existing records from primary storage. [2025-09-14T20:51:09.662868] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-14T20:51:09.663032] [INFO ] [MAIN ] BY: Loaded 16124 primary data records. [2025-09-14T20:51:09.665704] [INFO ] [MAIN ] Derivative Progress: 353/2226 symbols completed. BXP took 1.0s. Estimated remaining: 11m 0s. Rate: 170.3 symbols/min [2025-09-14T20:51:09.671586] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:09.770323] [DEBUG] [MAIN ] BXSL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:09.787781] [INFO ] [MAIN ] BXSL: Generated 1352 derivative records from 35067 primary records. [2025-09-14T20:51:09.809020] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-14T20:51:09.973612] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1352 records). [2025-09-14T20:51:10.029232] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-14T20:51:10.031813] [INFO ] [MAIN ] Derivative Progress: 354/2226 symbols completed. BXSL took 1.1s. Estimated remaining: 10m 60s. Rate: 170.2 symbols/min [2025-09-14T20:51:10.032232] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:10.047372] [DEBUG] [LOCAL ] BYD: Loaded 33858 existing records from primary storage. [2025-09-14T20:51:10.050458] [INFO ] [MAIN ] BYD: Loaded 33858 primary data records. [2025-09-14T20:51:10.055671] [DEBUG] [LOCAL ] BYM: Loaded 8535 existing records from primary storage. [2025-09-14T20:51:10.088680] [INFO ] [MAIN ] BYM: Loaded 8535 primary data records. [2025-09-14T20:51:10.647888] [DEBUG] [MAIN ] BY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:10.649784] [INFO ] [MAIN ] BY: Generated 1352 derivative records from 16124 primary records. [2025-09-14T20:51:10.650666] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-14T20:51:10.669822] [DEBUG] [LOCAL ] BY: Derivative data saved (1352 records). [2025-09-14T20:51:10.670263] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-14T20:51:10.672675] [INFO ] [MAIN ] Derivative Progress: 355/2226 symbols completed. BY took 1.1s. Estimated remaining: 11m 1s. Rate: 169.8 symbols/min [2025-09-14T20:51:10.673947] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:10.692056] [DEBUG] [MAIN ] BYD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:10.693679] [INFO ] [MAIN ] BYD: Generated 1352 derivative records from 33858 primary records. [2025-09-14T20:51:10.700982] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-14T20:51:10.712684] [DEBUG] [MAIN ] BYM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:10.722336] [INFO ] [MAIN ] BYM: Generated 1352 derivative records from 8535 primary records. [2025-09-14T20:51:10.730886] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-14T20:51:10.734767] [DEBUG] [LOCAL ] BYD: Derivative data saved (1352 records). [2025-09-14T20:51:10.743017] [DEBUG] [LOCAL ] BZH: Loaded 24562 existing records from primary storage. [2025-09-14T20:51:10.746842] [INFO ] [MAIN ] BZH: Loaded 24562 primary data records. [2025-09-14T20:51:10.743128] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-14T20:51:10.761622] [INFO ] [MAIN ] Derivative Progress: 356/2226 symbols completed. BYD took 1.1s. Estimated remaining: 10m 59s. Rate: 170.2 symbols/min [2025-09-14T20:51:10.783253] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:10.789448] [DEBUG] [LOCAL ] BYM: Derivative data saved (1352 records). [2025-09-14T20:51:10.817476] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-14T20:51:10.858509] [INFO ] [MAIN ] Derivative Progress: 357/2226 symbols completed. BYM took 0.8s. Estimated remaining: 10m 58s. Rate: 170.6 symbols/min [2025-09-14T20:51:10.860010] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:11.054358] [DEBUG] [LOCAL ] CAAP: Loaded 13531 existing records from primary storage. [2025-09-14T20:51:11.069283] [INFO ] [MAIN ] CAAP: Loaded 13531 primary data records. [2025-09-14T20:51:11.071252] [DEBUG] [LOCAL ] C: Loaded 40482 existing records from primary storage. [2025-09-14T20:51:11.110051] [INFO ] [MAIN ] C: Loaded 40482 primary data records. [2025-09-14T20:51:11.573848] [DEBUG] [MAIN ] BZH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:11.664579] [INFO ] [MAIN ] BZH: Generated 1352 derivative records from 24562 primary records. [2025-09-14T20:51:11.665281] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-14T20:51:11.681032] [DEBUG] [LOCAL ] BZH: Derivative data saved (1352 records). [2025-09-14T20:51:11.683019] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-14T20:51:11.685202] [INFO ] [MAIN ] Derivative Progress: 358/2226 symbols completed. BZH took 1.0s. Estimated remaining: 10m 60s. Rate: 169.9 symbols/min [2025-09-14T20:51:11.705578] [DEBUG] [MAIN ] CAAP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:11.707864] [INFO ] [MAIN ] CAAP: Generated 1352 derivative records from 13531 primary records. [2025-09-14T20:51:11.709207] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-14T20:51:11.733559] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1352 records). [2025-09-14T20:51:11.734210] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-14T20:51:11.734021] [DEBUG] [MAIN ] C: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:11.737359] [INFO ] [MAIN ] C: Generated 1352 derivative records from 40482 primary records. [2025-09-14T20:51:11.736451] [INFO ] [MAIN ] Derivative Progress: 359/2226 symbols completed. CAAP took 0.9s. Estimated remaining: 10m 58s. Rate: 170.3 symbols/min [2025-09-14T20:51:11.737542] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-14T20:51:11.752811] [DEBUG] [LOCAL ] C: Derivative data saved (1352 records). [2025-09-14T20:51:11.753083] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-14T20:51:11.755407] [INFO ] [MAIN ] Derivative Progress: 360/2226 symbols completed. C took 1.0s. Estimated remaining: 10m 56s. Rate: 170.8 symbols/min [2025-09-14T20:51:11.756207] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:11.756355] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:11.756440] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:11.784521] [DEBUG] [LOCAL ] CABO: Loaded 13907 existing records from primary storage. [2025-09-14T20:51:11.791600] [INFO ] [MAIN ] CABO: Loaded 13907 primary data records. [2025-09-14T20:51:11.792164] [DEBUG] [LOCAL ] CACI: Loaded 17208 existing records from primary storage. [2025-09-14T20:51:11.818456] [INFO ] [MAIN ] CACI: Loaded 17208 primary data records. [2025-09-14T20:51:12.076323] [DEBUG] [LOCAL ] CADE: Loaded 37014 existing records from primary storage. [2025-09-14T20:51:12.193411] [INFO ] [MAIN ] CADE: Loaded 37014 primary data records. [2025-09-14T20:51:12.749291] [DEBUG] [MAIN ] CACI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:12.750788] [INFO ] [MAIN ] CACI: Generated 1352 derivative records from 17208 primary records. [2025-09-14T20:51:12.751775] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-14T20:51:12.771355] [DEBUG] [MAIN ] CABO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:12.774487] [DEBUG] [LOCAL ] CACI: Derivative data saved (1352 records). [2025-09-14T20:51:12.775188] [INFO ] [MAIN ] CABO: Generated 1352 derivative records from 13907 primary records. [2025-09-14T20:51:12.775309] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-14T20:51:12.775556] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-14T20:51:12.777628] [INFO ] [MAIN ] Derivative Progress: 361/2226 symbols completed. CACI took 1.0s. Estimated remaining: 10m 59s. Rate: 169.9 symbols/min [2025-09-14T20:51:12.779019] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:12.794452] [DEBUG] [LOCAL ] CABO: Derivative data saved (1352 records). [2025-09-14T20:51:12.805006] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-14T20:51:12.804846] [DEBUG] [MAIN ] CADE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:12.805972] [INFO ] [MAIN ] CADE: Generated 1352 derivative records from 37014 primary records. [2025-09-14T20:51:12.808525] [INFO ] [MAIN ] Derivative Progress: 362/2226 symbols completed. CABO took 1.1s. Estimated remaining: 10m 57s. Rate: 170.3 symbols/min [2025-09-14T20:51:12.808834] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-14T20:51:12.809138] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:12.835985] [DEBUG] [LOCAL ] CAF: Loaded 2328 existing records from primary storage. [2025-09-14T20:51:12.836572] [DEBUG] [LOCAL ] CADE: Derivative data saved (1352 records). [2025-09-14T20:51:12.837044] [INFO ] [MAIN ] CAF: Loaded 2328 primary data records. [2025-09-14T20:51:12.836974] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-14T20:51:12.908764] [DEBUG] [LOCAL ] CAE: Loaded 28792 existing records from primary storage. [2025-09-14T20:51:12.917102] [INFO ] [MAIN ] Derivative Progress: 363/2226 symbols completed. CADE took 1.2s. Estimated remaining: 10m 55s. Rate: 170.6 symbols/min [2025-09-14T20:51:12.939697] [INFO ] [MAIN ] CAE: Loaded 28792 primary data records. [2025-09-14T20:51:12.950810] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:13.417037] [DEBUG] [LOCAL ] CAG: Loaded 40406 existing records from primary storage. [2025-09-14T20:51:13.417355] [INFO ] [MAIN ] CAG: Loaded 40406 primary data records. [2025-09-14T20:51:13.715890] [DEBUG] [MAIN ] CAF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:13.717425] [INFO ] [MAIN ] CAF: Generated 1352 derivative records from 2328 primary records. [2025-09-14T20:51:13.718181] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-14T20:51:13.732156] [DEBUG] [LOCAL ] CAF: Derivative data saved (1352 records). [2025-09-14T20:51:13.734189] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-14T20:51:13.736415] [INFO ] [MAIN ] Derivative Progress: 364/2226 symbols completed. CAF took 0.9s. Estimated remaining: 10m 57s. Rate: 170.0 symbols/min [2025-09-14T20:51:13.736735] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:13.750397] [DEBUG] [MAIN ] CAE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:13.751354] [INFO ] [MAIN ] CAE: Generated 1352 derivative records from 28792 primary records. [2025-09-14T20:51:13.751601] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-14T20:51:13.766655] [DEBUG] [LOCAL ] CAE: Derivative data saved (1352 records). [2025-09-14T20:51:13.766898] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-14T20:51:13.769674] [INFO ] [MAIN ] Derivative Progress: 365/2226 symbols completed. CAE took 1.0s. Estimated remaining: 10m 55s. Rate: 170.4 symbols/min [2025-09-14T20:51:13.770204] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:13.790765] [DEBUG] [MAIN ] CAG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:13.791723] [INFO ] [MAIN ] CAG: Generated 1352 derivative records from 40406 primary records. [2025-09-14T20:51:13.791925] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-14T20:51:13.817011] [DEBUG] [LOCAL ] CAG: Derivative data saved (1352 records). [2025-09-14T20:51:13.824083] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-14T20:51:13.827019] [INFO ] [MAIN ] Derivative Progress: 366/2226 symbols completed. CAG took 0.9s. Estimated remaining: 10m 53s. Rate: 170.8 symbols/min [2025-09-14T20:51:13.827687] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:13.842295] [DEBUG] [LOCAL ] CAL: Loaded 32070 existing records from primary storage. [2025-09-14T20:51:13.853152] [INFO ] [MAIN ] CAL: Loaded 32070 primary data records. [2025-09-14T20:51:13.854016] [DEBUG] [LOCAL ] CAH: Loaded 38710 existing records from primary storage. [2025-09-14T20:51:13.859376] [INFO ] [MAIN ] CAH: Loaded 38710 primary data records. [2025-09-14T20:51:14.116277] [DEBUG] [LOCAL ] CALX: Loaded 28955 existing records from primary storage. [2025-09-14T20:51:14.233135] [INFO ] [MAIN ] CALX: Loaded 28955 primary data records. [2025-09-14T20:51:14.757095] [DEBUG] [MAIN ] CAH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:14.759400] [INFO ] [MAIN ] CAH: Generated 1352 derivative records from 38710 primary records. [2025-09-14T20:51:14.759990] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-14T20:51:14.770368] [DEBUG] [MAIN ] CAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:14.771472] [INFO ] [MAIN ] CAL: Generated 1352 derivative records from 32070 primary records. [2025-09-14T20:51:14.771809] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-14T20:51:14.784983] [DEBUG] [LOCAL ] CAH: Derivative data saved (1352 records). [2025-09-14T20:51:14.785331] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-14T20:51:14.788291] [INFO ] [MAIN ] Derivative Progress: 367/2226 symbols completed. CAH took 1.1s. Estimated remaining: 10m 56s. Rate: 170.0 symbols/min [2025-09-14T20:51:14.794229] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:14.802608] [DEBUG] [LOCAL ] CAL: Derivative data saved (1352 records). [2025-09-14T20:51:14.802829] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-14T20:51:14.804753] [INFO ] [MAIN ] Derivative Progress: 368/2226 symbols completed. CAL took 1.0s. Estimated remaining: 10m 54s. Rate: 170.4 symbols/min [2025-09-14T20:51:14.805105] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:14.820082] [DEBUG] [MAIN ] CALX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:14.826259] [INFO ] [MAIN ] CALX: Generated 1352 derivative records from 28955 primary records. [2025-09-14T20:51:14.830000] [DEBUG] [LOCAL ] CAPL: Loaded 3919 existing records from primary storage. [2025-09-14T20:51:14.830073] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-14T20:51:14.830235] [INFO ] [MAIN ] CAPL: Loaded 3919 primary data records. [2025-09-14T20:51:14.914883] [DEBUG] [LOCAL ] CALX: Derivative data saved (1352 records). [2025-09-14T20:51:14.936593] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-14T20:51:14.956514] [INFO ] [MAIN ] Derivative Progress: 369/2226 symbols completed. CALX took 1.1s. Estimated remaining: 10m 53s. Rate: 170.7 symbols/min [2025-09-14T20:51:14.954216] [DEBUG] [LOCAL ] CANG: Loaded 20289 existing records from primary storage. [2025-09-14T20:51:14.972996] [INFO ] [MAIN ] CANG: Loaded 20289 primary data records. [2025-09-14T20:51:14.962539] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:15.432492] [DEBUG] [LOCAL ] CARR: Loaded 40349 existing records from primary storage. [2025-09-14T20:51:15.433634] [INFO ] [MAIN ] CARR: Loaded 40349 primary data records. [2025-09-14T20:51:15.636996] [DEBUG] [MAIN ] CAPL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:15.643230] [INFO ] [MAIN ] CAPL: Generated 1352 derivative records from 3919 primary records. [2025-09-14T20:51:15.741658] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-14T20:51:15.742122] [DEBUG] [MAIN ] CANG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:15.743720] [INFO ] [MAIN ] CANG: Generated 1352 derivative records from 20289 primary records. [2025-09-14T20:51:15.745432] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-14T20:51:15.774469] [DEBUG] [LOCAL ] CANG: Derivative data saved (1352 records). [2025-09-14T20:51:15.774616] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-14T20:51:15.777337] [INFO ] [MAIN ] Derivative Progress: 370/2226 symbols completed. CANG took 1.0s. Estimated remaining: 10m 55s. Rate: 170.1 symbols/min [2025-09-14T20:51:15.773424] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1352 records). [2025-09-14T20:51:15.777589] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:15.777733] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-14T20:51:15.781218] [INFO ] [MAIN ] Derivative Progress: 371/2226 symbols completed. CAPL took 1.0s. Estimated remaining: 10m 53s. Rate: 170.6 symbols/min [2025-09-14T20:51:15.782576] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:15.810665] [DEBUG] [MAIN ] CARR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:15.811554] [INFO ] [MAIN ] CARR: Generated 1352 derivative records from 40349 primary records. [2025-09-14T20:51:15.811876] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-14T20:51:15.840214] [DEBUG] [LOCAL ] CARR: Derivative data saved (1352 records). [2025-09-14T20:51:15.840429] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-14T20:51:15.842366] [INFO ] [MAIN ] Derivative Progress: 372/2226 symbols completed. CARR took 0.9s. Estimated remaining: 10m 51s. Rate: 170.9 symbols/min [2025-09-14T20:51:15.851874] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:15.851516] [DEBUG] [LOCAL ] CARS: Loaded 29560 existing records from primary storage. [2025-09-14T20:51:15.852375] [INFO ] [MAIN ] CARS: Loaded 29560 primary data records. [2025-09-14T20:51:15.933423] [DEBUG] [LOCAL ] CATO: Loaded 5126 existing records from primary storage. [2025-09-14T20:51:15.980393] [DEBUG] [LOCAL ] CAT: Loaded 39807 existing records from primary storage. [2025-09-14T20:51:15.980530] [INFO ] [MAIN ] CATO: Loaded 5126 primary data records. [2025-09-14T20:51:16.004744] [INFO ] [MAIN ] CAT: Loaded 39807 primary data records. [2025-09-14T20:51:16.809636] [DEBUG] [MAIN ] CARS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:16.812090] [INFO ] [MAIN ] CARS: Generated 1352 derivative records from 29560 primary records. [2025-09-14T20:51:16.812430] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-14T20:51:16.842023] [DEBUG] [LOCAL ] CARS: Derivative data saved (1352 records). [2025-09-14T20:51:16.843725] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-14T20:51:16.844702] [DEBUG] [MAIN ] CATO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:16.849103] [INFO ] [MAIN ] Derivative Progress: 373/2226 symbols completed. CARS took 1.1s. Estimated remaining: 10m 54s. Rate: 170.1 symbols/min [2025-09-14T20:51:16.847081] [INFO ] [MAIN ] CATO: Generated 1352 derivative records from 5126 primary records. [2025-09-14T20:51:16.861384] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-14T20:51:16.861996] [DEBUG] [MAIN ] CAT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:16.864150] [INFO ] [MAIN ] CAT: Generated 1352 derivative records from 39807 primary records. [2025-09-14T20:51:16.864547] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-14T20:51:16.876916] [DEBUG] [LOCAL ] CATO: Derivative data saved (1352 records). [2025-09-14T20:51:16.882999] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-14T20:51:16.887207] [INFO ] [MAIN ] Derivative Progress: 374/2226 symbols completed. CATO took 1.0s. Estimated remaining: 10m 52s. Rate: 170.5 symbols/min [2025-09-14T20:51:16.893695] [DEBUG] [LOCAL ] CAT: Derivative data saved (1352 records). [2025-09-14T20:51:16.893824] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-14T20:51:16.896365] [INFO ] [MAIN ] Derivative Progress: 375/2226 symbols completed. CAT took 1.1s. Estimated remaining: 10m 50s. Rate: 170.9 symbols/min [2025-09-14T20:51:16.897349] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:16.897198] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:16.896948] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:16.912352] [DEBUG] [LOCAL ] CBAN: Loaded 7543 existing records from primary storage. [2025-09-14T20:51:16.912886] [INFO ] [MAIN ] CBAN: Loaded 7543 primary data records. [2025-09-14T20:51:17.186989] [DEBUG] [LOCAL ] CB: Loaded 37384 existing records from primary storage. [2025-09-14T20:51:17.279903] [DEBUG] [LOCAL ] CAVA: Loaded 40321 existing records from primary storage. [2025-09-14T20:51:17.280635] [INFO ] [MAIN ] CB: Loaded 37384 primary data records. [2025-09-14T20:51:17.280930] [INFO ] [MAIN ] CAVA: Loaded 40321 primary data records. [2025-09-14T20:51:17.881478] [DEBUG] [MAIN ] CBAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:17.883986] [INFO ] [MAIN ] CBAN: Generated 1352 derivative records from 7543 primary records. [2025-09-14T20:51:17.885557] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-14T20:51:17.900520] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1352 records). [2025-09-14T20:51:17.901049] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-14T20:51:17.903674] [INFO ] [MAIN ] Derivative Progress: 376/2226 symbols completed. CBAN took 1.0s. Estimated remaining: 10m 53s. Rate: 170.1 symbols/min [2025-09-14T20:51:17.904364] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:17.926173] [DEBUG] [MAIN ] CB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:17.928077] [INFO ] [MAIN ] CB: Generated 1352 derivative records from 37384 primary records. [2025-09-14T20:51:17.944744] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-14T20:51:17.945221] [DEBUG] [LOCAL ] CBL: Loaded 12055 existing records from primary storage. [2025-09-14T20:51:17.946999] [INFO ] [MAIN ] CBL: Loaded 12055 primary data records. [2025-09-14T20:51:17.945718] [DEBUG] [MAIN ] CAVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:17.959627] [INFO ] [MAIN ] CAVA: Generated 1352 derivative records from 40321 primary records. [2025-09-14T20:51:18.004396] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-14T20:51:18.082121] [DEBUG] [LOCAL ] CB: Derivative data saved (1352 records). [2025-09-14T20:51:18.097611] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-14T20:51:18.133319] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1352 records). [2025-09-14T20:51:18.136074] [INFO ] [MAIN ] Derivative Progress: 377/2226 symbols completed. CB took 1.2s. Estimated remaining: 10m 52s. Rate: 170.2 symbols/min [2025-09-14T20:51:18.150283] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-14T20:51:18.185722] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:18.181737] [INFO ] [MAIN ] Derivative Progress: 378/2226 symbols completed. CAVA took 1.3s. Estimated remaining: 10m 50s. Rate: 170.6 symbols/min [2025-09-14T20:51:18.186261] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:18.278820] [DEBUG] [LOCAL ] CBNA: Loaded 2374 existing records from primary storage. [2025-09-14T20:51:18.280526] [INFO ] [MAIN ] CBNA: Loaded 2374 primary data records. [2025-09-14T20:51:18.589899] [DEBUG] [LOCAL ] CBRE: Loaded 37804 existing records from primary storage. [2025-09-14T20:51:18.602081] [INFO ] [MAIN ] CBRE: Loaded 37804 primary data records. [2025-09-14T20:51:18.732150] [DEBUG] [MAIN ] CBL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:18.738088] [INFO ] [MAIN ] CBL: Generated 1352 derivative records from 12055 primary records. [2025-09-14T20:51:18.738368] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-14T20:51:18.804210] [DEBUG] [LOCAL ] CBL: Derivative data saved (1352 records). [2025-09-14T20:51:18.813102] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-14T20:51:18.832247] [INFO ] [MAIN ] Derivative Progress: 379/2226 symbols completed. CBL took 0.9s. Estimated remaining: 10m 51s. Rate: 170.3 symbols/min [2025-09-14T20:51:18.838870] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:18.957103] [DEBUG] [MAIN ] CBNA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:18.958096] [INFO ] [MAIN ] CBNA: Generated 1352 derivative records from 2374 primary records. [2025-09-14T20:51:18.958394] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-14T20:51:18.979740] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1352 records). [2025-09-14T20:51:18.980703] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-14T20:51:18.990052] [INFO ] [MAIN ] Derivative Progress: 380/2226 symbols completed. CBNA took 0.8s. Estimated remaining: 10m 50s. Rate: 170.5 symbols/min [2025-09-14T20:51:18.992921] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:18.996057] [DEBUG] [LOCAL ] CBT: Loaded 23085 existing records from primary storage. [2025-09-14T20:51:18.996914] [INFO ] [MAIN ] CBT: Loaded 23085 primary data records. [2025-09-14T20:51:19.157406] [DEBUG] [LOCAL ] CBU: Loaded 16496 existing records from primary storage. [2025-09-14T20:51:19.187854] [DEBUG] [MAIN ] CBRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:19.214708] [INFO ] [MAIN ] CBU: Loaded 16496 primary data records. [2025-09-14T20:51:19.216742] [INFO ] [MAIN ] CBRE: Generated 1352 derivative records from 37804 primary records. [2025-09-14T20:51:19.220060] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-14T20:51:19.483486] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1352 records). [2025-09-14T20:51:19.505887] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-14T20:51:19.551504] [INFO ] [MAIN ] Derivative Progress: 381/2226 symbols completed. CBRE took 1.4s. Estimated remaining: 10m 50s. Rate: 170.2 symbols/min [2025-09-14T20:51:19.564507] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:19.711551] [DEBUG] [LOCAL ] CBZ: Loaded 25154 existing records from primary storage. [2025-09-14T20:51:19.712509] [INFO ] [MAIN ] CBZ: Loaded 25154 primary data records. [2025-09-14T20:51:19.790343] [DEBUG] [MAIN ] CBT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:19.814765] [INFO ] [MAIN ] CBT: Generated 1352 derivative records from 23085 primary records. [2025-09-14T20:51:19.832203] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-14T20:51:19.932885] [DEBUG] [LOCAL ] CBT: Derivative data saved (1352 records). [2025-09-14T20:51:20.024806] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-14T20:51:20.028148] [INFO ] [MAIN ] Derivative Progress: 382/2226 symbols completed. CBT took 1.2s. Estimated remaining: 10m 51s. Rate: 170.1 symbols/min [2025-09-14T20:51:20.029539] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:20.046225] [DEBUG] [MAIN ] CBU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:20.048264] [INFO ] [MAIN ] CBU: Generated 1352 derivative records from 16496 primary records. [2025-09-14T20:51:20.050261] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-14T20:51:20.065493] [DEBUG] [LOCAL ] CBU: Derivative data saved (1352 records). [2025-09-14T20:51:20.065719] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-14T20:51:20.067931] [INFO ] [MAIN ] Derivative Progress: 383/2226 symbols completed. CBU took 1.1s. Estimated remaining: 10m 49s. Rate: 170.5 symbols/min [2025-09-14T20:51:20.068502] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:20.094846] [DEBUG] [MAIN ] CBZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:20.095810] [INFO ] [MAIN ] CBZ: Generated 1352 derivative records from 25154 primary records. [2025-09-14T20:51:20.096915] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-14T20:51:20.111468] [DEBUG] [LOCAL ] CC: Loaded 39907 existing records from primary storage. [2025-09-14T20:51:20.121524] [INFO ] [MAIN ] CC: Loaded 39907 primary data records. [2025-09-14T20:51:20.123775] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1352 records). [2025-09-14T20:51:20.124223] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-14T20:51:20.126818] [INFO ] [MAIN ] Derivative Progress: 384/2226 symbols completed. CBZ took 0.6s. Estimated remaining: 10m 47s. Rate: 170.8 symbols/min [2025-09-14T20:51:20.164187] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:20.323391] [DEBUG] [LOCAL ] CCI: Loaded 39942 existing records from primary storage. [2025-09-14T20:51:20.346864] [INFO ] [MAIN ] CCI: Loaded 39942 primary data records. [2025-09-14T20:51:20.347272] [DEBUG] [LOCAL ] CCIF: Loaded 11453 existing records from primary storage. [2025-09-14T20:51:20.441027] [INFO ] [MAIN ] CCIF: Loaded 11453 primary data records. [2025-09-14T20:51:21.047608] [DEBUG] [MAIN ] CC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:21.051443] [INFO ] [MAIN ] CC: Generated 1352 derivative records from 39907 primary records. [2025-09-14T20:51:21.051947] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-14T20:51:21.085834] [DEBUG] [LOCAL ] CC: Derivative data saved (1352 records). [2025-09-14T20:51:21.086398] [DEBUG] [MAIN ] CCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:21.088004] [INFO ] [MAIN ] CCI: Generated 1352 derivative records from 39942 primary records. [2025-09-14T20:51:21.094377] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-14T20:51:21.098883] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-14T20:51:21.100988] [DEBUG] [MAIN ] CCIF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:21.104200] [INFO ] [MAIN ] Derivative Progress: 385/2226 symbols completed. CC took 1.1s. Estimated remaining: 10m 50s. Rate: 170.1 symbols/min [2025-09-14T20:51:21.112625] [INFO ] [MAIN ] CCIF: Generated 1352 derivative records from 11453 primary records. [2025-09-14T20:51:21.115734] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:21.116282] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-14T20:51:21.119428] [DEBUG] [LOCAL ] CCI: Derivative data saved (1352 records). [2025-09-14T20:51:21.120847] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-14T20:51:21.124921] [INFO ] [MAIN ] Derivative Progress: 386/2226 symbols completed. CCI took 1.1s. Estimated remaining: 10m 48s. Rate: 170.5 symbols/min [2025-09-14T20:51:21.137296] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:21.138465] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1352 records). [2025-09-14T20:51:21.139533] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-14T20:51:21.143707] [INFO ] [MAIN ] Derivative Progress: 387/2226 symbols completed. CCIF took 1.0s. Estimated remaining: 10m 46s. Rate: 170.9 symbols/min [2025-09-14T20:51:21.144462] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:21.237732] [DEBUG] [LOCAL ] CCJ: Loaded 40437 existing records from primary storage. [2025-09-14T20:51:21.241719] [DEBUG] [LOCAL ] CCK: Loaded 34738 existing records from primary storage. [2025-09-14T20:51:21.241919] [INFO ] [MAIN ] CCJ: Loaded 40437 primary data records. [2025-09-14T20:51:21.242363] [INFO ] [MAIN ] CCK: Loaded 34738 primary data records. [2025-09-14T20:51:21.243224] [DEBUG] [LOCAL ] CCL: Loaded 40540 existing records from primary storage. [2025-09-14T20:51:21.316388] [INFO ] [MAIN ] CCL: Loaded 40540 primary data records. [2025-09-14T20:51:22.244922] [DEBUG] [MAIN ] CCJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:22.250471] [INFO ] [MAIN ] CCJ: Generated 1352 derivative records from 40437 primary records. [2025-09-14T20:51:22.251945] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-14T20:51:22.264528] [DEBUG] [MAIN ] CCK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:22.282471] [INFO ] [MAIN ] CCK: Generated 1352 derivative records from 34738 primary records. [2025-09-14T20:51:22.289214] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1352 records). [2025-09-14T20:51:22.289319] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-14T20:51:22.290677] [DEBUG] [MAIN ] CCL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:22.292294] [INFO ] [MAIN ] CCL: Generated 1352 derivative records from 40540 primary records. [2025-09-14T20:51:22.290341] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-14T20:51:22.295154] [INFO ] [MAIN ] Derivative Progress: 388/2226 symbols completed. CCJ took 1.2s. Estimated remaining: 10m 49s. Rate: 169.9 symbols/min [2025-09-14T20:51:22.295607] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-14T20:51:22.325060] [DEBUG] [LOCAL ] CCK: Derivative data saved (1352 records). [2025-09-14T20:51:22.326981] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-14T20:51:22.330054] [INFO ] [MAIN ] Derivative Progress: 389/2226 symbols completed. CCK took 1.2s. Estimated remaining: 10m 47s. Rate: 170.3 symbols/min [2025-09-14T20:51:22.330873] [DEBUG] [LOCAL ] CCL: Derivative data saved (1352 records). [2025-09-14T20:51:22.330976] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-14T20:51:22.334183] [INFO ] [MAIN ] Derivative Progress: 390/2226 symbols completed. CCL took 1.2s. Estimated remaining: 10m 45s. Rate: 170.7 symbols/min [2025-09-14T20:51:22.334815] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:22.334922] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:22.335063] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:22.349214] [DEBUG] [LOCAL ] CCRD: Loaded 7757 existing records from primary storage. [2025-09-14T20:51:22.349576] [INFO ] [MAIN ] CCRD: Loaded 7757 primary data records. [2025-09-14T20:51:22.561882] [DEBUG] [LOCAL ] CCO: Loaded 36522 existing records from primary storage. [2025-09-14T20:51:22.566557] [INFO ] [MAIN ] CCO: Loaded 36522 primary data records. [2025-09-14T20:51:22.563071] [DEBUG] [LOCAL ] CCS: Loaded 22771 existing records from primary storage. [2025-09-14T20:51:22.616117] [INFO ] [MAIN ] CCS: Loaded 22771 primary data records. [2025-09-14T20:51:23.240126] [DEBUG] [MAIN ] CCRD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:23.242114] [INFO ] [MAIN ] CCRD: Generated 1352 derivative records from 7757 primary records. [2025-09-14T20:51:23.242832] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-14T20:51:23.259699] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1352 records). [2025-09-14T20:51:23.260166] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-14T20:51:23.262181] [INFO ] [MAIN ] Derivative Progress: 391/2226 symbols completed. CCRD took 0.9s. Estimated remaining: 10m 48s. Rate: 170.0 symbols/min [2025-09-14T20:51:23.262655] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:23.277446] [DEBUG] [MAIN ] CCS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:23.279842] [INFO ] [MAIN ] CCS: Generated 1352 derivative records from 22771 primary records. [2025-09-14T20:51:23.280798] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-14T20:51:23.308964] [DEBUG] [LOCAL ] CCS: Derivative data saved (1352 records). [2025-09-14T20:51:23.309139] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-14T20:51:23.311392] [INFO ] [MAIN ] Derivative Progress: 392/2226 symbols completed. CCS took 1.0s. Estimated remaining: 10m 46s. Rate: 170.4 symbols/min [2025-09-14T20:51:23.312035] [DEBUG] [MAIN ] CCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:23.317840] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:23.319332] [INFO ] [MAIN ] CCO: Generated 1352 derivative records from 36522 primary records. [2025-09-14T20:51:23.320007] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-14T20:51:23.320435] [DEBUG] [LOCAL ] CCU: Loaded 16710 existing records from primary storage. [2025-09-14T20:51:23.321572] [INFO ] [MAIN ] CCU: Loaded 16710 primary data records. [2025-09-14T20:51:23.417470] [DEBUG] [LOCAL ] CCO: Derivative data saved (1352 records). [2025-09-14T20:51:23.438334] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-14T20:51:23.454471] [INFO ] [MAIN ] Derivative Progress: 393/2226 symbols completed. CCO took 1.1s. Estimated remaining: 10m 45s. Rate: 170.6 symbols/min [2025-09-14T20:51:23.466363] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:23.658231] [DEBUG] [LOCAL ] CDE: Loaded 40384 existing records from primary storage. [2025-09-14T20:51:23.660128] [INFO ] [MAIN ] CDE: Loaded 40384 primary data records. [2025-09-14T20:51:23.659071] [DEBUG] [LOCAL ] CDLR: Loaded 7036 existing records from primary storage. [2025-09-14T20:51:23.660941] [INFO ] [MAIN ] CDLR: Loaded 7036 primary data records. [2025-09-14T20:51:24.287063] [DEBUG] [MAIN ] CCU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:24.289609] [INFO ] [MAIN ] CCU: Generated 1352 derivative records from 16710 primary records. [2025-09-14T20:51:24.290728] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-14T20:51:24.306705] [DEBUG] [LOCAL ] CCU: Derivative data saved (1352 records). [2025-09-14T20:51:24.307408] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-14T20:51:24.309365] [INFO ] [MAIN ] Derivative Progress: 394/2226 symbols completed. CCU took 1.0s. Estimated remaining: 10m 47s. Rate: 170.0 symbols/min [2025-09-14T20:51:24.310146] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:24.339275] [DEBUG] [MAIN ] CDE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:24.339671] [DEBUG] [MAIN ] CDLR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:24.346586] [INFO ] [MAIN ] CDE: Generated 1352 derivative records from 40384 primary records. [2025-09-14T20:51:24.347489] [INFO ] [MAIN ] CDLR: Generated 1352 derivative records from 7036 primary records. [2025-09-14T20:51:24.347794] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-14T20:51:24.348964] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-14T20:51:24.383909] [DEBUG] [LOCAL ] CDRE: Loaded 18728 existing records from primary storage. [2025-09-14T20:51:24.384885] [DEBUG] [LOCAL ] CDE: Derivative data saved (1352 records). [2025-09-14T20:51:24.385329] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-14T20:51:24.385538] [INFO ] [MAIN ] CDRE: Loaded 18728 primary data records. [2025-09-14T20:51:24.385410] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1352 records). [2025-09-14T20:51:24.388807] [INFO ] [MAIN ] Derivative Progress: 395/2226 symbols completed. CDE took 1.1s. Estimated remaining: 10m 45s. Rate: 170.4 symbols/min [2025-09-14T20:51:24.385965] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-14T20:51:24.429939] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:24.439768] [INFO ] [MAIN ] Derivative Progress: 396/2226 symbols completed. CDLR took 0.9s. Estimated remaining: 10m 43s. Rate: 170.7 symbols/min [2025-09-14T20:51:24.461245] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:24.562910] [DEBUG] [LOCAL ] CEE: Loaded 4013 existing records from primary storage. [2025-09-14T20:51:24.592524] [INFO ] [MAIN ] CEE: Loaded 4013 primary data records. [2025-09-14T20:51:24.823020] [DEBUG] [LOCAL ] CE: Loaded 38584 existing records from primary storage. [2025-09-14T20:51:24.827409] [INFO ] [MAIN ] CE: Loaded 38584 primary data records. [2025-09-14T20:51:25.298959] [DEBUG] [MAIN ] CDRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:25.300304] [INFO ] [MAIN ] CDRE: Generated 1352 derivative records from 18728 primary records. [2025-09-14T20:51:25.300918] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-14T20:51:25.315447] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1352 records). [2025-09-14T20:51:25.315607] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-14T20:51:25.317564] [INFO ] [MAIN ] Derivative Progress: 397/2226 symbols completed. CDRE took 1.0s. Estimated remaining: 10m 45s. Rate: 170.1 symbols/min [2025-09-14T20:51:25.318347] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:25.333601] [DEBUG] [MAIN ] CEE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:25.334682] [INFO ] [MAIN ] CEE: Generated 1352 derivative records from 4013 primary records. [2025-09-14T20:51:25.335202] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-14T20:51:25.353631] [DEBUG] [LOCAL ] CEE: Derivative data saved (1352 records). [2025-09-14T20:51:25.356805] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-14T20:51:25.359449] [INFO ] [MAIN ] Derivative Progress: 398/2226 symbols completed. CEE took 0.9s. Estimated remaining: 10m 43s. Rate: 170.5 symbols/min [2025-09-14T20:51:25.377183] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:25.377963] [DEBUG] [MAIN ] CE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:25.379513] [DEBUG] [LOCAL ] CEPU: Loaded 18775 existing records from primary storage. [2025-09-14T20:51:25.380504] [INFO ] [MAIN ] CE: Generated 1352 derivative records from 38584 primary records. [2025-09-14T20:51:25.380862] [INFO ] [MAIN ] CEPU: Loaded 18775 primary data records. [2025-09-14T20:51:25.380948] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-14T20:51:25.500556] [DEBUG] [LOCAL ] CE: Derivative data saved (1352 records). [2025-09-14T20:51:25.527599] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-14T20:51:25.588457] [INFO ] [MAIN ] Derivative Progress: 399/2226 symbols completed. CE took 1.2s. Estimated remaining: 10m 43s. Rate: 170.6 symbols/min [2025-09-14T20:51:25.689833] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:25.716899] [DEBUG] [LOCAL ] CF: Loaded 39355 existing records from primary storage. [2025-09-14T20:51:25.717240] [INFO ] [MAIN ] CF: Loaded 39355 primary data records. [2025-09-14T20:51:26.034564] [DEBUG] [LOCAL ] CFG: Loaded 40366 existing records from primary storage. [2025-09-14T20:51:26.036200] [INFO ] [MAIN ] CFG: Loaded 40366 primary data records. [2025-09-14T20:51:26.047535] [DEBUG] [MAIN ] CEPU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:26.105442] [INFO ] [MAIN ] CEPU: Generated 1352 derivative records from 18775 primary records. [2025-09-14T20:51:26.126934] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-14T20:51:26.348698] [DEBUG] [MAIN ] CF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:26.350943] [INFO ] [MAIN ] CF: Generated 1352 derivative records from 39355 primary records. [2025-09-14T20:51:26.349924] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1352 records). [2025-09-14T20:51:26.351914] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-14T20:51:26.352015] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-14T20:51:26.355081] [INFO ] [MAIN ] Derivative Progress: 400/2226 symbols completed. CEPU took 1.0s. Estimated remaining: 10m 44s. Rate: 170.1 symbols/min [2025-09-14T20:51:26.356511] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:26.373104] [DEBUG] [LOCAL ] CF: Derivative data saved (1352 records). [2025-09-14T20:51:26.373446] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-14T20:51:26.375936] [INFO ] [MAIN ] Derivative Progress: 401/2226 symbols completed. CF took 1.0s. Estimated remaining: 10m 42s. Rate: 170.5 symbols/min [2025-09-14T20:51:26.376266] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:26.398568] [DEBUG] [MAIN ] CFG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:26.399703] [INFO ] [MAIN ] CFG: Generated 1352 derivative records from 40366 primary records. [2025-09-14T20:51:26.399858] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-14T20:51:26.420449] [DEBUG] [LOCAL ] CFG: Derivative data saved (1352 records). [2025-09-14T20:51:26.421689] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-14T20:51:26.424164] [INFO ] [MAIN ] Derivative Progress: 402/2226 symbols completed. CFG took 0.7s. Estimated remaining: 10m 40s. Rate: 170.9 symbols/min [2025-09-14T20:51:26.424530] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:26.425815] [DEBUG] [LOCAL ] CFR: Loaded 24399 existing records from primary storage. [2025-09-14T20:51:26.426324] [INFO ] [MAIN ] CFR: Loaded 24399 primary data records. [2025-09-14T20:51:26.523450] [DEBUG] [LOCAL ] CGV: Loaded 953 existing records from primary storage. [2025-09-14T20:51:26.559444] [INFO ] [MAIN ] CGV: Loaded 953 primary data records. [2025-09-14T20:51:26.583905] [DEBUG] [LOCAL ] CGAU: Loaded 31557 existing records from primary storage. [2025-09-14T20:51:26.675022] [INFO ] [MAIN ] CGAU: Loaded 31557 primary data records. [2025-09-14T20:51:27.390681] [DEBUG] [MAIN ] CFR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:27.392335] [INFO ] [MAIN ] CFR: Generated 1352 derivative records from 24399 primary records. [2025-09-14T20:51:27.394577] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-14T20:51:27.417749] [DEBUG] [MAIN ] CGV: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T20:51:27.420885] [DEBUG] [LOCAL ] CFR: Derivative data saved (1352 records). [2025-09-14T20:51:27.422819] [INFO ] [MAIN ] CGV: Generated 1349 derivative records from 953 primary records. [2025-09-14T20:51:27.423360] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-14T20:51:27.423436] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-14T20:51:27.428252] [INFO ] [MAIN ] Derivative Progress: 403/2226 symbols completed. CFR took 1.1s. Estimated remaining: 10m 43s. Rate: 170.1 symbols/min [2025-09-14T20:51:27.452612] [DEBUG] [LOCAL ] CGV: Derivative data saved (1349 records). [2025-09-14T20:51:27.453288] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-14T20:51:27.456234] [INFO ] [MAIN ] Derivative Progress: 404/2226 symbols completed. CGV took 1.0s. Estimated remaining: 10m 41s. Rate: 170.5 symbols/min [2025-09-14T20:51:27.453179] [DEBUG] [MAIN ] CGAU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:27.457891] [INFO ] [MAIN ] CGAU: Generated 1352 derivative records from 31557 primary records. [2025-09-14T20:51:27.458060] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-14T20:51:27.476607] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1352 records). [2025-09-14T20:51:27.476920] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-14T20:51:27.479814] [INFO ] [MAIN ] Derivative Progress: 405/2226 symbols completed. CGAU took 1.1s. Estimated remaining: 10m 39s. Rate: 170.9 symbols/min [2025-09-14T20:51:27.480899] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:27.480786] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:27.481073] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:27.524243] [DEBUG] [LOCAL ] CHCT: Loaded 18123 existing records from primary storage. [2025-09-14T20:51:27.523242] [DEBUG] [LOCAL ] CHE: Loaded 11232 existing records from primary storage. [2025-09-14T20:51:27.524537] [INFO ] [MAIN ] CHCT: Loaded 18123 primary data records. [2025-09-14T20:51:27.530323] [INFO ] [MAIN ] CHE: Loaded 11232 primary data records. [2025-09-14T20:51:27.919630] [DEBUG] [LOCAL ] CHD: Loaded 39567 existing records from primary storage. [2025-09-14T20:51:28.036558] [INFO ] [MAIN ] CHD: Loaded 39567 primary data records. [2025-09-14T20:51:28.449715] [DEBUG] [MAIN ] CHCT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:28.451293] [INFO ] [MAIN ] CHCT: Generated 1352 derivative records from 18123 primary records. [2025-09-14T20:51:28.461629] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-14T20:51:28.461522] [DEBUG] [MAIN ] CHE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:28.464192] [INFO ] [MAIN ] CHE: Generated 1352 derivative records from 11232 primary records. [2025-09-14T20:51:28.478099] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1352 records). [2025-09-14T20:51:28.478234] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-14T20:51:28.480009] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-14T20:51:28.482514] [INFO ] [MAIN ] Derivative Progress: 406/2226 symbols completed. CHCT took 1.0s. Estimated remaining: 10m 42s. Rate: 170.1 symbols/min [2025-09-14T20:51:28.488747] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:28.497832] [DEBUG] [LOCAL ] CHE: Derivative data saved (1352 records). [2025-09-14T20:51:28.499660] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-14T20:51:28.502443] [INFO ] [MAIN ] Derivative Progress: 407/2226 symbols completed. CHE took 1.0s. Estimated remaining: 10m 40s. Rate: 170.5 symbols/min [2025-09-14T20:51:28.502831] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:28.521037] [DEBUG] [MAIN ] CHD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:28.522034] [INFO ] [MAIN ] CHD: Generated 1352 derivative records from 39567 primary records. [2025-09-14T20:51:28.522264] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-14T20:51:28.569223] [DEBUG] [LOCAL ] CHD: Derivative data saved (1352 records). [2025-09-14T20:51:28.577744] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-14T20:51:28.580382] [INFO ] [MAIN ] Derivative Progress: 408/2226 symbols completed. CHD took 1.1s. Estimated remaining: 10m 39s. Rate: 170.8 symbols/min [2025-09-14T20:51:28.589342] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:28.590449] [DEBUG] [LOCAL ] CHH: Loaded 23681 existing records from primary storage. [2025-09-14T20:51:28.591232] [INFO ] [MAIN ] CHH: Loaded 23681 primary data records. [2025-09-14T20:51:28.712502] [DEBUG] [LOCAL ] CHGG: Loaded 35858 existing records from primary storage. [2025-09-14T20:51:28.716177] [INFO ] [MAIN ] CHGG: Loaded 35858 primary data records. [2025-09-14T20:51:28.903155] [DEBUG] [LOCAL ] CHMI: Loaded 15383 existing records from primary storage. [2025-09-14T20:51:29.006787] [INFO ] [MAIN ] CHMI: Loaded 15383 primary data records. [2025-09-14T20:51:29.552968] [DEBUG] [MAIN ] CHH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:29.554426] [INFO ] [MAIN ] CHH: Generated 1352 derivative records from 23681 primary records. [2025-09-14T20:51:29.555155] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-14T20:51:29.573910] [DEBUG] [LOCAL ] CHH: Derivative data saved (1352 records). [2025-09-14T20:51:29.574797] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-14T20:51:29.577137] [INFO ] [MAIN ] Derivative Progress: 409/2226 symbols completed. CHH took 1.1s. Estimated remaining: 10m 41s. Rate: 170.0 symbols/min [2025-09-14T20:51:29.578060] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:29.589087] [DEBUG] [MAIN ] CHGG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:29.591828] [INFO ] [MAIN ] CHGG: Generated 1352 derivative records from 35858 primary records. [2025-09-14T20:51:29.593109] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-14T20:51:29.603682] [DEBUG] [MAIN ] CHMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:29.611772] [DEBUG] [LOCAL ] CHN: Loaded 3676 existing records from primary storage. [2025-09-14T20:51:29.612338] [INFO ] [MAIN ] CHMI: Generated 1352 derivative records from 15383 primary records. [2025-09-14T20:51:29.615384] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-14T20:51:29.613227] [INFO ] [MAIN ] CHN: Loaded 3676 primary data records. [2025-09-14T20:51:29.619139] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1352 records). [2025-09-14T20:51:29.648454] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-14T20:51:29.686432] [INFO ] [MAIN ] Derivative Progress: 410/2226 symbols completed. CHGG took 1.2s. Estimated remaining: 10m 40s. Rate: 170.3 symbols/min [2025-09-14T20:51:29.707787] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:29.736381] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1352 records). [2025-09-14T20:51:29.753018] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-14T20:51:29.781198] [INFO ] [MAIN ] Derivative Progress: 411/2226 symbols completed. CHMI took 1.2s. Estimated remaining: 10m 38s. Rate: 170.6 symbols/min [2025-09-14T20:51:29.789816] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:29.950493] [DEBUG] [LOCAL ] CHT: Loaded 14550 existing records from primary storage. [2025-09-14T20:51:29.961330] [INFO ] [MAIN ] CHT: Loaded 14550 primary data records. [2025-09-14T20:51:29.962729] [DEBUG] [LOCAL ] CHPT: Loaded 37016 existing records from primary storage. [2025-09-14T20:51:29.968501] [INFO ] [MAIN ] CHPT: Loaded 37016 primary data records. [2025-09-14T20:51:30.440709] [DEBUG] [MAIN ] CHN: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T20:51:30.480732] [INFO ] [MAIN ] CHN: Generated 1350 derivative records from 3676 primary records. [2025-09-14T20:51:30.482914] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-14T20:51:30.586048] [DEBUG] [LOCAL ] CHN: Derivative data saved (1350 records). [2025-09-14T20:51:30.586825] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-14T20:51:30.589906] [INFO ] [MAIN ] Derivative Progress: 412/2226 symbols completed. CHN took 1.0s. Estimated remaining: 10m 40s. Rate: 170.1 symbols/min [2025-09-14T20:51:30.590336] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:30.613313] [DEBUG] [MAIN ] CHT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:30.614342] [INFO ] [MAIN ] CHT: Generated 1352 derivative records from 14550 primary records. [2025-09-14T20:51:30.614609] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-14T20:51:30.631098] [DEBUG] [LOCAL ] CHT: Derivative data saved (1352 records). [2025-09-14T20:51:30.631274] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-14T20:51:30.633479] [INFO ] [MAIN ] Derivative Progress: 413/2226 symbols completed. CHT took 0.8s. Estimated remaining: 10m 38s. Rate: 170.5 symbols/min [2025-09-14T20:51:30.655238] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:30.654823] [DEBUG] [MAIN ] CHPT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:30.656243] [INFO ] [MAIN ] CHPT: Generated 1352 derivative records from 37016 primary records. [2025-09-14T20:51:30.656443] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-14T20:51:30.670923] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1352 records). [2025-09-14T20:51:30.672325] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-14T20:51:30.675182] [INFO ] [MAIN ] Derivative Progress: 414/2226 symbols completed. CHPT took 1.0s. Estimated remaining: 10m 36s. Rate: 170.8 symbols/min [2025-09-14T20:51:30.687968] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:30.688866] [DEBUG] [LOCAL ] CHWY: Loaded 40401 existing records from primary storage. [2025-09-14T20:51:30.689574] [INFO ] [MAIN ] CHWY: Loaded 40401 primary data records. [2025-09-14T20:51:30.857510] [DEBUG] [LOCAL ] CIA: Loaded 12924 existing records from primary storage. [2025-09-14T20:51:30.878705] [INFO ] [MAIN ] CIA: Loaded 12924 primary data records. [2025-09-14T20:51:30.893205] [DEBUG] [LOCAL ] CI: Loaded 37661 existing records from primary storage. [2025-09-14T20:51:30.958555] [INFO ] [MAIN ] CI: Loaded 37661 primary data records. [2025-09-14T20:51:31.710541] [DEBUG] [MAIN ] CHWY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:31.712894] [INFO ] [MAIN ] CHWY: Generated 1352 derivative records from 40401 primary records. [2025-09-14T20:51:31.714774] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-14T20:51:31.737522] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1352 records). [2025-09-14T20:51:31.739251] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-14T20:51:31.752706] [INFO ] [MAIN ] Derivative Progress: 415/2226 symbols completed. CHWY took 1.2s. Estimated remaining: 10m 39s. Rate: 170.0 symbols/min [2025-09-14T20:51:31.753730] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:31.753471] [DEBUG] [MAIN ] CIA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:31.757586] [INFO ] [MAIN ] CIA: Generated 1352 derivative records from 12924 primary records. [2025-09-14T20:51:31.757987] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-14T20:51:31.780518] [DEBUG] [MAIN ] CI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:31.784034] [DEBUG] [LOCAL ] CIA: Derivative data saved (1352 records). [2025-09-14T20:51:31.785269] [INFO ] [MAIN ] CI: Generated 1352 derivative records from 37661 primary records. [2025-09-14T20:51:31.785506] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-14T20:51:31.785687] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-14T20:51:31.789120] [INFO ] [MAIN ] Derivative Progress: 416/2226 symbols completed. CIA took 1.1s. Estimated remaining: 10m 38s. Rate: 170.3 symbols/min [2025-09-14T20:51:31.789674] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:31.809500] [DEBUG] [LOCAL ] CI: Derivative data saved (1352 records). [2025-09-14T20:51:31.809602] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-14T20:51:31.811967] [INFO ] [MAIN ] Derivative Progress: 417/2226 symbols completed. CI took 1.2s. Estimated remaining: 10m 36s. Rate: 170.7 symbols/min [2025-09-14T20:51:31.812331] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:31.824921] [DEBUG] [LOCAL ] CIB: Loaded 22339 existing records from primary storage. [2025-09-14T20:51:31.827837] [DEBUG] [LOCAL ] CIF: Loaded 2998 existing records from primary storage. [2025-09-14T20:51:31.828032] [INFO ] [MAIN ] CIF: Loaded 2998 primary data records. [2025-09-14T20:51:31.828115] [INFO ] [MAIN ] CIB: Loaded 22339 primary data records. [2025-09-14T20:51:32.155490] [DEBUG] [LOCAL ] CIEN: Loaded 39027 existing records from primary storage. [2025-09-14T20:51:32.186408] [INFO ] [MAIN ] CIEN: Loaded 39027 primary data records. [2025-09-14T20:51:32.752624] [DEBUG] [MAIN ] CIB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:32.753704] [INFO ] [MAIN ] CIB: Generated 1352 derivative records from 22339 primary records. [2025-09-14T20:51:32.753897] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-14T20:51:32.780887] [DEBUG] [LOCAL ] CIB: Derivative data saved (1352 records). [2025-09-14T20:51:32.781392] [DEBUG] [MAIN ] CIF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:32.781537] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-14T20:51:32.782507] [INFO ] [MAIN ] CIF: Generated 1352 derivative records from 2998 primary records. [2025-09-14T20:51:32.784567] [INFO ] [MAIN ] Derivative Progress: 418/2226 symbols completed. CIB took 1.0s. Estimated remaining: 10m 38s. Rate: 170.0 symbols/min [2025-09-14T20:51:32.784815] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-14T20:51:32.810531] [DEBUG] [MAIN ] CIEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:32.811249] [DEBUG] [LOCAL ] CIF: Derivative data saved (1352 records). [2025-09-14T20:51:32.812094] [INFO ] [MAIN ] CIEN: Generated 1352 derivative records from 39027 primary records. [2025-09-14T20:51:32.812411] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-14T20:51:32.812340] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-14T20:51:32.815232] [INFO ] [MAIN ] Derivative Progress: 419/2226 symbols completed. CIF took 1.0s. Estimated remaining: 10m 36s. Rate: 170.4 symbols/min [2025-09-14T20:51:32.827899] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1352 records). [2025-09-14T20:51:32.827988] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-14T20:51:32.830307] [INFO ] [MAIN ] Derivative Progress: 420/2226 symbols completed. CIEN took 1.0s. Estimated remaining: 10m 35s. Rate: 170.8 symbols/min [2025-09-14T20:51:32.831134] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:32.830963] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:32.831222] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:32.846048] [DEBUG] [LOCAL ] CII: Loaded 10502 existing records from primary storage. [2025-09-14T20:51:32.846270] [INFO ] [MAIN ] CII: Loaded 10502 primary data records. [2025-09-14T20:51:33.007259] [DEBUG] [LOCAL ] CIM: Loaded 27047 existing records from primary storage. [2025-09-14T20:51:33.012946] [DEBUG] [LOCAL ] CIG: Loaded 33103 existing records from primary storage. [2025-09-14T20:51:33.035893] [INFO ] [MAIN ] CIM: Loaded 27047 primary data records. [2025-09-14T20:51:33.075372] [INFO ] [MAIN ] CIG: Loaded 33103 primary data records. [2025-09-14T20:51:33.766439] [DEBUG] [MAIN ] CII: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:33.767505] [INFO ] [MAIN ] CII: Generated 1352 derivative records from 10502 primary records. [2025-09-14T20:51:33.768095] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-14T20:51:33.786797] [DEBUG] [LOCAL ] CII: Derivative data saved (1352 records). [2025-09-14T20:51:33.787405] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-14T20:51:33.789669] [INFO ] [MAIN ] Derivative Progress: 421/2226 symbols completed. CII took 1.0s. Estimated remaining: 10m 37s. Rate: 170.1 symbols/min [2025-09-14T20:51:33.789980] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:33.795227] [DEBUG] [LOCAL ] CIMN: Loaded 2000 existing records from primary storage. [2025-09-14T20:51:33.795862] [INFO ] [MAIN ] CIMN: Loaded 2000 primary data records. [2025-09-14T20:51:33.902338] [DEBUG] [MAIN ] CIG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:33.907937] [DEBUG] [MAIN ] CIM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:33.992159] [INFO ] [MAIN ] CIM: Generated 1352 derivative records from 27047 primary records. [2025-09-14T20:51:34.024540] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-14T20:51:33.925509] [INFO ] [MAIN ] CIG: Generated 1352 derivative records from 33103 primary records. [2025-09-14T20:51:34.057724] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-14T20:51:34.165180] [DEBUG] [LOCAL ] CIM: Derivative data saved (1352 records). [2025-09-14T20:51:34.169314] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-14T20:51:34.172420] [INFO ] [MAIN ] Derivative Progress: 422/2226 symbols completed. CIM took 1.3s. Estimated remaining: 10m 37s. Rate: 170.0 symbols/min [2025-09-14T20:51:34.174914] [INFO ] [MAIN ] CIMO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:34.178352] [DEBUG] [LOCAL ] CIG: Derivative data saved (1352 records). [2025-09-14T20:51:34.180688] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-14T20:51:34.183280] [DEBUG] [LOCAL ] CIMO: Loaded 2054 existing records from primary storage. [2025-09-14T20:51:34.186165] [INFO ] [MAIN ] Derivative Progress: 423/2226 symbols completed. CIG took 1.4s. Estimated remaining: 10m 35s. Rate: 170.4 symbols/min [2025-09-14T20:51:34.186286] [INFO ] [MAIN ] CIMO: Loaded 2054 primary data records. [2025-09-14T20:51:34.187492] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:34.310172] [DEBUG] [LOCAL ] CINT: Loaded 13273 existing records from primary storage. [2025-09-14T20:51:34.366171] [INFO ] [MAIN ] CINT: Loaded 13273 primary data records. [2025-09-14T20:51:34.565138] [DEBUG] [MAIN ] CIMN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:34.603391] [INFO ] [MAIN ] CIMN: Generated 1352 derivative records from 2000 primary records. [2025-09-14T20:51:34.603629] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-14T20:51:34.700744] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1352 records). [2025-09-14T20:51:34.790266] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-14T20:51:34.792792] [INFO ] [MAIN ] Derivative Progress: 424/2226 symbols completed. CIMN took 1.0s. Estimated remaining: 10m 35s. Rate: 170.1 symbols/min [2025-09-14T20:51:34.793256] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:34.820091] [DEBUG] [MAIN ] CIMO: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:51:34.821514] [INFO ] [MAIN ] CIMO: Generated 1351 derivative records from 2054 primary records. [2025-09-14T20:51:34.821764] [DEBUG] [LOCAL ] CIMO: Saving derivative data. [2025-09-14T20:51:34.836769] [DEBUG] [LOCAL ] CIO: Loaded 14685 existing records from primary storage. [2025-09-14T20:51:34.839324] [INFO ] [MAIN ] CIO: Loaded 14685 primary data records. [2025-09-14T20:51:34.840729] [DEBUG] [LOCAL ] CIMO: Derivative data saved (1351 records). [2025-09-14T20:51:34.873384] [INFO ] [MAIN ] CIMO: Successfully saved derivative data. [2025-09-14T20:51:34.960993] [DEBUG] [MAIN ] CINT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:34.922630] [INFO ] [MAIN ] Derivative Progress: 425/2226 symbols completed. CIMO took 0.7s. Estimated remaining: 10m 34s. Rate: 170.4 symbols/min [2025-09-14T20:51:34.972967] [INFO ] [MAIN ] CINT: Generated 1352 derivative records from 13273 primary records. [2025-09-14T20:51:34.978590] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-14T20:51:34.978399] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:35.149334] [DEBUG] [LOCAL ] CINT: Derivative data saved (1352 records). [2025-09-14T20:51:35.150361] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-14T20:51:35.153039] [INFO ] [MAIN ] Derivative Progress: 426/2226 symbols completed. CINT took 1.0s. Estimated remaining: 10m 33s. Rate: 170.5 symbols/min [2025-09-14T20:51:35.160881] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:35.173127] [DEBUG] [LOCAL ] CION: Loaded 20633 existing records from primary storage. [2025-09-14T20:51:35.173895] [INFO ] [MAIN ] CION: Loaded 20633 primary data records. [2025-09-14T20:51:35.368115] [DEBUG] [MAIN ] CIO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:35.397807] [INFO ] [MAIN ] CIO: Generated 1352 derivative records from 14685 primary records. [2025-09-14T20:51:35.400769] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-14T20:51:35.517918] [DEBUG] [LOCAL ] CIVI: Loaded 39579 existing records from primary storage. [2025-09-14T20:51:35.518937] [INFO ] [MAIN ] CIVI: Loaded 39579 primary data records. [2025-09-14T20:51:35.624093] [DEBUG] [LOCAL ] CIO: Derivative data saved (1352 records). [2025-09-14T20:51:35.652853] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-14T20:51:35.692865] [INFO ] [MAIN ] Derivative Progress: 427/2226 symbols completed. CIO took 0.9s. Estimated remaining: 10m 34s. Rate: 170.3 symbols/min [2025-09-14T20:51:35.722935] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:35.835599] [DEBUG] [MAIN ] CION: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:35.837935] [INFO ] [MAIN ] CION: Generated 1352 derivative records from 20633 primary records. [2025-09-14T20:51:35.840028] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-14T20:51:35.882089] [DEBUG] [MAIN ] CIVI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:35.885136] [INFO ] [MAIN ] CIVI: Generated 1352 derivative records from 39579 primary records. [2025-09-14T20:51:35.883495] [DEBUG] [LOCAL ] CION: Derivative data saved (1352 records). [2025-09-14T20:51:35.897259] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-14T20:51:35.897395] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-14T20:51:35.900167] [INFO ] [MAIN ] Derivative Progress: 428/2226 symbols completed. CION took 0.9s. Estimated remaining: 10m 33s. Rate: 170.5 symbols/min [2025-09-14T20:51:35.901690] [DEBUG] [LOCAL ] CL: Loaded 40389 existing records from primary storage. [2025-09-14T20:51:35.902577] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:35.908967] [INFO ] [MAIN ] CL: Loaded 40389 primary data records. [2025-09-14T20:51:35.947601] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1352 records). [2025-09-14T20:51:35.985740] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-14T20:51:36.024355] [INFO ] [MAIN ] Derivative Progress: 429/2226 symbols completed. CIVI took 0.9s. Estimated remaining: 10m 32s. Rate: 170.7 symbols/min [2025-09-14T20:51:36.056886] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:36.266153] [DEBUG] [LOCAL ] CLB: Loaded 24690 existing records from primary storage. [2025-09-14T20:51:36.266515] [INFO ] [MAIN ] CLB: Loaded 24690 primary data records. [2025-09-14T20:51:36.356897] [DEBUG] [LOCAL ] CLCO: Loaded 8144 existing records from primary storage. [2025-09-14T20:51:36.368044] [INFO ] [MAIN ] CLCO: Loaded 8144 primary data records. [2025-09-14T20:51:36.875329] [DEBUG] [MAIN ] CL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:36.878131] [INFO ] [MAIN ] CL: Generated 1352 derivative records from 40389 primary records. [2025-09-14T20:51:36.878511] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-14T20:51:36.900238] [DEBUG] [LOCAL ] CL: Derivative data saved (1352 records). [2025-09-14T20:51:36.901380] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-14T20:51:36.907469] [INFO ] [MAIN ] Derivative Progress: 430/2226 symbols completed. CL took 1.2s. Estimated remaining: 10m 33s. Rate: 170.1 symbols/min [2025-09-14T20:51:36.911399] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:36.933451] [DEBUG] [MAIN ] CLCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:36.935827] [INFO ] [MAIN ] CLCO: Generated 1352 derivative records from 8144 primary records. [2025-09-14T20:51:36.936005] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-14T20:51:36.934776] [DEBUG] [MAIN ] CLB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:36.938238] [INFO ] [MAIN ] CLB: Generated 1352 derivative records from 24690 primary records. [2025-09-14T20:51:36.948456] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-14T20:51:36.958960] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1352 records). [2025-09-14T20:51:36.974475] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-14T20:51:36.979440] [DEBUG] [LOCAL ] CLB: Derivative data saved (1352 records). [2025-09-14T20:51:36.981909] [INFO ] [MAIN ] Derivative Progress: 431/2226 symbols completed. CLCO took 0.9s. Estimated remaining: 10m 32s. Rate: 170.4 symbols/min [2025-09-14T20:51:36.982682] [DEBUG] [LOCAL ] CLDT: Loaded 18061 existing records from primary storage. [2025-09-14T20:51:36.983174] [INFO ] [MAIN ] CLDT: Loaded 18061 primary data records. [2025-09-14T20:51:36.983441] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:36.982922] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-14T20:51:36.985767] [INFO ] [MAIN ] Derivative Progress: 432/2226 symbols completed. CLB took 1.1s. Estimated remaining: 10m 30s. Rate: 170.8 symbols/min [2025-09-14T20:51:36.986083] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:37.220541] [DEBUG] [LOCAL ] CLH: Loaded 20164 existing records from primary storage. [2025-09-14T20:51:37.305524] [INFO ] [MAIN ] CLH: Loaded 20164 primary data records. [2025-09-14T20:51:37.432983] [DEBUG] [LOCAL ] CLF: Loaded 40482 existing records from primary storage. [2025-09-14T20:51:37.438018] [INFO ] [MAIN ] CLF: Loaded 40482 primary data records. [2025-09-14T20:51:37.909869] [DEBUG] [MAIN ] CLDT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:37.911803] [INFO ] [MAIN ] CLDT: Generated 1352 derivative records from 18061 primary records. [2025-09-14T20:51:37.912386] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-14T20:51:37.930227] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1352 records). [2025-09-14T20:51:37.931235] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-14T20:51:37.933850] [INFO ] [MAIN ] Derivative Progress: 433/2226 symbols completed. CLDT took 1.0s. Estimated remaining: 10m 32s. Rate: 170.2 symbols/min [2025-09-14T20:51:37.946408] [DEBUG] [MAIN ] CLH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:37.947468] [INFO ] [MAIN ] CLH: Generated 1352 derivative records from 20164 primary records. [2025-09-14T20:51:37.947765] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-14T20:51:37.973684] [DEBUG] [LOCAL ] CLH: Derivative data saved (1352 records). [2025-09-14T20:51:37.974030] [DEBUG] [MAIN ] CLF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:37.974252] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-14T20:51:37.975112] [INFO ] [MAIN ] CLF: Generated 1352 derivative records from 40482 primary records. [2025-09-14T20:51:37.977407] [INFO ] [MAIN ] Derivative Progress: 434/2226 symbols completed. CLH took 1.0s. Estimated remaining: 10m 31s. Rate: 170.5 symbols/min [2025-09-14T20:51:37.977660] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-14T20:51:37.990277] [DEBUG] [LOCAL ] CLF: Derivative data saved (1352 records). [2025-09-14T20:51:37.990366] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-14T20:51:37.992922] [INFO ] [MAIN ] Derivative Progress: 435/2226 symbols completed. CLF took 1.0s. Estimated remaining: 10m 29s. Rate: 170.9 symbols/min [2025-09-14T20:51:37.993535] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:37.993578] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:37.993697] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:38.005142] [DEBUG] [LOCAL ] CLPR: Loaded 7910 existing records from primary storage. [2025-09-14T20:51:38.005404] [INFO ] [MAIN ] CLPR: Loaded 7910 primary data records. [2025-09-14T20:51:38.240304] [DEBUG] [LOCAL ] CLVT: Loaded 39160 existing records from primary storage. [2025-09-14T20:51:38.241108] [DEBUG] [LOCAL ] CLS: Loaded 40398 existing records from primary storage. [2025-09-14T20:51:38.316927] [INFO ] [MAIN ] CLS: Loaded 40398 primary data records. [2025-09-14T20:51:38.317053] [INFO ] [MAIN ] CLVT: Loaded 39160 primary data records. [2025-09-14T20:51:38.983782] [DEBUG] [MAIN ] CLPR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:38.985685] [INFO ] [MAIN ] CLPR: Generated 1352 derivative records from 7910 primary records. [2025-09-14T20:51:38.986395] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-14T20:51:39.023483] [DEBUG] [MAIN ] CLS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:39.025150] [INFO ] [MAIN ] CLS: Generated 1352 derivative records from 40398 primary records. [2025-09-14T20:51:39.036220] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1352 records). [2025-09-14T20:51:39.036303] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-14T20:51:39.037711] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-14T20:51:39.037521] [DEBUG] [MAIN ] CLVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:39.042909] [INFO ] [MAIN ] CLVT: Generated 1352 derivative records from 39160 primary records. [2025-09-14T20:51:39.049931] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-14T20:51:39.041519] [INFO ] [MAIN ] Derivative Progress: 436/2226 symbols completed. CLPR took 1.0s. Estimated remaining: 10m 31s. Rate: 170.1 symbols/min [2025-09-14T20:51:39.053615] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:39.070681] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1352 records). [2025-09-14T20:51:39.071703] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-14T20:51:39.072232] [DEBUG] [LOCAL ] CLS: Derivative data saved (1352 records). [2025-09-14T20:51:39.074814] [INFO ] [MAIN ] Derivative Progress: 437/2226 symbols completed. CLVT took 1.1s. Estimated remaining: 10m 30s. Rate: 170.5 symbols/min [2025-09-14T20:51:39.075329] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-14T20:51:39.078366] [INFO ] [MAIN ] Derivative Progress: 438/2226 symbols completed. CLS took 1.1s. Estimated remaining: 10m 28s. Rate: 170.9 symbols/min [2025-09-14T20:51:39.078478] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:39.079108] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:39.099224] [DEBUG] [LOCAL ] CLW: Loaded 15967 existing records from primary storage. [2025-09-14T20:51:39.099498] [INFO ] [MAIN ] CLW: Loaded 15967 primary data records. [2025-09-14T20:51:39.343896] [DEBUG] [LOCAL ] CM: Loaded 36406 existing records from primary storage. [2025-09-14T20:51:39.344771] [DEBUG] [LOCAL ] CLX: Loaded 39046 existing records from primary storage. [2025-09-14T20:51:39.434305] [INFO ] [MAIN ] CM: Loaded 36406 primary data records. [2025-09-14T20:51:39.434570] [INFO ] [MAIN ] CLX: Loaded 39046 primary data records. [2025-09-14T20:51:40.053635] [DEBUG] [MAIN ] CLW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:40.054611] [INFO ] [MAIN ] CLW: Generated 1352 derivative records from 15967 primary records. [2025-09-14T20:51:40.058162] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-14T20:51:40.077883] [DEBUG] [LOCAL ] CLW: Derivative data saved (1352 records). [2025-09-14T20:51:40.080891] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-14T20:51:40.083163] [INFO ] [MAIN ] Derivative Progress: 439/2226 symbols completed. CLW took 1.0s. Estimated remaining: 10m 30s. Rate: 170.1 symbols/min [2025-09-14T20:51:40.084302] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:40.098316] [DEBUG] [MAIN ] CM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:40.099707] [INFO ] [MAIN ] CM: Generated 1352 derivative records from 36406 primary records. [2025-09-14T20:51:40.099981] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-14T20:51:40.118395] [DEBUG] [MAIN ] CLX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:40.122919] [INFO ] [MAIN ] CLX: Generated 1352 derivative records from 39046 primary records. [2025-09-14T20:51:40.123379] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-14T20:51:40.125903] [DEBUG] [LOCAL ] CM: Derivative data saved (1352 records). [2025-09-14T20:51:40.126277] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-14T20:51:40.135972] [INFO ] [MAIN ] Derivative Progress: 440/2226 symbols completed. CM took 1.1s. Estimated remaining: 10m 29s. Rate: 170.5 symbols/min [2025-09-14T20:51:40.146922] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:40.146777] [DEBUG] [LOCAL ] CLX: Derivative data saved (1352 records). [2025-09-14T20:51:40.147251] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-14T20:51:40.149842] [INFO ] [MAIN ] Derivative Progress: 441/2226 symbols completed. CLX took 1.1s. Estimated remaining: 10m 27s. Rate: 170.8 symbols/min [2025-09-14T20:51:40.150272] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:40.181826] [DEBUG] [LOCAL ] CMA: Loaded 37599 existing records from primary storage. [2025-09-14T20:51:40.182134] [INFO ] [MAIN ] CMA: Loaded 37599 primary data records. [2025-09-14T20:51:40.273665] [DEBUG] [LOCAL ] CMBT: Loaded 16797 existing records from primary storage. [2025-09-14T20:51:40.308507] [INFO ] [MAIN ] CMBT: Loaded 16797 primary data records. [2025-09-14T20:51:40.485576] [DEBUG] [LOCAL ] CMC: Loaded 33573 existing records from primary storage. [2025-09-14T20:51:40.560314] [INFO ] [MAIN ] CMC: Loaded 33573 primary data records. [2025-09-14T20:51:41.171786] [DEBUG] [MAIN ] CMA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:41.174353] [INFO ] [MAIN ] CMA: Generated 1352 derivative records from 37599 primary records. [2025-09-14T20:51:41.174529] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-14T20:51:41.200012] [DEBUG] [MAIN ] CMBT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:41.202292] [INFO ] [MAIN ] CMBT: Generated 1352 derivative records from 16797 primary records. [2025-09-14T20:51:41.203980] [DEBUG] [LOCAL ] CMA: Derivative data saved (1352 records). [2025-09-14T20:51:41.203363] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-14T20:51:41.205139] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-14T20:51:41.216772] [INFO ] [MAIN ] Derivative Progress: 442/2226 symbols completed. CMA took 1.1s. Estimated remaining: 10m 29s. Rate: 170.1 symbols/min [2025-09-14T20:51:41.219331] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:41.232432] [DEBUG] [MAIN ] CMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:41.234629] [INFO ] [MAIN ] CMC: Generated 1352 derivative records from 33573 primary records. [2025-09-14T20:51:41.235063] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-14T20:51:41.238616] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1352 records). [2025-09-14T20:51:41.241381] [DEBUG] [LOCAL ] CMCM: Loaded 3310 existing records from primary storage. [2025-09-14T20:51:41.247297] [INFO ] [MAIN ] CMCM: Loaded 3310 primary data records. [2025-09-14T20:51:41.247404] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-14T20:51:41.274123] [INFO ] [MAIN ] Derivative Progress: 443/2226 symbols completed. CMBT took 1.1s. Estimated remaining: 10m 28s. Rate: 170.4 symbols/min [2025-09-14T20:51:41.258707] [DEBUG] [LOCAL ] CMC: Derivative data saved (1352 records). [2025-09-14T20:51:41.312753] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-14T20:51:41.312448] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:41.356909] [INFO ] [MAIN ] Derivative Progress: 444/2226 symbols completed. CMC took 1.2s. Estimated remaining: 10m 26s. Rate: 170.7 symbols/min [2025-09-14T20:51:41.386092] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:41.584328] [DEBUG] [MAIN ] CMCM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:41.615975] [INFO ] [MAIN ] CMCM: Generated 1352 derivative records from 3310 primary records. [2025-09-14T20:51:41.618597] [DEBUG] [LOCAL ] CMI: Loaded 30752 existing records from primary storage. [2025-09-14T20:51:41.618803] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-14T20:51:41.620484] [INFO ] [MAIN ] CMI: Loaded 30752 primary data records. [2025-09-14T20:51:41.620395] [DEBUG] [LOCAL ] CMG: Loaded 40465 existing records from primary storage. [2025-09-14T20:51:41.622010] [INFO ] [MAIN ] CMG: Loaded 40465 primary data records. [2025-09-14T20:51:41.656380] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1352 records). [2025-09-14T20:51:41.715592] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-14T20:51:41.810086] [INFO ] [MAIN ] Derivative Progress: 445/2226 symbols completed. CMCM took 0.6s. Estimated remaining: 10m 27s. Rate: 170.6 symbols/min [2025-09-14T20:51:41.920678] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:42.256139] [DEBUG] [LOCAL ] CMP: Loaded 28011 existing records from primary storage. [2025-09-14T20:51:42.257973] [INFO ] [MAIN ] CMP: Loaded 28011 primary data records. [2025-09-14T20:51:42.402195] [DEBUG] [MAIN ] CMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:42.414929] [INFO ] [MAIN ] CMI: Generated 1352 derivative records from 30752 primary records. [2025-09-14T20:51:42.448067] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-14T20:51:42.600844] [DEBUG] [LOCAL ] CMI: Derivative data saved (1352 records). [2025-09-14T20:51:42.601146] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-14T20:51:42.603557] [INFO ] [MAIN ] Derivative Progress: 446/2226 symbols completed. CMI took 1.2s. Estimated remaining: 10m 28s. Rate: 170.1 symbols/min [2025-09-14T20:51:42.607312] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:42.623130] [DEBUG] [MAIN ] CMG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:42.624451] [INFO ] [MAIN ] CMG: Generated 1352 derivative records from 40465 primary records. [2025-09-14T20:51:42.624605] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-14T20:51:42.640391] [DEBUG] [LOCAL ] CMG: Derivative data saved (1352 records). [2025-09-14T20:51:42.649166] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-14T20:51:42.651742] [INFO ] [MAIN ] Derivative Progress: 447/2226 symbols completed. CMG took 1.3s. Estimated remaining: 10m 26s. Rate: 170.4 symbols/min [2025-09-14T20:51:42.652224] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:42.676710] [DEBUG] [MAIN ] CMP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:42.677515] [DEBUG] [LOCAL ] CMRE: Loaded 26592 existing records from primary storage. [2025-09-14T20:51:42.678628] [INFO ] [MAIN ] CMP: Generated 1352 derivative records from 28011 primary records. [2025-09-14T20:51:42.678805] [INFO ] [MAIN ] CMRE: Loaded 26592 primary data records. [2025-09-14T20:51:42.679283] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-14T20:51:42.816358] [DEBUG] [LOCAL ] CMP: Derivative data saved (1352 records). [2025-09-14T20:51:42.843123] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-14T20:51:42.905340] [INFO ] [MAIN ] Derivative Progress: 448/2226 symbols completed. CMP took 1.0s. Estimated remaining: 10m 26s. Rate: 170.5 symbols/min [2025-09-14T20:51:42.914776] [DEBUG] [LOCAL ] CMS: Loaded 39684 existing records from primary storage. [2025-09-14T20:51:42.980725] [INFO ] [MAIN ] CMS: Loaded 39684 primary data records. [2025-09-14T20:51:43.330399] [DEBUG] [MAIN ] CMRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:43.332157] [INFO ] [MAIN ] CMRE: Generated 1352 derivative records from 26592 primary records. [2025-09-14T20:51:43.332258] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-14T20:51:43.348248] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1352 records). [2025-09-14T20:51:43.348469] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-14T20:51:43.350801] [INFO ] [MAIN ] Derivative Progress: 449/2226 symbols completed. CMRE took 0.7s. Estimated remaining: 10m 26s. Rate: 170.4 symbols/min [2025-09-14T20:51:43.364608] [DEBUG] [MAIN ] CMS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:43.365384] [INFO ] [MAIN ] CMS: Generated 1352 derivative records from 39684 primary records. [2025-09-14T20:51:43.365468] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-14T20:51:43.377631] [DEBUG] [LOCAL ] CMS: Derivative data saved (1352 records). [2025-09-14T20:51:43.377760] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-14T20:51:43.379824] [INFO ] [MAIN ] Derivative Progress: 450/2226 symbols completed. CMS took 0.7s. Estimated remaining: 10m 24s. Rate: 170.8 symbols/min [2025-09-14T20:51:43.381052] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:43.380832] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:43.381323] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:43.395090] [DEBUG] [LOCAL ] CMSC: Loaded 3570 existing records from primary storage. [2025-09-14T20:51:43.391568] [DEBUG] [LOCAL ] CMSA: Loaded 2560 existing records from primary storage. [2025-09-14T20:51:43.395378] [INFO ] [MAIN ] CMSA: Loaded 2560 primary data records. [2025-09-14T20:51:43.399095] [DEBUG] [LOCAL ] CMSD: Loaded 5819 existing records from primary storage. [2025-09-14T20:51:43.395421] [INFO ] [MAIN ] CMSC: Loaded 3570 primary data records. [2025-09-14T20:51:43.452458] [INFO ] [MAIN ] CMSD: Loaded 5819 primary data records. [2025-09-14T20:51:44.364185] [DEBUG] [MAIN ] CMSC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:44.375361] [INFO ] [MAIN ] CMSC: Generated 1352 derivative records from 3570 primary records. [2025-09-14T20:51:44.376059] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-14T20:51:44.376398] [DEBUG] [MAIN ] CMSA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:44.391502] [INFO ] [MAIN ] CMSA: Generated 1352 derivative records from 2560 primary records. [2025-09-14T20:51:44.398011] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-14T20:51:44.397875] [DEBUG] [MAIN ] CMSD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:44.403625] [INFO ] [MAIN ] CMSD: Generated 1352 derivative records from 5819 primary records. [2025-09-14T20:51:44.406866] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1352 records). [2025-09-14T20:51:44.412454] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-14T20:51:44.420068] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1352 records). [2025-09-14T20:51:44.420394] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-14T20:51:44.433179] [INFO ] [MAIN ] Derivative Progress: 451/2226 symbols completed. CMSC took 1.1s. Estimated remaining: 10m 26s. Rate: 170.0 symbols/min [2025-09-14T20:51:44.431050] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-14T20:51:44.434314] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1352 records). [2025-09-14T20:51:44.434559] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:44.438230] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-14T20:51:44.438017] [INFO ] [MAIN ] Derivative Progress: 452/2226 symbols completed. CMSA took 1.1s. Estimated remaining: 10m 25s. Rate: 170.4 symbols/min [2025-09-14T20:51:44.441386] [INFO ] [MAIN ] Derivative Progress: 453/2226 symbols completed. CMSD took 1.1s. Estimated remaining: 10m 23s. Rate: 170.8 symbols/min [2025-09-14T20:51:44.441318] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:44.441973] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:44.453166] [DEBUG] [LOCAL ] CMU: Loaded 4747 existing records from primary storage. [2025-09-14T20:51:44.453447] [INFO ] [MAIN ] CMU: Loaded 4747 primary data records. [2025-09-14T20:51:44.634869] [DEBUG] [LOCAL ] CMTG: Loaded 27084 existing records from primary storage. [2025-09-14T20:51:44.653568] [INFO ] [MAIN ] CMTG: Loaded 27084 primary data records. [2025-09-14T20:51:44.772758] [DEBUG] [LOCAL ] CNA: Loaded 24776 existing records from primary storage. [2025-09-14T20:51:44.807109] [INFO ] [MAIN ] CNA: Loaded 24776 primary data records. [2025-09-14T20:51:45.357663] [DEBUG] [MAIN ] CMU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:45.360782] [INFO ] [MAIN ] CMU: Generated 1352 derivative records from 4747 primary records. [2025-09-14T20:51:45.361341] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-14T20:51:45.380142] [DEBUG] [LOCAL ] CMU: Derivative data saved (1352 records). [2025-09-14T20:51:45.382050] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-14T20:51:45.384506] [INFO ] [MAIN ] Derivative Progress: 454/2226 symbols completed. CMU took 0.9s. Estimated remaining: 10m 25s. Rate: 170.1 symbols/min [2025-09-14T20:51:45.395763] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:45.395563] [DEBUG] [MAIN ] CMTG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:45.396611] [INFO ] [MAIN ] CMTG: Generated 1352 derivative records from 27084 primary records. [2025-09-14T20:51:45.397122] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-14T20:51:45.412778] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1352 records). [2025-09-14T20:51:45.413311] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-14T20:51:45.415506] [INFO ] [MAIN ] Derivative Progress: 455/2226 symbols completed. CMTG took 1.0s. Estimated remaining: 10m 23s. Rate: 170.5 symbols/min [2025-09-14T20:51:45.415938] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:45.426172] [DEBUG] [MAIN ] CNA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:45.427197] [INFO ] [MAIN ] CNA: Generated 1352 derivative records from 24776 primary records. [2025-09-14T20:51:45.427469] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-14T20:51:45.445140] [DEBUG] [LOCAL ] CNA: Derivative data saved (1352 records). [2025-09-14T20:51:45.445358] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-14T20:51:45.447210] [INFO ] [MAIN ] Derivative Progress: 456/2226 symbols completed. CNA took 1.0s. Estimated remaining: 10m 22s. Rate: 170.8 symbols/min [2025-09-14T20:51:45.447860] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:45.461743] [DEBUG] [LOCAL ] CNF: Loaded 8737 existing records from primary storage. [2025-09-14T20:51:45.462109] [INFO ] [MAIN ] CNF: Loaded 8737 primary data records. [2025-09-14T20:51:45.593595] [DEBUG] [LOCAL ] CNC: Loaded 40524 existing records from primary storage. [2025-09-14T20:51:45.665326] [INFO ] [MAIN ] CNC: Loaded 40524 primary data records. [2025-09-14T20:51:45.896884] [DEBUG] [LOCAL ] CNH: Loaded 40307 existing records from primary storage. [2025-09-14T20:51:45.897423] [INFO ] [MAIN ] CNH: Loaded 40307 primary data records. [2025-09-14T20:51:46.364920] [DEBUG] [MAIN ] CNF: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:51:46.366256] [INFO ] [MAIN ] CNF: Generated 1351 derivative records from 8737 primary records. [2025-09-14T20:51:46.366360] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-14T20:51:46.476170] [DEBUG] [LOCAL ] CNF: Derivative data saved (1351 records). [2025-09-14T20:51:46.477201] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-14T20:51:46.480242] [INFO ] [MAIN ] Derivative Progress: 457/2226 symbols completed. CNF took 1.1s. Estimated remaining: 10m 24s. Rate: 170.1 symbols/min [2025-09-14T20:51:46.482727] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:46.496479] [DEBUG] [MAIN ] CNC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:46.498308] [INFO ] [MAIN ] CNC: Generated 1352 derivative records from 40524 primary records. [2025-09-14T20:51:46.498428] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-14T20:51:46.514167] [DEBUG] [LOCAL ] CNC: Derivative data saved (1352 records). [2025-09-14T20:51:46.514724] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-14T20:51:46.517777] [INFO ] [MAIN ] Derivative Progress: 458/2226 symbols completed. CNC took 1.1s. Estimated remaining: 10m 22s. Rate: 170.4 symbols/min [2025-09-14T20:51:46.518615] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:46.534271] [DEBUG] [MAIN ] CNH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:46.535082] [INFO ] [MAIN ] CNH: Generated 1352 derivative records from 40307 primary records. [2025-09-14T20:51:46.535165] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-14T20:51:46.561600] [DEBUG] [LOCAL ] CNH: Derivative data saved (1352 records). [2025-09-14T20:51:46.561996] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-14T20:51:46.563991] [INFO ] [MAIN ] Derivative Progress: 459/2226 symbols completed. CNH took 1.1s. Estimated remaining: 10m 21s. Rate: 170.7 symbols/min [2025-09-14T20:51:46.564475] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:46.582218] [DEBUG] [LOCAL ] CNI: Loaded 38895 existing records from primary storage. [2025-09-14T20:51:46.582468] [INFO ] [MAIN ] CNI: Loaded 38895 primary data records. [2025-09-14T20:51:46.754951] [DEBUG] [LOCAL ] CNK: Loaded 39750 existing records from primary storage. [2025-09-14T20:51:46.779707] [INFO ] [MAIN ] CNK: Loaded 39750 primary data records. [2025-09-14T20:51:46.866587] [DEBUG] [LOCAL ] CNM: Loaded 38006 existing records from primary storage. [2025-09-14T20:51:46.991079] [INFO ] [MAIN ] CNM: Loaded 38006 primary data records. [2025-09-14T20:51:47.526486] [DEBUG] [MAIN ] CNI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:47.528279] [INFO ] [MAIN ] CNI: Generated 1352 derivative records from 38895 primary records. [2025-09-14T20:51:47.528672] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-14T20:51:47.548138] [DEBUG] [LOCAL ] CNI: Derivative data saved (1352 records). [2025-09-14T20:51:47.548321] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-14T20:51:47.551439] [INFO ] [MAIN ] Derivative Progress: 460/2226 symbols completed. CNI took 1.1s. Estimated remaining: 10m 23s. Rate: 170.1 symbols/min [2025-09-14T20:51:47.563710] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:47.564396] [DEBUG] [MAIN ] CNK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:47.566333] [INFO ] [MAIN ] CNK: Generated 1352 derivative records from 39750 primary records. [2025-09-14T20:51:47.566522] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-14T20:51:47.599962] [DEBUG] [MAIN ] CNM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:47.601691] [DEBUG] [LOCAL ] CNK: Derivative data saved (1352 records). [2025-09-14T20:51:47.602664] [INFO ] [MAIN ] CNM: Generated 1352 derivative records from 38006 primary records. [2025-09-14T20:51:47.602778] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-14T20:51:47.609852] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-14T20:51:47.614118] [INFO ] [MAIN ] Derivative Progress: 461/2226 symbols completed. CNK took 1.1s. Estimated remaining: 10m 22s. Rate: 170.4 symbols/min [2025-09-14T20:51:47.622818] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:47.642229] [DEBUG] [LOCAL ] CNM: Derivative data saved (1352 records). [2025-09-14T20:51:47.642564] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-14T20:51:47.645388] [INFO ] [MAIN ] Derivative Progress: 462/2226 symbols completed. CNM took 1.1s. Estimated remaining: 10m 20s. Rate: 170.7 symbols/min [2025-09-14T20:51:47.645926] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:47.643338] [DEBUG] [LOCAL ] CNMD: Loaded 23985 existing records from primary storage. [2025-09-14T20:51:47.646603] [INFO ] [MAIN ] CNMD: Loaded 23985 primary data records. [2025-09-14T20:51:47.860912] [DEBUG] [LOCAL ] CNNE: Loaded 26922 existing records from primary storage. [2025-09-14T20:51:47.897423] [INFO ] [MAIN ] CNNE: Loaded 26922 primary data records. [2025-09-14T20:51:48.089251] [DEBUG] [LOCAL ] CNO: Loaded 30210 existing records from primary storage. [2025-09-14T20:51:48.129978] [INFO ] [MAIN ] CNO: Loaded 30210 primary data records. [2025-09-14T20:51:48.930998] [DEBUG] [MAIN ] CNMD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:48.932666] [INFO ] [MAIN ] CNMD: Generated 1352 derivative records from 23985 primary records. [2025-09-14T20:51:48.932785] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-14T20:51:48.950779] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1352 records). [2025-09-14T20:51:48.951750] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-14T20:51:48.954421] [INFO ] [MAIN ] Derivative Progress: 463/2226 symbols completed. CNMD took 1.4s. Estimated remaining: 10m 23s. Rate: 169.7 symbols/min [2025-09-14T20:51:48.971336] [DEBUG] [MAIN ] CNNE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:48.972254] [INFO ] [MAIN ] CNNE: Generated 1352 derivative records from 26922 primary records. [2025-09-14T20:51:48.972476] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-14T20:51:48.989077] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1352 records). [2025-09-14T20:51:48.989432] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-14T20:51:48.991984] [INFO ] [MAIN ] Derivative Progress: 464/2226 symbols completed. CNNE took 1.4s. Estimated remaining: 10m 22s. Rate: 170.0 symbols/min [2025-09-14T20:51:49.009195] [DEBUG] [MAIN ] CNO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:49.010528] [INFO ] [MAIN ] CNO: Generated 1352 derivative records from 30210 primary records. [2025-09-14T20:51:49.010634] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-14T20:51:49.028447] [DEBUG] [LOCAL ] CNO: Derivative data saved (1352 records). [2025-09-14T20:51:49.028620] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-14T20:51:49.030722] [INFO ] [MAIN ] Derivative Progress: 465/2226 symbols completed. CNO took 1.4s. Estimated remaining: 10m 20s. Rate: 170.4 symbols/min [2025-09-14T20:51:49.031365] [INFO ] [MAIN ] CNR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:49.031833] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:49.031433] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:49.093497] [DEBUG] [LOCAL ] CNR: Loaded 32616 existing records from primary storage. [2025-09-14T20:51:49.094362] [INFO ] [MAIN ] CNR: Loaded 32616 primary data records. [2025-09-14T20:51:49.162550] [DEBUG] [LOCAL ] CNQ: Loaded 40333 existing records from primary storage. [2025-09-14T20:51:49.196435] [INFO ] [MAIN ] CNQ: Loaded 40333 primary data records. [2025-09-14T20:51:49.279574] [DEBUG] [LOCAL ] CNP: Loaded 40238 existing records from primary storage. [2025-09-14T20:51:49.346905] [INFO ] [MAIN ] CNP: Loaded 40238 primary data records. [2025-09-14T20:51:50.009916] [DEBUG] [MAIN ] CNR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:50.013569] [INFO ] [MAIN ] CNR: Generated 1352 derivative records from 32616 primary records. [2025-09-14T20:51:50.016982] [DEBUG] [LOCAL ] CNR: Saving derivative data. [2025-09-14T20:51:50.027892] [DEBUG] [MAIN ] CNQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:50.030425] [INFO ] [MAIN ] CNQ: Generated 1352 derivative records from 40333 primary records. [2025-09-14T20:51:50.039564] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-14T20:51:50.051748] [DEBUG] [LOCAL ] CNR: Derivative data saved (1352 records). [2025-09-14T20:51:50.056923] [INFO ] [MAIN ] CNR: Successfully saved derivative data. [2025-09-14T20:51:50.061778] [INFO ] [MAIN ] Derivative Progress: 466/2226 symbols completed. CNR took 1.0s. Estimated remaining: 10m 22s. Rate: 169.7 symbols/min [2025-09-14T20:51:50.072494] [DEBUG] [MAIN ] CNP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:50.072970] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1352 records). [2025-09-14T20:51:50.073876] [INFO ] [MAIN ] CNP: Generated 1352 derivative records from 40238 primary records. [2025-09-14T20:51:50.074216] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:50.074308] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-14T20:51:50.074599] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-14T20:51:50.078799] [INFO ] [MAIN ] Derivative Progress: 467/2226 symbols completed. CNQ took 1.0s. Estimated remaining: 10m 21s. Rate: 170.0 symbols/min [2025-09-14T20:51:50.085660] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:50.092312] [DEBUG] [LOCAL ] CNP: Derivative data saved (1352 records). [2025-09-14T20:51:50.093043] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-14T20:51:50.095362] [INFO ] [MAIN ] Derivative Progress: 468/2226 symbols completed. CNP took 1.1s. Estimated remaining: 10m 19s. Rate: 170.4 symbols/min [2025-09-14T20:51:50.096302] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:50.115773] [DEBUG] [LOCAL ] CNS: Loaded 14962 existing records from primary storage. [2025-09-14T20:51:50.115994] [INFO ] [MAIN ] CNS: Loaded 14962 primary data records. [2025-09-14T20:51:50.325008] [DEBUG] [LOCAL ] CODI: Loaded 31566 existing records from primary storage. [2025-09-14T20:51:50.343516] [INFO ] [MAIN ] CODI: Loaded 31566 primary data records. [2025-09-14T20:51:50.344858] [DEBUG] [LOCAL ] CNX: Loaded 38562 existing records from primary storage. [2025-09-14T20:51:50.441504] [INFO ] [MAIN ] CNX: Loaded 38562 primary data records. [2025-09-14T20:51:51.014423] [DEBUG] [MAIN ] CNS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:51.016749] [INFO ] [MAIN ] CNS: Generated 1352 derivative records from 14962 primary records. [2025-09-14T20:51:51.017173] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-14T20:51:51.032405] [DEBUG] [LOCAL ] CNS: Derivative data saved (1352 records). [2025-09-14T20:51:51.033107] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-14T20:51:51.035712] [INFO ] [MAIN ] Derivative Progress: 469/2226 symbols completed. CNS took 1.0s. Estimated remaining: 10m 21s. Rate: 169.8 symbols/min [2025-09-14T20:51:51.036543] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:51.056422] [DEBUG] [MAIN ] CODI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:51.057821] [INFO ] [MAIN ] CODI: Generated 1352 derivative records from 31566 primary records. [2025-09-14T20:51:51.058491] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-14T20:51:51.078683] [DEBUG] [LOCAL ] CODI: Derivative data saved (1352 records). [2025-09-14T20:51:51.089173] [DEBUG] [MAIN ] CNX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:51.089247] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-14T20:51:51.092506] [INFO ] [MAIN ] CNX: Generated 1352 derivative records from 38562 primary records. [2025-09-14T20:51:51.091679] [INFO ] [MAIN ] Derivative Progress: 470/2226 symbols completed. CODI took 1.0s. Estimated remaining: 10m 20s. Rate: 170.1 symbols/min [2025-09-14T20:51:51.092696] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-14T20:51:51.093005] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:51.118653] [DEBUG] [LOCAL ] CNX: Derivative data saved (1352 records). [2025-09-14T20:51:51.118859] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-14T20:51:51.121158] [INFO ] [MAIN ] Derivative Progress: 471/2226 symbols completed. CNX took 1.0s. Estimated remaining: 10m 18s. Rate: 170.4 symbols/min [2025-09-14T20:51:51.121734] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:51.141930] [DEBUG] [LOCAL ] COF: Loaded 40371 existing records from primary storage. [2025-09-14T20:51:51.142550] [INFO ] [MAIN ] COF: Loaded 40371 primary data records. [2025-09-14T20:51:51.376330] [DEBUG] [LOCAL ] COHR: Loaded 40158 existing records from primary storage. [2025-09-14T20:51:51.376495] [DEBUG] [LOCAL ] COLD: Loaded 39316 existing records from primary storage. [2025-09-14T20:51:51.453147] [INFO ] [MAIN ] COHR: Loaded 40158 primary data records. [2025-09-14T20:51:51.528757] [INFO ] [MAIN ] COLD: Loaded 39316 primary data records. [2025-09-14T20:51:52.138236] [DEBUG] [MAIN ] COF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:52.140600] [INFO ] [MAIN ] COF: Generated 1352 derivative records from 40371 primary records. [2025-09-14T20:51:52.141054] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-14T20:51:52.157868] [DEBUG] [LOCAL ] COF: Derivative data saved (1352 records). [2025-09-14T20:51:52.158291] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-14T20:51:52.160748] [INFO ] [MAIN ] Derivative Progress: 472/2226 symbols completed. COF took 1.1s. Estimated remaining: 10m 20s. Rate: 169.7 symbols/min [2025-09-14T20:51:52.161617] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:52.181395] [DEBUG] [MAIN ] COHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:52.193154] [INFO ] [MAIN ] COHR: Generated 1352 derivative records from 40158 primary records. [2025-09-14T20:51:52.193604] [DEBUG] [MAIN ] COLD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:52.193891] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-14T20:51:52.194772] [INFO ] [MAIN ] COLD: Generated 1352 derivative records from 39316 primary records. [2025-09-14T20:51:52.195854] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-14T20:51:52.209919] [DEBUG] [LOCAL ] COHR: Derivative data saved (1352 records). [2025-09-14T20:51:52.225582] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-14T20:51:52.231474] [DEBUG] [LOCAL ] COLD: Derivative data saved (1352 records). [2025-09-14T20:51:52.231699] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-14T20:51:52.233954] [INFO ] [MAIN ] Derivative Progress: 473/2226 symbols completed. COHR took 1.1s. Estimated remaining: 10m 19s. Rate: 170.0 symbols/min [2025-09-14T20:51:52.237296] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:52.237185] [INFO ] [MAIN ] Derivative Progress: 474/2226 symbols completed. COLD took 1.1s. Estimated remaining: 10m 17s. Rate: 170.3 symbols/min [2025-09-14T20:51:52.238402] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:52.253556] [DEBUG] [LOCAL ] COMP: Loaded 40161 existing records from primary storage. [2025-09-14T20:51:52.254169] [INFO ] [MAIN ] COMP: Loaded 40161 primary data records. [2025-09-14T20:51:52.390898] [DEBUG] [LOCAL ] COOK: Loaded 18711 existing records from primary storage. [2025-09-14T20:51:52.451286] [INFO ] [MAIN ] COOK: Loaded 18711 primary data records. [2025-09-14T20:51:52.472482] [DEBUG] [LOCAL ] CON: Loaded 28932 existing records from primary storage. [2025-09-14T20:51:52.574349] [INFO ] [MAIN ] CON: Loaded 28932 primary data records. [2025-09-14T20:51:53.183394] [DEBUG] [MAIN ] COMP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:53.184764] [INFO ] [MAIN ] COMP: Generated 1352 derivative records from 40161 primary records. [2025-09-14T20:51:53.185222] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-14T20:51:53.201795] [DEBUG] [LOCAL ] COMP: Derivative data saved (1352 records). [2025-09-14T20:51:53.202866] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-14T20:51:53.213689] [DEBUG] [MAIN ] COOK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:53.217683] [INFO ] [MAIN ] COOK: Generated 1352 derivative records from 18711 primary records. [2025-09-14T20:51:53.217805] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-14T20:51:53.216452] [INFO ] [MAIN ] Derivative Progress: 475/2226 symbols completed. COMP took 1.1s. Estimated remaining: 10m 19s. Rate: 169.7 symbols/min [2025-09-14T20:51:53.231220] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:53.244550] [DEBUG] [MAIN ] CON: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:51:53.244281] [DEBUG] [LOCAL ] COOK: Derivative data saved (1352 records). [2025-09-14T20:51:53.246112] [INFO ] [MAIN ] CON: Generated 1351 derivative records from 28932 primary records. [2025-09-14T20:51:53.245329] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-14T20:51:53.249779] [INFO ] [MAIN ] Derivative Progress: 476/2226 symbols completed. COOK took 1.0s. Estimated remaining: 10m 18s. Rate: 170.0 symbols/min [2025-09-14T20:51:53.251123] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-14T20:51:53.252754] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:53.267416] [DEBUG] [LOCAL ] CON: Derivative data saved (1351 records). [2025-09-14T20:51:53.267614] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-14T20:51:53.269411] [INFO ] [MAIN ] Derivative Progress: 477/2226 symbols completed. CON took 1.0s. Estimated remaining: 10m 16s. Rate: 170.4 symbols/min [2025-09-14T20:51:53.269775] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:53.355421] [DEBUG] [LOCAL ] COP: Loaded 40467 existing records from primary storage. [2025-09-14T20:51:53.355820] [INFO ] [MAIN ] COP: Loaded 40467 primary data records. [2025-09-14T20:51:53.485176] [DEBUG] [LOCAL ] COR: Loaded 34959 existing records from primary storage. [2025-09-14T20:51:53.522509] [INFO ] [MAIN ] COR: Loaded 34959 primary data records. [2025-09-14T20:51:53.573863] [DEBUG] [LOCAL ] COTY: Loaded 40116 existing records from primary storage. [2025-09-14T20:51:53.719600] [INFO ] [MAIN ] COTY: Loaded 40116 primary data records. [2025-09-14T20:51:54.310458] [DEBUG] [MAIN ] COP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:54.311600] [INFO ] [MAIN ] COP: Generated 1352 derivative records from 40467 primary records. [2025-09-14T20:51:54.311955] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-14T20:51:54.329107] [DEBUG] [LOCAL ] COP: Derivative data saved (1352 records). [2025-09-14T20:51:54.329929] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-14T20:51:54.332482] [INFO ] [MAIN ] Derivative Progress: 478/2226 symbols completed. COP took 1.1s. Estimated remaining: 10m 18s. Rate: 169.6 symbols/min [2025-09-14T20:51:54.349939] [DEBUG] [MAIN ] COTY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:54.360584] [INFO ] [MAIN ] COTY: Generated 1352 derivative records from 40116 primary records. [2025-09-14T20:51:54.361096] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-14T20:51:54.360949] [DEBUG] [MAIN ] COR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:54.362774] [INFO ] [MAIN ] COR: Generated 1352 derivative records from 34959 primary records. [2025-09-14T20:51:54.363162] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-14T20:51:54.387967] [DEBUG] [LOCAL ] COTY: Derivative data saved (1352 records). [2025-09-14T20:51:54.388058] [DEBUG] [LOCAL ] COR: Derivative data saved (1352 records). [2025-09-14T20:51:54.388345] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-14T20:51:54.390540] [INFO ] [MAIN ] Derivative Progress: 479/2226 symbols completed. COTY took 1.1s. Estimated remaining: 10m 17s. Rate: 169.9 symbols/min [2025-09-14T20:51:54.390700] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-14T20:51:54.393902] [INFO ] [MAIN ] Derivative Progress: 480/2226 symbols completed. COR took 1.1s. Estimated remaining: 10m 15s. Rate: 170.3 symbols/min [2025-09-14T20:51:54.394960] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:54.395340] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:54.395280] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:54.437855] [DEBUG] [LOCAL ] CPA: Loaded 21487 existing records from primary storage. [2025-09-14T20:51:54.438171] [INFO ] [MAIN ] CPA: Loaded 21487 primary data records. [2025-09-14T20:51:54.505807] [DEBUG] [LOCAL ] COUR: Loaded 36989 existing records from primary storage. [2025-09-14T20:51:54.539328] [INFO ] [MAIN ] COUR: Loaded 36989 primary data records. [2025-09-14T20:51:54.736555] [DEBUG] [LOCAL ] CP: Loaded 40048 existing records from primary storage. [2025-09-14T20:51:54.785694] [INFO ] [MAIN ] CP: Loaded 40048 primary data records. [2025-09-14T20:51:55.396628] [DEBUG] [MAIN ] CPA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:55.398135] [INFO ] [MAIN ] CPA: Generated 1352 derivative records from 21487 primary records. [2025-09-14T20:51:55.398264] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-14T20:51:55.428863] [DEBUG] [MAIN ] COUR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:55.430392] [INFO ] [MAIN ] COUR: Generated 1352 derivative records from 36989 primary records. [2025-09-14T20:51:55.431620] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-14T20:51:55.448892] [DEBUG] [LOCAL ] COUR: Derivative data saved (1352 records). [2025-09-14T20:51:55.449395] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-14T20:51:55.452226] [INFO ] [MAIN ] Derivative Progress: 481/2226 symbols completed. COUR took 1.1s. Estimated remaining: 10m 17s. Rate: 169.6 symbols/min [2025-09-14T20:51:55.449088] [DEBUG] [LOCAL ] CPA: Derivative data saved (1352 records). [2025-09-14T20:51:55.453075] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-14T20:51:55.453692] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:55.455836] [INFO ] [MAIN ] Derivative Progress: 482/2226 symbols completed. CPA took 1.1s. Estimated remaining: 10m 16s. Rate: 169.9 symbols/min [2025-09-14T20:51:55.456999] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:55.472401] [DEBUG] [MAIN ] CP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:55.474441] [INFO ] [MAIN ] CP: Generated 1352 derivative records from 40048 primary records. [2025-09-14T20:51:55.474734] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-14T20:51:55.508626] [DEBUG] [LOCAL ] CPF: Loaded 11023 existing records from primary storage. [2025-09-14T20:51:55.509275] [DEBUG] [LOCAL ] CP: Derivative data saved (1352 records). [2025-09-14T20:51:55.509430] [INFO ] [MAIN ] CPF: Loaded 11023 primary data records. [2025-09-14T20:51:55.509554] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-14T20:51:55.545594] [INFO ] [MAIN ] Derivative Progress: 483/2226 symbols completed. CP took 1.2s. Estimated remaining: 10m 14s. Rate: 170.2 symbols/min [2025-09-14T20:51:55.604968] [DEBUG] [LOCAL ] CPAY: Loaded 22765 existing records from primary storage. [2025-09-14T20:51:55.598674] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:55.633320] [INFO ] [MAIN ] CPAY: Loaded 22765 primary data records. [2025-09-14T20:51:55.808221] [DEBUG] [LOCAL ] CPK: Loaded 9467 existing records from primary storage. [2025-09-14T20:51:55.918178] [INFO ] [MAIN ] CPK: Loaded 9467 primary data records. [2025-09-14T20:51:56.467086] [DEBUG] [MAIN ] CPF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:56.468241] [INFO ] [MAIN ] CPF: Generated 1352 derivative records from 11023 primary records. [2025-09-14T20:51:56.468961] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-14T20:51:56.502120] [DEBUG] [MAIN ] CPAY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:56.504631] [DEBUG] [LOCAL ] CPF: Derivative data saved (1352 records). [2025-09-14T20:51:56.506543] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-14T20:51:56.508579] [INFO ] [MAIN ] Derivative Progress: 484/2226 symbols completed. CPF took 1.1s. Estimated remaining: 10m 16s. Rate: 169.6 symbols/min [2025-09-14T20:51:56.506194] [INFO ] [MAIN ] CPAY: Generated 1352 derivative records from 22765 primary records. [2025-09-14T20:51:56.509011] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-14T20:51:56.508885] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:56.528324] [DEBUG] [MAIN ] CPK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:56.534468] [INFO ] [MAIN ] CPK: Generated 1352 derivative records from 9467 primary records. [2025-09-14T20:51:56.534652] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-14T20:51:56.538233] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1352 records). [2025-09-14T20:51:56.546383] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-14T20:51:56.549922] [INFO ] [MAIN ] Derivative Progress: 485/2226 symbols completed. CPAY took 1.1s. Estimated remaining: 10m 15s. Rate: 169.9 symbols/min [2025-09-14T20:51:56.551011] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:56.552314] [DEBUG] [LOCAL ] CPK: Derivative data saved (1352 records). [2025-09-14T20:51:56.553004] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-14T20:51:56.572087] [INFO ] [MAIN ] Derivative Progress: 486/2226 symbols completed. CPK took 1.0s. Estimated remaining: 10m 13s. Rate: 170.2 symbols/min [2025-09-14T20:51:56.572710] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:56.628233] [DEBUG] [LOCAL ] CPS: Loaded 18945 existing records from primary storage. [2025-09-14T20:51:56.629313] [DEBUG] [LOCAL ] CPNG: Loaded 40425 existing records from primary storage. [2025-09-14T20:51:56.629586] [INFO ] [MAIN ] CPS: Loaded 18945 primary data records. [2025-09-14T20:51:56.629675] [INFO ] [MAIN ] CPNG: Loaded 40425 primary data records. [2025-09-14T20:51:56.846081] [DEBUG] [LOCAL ] CPRI: Loaded 39506 existing records from primary storage. [2025-09-14T20:51:56.888386] [INFO ] [MAIN ] CPRI: Loaded 39506 primary data records. [2025-09-14T20:51:57.525721] [DEBUG] [MAIN ] CPS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:57.525334] [DEBUG] [MAIN ] CPNG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:57.526587] [INFO ] [MAIN ] CPS: Generated 1352 derivative records from 18945 primary records. [2025-09-14T20:51:57.527162] [INFO ] [MAIN ] CPNG: Generated 1352 derivative records from 40425 primary records. [2025-09-14T20:51:57.527385] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-14T20:51:57.527592] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-14T20:51:57.551869] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1352 records). [2025-09-14T20:51:57.553626] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-14T20:51:57.553860] [DEBUG] [LOCAL ] CPS: Derivative data saved (1352 records). [2025-09-14T20:51:57.554938] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-14T20:51:57.557617] [INFO ] [MAIN ] Derivative Progress: 487/2226 symbols completed. CPNG took 1.0s. Estimated remaining: 10m 15s. Rate: 169.6 symbols/min [2025-09-14T20:51:57.560309] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:57.560456] [INFO ] [MAIN ] Derivative Progress: 488/2226 symbols completed. CPS took 1.0s. Estimated remaining: 10m 14s. Rate: 169.9 symbols/min [2025-09-14T20:51:57.570974] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:57.571268] [DEBUG] [MAIN ] CPRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:57.572384] [INFO ] [MAIN ] CPRI: Generated 1352 derivative records from 39506 primary records. [2025-09-14T20:51:57.572665] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-14T20:51:57.590970] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1352 records). [2025-09-14T20:51:57.591202] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-14T20:51:57.593456] [INFO ] [MAIN ] Derivative Progress: 489/2226 symbols completed. CPRI took 1.0s. Estimated remaining: 10m 12s. Rate: 170.3 symbols/min [2025-09-14T20:51:57.593840] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:57.602091] [DEBUG] [LOCAL ] CQP: Loaded 15095 existing records from primary storage. [2025-09-14T20:51:57.602776] [INFO ] [MAIN ] CQP: Loaded 15095 primary data records. [2025-09-14T20:51:57.758455] [DEBUG] [LOCAL ] CPT: Loaded 33071 existing records from primary storage. [2025-09-14T20:51:57.779214] [INFO ] [MAIN ] CPT: Loaded 33071 primary data records. [2025-09-14T20:51:57.814863] [DEBUG] [LOCAL ] CR: Loaded 18070 existing records from primary storage. [2025-09-14T20:51:57.926180] [INFO ] [MAIN ] CR: Loaded 18070 primary data records. [2025-09-14T20:51:58.545547] [DEBUG] [MAIN ] CQP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:58.548501] [INFO ] [MAIN ] CQP: Generated 1352 derivative records from 15095 primary records. [2025-09-14T20:51:58.548906] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-14T20:51:58.564849] [DEBUG] [LOCAL ] CQP: Derivative data saved (1352 records). [2025-09-14T20:51:58.565440] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-14T20:51:58.567670] [INFO ] [MAIN ] Derivative Progress: 490/2226 symbols completed. CQP took 1.0s. Estimated remaining: 10m 14s. Rate: 169.6 symbols/min [2025-09-14T20:51:58.568525] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:58.588972] [DEBUG] [MAIN ] CPT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:58.593203] [DEBUG] [LOCAL ] CRBD: Loaded 6949 existing records from primary storage. [2025-09-14T20:51:58.594116] [INFO ] [MAIN ] CPT: Generated 1352 derivative records from 33071 primary records. [2025-09-14T20:51:58.594509] [INFO ] [MAIN ] CRBD: Loaded 6949 primary data records. [2025-09-14T20:51:58.594607] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-14T20:51:58.649325] [DEBUG] [LOCAL ] CPT: Derivative data saved (1352 records). [2025-09-14T20:51:58.710227] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-14T20:51:58.721243] [DEBUG] [MAIN ] CR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:58.730115] [INFO ] [MAIN ] Derivative Progress: 491/2226 symbols completed. CPT took 1.2s. Estimated remaining: 10m 13s. Rate: 169.8 symbols/min [2025-09-14T20:51:58.742061] [INFO ] [MAIN ] CR: Generated 1352 derivative records from 18070 primary records. [2025-09-14T20:51:58.742261] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:58.753340] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-14T20:51:58.839586] [DEBUG] [LOCAL ] CR: Derivative data saved (1352 records). [2025-09-14T20:51:58.932230] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-14T20:51:58.935133] [INFO ] [MAIN ] Derivative Progress: 492/2226 symbols completed. CR took 1.3s. Estimated remaining: 10m 12s. Rate: 170.0 symbols/min [2025-09-14T20:51:58.935837] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:58.972858] [DEBUG] [MAIN ] CRBD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:58.986049] [INFO ] [MAIN ] CRBD: Generated 1352 derivative records from 6949 primary records. [2025-09-14T20:51:58.986330] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-14T20:51:58.987065] [DEBUG] [LOCAL ] CRBG: Loaded 39482 existing records from primary storage. [2025-09-14T20:51:58.995855] [INFO ] [MAIN ] CRBG: Loaded 39482 primary data records. [2025-09-14T20:51:59.075715] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1352 records). [2025-09-14T20:51:59.095555] [DEBUG] [LOCAL ] CRC: Loaded 32978 existing records from primary storage. [2025-09-14T20:51:59.118058] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-14T20:51:59.118174] [INFO ] [MAIN ] CRC: Loaded 32978 primary data records. [2025-09-14T20:51:59.139101] [INFO ] [MAIN ] Derivative Progress: 493/2226 symbols completed. CRBD took 0.6s. Estimated remaining: 10m 11s. Rate: 170.1 symbols/min [2025-09-14T20:51:59.615596] [DEBUG] [MAIN ] CRBG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:59.616619] [INFO ] [MAIN ] CRBG: Generated 1352 derivative records from 39482 primary records. [2025-09-14T20:51:59.616923] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-14T20:51:59.630508] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1352 records). [2025-09-14T20:51:59.631858] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-14T20:51:59.633858] [INFO ] [MAIN ] Derivative Progress: 494/2226 symbols completed. CRBG took 0.9s. Estimated remaining: 10m 11s. Rate: 170.0 symbols/min [2025-09-14T20:51:59.643857] [DEBUG] [MAIN ] CRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:51:59.644497] [INFO ] [MAIN ] CRC: Generated 1352 derivative records from 32978 primary records. [2025-09-14T20:51:59.644575] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-14T20:51:59.656483] [DEBUG] [LOCAL ] CRC: Derivative data saved (1352 records). [2025-09-14T20:51:59.656561] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-14T20:51:59.658915] [INFO ] [MAIN ] Derivative Progress: 495/2226 symbols completed. CRC took 0.7s. Estimated remaining: 10m 10s. Rate: 170.3 symbols/min [2025-09-14T20:51:59.659654] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:59.659828] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:59.660029] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:51:59.742187] [DEBUG] [LOCAL ] CRH: Loaded 40240 existing records from primary storage. [2025-09-14T20:51:59.742889] [DEBUG] [LOCAL ] CRGY: Loaded 39368 existing records from primary storage. [2025-09-14T20:51:59.743224] [INFO ] [MAIN ] CRGY: Loaded 39368 primary data records. [2025-09-14T20:51:59.743290] [INFO ] [MAIN ] CRH: Loaded 40240 primary data records. [2025-09-14T20:51:59.743842] [DEBUG] [LOCAL ] CRI: Loaded 37683 existing records from primary storage. [2025-09-14T20:51:59.775985] [INFO ] [MAIN ] CRI: Loaded 37683 primary data records. [2025-09-14T20:52:00.605402] [DEBUG] [MAIN ] CRGY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:00.605898] [DEBUG] [MAIN ] CRH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:00.608585] [INFO ] [MAIN ] CRH: Generated 1352 derivative records from 40240 primary records. [2025-09-14T20:52:00.607955] [INFO ] [MAIN ] CRGY: Generated 1352 derivative records from 39368 primary records. [2025-09-14T20:52:00.609623] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-14T20:52:00.609726] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-14T20:52:00.639890] [DEBUG] [LOCAL ] CRH: Derivative data saved (1352 records). [2025-09-14T20:52:00.641498] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-14T20:52:00.644002] [INFO ] [MAIN ] Derivative Progress: 496/2226 symbols completed. CRH took 1.0s. Estimated remaining: 10m 12s. Rate: 169.7 symbols/min [2025-09-14T20:52:00.647852] [DEBUG] [MAIN ] CRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:00.648046] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:00.650554] [INFO ] [MAIN ] CRI: Generated 1352 derivative records from 37683 primary records. [2025-09-14T20:52:00.649847] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1352 records). [2025-09-14T20:52:00.651236] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-14T20:52:00.651173] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-14T20:52:00.654983] [INFO ] [MAIN ] Derivative Progress: 497/2226 symbols completed. CRGY took 1.0s. Estimated remaining: 10m 10s. Rate: 170.0 symbols/min [2025-09-14T20:52:00.661434] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:00.668513] [DEBUG] [LOCAL ] CRI: Derivative data saved (1352 records). [2025-09-14T20:52:00.668687] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-14T20:52:00.673004] [INFO ] [MAIN ] Derivative Progress: 498/2226 symbols completed. CRI took 1.0s. Estimated remaining: 10m 9s. Rate: 170.3 symbols/min [2025-09-14T20:52:00.673483] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:00.723431] [DEBUG] [LOCAL ] CRK: Loaded 39134 existing records from primary storage. [2025-09-14T20:52:00.732057] [INFO ] [MAIN ] CRK: Loaded 39134 primary data records. [2025-09-14T20:52:00.851455] [DEBUG] [LOCAL ] CRL: Loaded 31895 existing records from primary storage. [2025-09-14T20:52:00.868281] [INFO ] [MAIN ] CRL: Loaded 31895 primary data records. [2025-09-14T20:52:00.895464] [DEBUG] [LOCAL ] CRM: Loaded 40510 existing records from primary storage. [2025-09-14T20:52:00.912474] [INFO ] [MAIN ] CRM: Loaded 40510 primary data records. [2025-09-14T20:52:01.656632] [DEBUG] [MAIN ] CRK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:01.666953] [INFO ] [MAIN ] CRK: Generated 1352 derivative records from 39134 primary records. [2025-09-14T20:52:01.667195] [DEBUG] [MAIN ] CRL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:01.667397] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-14T20:52:01.667915] [INFO ] [MAIN ] CRL: Generated 1352 derivative records from 31895 primary records. [2025-09-14T20:52:01.668978] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-14T20:52:01.693122] [DEBUG] [LOCAL ] CRL: Derivative data saved (1352 records). [2025-09-14T20:52:01.694670] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-14T20:52:01.698223] [INFO ] [MAIN ] Derivative Progress: 499/2226 symbols completed. CRL took 1.0s. Estimated remaining: 10m 11s. Rate: 169.7 symbols/min [2025-09-14T20:52:01.699203] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:01.699002] [DEBUG] [LOCAL ] CRK: Derivative data saved (1352 records). [2025-09-14T20:52:01.710795] [DEBUG] [MAIN ] CRM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:01.709990] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-14T20:52:01.713850] [INFO ] [MAIN ] Derivative Progress: 500/2226 symbols completed. CRK took 1.1s. Estimated remaining: 10m 9s. Rate: 170.0 symbols/min [2025-09-14T20:52:01.711872] [INFO ] [MAIN ] CRM: Generated 1352 derivative records from 40510 primary records. [2025-09-14T20:52:01.714162] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:01.714272] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-14T20:52:01.731971] [DEBUG] [LOCAL ] CRT: Loaded 3442 existing records from primary storage. [2025-09-14T20:52:01.733221] [INFO ] [MAIN ] CRT: Loaded 3442 primary data records. [2025-09-14T20:52:01.733021] [DEBUG] [LOCAL ] CRM: Derivative data saved (1352 records). [2025-09-14T20:52:01.772934] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-14T20:52:01.827529] [INFO ] [MAIN ] Derivative Progress: 501/2226 symbols completed. CRM took 1.2s. Estimated remaining: 10m 8s. Rate: 170.3 symbols/min [2025-09-14T20:52:01.865458] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:01.932070] [DEBUG] [LOCAL ] CRS: Loaded 32697 existing records from primary storage. [2025-09-14T20:52:01.967082] [INFO ] [MAIN ] CRS: Loaded 32697 primary data records. [2025-09-14T20:52:02.291100] [DEBUG] [LOCAL ] CSAN: Loaded 31822 existing records from primary storage. [2025-09-14T20:52:02.307728] [INFO ] [MAIN ] CSAN: Loaded 31822 primary data records. [2025-09-14T20:52:02.581213] [DEBUG] [MAIN ] CRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:02.685713] [INFO ] [MAIN ] CRT: Generated 1352 derivative records from 3442 primary records. [2025-09-14T20:52:02.687625] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-14T20:52:02.703357] [DEBUG] [LOCAL ] CRT: Derivative data saved (1352 records). [2025-09-14T20:52:02.704528] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-14T20:52:02.706944] [INFO ] [MAIN ] Derivative Progress: 502/2226 symbols completed. CRT took 1.0s. Estimated remaining: 10m 9s. Rate: 169.7 symbols/min [2025-09-14T20:52:02.710538] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:02.724526] [DEBUG] [MAIN ] CRS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:02.725988] [INFO ] [MAIN ] CRS: Generated 1352 derivative records from 32697 primary records. [2025-09-14T20:52:02.726281] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-14T20:52:02.741345] [DEBUG] [LOCAL ] CRS: Derivative data saved (1352 records). [2025-09-14T20:52:02.748504] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-14T20:52:02.751135] [INFO ] [MAIN ] Derivative Progress: 503/2226 symbols completed. CRS took 1.1s. Estimated remaining: 10m 8s. Rate: 170.0 symbols/min [2025-09-14T20:52:02.753046] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:02.775431] [DEBUG] [MAIN ] CSAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:02.780487] [DEBUG] [LOCAL ] CSL: Loaded 22559 existing records from primary storage. [2025-09-14T20:52:02.781597] [INFO ] [MAIN ] CSAN: Generated 1352 derivative records from 31822 primary records. [2025-09-14T20:52:02.781934] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-14T20:52:02.782041] [INFO ] [MAIN ] CSL: Loaded 22559 primary data records. [2025-09-14T20:52:02.840159] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1352 records). [2025-09-14T20:52:02.840348] [DEBUG] [LOCAL ] CSR: Loaded 9762 existing records from primary storage. [2025-09-14T20:52:02.885863] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-14T20:52:02.891411] [INFO ] [MAIN ] CSR: Loaded 9762 primary data records. [2025-09-14T20:52:02.906209] [INFO ] [MAIN ] Derivative Progress: 504/2226 symbols completed. CSAN took 1.0s. Estimated remaining: 10m 7s. Rate: 170.2 symbols/min [2025-09-14T20:52:02.917915] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:03.335927] [DEBUG] [LOCAL ] CSTM: Loaded 35715 existing records from primary storage. [2025-09-14T20:52:03.472127] [INFO ] [MAIN ] CSTM: Loaded 35715 primary data records. [2025-09-14T20:52:03.772524] [DEBUG] [MAIN ] CSL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:03.774144] [INFO ] [MAIN ] CSL: Generated 1352 derivative records from 22559 primary records. [2025-09-14T20:52:03.775681] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-14T20:52:03.804742] [DEBUG] [LOCAL ] CSL: Derivative data saved (1352 records). [2025-09-14T20:52:03.805337] [DEBUG] [MAIN ] CSR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:03.806881] [INFO ] [MAIN ] CSR: Generated 1352 derivative records from 9762 primary records. [2025-09-14T20:52:03.805851] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-14T20:52:03.807232] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-14T20:52:03.809437] [INFO ] [MAIN ] Derivative Progress: 505/2226 symbols completed. CSL took 1.1s. Estimated remaining: 10m 8s. Rate: 169.7 symbols/min [2025-09-14T20:52:03.811009] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:03.825594] [DEBUG] [LOCAL ] CSR: Derivative data saved (1352 records). [2025-09-14T20:52:03.830231] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-14T20:52:03.834950] [INFO ] [MAIN ] Derivative Progress: 506/2226 symbols completed. CSR took 1.1s. Estimated remaining: 10m 7s. Rate: 170.0 symbols/min [2025-09-14T20:52:03.840462] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:03.840932] [DEBUG] [LOCAL ] CSV: Loaded 9150 existing records from primary storage. [2025-09-14T20:52:03.841820] [INFO ] [MAIN ] CSV: Loaded 9150 primary data records. [2025-09-14T20:52:03.889996] [DEBUG] [MAIN ] CSTM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:03.947922] [DEBUG] [LOCAL ] CTBB: Loaded 4859 existing records from primary storage. [2025-09-14T20:52:03.954317] [INFO ] [MAIN ] CSTM: Generated 1352 derivative records from 35715 primary records. [2025-09-14T20:52:03.966384] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-14T20:52:03.965851] [INFO ] [MAIN ] CTBB: Loaded 4859 primary data records. [2025-09-14T20:52:04.266142] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1352 records). [2025-09-14T20:52:04.311479] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-14T20:52:04.325470] [INFO ] [MAIN ] Derivative Progress: 507/2226 symbols completed. CSTM took 1.4s. Estimated remaining: 10m 7s. Rate: 169.9 symbols/min [2025-09-14T20:52:04.348955] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:04.465091] [DEBUG] [LOCAL ] CTDD: Loaded 3852 existing records from primary storage. [2025-09-14T20:52:04.466306] [INFO ] [MAIN ] CTDD: Loaded 3852 primary data records. [2025-09-14T20:52:04.661528] [DEBUG] [MAIN ] CSV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:04.663331] [INFO ] [MAIN ] CSV: Generated 1352 derivative records from 9150 primary records. [2025-09-14T20:52:04.751416] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-14T20:52:04.780464] [DEBUG] [MAIN ] CTBB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:04.782305] [INFO ] [MAIN ] CTBB: Generated 1352 derivative records from 4859 primary records. [2025-09-14T20:52:04.785354] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-14T20:52:04.785210] [DEBUG] [LOCAL ] CSV: Derivative data saved (1352 records). [2025-09-14T20:52:04.796585] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-14T20:52:04.798897] [INFO ] [MAIN ] Derivative Progress: 508/2226 symbols completed. CSV took 1.0s. Estimated remaining: 10m 7s. Rate: 169.8 symbols/min [2025-09-14T20:52:04.801528] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1352 records). [2025-09-14T20:52:04.801756] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-14T20:52:04.804231] [INFO ] [MAIN ] Derivative Progress: 509/2226 symbols completed. CTBB took 1.0s. Estimated remaining: 10m 6s. Rate: 170.1 symbols/min [2025-09-14T20:52:04.818194] [DEBUG] [MAIN ] CTDD: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:52:04.818880] [INFO ] [MAIN ] CTDD: Generated 1351 derivative records from 3852 primary records. [2025-09-14T20:52:04.818959] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-14T20:52:04.830533] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1351 records). [2025-09-14T20:52:04.830608] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-14T20:52:04.832748] [INFO ] [MAIN ] Derivative Progress: 510/2226 symbols completed. CTDD took 0.5s. Estimated remaining: 10m 4s. Rate: 170.4 symbols/min [2025-09-14T20:52:04.833330] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:04.833224] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:04.833732] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:04.873958] [DEBUG] [LOCAL ] CTOS: Loaded 27448 existing records from primary storage. [2025-09-14T20:52:04.874293] [INFO ] [MAIN ] CTOS: Loaded 27448 primary data records. [2025-09-14T20:52:05.046307] [DEBUG] [LOCAL ] CTRE: Loaded 36929 existing records from primary storage. [2025-09-14T20:52:05.073445] [DEBUG] [LOCAL ] CTRA: Loaded 40394 existing records from primary storage. [2025-09-14T20:52:05.108880] [INFO ] [MAIN ] CTRE: Loaded 36929 primary data records. [2025-09-14T20:52:05.112553] [INFO ] [MAIN ] CTRA: Loaded 40394 primary data records. [2025-09-14T20:52:05.842865] [DEBUG] [MAIN ] CTOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:05.843866] [INFO ] [MAIN ] CTOS: Generated 1352 derivative records from 27448 primary records. [2025-09-14T20:52:05.845243] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-14T20:52:05.858722] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1352 records). [2025-09-14T20:52:05.858924] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-14T20:52:05.861732] [INFO ] [MAIN ] Derivative Progress: 511/2226 symbols completed. CTOS took 1.0s. Estimated remaining: 10m 6s. Rate: 169.8 symbols/min [2025-09-14T20:52:05.863121] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:05.875224] [DEBUG] [MAIN ] CTRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:05.876802] [INFO ] [MAIN ] CTRE: Generated 1352 derivative records from 36929 primary records. [2025-09-14T20:52:05.877151] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-14T20:52:05.897102] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1352 records). [2025-09-14T20:52:05.901459] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-14T20:52:05.901394] [DEBUG] [MAIN ] CTRA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:05.903909] [INFO ] [MAIN ] Derivative Progress: 512/2226 symbols completed. CTRE took 1.1s. Estimated remaining: 10m 5s. Rate: 170.1 symbols/min [2025-09-14T20:52:05.904804] [INFO ] [MAIN ] CTRA: Generated 1352 derivative records from 40394 primary records. [2025-09-14T20:52:05.905314] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:05.905525] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-14T20:52:05.932028] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1352 records). [2025-09-14T20:52:05.932362] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-14T20:52:05.934631] [INFO ] [MAIN ] Derivative Progress: 513/2226 symbols completed. CTRA took 1.1s. Estimated remaining: 10m 3s. Rate: 170.4 symbols/min [2025-09-14T20:52:05.935140] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:05.961470] [DEBUG] [LOCAL ] CTS: Loaded 14207 existing records from primary storage. [2025-09-14T20:52:05.962044] [INFO ] [MAIN ] CTS: Loaded 14207 primary data records. [2025-09-14T20:52:05.964419] [DEBUG] [LOCAL ] CTRI: Loaded 29300 existing records from primary storage. [2025-09-14T20:52:06.010602] [INFO ] [MAIN ] CTRI: Loaded 29300 primary data records. [2025-09-14T20:52:06.389487] [DEBUG] [LOCAL ] CTVA: Loaded 40082 existing records from primary storage. [2025-09-14T20:52:06.453604] [INFO ] [MAIN ] CTVA: Loaded 40082 primary data records. [2025-09-14T20:52:06.887479] [DEBUG] [MAIN ] CTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:06.890339] [INFO ] [MAIN ] CTS: Generated 1352 derivative records from 14207 primary records. [2025-09-14T20:52:06.890498] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-14T20:52:06.901331] [DEBUG] [MAIN ] CTRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:06.907892] [INFO ] [MAIN ] CTRI: Generated 1352 derivative records from 29300 primary records. [2025-09-14T20:52:06.909169] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-14T20:52:06.922030] [DEBUG] [LOCAL ] CTS: Derivative data saved (1352 records). [2025-09-14T20:52:06.928816] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-14T20:52:06.931670] [INFO ] [MAIN ] Derivative Progress: 514/2226 symbols completed. CTS took 1.0s. Estimated remaining: 10m 5s. Rate: 169.8 symbols/min [2025-09-14T20:52:06.929740] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1352 records). [2025-09-14T20:52:06.932080] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:06.932515] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-14T20:52:06.936108] [INFO ] [MAIN ] Derivative Progress: 515/2226 symbols completed. CTRI took 1.1s. Estimated remaining: 10m 4s. Rate: 170.1 symbols/min [2025-09-14T20:52:06.937521] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:06.951600] [DEBUG] [MAIN ] CTVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:06.952582] [INFO ] [MAIN ] CTVA: Generated 1352 derivative records from 40082 primary records. [2025-09-14T20:52:06.952876] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-14T20:52:06.966660] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1352 records). [2025-09-14T20:52:06.973270] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-14T20:52:06.976074] [INFO ] [MAIN ] Derivative Progress: 516/2226 symbols completed. CTVA took 1.0s. Estimated remaining: 10m 2s. Rate: 170.4 symbols/min [2025-09-14T20:52:06.976687] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:06.997551] [DEBUG] [LOCAL ] CUBI: Loaded 20046 existing records from primary storage. [2025-09-14T20:52:06.998013] [INFO ] [MAIN ] CUBI: Loaded 20046 primary data records. [2025-09-14T20:52:07.114035] [DEBUG] [LOCAL ] CUBE: Loaded 38219 existing records from primary storage. [2025-09-14T20:52:07.120843] [INFO ] [MAIN ] CUBE: Loaded 38219 primary data records. [2025-09-14T20:52:07.447825] [DEBUG] [LOCAL ] CUK: Loaded 38115 existing records from primary storage. [2025-09-14T20:52:07.454935] [INFO ] [MAIN ] CUK: Loaded 38115 primary data records. [2025-09-14T20:52:07.937824] [DEBUG] [MAIN ] CUBI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:07.939786] [INFO ] [MAIN ] CUBI: Generated 1352 derivative records from 20046 primary records. [2025-09-14T20:52:07.940194] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-14T20:52:07.959150] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1352 records). [2025-09-14T20:52:07.959542] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-14T20:52:07.967616] [INFO ] [MAIN ] Derivative Progress: 517/2226 symbols completed. CUBI took 1.0s. Estimated remaining: 10m 4s. Rate: 169.8 symbols/min [2025-09-14T20:52:07.972566] [DEBUG] [MAIN ] CUBE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:07.973068] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:07.973909] [INFO ] [MAIN ] CUBE: Generated 1352 derivative records from 38219 primary records. [2025-09-14T20:52:07.975271] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-14T20:52:07.995332] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1352 records). [2025-09-14T20:52:07.994264] [DEBUG] [LOCAL ] CULP: Loaded 2034 existing records from primary storage. [2025-09-14T20:52:07.995452] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-14T20:52:07.998577] [INFO ] [MAIN ] Derivative Progress: 518/2226 symbols completed. CUBE took 1.1s. Estimated remaining: 10m 3s. Rate: 170.1 symbols/min [2025-09-14T20:52:08.005005] [INFO ] [MAIN ] CULP: Loaded 2034 primary data records. [2025-09-14T20:52:08.009362] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:08.023795] [DEBUG] [MAIN ] CUK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:08.071024] [INFO ] [MAIN ] CUK: Generated 1352 derivative records from 38115 primary records. [2025-09-14T20:52:08.103673] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-14T20:52:08.218024] [DEBUG] [LOCAL ] CUK: Derivative data saved (1352 records). [2025-09-14T20:52:08.224104] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-14T20:52:08.359322] [INFO ] [MAIN ] Derivative Progress: 519/2226 symbols completed. CUK took 1.4s. Estimated remaining: 10m 2s. Rate: 170.1 symbols/min [2025-09-14T20:52:08.373043] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:08.373910] [DEBUG] [LOCAL ] CURB: Loaded 23951 existing records from primary storage. [2025-09-14T20:52:08.374429] [INFO ] [MAIN ] CURB: Loaded 23951 primary data records. [2025-09-14T20:52:08.662093] [DEBUG] [LOCAL ] CURV: Loaded 19974 existing records from primary storage. [2025-09-14T20:52:08.674871] [INFO ] [MAIN ] CURV: Loaded 19974 primary data records. [2025-09-14T20:52:08.768522] [DEBUG] [MAIN ] CULP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:08.793700] [INFO ] [MAIN ] CULP: Generated 1352 derivative records from 2034 primary records. [2025-09-14T20:52:08.806235] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-14T20:52:08.861517] [DEBUG] [LOCAL ] CULP: Derivative data saved (1352 records). [2025-09-14T20:52:08.901328] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-14T20:52:08.997292] [INFO ] [MAIN ] Derivative Progress: 520/2226 symbols completed. CULP took 1.0s. Estimated remaining: 10m 3s. Rate: 169.8 symbols/min [2025-09-14T20:52:09.005021] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:09.024775] [DEBUG] [MAIN ] CURB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:09.025746] [INFO ] [MAIN ] CURB: Generated 1352 derivative records from 23951 primary records. [2025-09-14T20:52:09.026555] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-14T20:52:09.042064] [DEBUG] [LOCAL ] CURB: Derivative data saved (1352 records). [2025-09-14T20:52:09.044708] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-14T20:52:09.048106] [INFO ] [MAIN ] Derivative Progress: 521/2226 symbols completed. CURB took 1.0s. Estimated remaining: 10m 1s. Rate: 170.1 symbols/min [2025-09-14T20:52:09.058997] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:09.059517] [DEBUG] [MAIN ] CURV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:09.060931] [INFO ] [MAIN ] CURV: Generated 1352 derivative records from 19974 primary records. [2025-09-14T20:52:09.070901] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-14T20:52:09.083897] [DEBUG] [LOCAL ] CURV: Derivative data saved (1352 records). [2025-09-14T20:52:09.084229] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-14T20:52:09.086470] [INFO ] [MAIN ] Derivative Progress: 522/2226 symbols completed. CURV took 0.7s. Estimated remaining: 10m 0s. Rate: 170.4 symbols/min [2025-09-14T20:52:09.087587] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:09.100930] [DEBUG] [LOCAL ] CUZ: Loaded 37222 existing records from primary storage. [2025-09-14T20:52:09.101243] [INFO ] [MAIN ] CUZ: Loaded 37222 primary data records. [2025-09-14T20:52:09.233080] [DEBUG] [LOCAL ] CVEO: Loaded 11781 existing records from primary storage. [2025-09-14T20:52:09.238367] [INFO ] [MAIN ] CVEO: Loaded 11781 primary data records. [2025-09-14T20:52:09.412066] [DEBUG] [LOCAL ] CVE: Loaded 40314 existing records from primary storage. [2025-09-14T20:52:09.535292] [INFO ] [MAIN ] CVE: Loaded 40314 primary data records. [2025-09-14T20:52:10.046766] [DEBUG] [MAIN ] CUZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:10.049493] [INFO ] [MAIN ] CUZ: Generated 1352 derivative records from 37222 primary records. [2025-09-14T20:52:10.049857] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-14T20:52:10.061331] [DEBUG] [MAIN ] CVEO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:10.072055] [INFO ] [MAIN ] CVEO: Generated 1352 derivative records from 11781 primary records. [2025-09-14T20:52:10.073461] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-14T20:52:10.089327] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1352 records). [2025-09-14T20:52:10.092917] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-14T20:52:10.093012] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1352 records). [2025-09-14T20:52:10.095397] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-14T20:52:10.095069] [INFO ] [MAIN ] Derivative Progress: 523/2226 symbols completed. CUZ took 1.1s. Estimated remaining: 10m 2s. Rate: 169.8 symbols/min [2025-09-14T20:52:10.108274] [INFO ] [MAIN ] Derivative Progress: 524/2226 symbols completed. CVEO took 1.0s. Estimated remaining: 10m 0s. Rate: 170.1 symbols/min [2025-09-14T20:52:10.108637] [DEBUG] [MAIN ] CVE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:10.109696] [INFO ] [MAIN ] CVE: Generated 1352 derivative records from 40314 primary records. [2025-09-14T20:52:10.109776] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-14T20:52:10.122198] [DEBUG] [LOCAL ] CVE: Derivative data saved (1352 records). [2025-09-14T20:52:10.122304] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-14T20:52:10.124561] [INFO ] [MAIN ] Derivative Progress: 525/2226 symbols completed. CVE took 1.1s. Estimated remaining: 9m 59s. Rate: 170.4 symbols/min [2025-09-14T20:52:10.125383] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:10.125572] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:10.125851] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:10.156347] [DEBUG] [LOCAL ] CVLG: Loaded 11706 existing records from primary storage. [2025-09-14T20:52:10.156553] [INFO ] [MAIN ] CVLG: Loaded 11706 primary data records. [2025-09-14T20:52:10.289060] [DEBUG] [LOCAL ] CVI: Loaded 34598 existing records from primary storage. [2025-09-14T20:52:10.305155] [INFO ] [MAIN ] CVI: Loaded 34598 primary data records. [2025-09-14T20:52:10.543252] [DEBUG] [LOCAL ] CVNA: Loaded 39897 existing records from primary storage. [2025-09-14T20:52:10.568459] [INFO ] [MAIN ] CVNA: Loaded 39897 primary data records. [2025-09-14T20:52:11.137140] [DEBUG] [MAIN ] CVLG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:11.138937] [INFO ] [MAIN ] CVLG: Generated 1352 derivative records from 11706 primary records. [2025-09-14T20:52:11.139189] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-14T20:52:11.154883] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1352 records). [2025-09-14T20:52:11.156057] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-14T20:52:11.159839] [INFO ] [MAIN ] Derivative Progress: 526/2226 symbols completed. CVLG took 1.0s. Estimated remaining: 10m 1s. Rate: 169.8 symbols/min [2025-09-14T20:52:11.160173] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:11.171764] [DEBUG] [MAIN ] CVI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:11.173201] [INFO ] [MAIN ] CVI: Generated 1352 derivative records from 34598 primary records. [2025-09-14T20:52:11.173376] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-14T20:52:11.188529] [DEBUG] [LOCAL ] CVI: Derivative data saved (1352 records). [2025-09-14T20:52:11.188804] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-14T20:52:11.191256] [INFO ] [MAIN ] Derivative Progress: 527/2226 symbols completed. CVI took 1.1s. Estimated remaining: 9m 59s. Rate: 170.1 symbols/min [2025-09-14T20:52:11.201381] [DEBUG] [MAIN ] CVNA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:11.201627] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:11.202460] [INFO ] [MAIN ] CVNA: Generated 1352 derivative records from 39897 primary records. [2025-09-14T20:52:11.202592] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-14T20:52:11.216775] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1352 records). [2025-09-14T20:52:11.217010] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-14T20:52:11.219470] [INFO ] [MAIN ] Derivative Progress: 528/2226 symbols completed. CVNA took 1.1s. Estimated remaining: 9m 58s. Rate: 170.4 symbols/min [2025-09-14T20:52:11.219938] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:11.262846] [DEBUG] [LOCAL ] CVS: Loaded 40438 existing records from primary storage. [2025-09-14T20:52:11.263330] [INFO ] [MAIN ] CVS: Loaded 40438 primary data records. [2025-09-14T20:52:11.361446] [DEBUG] [LOCAL ] CW: Loaded 16960 existing records from primary storage. [2025-09-14T20:52:11.392616] [DEBUG] [LOCAL ] CVX: Loaded 40500 existing records from primary storage. [2025-09-14T20:52:11.391871] [INFO ] [MAIN ] CW: Loaded 16960 primary data records. [2025-09-14T20:52:11.392872] [INFO ] [MAIN ] CVX: Loaded 40500 primary data records. [2025-09-14T20:52:12.219255] [DEBUG] [MAIN ] CW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:12.231057] [DEBUG] [MAIN ] CVX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:12.231975] [INFO ] [MAIN ] CVX: Generated 1352 derivative records from 40500 primary records. [2025-09-14T20:52:12.230463] [DEBUG] [MAIN ] CVS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:12.233189] [INFO ] [MAIN ] CW: Generated 1352 derivative records from 16960 primary records. [2025-09-14T20:52:12.234082] [INFO ] [MAIN ] CVS: Generated 1352 derivative records from 40438 primary records. [2025-09-14T20:52:12.234247] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-14T20:52:12.233370] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-14T20:52:12.235085] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-14T20:52:12.260800] [DEBUG] [LOCAL ] CVX: Derivative data saved (1352 records). [2025-09-14T20:52:12.265357] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-14T20:52:12.274295] [INFO ] [MAIN ] Derivative Progress: 529/2226 symbols completed. CVX took 1.1s. Estimated remaining: 9m 60s. Rate: 169.7 symbols/min [2025-09-14T20:52:12.265464] [DEBUG] [LOCAL ] CW: Derivative data saved (1352 records). [2025-09-14T20:52:12.278177] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:12.280992] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-14T20:52:12.282268] [DEBUG] [LOCAL ] CVS: Derivative data saved (1352 records). [2025-09-14T20:52:12.284566] [INFO ] [MAIN ] Derivative Progress: 530/2226 symbols completed. CW took 1.1s. Estimated remaining: 9m 58s. Rate: 170.0 symbols/min [2025-09-14T20:52:12.285127] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:12.282436] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-14T20:52:12.287611] [INFO ] [MAIN ] Derivative Progress: 531/2226 symbols completed. CVS took 1.1s. Estimated remaining: 9m 57s. Rate: 170.4 symbols/min [2025-09-14T20:52:12.288506] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:12.341904] [DEBUG] [LOCAL ] CWH: Loaded 38864 existing records from primary storage. [2025-09-14T20:52:12.342113] [INFO ] [MAIN ] CWH: Loaded 38864 primary data records. [2025-09-14T20:52:12.477893] [DEBUG] [LOCAL ] CWAN: Loaded 39593 existing records from primary storage. [2025-09-14T20:52:12.487835] [INFO ] [MAIN ] CWAN: Loaded 39593 primary data records. [2025-09-14T20:52:12.501191] [DEBUG] [LOCAL ] CWEN: Loaded 33419 existing records from primary storage. [2025-09-14T20:52:12.527064] [INFO ] [MAIN ] CWEN: Loaded 33419 primary data records. [2025-09-14T20:52:13.336189] [DEBUG] [MAIN ] CWH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:13.349753] [INFO ] [MAIN ] CWH: Generated 1352 derivative records from 38864 primary records. [2025-09-14T20:52:13.351321] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-14T20:52:13.352437] [DEBUG] [MAIN ] CWAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:13.363935] [DEBUG] [MAIN ] CWEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:13.365471] [INFO ] [MAIN ] CWAN: Generated 1352 derivative records from 39593 primary records. [2025-09-14T20:52:13.366173] [INFO ] [MAIN ] CWEN: Generated 1352 derivative records from 33419 primary records. [2025-09-14T20:52:13.376065] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-14T20:52:13.366741] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-14T20:52:13.380764] [DEBUG] [LOCAL ] CWH: Derivative data saved (1352 records). [2025-09-14T20:52:13.388079] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-14T20:52:13.400416] [INFO ] [MAIN ] Derivative Progress: 532/2226 symbols completed. CWH took 1.1s. Estimated remaining: 9m 59s. Rate: 169.7 symbols/min [2025-09-14T20:52:13.407657] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:13.412695] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1352 records). [2025-09-14T20:52:13.414024] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-14T20:52:13.414662] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1352 records). [2025-09-14T20:52:13.417793] [INFO ] [MAIN ] Derivative Progress: 533/2226 symbols completed. CWAN took 1.1s. Estimated remaining: 9m 58s. Rate: 170.0 symbols/min [2025-09-14T20:52:13.418336] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-14T20:52:13.422345] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:13.422548] [INFO ] [MAIN ] Derivative Progress: 534/2226 symbols completed. CWEN took 1.1s. Estimated remaining: 9m 56s. Rate: 170.3 symbols/min [2025-09-14T20:52:13.424082] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:13.474472] [DEBUG] [LOCAL ] CWT: Loaded 20471 existing records from primary storage. [2025-09-14T20:52:13.475062] [INFO ] [MAIN ] CWT: Loaded 20471 primary data records. [2025-09-14T20:52:13.615824] [DEBUG] [LOCAL ] CWK: Loaded 37114 existing records from primary storage. [2025-09-14T20:52:13.634005] [INFO ] [MAIN ] CWK: Loaded 37114 primary data records. [2025-09-14T20:52:13.641225] [DEBUG] [LOCAL ] CX: Loaded 39740 existing records from primary storage. [2025-09-14T20:52:13.646732] [INFO ] [MAIN ] CX: Loaded 39740 primary data records. [2025-09-14T20:52:14.402503] [DEBUG] [MAIN ] CWT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:14.403913] [INFO ] [MAIN ] CWT: Generated 1352 derivative records from 20471 primary records. [2025-09-14T20:52:14.404742] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-14T20:52:14.422761] [DEBUG] [LOCAL ] CWT: Derivative data saved (1352 records). [2025-09-14T20:52:14.423345] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-14T20:52:14.433660] [DEBUG] [MAIN ] CX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:14.435538] [INFO ] [MAIN ] Derivative Progress: 535/2226 symbols completed. CWT took 1.0s. Estimated remaining: 9m 58s. Rate: 169.7 symbols/min [2025-09-14T20:52:14.436846] [INFO ] [MAIN ] CX: Generated 1352 derivative records from 39740 primary records. [2025-09-14T20:52:14.437125] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-14T20:52:14.437340] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:14.460760] [DEBUG] [LOCAL ] CX: Derivative data saved (1352 records). [2025-09-14T20:52:14.467571] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-14T20:52:14.465012] [DEBUG] [MAIN ] CWK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:14.467830] [DEBUG] [LOCAL ] CXE: Loaded 4713 existing records from primary storage. [2025-09-14T20:52:14.470756] [INFO ] [MAIN ] CWK: Generated 1352 derivative records from 37114 primary records. [2025-09-14T20:52:14.470046] [INFO ] [MAIN ] Derivative Progress: 536/2226 symbols completed. CX took 1.0s. Estimated remaining: 9m 57s. Rate: 170.0 symbols/min [2025-09-14T20:52:14.470943] [INFO ] [MAIN ] CXE: Loaded 4713 primary data records. [2025-09-14T20:52:14.471089] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-14T20:52:14.529397] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:14.623979] [DEBUG] [LOCAL ] CWK: Derivative data saved (1352 records). [2025-09-14T20:52:14.675540] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-14T20:52:14.688204] [INFO ] [MAIN ] Derivative Progress: 537/2226 symbols completed. CWK took 1.3s. Estimated remaining: 9m 56s. Rate: 170.1 symbols/min [2025-09-14T20:52:14.685582] [DEBUG] [LOCAL ] CXH: Loaded 3883 existing records from primary storage. [2025-09-14T20:52:14.777762] [INFO ] [MAIN ] CXH: Loaded 3883 primary data records. [2025-09-14T20:52:14.778028] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:15.107771] [DEBUG] [LOCAL ] CXM: Loaded 35801 existing records from primary storage. [2025-09-14T20:52:15.108505] [INFO ] [MAIN ] CXM: Loaded 35801 primary data records. [2025-09-14T20:52:15.131617] [DEBUG] [MAIN ] CXE: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:52:15.191236] [INFO ] [MAIN ] CXE: Generated 1351 derivative records from 4713 primary records. [2025-09-14T20:52:15.227818] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-14T20:52:15.255722] [DEBUG] [LOCAL ] CXE: Derivative data saved (1351 records). [2025-09-14T20:52:15.266084] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-14T20:52:15.293472] [INFO ] [MAIN ] Derivative Progress: 538/2226 symbols completed. CXE took 0.9s. Estimated remaining: 9m 56s. Rate: 169.9 symbols/min [2025-09-14T20:52:15.424505] [DEBUG] [MAIN ] CXH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:15.426410] [INFO ] [MAIN ] CXH: Generated 1352 derivative records from 3883 primary records. [2025-09-14T20:52:15.426691] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-14T20:52:15.440974] [DEBUG] [LOCAL ] CXH: Derivative data saved (1352 records). [2025-09-14T20:52:15.441136] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-14T20:52:15.443822] [INFO ] [MAIN ] Derivative Progress: 539/2226 symbols completed. CXH took 0.9s. Estimated remaining: 9m 55s. Rate: 170.1 symbols/min [2025-09-14T20:52:15.457960] [DEBUG] [MAIN ] CXM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:15.458694] [INFO ] [MAIN ] CXM: Generated 1352 derivative records from 35801 primary records. [2025-09-14T20:52:15.458772] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-14T20:52:15.470797] [DEBUG] [LOCAL ] CXM: Derivative data saved (1352 records). [2025-09-14T20:52:15.470880] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-14T20:52:15.472878] [INFO ] [MAIN ] Derivative Progress: 540/2226 symbols completed. CXM took 0.7s. Estimated remaining: 9m 54s. Rate: 170.3 symbols/min [2025-09-14T20:52:15.473903] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:15.474081] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:15.473785] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:15.511844] [DEBUG] [LOCAL ] CXT: Loaded 22501 existing records from primary storage. [2025-09-14T20:52:15.522806] [DEBUG] [LOCAL ] CYD: Loaded 19326 existing records from primary storage. [2025-09-14T20:52:15.523091] [INFO ] [MAIN ] CXT: Loaded 22501 primary data records. [2025-09-14T20:52:15.523805] [INFO ] [MAIN ] CYD: Loaded 19326 primary data records. [2025-09-14T20:52:15.711744] [DEBUG] [LOCAL ] CXW: Loaded 33263 existing records from primary storage. [2025-09-14T20:52:15.735180] [INFO ] [MAIN ] CXW: Loaded 33263 primary data records. [2025-09-14T20:52:16.480968] [DEBUG] [MAIN ] CXT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:16.482807] [INFO ] [MAIN ] CXT: Generated 1352 derivative records from 22501 primary records. [2025-09-14T20:52:16.483092] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-14T20:52:16.515963] [DEBUG] [LOCAL ] CXT: Derivative data saved (1352 records). [2025-09-14T20:52:16.516394] [DEBUG] [MAIN ] CYD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:16.517805] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-14T20:52:16.522953] [INFO ] [MAIN ] Derivative Progress: 541/2226 symbols completed. CXT took 1.0s. Estimated remaining: 9m 56s. Rate: 169.7 symbols/min [2025-09-14T20:52:16.519750] [INFO ] [MAIN ] CYD: Generated 1352 derivative records from 19326 primary records. [2025-09-14T20:52:16.523708] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:16.523763] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-14T20:52:16.535771] [DEBUG] [MAIN ] CXW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:16.537735] [INFO ] [MAIN ] CXW: Generated 1352 derivative records from 33263 primary records. [2025-09-14T20:52:16.543525] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-14T20:52:16.563096] [DEBUG] [LOCAL ] CXW: Derivative data saved (1352 records). [2025-09-14T20:52:16.563249] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-14T20:52:16.564388] [DEBUG] [LOCAL ] CYD: Derivative data saved (1352 records). [2025-09-14T20:52:16.567296] [INFO ] [MAIN ] Derivative Progress: 542/2226 symbols completed. CXW took 1.1s. Estimated remaining: 9m 54s. Rate: 170.0 symbols/min [2025-09-14T20:52:16.567421] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-14T20:52:16.567825] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:16.570864] [INFO ] [MAIN ] Derivative Progress: 543/2226 symbols completed. CYD took 1.1s. Estimated remaining: 9m 53s. Rate: 170.3 symbols/min [2025-09-14T20:52:16.571421] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:16.596130] [DEBUG] [LOCAL ] DAC: Loaded 9159 existing records from primary storage. [2025-09-14T20:52:16.596408] [INFO ] [MAIN ] DAC: Loaded 9159 primary data records. [2025-09-14T20:52:16.730496] [DEBUG] [LOCAL ] CYH: Loaded 36354 existing records from primary storage. [2025-09-14T20:52:16.747797] [INFO ] [MAIN ] CYH: Loaded 36354 primary data records. [2025-09-14T20:52:16.960285] [DEBUG] [LOCAL ] D: Loaded 40397 existing records from primary storage. [2025-09-14T20:52:16.997633] [INFO ] [MAIN ] D: Loaded 40397 primary data records. [2025-09-14T20:52:17.537410] [DEBUG] [MAIN ] DAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:17.538827] [INFO ] [MAIN ] DAC: Generated 1352 derivative records from 9159 primary records. [2025-09-14T20:52:17.539308] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-14T20:52:17.555357] [DEBUG] [LOCAL ] DAC: Derivative data saved (1352 records). [2025-09-14T20:52:17.556598] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-14T20:52:17.564831] [INFO ] [MAIN ] Derivative Progress: 544/2226 symbols completed. DAC took 1.0s. Estimated remaining: 9m 55s. Rate: 169.7 symbols/min [2025-09-14T20:52:17.569614] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:17.570426] [DEBUG] [MAIN ] CYH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:17.571502] [INFO ] [MAIN ] CYH: Generated 1352 derivative records from 36354 primary records. [2025-09-14T20:52:17.572092] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-14T20:52:17.588274] [DEBUG] [LOCAL ] CYH: Derivative data saved (1352 records). [2025-09-14T20:52:17.591014] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-14T20:52:17.594155] [INFO ] [MAIN ] Derivative Progress: 545/2226 symbols completed. CYH took 1.1s. Estimated remaining: 9m 53s. Rate: 170.0 symbols/min [2025-09-14T20:52:17.594824] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:17.607237] [DEBUG] [MAIN ] D: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:17.609857] [INFO ] [MAIN ] D: Generated 1352 derivative records from 40397 primary records. [2025-09-14T20:52:17.609981] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-14T20:52:17.636132] [DEBUG] [LOCAL ] D: Derivative data saved (1352 records). [2025-09-14T20:52:17.636389] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-14T20:52:17.639007] [INFO ] [MAIN ] Derivative Progress: 546/2226 symbols completed. D took 1.1s. Estimated remaining: 9m 52s. Rate: 170.3 symbols/min [2025-09-14T20:52:17.639816] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:17.657893] [DEBUG] [LOCAL ] DAL: Loaded 40493 existing records from primary storage. [2025-09-14T20:52:17.669712] [INFO ] [MAIN ] DAL: Loaded 40493 primary data records. [2025-09-14T20:52:17.797059] [DEBUG] [LOCAL ] DAO: Loaded 13641 existing records from primary storage. [2025-09-14T20:52:17.825031] [INFO ] [MAIN ] DAO: Loaded 13641 primary data records. [2025-09-14T20:52:17.827510] [DEBUG] [LOCAL ] DAN: Loaded 36951 existing records from primary storage. [2025-09-14T20:52:17.874249] [INFO ] [MAIN ] DAN: Loaded 36951 primary data records. [2025-09-14T20:52:18.659381] [DEBUG] [MAIN ] DAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:18.661495] [INFO ] [MAIN ] DAL: Generated 1352 derivative records from 40493 primary records. [2025-09-14T20:52:18.662671] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-14T20:52:18.681674] [DEBUG] [LOCAL ] DAL: Derivative data saved (1352 records). [2025-09-14T20:52:18.682266] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-14T20:52:18.684448] [INFO ] [MAIN ] Derivative Progress: 547/2226 symbols completed. DAL took 1.1s. Estimated remaining: 9m 54s. Rate: 169.7 symbols/min [2025-09-14T20:52:18.687026] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:18.711463] [DEBUG] [MAIN ] DAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:18.713524] [INFO ] [MAIN ] DAN: Generated 1352 derivative records from 36951 primary records. [2025-09-14T20:52:18.713795] [DEBUG] [MAIN ] DAO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:18.714092] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-14T20:52:18.714684] [INFO ] [MAIN ] DAO: Generated 1352 derivative records from 13641 primary records. [2025-09-14T20:52:18.714848] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-14T20:52:18.737736] [DEBUG] [LOCAL ] DAO: Derivative data saved (1352 records). [2025-09-14T20:52:18.739062] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-14T20:52:18.742321] [INFO ] [MAIN ] Derivative Progress: 548/2226 symbols completed. DAO took 1.1s. Estimated remaining: 9m 52s. Rate: 169.9 symbols/min [2025-09-14T20:52:18.744743] [DEBUG] [LOCAL ] DAN: Derivative data saved (1352 records). [2025-09-14T20:52:18.744960] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:18.745314] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-14T20:52:18.748227] [INFO ] [MAIN ] Derivative Progress: 549/2226 symbols completed. DAN took 1.2s. Estimated remaining: 9m 51s. Rate: 170.2 symbols/min [2025-09-14T20:52:18.748866] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:18.781429] [DEBUG] [LOCAL ] DAR: Loaded 39024 existing records from primary storage. [2025-09-14T20:52:18.781889] [INFO ] [MAIN ] DAR: Loaded 39024 primary data records. [2025-09-14T20:52:18.960313] [DEBUG] [LOCAL ] DAVA: Loaded 30679 existing records from primary storage. [2025-09-14T20:52:18.981314] [INFO ] [MAIN ] DAVA: Loaded 30679 primary data records. [2025-09-14T20:52:19.015537] [DEBUG] [LOCAL ] DAY: Loaded 37479 existing records from primary storage. [2025-09-14T20:52:19.135548] [INFO ] [MAIN ] DAY: Loaded 37479 primary data records. [2025-09-14T20:52:19.747381] [DEBUG] [MAIN ] DAR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:19.749602] [INFO ] [MAIN ] DAR: Generated 1352 derivative records from 39024 primary records. [2025-09-14T20:52:19.750021] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-14T20:52:19.770564] [DEBUG] [LOCAL ] DAR: Derivative data saved (1352 records). [2025-09-14T20:52:19.771825] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-14T20:52:19.775437] [INFO ] [MAIN ] Derivative Progress: 550/2226 symbols completed. DAR took 1.1s. Estimated remaining: 9m 53s. Rate: 169.7 symbols/min [2025-09-14T20:52:19.776759] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:19.805189] [DEBUG] [MAIN ] DAY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:19.811427] [INFO ] [MAIN ] DAY: Generated 1352 derivative records from 37479 primary records. [2025-09-14T20:52:19.810443] [DEBUG] [MAIN ] DAVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:19.811693] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-14T20:52:19.813748] [INFO ] [MAIN ] DAVA: Generated 1352 derivative records from 30679 primary records. [2025-09-14T20:52:19.814156] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-14T20:52:19.840613] [DEBUG] [LOCAL ] DAY: Derivative data saved (1352 records). [2025-09-14T20:52:19.841425] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-14T20:52:19.841109] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1352 records). [2025-09-14T20:52:19.852160] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-14T20:52:19.854826] [INFO ] [MAIN ] Derivative Progress: 551/2226 symbols completed. DAY took 1.1s. Estimated remaining: 9m 52s. Rate: 169.9 symbols/min [2025-09-14T20:52:19.858660] [INFO ] [MAIN ] DBD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:19.858808] [INFO ] [MAIN ] Derivative Progress: 552/2226 symbols completed. DAVA took 1.1s. Estimated remaining: 9m 50s. Rate: 170.2 symbols/min [2025-09-14T20:52:19.859576] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:19.877889] [DEBUG] [LOCAL ] DB: Loaded 39472 existing records from primary storage. [2025-09-14T20:52:19.878376] [INFO ] [MAIN ] DB: Loaded 39472 primary data records. [2025-09-14T20:52:20.038026] [DEBUG] [LOCAL ] DBI: Loaded 33452 existing records from primary storage. [2025-09-14T20:52:20.070876] [INFO ] [MAIN ] DBI: Loaded 33452 primary data records. [2025-09-14T20:52:20.077235] [DEBUG] [LOCAL ] DBD: Loaded 18458 existing records from primary storage. [2025-09-14T20:52:20.097887] [INFO ] [MAIN ] DBD: Loaded 18458 primary data records. [2025-09-14T20:52:20.866389] [DEBUG] [MAIN ] DB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:20.868726] [INFO ] [MAIN ] DB: Generated 1352 derivative records from 39472 primary records. [2025-09-14T20:52:20.871549] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-14T20:52:20.891255] [DEBUG] [LOCAL ] DB: Derivative data saved (1352 records). [2025-09-14T20:52:20.892014] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-14T20:52:20.893919] [INFO ] [MAIN ] Derivative Progress: 553/2226 symbols completed. DB took 1.1s. Estimated remaining: 9m 52s. Rate: 169.6 symbols/min [2025-09-14T20:52:20.909491] [DEBUG] [MAIN ] DBI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:20.911162] [INFO ] [MAIN ] DBI: Generated 1352 derivative records from 33452 primary records. [2025-09-14T20:52:20.912057] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-14T20:52:20.931809] [DEBUG] [MAIN ] DBD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:20.937504] [INFO ] [MAIN ] DBD: Generated 1352 derivative records from 18458 primary records. [2025-09-14T20:52:20.937981] [DEBUG] [LOCAL ] DBI: Derivative data saved (1352 records). [2025-09-14T20:52:20.938105] [DEBUG] [LOCAL ] DBD: Saving derivative data. [2025-09-14T20:52:20.938162] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-14T20:52:20.942123] [INFO ] [MAIN ] Derivative Progress: 554/2226 symbols completed. DBI took 1.1s. Estimated remaining: 9m 51s. Rate: 169.9 symbols/min [2025-09-14T20:52:20.955279] [DEBUG] [LOCAL ] DBD: Derivative data saved (1352 records). [2025-09-14T20:52:20.955478] [INFO ] [MAIN ] DBD: Successfully saved derivative data. [2025-09-14T20:52:20.957824] [INFO ] [MAIN ] Derivative Progress: 555/2226 symbols completed. DBD took 1.1s. Estimated remaining: 9m 49s. Rate: 170.2 symbols/min [2025-09-14T20:52:20.958467] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:20.958682] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:20.959104] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:20.970943] [DEBUG] [LOCAL ] DBL: Loaded 7122 existing records from primary storage. [2025-09-14T20:52:20.971157] [INFO ] [MAIN ] DBL: Loaded 7122 primary data records. [2025-09-14T20:52:21.200332] [DEBUG] [LOCAL ] DCI: Loaded 27720 existing records from primary storage. [2025-09-14T20:52:21.290590] [DEBUG] [LOCAL ] DBRG: Loaded 37419 existing records from primary storage. [2025-09-14T20:52:21.291524] [INFO ] [MAIN ] DCI: Loaded 27720 primary data records. [2025-09-14T20:52:21.292248] [INFO ] [MAIN ] DBRG: Loaded 37419 primary data records. [2025-09-14T20:52:21.891408] [DEBUG] [MAIN ] DBL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:21.894521] [INFO ] [MAIN ] DBL: Generated 1352 derivative records from 7122 primary records. [2025-09-14T20:52:21.895388] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-14T20:52:21.910656] [DEBUG] [LOCAL ] DBL: Derivative data saved (1352 records). [2025-09-14T20:52:21.910960] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-14T20:52:21.913570] [INFO ] [MAIN ] Derivative Progress: 556/2226 symbols completed. DBL took 1.0s. Estimated remaining: 9m 51s. Rate: 169.6 symbols/min [2025-09-14T20:52:21.914023] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:21.928757] [DEBUG] [MAIN ] DCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:21.932936] [INFO ] [MAIN ] DCI: Generated 1352 derivative records from 27720 primary records. [2025-09-14T20:52:21.933534] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-14T20:52:21.949939] [DEBUG] [LOCAL ] DCO: Loaded 10870 existing records from primary storage. [2025-09-14T20:52:21.962667] [DEBUG] [LOCAL ] DCI: Derivative data saved (1352 records). [2025-09-14T20:52:21.962854] [INFO ] [MAIN ] DCO: Loaded 10870 primary data records. [2025-09-14T20:52:21.962911] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-14T20:52:21.976792] [INFO ] [MAIN ] Derivative Progress: 557/2226 symbols completed. DCI took 1.0s. Estimated remaining: 9m 49s. Rate: 169.9 symbols/min [2025-09-14T20:52:21.986487] [DEBUG] [MAIN ] DBRG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:22.003975] [INFO ] [MAIN ] DBRG: Generated 1352 derivative records from 37419 primary records. [2025-09-14T20:52:22.030058] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-14T20:52:22.043377] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:22.090492] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1352 records). [2025-09-14T20:52:22.106431] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-14T20:52:22.161670] [INFO ] [MAIN ] Derivative Progress: 558/2226 symbols completed. DBRG took 1.2s. Estimated remaining: 9m 49s. Rate: 170.0 symbols/min [2025-09-14T20:52:22.166949] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:22.291843] [DEBUG] [LOCAL ] DD: Loaded 39762 existing records from primary storage. [2025-09-14T20:52:22.302248] [DEBUG] [MAIN ] DCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:22.302334] [INFO ] [MAIN ] DD: Loaded 39762 primary data records. [2025-09-14T20:52:22.303263] [INFO ] [MAIN ] DCO: Generated 1352 derivative records from 10870 primary records. [2025-09-14T20:52:22.335223] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-14T20:52:22.442061] [DEBUG] [LOCAL ] DDD: Loaded 38100 existing records from primary storage. [2025-09-14T20:52:22.470049] [INFO ] [MAIN ] DDD: Loaded 38100 primary data records. [2025-09-14T20:52:22.459771] [DEBUG] [LOCAL ] DCO: Derivative data saved (1352 records). [2025-09-14T20:52:22.470192] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-14T20:52:22.514467] [INFO ] [MAIN ] Derivative Progress: 559/2226 symbols completed. DCO took 0.6s. Estimated remaining: 9m 48s. Rate: 170.0 symbols/min [2025-09-14T20:52:22.554561] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:22.973421] [DEBUG] [LOCAL ] DDL: Loaded 26209 existing records from primary storage. [2025-09-14T20:52:22.974570] [INFO ] [MAIN ] DDL: Loaded 26209 primary data records. [2025-09-14T20:52:23.090106] [DEBUG] [MAIN ] DD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:23.132318] [INFO ] [MAIN ] DD: Generated 1352 derivative records from 39762 primary records. [2025-09-14T20:52:23.140631] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-14T20:52:23.274277] [DEBUG] [LOCAL ] DD: Derivative data saved (1352 records). [2025-09-14T20:52:23.284037] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-14T20:52:23.286978] [INFO ] [MAIN ] Derivative Progress: 560/2226 symbols completed. DD took 1.3s. Estimated remaining: 9m 49s. Rate: 169.7 symbols/min [2025-09-14T20:52:23.284718] [DEBUG] [MAIN ] DDD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:23.288482] [INFO ] [MAIN ] DDD: Generated 1352 derivative records from 38100 primary records. [2025-09-14T20:52:23.288575] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:23.288810] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-14T20:52:23.304291] [DEBUG] [LOCAL ] DDD: Derivative data saved (1352 records). [2025-09-14T20:52:23.304929] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-14T20:52:23.307882] [INFO ] [MAIN ] Derivative Progress: 561/2226 symbols completed. DDD took 1.1s. Estimated remaining: 9m 48s. Rate: 170.0 symbols/min [2025-09-14T20:52:23.308364] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:23.316078] [DEBUG] [LOCAL ] DDT: Loaded 1389 existing records from primary storage. [2025-09-14T20:52:23.316481] [INFO ] [MAIN ] DDT: Loaded 1389 primary data records. [2025-09-14T20:52:23.371757] [DEBUG] [LOCAL ] DDS: Loaded 9703 existing records from primary storage. [2025-09-14T20:52:23.415695] [INFO ] [MAIN ] DDS: Loaded 9703 primary data records. [2025-09-14T20:52:23.465677] [DEBUG] [MAIN ] DDL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:23.495277] [INFO ] [MAIN ] DDL: Generated 1352 derivative records from 26209 primary records. [2025-09-14T20:52:23.571832] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-14T20:52:23.901104] [DEBUG] [LOCAL ] DDL: Derivative data saved (1352 records). [2025-09-14T20:52:23.901957] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-14T20:52:23.904705] [INFO ] [MAIN ] Derivative Progress: 562/2226 symbols completed. DDL took 1.4s. Estimated remaining: 9m 48s. Rate: 169.8 symbols/min [2025-09-14T20:52:23.905947] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:23.930253] [DEBUG] [MAIN ] DDT: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:52:23.933252] [INFO ] [MAIN ] DDT: Generated 1351 derivative records from 1389 primary records. [2025-09-14T20:52:23.934204] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-14T20:52:23.966103] [DEBUG] [MAIN ] DDS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:23.966382] [DEBUG] [LOCAL ] DDT: Derivative data saved (1351 records). [2025-09-14T20:52:23.967613] [INFO ] [MAIN ] DDS: Generated 1352 derivative records from 9703 primary records. [2025-09-14T20:52:23.968192] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-14T20:52:23.968494] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-14T20:52:23.970869] [INFO ] [MAIN ] Derivative Progress: 563/2226 symbols completed. DDT took 0.7s. Estimated remaining: 9m 47s. Rate: 170.0 symbols/min [2025-09-14T20:52:23.971199] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:23.993683] [DEBUG] [LOCAL ] DE: Loaded 35483 existing records from primary storage. [2025-09-14T20:52:23.993881] [INFO ] [MAIN ] DE: Loaded 35483 primary data records. [2025-09-14T20:52:24.153211] [DEBUG] [LOCAL ] DDS: Derivative data saved (1352 records). [2025-09-14T20:52:24.196953] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-14T20:52:24.200606] [INFO ] [MAIN ] Derivative Progress: 564/2226 symbols completed. DDS took 0.9s. Estimated remaining: 9m 46s. Rate: 170.1 symbols/min [2025-09-14T20:52:24.285994] [DEBUG] [LOCAL ] DEA: Loaded 29951 existing records from primary storage. [2025-09-14T20:52:24.292928] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:24.293256] [INFO ] [MAIN ] DEA: Loaded 29951 primary data records. [2025-09-14T20:52:24.534136] [DEBUG] [LOCAL ] DEC: Loaded 21746 existing records from primary storage. [2025-09-14T20:52:24.547805] [INFO ] [MAIN ] DEC: Loaded 21746 primary data records. [2025-09-14T20:52:24.777590] [DEBUG] [MAIN ] DE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:24.846033] [INFO ] [MAIN ] DE: Generated 1352 derivative records from 35483 primary records. [2025-09-14T20:52:24.851722] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-14T20:52:24.963168] [DEBUG] [LOCAL ] DE: Derivative data saved (1352 records). [2025-09-14T20:52:24.964986] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-14T20:52:24.968023] [INFO ] [MAIN ] Derivative Progress: 565/2226 symbols completed. DE took 1.1s. Estimated remaining: 9m 47s. Rate: 169.8 symbols/min [2025-09-14T20:52:24.969187] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:24.986195] [DEBUG] [MAIN ] DEA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:24.988253] [INFO ] [MAIN ] DEA: Generated 1352 derivative records from 29951 primary records. [2025-09-14T20:52:24.988882] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-14T20:52:25.015135] [DEBUG] [MAIN ] DEC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:25.017351] [INFO ] [MAIN ] DEC: Generated 1352 derivative records from 21746 primary records. [2025-09-14T20:52:25.018212] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-14T20:52:25.019867] [DEBUG] [LOCAL ] DEA: Derivative data saved (1352 records). [2025-09-14T20:52:25.039376] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-14T20:52:25.045024] [INFO ] [MAIN ] Derivative Progress: 566/2226 symbols completed. DEA took 1.1s. Estimated remaining: 9m 46s. Rate: 170.0 symbols/min [2025-09-14T20:52:25.042459] [DEBUG] [LOCAL ] DEC: Derivative data saved (1352 records). [2025-09-14T20:52:25.045767] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-14T20:52:25.046033] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:25.048667] [INFO ] [MAIN ] Derivative Progress: 567/2226 symbols completed. DEC took 0.8s. Estimated remaining: 9m 45s. Rate: 170.3 symbols/min [2025-09-14T20:52:25.049738] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:25.066598] [DEBUG] [LOCAL ] DECK: Loaded 40114 existing records from primary storage. [2025-09-14T20:52:25.066959] [INFO ] [MAIN ] DECK: Loaded 40114 primary data records. [2025-09-14T20:52:25.292112] [DEBUG] [LOCAL ] DEI: Loaded 36290 existing records from primary storage. [2025-09-14T20:52:25.391348] [INFO ] [MAIN ] DEI: Loaded 36290 primary data records. [2025-09-14T20:52:25.435554] [DEBUG] [LOCAL ] DELL: Loaded 40477 existing records from primary storage. [2025-09-14T20:52:25.475854] [INFO ] [MAIN ] DELL: Loaded 40477 primary data records. [2025-09-14T20:52:26.060267] [DEBUG] [MAIN ] DECK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:26.062420] [INFO ] [MAIN ] DECK: Generated 1352 derivative records from 40114 primary records. [2025-09-14T20:52:26.064475] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-14T20:52:26.082315] [DEBUG] [LOCAL ] DECK: Derivative data saved (1352 records). [2025-09-14T20:52:26.084393] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-14T20:52:26.087730] [INFO ] [MAIN ] Derivative Progress: 568/2226 symbols completed. DECK took 1.1s. Estimated remaining: 9m 46s. Rate: 169.7 symbols/min [2025-09-14T20:52:26.100251] [DEBUG] [MAIN ] DEI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:26.101223] [INFO ] [MAIN ] DEI: Generated 1352 derivative records from 36290 primary records. [2025-09-14T20:52:26.101526] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-14T20:52:26.118082] [DEBUG] [LOCAL ] DEI: Derivative data saved (1352 records). [2025-09-14T20:52:26.128922] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-14T20:52:26.131739] [INFO ] [MAIN ] Derivative Progress: 569/2226 symbols completed. DEI took 1.1s. Estimated remaining: 9m 45s. Rate: 170.0 symbols/min [2025-09-14T20:52:26.129241] [DEBUG] [MAIN ] DELL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:26.132954] [INFO ] [MAIN ] DELL: Generated 1352 derivative records from 40477 primary records. [2025-09-14T20:52:26.133076] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-14T20:52:26.146595] [DEBUG] [LOCAL ] DELL: Derivative data saved (1352 records). [2025-09-14T20:52:26.146787] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-14T20:52:26.149084] [INFO ] [MAIN ] Derivative Progress: 570/2226 symbols completed. DELL took 1.1s. Estimated remaining: 9m 44s. Rate: 170.2 symbols/min [2025-09-14T20:52:26.149721] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:26.149811] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:26.149900] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:26.170530] [DEBUG] [LOCAL ] DFIN: Loaded 16451 existing records from primary storage. [2025-09-14T20:52:26.170815] [INFO ] [MAIN ] DFIN: Loaded 16451 primary data records. [2025-09-14T20:52:26.309768] [DEBUG] [LOCAL ] DFH: Loaded 24215 existing records from primary storage. [2025-09-14T20:52:26.336739] [INFO ] [MAIN ] DFH: Loaded 24215 primary data records. [2025-09-14T20:52:26.450388] [DEBUG] [LOCAL ] DEO: Loaded 36454 existing records from primary storage. [2025-09-14T20:52:26.463917] [INFO ] [MAIN ] DEO: Loaded 36454 primary data records. [2025-09-14T20:52:27.091714] [DEBUG] [MAIN ] DFIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:27.094468] [INFO ] [MAIN ] DFIN: Generated 1352 derivative records from 16451 primary records. [2025-09-14T20:52:27.095184] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-14T20:52:27.114381] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1352 records). [2025-09-14T20:52:27.114726] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-14T20:52:27.124434] [INFO ] [MAIN ] Derivative Progress: 571/2226 symbols completed. DFIN took 1.0s. Estimated remaining: 9m 45s. Rate: 169.7 symbols/min [2025-09-14T20:52:27.128807] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:27.130302] [DEBUG] [MAIN ] DEO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:27.131715] [INFO ] [MAIN ] DEO: Generated 1352 derivative records from 36454 primary records. [2025-09-14T20:52:27.132037] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-14T20:52:27.147469] [DEBUG] [MAIN ] DFH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:27.160654] [DEBUG] [LOCAL ] DEO: Derivative data saved (1352 records). [2025-09-14T20:52:27.161736] [INFO ] [MAIN ] DFH: Generated 1352 derivative records from 24215 primary records. [2025-09-14T20:52:27.162139] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-14T20:52:27.166402] [DEBUG] [LOCAL ] DFP: Loaded 8600 existing records from primary storage. [2025-09-14T20:52:27.168630] [INFO ] [MAIN ] Derivative Progress: 572/2226 symbols completed. DEO took 1.0s. Estimated remaining: 9m 44s. Rate: 170.0 symbols/min [2025-09-14T20:52:27.168745] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-14T20:52:27.169431] [INFO ] [MAIN ] DFP: Loaded 8600 primary data records. [2025-09-14T20:52:27.170573] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:27.242117] [DEBUG] [LOCAL ] DFH: Derivative data saved (1352 records). [2025-09-14T20:52:27.279484] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-14T20:52:27.293323] [INFO ] [MAIN ] Derivative Progress: 573/2226 symbols completed. DFH took 1.1s. Estimated remaining: 9m 43s. Rate: 170.2 symbols/min [2025-09-14T20:52:27.305187] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:27.511811] [DEBUG] [LOCAL ] DG: Loaded 40084 existing records from primary storage. [2025-09-14T20:52:27.512995] [INFO ] [MAIN ] DG: Loaded 40084 primary data records. [2025-09-14T20:52:27.654476] [DEBUG] [LOCAL ] DGX: Loaded 33788 existing records from primary storage. [2025-09-14T20:52:27.661129] [INFO ] [MAIN ] DGX: Loaded 33788 primary data records. [2025-09-14T20:52:27.999062] [DEBUG] [MAIN ] DFP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:28.019262] [INFO ] [MAIN ] DFP: Generated 1352 derivative records from 8600 primary records. [2025-09-14T20:52:28.020184] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-14T20:52:28.114098] [DEBUG] [LOCAL ] DFP: Derivative data saved (1352 records). [2025-09-14T20:52:28.193878] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-14T20:52:28.207356] [INFO ] [MAIN ] Derivative Progress: 574/2226 symbols completed. DFP took 1.1s. Estimated remaining: 9m 44s. Rate: 169.7 symbols/min [2025-09-14T20:52:28.208294] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:28.232057] [DEBUG] [MAIN ] DG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:28.232917] [INFO ] [MAIN ] DG: Generated 1352 derivative records from 40084 primary records. [2025-09-14T20:52:28.233473] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-14T20:52:28.240571] [DEBUG] [LOCAL ] DHF: Loaded 16009 existing records from primary storage. [2025-09-14T20:52:28.250208] [INFO ] [MAIN ] DHF: Loaded 16009 primary data records. [2025-09-14T20:52:28.310149] [DEBUG] [LOCAL ] DG: Derivative data saved (1352 records). [2025-09-14T20:52:28.338660] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-14T20:52:28.366301] [INFO ] [MAIN ] Derivative Progress: 575/2226 symbols completed. DG took 1.2s. Estimated remaining: 9m 43s. Rate: 169.9 symbols/min [2025-09-14T20:52:28.367130] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:28.378516] [DEBUG] [MAIN ] DGX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:28.406886] [INFO ] [MAIN ] DGX: Generated 1352 derivative records from 33788 primary records. [2025-09-14T20:52:28.447276] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-14T20:52:28.581302] [DEBUG] [LOCAL ] DGX: Derivative data saved (1352 records). [2025-09-14T20:52:28.582385] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-14T20:52:28.585357] [INFO ] [MAIN ] Derivative Progress: 576/2226 symbols completed. DGX took 1.3s. Estimated remaining: 9m 42s. Rate: 170.0 symbols/min [2025-09-14T20:52:28.585634] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:28.622074] [DEBUG] [LOCAL ] DHI: Loaded 40196 existing records from primary storage. [2025-09-14T20:52:28.623366] [INFO ] [MAIN ] DHI: Loaded 40196 primary data records. [2025-09-14T20:52:28.729604] [DEBUG] [MAIN ] DHF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:28.752367] [INFO ] [MAIN ] DHF: Generated 1352 derivative records from 16009 primary records. [2025-09-14T20:52:28.793626] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-14T20:52:28.844352] [DEBUG] [LOCAL ] DHR: Loaded 40171 existing records from primary storage. [2025-09-14T20:52:28.845381] [INFO ] [MAIN ] DHR: Loaded 40171 primary data records. [2025-09-14T20:52:29.012520] [DEBUG] [LOCAL ] DHF: Derivative data saved (1352 records). [2025-09-14T20:52:29.038317] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-14T20:52:29.064569] [INFO ] [MAIN ] Derivative Progress: 577/2226 symbols completed. DHF took 0.9s. Estimated remaining: 9m 42s. Rate: 169.9 symbols/min [2025-09-14T20:52:29.071430] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:29.256369] [DEBUG] [MAIN ] DHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:29.257268] [INFO ] [MAIN ] DHI: Generated 1352 derivative records from 40196 primary records. [2025-09-14T20:52:29.266824] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-14T20:52:29.280257] [DEBUG] [LOCAL ] DHI: Derivative data saved (1352 records). [2025-09-14T20:52:29.280634] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-14T20:52:29.283618] [INFO ] [MAIN ] Derivative Progress: 578/2226 symbols completed. DHI took 0.9s. Estimated remaining: 9m 42s. Rate: 170.0 symbols/min [2025-09-14T20:52:29.287173] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:29.299660] [DEBUG] [LOCAL ] DHT: Loaded 35605 existing records from primary storage. [2025-09-14T20:52:29.311093] [DEBUG] [MAIN ] DHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:29.311603] [INFO ] [MAIN ] DHT: Loaded 35605 primary data records. [2025-09-14T20:52:29.312935] [INFO ] [MAIN ] DHR: Generated 1352 derivative records from 40171 primary records. [2025-09-14T20:52:29.318246] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-14T20:52:29.438402] [DEBUG] [LOCAL ] DHX: Loaded 9236 existing records from primary storage. [2025-09-14T20:52:29.444739] [DEBUG] [LOCAL ] DHR: Derivative data saved (1352 records). [2025-09-14T20:52:29.445088] [INFO ] [MAIN ] DHX: Loaded 9236 primary data records. [2025-09-14T20:52:29.445353] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-14T20:52:29.447945] [INFO ] [MAIN ] Derivative Progress: 579/2226 symbols completed. DHR took 0.9s. Estimated remaining: 9m 41s. Rate: 170.1 symbols/min [2025-09-14T20:52:29.485852] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:29.844741] [DEBUG] [LOCAL ] DIAX: Loaded 8704 existing records from primary storage. [2025-09-14T20:52:29.890104] [INFO ] [MAIN ] DIAX: Loaded 8704 primary data records. [2025-09-14T20:52:30.293578] [DEBUG] [MAIN ] DHT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:30.295870] [INFO ] [MAIN ] DHT: Generated 1352 derivative records from 35605 primary records. [2025-09-14T20:52:30.296610] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-14T20:52:30.324994] [DEBUG] [LOCAL ] DHT: Derivative data saved (1352 records). [2025-09-14T20:52:30.326192] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-14T20:52:30.326636] [DEBUG] [MAIN ] DHX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:30.329177] [INFO ] [MAIN ] Derivative Progress: 580/2226 symbols completed. DHT took 1.3s. Estimated remaining: 9m 42s. Rate: 169.7 symbols/min [2025-09-14T20:52:30.330308] [INFO ] [MAIN ] DHX: Generated 1352 derivative records from 9236 primary records. [2025-09-14T20:52:30.330593] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-14T20:52:30.331187] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:30.345907] [DEBUG] [LOCAL ] DHX: Derivative data saved (1352 records). [2025-09-14T20:52:30.346098] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-14T20:52:30.349848] [INFO ] [MAIN ] Derivative Progress: 581/2226 symbols completed. DHX took 1.1s. Estimated remaining: 9m 41s. Rate: 170.0 symbols/min [2025-09-14T20:52:30.351930] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:30.363472] [DEBUG] [MAIN ] DIAX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:30.364386] [INFO ] [MAIN ] DIAX: Generated 1352 derivative records from 8704 primary records. [2025-09-14T20:52:30.364488] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-14T20:52:30.387708] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1352 records). [2025-09-14T20:52:30.388189] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-14T20:52:30.390487] [INFO ] [MAIN ] Derivative Progress: 582/2226 symbols completed. DIAX took 0.9s. Estimated remaining: 9m 39s. Rate: 170.2 symbols/min [2025-09-14T20:52:30.390975] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:30.406040] [DEBUG] [LOCAL ] DIN: Loaded 27267 existing records from primary storage. [2025-09-14T20:52:30.406367] [INFO ] [MAIN ] DIN: Loaded 27267 primary data records. [2025-09-14T20:52:30.575542] [DEBUG] [LOCAL ] DINO: Loaded 39866 existing records from primary storage. [2025-09-14T20:52:30.605875] [INFO ] [MAIN ] DINO: Loaded 39866 primary data records. [2025-09-14T20:52:30.829249] [DEBUG] [LOCAL ] DIS: Loaded 40528 existing records from primary storage. [2025-09-14T20:52:30.854053] [INFO ] [MAIN ] DIS: Loaded 40528 primary data records. [2025-09-14T20:52:31.337454] [DEBUG] [MAIN ] DIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:31.341497] [INFO ] [MAIN ] DIN: Generated 1352 derivative records from 27267 primary records. [2025-09-14T20:52:31.341855] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-14T20:52:31.359245] [DEBUG] [LOCAL ] DIN: Derivative data saved (1352 records). [2025-09-14T20:52:31.359753] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-14T20:52:31.362261] [INFO ] [MAIN ] Derivative Progress: 583/2226 symbols completed. DIN took 1.0s. Estimated remaining: 9m 41s. Rate: 169.7 symbols/min [2025-09-14T20:52:31.378279] [DEBUG] [MAIN ] DINO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:31.379075] [INFO ] [MAIN ] DINO: Generated 1352 derivative records from 39866 primary records. [2025-09-14T20:52:31.379262] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-14T20:52:31.404227] [DEBUG] [LOCAL ] DINO: Derivative data saved (1352 records). [2025-09-14T20:52:31.404538] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-14T20:52:31.404894] [DEBUG] [MAIN ] DIS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:31.407376] [INFO ] [MAIN ] Derivative Progress: 584/2226 symbols completed. DINO took 1.1s. Estimated remaining: 9m 40s. Rate: 170.0 symbols/min [2025-09-14T20:52:31.408555] [INFO ] [MAIN ] DIS: Generated 1352 derivative records from 40528 primary records. [2025-09-14T20:52:31.408675] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-14T20:52:31.421427] [DEBUG] [LOCAL ] DIS: Derivative data saved (1352 records). [2025-09-14T20:52:31.421507] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-14T20:52:31.423656] [INFO ] [MAIN ] Derivative Progress: 585/2226 symbols completed. DIS took 1.0s. Estimated remaining: 9m 38s. Rate: 170.3 symbols/min [2025-09-14T20:52:31.424500] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:31.424598] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:31.424778] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:31.451711] [DEBUG] [LOCAL ] DKL: Loaded 13168 existing records from primary storage. [2025-09-14T20:52:31.452329] [INFO ] [MAIN ] DKL: Loaded 13168 primary data records. [2025-09-14T20:52:31.700625] [DEBUG] [LOCAL ] DKS: Loaded 37372 existing records from primary storage. [2025-09-14T20:52:31.701910] [DEBUG] [LOCAL ] DK: Loaded 37241 existing records from primary storage. [2025-09-14T20:52:31.797497] [INFO ] [MAIN ] DK: Loaded 37241 primary data records. [2025-09-14T20:52:31.797609] [INFO ] [MAIN ] DKS: Loaded 37372 primary data records. [2025-09-14T20:52:32.396952] [DEBUG] [MAIN ] DKL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:32.400043] [INFO ] [MAIN ] DKL: Generated 1352 derivative records from 13168 primary records. [2025-09-14T20:52:32.400280] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-14T20:52:32.416634] [DEBUG] [LOCAL ] DKL: Derivative data saved (1352 records). [2025-09-14T20:52:32.417129] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-14T20:52:32.419608] [INFO ] [MAIN ] Derivative Progress: 586/2226 symbols completed. DKL took 1.0s. Estimated remaining: 9m 40s. Rate: 169.7 symbols/min [2025-09-14T20:52:32.420436] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:32.441013] [DEBUG] [MAIN ] DKS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:32.451712] [INFO ] [MAIN ] DKS: Generated 1352 derivative records from 37372 primary records. [2025-09-14T20:52:32.452223] [DEBUG] [MAIN ] DK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:32.459330] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-14T20:52:32.460038] [INFO ] [MAIN ] DK: Generated 1352 derivative records from 37241 primary records. [2025-09-14T20:52:32.461060] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-14T20:52:32.474191] [DEBUG] [LOCAL ] DKS: Derivative data saved (1352 records). [2025-09-14T20:52:32.474684] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-14T20:52:32.489715] [INFO ] [MAIN ] Derivative Progress: 587/2226 symbols completed. DKS took 1.1s. Estimated remaining: 9m 39s. Rate: 170.0 symbols/min [2025-09-14T20:52:32.492581] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:32.497912] [DEBUG] [LOCAL ] DLB: Loaded 23969 existing records from primary storage. [2025-09-14T20:52:32.499734] [DEBUG] [LOCAL ] DK: Derivative data saved (1352 records). [2025-09-14T20:52:32.499995] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-14T20:52:32.500232] [INFO ] [MAIN ] DLB: Loaded 23969 primary data records. [2025-09-14T20:52:32.503079] [INFO ] [MAIN ] Derivative Progress: 588/2226 symbols completed. DK took 1.1s. Estimated remaining: 9m 37s. Rate: 170.2 symbols/min [2025-09-14T20:52:32.503938] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:32.574054] [DEBUG] [LOCAL ] DLNG: Loaded 4441 existing records from primary storage. [2025-09-14T20:52:32.611187] [INFO ] [MAIN ] DLNG: Loaded 4441 primary data records. [2025-09-14T20:52:32.964843] [DEBUG] [LOCAL ] DLR: Loaded 38217 existing records from primary storage. [2025-09-14T20:52:32.981838] [INFO ] [MAIN ] DLR: Loaded 38217 primary data records. [2025-09-14T20:52:33.463815] [DEBUG] [MAIN ] DLB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:33.465342] [INFO ] [MAIN ] DLB: Generated 1352 derivative records from 23969 primary records. [2025-09-14T20:52:33.465674] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-14T20:52:33.483100] [DEBUG] [LOCAL ] DLB: Derivative data saved (1352 records). [2025-09-14T20:52:33.484726] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-14T20:52:33.488051] [INFO ] [MAIN ] Derivative Progress: 589/2226 symbols completed. DLB took 1.1s. Estimated remaining: 9m 39s. Rate: 169.7 symbols/min [2025-09-14T20:52:33.488893] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:33.501876] [DEBUG] [MAIN ] DLNG: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:52:33.506475] [INFO ] [MAIN ] DLNG: Generated 1351 derivative records from 4441 primary records. [2025-09-14T20:52:33.506959] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-14T20:52:33.530181] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1351 records). [2025-09-14T20:52:33.529119] [DEBUG] [MAIN ] DLR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:33.530556] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-14T20:52:33.531636] [INFO ] [MAIN ] DLR: Generated 1352 derivative records from 38217 primary records. [2025-09-14T20:52:33.538438] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-14T20:52:33.540839] [INFO ] [MAIN ] Derivative Progress: 590/2226 symbols completed. DLNG took 1.0s. Estimated remaining: 9m 38s. Rate: 170.0 symbols/min [2025-09-14T20:52:33.542319] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:33.569659] [DEBUG] [LOCAL ] DLR: Derivative data saved (1352 records). [2025-09-14T20:52:33.570007] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-14T20:52:33.572818] [INFO ] [MAIN ] Derivative Progress: 591/2226 symbols completed. DLR took 1.1s. Estimated remaining: 9m 36s. Rate: 170.2 symbols/min [2025-09-14T20:52:33.570499] [DEBUG] [LOCAL ] DLX: Loaded 21803 existing records from primary storage. [2025-09-14T20:52:33.576615] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:33.576725] [INFO ] [MAIN ] DLX: Loaded 21803 primary data records. [2025-09-14T20:52:33.670599] [DEBUG] [LOCAL ] DLY: Loaded 13869 existing records from primary storage. [2025-09-14T20:52:33.692063] [DEBUG] [LOCAL ] DMA: Loaded 3632 existing records from primary storage. [2025-09-14T20:52:33.696083] [INFO ] [MAIN ] DMA: Loaded 3632 primary data records. [2025-09-14T20:52:33.695541] [INFO ] [MAIN ] DLY: Loaded 13869 primary data records. [2025-09-14T20:52:34.462668] [DEBUG] [MAIN ] DLX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:34.465597] [INFO ] [MAIN ] DLX: Generated 1352 derivative records from 21803 primary records. [2025-09-14T20:52:34.466685] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-14T20:52:34.483993] [DEBUG] [LOCAL ] DLX: Derivative data saved (1352 records). [2025-09-14T20:52:34.497587] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-14T20:52:34.498368] [DEBUG] [MAIN ] DMA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:34.501924] [INFO ] [MAIN ] DMA: Generated 1352 derivative records from 3632 primary records. [2025-09-14T20:52:34.500862] [INFO ] [MAIN ] Derivative Progress: 592/2226 symbols completed. DLX took 1.0s. Estimated remaining: 9m 38s. Rate: 169.8 symbols/min [2025-09-14T20:52:34.502159] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-14T20:52:34.502502] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:34.514123] [DEBUG] [MAIN ] DLY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:34.523240] [INFO ] [MAIN ] DLY: Generated 1352 derivative records from 13869 primary records. [2025-09-14T20:52:34.525389] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-14T20:52:34.528420] [DEBUG] [LOCAL ] DMA: Derivative data saved (1352 records). [2025-09-14T20:52:34.537375] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-14T20:52:34.543297] [DEBUG] [LOCAL ] DLY: Derivative data saved (1352 records). [2025-09-14T20:52:34.545990] [INFO ] [MAIN ] Derivative Progress: 593/2226 symbols completed. DMA took 1.0s. Estimated remaining: 9m 36s. Rate: 170.0 symbols/min [2025-09-14T20:52:34.546280] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-14T20:52:34.546613] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:34.553678] [DEBUG] [LOCAL ] DMB: Loaded 8087 existing records from primary storage. [2025-09-14T20:52:34.553263] [INFO ] [MAIN ] Derivative Progress: 594/2226 symbols completed. DLY took 1.0s. Estimated remaining: 9m 35s. Rate: 170.3 symbols/min [2025-09-14T20:52:34.554477] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:34.554260] [INFO ] [MAIN ] DMB: Loaded 8087 primary data records. [2025-09-14T20:52:34.649974] [DEBUG] [LOCAL ] DMO: Loaded 7071 existing records from primary storage. [2025-09-14T20:52:34.668023] [INFO ] [MAIN ] DMO: Loaded 7071 primary data records. [2025-09-14T20:52:35.025517] [DEBUG] [LOCAL ] DNA: Loaded 36266 existing records from primary storage. [2025-09-14T20:52:35.116884] [INFO ] [MAIN ] DNA: Loaded 36266 primary data records. [2025-09-14T20:52:35.519469] [DEBUG] [MAIN ] DMB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:35.520828] [INFO ] [MAIN ] DMB: Generated 1352 derivative records from 8087 primary records. [2025-09-14T20:52:35.522798] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-14T20:52:35.550125] [DEBUG] [LOCAL ] DMB: Derivative data saved (1352 records). [2025-09-14T20:52:35.550734] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-14T20:52:35.550503] [DEBUG] [MAIN ] DMO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:35.554477] [INFO ] [MAIN ] DMO: Generated 1352 derivative records from 7071 primary records. [2025-09-14T20:52:35.553069] [INFO ] [MAIN ] Derivative Progress: 595/2226 symbols completed. DMB took 1.1s. Estimated remaining: 9m 36s. Rate: 169.8 symbols/min [2025-09-14T20:52:35.554942] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:35.556219] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-14T20:52:35.571091] [DEBUG] [LOCAL ] DMO: Derivative data saved (1352 records). [2025-09-14T20:52:35.571347] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-14T20:52:35.573871] [INFO ] [MAIN ] Derivative Progress: 596/2226 symbols completed. DMO took 1.0s. Estimated remaining: 9m 35s. Rate: 170.0 symbols/min [2025-09-14T20:52:35.574407] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:35.604751] [DEBUG] [MAIN ] DNA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:35.605761] [INFO ] [MAIN ] DNA: Generated 1352 derivative records from 36266 primary records. [2025-09-14T20:52:35.605951] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-14T20:52:35.643844] [DEBUG] [LOCAL ] DNP: Loaded 24884 existing records from primary storage. [2025-09-14T20:52:35.643941] [DEBUG] [LOCAL ] DNOW: Loaded 32346 existing records from primary storage. [2025-09-14T20:52:35.644466] [DEBUG] [LOCAL ] DNA: Derivative data saved (1352 records). [2025-09-14T20:52:35.644781] [INFO ] [MAIN ] DNOW: Loaded 32346 primary data records. [2025-09-14T20:52:35.644840] [INFO ] [MAIN ] DNP: Loaded 24884 primary data records. [2025-09-14T20:52:35.645347] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-14T20:52:35.659079] [INFO ] [MAIN ] Derivative Progress: 597/2226 symbols completed. DNA took 1.1s. Estimated remaining: 9m 34s. Rate: 170.3 symbols/min [2025-09-14T20:52:35.683167] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:36.245551] [DEBUG] [LOCAL ] DOC: Loaded 40314 existing records from primary storage. [2025-09-14T20:52:36.246450] [INFO ] [MAIN ] DOC: Loaded 40314 primary data records. [2025-09-14T20:52:36.582579] [DEBUG] [MAIN ] DNOW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:36.587624] [DEBUG] [MAIN ] DNP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:36.590521] [INFO ] [MAIN ] DNP: Generated 1352 derivative records from 24884 primary records. [2025-09-14T20:52:36.590678] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-14T20:52:36.589573] [INFO ] [MAIN ] DNOW: Generated 1352 derivative records from 32346 primary records. [2025-09-14T20:52:36.591925] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-14T20:52:36.607145] [DEBUG] [LOCAL ] DNP: Derivative data saved (1352 records). [2025-09-14T20:52:36.607436] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-14T20:52:36.609804] [INFO ] [MAIN ] Derivative Progress: 598/2226 symbols completed. DNP took 1.0s. Estimated remaining: 9m 35s. Rate: 169.8 symbols/min [2025-09-14T20:52:36.623976] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1352 records). [2025-09-14T20:52:36.624357] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-14T20:52:36.626750] [INFO ] [MAIN ] Derivative Progress: 599/2226 symbols completed. DNOW took 1.1s. Estimated remaining: 9m 34s. Rate: 170.0 symbols/min [2025-09-14T20:52:36.640008] [DEBUG] [MAIN ] DOC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:36.640849] [INFO ] [MAIN ] DOC: Generated 1352 derivative records from 40314 primary records. [2025-09-14T20:52:36.640934] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-14T20:52:36.654008] [DEBUG] [LOCAL ] DOC: Derivative data saved (1352 records). [2025-09-14T20:52:36.654143] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-14T20:52:36.656403] [INFO ] [MAIN ] Derivative Progress: 600/2226 symbols completed. DOC took 1.0s. Estimated remaining: 9m 33s. Rate: 170.3 symbols/min [2025-09-14T20:52:36.657759] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:36.657910] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:36.658049] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:36.724578] [DEBUG] [LOCAL ] DOLE: Loaded 28724 existing records from primary storage. [2025-09-14T20:52:36.726567] [INFO ] [MAIN ] DOLE: Loaded 28724 primary data records. [2025-09-14T20:52:36.739181] [DEBUG] [LOCAL ] DOCS: Loaded 38355 existing records from primary storage. [2025-09-14T20:52:36.792470] [INFO ] [MAIN ] DOCS: Loaded 38355 primary data records. [2025-09-14T20:52:36.921125] [DEBUG] [LOCAL ] DOCN: Loaded 38164 existing records from primary storage. [2025-09-14T20:52:36.976972] [INFO ] [MAIN ] DOCN: Loaded 38164 primary data records. [2025-09-14T20:52:37.698344] [DEBUG] [MAIN ] DOCS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:37.710534] [INFO ] [MAIN ] DOCS: Generated 1352 derivative records from 38355 primary records. [2025-09-14T20:52:37.711137] [DEBUG] [MAIN ] DOLE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:37.711395] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-14T20:52:37.711966] [INFO ] [MAIN ] DOLE: Generated 1352 derivative records from 28724 primary records. [2025-09-14T20:52:37.713812] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-14T20:52:37.737006] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1352 records). [2025-09-14T20:52:37.750826] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-14T20:52:37.753181] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1352 records). [2025-09-14T20:52:37.753483] [DEBUG] [MAIN ] DOCN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:37.756328] [INFO ] [MAIN ] Derivative Progress: 601/2226 symbols completed. DOCS took 1.1s. Estimated remaining: 9m 35s. Rate: 169.7 symbols/min [2025-09-14T20:52:37.757023] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-14T20:52:37.758288] [INFO ] [MAIN ] DOCN: Generated 1352 derivative records from 38164 primary records. [2025-09-14T20:52:37.760315] [INFO ] [MAIN ] Derivative Progress: 602/2226 symbols completed. DOLE took 1.1s. Estimated remaining: 9m 33s. Rate: 170.0 symbols/min [2025-09-14T20:52:37.758350] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:37.760498] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-14T20:52:37.760821] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:37.776180] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1352 records). [2025-09-14T20:52:37.776379] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-14T20:52:37.778452] [INFO ] [MAIN ] Derivative Progress: 603/2226 symbols completed. DOCN took 1.1s. Estimated remaining: 9m 32s. Rate: 170.2 symbols/min [2025-09-14T20:52:37.778766] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:37.813805] [DEBUG] [LOCAL ] DOUG: Loaded 26246 existing records from primary storage. [2025-09-14T20:52:37.814063] [INFO ] [MAIN ] DOUG: Loaded 26246 primary data records. [2025-09-14T20:52:37.932764] [DEBUG] [LOCAL ] DOV: Loaded 33991 existing records from primary storage. [2025-09-14T20:52:37.944839] [INFO ] [MAIN ] DOV: Loaded 33991 primary data records. [2025-09-14T20:52:38.048363] [DEBUG] [LOCAL ] DOW: Loaded 40473 existing records from primary storage. [2025-09-14T20:52:38.121699] [INFO ] [MAIN ] DOW: Loaded 40473 primary data records. [2025-09-14T20:52:38.746068] [DEBUG] [MAIN ] DOUG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:38.748273] [INFO ] [MAIN ] DOUG: Generated 1352 derivative records from 26246 primary records. [2025-09-14T20:52:38.749332] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-14T20:52:38.771613] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1352 records). [2025-09-14T20:52:38.774195] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-14T20:52:38.778510] [INFO ] [MAIN ] Derivative Progress: 604/2226 symbols completed. DOUG took 1.0s. Estimated remaining: 9m 33s. Rate: 169.7 symbols/min [2025-09-14T20:52:38.779579] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:38.792458] [DEBUG] [MAIN ] DOV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:38.794722] [INFO ] [MAIN ] DOV: Generated 1352 derivative records from 33991 primary records. [2025-09-14T20:52:38.795333] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-14T20:52:38.819534] [DEBUG] [LOCAL ] DOV: Derivative data saved (1352 records). [2025-09-14T20:52:38.823960] [DEBUG] [MAIN ] DOW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:38.828705] [INFO ] [MAIN ] DOW: Generated 1352 derivative records from 40473 primary records. [2025-09-14T20:52:38.824337] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-14T20:52:38.831621] [INFO ] [MAIN ] Derivative Progress: 605/2226 symbols completed. DOV took 1.1s. Estimated remaining: 9m 32s. Rate: 170.0 symbols/min [2025-09-14T20:52:38.828907] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-14T20:52:38.832966] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:38.855235] [DEBUG] [LOCAL ] DOW: Derivative data saved (1352 records). [2025-09-14T20:52:38.855406] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-14T20:52:38.855519] [DEBUG] [LOCAL ] DPG: Loaded 9966 existing records from primary storage. [2025-09-14T20:52:38.858458] [INFO ] [MAIN ] Derivative Progress: 606/2226 symbols completed. DOW took 1.1s. Estimated remaining: 9m 31s. Rate: 170.2 symbols/min [2025-09-14T20:52:38.858740] [INFO ] [MAIN ] DPG: Loaded 9966 primary data records. [2025-09-14T20:52:38.859105] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:39.085907] [DEBUG] [LOCAL ] DQ: Loaded 31915 existing records from primary storage. [2025-09-14T20:52:39.086238] [INFO ] [MAIN ] DQ: Loaded 31915 primary data records. [2025-09-14T20:52:39.298726] [DEBUG] [LOCAL ] DRD: Loaded 26676 existing records from primary storage. [2025-09-14T20:52:39.320914] [INFO ] [MAIN ] DRD: Loaded 26676 primary data records. [2025-09-14T20:52:39.862246] [DEBUG] [MAIN ] DPG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:39.864325] [INFO ] [MAIN ] DPG: Generated 1352 derivative records from 9966 primary records. [2025-09-14T20:52:39.865853] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-14T20:52:39.884129] [DEBUG] [LOCAL ] DPG: Derivative data saved (1352 records). [2025-09-14T20:52:39.885312] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-14T20:52:39.887349] [INFO ] [MAIN ] Derivative Progress: 607/2226 symbols completed. DPG took 1.1s. Estimated remaining: 9m 32s. Rate: 169.7 symbols/min [2025-09-14T20:52:39.888096] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:39.902720] [DEBUG] [MAIN ] DQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:39.903894] [INFO ] [MAIN ] DQ: Generated 1352 derivative records from 31915 primary records. [2025-09-14T20:52:39.904261] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-14T20:52:39.927562] [DEBUG] [MAIN ] DRD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:39.931514] [INFO ] [MAIN ] DRD: Generated 1352 derivative records from 26676 primary records. [2025-09-14T20:52:39.932158] [DEBUG] [LOCAL ] DQ: Derivative data saved (1352 records). [2025-09-14T20:52:39.932366] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-14T20:52:39.932590] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-14T20:52:39.935666] [INFO ] [MAIN ] Derivative Progress: 608/2226 symbols completed. DQ took 1.1s. Estimated remaining: 9m 31s. Rate: 169.9 symbols/min [2025-09-14T20:52:39.945885] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:39.960036] [DEBUG] [LOCAL ] DRD: Derivative data saved (1352 records). [2025-09-14T20:52:39.960260] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-14T20:52:39.962984] [INFO ] [MAIN ] Derivative Progress: 609/2226 symbols completed. DRD took 1.1s. Estimated remaining: 9m 30s. Rate: 170.2 symbols/min [2025-09-14T20:52:39.964341] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:39.977957] [DEBUG] [LOCAL ] DRH: Loaded 37808 existing records from primary storage. [2025-09-14T20:52:39.978388] [INFO ] [MAIN ] DRH: Loaded 37808 primary data records. [2025-09-14T20:52:40.023284] [DEBUG] [LOCAL ] DRLL: Loaded 6601 existing records from primary storage. [2025-09-14T20:52:40.048466] [INFO ] [MAIN ] DRLL: Loaded 6601 primary data records. [2025-09-14T20:52:40.514609] [DEBUG] [LOCAL ] DRI: Loaded 35431 existing records from primary storage. [2025-09-14T20:52:40.635264] [INFO ] [MAIN ] DRI: Loaded 35431 primary data records. [2025-09-14T20:52:40.953336] [DEBUG] [MAIN ] DRH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:40.966210] [INFO ] [MAIN ] DRH: Generated 1352 derivative records from 37808 primary records. [2025-09-14T20:52:40.966632] [DEBUG] [MAIN ] DRLL: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:52:40.966849] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-14T20:52:40.967871] [INFO ] [MAIN ] DRLL: Generated 1351 derivative records from 6601 primary records. [2025-09-14T20:52:40.971501] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-14T20:52:40.991348] [DEBUG] [LOCAL ] DRH: Derivative data saved (1352 records). [2025-09-14T20:52:41.007873] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1351 records). [2025-09-14T20:52:41.008208] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-14T20:52:41.004784] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-14T20:52:41.010957] [INFO ] [MAIN ] Derivative Progress: 610/2226 symbols completed. DRLL took 1.0s. Estimated remaining: 9m 32s. Rate: 169.6 symbols/min [2025-09-14T20:52:41.013602] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:41.014260] [INFO ] [MAIN ] Derivative Progress: 611/2226 symbols completed. DRH took 1.1s. Estimated remaining: 9m 30s. Rate: 169.9 symbols/min [2025-09-14T20:52:41.018094] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:41.030814] [DEBUG] [MAIN ] DRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:41.031728] [INFO ] [MAIN ] DRI: Generated 1352 derivative records from 35431 primary records. [2025-09-14T20:52:41.031804] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-14T20:52:41.054266] [DEBUG] [LOCAL ] DRI: Derivative data saved (1352 records). [2025-09-14T20:52:41.054346] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-14T20:52:41.056942] [INFO ] [MAIN ] Derivative Progress: 612/2226 symbols completed. DRI took 1.1s. Estimated remaining: 9m 29s. Rate: 170.2 symbols/min [2025-09-14T20:52:41.057372] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:41.074940] [DEBUG] [LOCAL ] DSM: Loaded 10547 existing records from primary storage. [2025-09-14T20:52:41.074141] [DEBUG] [LOCAL ] DSL: Loaded 20334 existing records from primary storage. [2025-09-14T20:52:41.077893] [INFO ] [MAIN ] DSM: Loaded 10547 primary data records. [2025-09-14T20:52:41.077677] [DEBUG] [LOCAL ] DSMC: Loaded 1241 existing records from primary storage. [2025-09-14T20:52:41.078124] [INFO ] [MAIN ] DSL: Loaded 20334 primary data records. [2025-09-14T20:52:41.084164] [INFO ] [MAIN ] DSMC: Loaded 1241 primary data records. [2025-09-14T20:52:41.988469] [DEBUG] [MAIN ] DSM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:41.992479] [INFO ] [MAIN ] DSM: Generated 1352 derivative records from 10547 primary records. [2025-09-14T20:52:41.994061] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-14T20:52:42.011768] [DEBUG] [MAIN ] DSL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:42.024222] [DEBUG] [MAIN ] DSMC: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T20:52:42.025389] [INFO ] [MAIN ] DSL: Generated 1352 derivative records from 20334 primary records. [2025-09-14T20:52:42.026337] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-14T20:52:42.027180] [INFO ] [MAIN ] DSMC: Generated 1349 derivative records from 1241 primary records. [2025-09-14T20:52:42.028382] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-14T20:52:42.029738] [DEBUG] [LOCAL ] DSM: Derivative data saved (1352 records). [2025-09-14T20:52:42.035717] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-14T20:52:42.038313] [INFO ] [MAIN ] Derivative Progress: 613/2226 symbols completed. DSM took 1.0s. Estimated remaining: 9m 30s. Rate: 169.7 symbols/min [2025-09-14T20:52:42.054440] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1349 records). [2025-09-14T20:52:42.055115] [DEBUG] [LOCAL ] DSL: Derivative data saved (1352 records). [2025-09-14T20:52:42.055261] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-14T20:52:42.055348] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-14T20:52:42.058177] [INFO ] [MAIN ] Derivative Progress: 614/2226 symbols completed. DSL took 1.0s. Estimated remaining: 9m 29s. Rate: 169.9 symbols/min [2025-09-14T20:52:42.060575] [INFO ] [MAIN ] Derivative Progress: 615/2226 symbols completed. DSMC took 1.0s. Estimated remaining: 9m 28s. Rate: 170.2 symbols/min [2025-09-14T20:52:42.061333] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:42.061665] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:42.062193] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:42.088588] [DEBUG] [LOCAL ] DSU: Loaded 15655 existing records from primary storage. [2025-09-14T20:52:42.105466] [DEBUG] [LOCAL ] DSX: Loaded 17812 existing records from primary storage. [2025-09-14T20:52:42.104410] [INFO ] [MAIN ] DSU: Loaded 15655 primary data records. [2025-09-14T20:52:42.106072] [INFO ] [MAIN ] DSX: Loaded 17812 primary data records. [2025-09-14T20:52:42.302581] [DEBUG] [LOCAL ] DT: Loaded 39809 existing records from primary storage. [2025-09-14T20:52:42.346213] [INFO ] [MAIN ] DT: Loaded 39809 primary data records. [2025-09-14T20:52:43.074704] [DEBUG] [MAIN ] DSU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:43.076132] [INFO ] [MAIN ] DSU: Generated 1352 derivative records from 15655 primary records. [2025-09-14T20:52:43.076341] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-14T20:52:43.089481] [DEBUG] [MAIN ] DSX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:43.103337] [DEBUG] [LOCAL ] DSU: Derivative data saved (1352 records). [2025-09-14T20:52:43.104144] [INFO ] [MAIN ] DSX: Generated 1352 derivative records from 17812 primary records. [2025-09-14T20:52:43.104425] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-14T20:52:43.121328] [INFO ] [MAIN ] Derivative Progress: 616/2226 symbols completed. DSU took 1.1s. Estimated remaining: 9m 29s. Rate: 169.7 symbols/min [2025-09-14T20:52:43.121612] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-14T20:52:43.123988] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:43.122354] [DEBUG] [MAIN ] DT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:43.125333] [INFO ] [MAIN ] DT: Generated 1352 derivative records from 39809 primary records. [2025-09-14T20:52:43.135965] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-14T20:52:43.141232] [DEBUG] [LOCAL ] DSX: Derivative data saved (1352 records). [2025-09-14T20:52:43.147211] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-14T20:52:43.153150] [INFO ] [MAIN ] Derivative Progress: 617/2226 symbols completed. DSX took 1.1s. Estimated remaining: 9m 28s. Rate: 169.9 symbols/min [2025-09-14T20:52:43.156508] [DEBUG] [LOCAL ] DT: Derivative data saved (1352 records). [2025-09-14T20:52:43.156827] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:43.157409] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-14T20:52:43.161469] [DEBUG] [LOCAL ] DTB: Loaded 3720 existing records from primary storage. [2025-09-14T20:52:43.164180] [INFO ] [MAIN ] Derivative Progress: 618/2226 symbols completed. DT took 1.1s. Estimated remaining: 9m 27s. Rate: 170.2 symbols/min [2025-09-14T20:52:43.164805] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:43.165054] [INFO ] [MAIN ] DTB: Loaded 3720 primary data records. [2025-09-14T20:52:43.252554] [DEBUG] [LOCAL ] DTG: Loaded 4209 existing records from primary storage. [2025-09-14T20:52:43.281214] [INFO ] [MAIN ] DTG: Loaded 4209 primary data records. [2025-09-14T20:52:43.616544] [DEBUG] [LOCAL ] DTE: Loaded 35858 existing records from primary storage. [2025-09-14T20:52:43.671353] [INFO ] [MAIN ] DTE: Loaded 35858 primary data records. [2025-09-14T20:52:44.078370] [DEBUG] [MAIN ] DTB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:44.080390] [INFO ] [MAIN ] DTB: Generated 1352 derivative records from 3720 primary records. [2025-09-14T20:52:44.080712] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-14T20:52:44.099136] [DEBUG] [LOCAL ] DTB: Derivative data saved (1352 records). [2025-09-14T20:52:44.111240] [DEBUG] [MAIN ] DTG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:44.111346] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-14T20:52:44.114905] [INFO ] [MAIN ] Derivative Progress: 619/2226 symbols completed. DTB took 1.0s. Estimated remaining: 9m 28s. Rate: 169.7 symbols/min [2025-09-14T20:52:44.112614] [INFO ] [MAIN ] DTG: Generated 1352 derivative records from 4209 primary records. [2025-09-14T20:52:44.115513] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:44.116060] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-14T20:52:44.129964] [DEBUG] [LOCAL ] DTG: Derivative data saved (1352 records). [2025-09-14T20:52:44.130220] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-14T20:52:44.133496] [INFO ] [MAIN ] Derivative Progress: 620/2226 symbols completed. DTG took 1.0s. Estimated remaining: 9m 27s. Rate: 170.0 symbols/min [2025-09-14T20:52:44.133886] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:44.146966] [DEBUG] [MAIN ] DTE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:44.149258] [INFO ] [MAIN ] DTE: Generated 1352 derivative records from 35858 primary records. [2025-09-14T20:52:44.149410] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-14T20:52:44.152852] [DEBUG] [LOCAL ] DTW: Loaded 3562 existing records from primary storage. [2025-09-14T20:52:44.164652] [DEBUG] [LOCAL ] DTE: Derivative data saved (1352 records). [2025-09-14T20:52:44.161799] [INFO ] [MAIN ] DTW: Loaded 3562 primary data records. [2025-09-14T20:52:44.185381] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-14T20:52:44.232110] [INFO ] [MAIN ] Derivative Progress: 621/2226 symbols completed. DTE took 1.1s. Estimated remaining: 9m 26s. Rate: 170.2 symbols/min [2025-09-14T20:52:44.264202] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:44.293089] [DEBUG] [LOCAL ] DTM: Loaded 32519 existing records from primary storage. [2025-09-14T20:52:44.314703] [INFO ] [MAIN ] DTM: Loaded 32519 primary data records. [2025-09-14T20:52:44.838845] [DEBUG] [LOCAL ] DUK: Loaded 40227 existing records from primary storage. [2025-09-14T20:52:44.839626] [INFO ] [MAIN ] DUK: Loaded 40227 primary data records. [2025-09-14T20:52:45.057782] [DEBUG] [MAIN ] DTW: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:52:45.152021] [INFO ] [MAIN ] DTW: Generated 1351 derivative records from 3562 primary records. [2025-09-14T20:52:45.152707] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-14T20:52:45.167884] [DEBUG] [LOCAL ] DTW: Derivative data saved (1351 records). [2025-09-14T20:52:45.168921] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-14T20:52:45.171156] [INFO ] [MAIN ] Derivative Progress: 622/2226 symbols completed. DTW took 1.0s. Estimated remaining: 9m 27s. Rate: 169.7 symbols/min [2025-09-14T20:52:45.172354] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:45.188594] [DEBUG] [MAIN ] DTM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:45.191346] [INFO ] [MAIN ] DTM: Generated 1352 derivative records from 32519 primary records. [2025-09-14T20:52:45.191509] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-14T20:52:45.202498] [DEBUG] [LOCAL ] DUKB: Loaded 4720 existing records from primary storage. [2025-09-14T20:52:45.206319] [INFO ] [MAIN ] DUKB: Loaded 4720 primary data records. [2025-09-14T20:52:45.271269] [DEBUG] [LOCAL ] DTM: Derivative data saved (1352 records). [2025-09-14T20:52:45.303674] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-14T20:52:45.334092] [INFO ] [MAIN ] Derivative Progress: 623/2226 symbols completed. DTM took 1.2s. Estimated remaining: 9m 26s. Rate: 169.9 symbols/min [2025-09-14T20:52:45.378278] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:45.356858] [DEBUG] [MAIN ] DUK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:45.399689] [INFO ] [MAIN ] DUK: Generated 1352 derivative records from 40227 primary records. [2025-09-14T20:52:45.421060] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-14T20:52:45.526942] [DEBUG] [LOCAL ] DUK: Derivative data saved (1352 records). [2025-09-14T20:52:45.542842] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-14T20:52:45.545890] [INFO ] [MAIN ] Derivative Progress: 624/2226 symbols completed. DUK took 1.3s. Estimated remaining: 9m 26s. Rate: 170.0 symbols/min [2025-09-14T20:52:45.546939] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:45.579627] [DEBUG] [MAIN ] DUKB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:45.593620] [INFO ] [MAIN ] DUKB: Generated 1352 derivative records from 4720 primary records. [2025-09-14T20:52:45.594019] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-14T20:52:45.595488] [DEBUG] [LOCAL ] DV: Loaded 38284 existing records from primary storage. [2025-09-14T20:52:45.604294] [INFO ] [MAIN ] DV: Loaded 38284 primary data records. [2025-09-14T20:52:45.734964] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1352 records). [2025-09-14T20:52:45.762701] [DEBUG] [LOCAL ] DVA: Loaded 30946 existing records from primary storage. [2025-09-14T20:52:45.788434] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-14T20:52:45.816720] [INFO ] [MAIN ] DVA: Loaded 30946 primary data records. [2025-09-14T20:52:45.819386] [INFO ] [MAIN ] Derivative Progress: 625/2226 symbols completed. DUKB took 0.6s. Estimated remaining: 9m 25s. Rate: 170.0 symbols/min [2025-09-14T20:52:45.835248] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:46.249979] [DEBUG] [LOCAL ] DVN: Loaded 40439 existing records from primary storage. [2025-09-14T20:52:46.250892] [INFO ] [MAIN ] DVN: Loaded 40439 primary data records. [2025-09-14T20:52:46.250721] [DEBUG] [MAIN ] DV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:46.273352] [INFO ] [MAIN ] DV: Generated 1352 derivative records from 38284 primary records. [2025-09-14T20:52:46.318280] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-14T20:52:46.395726] [DEBUG] [LOCAL ] DV: Derivative data saved (1352 records). [2025-09-14T20:52:46.401974] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-14T20:52:46.456686] [INFO ] [MAIN ] Derivative Progress: 626/2226 symbols completed. DV took 1.1s. Estimated remaining: 9m 25s. Rate: 169.8 symbols/min [2025-09-14T20:52:46.547097] [DEBUG] [MAIN ] DVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:46.565042] [INFO ] [MAIN ] DVA: Generated 1352 derivative records from 30946 primary records. [2025-09-14T20:52:46.565702] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:46.565979] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-14T20:52:46.581193] [DEBUG] [LOCAL ] DVA: Derivative data saved (1352 records). [2025-09-14T20:52:46.581969] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-14T20:52:46.584743] [INFO ] [MAIN ] Derivative Progress: 627/2226 symbols completed. DVA took 1.0s. Estimated remaining: 9m 24s. Rate: 170.0 symbols/min [2025-09-14T20:52:46.585293] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:46.608246] [DEBUG] [MAIN ] DVN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:46.609332] [INFO ] [MAIN ] DVN: Generated 1352 derivative records from 40439 primary records. [2025-09-14T20:52:46.609463] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-14T20:52:46.641472] [DEBUG] [LOCAL ] DVN: Derivative data saved (1352 records). [2025-09-14T20:52:46.641839] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-14T20:52:46.644633] [INFO ] [MAIN ] Derivative Progress: 628/2226 symbols completed. DVN took 0.8s. Estimated remaining: 9m 23s. Rate: 170.2 symbols/min [2025-09-14T20:52:46.675468] [DEBUG] [LOCAL ] DXC: Loaded 37447 existing records from primary storage. [2025-09-14T20:52:46.676868] [DEBUG] [LOCAL ] DX: Loaded 39442 existing records from primary storage. [2025-09-14T20:52:46.677245] [INFO ] [MAIN ] DXC: Loaded 37447 primary data records. [2025-09-14T20:52:46.677342] [INFO ] [MAIN ] DX: Loaded 39442 primary data records. [2025-09-14T20:52:47.351470] [DEBUG] [MAIN ] DXC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:47.352178] [DEBUG] [MAIN ] DX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:47.353023] [INFO ] [MAIN ] DXC: Generated 1352 derivative records from 37447 primary records. [2025-09-14T20:52:47.353990] [INFO ] [MAIN ] DX: Generated 1352 derivative records from 39442 primary records. [2025-09-14T20:52:47.354083] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-14T20:52:47.354210] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-14T20:52:47.378150] [DEBUG] [LOCAL ] DX: Derivative data saved (1352 records). [2025-09-14T20:52:47.378708] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-14T20:52:47.381930] [INFO ] [MAIN ] Derivative Progress: 629/2226 symbols completed. DX took 0.8s. Estimated remaining: 9m 24s. Rate: 169.9 symbols/min [2025-09-14T20:52:47.384852] [DEBUG] [LOCAL ] DXC: Derivative data saved (1352 records). [2025-09-14T20:52:47.384961] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-14T20:52:47.386911] [INFO ] [MAIN ] Derivative Progress: 630/2226 symbols completed. DXC took 0.8s. Estimated remaining: 9m 23s. Rate: 170.2 symbols/min [2025-09-14T20:52:47.387421] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:47.387723] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:47.387836] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:47.433739] [DEBUG] [LOCAL ] E: Loaded 25020 existing records from primary storage. [2025-09-14T20:52:47.441631] [DEBUG] [LOCAL ] DY: Loaded 21411 existing records from primary storage. [2025-09-14T20:52:47.443539] [DEBUG] [LOCAL ] DXYZ: Loaded 26884 existing records from primary storage. [2025-09-14T20:52:47.443693] [INFO ] [MAIN ] E: Loaded 25020 primary data records. [2025-09-14T20:52:47.465053] [INFO ] [MAIN ] DY: Loaded 21411 primary data records. [2025-09-14T20:52:47.465211] [INFO ] [MAIN ] DXYZ: Loaded 26884 primary data records. [2025-09-14T20:52:48.361890] [DEBUG] [MAIN ] E: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:48.364313] [INFO ] [MAIN ] E: Generated 1352 derivative records from 25020 primary records. [2025-09-14T20:52:48.364485] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-14T20:52:48.362507] [DEBUG] [MAIN ] DY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:48.366607] [INFO ] [MAIN ] DY: Generated 1352 derivative records from 21411 primary records. [2025-09-14T20:52:48.381685] [DEBUG] [LOCAL ] E: Derivative data saved (1352 records). [2025-09-14T20:52:48.382080] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-14T20:52:48.382290] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-14T20:52:48.386120] [INFO ] [MAIN ] Derivative Progress: 631/2226 symbols completed. E took 1.0s. Estimated remaining: 9m 24s. Rate: 169.7 symbols/min [2025-09-14T20:52:48.395464] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:48.417019] [DEBUG] [LOCAL ] DY: Derivative data saved (1352 records). [2025-09-14T20:52:48.414708] [DEBUG] [MAIN ] DXYZ: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:52:48.418699] [INFO ] [MAIN ] DXYZ: Generated 1351 derivative records from 26884 primary records. [2025-09-14T20:52:48.419097] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-14T20:52:48.419798] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-14T20:52:48.422923] [INFO ] [MAIN ] Derivative Progress: 632/2226 symbols completed. DY took 1.0s. Estimated remaining: 9m 23s. Rate: 169.9 symbols/min [2025-09-14T20:52:48.429336] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:48.438634] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1351 records). [2025-09-14T20:52:48.438856] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-14T20:52:48.441325] [INFO ] [MAIN ] Derivative Progress: 633/2226 symbols completed. DXYZ took 1.1s. Estimated remaining: 9m 22s. Rate: 170.2 symbols/min [2025-09-14T20:52:48.441785] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:48.447427] [DEBUG] [LOCAL ] EAI: Loaded 2854 existing records from primary storage. [2025-09-14T20:52:48.447806] [INFO ] [MAIN ] EAI: Loaded 2854 primary data records. [2025-09-14T20:52:48.601096] [DEBUG] [LOCAL ] EAF: Loaded 33346 existing records from primary storage. [2025-09-14T20:52:48.602632] [DEBUG] [LOCAL ] EARN: Loaded 20708 existing records from primary storage. [2025-09-14T20:52:48.628790] [INFO ] [MAIN ] EARN: Loaded 20708 primary data records. [2025-09-14T20:52:48.628925] [INFO ] [MAIN ] EAF: Loaded 33346 primary data records. [2025-09-14T20:52:49.375071] [DEBUG] [MAIN ] EAI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:49.376680] [INFO ] [MAIN ] EAI: Generated 1352 derivative records from 2854 primary records. [2025-09-14T20:52:49.377027] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-14T20:52:49.394491] [DEBUG] [LOCAL ] EAI: Derivative data saved (1352 records). [2025-09-14T20:52:49.399987] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-14T20:52:49.403161] [INFO ] [MAIN ] Derivative Progress: 634/2226 symbols completed. EAI took 1.0s. Estimated remaining: 9m 23s. Rate: 169.7 symbols/min [2025-09-14T20:52:49.410848] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:49.423055] [DEBUG] [MAIN ] EARN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:49.428351] [DEBUG] [MAIN ] EAF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:49.429780] [INFO ] [MAIN ] EARN: Generated 1352 derivative records from 20708 primary records. [2025-09-14T20:52:49.431715] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-14T20:52:49.431310] [INFO ] [MAIN ] EAF: Generated 1352 derivative records from 33346 primary records. [2025-09-14T20:52:49.433001] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-14T20:52:49.455095] [DEBUG] [LOCAL ] EARN: Derivative data saved (1352 records). [2025-09-14T20:52:49.460632] [DEBUG] [LOCAL ] EAF: Derivative data saved (1352 records). [2025-09-14T20:52:49.460895] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-14T20:52:49.461065] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-14T20:52:49.463406] [INFO ] [MAIN ] Derivative Progress: 635/2226 symbols completed. EARN took 1.0s. Estimated remaining: 9m 22s. Rate: 169.9 symbols/min [2025-09-14T20:52:49.465884] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:49.465999] [INFO ] [MAIN ] Derivative Progress: 636/2226 symbols completed. EAF took 1.1s. Estimated remaining: 9m 21s. Rate: 170.2 symbols/min [2025-09-14T20:52:49.466899] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:49.487250] [DEBUG] [LOCAL ] EBF: Loaded 14154 existing records from primary storage. [2025-09-14T20:52:49.497483] [INFO ] [MAIN ] EBF: Loaded 14154 primary data records. [2025-09-14T20:52:49.639474] [DEBUG] [LOCAL ] EB: Loaded 27695 existing records from primary storage. [2025-09-14T20:52:49.652225] [DEBUG] [LOCAL ] EAT: Loaded 37345 existing records from primary storage. [2025-09-14T20:52:49.651549] [INFO ] [MAIN ] EB: Loaded 27695 primary data records. [2025-09-14T20:52:49.658194] [INFO ] [MAIN ] EAT: Loaded 37345 primary data records. [2025-09-14T20:52:50.460710] [DEBUG] [MAIN ] EBF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:50.462814] [INFO ] [MAIN ] EBF: Generated 1352 derivative records from 14154 primary records. [2025-09-14T20:52:50.463812] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-14T20:52:50.485514] [DEBUG] [LOCAL ] EBF: Derivative data saved (1352 records). [2025-09-14T20:52:50.486092] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-14T20:52:50.488680] [INFO ] [MAIN ] Derivative Progress: 637/2226 symbols completed. EBF took 1.0s. Estimated remaining: 9m 22s. Rate: 169.7 symbols/min [2025-09-14T20:52:50.502851] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:50.502544] [DEBUG] [MAIN ] EB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:50.514487] [DEBUG] [MAIN ] EAT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:50.510128] [INFO ] [MAIN ] EB: Generated 1352 derivative records from 27695 primary records. [2025-09-14T20:52:50.515193] [INFO ] [MAIN ] EAT: Generated 1352 derivative records from 37345 primary records. [2025-09-14T20:52:50.515276] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-14T20:52:50.515564] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-14T20:52:50.536869] [DEBUG] [LOCAL ] EB: Derivative data saved (1352 records). [2025-09-14T20:52:50.539453] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-14T20:52:50.541334] [INFO ] [MAIN ] Derivative Progress: 638/2226 symbols completed. EB took 1.1s. Estimated remaining: 9m 21s. Rate: 169.9 symbols/min [2025-09-14T20:52:50.544439] [DEBUG] [LOCAL ] EAT: Derivative data saved (1352 records). [2025-09-14T20:52:50.544697] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:50.545187] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-14T20:52:50.548150] [INFO ] [MAIN ] Derivative Progress: 639/2226 symbols completed. EAT took 1.1s. Estimated remaining: 9m 20s. Rate: 170.2 symbols/min [2025-09-14T20:52:50.548785] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:50.594155] [DEBUG] [LOCAL ] EBR: Loaded 31998 existing records from primary storage. [2025-09-14T20:52:50.594779] [INFO ] [MAIN ] EBR: Loaded 31998 primary data records. [2025-09-14T20:52:50.748716] [DEBUG] [LOCAL ] EC: Loaded 36834 existing records from primary storage. [2025-09-14T20:52:50.750324] [INFO ] [MAIN ] EC: Loaded 36834 primary data records. [2025-09-14T20:52:50.749578] [DEBUG] [LOCAL ] EBS: Loaded 35421 existing records from primary storage. [2025-09-14T20:52:50.776862] [INFO ] [MAIN ] EBS: Loaded 35421 primary data records. [2025-09-14T20:52:51.540177] [DEBUG] [MAIN ] EBR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:51.541840] [INFO ] [MAIN ] EBR: Generated 1352 derivative records from 31998 primary records. [2025-09-14T20:52:51.542913] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-14T20:52:51.558518] [DEBUG] [LOCAL ] EBR: Derivative data saved (1352 records). [2025-09-14T20:52:51.558830] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-14T20:52:51.561467] [INFO ] [MAIN ] Derivative Progress: 640/2226 symbols completed. EBR took 1.1s. Estimated remaining: 9m 21s. Rate: 169.7 symbols/min [2025-09-14T20:52:51.579961] [DEBUG] [MAIN ] EC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:51.569745] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:51.584529] [INFO ] [MAIN ] EC: Generated 1352 derivative records from 36834 primary records. [2025-09-14T20:52:51.584901] [DEBUG] [MAIN ] EBS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:51.586202] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-14T20:52:51.585888] [INFO ] [MAIN ] EBS: Generated 1352 derivative records from 35421 primary records. [2025-09-14T20:52:51.587530] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-14T20:52:51.611246] [DEBUG] [LOCAL ] EC: Derivative data saved (1352 records). [2025-09-14T20:52:51.613311] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-14T20:52:51.613003] [DEBUG] [LOCAL ] EBS: Derivative data saved (1352 records). [2025-09-14T20:52:51.615902] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-14T20:52:51.615601] [INFO ] [MAIN ] Derivative Progress: 641/2226 symbols completed. EC took 1.1s. Estimated remaining: 9m 20s. Rate: 169.9 symbols/min [2025-09-14T20:52:51.624682] [INFO ] [MAIN ] Derivative Progress: 642/2226 symbols completed. EBS took 1.1s. Estimated remaining: 9m 18s. Rate: 170.2 symbols/min [2025-09-14T20:52:51.624836] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:51.625417] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:51.630179] [DEBUG] [LOCAL ] ECCU: Loaded 1685 existing records from primary storage. [2025-09-14T20:52:51.637026] [INFO ] [MAIN ] ECCU: Loaded 1685 primary data records. [2025-09-14T20:52:51.651554] [DEBUG] [LOCAL ] ECAT: Loaded 21834 existing records from primary storage. [2025-09-14T20:52:51.709386] [INFO ] [MAIN ] ECAT: Loaded 21834 primary data records. [2025-09-14T20:52:51.853971] [DEBUG] [LOCAL ] ECC: Loaded 32304 existing records from primary storage. [2025-09-14T20:52:51.922695] [INFO ] [MAIN ] ECC: Loaded 32304 primary data records. [2025-09-14T20:52:52.619425] [DEBUG] [MAIN ] ECCU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:52.620955] [INFO ] [MAIN ] ECCU: Generated 1352 derivative records from 1685 primary records. [2025-09-14T20:52:52.623594] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-09-14T20:52:52.638494] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1352 records). [2025-09-14T20:52:52.650168] [DEBUG] [MAIN ] ECAT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:52.650313] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-09-14T20:52:52.652873] [INFO ] [MAIN ] Derivative Progress: 643/2226 symbols completed. ECCU took 1.0s. Estimated remaining: 9m 20s. Rate: 169.7 symbols/min [2025-09-14T20:52:52.654566] [INFO ] [MAIN ] ECAT: Generated 1352 derivative records from 21834 primary records. [2025-09-14T20:52:52.654891] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-14T20:52:52.674034] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1352 records). [2025-09-14T20:52:52.684803] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-14T20:52:52.685218] [DEBUG] [MAIN ] ECC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:52.689199] [INFO ] [MAIN ] ECC: Generated 1352 derivative records from 32304 primary records. [2025-09-14T20:52:52.688267] [INFO ] [MAIN ] Derivative Progress: 644/2226 symbols completed. ECAT took 1.1s. Estimated remaining: 9m 19s. Rate: 169.9 symbols/min [2025-09-14T20:52:52.689585] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-14T20:52:52.701890] [DEBUG] [LOCAL ] ECC: Derivative data saved (1352 records). [2025-09-14T20:52:52.702111] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-14T20:52:52.704544] [INFO ] [MAIN ] Derivative Progress: 645/2226 symbols completed. ECC took 1.1s. Estimated remaining: 9m 17s. Rate: 170.2 symbols/min [2025-09-14T20:52:52.705374] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:52.705598] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:52.705800] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:52.723932] [DEBUG] [LOCAL ] ECO: Loaded 13176 existing records from primary storage. [2025-09-14T20:52:52.724382] [INFO ] [MAIN ] ECO: Loaded 13176 primary data records. [2025-09-14T20:52:52.894362] [DEBUG] [LOCAL ] ECG: Loaded 24863 existing records from primary storage. [2025-09-14T20:52:52.932392] [DEBUG] [LOCAL ] ECL: Loaded 34722 existing records from primary storage. [2025-09-14T20:52:52.932826] [INFO ] [MAIN ] ECL: Loaded 34722 primary data records. [2025-09-14T20:52:52.932958] [INFO ] [MAIN ] ECG: Loaded 24863 primary data records. [2025-09-14T20:52:53.704483] [DEBUG] [MAIN ] ECO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:53.705534] [INFO ] [MAIN ] ECO: Generated 1352 derivative records from 13176 primary records. [2025-09-14T20:52:53.715446] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-14T20:52:53.717828] [DEBUG] [MAIN ] ECL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:53.719124] [INFO ] [MAIN ] ECL: Generated 1352 derivative records from 34722 primary records. [2025-09-14T20:52:53.725388] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-14T20:52:53.739425] [DEBUG] [LOCAL ] ECO: Derivative data saved (1352 records). [2025-09-14T20:52:53.742800] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-14T20:52:53.745595] [INFO ] [MAIN ] Derivative Progress: 646/2226 symbols completed. ECO took 1.0s. Estimated remaining: 9m 19s. Rate: 169.6 symbols/min [2025-09-14T20:52:53.747787] [DEBUG] [LOCAL ] ECL: Derivative data saved (1352 records). [2025-09-14T20:52:53.748016] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:53.749120] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-14T20:52:53.753735] [INFO ] [MAIN ] Derivative Progress: 647/2226 symbols completed. ECL took 1.0s. Estimated remaining: 9m 18s. Rate: 169.9 symbols/min [2025-09-14T20:52:53.755289] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:53.767489] [DEBUG] [MAIN ] ECG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:53.768598] [INFO ] [MAIN ] ECG: Generated 1352 derivative records from 24863 primary records. [2025-09-14T20:52:53.768763] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-14T20:52:53.811499] [DEBUG] [LOCAL ] ECG: Derivative data saved (1352 records). [2025-09-14T20:52:53.811944] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-14T20:52:53.814366] [INFO ] [MAIN ] Derivative Progress: 648/2226 symbols completed. ECG took 1.1s. Estimated remaining: 9m 17s. Rate: 170.1 symbols/min [2025-09-14T20:52:53.814766] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:53.854327] [DEBUG] [LOCAL ] EDD: Loaded 20453 existing records from primary storage. [2025-09-14T20:52:53.864889] [INFO ] [MAIN ] EDD: Loaded 20453 primary data records. [2025-09-14T20:52:53.865495] [DEBUG] [LOCAL ] ECVT: Loaded 32268 existing records from primary storage. [2025-09-14T20:52:53.898013] [INFO ] [MAIN ] ECVT: Loaded 32268 primary data records. [2025-09-14T20:52:54.048481] [DEBUG] [LOCAL ] ED: Loaded 39716 existing records from primary storage. [2025-09-14T20:52:54.095676] [INFO ] [MAIN ] ED: Loaded 39716 primary data records. [2025-09-14T20:52:54.854401] [DEBUG] [MAIN ] EDD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:54.873508] [INFO ] [MAIN ] EDD: Generated 1352 derivative records from 20453 primary records. [2025-09-14T20:52:54.874185] [DEBUG] [MAIN ] ECVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:54.875799] [INFO ] [MAIN ] ECVT: Generated 1352 derivative records from 32268 primary records. [2025-09-14T20:52:54.876063] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-14T20:52:54.874904] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-14T20:52:54.899481] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1352 records). [2025-09-14T20:52:54.904157] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-14T20:52:54.906026] [DEBUG] [LOCAL ] EDD: Derivative data saved (1352 records). [2025-09-14T20:52:54.909302] [INFO ] [MAIN ] Derivative Progress: 649/2226 symbols completed. ECVT took 1.2s. Estimated remaining: 9m 18s. Rate: 169.6 symbols/min [2025-09-14T20:52:54.909612] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-14T20:52:54.913322] [INFO ] [MAIN ] Derivative Progress: 650/2226 symbols completed. EDD took 1.1s. Estimated remaining: 9m 17s. Rate: 169.8 symbols/min [2025-09-14T20:52:54.913147] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:54.914390] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:54.928934] [DEBUG] [MAIN ] ED: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:54.930487] [INFO ] [MAIN ] ED: Generated 1352 derivative records from 39716 primary records. [2025-09-14T20:52:54.930834] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-14T20:52:54.965257] [DEBUG] [LOCAL ] ED: Derivative data saved (1352 records). [2025-09-14T20:52:54.966104] [DEBUG] [LOCAL ] EDN: Loaded 13165 existing records from primary storage. [2025-09-14T20:52:54.972353] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-14T20:52:54.972517] [INFO ] [MAIN ] EDN: Loaded 13165 primary data records. [2025-09-14T20:52:54.974932] [INFO ] [MAIN ] Derivative Progress: 651/2226 symbols completed. ED took 1.2s. Estimated remaining: 9m 16s. Rate: 170.0 symbols/min [2025-09-14T20:52:54.975611] [DEBUG] [LOCAL ] EDF: Loaded 9711 existing records from primary storage. [2025-09-14T20:52:54.987999] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:55.007923] [INFO ] [MAIN ] EDF: Loaded 9711 primary data records. [2025-09-14T20:52:55.487520] [DEBUG] [LOCAL ] EDU: Loaded 33261 existing records from primary storage. [2025-09-14T20:52:55.488824] [INFO ] [MAIN ] EDU: Loaded 33261 primary data records. [2025-09-14T20:52:55.902855] [DEBUG] [MAIN ] EDN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:55.907097] [INFO ] [MAIN ] EDN: Generated 1352 derivative records from 13165 primary records. [2025-09-14T20:52:55.907365] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-14T20:52:55.920360] [DEBUG] [MAIN ] EDF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:55.927317] [INFO ] [MAIN ] EDF: Generated 1352 derivative records from 9711 primary records. [2025-09-14T20:52:55.927684] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-14T20:52:55.935180] [DEBUG] [LOCAL ] EDN: Derivative data saved (1352 records). [2025-09-14T20:52:55.943856] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-14T20:52:55.947153] [INFO ] [MAIN ] Derivative Progress: 652/2226 symbols completed. EDN took 1.0s. Estimated remaining: 9m 17s. Rate: 169.6 symbols/min [2025-09-14T20:52:55.948021] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:55.950362] [DEBUG] [LOCAL ] EDF: Derivative data saved (1352 records). [2025-09-14T20:52:55.950810] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-14T20:52:55.954909] [INFO ] [MAIN ] Derivative Progress: 653/2226 symbols completed. EDF took 1.0s. Estimated remaining: 9m 16s. Rate: 169.8 symbols/min [2025-09-14T20:52:55.956378] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:55.970121] [DEBUG] [MAIN ] EDU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:55.974872] [DEBUG] [LOCAL ] EEA: Loaded 2030 existing records from primary storage. [2025-09-14T20:52:55.971917] [INFO ] [MAIN ] EDU: Generated 1352 derivative records from 33261 primary records. [2025-09-14T20:52:55.975232] [INFO ] [MAIN ] EEA: Loaded 2030 primary data records. [2025-09-14T20:52:55.975277] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-14T20:52:56.109217] [DEBUG] [LOCAL ] EE: Loaded 24503 existing records from primary storage. [2025-09-14T20:52:56.122914] [INFO ] [MAIN ] EE: Loaded 24503 primary data records. [2025-09-14T20:52:56.117252] [DEBUG] [LOCAL ] EDU: Derivative data saved (1352 records). [2025-09-14T20:52:56.155516] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-14T20:52:56.191120] [INFO ] [MAIN ] Derivative Progress: 654/2226 symbols completed. EDU took 1.2s. Estimated remaining: 9m 15s. Rate: 169.9 symbols/min [2025-09-14T20:52:56.257250] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:56.490888] [DEBUG] [LOCAL ] EEX: Loaded 7466 existing records from primary storage. [2025-09-14T20:52:56.577936] [INFO ] [MAIN ] EEX: Loaded 7466 primary data records. [2025-09-14T20:52:56.955801] [DEBUG] [MAIN ] EEA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:56.957827] [INFO ] [MAIN ] EEA: Generated 1352 derivative records from 2030 primary records. [2025-09-14T20:52:56.958209] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-14T20:52:56.972939] [DEBUG] [LOCAL ] EEA: Derivative data saved (1352 records). [2025-09-14T20:52:56.973945] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-14T20:52:56.976255] [INFO ] [MAIN ] Derivative Progress: 655/2226 symbols completed. EEA took 1.0s. Estimated remaining: 9m 16s. Rate: 169.6 symbols/min [2025-09-14T20:52:56.977079] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:56.992105] [DEBUG] [MAIN ] EE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:56.992969] [INFO ] [MAIN ] EE: Generated 1352 derivative records from 24503 primary records. [2025-09-14T20:52:56.993555] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-14T20:52:57.008381] [DEBUG] [LOCAL ] EE: Derivative data saved (1352 records). [2025-09-14T20:52:57.009866] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-14T20:52:57.012595] [INFO ] [MAIN ] Derivative Progress: 656/2226 symbols completed. EE took 1.1s. Estimated remaining: 9m 15s. Rate: 169.8 symbols/min [2025-09-14T20:52:57.015565] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:57.028117] [DEBUG] [MAIN ] EEX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:57.044622] [INFO ] [MAIN ] EEX: Generated 1352 derivative records from 7466 primary records. [2025-09-14T20:52:57.044881] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-14T20:52:57.062186] [DEBUG] [LOCAL ] EEX: Derivative data saved (1352 records). [2025-09-14T20:52:57.062386] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-14T20:52:57.080855] [INFO ] [MAIN ] Derivative Progress: 657/2226 symbols completed. EEX took 0.8s. Estimated remaining: 9m 14s. Rate: 170.0 symbols/min [2025-09-14T20:52:57.081300] [DEBUG] [LOCAL ] EFR: Loaded 10568 existing records from primary storage. [2025-09-14T20:52:57.082608] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:57.082700] [INFO ] [MAIN ] EFR: Loaded 10568 primary data records. [2025-09-14T20:52:57.082084] [DEBUG] [LOCAL ] EFC: Loaded 34360 existing records from primary storage. [2025-09-14T20:52:57.083426] [INFO ] [MAIN ] EFC: Loaded 34360 primary data records. [2025-09-14T20:52:57.265733] [DEBUG] [LOCAL ] EFT: Loaded 9263 existing records from primary storage. [2025-09-14T20:52:57.278082] [INFO ] [MAIN ] EFT: Loaded 9263 primary data records. [2025-09-14T20:52:57.965593] [DEBUG] [MAIN ] EFR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:57.969679] [INFO ] [MAIN ] EFR: Generated 1352 derivative records from 10568 primary records. [2025-09-14T20:52:57.970270] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-14T20:52:57.991696] [DEBUG] [MAIN ] EFC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:57.998031] [DEBUG] [LOCAL ] EFR: Derivative data saved (1352 records). [2025-09-14T20:52:58.004944] [INFO ] [MAIN ] EFC: Generated 1352 derivative records from 34360 primary records. [2025-09-14T20:52:58.010487] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-14T20:52:58.010251] [DEBUG] [MAIN ] EFT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:58.010414] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-14T20:52:58.012371] [INFO ] [MAIN ] EFT: Generated 1352 derivative records from 9263 primary records. [2025-09-14T20:52:58.014957] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-14T20:52:58.014484] [INFO ] [MAIN ] Derivative Progress: 658/2226 symbols completed. EFR took 1.0s. Estimated remaining: 9m 15s. Rate: 169.6 symbols/min [2025-09-14T20:52:58.038051] [DEBUG] [LOCAL ] EFC: Derivative data saved (1352 records). [2025-09-14T20:52:58.041123] [DEBUG] [LOCAL ] EFT: Derivative data saved (1352 records). [2025-09-14T20:52:58.041272] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-14T20:52:58.041503] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-14T20:52:58.044253] [INFO ] [MAIN ] Derivative Progress: 659/2226 symbols completed. EFC took 1.1s. Estimated remaining: 9m 14s. Rate: 169.9 symbols/min [2025-09-14T20:52:58.046891] [INFO ] [MAIN ] Derivative Progress: 660/2226 symbols completed. EFT took 1.0s. Estimated remaining: 9m 12s. Rate: 170.1 symbols/min [2025-09-14T20:52:58.048126] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:58.047924] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:58.047785] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:58.088401] [DEBUG] [LOCAL ] EFXT: Loaded 21439 existing records from primary storage. [2025-09-14T20:52:58.098401] [DEBUG] [LOCAL ] EG: Loaded 21242 existing records from primary storage. [2025-09-14T20:52:58.098662] [INFO ] [MAIN ] EFXT: Loaded 21439 primary data records. [2025-09-14T20:52:58.110578] [INFO ] [MAIN ] EG: Loaded 21242 primary data records. [2025-09-14T20:52:58.295414] [DEBUG] [LOCAL ] EFX: Loaded 33339 existing records from primary storage. [2025-09-14T20:52:58.410040] [INFO ] [MAIN ] EFX: Loaded 33339 primary data records. [2025-09-14T20:52:59.016831] [DEBUG] [MAIN ] EG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:59.021911] [DEBUG] [MAIN ] EFXT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:59.023153] [INFO ] [MAIN ] EG: Generated 1352 derivative records from 21242 primary records. [2025-09-14T20:52:59.024114] [INFO ] [MAIN ] EFXT: Generated 1352 derivative records from 21439 primary records. [2025-09-14T20:52:59.024276] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-14T20:52:59.024876] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-14T20:52:59.046816] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1352 records). [2025-09-14T20:52:59.052282] [DEBUG] [LOCAL ] EG: Derivative data saved (1352 records). [2025-09-14T20:52:59.052478] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-14T20:52:59.053483] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-14T20:52:59.056255] [INFO ] [MAIN ] Derivative Progress: 661/2226 symbols completed. EFXT took 1.0s. Estimated remaining: 9m 14s. Rate: 169.6 symbols/min [2025-09-14T20:52:59.060571] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:59.060619] [INFO ] [MAIN ] Derivative Progress: 662/2226 symbols completed. EG took 1.0s. Estimated remaining: 9m 12s. Rate: 169.9 symbols/min [2025-09-14T20:52:59.061692] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:59.073053] [DEBUG] [MAIN ] EFX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:52:59.074123] [INFO ] [MAIN ] EFX: Generated 1352 derivative records from 33339 primary records. [2025-09-14T20:52:59.074431] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-14T20:52:59.087871] [DEBUG] [LOCAL ] EFX: Derivative data saved (1352 records). [2025-09-14T20:52:59.088068] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-14T20:52:59.090834] [INFO ] [MAIN ] Derivative Progress: 663/2226 symbols completed. EFX took 1.0s. Estimated remaining: 9m 11s. Rate: 170.1 symbols/min [2025-09-14T20:52:59.091762] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:52:59.114041] [DEBUG] [LOCAL ] EGP: Loaded 22583 existing records from primary storage. [2025-09-14T20:52:59.114324] [INFO ] [MAIN ] EGP: Loaded 22583 primary data records. [2025-09-14T20:52:59.313742] [DEBUG] [LOCAL ] EGO: Loaded 38604 existing records from primary storage. [2025-09-14T20:52:59.326246] [DEBUG] [LOCAL ] EGY: Loaded 31091 existing records from primary storage. [2025-09-14T20:52:59.326413] [INFO ] [MAIN ] EGO: Loaded 38604 primary data records. [2025-09-14T20:52:59.327028] [INFO ] [MAIN ] EGY: Loaded 31091 primary data records. [2025-09-14T20:53:00.168747] [DEBUG] [MAIN ] EGP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:00.170383] [INFO ] [MAIN ] EGP: Generated 1352 derivative records from 22583 primary records. [2025-09-14T20:53:00.181613] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-14T20:53:00.182662] [DEBUG] [MAIN ] EGO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:00.184774] [INFO ] [MAIN ] EGO: Generated 1352 derivative records from 38604 primary records. [2025-09-14T20:53:00.190764] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-14T20:53:00.211262] [DEBUG] [LOCAL ] EGP: Derivative data saved (1352 records). [2025-09-14T20:53:00.215016] [DEBUG] [LOCAL ] EGO: Derivative data saved (1352 records). [2025-09-14T20:53:00.215705] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-14T20:53:00.215339] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-14T20:53:00.218370] [INFO ] [MAIN ] Derivative Progress: 664/2226 symbols completed. EGO took 1.2s. Estimated remaining: 9m 13s. Rate: 169.6 symbols/min [2025-09-14T20:53:00.232016] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:00.231818] [DEBUG] [MAIN ] EGY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:00.232191] [INFO ] [MAIN ] Derivative Progress: 665/2226 symbols completed. EGP took 1.2s. Estimated remaining: 9m 12s. Rate: 169.8 symbols/min [2025-09-14T20:53:00.233052] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:00.234401] [INFO ] [MAIN ] EGY: Generated 1352 derivative records from 31091 primary records. [2025-09-14T20:53:00.234802] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-14T20:53:00.289424] [DEBUG] [LOCAL ] EGY: Derivative data saved (1352 records). [2025-09-14T20:53:00.304616] [DEBUG] [LOCAL ] EHAB: Loaded 22977 existing records from primary storage. [2025-09-14T20:53:00.305071] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-14T20:53:00.305431] [INFO ] [MAIN ] EHAB: Loaded 22977 primary data records. [2025-09-14T20:53:00.308787] [INFO ] [MAIN ] Derivative Progress: 666/2226 symbols completed. EGY took 1.2s. Estimated remaining: 9m 11s. Rate: 170.0 symbols/min [2025-09-14T20:53:00.366329] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:00.408491] [DEBUG] [LOCAL ] EHC: Loaded 31562 existing records from primary storage. [2025-09-14T20:53:00.425401] [INFO ] [MAIN ] EHC: Loaded 31562 primary data records. [2025-09-14T20:53:00.626551] [DEBUG] [LOCAL ] EHI: Loaded 7822 existing records from primary storage. [2025-09-14T20:53:00.664306] [INFO ] [MAIN ] EHI: Loaded 7822 primary data records. [2025-09-14T20:53:01.495022] [DEBUG] [MAIN ] EHAB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:01.497582] [INFO ] [MAIN ] EHAB: Generated 1352 derivative records from 22977 primary records. [2025-09-14T20:53:01.497837] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-14T20:53:01.519277] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1352 records). [2025-09-14T20:53:01.531042] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-14T20:53:01.531452] [DEBUG] [MAIN ] EHC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:01.534973] [INFO ] [MAIN ] Derivative Progress: 667/2226 symbols completed. EHAB took 1.3s. Estimated remaining: 9m 12s. Rate: 169.4 symbols/min [2025-09-14T20:53:01.537972] [INFO ] [MAIN ] EHC: Generated 1352 derivative records from 31562 primary records. [2025-09-14T20:53:01.538548] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:01.538765] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-14T20:53:01.558275] [DEBUG] [MAIN ] EHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:01.564010] [INFO ] [MAIN ] EHI: Generated 1352 derivative records from 7822 primary records. [2025-09-14T20:53:01.567854] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-14T20:53:01.568964] [DEBUG] [LOCAL ] EHC: Derivative data saved (1352 records). [2025-09-14T20:53:01.570980] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-14T20:53:01.573604] [INFO ] [MAIN ] Derivative Progress: 668/2226 symbols completed. EHC took 1.3s. Estimated remaining: 9m 11s. Rate: 169.6 symbols/min [2025-09-14T20:53:01.584859] [INFO ] [MAIN ] EICC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:01.592005] [DEBUG] [LOCAL ] EHI: Derivative data saved (1352 records). [2025-09-14T20:53:01.592802] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-14T20:53:01.595785] [INFO ] [MAIN ] Derivative Progress: 669/2226 symbols completed. EHI took 1.2s. Estimated remaining: 9m 10s. Rate: 169.8 symbols/min [2025-09-14T20:53:01.596835] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:01.608242] [DEBUG] [LOCAL ] EIC: Loaded 18009 existing records from primary storage. [2025-09-14T20:53:01.608807] [INFO ] [MAIN ] EIC: Loaded 18009 primary data records. [2025-09-14T20:53:01.612551] [DEBUG] [LOCAL ] EICC: Loaded 4350 existing records from primary storage. [2025-09-14T20:53:01.618379] [INFO ] [MAIN ] EICC: Loaded 4350 primary data records. [2025-09-14T20:53:01.863466] [DEBUG] [LOCAL ] EIG: Loaded 15585 existing records from primary storage. [2025-09-14T20:53:01.876934] [INFO ] [MAIN ] EIG: Loaded 15585 primary data records. [2025-09-14T20:53:02.658133] [DEBUG] [MAIN ] EIC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:02.669967] [DEBUG] [MAIN ] EICC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:02.669487] [INFO ] [MAIN ] EIC: Generated 1352 derivative records from 18009 primary records. [2025-09-14T20:53:02.670996] [INFO ] [MAIN ] EICC: Generated 1352 derivative records from 4350 primary records. [2025-09-14T20:53:02.671076] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-14T20:53:02.671290] [DEBUG] [LOCAL ] EICC: Saving derivative data. [2025-09-14T20:53:02.698525] [DEBUG] [LOCAL ] EICC: Derivative data saved (1352 records). [2025-09-14T20:53:02.698969] [DEBUG] [LOCAL ] EIC: Derivative data saved (1352 records). [2025-09-14T20:53:02.701205] [INFO ] [MAIN ] EICC: Successfully saved derivative data. [2025-09-14T20:53:02.704542] [INFO ] [MAIN ] Derivative Progress: 670/2226 symbols completed. EICC took 1.1s. Estimated remaining: 9m 11s. Rate: 169.3 symbols/min [2025-09-14T20:53:02.701275] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-14T20:53:02.705119] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:02.707154] [INFO ] [MAIN ] Derivative Progress: 671/2226 symbols completed. EIC took 1.2s. Estimated remaining: 9m 10s. Rate: 169.6 symbols/min [2025-09-14T20:53:02.708677] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:02.719444] [DEBUG] [MAIN ] EIG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:02.720366] [INFO ] [MAIN ] EIG: Generated 1352 derivative records from 15585 primary records. [2025-09-14T20:53:02.720629] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-14T20:53:02.735279] [DEBUG] [LOCAL ] EIG: Derivative data saved (1352 records). [2025-09-14T20:53:02.735362] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-14T20:53:02.737867] [INFO ] [MAIN ] Derivative Progress: 672/2226 symbols completed. EIG took 1.1s. Estimated remaining: 9m 9s. Rate: 169.8 symbols/min [2025-09-14T20:53:02.738252] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:02.794131] [DEBUG] [LOCAL ] EIX: Loaded 40171 existing records from primary storage. [2025-09-14T20:53:02.796425] [INFO ] [MAIN ] EIX: Loaded 40171 primary data records. [2025-09-14T20:53:02.849126] [DEBUG] [LOCAL ] EL: Loaded 40296 existing records from primary storage. [2025-09-14T20:53:02.872010] [INFO ] [MAIN ] EL: Loaded 40296 primary data records. [2025-09-14T20:53:02.972405] [DEBUG] [LOCAL ] ELAN: Loaded 40091 existing records from primary storage. [2025-09-14T20:53:03.026180] [INFO ] [MAIN ] ELAN: Loaded 40091 primary data records. [2025-09-14T20:53:03.732595] [DEBUG] [MAIN ] EIX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:03.734983] [INFO ] [MAIN ] EIX: Generated 1352 derivative records from 40171 primary records. [2025-09-14T20:53:03.745894] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-14T20:53:03.745817] [DEBUG] [MAIN ] EL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:03.747134] [INFO ] [MAIN ] EL: Generated 1352 derivative records from 40296 primary records. [2025-09-14T20:53:03.748489] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-14T20:53:03.761938] [DEBUG] [LOCAL ] EIX: Derivative data saved (1352 records). [2025-09-14T20:53:03.762693] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-14T20:53:03.764346] [INFO ] [MAIN ] Derivative Progress: 673/2226 symbols completed. EIX took 1.1s. Estimated remaining: 9m 10s. Rate: 169.3 symbols/min [2025-09-14T20:53:03.786694] [DEBUG] [LOCAL ] EL: Derivative data saved (1352 records). [2025-09-14T20:53:03.787020] [DEBUG] [MAIN ] ELAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:03.787887] [INFO ] [MAIN ] ELAN: Generated 1352 derivative records from 40091 primary records. [2025-09-14T20:53:03.787978] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-14T20:53:03.790542] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-14T20:53:03.790466] [INFO ] [MAIN ] Derivative Progress: 674/2226 symbols completed. EL took 1.1s. Estimated remaining: 9m 9s. Rate: 169.5 symbols/min [2025-09-14T20:53:03.803813] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1352 records). [2025-09-14T20:53:03.803947] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-14T20:53:03.805852] [INFO ] [MAIN ] Derivative Progress: 675/2226 symbols completed. ELAN took 1.1s. Estimated remaining: 9m 8s. Rate: 169.8 symbols/min [2025-09-14T20:53:03.806455] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:03.806541] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:03.806582] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:03.813167] [DEBUG] [LOCAL ] ELC: Loaded 2672 existing records from primary storage. [2025-09-14T20:53:03.813776] [INFO ] [MAIN ] ELC: Loaded 2672 primary data records. [2025-09-14T20:53:04.066313] [DEBUG] [LOCAL ] ELF: Loaded 39284 existing records from primary storage. [2025-09-14T20:53:04.066853] [DEBUG] [LOCAL ] ELME: Loaded 29297 existing records from primary storage. [2025-09-14T20:53:04.157369] [INFO ] [MAIN ] ELME: Loaded 29297 primary data records. [2025-09-14T20:53:04.067202] [INFO ] [MAIN ] ELF: Loaded 39284 primary data records. [2025-09-14T20:53:04.811140] [DEBUG] [MAIN ] ELC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:04.812358] [INFO ] [MAIN ] ELC: Generated 1352 derivative records from 2672 primary records. [2025-09-14T20:53:04.813203] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-14T20:53:04.828660] [DEBUG] [LOCAL ] ELC: Derivative data saved (1352 records). [2025-09-14T20:53:04.830457] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-14T20:53:04.832149] [INFO ] [MAIN ] Derivative Progress: 676/2226 symbols completed. ELC took 1.0s. Estimated remaining: 9m 9s. Rate: 169.3 symbols/min [2025-09-14T20:53:04.843827] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:04.844120] [DEBUG] [MAIN ] ELF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:04.845285] [INFO ] [MAIN ] ELF: Generated 1352 derivative records from 39284 primary records. [2025-09-14T20:53:04.845716] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-14T20:53:04.873135] [DEBUG] [LOCAL ] ELF: Derivative data saved (1352 records). [2025-09-14T20:53:04.872156] [DEBUG] [MAIN ] ELME: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:04.874081] [INFO ] [MAIN ] ELME: Generated 1352 derivative records from 29297 primary records. [2025-09-14T20:53:04.878804] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-14T20:53:04.882213] [INFO ] [MAIN ] Derivative Progress: 677/2226 symbols completed. ELF took 1.1s. Estimated remaining: 9m 8s. Rate: 169.5 symbols/min [2025-09-14T20:53:04.882664] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:04.882449] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-14T20:53:04.898210] [DEBUG] [LOCAL ] ELME: Derivative data saved (1352 records). [2025-09-14T20:53:04.905059] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-14T20:53:04.907736] [INFO ] [MAIN ] Derivative Progress: 678/2226 symbols completed. ELME took 1.1s. Estimated remaining: 9m 7s. Rate: 169.8 symbols/min [2025-09-14T20:53:04.905687] [DEBUG] [LOCAL ] ELP: Loaded 19609 existing records from primary storage. [2025-09-14T20:53:04.908126] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:04.908282] [INFO ] [MAIN ] ELP: Loaded 19609 primary data records. [2025-09-14T20:53:05.137715] [DEBUG] [LOCAL ] ELS: Loaded 37194 existing records from primary storage. [2025-09-14T20:53:05.222155] [INFO ] [MAIN ] ELS: Loaded 37194 primary data records. [2025-09-14T20:53:05.319700] [DEBUG] [LOCAL ] ELV: Loaded 38179 existing records from primary storage. [2025-09-14T20:53:05.333781] [INFO ] [MAIN ] ELV: Loaded 38179 primary data records. [2025-09-14T20:53:05.853201] [DEBUG] [MAIN ] ELP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:05.854173] [INFO ] [MAIN ] ELP: Generated 1352 derivative records from 19609 primary records. [2025-09-14T20:53:05.855417] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-14T20:53:05.872193] [DEBUG] [LOCAL ] ELP: Derivative data saved (1352 records). [2025-09-14T20:53:05.873254] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-14T20:53:05.875553] [INFO ] [MAIN ] Derivative Progress: 679/2226 symbols completed. ELP took 1.0s. Estimated remaining: 9m 8s. Rate: 169.3 symbols/min [2025-09-14T20:53:05.876909] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:05.892945] [DEBUG] [MAIN ] ELS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:05.893869] [INFO ] [MAIN ] ELS: Generated 1352 derivative records from 37194 primary records. [2025-09-14T20:53:05.894435] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-14T20:53:05.913069] [DEBUG] [LOCAL ] ELS: Derivative data saved (1352 records). [2025-09-14T20:53:05.921708] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-14T20:53:05.922309] [DEBUG] [LOCAL ] EMD: Loaded 15058 existing records from primary storage. [2025-09-14T20:53:05.924285] [INFO ] [MAIN ] Derivative Progress: 680/2226 symbols completed. ELS took 1.0s. Estimated remaining: 9m 7s. Rate: 169.5 symbols/min [2025-09-14T20:53:05.924632] [INFO ] [MAIN ] EMD: Loaded 15058 primary data records. [2025-09-14T20:53:05.925286] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:05.960040] [DEBUG] [MAIN ] ELV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:06.017277] [INFO ] [MAIN ] ELV: Generated 1352 derivative records from 38179 primary records. [2025-09-14T20:53:06.045090] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-14T20:53:06.155181] [DEBUG] [LOCAL ] EME: Loaded 22709 existing records from primary storage. [2025-09-14T20:53:06.157438] [INFO ] [MAIN ] EME: Loaded 22709 primary data records. [2025-09-14T20:53:06.158148] [DEBUG] [LOCAL ] ELV: Derivative data saved (1352 records). [2025-09-14T20:53:06.268934] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-14T20:53:06.298877] [INFO ] [MAIN ] Derivative Progress: 681/2226 symbols completed. ELV took 1.4s. Estimated remaining: 9m 7s. Rate: 169.5 symbols/min [2025-09-14T20:53:06.320126] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:06.383367] [DEBUG] [LOCAL ] EMF: Loaded 2183 existing records from primary storage. [2025-09-14T20:53:06.404996] [INFO ] [MAIN ] EMF: Loaded 2183 primary data records. [2025-09-14T20:53:06.859238] [DEBUG] [MAIN ] EMD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:06.861353] [INFO ] [MAIN ] EMD: Generated 1352 derivative records from 15058 primary records. [2025-09-14T20:53:06.862232] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-14T20:53:06.877533] [DEBUG] [LOCAL ] EMD: Derivative data saved (1352 records). [2025-09-14T20:53:06.878116] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-14T20:53:06.880106] [INFO ] [MAIN ] Derivative Progress: 682/2226 symbols completed. EMD took 1.0s. Estimated remaining: 9m 7s. Rate: 169.4 symbols/min [2025-09-14T20:53:06.882416] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:06.903387] [DEBUG] [MAIN ] EME: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:06.904744] [INFO ] [MAIN ] EME: Generated 1352 derivative records from 22709 primary records. [2025-09-14T20:53:06.905173] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-14T20:53:06.923046] [DEBUG] [LOCAL ] EME: Derivative data saved (1352 records). [2025-09-14T20:53:06.933368] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-14T20:53:06.935982] [INFO ] [MAIN ] Derivative Progress: 683/2226 symbols completed. EME took 1.0s. Estimated remaining: 9m 6s. Rate: 169.6 symbols/min [2025-09-14T20:53:06.933733] [DEBUG] [MAIN ] EMF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:06.936437] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:06.937497] [INFO ] [MAIN ] EMF: Generated 1352 derivative records from 2183 primary records. [2025-09-14T20:53:06.938178] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-14T20:53:06.964271] [DEBUG] [LOCAL ] EMF: Derivative data saved (1352 records). [2025-09-14T20:53:06.967862] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-14T20:53:06.971039] [INFO ] [MAIN ] Derivative Progress: 684/2226 symbols completed. EMF took 0.7s. Estimated remaining: 9m 5s. Rate: 169.8 symbols/min [2025-09-14T20:53:06.971543] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:06.993601] [DEBUG] [LOCAL ] EMN: Loaded 38189 existing records from primary storage. [2025-09-14T20:53:06.994057] [DEBUG] [LOCAL ] EMO: Loaded 9565 existing records from primary storage. [2025-09-14T20:53:06.994285] [INFO ] [MAIN ] EMN: Loaded 38189 primary data records. [2025-09-14T20:53:06.994622] [INFO ] [MAIN ] EMO: Loaded 9565 primary data records. [2025-09-14T20:53:07.093072] [DEBUG] [LOCAL ] EMP: Loaded 2192 existing records from primary storage. [2025-09-14T20:53:07.162333] [INFO ] [MAIN ] EMP: Loaded 2192 primary data records. [2025-09-14T20:53:07.950773] [DEBUG] [MAIN ] EMN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:07.951513] [DEBUG] [MAIN ] EMO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:07.952361] [INFO ] [MAIN ] EMN: Generated 1352 derivative records from 38189 primary records. [2025-09-14T20:53:07.953849] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-14T20:53:07.953733] [INFO ] [MAIN ] EMO: Generated 1352 derivative records from 9565 primary records. [2025-09-14T20:53:07.956168] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-14T20:53:07.990120] [DEBUG] [MAIN ] EMP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:07.992931] [INFO ] [MAIN ] EMP: Generated 1352 derivative records from 2192 primary records. [2025-09-14T20:53:07.994103] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-14T20:53:07.995880] [DEBUG] [LOCAL ] EMN: Derivative data saved (1352 records). [2025-09-14T20:53:07.996692] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-14T20:53:08.008622] [INFO ] [MAIN ] Derivative Progress: 685/2226 symbols completed. EMN took 1.1s. Estimated remaining: 9m 6s. Rate: 169.3 symbols/min [2025-09-14T20:53:08.011392] [DEBUG] [LOCAL ] EMO: Derivative data saved (1352 records). [2025-09-14T20:53:08.011891] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:08.013205] [DEBUG] [LOCAL ] EMP: Derivative data saved (1352 records). [2025-09-14T20:53:08.013282] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-14T20:53:08.013906] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-14T20:53:08.016587] [INFO ] [MAIN ] Derivative Progress: 686/2226 symbols completed. EMO took 1.1s. Estimated remaining: 9m 5s. Rate: 169.6 symbols/min [2025-09-14T20:53:08.017017] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:08.020061] [INFO ] [MAIN ] Derivative Progress: 687/2226 symbols completed. EMP took 1.0s. Estimated remaining: 9m 4s. Rate: 169.8 symbols/min [2025-09-14T20:53:08.021256] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:08.029384] [DEBUG] [LOCAL ] ENFY: Loaded 2700 existing records from primary storage. [2025-09-14T20:53:08.030029] [INFO ] [MAIN ] ENFY: Loaded 2700 primary data records. [2025-09-14T20:53:08.338487] [DEBUG] [LOCAL ] EMR: Loaded 40060 existing records from primary storage. [2025-09-14T20:53:08.352077] [INFO ] [MAIN ] EMR: Loaded 40060 primary data records. [2025-09-14T20:53:08.353975] [DEBUG] [LOCAL ] ENB: Loaded 40294 existing records from primary storage. [2025-09-14T20:53:08.392922] [INFO ] [MAIN ] ENB: Loaded 40294 primary data records. [2025-09-14T20:53:08.873631] [DEBUG] [MAIN ] ENFY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:08.966053] [INFO ] [MAIN ] ENFY: Generated 1352 derivative records from 2700 primary records. [2025-09-14T20:53:08.967841] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-14T20:53:08.983468] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1352 records). [2025-09-14T20:53:08.984090] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-14T20:53:08.987225] [INFO ] [MAIN ] Derivative Progress: 688/2226 symbols completed. ENFY took 1.0s. Estimated remaining: 9m 5s. Rate: 169.4 symbols/min [2025-09-14T20:53:09.011513] [DEBUG] [MAIN ] EMR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:09.012822] [INFO ] [MAIN ] EMR: Generated 1352 derivative records from 40060 primary records. [2025-09-14T20:53:09.023107] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-14T20:53:09.023479] [DEBUG] [MAIN ] ENB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:09.029784] [INFO ] [MAIN ] ENB: Generated 1352 derivative records from 40294 primary records. [2025-09-14T20:53:09.030863] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-14T20:53:09.055684] [DEBUG] [LOCAL ] ENB: Derivative data saved (1352 records). [2025-09-14T20:53:09.057138] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-14T20:53:09.057026] [DEBUG] [LOCAL ] EMR: Derivative data saved (1352 records). [2025-09-14T20:53:09.059212] [INFO ] [MAIN ] Derivative Progress: 689/2226 symbols completed. ENB took 1.0s. Estimated remaining: 9m 4s. Rate: 169.6 symbols/min [2025-09-14T20:53:09.059475] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-14T20:53:09.062774] [INFO ] [MAIN ] Derivative Progress: 690/2226 symbols completed. EMR took 1.1s. Estimated remaining: 9m 3s. Rate: 169.8 symbols/min [2025-09-14T20:53:09.063564] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:09.063927] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:09.063825] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:09.070191] [DEBUG] [LOCAL ] ENO: Loaded 1267 existing records from primary storage. [2025-09-14T20:53:09.070687] [INFO ] [MAIN ] ENO: Loaded 1267 primary data records. [2025-09-14T20:53:09.387584] [DEBUG] [LOCAL ] ENIC: Loaded 28052 existing records from primary storage. [2025-09-14T20:53:09.387024] [DEBUG] [LOCAL ] ENOV: Loaded 34517 existing records from primary storage. [2025-09-14T20:53:09.391658] [INFO ] [MAIN ] ENIC: Loaded 28052 primary data records. [2025-09-14T20:53:09.391711] [INFO ] [MAIN ] ENOV: Loaded 34517 primary data records. [2025-09-14T20:53:10.038247] [DEBUG] [MAIN ] ENO: Filtered 5251 bins outside market hours, 5867 incomplete bins [2025-09-14T20:53:10.040329] [INFO ] [MAIN ] ENO: Generated 1347 derivative records from 1267 primary records. [2025-09-14T20:53:10.040920] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-14T20:53:10.053941] [DEBUG] [LOCAL ] ENO: Derivative data saved (1347 records). [2025-09-14T20:53:10.054622] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-14T20:53:10.057055] [INFO ] [MAIN ] Derivative Progress: 691/2226 symbols completed. ENO took 1.0s. Estimated remaining: 9m 4s. Rate: 169.4 symbols/min [2025-09-14T20:53:10.057694] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:10.083632] [DEBUG] [MAIN ] ENOV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:10.084173] [DEBUG] [MAIN ] ENIC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:10.085792] [INFO ] [MAIN ] ENIC: Generated 1352 derivative records from 28052 primary records. [2025-09-14T20:53:10.085144] [INFO ] [MAIN ] ENOV: Generated 1352 derivative records from 34517 primary records. [2025-09-14T20:53:10.085958] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-14T20:53:10.086149] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-14T20:53:10.112988] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1352 records). [2025-09-14T20:53:10.114085] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1352 records). [2025-09-14T20:53:10.114254] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-14T20:53:10.114340] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-14T20:53:10.117086] [INFO ] [MAIN ] Derivative Progress: 692/2226 symbols completed. ENOV took 1.1s. Estimated remaining: 9m 3s. Rate: 169.6 symbols/min [2025-09-14T20:53:10.120566] [INFO ] [MAIN ] Derivative Progress: 693/2226 symbols completed. ENIC took 1.1s. Estimated remaining: 9m 2s. Rate: 169.8 symbols/min [2025-09-14T20:53:10.120674] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:10.130780] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:10.151910] [DEBUG] [LOCAL ] ENR: Loaded 33339 existing records from primary storage. [2025-09-14T20:53:10.158438] [INFO ] [MAIN ] ENR: Loaded 33339 primary data records. [2025-09-14T20:53:10.269554] [DEBUG] [LOCAL ] ENS: Loaded 21770 existing records from primary storage. [2025-09-14T20:53:10.285095] [INFO ] [MAIN ] ENS: Loaded 21770 primary data records. [2025-09-14T20:53:10.289504] [DEBUG] [LOCAL ] ENVA: Loaded 18954 existing records from primary storage. [2025-09-14T20:53:10.348309] [INFO ] [MAIN ] ENVA: Loaded 18954 primary data records. [2025-09-14T20:53:11.102679] [DEBUG] [MAIN ] ENR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:11.106591] [INFO ] [MAIN ] ENR: Generated 1352 derivative records from 33339 primary records. [2025-09-14T20:53:11.107842] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-14T20:53:11.132735] [DEBUG] [MAIN ] ENS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:11.136294] [DEBUG] [LOCAL ] ENR: Derivative data saved (1352 records). [2025-09-14T20:53:11.143773] [INFO ] [MAIN ] ENS: Generated 1352 derivative records from 21770 primary records. [2025-09-14T20:53:11.148234] [DEBUG] [MAIN ] ENVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:11.148900] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-14T20:53:11.148522] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-14T20:53:11.150081] [INFO ] [MAIN ] ENVA: Generated 1352 derivative records from 18954 primary records. [2025-09-14T20:53:11.152732] [INFO ] [MAIN ] Derivative Progress: 694/2226 symbols completed. ENR took 1.1s. Estimated remaining: 9m 3s. Rate: 169.3 symbols/min [2025-09-14T20:53:11.154378] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-14T20:53:11.155231] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:11.179658] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1352 records). [2025-09-14T20:53:11.182429] [DEBUG] [LOCAL ] ENS: Derivative data saved (1352 records). [2025-09-14T20:53:11.183041] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-14T20:53:11.186297] [INFO ] [MAIN ] Derivative Progress: 695/2226 symbols completed. ENS took 1.1s. Estimated remaining: 9m 2s. Rate: 169.6 symbols/min [2025-09-14T20:53:11.182797] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-14T20:53:11.188799] [INFO ] [MAIN ] Derivative Progress: 696/2226 symbols completed. ENVA took 1.1s. Estimated remaining: 9m 1s. Rate: 169.8 symbols/min [2025-09-14T20:53:11.188746] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:11.189296] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:11.201111] [DEBUG] [LOCAL ] EOD: Loaded 11000 existing records from primary storage. [2025-09-14T20:53:11.201392] [INFO ] [MAIN ] EOD: Loaded 11000 primary data records. [2025-09-14T20:53:11.303214] [DEBUG] [LOCAL ] EOI: Loaded 7034 existing records from primary storage. [2025-09-14T20:53:11.315174] [INFO ] [MAIN ] EOI: Loaded 7034 primary data records. [2025-09-14T20:53:11.644406] [DEBUG] [LOCAL ] EOG: Loaded 40135 existing records from primary storage. [2025-09-14T20:53:11.682482] [INFO ] [MAIN ] EOG: Loaded 40135 primary data records. [2025-09-14T20:53:12.166952] [DEBUG] [MAIN ] EOD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:12.170691] [INFO ] [MAIN ] EOD: Generated 1352 derivative records from 11000 primary records. [2025-09-14T20:53:12.172334] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-14T20:53:12.189767] [DEBUG] [MAIN ] EOI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:12.196505] [DEBUG] [LOCAL ] EOD: Derivative data saved (1352 records). [2025-09-14T20:53:12.198217] [INFO ] [MAIN ] EOI: Generated 1352 derivative records from 7034 primary records. [2025-09-14T20:53:12.198624] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-14T20:53:12.201101] [INFO ] [MAIN ] Derivative Progress: 697/2226 symbols completed. EOD took 1.0s. Estimated remaining: 9m 2s. Rate: 169.4 symbols/min [2025-09-14T20:53:12.198708] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-14T20:53:12.201696] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:12.217783] [DEBUG] [LOCAL ] EOI: Derivative data saved (1352 records). [2025-09-14T20:53:12.218525] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-14T20:53:12.220960] [INFO ] [MAIN ] Derivative Progress: 698/2226 symbols completed. EOI took 1.0s. Estimated remaining: 9m 1s. Rate: 169.6 symbols/min [2025-09-14T20:53:12.221444] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:12.240908] [DEBUG] [MAIN ] EOG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:12.249608] [DEBUG] [LOCAL ] EOS: Loaded 10469 existing records from primary storage. [2025-09-14T20:53:12.250839] [INFO ] [MAIN ] EOG: Generated 1352 derivative records from 40135 primary records. [2025-09-14T20:53:12.251224] [INFO ] [MAIN ] EOS: Loaded 10469 primary data records. [2025-09-14T20:53:12.251123] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-14T20:53:12.274072] [DEBUG] [LOCAL ] EOT: Loaded 5036 existing records from primary storage. [2025-09-14T20:53:12.313225] [INFO ] [MAIN ] EOT: Loaded 5036 primary data records. [2025-09-14T20:53:12.371051] [DEBUG] [LOCAL ] EOG: Derivative data saved (1352 records). [2025-09-14T20:53:12.503530] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-14T20:53:12.551992] [INFO ] [MAIN ] Derivative Progress: 699/2226 symbols completed. EOG took 1.4s. Estimated remaining: 9m 0s. Rate: 169.6 symbols/min [2025-09-14T20:53:12.599468] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:12.895928] [DEBUG] [LOCAL ] EPAC: Loaded 19349 existing records from primary storage. [2025-09-14T20:53:12.896873] [INFO ] [MAIN ] EPAC: Loaded 19349 primary data records. [2025-09-14T20:53:13.080173] [DEBUG] [MAIN ] EOT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:13.196724] [INFO ] [MAIN ] EOT: Generated 1352 derivative records from 5036 primary records. [2025-09-14T20:53:13.209201] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-14T20:53:13.197405] [DEBUG] [MAIN ] EOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:13.211479] [INFO ] [MAIN ] EOS: Generated 1352 derivative records from 10469 primary records. [2025-09-14T20:53:13.212067] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-14T20:53:13.238863] [DEBUG] [LOCAL ] EOS: Derivative data saved (1352 records). [2025-09-14T20:53:13.240054] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-14T20:53:13.242229] [INFO ] [MAIN ] Derivative Progress: 700/2226 symbols completed. EOS took 1.0s. Estimated remaining: 9m 1s. Rate: 169.4 symbols/min [2025-09-14T20:53:13.243215] [DEBUG] [LOCAL ] EOT: Derivative data saved (1352 records). [2025-09-14T20:53:13.244164] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:13.245573] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-14T20:53:13.248545] [INFO ] [MAIN ] Derivative Progress: 701/2226 symbols completed. EOT took 1.0s. Estimated remaining: 8m 59s. Rate: 169.6 symbols/min [2025-09-14T20:53:13.249346] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:13.265005] [DEBUG] [MAIN ] EPAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:13.265872] [INFO ] [MAIN ] EPAC: Generated 1352 derivative records from 19349 primary records. [2025-09-14T20:53:13.265959] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-14T20:53:13.279431] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1352 records). [2025-09-14T20:53:13.288528] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-14T20:53:13.291024] [INFO ] [MAIN ] Derivative Progress: 702/2226 symbols completed. EPAC took 0.7s. Estimated remaining: 8m 58s. Rate: 169.8 symbols/min [2025-09-14T20:53:13.291413] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:13.321549] [DEBUG] [LOCAL ] EPC: Loaded 30114 existing records from primary storage. [2025-09-14T20:53:13.321828] [INFO ] [MAIN ] EPC: Loaded 30114 primary data records. [2025-09-14T20:53:13.322379] [DEBUG] [LOCAL ] EPAM: Loaded 29270 existing records from primary storage. [2025-09-14T20:53:13.339465] [INFO ] [MAIN ] EPAM: Loaded 29270 primary data records. [2025-09-14T20:53:13.733816] [DEBUG] [LOCAL ] EPD: Loaded 40362 existing records from primary storage. [2025-09-14T20:53:13.850762] [INFO ] [MAIN ] EPD: Loaded 40362 primary data records. [2025-09-14T20:53:14.269887] [DEBUG] [MAIN ] EPC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:14.282572] [INFO ] [MAIN ] EPC: Generated 1352 derivative records from 30114 primary records. [2025-09-14T20:53:14.282949] [DEBUG] [MAIN ] EPAM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:14.283304] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-14T20:53:14.283935] [INFO ] [MAIN ] EPAM: Generated 1352 derivative records from 29270 primary records. [2025-09-14T20:53:14.284959] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-14T20:53:14.312914] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1352 records). [2025-09-14T20:53:14.309326] [DEBUG] [LOCAL ] EPC: Derivative data saved (1352 records). [2025-09-14T20:53:14.313504] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-14T20:53:14.313577] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-14T20:53:14.317310] [INFO ] [MAIN ] Derivative Progress: 703/2226 symbols completed. EPAM took 1.1s. Estimated remaining: 8m 60s. Rate: 169.4 symbols/min [2025-09-14T20:53:14.320067] [INFO ] [MAIN ] Derivative Progress: 704/2226 symbols completed. EPC took 1.1s. Estimated remaining: 8m 58s. Rate: 169.6 symbols/min [2025-09-14T20:53:14.335919] [DEBUG] [MAIN ] EPD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:14.336784] [INFO ] [MAIN ] EPD: Generated 1352 derivative records from 40362 primary records. [2025-09-14T20:53:14.336868] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-14T20:53:14.349272] [DEBUG] [LOCAL ] EPD: Derivative data saved (1352 records). [2025-09-14T20:53:14.349361] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-14T20:53:14.351317] [INFO ] [MAIN ] Derivative Progress: 705/2226 symbols completed. EPD took 1.1s. Estimated remaining: 8m 57s. Rate: 169.8 symbols/min [2025-09-14T20:53:14.352381] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:14.352186] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:14.353366] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:14.366548] [DEBUG] [LOCAL ] EQBK: Loaded 8151 existing records from primary storage. [2025-09-14T20:53:14.367109] [INFO ] [MAIN ] EQBK: Loaded 8151 primary data records. [2025-09-14T20:53:14.542700] [DEBUG] [LOCAL ] EPRT: Loaded 36216 existing records from primary storage. [2025-09-14T20:53:14.616909] [INFO ] [MAIN ] EPRT: Loaded 36216 primary data records. [2025-09-14T20:53:14.701636] [DEBUG] [LOCAL ] EPR: Loaded 33117 existing records from primary storage. [2025-09-14T20:53:14.791637] [INFO ] [MAIN ] EPR: Loaded 33117 primary data records. [2025-09-14T20:53:15.347290] [DEBUG] [MAIN ] EQBK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:15.348193] [INFO ] [MAIN ] EQBK: Generated 1352 derivative records from 8151 primary records. [2025-09-14T20:53:15.349836] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-14T20:53:15.365569] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1352 records). [2025-09-14T20:53:15.368273] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-14T20:53:15.371204] [INFO ] [MAIN ] Derivative Progress: 706/2226 symbols completed. EQBK took 1.0s. Estimated remaining: 8m 58s. Rate: 169.4 symbols/min [2025-09-14T20:53:15.371907] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:15.385917] [DEBUG] [MAIN ] EPRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:15.387689] [INFO ] [MAIN ] EPRT: Generated 1352 derivative records from 36216 primary records. [2025-09-14T20:53:15.387923] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-14T20:53:15.404432] [DEBUG] [MAIN ] EPR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:15.408332] [INFO ] [MAIN ] EPR: Generated 1352 derivative records from 33117 primary records. [2025-09-14T20:53:15.410416] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-14T20:53:15.412358] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1352 records). [2025-09-14T20:53:15.418041] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-14T20:53:15.425428] [INFO ] [MAIN ] Derivative Progress: 707/2226 symbols completed. EPRT took 1.1s. Estimated remaining: 8m 57s. Rate: 169.6 symbols/min [2025-09-14T20:53:15.428596] [DEBUG] [LOCAL ] EPR: Derivative data saved (1352 records). [2025-09-14T20:53:15.429045] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-14T20:53:15.429094] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:15.431928] [INFO ] [MAIN ] Derivative Progress: 708/2226 symbols completed. EPR took 1.1s. Estimated remaining: 8m 56s. Rate: 169.8 symbols/min [2025-09-14T20:53:15.432495] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:15.463278] [DEBUG] [LOCAL ] EQH: Loaded 39546 existing records from primary storage. [2025-09-14T20:53:15.463469] [INFO ] [MAIN ] EQH: Loaded 39546 primary data records. [2025-09-14T20:53:15.663879] [DEBUG] [LOCAL ] EQNR: Loaded 39924 existing records from primary storage. [2025-09-14T20:53:15.672732] [INFO ] [MAIN ] EQNR: Loaded 39924 primary data records. [2025-09-14T20:53:15.667346] [DEBUG] [LOCAL ] EQR: Loaded 38710 existing records from primary storage. [2025-09-14T20:53:15.701624] [INFO ] [MAIN ] EQR: Loaded 38710 primary data records. [2025-09-14T20:53:16.366716] [DEBUG] [MAIN ] EQH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:16.368016] [INFO ] [MAIN ] EQH: Generated 1352 derivative records from 39546 primary records. [2025-09-14T20:53:16.369840] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-14T20:53:16.386724] [DEBUG] [LOCAL ] EQH: Derivative data saved (1352 records). [2025-09-14T20:53:16.388946] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-14T20:53:16.391755] [INFO ] [MAIN ] Derivative Progress: 709/2226 symbols completed. EQH took 1.0s. Estimated remaining: 8m 57s. Rate: 169.4 symbols/min [2025-09-14T20:53:16.392671] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:16.407606] [DEBUG] [MAIN ] EQNR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:16.408704] [INFO ] [MAIN ] EQNR: Generated 1352 derivative records from 39924 primary records. [2025-09-14T20:53:16.415051] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-14T20:53:16.419437] [DEBUG] [MAIN ] EQR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:16.421631] [INFO ] [MAIN ] EQR: Generated 1352 derivative records from 38710 primary records. [2025-09-14T20:53:16.421821] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-14T20:53:16.446512] [DEBUG] [LOCAL ] EQR: Derivative data saved (1352 records). [2025-09-14T20:53:16.447912] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-14T20:53:16.451066] [INFO ] [MAIN ] Derivative Progress: 710/2226 symbols completed. EQR took 1.0s. Estimated remaining: 8m 56s. Rate: 169.6 symbols/min [2025-09-14T20:53:16.448266] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1352 records). [2025-09-14T20:53:16.451469] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-14T20:53:16.455487] [INFO ] [MAIN ] Derivative Progress: 711/2226 symbols completed. EQNR took 1.0s. Estimated remaining: 8m 55s. Rate: 169.8 symbols/min [2025-09-14T20:53:16.451684] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:16.467040] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:16.473214] [DEBUG] [LOCAL ] EQV: Loaded 2163 existing records from primary storage. [2025-09-14T20:53:16.474222] [INFO ] [MAIN ] EQV: Loaded 2163 primary data records. [2025-09-14T20:53:16.558185] [DEBUG] [LOCAL ] EQT: Loaded 40425 existing records from primary storage. [2025-09-14T20:53:16.587173] [INFO ] [MAIN ] EQT: Loaded 40425 primary data records. [2025-09-14T20:53:16.818503] [DEBUG] [LOCAL ] ERJ: Loaded 38090 existing records from primary storage. [2025-09-14T20:53:16.998544] [INFO ] [MAIN ] ERJ: Loaded 38090 primary data records. [2025-09-14T20:53:17.500267] [DEBUG] [MAIN ] EQV: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T20:53:17.511614] [INFO ] [MAIN ] EQV: Generated 1349 derivative records from 2163 primary records. [2025-09-14T20:53:17.511873] [DEBUG] [MAIN ] EQT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:17.513444] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-14T20:53:17.514300] [INFO ] [MAIN ] EQT: Generated 1352 derivative records from 40425 primary records. [2025-09-14T20:53:17.515811] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-14T20:53:17.529070] [DEBUG] [LOCAL ] EQV: Derivative data saved (1349 records). [2025-09-14T20:53:17.536405] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-14T20:53:17.540944] [INFO ] [MAIN ] Derivative Progress: 712/2226 symbols completed. EQV took 1.1s. Estimated remaining: 8m 56s. Rate: 169.3 symbols/min [2025-09-14T20:53:17.544844] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:17.544723] [DEBUG] [LOCAL ] EQT: Derivative data saved (1352 records). [2025-09-14T20:53:17.545223] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-14T20:53:17.548809] [INFO ] [MAIN ] Derivative Progress: 713/2226 symbols completed. EQT took 1.2s. Estimated remaining: 8m 55s. Rate: 169.6 symbols/min [2025-09-14T20:53:17.549396] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:17.563116] [DEBUG] [MAIN ] ERJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:17.564005] [INFO ] [MAIN ] ERJ: Generated 1352 derivative records from 38090 primary records. [2025-09-14T20:53:17.564155] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-14T20:53:17.577562] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1352 records). [2025-09-14T20:53:17.577994] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-14T20:53:17.580551] [INFO ] [MAIN ] Derivative Progress: 714/2226 symbols completed. ERJ took 1.1s. Estimated remaining: 8m 54s. Rate: 169.8 symbols/min [2025-09-14T20:53:17.580934] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:17.642658] [DEBUG] [LOCAL ] ERO: Loaded 30409 existing records from primary storage. [2025-09-14T20:53:17.643046] [DEBUG] [LOCAL ] ESAB: Loaded 18378 existing records from primary storage. [2025-09-14T20:53:17.643270] [INFO ] [MAIN ] ERO: Loaded 30409 primary data records. [2025-09-14T20:53:17.643432] [INFO ] [MAIN ] ESAB: Loaded 18378 primary data records. [2025-09-14T20:53:17.702332] [DEBUG] [LOCAL ] ES: Loaded 39539 existing records from primary storage. [2025-09-14T20:53:17.780461] [INFO ] [MAIN ] ES: Loaded 39539 primary data records. [2025-09-14T20:53:18.535327] [DEBUG] [MAIN ] ESAB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:18.540586] [INFO ] [MAIN ] ESAB: Generated 1352 derivative records from 18378 primary records. [2025-09-14T20:53:18.540869] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-14T20:53:18.539517] [DEBUG] [MAIN ] ERO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:18.551892] [DEBUG] [MAIN ] ES: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:18.553311] [INFO ] [MAIN ] ERO: Generated 1352 derivative records from 30409 primary records. [2025-09-14T20:53:18.564518] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-14T20:53:18.565461] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1352 records). [2025-09-14T20:53:18.566382] [INFO ] [MAIN ] ES: Generated 1352 derivative records from 39539 primary records. [2025-09-14T20:53:18.567669] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-14T20:53:18.567758] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-14T20:53:18.571326] [INFO ] [MAIN ] Derivative Progress: 715/2226 symbols completed. ESAB took 1.0s. Estimated remaining: 8m 55s. Rate: 169.4 symbols/min [2025-09-14T20:53:18.577889] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:18.597387] [DEBUG] [LOCAL ] ERO: Derivative data saved (1352 records). [2025-09-14T20:53:18.596655] [DEBUG] [LOCAL ] ES: Derivative data saved (1352 records). [2025-09-14T20:53:18.597588] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-14T20:53:18.597546] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-14T20:53:18.599389] [INFO ] [MAIN ] Derivative Progress: 716/2226 symbols completed. ES took 1.1s. Estimated remaining: 8m 54s. Rate: 169.6 symbols/min [2025-09-14T20:53:18.601681] [INFO ] [MAIN ] Derivative Progress: 717/2226 symbols completed. ERO took 1.1s. Estimated remaining: 8m 53s. Rate: 169.8 symbols/min [2025-09-14T20:53:18.601783] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:18.602099] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:18.617786] [DEBUG] [LOCAL ] ESE: Loaded 12305 existing records from primary storage. [2025-09-14T20:53:18.618291] [INFO ] [MAIN ] ESE: Loaded 12305 primary data records. [2025-09-14T20:53:18.846668] [DEBUG] [LOCAL ] ESNT: Loaded 28299 existing records from primary storage. [2025-09-14T20:53:18.845126] [DEBUG] [LOCAL ] ESI: Loaded 37839 existing records from primary storage. [2025-09-14T20:53:18.847026] [INFO ] [MAIN ] ESNT: Loaded 28299 primary data records. [2025-09-14T20:53:18.847214] [INFO ] [MAIN ] ESI: Loaded 37839 primary data records. [2025-09-14T20:53:19.609216] [DEBUG] [MAIN ] ESE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:19.610951] [INFO ] [MAIN ] ESE: Generated 1352 derivative records from 12305 primary records. [2025-09-14T20:53:19.611146] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-14T20:53:19.627255] [DEBUG] [LOCAL ] ESE: Derivative data saved (1352 records). [2025-09-14T20:53:19.627402] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-14T20:53:19.629093] [INFO ] [MAIN ] Derivative Progress: 718/2226 symbols completed. ESE took 1.1s. Estimated remaining: 8m 54s. Rate: 169.4 symbols/min [2025-09-14T20:53:19.647779] [DEBUG] [MAIN ] ESI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:19.658416] [INFO ] [MAIN ] ESI: Generated 1352 derivative records from 37839 primary records. [2025-09-14T20:53:19.658769] [DEBUG] [MAIN ] ESNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:19.658957] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-14T20:53:19.659680] [INFO ] [MAIN ] ESNT: Generated 1352 derivative records from 28299 primary records. [2025-09-14T20:53:19.660635] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-14T20:53:19.680506] [DEBUG] [LOCAL ] ESI: Derivative data saved (1352 records). [2025-09-14T20:53:19.682809] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-14T20:53:19.684662] [INFO ] [MAIN ] Derivative Progress: 719/2226 symbols completed. ESI took 1.1s. Estimated remaining: 8m 53s. Rate: 169.6 symbols/min [2025-09-14T20:53:19.687914] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1352 records). [2025-09-14T20:53:19.688044] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-14T20:53:19.690756] [INFO ] [MAIN ] Derivative Progress: 720/2226 symbols completed. ESNT took 1.1s. Estimated remaining: 8m 52s. Rate: 169.8 symbols/min [2025-09-14T20:53:19.691463] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:19.691681] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:19.691568] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:19.735714] [DEBUG] [LOCAL ] ESS: Loaded 22486 existing records from primary storage. [2025-09-14T20:53:19.735961] [INFO ] [MAIN ] ESS: Loaded 22486 primary data records. [2025-09-14T20:53:19.865791] [DEBUG] [LOCAL ] ESRT: Loaded 34810 existing records from primary storage. [2025-09-14T20:53:19.865941] [DEBUG] [LOCAL ] ESTC: Loaded 37899 existing records from primary storage. [2025-09-14T20:53:19.882516] [INFO ] [MAIN ] ESRT: Loaded 34810 primary data records. [2025-09-14T20:53:19.900782] [INFO ] [MAIN ] ESTC: Loaded 37899 primary data records. [2025-09-14T20:53:20.634740] [DEBUG] [MAIN ] ESS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:20.636425] [INFO ] [MAIN ] ESS: Generated 1352 derivative records from 22486 primary records. [2025-09-14T20:53:20.636652] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-14T20:53:20.652240] [DEBUG] [LOCAL ] ESS: Derivative data saved (1352 records). [2025-09-14T20:53:20.654511] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-14T20:53:20.656893] [INFO ] [MAIN ] Derivative Progress: 721/2226 symbols completed. ESS took 1.0s. Estimated remaining: 8m 53s. Rate: 169.4 symbols/min [2025-09-14T20:53:20.667226] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:20.668079] [DEBUG] [MAIN ] ESRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:20.669520] [INFO ] [MAIN ] ESRT: Generated 1352 derivative records from 34810 primary records. [2025-09-14T20:53:20.669731] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-14T20:53:20.684831] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1352 records). [2025-09-14T20:53:20.685057] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-14T20:53:20.693666] [INFO ] [MAIN ] Derivative Progress: 722/2226 symbols completed. ESRT took 1.0s. Estimated remaining: 8m 52s. Rate: 169.6 symbols/min [2025-09-14T20:53:20.697778] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:20.698289] [DEBUG] [MAIN ] ESTC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:20.699559] [INFO ] [MAIN ] ESTC: Generated 1352 derivative records from 37899 primary records. [2025-09-14T20:53:20.699931] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-14T20:53:20.713015] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1352 records). [2025-09-14T20:53:20.713096] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-14T20:53:20.717482] [INFO ] [MAIN ] Derivative Progress: 723/2226 symbols completed. ESTC took 1.0s. Estimated remaining: 8m 51s. Rate: 169.8 symbols/min [2025-09-14T20:53:20.720684] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:20.726768] [DEBUG] [LOCAL ] ETB: Loaded 8298 existing records from primary storage. [2025-09-14T20:53:20.726912] [INFO ] [MAIN ] ETB: Loaded 8298 primary data records. [2025-09-14T20:53:20.921370] [DEBUG] [LOCAL ] ET: Loaded 40530 existing records from primary storage. [2025-09-14T20:53:20.948784] [DEBUG] [LOCAL ] ETD: Loaded 20670 existing records from primary storage. [2025-09-14T20:53:20.948290] [INFO ] [MAIN ] ET: Loaded 40530 primary data records. [2025-09-14T20:53:21.037138] [INFO ] [MAIN ] ETD: Loaded 20670 primary data records. [2025-09-14T20:53:21.701171] [DEBUG] [MAIN ] ETB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:21.703761] [INFO ] [MAIN ] ETB: Generated 1352 derivative records from 8298 primary records. [2025-09-14T20:53:21.704027] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-14T20:53:21.718486] [DEBUG] [LOCAL ] ETB: Derivative data saved (1352 records). [2025-09-14T20:53:21.719179] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-14T20:53:21.722306] [INFO ] [MAIN ] Derivative Progress: 724/2226 symbols completed. ETB took 1.0s. Estimated remaining: 8m 52s. Rate: 169.4 symbols/min [2025-09-14T20:53:21.723400] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:21.745689] [DEBUG] [MAIN ] ET: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:21.757399] [INFO ] [MAIN ] ET: Generated 1352 derivative records from 40530 primary records. [2025-09-14T20:53:21.757580] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-14T20:53:21.756613] [DEBUG] [MAIN ] ETD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:21.759062] [INFO ] [MAIN ] ETD: Generated 1352 derivative records from 20670 primary records. [2025-09-14T20:53:21.773257] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-14T20:53:21.775114] [DEBUG] [LOCAL ] ETG: Loaded 12352 existing records from primary storage. [2025-09-14T20:53:21.776918] [INFO ] [MAIN ] ETG: Loaded 12352 primary data records. [2025-09-14T20:53:21.800965] [DEBUG] [LOCAL ] ET: Derivative data saved (1352 records). [2025-09-14T20:53:21.815875] [DEBUG] [LOCAL ] ETD: Derivative data saved (1352 records). [2025-09-14T20:53:21.816010] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-14T20:53:21.853250] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-14T20:53:21.857373] [INFO ] [MAIN ] Derivative Progress: 725/2226 symbols completed. ET took 1.2s. Estimated remaining: 8m 51s. Rate: 169.5 symbols/min [2025-09-14T20:53:21.891306] [INFO ] [MAIN ] Derivative Progress: 726/2226 symbols completed. ETD took 1.2s. Estimated remaining: 8m 50s. Rate: 169.7 symbols/min [2025-09-14T20:53:21.891556] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:21.911278] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:22.018496] [DEBUG] [LOCAL ] ETJ: Loaded 11407 existing records from primary storage. [2025-09-14T20:53:22.099709] [INFO ] [MAIN ] ETJ: Loaded 11407 primary data records. [2025-09-14T20:53:22.280683] [DEBUG] [LOCAL ] ETN: Loaded 39663 existing records from primary storage. [2025-09-14T20:53:22.317102] [INFO ] [MAIN ] ETN: Loaded 39663 primary data records. [2025-09-14T20:53:22.611047] [DEBUG] [MAIN ] ETG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:22.701473] [INFO ] [MAIN ] ETG: Generated 1352 derivative records from 12352 primary records. [2025-09-14T20:53:22.702920] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-14T20:53:22.719534] [DEBUG] [LOCAL ] ETG: Derivative data saved (1352 records). [2025-09-14T20:53:22.723865] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-14T20:53:22.726997] [INFO ] [MAIN ] Derivative Progress: 727/2226 symbols completed. ETG took 1.0s. Estimated remaining: 8m 51s. Rate: 169.4 symbols/min [2025-09-14T20:53:22.727699] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:22.739359] [DEBUG] [MAIN ] ETJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:22.741067] [INFO ] [MAIN ] ETJ: Generated 1352 derivative records from 11407 primary records. [2025-09-14T20:53:22.741306] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-14T20:53:22.759451] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1352 records). [2025-09-14T20:53:22.763527] [DEBUG] [LOCAL ] ETO: Loaded 4919 existing records from primary storage. [2025-09-14T20:53:22.764062] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-14T20:53:22.764222] [INFO ] [MAIN ] ETO: Loaded 4919 primary data records. [2025-09-14T20:53:22.766717] [INFO ] [MAIN ] Derivative Progress: 728/2226 symbols completed. ETJ took 0.9s. Estimated remaining: 8m 50s. Rate: 169.6 symbols/min [2025-09-14T20:53:22.804414] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:22.948398] [DEBUG] [MAIN ] ETN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:22.983901] [INFO ] [MAIN ] ETN: Generated 1352 derivative records from 39663 primary records. [2025-09-14T20:53:22.984142] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-14T20:53:23.101247] [DEBUG] [LOCAL ] ETN: Derivative data saved (1352 records). [2025-09-14T20:53:23.102356] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-14T20:53:23.104451] [INFO ] [MAIN ] Derivative Progress: 729/2226 symbols completed. ETN took 1.2s. Estimated remaining: 8m 49s. Rate: 169.6 symbols/min [2025-09-14T20:53:23.105528] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:23.121590] [DEBUG] [LOCAL ] ETR: Loaded 40047 existing records from primary storage. [2025-09-14T20:53:23.123826] [INFO ] [MAIN ] ETR: Loaded 40047 primary data records. [2025-09-14T20:53:23.314270] [DEBUG] [LOCAL ] ETV: Loaded 15357 existing records from primary storage. [2025-09-14T20:53:23.357013] [INFO ] [MAIN ] ETV: Loaded 15357 primary data records. [2025-09-14T20:53:23.457216] [DEBUG] [MAIN ] ETO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:23.487212] [INFO ] [MAIN ] ETO: Generated 1352 derivative records from 4919 primary records. [2025-09-14T20:53:23.510735] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-14T20:53:23.601090] [DEBUG] [LOCAL ] ETO: Derivative data saved (1352 records). [2025-09-14T20:53:23.622042] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-14T20:53:23.628123] [INFO ] [MAIN ] Derivative Progress: 730/2226 symbols completed. ETO took 0.9s. Estimated remaining: 8m 49s. Rate: 169.5 symbols/min [2025-09-14T20:53:23.630195] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:23.740380] [DEBUG] [MAIN ] ETR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:23.747381] [INFO ] [MAIN ] ETR: Generated 1352 derivative records from 40047 primary records. [2025-09-14T20:53:23.747601] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-14T20:53:23.772058] [DEBUG] [LOCAL ] ETW: Loaded 18395 existing records from primary storage. [2025-09-14T20:53:23.771377] [DEBUG] [LOCAL ] ETR: Derivative data saved (1352 records). [2025-09-14T20:53:23.772574] [INFO ] [MAIN ] ETW: Loaded 18395 primary data records. [2025-09-14T20:53:23.773055] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-14T20:53:23.814041] [INFO ] [MAIN ] Derivative Progress: 731/2226 symbols completed. ETR took 1.0s. Estimated remaining: 8m 49s. Rate: 169.6 symbols/min [2025-09-14T20:53:23.861423] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:23.896448] [DEBUG] [MAIN ] ETV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:23.908936] [INFO ] [MAIN ] ETV: Generated 1352 derivative records from 15357 primary records. [2025-09-14T20:53:23.926169] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-14T20:53:23.977622] [DEBUG] [LOCAL ] ETX: Loaded 4115 existing records from primary storage. [2025-09-14T20:53:23.993515] [INFO ] [MAIN ] ETX: Loaded 4115 primary data records. [2025-09-14T20:53:24.153198] [DEBUG] [LOCAL ] ETV: Derivative data saved (1352 records). [2025-09-14T20:53:24.184778] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-14T20:53:24.216682] [INFO ] [MAIN ] Derivative Progress: 732/2226 symbols completed. ETV took 1.1s. Estimated remaining: 8m 49s. Rate: 169.6 symbols/min [2025-09-14T20:53:24.252009] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:24.439748] [DEBUG] [LOCAL ] ETY: Loaded 16489 existing records from primary storage. [2025-09-14T20:53:24.440820] [INFO ] [MAIN ] ETY: Loaded 16489 primary data records. [2025-09-14T20:53:24.547329] [DEBUG] [MAIN ] ETW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:24.565589] [INFO ] [MAIN ] ETW: Generated 1352 derivative records from 18395 primary records. [2025-09-14T20:53:24.577944] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-14T20:53:24.742121] [DEBUG] [LOCAL ] ETW: Derivative data saved (1352 records). [2025-09-14T20:53:24.760204] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-14T20:53:24.766294] [INFO ] [MAIN ] Derivative Progress: 733/2226 symbols completed. ETW took 1.1s. Estimated remaining: 8m 49s. Rate: 169.5 symbols/min [2025-09-14T20:53:24.767786] [DEBUG] [MAIN ] ETX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:24.769537] [INFO ] [MAIN ] ETX: Generated 1352 derivative records from 4115 primary records. [2025-09-14T20:53:24.769978] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-14T20:53:24.784599] [DEBUG] [LOCAL ] ETX: Derivative data saved (1352 records). [2025-09-14T20:53:24.784893] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-14T20:53:24.787077] [INFO ] [MAIN ] Derivative Progress: 734/2226 symbols completed. ETX took 0.9s. Estimated remaining: 8m 48s. Rate: 169.7 symbols/min [2025-09-14T20:53:24.801031] [DEBUG] [MAIN ] ETY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:24.801732] [INFO ] [MAIN ] ETY: Generated 1352 derivative records from 16489 primary records. [2025-09-14T20:53:24.801809] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-14T20:53:24.814153] [DEBUG] [LOCAL ] ETY: Derivative data saved (1352 records). [2025-09-14T20:53:24.814230] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-14T20:53:24.817138] [INFO ] [MAIN ] Derivative Progress: 735/2226 symbols completed. ETY took 0.6s. Estimated remaining: 8m 47s. Rate: 169.9 symbols/min [2025-09-14T20:53:24.817741] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:24.818038] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:24.818183] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:24.835538] [DEBUG] [LOCAL ] EVF: Loaded 6509 existing records from primary storage. [2025-09-14T20:53:24.836014] [INFO ] [MAIN ] EVF: Loaded 6509 primary data records. [2025-09-14T20:53:24.941132] [DEBUG] [LOCAL ] EVC: Loaded 14021 existing records from primary storage. [2025-09-14T20:53:24.962276] [INFO ] [MAIN ] EVC: Loaded 14021 primary data records. [2025-09-14T20:53:24.962894] [DEBUG] [LOCAL ] EVEX: Loaded 22451 existing records from primary storage. [2025-09-14T20:53:24.963004] [INFO ] [MAIN ] EVEX: Loaded 22451 primary data records. [2025-09-14T20:53:25.747473] [DEBUG] [MAIN ] EVF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:25.750628] [INFO ] [MAIN ] EVF: Generated 1352 derivative records from 6509 primary records. [2025-09-14T20:53:25.750990] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-14T20:53:25.764256] [DEBUG] [LOCAL ] EVF: Derivative data saved (1352 records). [2025-09-14T20:53:25.764717] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-14T20:53:25.767186] [INFO ] [MAIN ] Derivative Progress: 736/2226 symbols completed. EVF took 0.9s. Estimated remaining: 8m 47s. Rate: 169.5 symbols/min [2025-09-14T20:53:25.768928] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:25.793010] [DEBUG] [MAIN ] EVC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:25.800560] [INFO ] [MAIN ] EVC: Generated 1352 derivative records from 14021 primary records. [2025-09-14T20:53:25.801270] [DEBUG] [LOCAL ] EVG: Loaded 4298 existing records from primary storage. [2025-09-14T20:53:25.800839] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-14T20:53:25.801815] [INFO ] [MAIN ] EVG: Loaded 4298 primary data records. [2025-09-14T20:53:25.801665] [DEBUG] [MAIN ] EVEX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:25.803913] [INFO ] [MAIN ] EVEX: Generated 1352 derivative records from 22451 primary records. [2025-09-14T20:53:25.810368] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-14T20:53:25.847333] [DEBUG] [LOCAL ] EVC: Derivative data saved (1352 records). [2025-09-14T20:53:25.872141] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-14T20:53:25.923332] [INFO ] [MAIN ] Derivative Progress: 737/2226 symbols completed. EVC took 1.1s. Estimated remaining: 8m 47s. Rate: 169.6 symbols/min [2025-09-14T20:53:25.938370] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1352 records). [2025-09-14T20:53:25.938299] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:25.939165] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-14T20:53:25.953607] [INFO ] [MAIN ] Derivative Progress: 738/2226 symbols completed. EVEX took 1.1s. Estimated remaining: 8m 46s. Rate: 169.9 symbols/min [2025-09-14T20:53:25.969673] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:26.118516] [DEBUG] [LOCAL ] EVN: Loaded 7883 existing records from primary storage. [2025-09-14T20:53:26.119461] [INFO ] [MAIN ] EVN: Loaded 7883 primary data records. [2025-09-14T20:53:26.274309] [DEBUG] [LOCAL ] EVH: Loaded 37038 existing records from primary storage. [2025-09-14T20:53:26.329526] [INFO ] [MAIN ] EVH: Loaded 37038 primary data records. [2025-09-14T20:53:26.604044] [DEBUG] [MAIN ] EVG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:26.606222] [INFO ] [MAIN ] EVG: Generated 1352 derivative records from 4298 primary records. [2025-09-14T20:53:26.621845] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-14T20:53:26.696942] [DEBUG] [LOCAL ] EVG: Derivative data saved (1352 records). [2025-09-14T20:53:26.700662] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-14T20:53:26.790046] [INFO ] [MAIN ] Derivative Progress: 739/2226 symbols completed. EVG took 1.0s. Estimated remaining: 8m 46s. Rate: 169.5 symbols/min [2025-09-14T20:53:26.797220] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:26.815425] [DEBUG] [MAIN ] EVN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:26.816876] [INFO ] [MAIN ] EVN: Generated 1352 derivative records from 7883 primary records. [2025-09-14T20:53:26.817325] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-14T20:53:26.841479] [DEBUG] [LOCAL ] EVN: Derivative data saved (1352 records). [2025-09-14T20:53:26.842019] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-14T20:53:26.844134] [INFO ] [MAIN ] Derivative Progress: 740/2226 symbols completed. EVN took 0.9s. Estimated remaining: 8m 45s. Rate: 169.7 symbols/min [2025-09-14T20:53:26.844565] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:26.871464] [DEBUG] [LOCAL ] EVR: Loaded 25593 existing records from primary storage. [2025-09-14T20:53:26.876225] [DEBUG] [MAIN ] EVH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:26.877419] [INFO ] [MAIN ] EVR: Loaded 25593 primary data records. [2025-09-14T20:53:26.877292] [INFO ] [MAIN ] EVH: Generated 1352 derivative records from 37038 primary records. [2025-09-14T20:53:26.877567] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-14T20:53:26.975293] [DEBUG] [LOCAL ] EVT: Loaded 12781 existing records from primary storage. [2025-09-14T20:53:26.989015] [DEBUG] [LOCAL ] EVH: Derivative data saved (1352 records). [2025-09-14T20:53:26.995636] [INFO ] [MAIN ] EVT: Loaded 12781 primary data records. [2025-09-14T20:53:27.005348] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-14T20:53:27.023914] [INFO ] [MAIN ] Derivative Progress: 741/2226 symbols completed. EVH took 1.1s. Estimated remaining: 8m 45s. Rate: 169.9 symbols/min [2025-09-14T20:53:27.122442] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:27.508607] [DEBUG] [LOCAL ] EVTC: Loaded 19605 existing records from primary storage. [2025-09-14T20:53:27.509454] [INFO ] [MAIN ] EVTC: Loaded 19605 primary data records. [2025-09-14T20:53:27.809308] [DEBUG] [MAIN ] EVR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:27.811185] [INFO ] [MAIN ] EVR: Generated 1352 derivative records from 25593 primary records. [2025-09-14T20:53:27.812088] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-14T20:53:27.841833] [DEBUG] [LOCAL ] EVR: Derivative data saved (1352 records). [2025-09-14T20:53:27.842697] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-14T20:53:27.843231] [DEBUG] [MAIN ] EVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:27.846259] [INFO ] [MAIN ] Derivative Progress: 742/2226 symbols completed. EVR took 1.0s. Estimated remaining: 8m 45s. Rate: 169.5 symbols/min [2025-09-14T20:53:27.848682] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:27.848186] [INFO ] [MAIN ] EVT: Generated 1352 derivative records from 12781 primary records. [2025-09-14T20:53:27.849750] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-14T20:53:27.866054] [DEBUG] [LOCAL ] EVT: Derivative data saved (1352 records). [2025-09-14T20:53:27.866286] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-14T20:53:27.868832] [INFO ] [MAIN ] Derivative Progress: 743/2226 symbols completed. EVT took 1.0s. Estimated remaining: 8m 44s. Rate: 169.8 symbols/min [2025-09-14T20:53:27.869093] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:27.899134] [DEBUG] [MAIN ] EVTC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:27.900030] [INFO ] [MAIN ] EVTC: Generated 1352 derivative records from 19605 primary records. [2025-09-14T20:53:27.900255] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-14T20:53:27.930752] [DEBUG] [LOCAL ] EVTR: Loaded 17332 existing records from primary storage. [2025-09-14T20:53:27.931488] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1352 records). [2025-09-14T20:53:27.932531] [INFO ] [MAIN ] EVTR: Loaded 17332 primary data records. [2025-09-14T20:53:27.932281] [DEBUG] [LOCAL ] EVTL: Loaded 29725 existing records from primary storage. [2025-09-14T20:53:27.938093] [INFO ] [MAIN ] EVTL: Loaded 29725 primary data records. [2025-09-14T20:53:27.932614] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-14T20:53:27.948027] [INFO ] [MAIN ] Derivative Progress: 744/2226 symbols completed. EVTC took 0.9s. Estimated remaining: 8m 43s. Rate: 169.9 symbols/min [2025-09-14T20:53:28.054596] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:28.531584] [DEBUG] [LOCAL ] EW: Loaded 40167 existing records from primary storage. [2025-09-14T20:53:28.533472] [INFO ] [MAIN ] EW: Loaded 40167 primary data records. [2025-09-14T20:53:28.892884] [DEBUG] [MAIN ] EVTL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:28.892048] [DEBUG] [MAIN ] EVTR: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:53:28.893802] [INFO ] [MAIN ] EVTL: Generated 1352 derivative records from 29725 primary records. [2025-09-14T20:53:28.894057] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-14T20:53:28.894541] [INFO ] [MAIN ] EVTR: Generated 1351 derivative records from 17332 primary records. [2025-09-14T20:53:28.895852] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-14T20:53:28.918503] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1352 records). [2025-09-14T20:53:28.919684] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-14T20:53:28.923146] [INFO ] [MAIN ] Derivative Progress: 745/2226 symbols completed. EVTL took 1.1s. Estimated remaining: 8m 44s. Rate: 169.5 symbols/min [2025-09-14T20:53:28.923386] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:28.925913] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1351 records). [2025-09-14T20:53:28.926346] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-14T20:53:28.928399] [INFO ] [MAIN ] Derivative Progress: 746/2226 symbols completed. EVTR took 1.1s. Estimated remaining: 8m 43s. Rate: 169.8 symbols/min [2025-09-14T20:53:28.929130] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:28.945244] [DEBUG] [MAIN ] EW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:28.955010] [INFO ] [MAIN ] EW: Generated 1352 derivative records from 40167 primary records. [2025-09-14T20:53:28.955287] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-14T20:53:28.969425] [DEBUG] [LOCAL ] EW: Derivative data saved (1352 records). [2025-09-14T20:53:28.985670] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-14T20:53:28.989504] [DEBUG] [LOCAL ] EXG: Loaded 25562 existing records from primary storage. [2025-09-14T20:53:28.988089] [INFO ] [MAIN ] Derivative Progress: 747/2226 symbols completed. EW took 1.0s. Estimated remaining: 8m 42s. Rate: 170.0 symbols/min [2025-09-14T20:53:28.989795] [INFO ] [MAIN ] EXG: Loaded 25562 primary data records. [2025-09-14T20:53:28.989973] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:29.106598] [DEBUG] [LOCAL ] EXK: Loaded 39936 existing records from primary storage. [2025-09-14T20:53:29.107848] [INFO ] [MAIN ] EXK: Loaded 39936 primary data records. [2025-09-14T20:53:29.368419] [DEBUG] [LOCAL ] EXP: Loaded 22227 existing records from primary storage. [2025-09-14T20:53:29.396473] [INFO ] [MAIN ] EXP: Loaded 22227 primary data records. [2025-09-14T20:53:29.884325] [DEBUG] [MAIN ] EXG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:29.886405] [INFO ] [MAIN ] EXG: Generated 1352 derivative records from 25562 primary records. [2025-09-14T20:53:29.886901] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-14T20:53:29.903136] [DEBUG] [LOCAL ] EXG: Derivative data saved (1352 records). [2025-09-14T20:53:29.903382] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-14T20:53:29.913863] [DEBUG] [MAIN ] EXK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:29.914587] [INFO ] [MAIN ] EXK: Generated 1352 derivative records from 39936 primary records. [2025-09-14T20:53:29.914787] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-14T20:53:29.917416] [INFO ] [MAIN ] Derivative Progress: 748/2226 symbols completed. EXG took 1.0s. Estimated remaining: 8m 43s. Rate: 169.6 symbols/min [2025-09-14T20:53:29.932004] [DEBUG] [LOCAL ] EXK: Derivative data saved (1352 records). [2025-09-14T20:53:29.932240] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-14T20:53:29.934571] [INFO ] [MAIN ] Derivative Progress: 749/2226 symbols completed. EXK took 1.0s. Estimated remaining: 8m 42s. Rate: 169.8 symbols/min [2025-09-14T20:53:29.944457] [DEBUG] [MAIN ] EXP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:29.945303] [INFO ] [MAIN ] EXP: Generated 1352 derivative records from 22227 primary records. [2025-09-14T20:53:29.945381] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-14T20:53:29.957434] [DEBUG] [LOCAL ] EXP: Derivative data saved (1352 records). [2025-09-14T20:53:29.957518] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-14T20:53:29.959812] [INFO ] [MAIN ] Derivative Progress: 750/2226 symbols completed. EXP took 1.0s. Estimated remaining: 8m 41s. Rate: 170.0 symbols/min [2025-09-14T20:53:29.960353] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:29.960411] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:29.960830] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:30.021266] [DEBUG] [LOCAL ] EXPD: Loaded 36005 existing records from primary storage. [2025-09-14T20:53:30.021509] [INFO ] [MAIN ] EXPD: Loaded 36005 primary data records. [2025-09-14T20:53:30.148967] [DEBUG] [LOCAL ] F: Loaded 40560 existing records from primary storage. [2025-09-14T20:53:30.149072] [DEBUG] [LOCAL ] EXR: Loaded 34050 existing records from primary storage. [2025-09-14T20:53:30.170277] [INFO ] [MAIN ] F: Loaded 40560 primary data records. [2025-09-14T20:53:30.198253] [INFO ] [MAIN ] EXR: Loaded 34050 primary data records. [2025-09-14T20:53:30.934005] [DEBUG] [MAIN ] EXPD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:30.937429] [INFO ] [MAIN ] EXPD: Generated 1352 derivative records from 36005 primary records. [2025-09-14T20:53:30.938440] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-14T20:53:31.020923] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1352 records). [2025-09-14T20:53:31.021665] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-14T20:53:31.024694] [INFO ] [MAIN ] Derivative Progress: 751/2226 symbols completed. EXPD took 1.1s. Estimated remaining: 8m 42s. Rate: 169.6 symbols/min [2025-09-14T20:53:31.025057] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:31.053883] [DEBUG] [MAIN ] F: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:31.054308] [DEBUG] [MAIN ] EXR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:31.055760] [INFO ] [MAIN ] F: Generated 1352 derivative records from 40560 primary records. [2025-09-14T20:53:31.056861] [INFO ] [MAIN ] EXR: Generated 1352 derivative records from 34050 primary records. [2025-09-14T20:53:31.057120] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-14T20:53:31.057049] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-14T20:53:31.089879] [DEBUG] [LOCAL ] EXR: Derivative data saved (1352 records). [2025-09-14T20:53:31.093676] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-14T20:53:31.093806] [DEBUG] [LOCAL ] F: Derivative data saved (1352 records). [2025-09-14T20:53:31.096394] [INFO ] [MAIN ] Derivative Progress: 752/2226 symbols completed. EXR took 1.1s. Estimated remaining: 8m 41s. Rate: 169.7 symbols/min [2025-09-14T20:53:31.096879] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:31.097081] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-14T20:53:31.101345] [INFO ] [MAIN ] Derivative Progress: 753/2226 symbols completed. F took 1.1s. Estimated remaining: 8m 40s. Rate: 170.0 symbols/min [2025-09-14T20:53:31.103174] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:31.114709] [DEBUG] [LOCAL ] FAF: Loaded 31749 existing records from primary storage. [2025-09-14T20:53:31.115086] [INFO ] [MAIN ] FAF: Loaded 31749 primary data records. [2025-09-14T20:53:31.335078] [DEBUG] [LOCAL ] FBK: Loaded 19646 existing records from primary storage. [2025-09-14T20:53:31.421913] [INFO ] [MAIN ] FBK: Loaded 19646 primary data records. [2025-09-14T20:53:31.422968] [DEBUG] [LOCAL ] FBIN: Loaded 38076 existing records from primary storage. [2025-09-14T20:53:31.424159] [INFO ] [MAIN ] FBIN: Loaded 38076 primary data records. [2025-09-14T20:53:32.001451] [DEBUG] [MAIN ] FAF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:32.004020] [INFO ] [MAIN ] FAF: Generated 1352 derivative records from 31749 primary records. [2025-09-14T20:53:32.004691] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-14T20:53:32.020386] [DEBUG] [LOCAL ] FAF: Derivative data saved (1352 records). [2025-09-14T20:53:32.021726] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-14T20:53:32.024005] [INFO ] [MAIN ] Derivative Progress: 754/2226 symbols completed. FAF took 1.0s. Estimated remaining: 8m 41s. Rate: 169.6 symbols/min [2025-09-14T20:53:32.025673] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:32.038314] [DEBUG] [MAIN ] FBK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:32.039967] [INFO ] [MAIN ] FBK: Generated 1352 derivative records from 19646 primary records. [2025-09-14T20:53:32.040121] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-14T20:53:32.068785] [DEBUG] [LOCAL ] FBK: Derivative data saved (1352 records). [2025-09-14T20:53:32.069145] [DEBUG] [MAIN ] FBIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:32.069633] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-14T20:53:32.070521] [INFO ] [MAIN ] FBIN: Generated 1352 derivative records from 38076 primary records. [2025-09-14T20:53:32.072773] [INFO ] [MAIN ] Derivative Progress: 755/2226 symbols completed. FBK took 1.0s. Estimated remaining: 8m 40s. Rate: 169.8 symbols/min [2025-09-14T20:53:32.073014] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-14T20:53:32.073268] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:32.086358] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1352 records). [2025-09-14T20:53:32.086493] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-14T20:53:32.089291] [INFO ] [MAIN ] Derivative Progress: 756/2226 symbols completed. FBIN took 1.0s. Estimated remaining: 8m 39s. Rate: 170.0 symbols/min [2025-09-14T20:53:32.089829] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:32.131184] [DEBUG] [LOCAL ] FC: Loaded 10642 existing records from primary storage. [2025-09-14T20:53:32.131476] [INFO ] [MAIN ] FC: Loaded 10642 primary data records. [2025-09-14T20:53:32.223567] [DEBUG] [LOCAL ] FBP: Loaded 34097 existing records from primary storage. [2025-09-14T20:53:32.240771] [INFO ] [MAIN ] FBP: Loaded 34097 primary data records. [2025-09-14T20:53:32.339851] [DEBUG] [LOCAL ] FBRT: Loaded 25573 existing records from primary storage. [2025-09-14T20:53:32.379274] [INFO ] [MAIN ] FBRT: Loaded 25573 primary data records. [2025-09-14T20:53:33.036628] [DEBUG] [MAIN ] FC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:33.037086] [DEBUG] [MAIN ] FBP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:33.038581] [INFO ] [MAIN ] FBP: Generated 1352 derivative records from 34097 primary records. [2025-09-14T20:53:33.038961] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-14T20:53:33.038803] [INFO ] [MAIN ] FC: Generated 1352 derivative records from 10642 primary records. [2025-09-14T20:53:33.040496] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-14T20:53:33.054536] [DEBUG] [LOCAL ] FBP: Derivative data saved (1352 records). [2025-09-14T20:53:33.055836] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-14T20:53:33.058480] [INFO ] [MAIN ] Derivative Progress: 757/2226 symbols completed. FBP took 1.0s. Estimated remaining: 8m 40s. Rate: 169.6 symbols/min [2025-09-14T20:53:33.064697] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:33.071217] [DEBUG] [LOCAL ] FC: Derivative data saved (1352 records). [2025-09-14T20:53:33.071813] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-14T20:53:33.084041] [DEBUG] [MAIN ] FBRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:33.083525] [INFO ] [MAIN ] Derivative Progress: 758/2226 symbols completed. FC took 1.0s. Estimated remaining: 8m 39s. Rate: 169.8 symbols/min [2025-09-14T20:53:33.085088] [INFO ] [MAIN ] FBRT: Generated 1352 derivative records from 25573 primary records. [2025-09-14T20:53:33.085548] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:33.085734] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-14T20:53:33.102809] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1352 records). [2025-09-14T20:53:33.103102] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-14T20:53:33.105906] [INFO ] [MAIN ] Derivative Progress: 759/2226 symbols completed. FBRT took 1.0s. Estimated remaining: 8m 38s. Rate: 170.0 symbols/min [2025-09-14T20:53:33.106316] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:33.145246] [DEBUG] [LOCAL ] FCN: Loaded 19410 existing records from primary storage. [2025-09-14T20:53:33.146886] [INFO ] [MAIN ] FCN: Loaded 19410 primary data records. [2025-09-14T20:53:33.165434] [DEBUG] [LOCAL ] FCF: Loaded 28808 existing records from primary storage. [2025-09-14T20:53:33.190547] [INFO ] [MAIN ] FCF: Loaded 28808 primary data records. [2025-09-14T20:53:33.346998] [DEBUG] [LOCAL ] FCPT: Loaded 27113 existing records from primary storage. [2025-09-14T20:53:33.373304] [INFO ] [MAIN ] FCPT: Loaded 27113 primary data records. [2025-09-14T20:53:34.083142] [DEBUG] [MAIN ] FCN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:34.089604] [DEBUG] [MAIN ] FCF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:34.090725] [INFO ] [MAIN ] FCN: Generated 1352 derivative records from 19410 primary records. [2025-09-14T20:53:34.098782] [INFO ] [MAIN ] FCF: Generated 1352 derivative records from 28808 primary records. [2025-09-14T20:53:34.102581] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-14T20:53:34.103601] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-14T20:53:34.104270] [DEBUG] [MAIN ] FCPT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:34.106177] [INFO ] [MAIN ] FCPT: Generated 1352 derivative records from 27113 primary records. [2025-09-14T20:53:34.113076] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-14T20:53:34.144167] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1352 records). [2025-09-14T20:53:34.140898] [DEBUG] [LOCAL ] FCF: Derivative data saved (1352 records). [2025-09-14T20:53:34.144342] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-14T20:53:34.146886] [INFO ] [MAIN ] Derivative Progress: 760/2226 symbols completed. FCPT took 1.0s. Estimated remaining: 8m 39s. Rate: 169.6 symbols/min [2025-09-14T20:53:34.147831] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:34.149950] [DEBUG] [LOCAL ] FCN: Derivative data saved (1352 records). [2025-09-14T20:53:34.150353] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-14T20:53:34.150221] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-14T20:53:34.153376] [INFO ] [MAIN ] Derivative Progress: 761/2226 symbols completed. FCF took 1.1s. Estimated remaining: 8m 38s. Rate: 169.8 symbols/min [2025-09-14T20:53:34.156130] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:34.156316] [INFO ] [MAIN ] Derivative Progress: 762/2226 symbols completed. FCN took 1.1s. Estimated remaining: 8m 37s. Rate: 170.0 symbols/min [2025-09-14T20:53:34.156985] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:34.168264] [DEBUG] [LOCAL ] FCT: Loaded 10451 existing records from primary storage. [2025-09-14T20:53:34.168546] [INFO ] [MAIN ] FCT: Loaded 10451 primary data records. [2025-09-14T20:53:34.371471] [DEBUG] [LOCAL ] FDP: Loaded 22780 existing records from primary storage. [2025-09-14T20:53:34.459484] [INFO ] [MAIN ] FDP: Loaded 22780 primary data records. [2025-09-14T20:53:34.477161] [DEBUG] [LOCAL ] FCX: Loaded 40442 existing records from primary storage. [2025-09-14T20:53:34.483876] [INFO ] [MAIN ] FCX: Loaded 40442 primary data records. [2025-09-14T20:53:35.061199] [DEBUG] [MAIN ] FCT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:35.063061] [INFO ] [MAIN ] FCT: Generated 1352 derivative records from 10451 primary records. [2025-09-14T20:53:35.064551] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-14T20:53:35.081236] [DEBUG] [LOCAL ] FCT: Derivative data saved (1352 records). [2025-09-14T20:53:35.081815] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-14T20:53:35.085271] [INFO ] [MAIN ] Derivative Progress: 763/2226 symbols completed. FCT took 0.9s. Estimated remaining: 8m 37s. Rate: 169.7 symbols/min [2025-09-14T20:53:35.101318] [DEBUG] [MAIN ] FDP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:35.106294] [INFO ] [MAIN ] FDP: Generated 1352 derivative records from 22780 primary records. [2025-09-14T20:53:35.106937] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-14T20:53:35.124252] [DEBUG] [MAIN ] FCX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:35.135950] [INFO ] [MAIN ] FCX: Generated 1352 derivative records from 40442 primary records. [2025-09-14T20:53:35.136927] [DEBUG] [LOCAL ] FDP: Derivative data saved (1352 records). [2025-09-14T20:53:35.136983] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-14T20:53:35.137072] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-14T20:53:35.139969] [INFO ] [MAIN ] Derivative Progress: 764/2226 symbols completed. FDP took 1.0s. Estimated remaining: 8m 36s. Rate: 169.9 symbols/min [2025-09-14T20:53:35.152814] [DEBUG] [LOCAL ] FCX: Derivative data saved (1352 records). [2025-09-14T20:53:35.152907] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-14T20:53:35.154811] [INFO ] [MAIN ] Derivative Progress: 765/2226 symbols completed. FCX took 1.0s. Estimated remaining: 8m 35s. Rate: 170.1 symbols/min [2025-09-14T20:53:35.155471] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:35.155366] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:35.155545] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:35.178263] [DEBUG] [LOCAL ] FDS: Loaded 18399 existing records from primary storage. [2025-09-14T20:53:35.178531] [INFO ] [MAIN ] FDS: Loaded 18399 primary data records. [2025-09-14T20:53:35.415577] [DEBUG] [LOCAL ] FDX: Loaded 38650 existing records from primary storage. [2025-09-14T20:53:35.421866] [INFO ] [MAIN ] FDX: Loaded 38650 primary data records. [2025-09-14T20:53:35.421694] [DEBUG] [LOCAL ] FE: Loaded 40224 existing records from primary storage. [2025-09-14T20:53:35.422152] [INFO ] [MAIN ] FE: Loaded 40224 primary data records. [2025-09-14T20:53:36.151187] [DEBUG] [MAIN ] FDS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:36.154867] [INFO ] [MAIN ] FDS: Generated 1352 derivative records from 18399 primary records. [2025-09-14T20:53:36.155514] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-14T20:53:36.171571] [DEBUG] [LOCAL ] FDS: Derivative data saved (1352 records). [2025-09-14T20:53:36.173271] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-14T20:53:36.178692] [INFO ] [MAIN ] Derivative Progress: 766/2226 symbols completed. FDS took 1.0s. Estimated remaining: 8m 36s. Rate: 169.6 symbols/min [2025-09-14T20:53:36.189802] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:36.190451] [DEBUG] [MAIN ] FDX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:36.201750] [INFO ] [MAIN ] FDX: Generated 1352 derivative records from 38650 primary records. [2025-09-14T20:53:36.202383] [DEBUG] [MAIN ] FE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:36.202602] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-14T20:53:36.203248] [INFO ] [MAIN ] FE: Generated 1352 derivative records from 40224 primary records. [2025-09-14T20:53:36.204206] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-14T20:53:36.231566] [DEBUG] [LOCAL ] FDX: Derivative data saved (1352 records). [2025-09-14T20:53:36.231681] [DEBUG] [LOCAL ] FE: Derivative data saved (1352 records). [2025-09-14T20:53:36.232121] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-14T20:53:36.231926] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-14T20:53:36.234966] [INFO ] [MAIN ] Derivative Progress: 767/2226 symbols completed. FE took 1.1s. Estimated remaining: 8m 35s. Rate: 169.8 symbols/min [2025-09-14T20:53:36.238047] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:36.238199] [INFO ] [MAIN ] Derivative Progress: 768/2226 symbols completed. FDX took 1.1s. Estimated remaining: 8m 34s. Rate: 170.1 symbols/min [2025-09-14T20:53:36.239275] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:36.251859] [DEBUG] [LOCAL ] FET: Loaded 9010 existing records from primary storage. [2025-09-14T20:53:36.252141] [INFO ] [MAIN ] FET: Loaded 9010 primary data records. [2025-09-14T20:53:36.396793] [DEBUG] [LOCAL ] FF: Loaded 18158 existing records from primary storage. [2025-09-14T20:53:36.408576] [INFO ] [MAIN ] FF: Loaded 18158 primary data records. [2025-09-14T20:53:36.414947] [DEBUG] [LOCAL ] FERG: Loaded 36237 existing records from primary storage. [2025-09-14T20:53:36.444105] [INFO ] [MAIN ] FERG: Loaded 36237 primary data records. [2025-09-14T20:53:37.201204] [DEBUG] [MAIN ] FET: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:37.202717] [INFO ] [MAIN ] FET: Generated 1352 derivative records from 9010 primary records. [2025-09-14T20:53:37.203991] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-14T20:53:37.221307] [DEBUG] [LOCAL ] FET: Derivative data saved (1352 records). [2025-09-14T20:53:37.221502] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-14T20:53:37.230617] [INFO ] [MAIN ] Derivative Progress: 769/2226 symbols completed. FET took 1.0s. Estimated remaining: 8m 35s. Rate: 169.7 symbols/min [2025-09-14T20:53:37.235678] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:37.236154] [DEBUG] [MAIN ] FERG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:37.237997] [INFO ] [MAIN ] FERG: Generated 1352 derivative records from 36237 primary records. [2025-09-14T20:53:37.238342] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-14T20:53:37.248715] [DEBUG] [MAIN ] FF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:37.252659] [INFO ] [MAIN ] FF: Generated 1352 derivative records from 18158 primary records. [2025-09-14T20:53:37.253310] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-14T20:53:37.264834] [DEBUG] [LOCAL ] FFA: Loaded 3498 existing records from primary storage. [2025-09-14T20:53:37.270041] [DEBUG] [LOCAL ] FERG: Derivative data saved (1352 records). [2025-09-14T20:53:37.276418] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-14T20:53:37.282344] [INFO ] [MAIN ] Derivative Progress: 770/2226 symbols completed. FERG took 1.1s. Estimated remaining: 8m 34s. Rate: 169.8 symbols/min [2025-09-14T20:53:37.282474] [INFO ] [MAIN ] FFA: Loaded 3498 primary data records. [2025-09-14T20:53:37.283150] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:37.307816] [DEBUG] [LOCAL ] FF: Derivative data saved (1352 records). [2025-09-14T20:53:37.324452] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-14T20:53:37.333419] [INFO ] [MAIN ] Derivative Progress: 771/2226 symbols completed. FF took 1.1s. Estimated remaining: 8m 33s. Rate: 170.0 symbols/min [2025-09-14T20:53:37.346492] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:37.463079] [DEBUG] [LOCAL ] FFC: Loaded 12077 existing records from primary storage. [2025-09-14T20:53:37.482571] [INFO ] [MAIN ] FFC: Loaded 12077 primary data records. [2025-09-14T20:53:37.718114] [DEBUG] [LOCAL ] FFWM: Loaded 26759 existing records from primary storage. [2025-09-14T20:53:37.767785] [INFO ] [MAIN ] FFWM: Loaded 26759 primary data records. [2025-09-14T20:53:38.057854] [DEBUG] [MAIN ] FFA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:38.095064] [INFO ] [MAIN ] FFA: Generated 1352 derivative records from 3498 primary records. [2025-09-14T20:53:38.098626] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-14T20:53:38.268805] [DEBUG] [LOCAL ] FFA: Derivative data saved (1352 records). [2025-09-14T20:53:38.269011] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-14T20:53:38.271035] [INFO ] [MAIN ] Derivative Progress: 772/2226 symbols completed. FFA took 1.0s. Estimated remaining: 8m 34s. Rate: 169.7 symbols/min [2025-09-14T20:53:38.271960] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:38.289897] [DEBUG] [MAIN ] FFC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:38.290925] [INFO ] [MAIN ] FFC: Generated 1352 derivative records from 12077 primary records. [2025-09-14T20:53:38.296342] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-14T20:53:38.317979] [DEBUG] [LOCAL ] FFC: Derivative data saved (1352 records). [2025-09-14T20:53:38.318180] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-14T20:53:38.318685] [DEBUG] [LOCAL ] FG: Loaded 15506 existing records from primary storage. [2025-09-14T20:53:38.321904] [INFO ] [MAIN ] Derivative Progress: 773/2226 symbols completed. FFC took 1.0s. Estimated remaining: 8m 33s. Rate: 169.9 symbols/min [2025-09-14T20:53:38.322263] [INFO ] [MAIN ] FG: Loaded 15506 primary data records. [2025-09-14T20:53:38.322821] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:38.436720] [DEBUG] [LOCAL ] FGN: Loaded 2766 existing records from primary storage. [2025-09-14T20:53:38.440971] [DEBUG] [MAIN ] FFWM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:38.444673] [INFO ] [MAIN ] FGN: Loaded 2766 primary data records. [2025-09-14T20:53:38.451667] [INFO ] [MAIN ] FFWM: Generated 1352 derivative records from 26759 primary records. [2025-09-14T20:53:38.508605] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-14T20:53:38.902487] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1352 records). [2025-09-14T20:53:38.914342] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-14T20:53:38.916911] [INFO ] [MAIN ] Derivative Progress: 774/2226 symbols completed. FFWM took 1.6s. Estimated remaining: 8m 33s. Rate: 169.7 symbols/min [2025-09-14T20:53:38.918057] [INFO ] [MAIN ] FGSN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:38.929947] [DEBUG] [LOCAL ] FGSN: Loaded 3585 existing records from primary storage. [2025-09-14T20:53:38.930736] [INFO ] [MAIN ] FGSN: Loaded 3585 primary data records. [2025-09-14T20:53:39.069839] [DEBUG] [MAIN ] FG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:39.102142] [INFO ] [MAIN ] FG: Generated 1352 derivative records from 15506 primary records. [2025-09-14T20:53:39.147562] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-14T20:53:39.234661] [DEBUG] [MAIN ] FGN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:39.243819] [INFO ] [MAIN ] FGN: Generated 1352 derivative records from 2766 primary records. [2025-09-14T20:53:39.250662] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-14T20:53:39.271722] [DEBUG] [LOCAL ] FGN: Derivative data saved (1352 records). [2025-09-14T20:53:39.269570] [DEBUG] [LOCAL ] FG: Derivative data saved (1352 records). [2025-09-14T20:53:39.272426] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-14T20:53:39.275284] [INFO ] [MAIN ] Derivative Progress: 775/2226 symbols completed. FGN took 1.0s. Estimated remaining: 8m 33s. Rate: 169.7 symbols/min [2025-09-14T20:53:39.275397] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-14T20:53:39.278793] [INFO ] [MAIN ] Derivative Progress: 776/2226 symbols completed. FG took 1.0s. Estimated remaining: 8m 32s. Rate: 169.9 symbols/min [2025-09-14T20:53:39.278916] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:39.279904] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:39.300040] [DEBUG] [MAIN ] FGSN: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:53:39.300815] [INFO ] [MAIN ] FGSN: Generated 1351 derivative records from 3585 primary records. [2025-09-14T20:53:39.300898] [DEBUG] [LOCAL ] FGSN: Saving derivative data. [2025-09-14T20:53:39.313127] [DEBUG] [LOCAL ] FGSN: Derivative data saved (1351 records). [2025-09-14T20:53:39.324388] [INFO ] [MAIN ] FGSN: Successfully saved derivative data. [2025-09-14T20:53:39.326985] [INFO ] [MAIN ] Derivative Progress: 777/2226 symbols completed. FGSN took 0.4s. Estimated remaining: 8m 31s. Rate: 170.1 symbols/min [2025-09-14T20:53:39.327465] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:39.365167] [DEBUG] [LOCAL ] FHI: Loaded 30397 existing records from primary storage. [2025-09-14T20:53:39.365764] [INFO ] [MAIN ] FHI: Loaded 30397 primary data records. [2025-09-14T20:53:39.366668] [DEBUG] [LOCAL ] FHN: Loaded 40144 existing records from primary storage. [2025-09-14T20:53:39.407128] [INFO ] [MAIN ] FHN: Loaded 40144 primary data records. [2025-09-14T20:53:39.718880] [DEBUG] [LOCAL ] FI: Loaded 40371 existing records from primary storage. [2025-09-14T20:53:39.878141] [INFO ] [MAIN ] FI: Loaded 40371 primary data records. [2025-09-14T20:53:40.331461] [DEBUG] [MAIN ] FHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:40.336542] [INFO ] [MAIN ] FHI: Generated 1352 derivative records from 30397 primary records. [2025-09-14T20:53:40.337323] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-14T20:53:40.368766] [DEBUG] [LOCAL ] FHI: Derivative data saved (1352 records). [2025-09-14T20:53:40.369042] [DEBUG] [MAIN ] FHN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:40.370415] [INFO ] [MAIN ] FHN: Generated 1352 derivative records from 40144 primary records. [2025-09-14T20:53:40.369407] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-14T20:53:40.371169] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-14T20:53:40.374331] [INFO ] [MAIN ] Derivative Progress: 778/2226 symbols completed. FHI took 1.1s. Estimated remaining: 8m 32s. Rate: 169.7 symbols/min [2025-09-14T20:53:40.394935] [DEBUG] [LOCAL ] FHN: Derivative data saved (1352 records). [2025-09-14T20:53:40.395425] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-14T20:53:40.397851] [INFO ] [MAIN ] Derivative Progress: 779/2226 symbols completed. FHN took 1.1s. Estimated remaining: 8m 31s. Rate: 169.9 symbols/min [2025-09-14T20:53:40.411739] [DEBUG] [MAIN ] FI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:40.413540] [INFO ] [MAIN ] FI: Generated 1352 derivative records from 40371 primary records. [2025-09-14T20:53:40.413708] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-14T20:53:40.427159] [DEBUG] [LOCAL ] FI: Derivative data saved (1352 records). [2025-09-14T20:53:40.427256] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-14T20:53:40.429680] [INFO ] [MAIN ] Derivative Progress: 780/2226 symbols completed. FI took 1.1s. Estimated remaining: 8m 30s. Rate: 170.1 symbols/min [2025-09-14T20:53:40.430448] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:40.430764] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:40.430872] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:40.474183] [DEBUG] [LOCAL ] FICO: Loaded 16252 existing records from primary storage. [2025-09-14T20:53:40.474558] [INFO ] [MAIN ] FICO: Loaded 16252 primary data records. [2025-09-14T20:53:40.590758] [DEBUG] [LOCAL ] FIHL: Loaded 29260 existing records from primary storage. [2025-09-14T20:53:40.604896] [INFO ] [MAIN ] FIHL: Loaded 29260 primary data records. [2025-09-14T20:53:40.604719] [DEBUG] [LOCAL ] FIGS: Loaded 36665 existing records from primary storage. [2025-09-14T20:53:40.686393] [INFO ] [MAIN ] FIGS: Loaded 36665 primary data records. [2025-09-14T20:53:41.443876] [DEBUG] [MAIN ] FICO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:41.453821] [INFO ] [MAIN ] FICO: Generated 1352 derivative records from 16252 primary records. [2025-09-14T20:53:41.458213] [DEBUG] [MAIN ] FIHL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:41.459148] [INFO ] [MAIN ] FIHL: Generated 1352 derivative records from 29260 primary records. [2025-09-14T20:53:41.458550] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-14T20:53:41.459295] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-14T20:53:41.485945] [DEBUG] [MAIN ] FIGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:41.491574] [INFO ] [MAIN ] FIGS: Generated 1352 derivative records from 36665 primary records. [2025-09-14T20:53:41.497943] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-14T20:53:41.497793] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1352 records). [2025-09-14T20:53:41.498476] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-14T20:53:41.502234] [INFO ] [MAIN ] Derivative Progress: 781/2226 symbols completed. FIHL took 1.1s. Estimated remaining: 8m 31s. Rate: 169.6 symbols/min [2025-09-14T20:53:41.502463] [DEBUG] [LOCAL ] FICO: Derivative data saved (1352 records). [2025-09-14T20:53:41.503662] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-14T20:53:41.503119] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:41.511905] [INFO ] [MAIN ] Derivative Progress: 782/2226 symbols completed. FICO took 1.1s. Estimated remaining: 8m 30s. Rate: 169.8 symbols/min [2025-09-14T20:53:41.514671] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:41.517692] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1352 records). [2025-09-14T20:53:41.518532] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-14T20:53:41.520831] [INFO ] [MAIN ] Derivative Progress: 783/2226 symbols completed. FIGS took 1.1s. Estimated remaining: 8m 29s. Rate: 170.1 symbols/min [2025-09-14T20:53:41.521783] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:41.532210] [DEBUG] [LOCAL ] FINS: Loaded 6552 existing records from primary storage. [2025-09-14T20:53:41.532379] [INFO ] [MAIN ] FINS: Loaded 6552 primary data records. [2025-09-14T20:53:41.762138] [DEBUG] [LOCAL ] FINV: Loaded 33673 existing records from primary storage. [2025-09-14T20:53:41.763276] [DEBUG] [LOCAL ] FIS: Loaded 40130 existing records from primary storage. [2025-09-14T20:53:41.840465] [INFO ] [MAIN ] FIS: Loaded 40130 primary data records. [2025-09-14T20:53:41.826918] [INFO ] [MAIN ] FINV: Loaded 33673 primary data records. [2025-09-14T20:53:42.437133] [DEBUG] [MAIN ] FINS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:42.438371] [INFO ] [MAIN ] FINS: Generated 1352 derivative records from 6552 primary records. [2025-09-14T20:53:42.438556] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-14T20:53:42.452674] [DEBUG] [LOCAL ] FINS: Derivative data saved (1352 records). [2025-09-14T20:53:42.454470] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-14T20:53:42.457143] [INFO ] [MAIN ] Derivative Progress: 784/2226 symbols completed. FINS took 1.0s. Estimated remaining: 8m 30s. Rate: 169.7 symbols/min [2025-09-14T20:53:42.457850] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:42.470282] [DEBUG] [MAIN ] FIS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:42.471237] [INFO ] [MAIN ] FIS: Generated 1352 derivative records from 40130 primary records. [2025-09-14T20:53:42.471480] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-14T20:53:42.493441] [DEBUG] [LOCAL ] FIS: Derivative data saved (1352 records). [2025-09-14T20:53:42.502994] [DEBUG] [MAIN ] FINV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:42.503103] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-14T20:53:42.506798] [INFO ] [MAIN ] FINV: Generated 1352 derivative records from 33673 primary records. [2025-09-14T20:53:42.505924] [INFO ] [MAIN ] Derivative Progress: 785/2226 symbols completed. FIS took 1.0s. Estimated remaining: 8m 29s. Rate: 169.9 symbols/min [2025-09-14T20:53:42.507051] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-14T20:53:42.507229] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:42.526912] [DEBUG] [LOCAL ] FIX: Loaded 21542 existing records from primary storage. [2025-09-14T20:53:42.532781] [DEBUG] [LOCAL ] FLC: Loaded 3956 existing records from primary storage. [2025-09-14T20:53:42.532858] [INFO ] [MAIN ] FIX: Loaded 21542 primary data records. [2025-09-14T20:53:42.530046] [DEBUG] [LOCAL ] FINV: Derivative data saved (1352 records). [2025-09-14T20:53:42.532966] [INFO ] [MAIN ] FLC: Loaded 3956 primary data records. [2025-09-14T20:53:42.554302] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-14T20:53:42.621884] [INFO ] [MAIN ] Derivative Progress: 786/2226 symbols completed. FINV took 1.1s. Estimated remaining: 8m 28s. Rate: 170.0 symbols/min [2025-09-14T20:53:42.672392] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:43.164221] [DEBUG] [LOCAL ] FLG: Loaded 40127 existing records from primary storage. [2025-09-14T20:53:43.165526] [INFO ] [MAIN ] FLG: Loaded 40127 primary data records. [2025-09-14T20:53:43.328315] [DEBUG] [MAIN ] FLC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:43.360526] [INFO ] [MAIN ] FLC: Generated 1352 derivative records from 3956 primary records. [2025-09-14T20:53:43.365944] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-14T20:53:43.482542] [DEBUG] [MAIN ] FIX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:43.484089] [INFO ] [MAIN ] FIX: Generated 1352 derivative records from 21542 primary records. [2025-09-14T20:53:43.492908] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-14T20:53:43.496429] [DEBUG] [LOCAL ] FLC: Derivative data saved (1352 records). [2025-09-14T20:53:43.498028] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-14T20:53:43.506503] [INFO ] [MAIN ] Derivative Progress: 787/2226 symbols completed. FLC took 1.0s. Estimated remaining: 8m 29s. Rate: 169.7 symbols/min [2025-09-14T20:53:43.509110] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:43.514128] [DEBUG] [LOCAL ] FIX: Derivative data saved (1352 records). [2025-09-14T20:53:43.514542] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-14T20:53:43.517250] [INFO ] [MAIN ] Derivative Progress: 788/2226 symbols completed. FIX took 1.1s. Estimated remaining: 8m 28s. Rate: 169.9 symbols/min [2025-09-14T20:53:43.517519] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:43.534708] [DEBUG] [MAIN ] FLG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:43.542182] [INFO ] [MAIN ] FLG: Generated 1352 derivative records from 40127 primary records. [2025-09-14T20:53:43.542432] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-14T20:53:43.572506] [DEBUG] [LOCAL ] FLG: Derivative data saved (1352 records). [2025-09-14T20:53:43.571557] [DEBUG] [LOCAL ] FLNG: Loaded 25164 existing records from primary storage. [2025-09-14T20:53:43.572760] [INFO ] [MAIN ] FLNG: Loaded 25164 primary data records. [2025-09-14T20:53:43.572825] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-14T20:53:43.574905] [INFO ] [MAIN ] Derivative Progress: 789/2226 symbols completed. FLG took 0.9s. Estimated remaining: 8m 27s. Rate: 170.1 symbols/min [2025-09-14T20:53:43.580362] [INFO ] [MAIN ] FLOC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:43.720311] [DEBUG] [LOCAL ] FLO: Loaded 39052 existing records from primary storage. [2025-09-14T20:53:43.731063] [INFO ] [MAIN ] FLO: Loaded 39052 primary data records. [2025-09-14T20:53:44.014735] [DEBUG] [LOCAL ] FLOC: Loaded 20938 existing records from primary storage. [2025-09-14T20:53:44.015533] [INFO ] [MAIN ] FLOC: Loaded 20938 primary data records. [2025-09-14T20:53:44.493581] [DEBUG] [MAIN ] FLNG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:44.494954] [INFO ] [MAIN ] FLNG: Generated 1352 derivative records from 25164 primary records. [2025-09-14T20:53:44.495322] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-14T20:53:44.512895] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1352 records). [2025-09-14T20:53:44.523446] [DEBUG] [MAIN ] FLO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:44.523737] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-14T20:53:44.526021] [INFO ] [MAIN ] Derivative Progress: 790/2226 symbols completed. FLNG took 1.0s. Estimated remaining: 8m 28s. Rate: 169.7 symbols/min [2025-09-14T20:53:44.526985] [INFO ] [MAIN ] FLO: Generated 1352 derivative records from 39052 primary records. [2025-09-14T20:53:44.527371] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-14T20:53:44.527503] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:44.556843] [DEBUG] [LOCAL ] FLO: Derivative data saved (1352 records). [2025-09-14T20:53:44.558339] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-14T20:53:44.558201] [DEBUG] [MAIN ] FLOC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:44.561435] [INFO ] [MAIN ] Derivative Progress: 791/2226 symbols completed. FLO took 1.0s. Estimated remaining: 8m 27s. Rate: 169.9 symbols/min [2025-09-14T20:53:44.562903] [INFO ] [MAIN ] FLOC: Generated 1352 derivative records from 20938 primary records. [2025-09-14T20:53:44.563237] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:44.563501] [DEBUG] [LOCAL ] FLOC: Saving derivative data. [2025-09-14T20:53:44.596030] [DEBUG] [LOCAL ] FLOC: Derivative data saved (1352 records). [2025-09-14T20:53:44.596234] [INFO ] [MAIN ] FLOC: Successfully saved derivative data. [2025-09-14T20:53:44.598817] [INFO ] [MAIN ] Derivative Progress: 792/2226 symbols completed. FLOC took 1.0s. Estimated remaining: 8m 26s. Rate: 170.1 symbols/min [2025-09-14T20:53:44.599626] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:44.620665] [DEBUG] [LOCAL ] FLR: Loaded 40081 existing records from primary storage. [2025-09-14T20:53:44.620929] [INFO ] [MAIN ] FLR: Loaded 40081 primary data records. [2025-09-14T20:53:44.782919] [DEBUG] [LOCAL ] FLS: Loaded 37556 existing records from primary storage. [2025-09-14T20:53:44.819619] [INFO ] [MAIN ] FLS: Loaded 37556 primary data records. [2025-09-14T20:53:44.864414] [DEBUG] [LOCAL ] FLUT: Loaded 38069 existing records from primary storage. [2025-09-14T20:53:44.872970] [INFO ] [MAIN ] FLUT: Loaded 38069 primary data records. [2025-09-14T20:53:45.606385] [DEBUG] [MAIN ] FLR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:45.607676] [INFO ] [MAIN ] FLR: Generated 1352 derivative records from 40081 primary records. [2025-09-14T20:53:45.608107] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-14T20:53:45.623380] [DEBUG] [LOCAL ] FLR: Derivative data saved (1352 records). [2025-09-14T20:53:45.623730] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-14T20:53:45.628189] [INFO ] [MAIN ] Derivative Progress: 793/2226 symbols completed. FLR took 1.1s. Estimated remaining: 8m 27s. Rate: 169.7 symbols/min [2025-09-14T20:53:45.639098] [DEBUG] [MAIN ] FLS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:45.639792] [INFO ] [MAIN ] FLS: Generated 1352 derivative records from 37556 primary records. [2025-09-14T20:53:45.639987] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-14T20:53:45.668350] [DEBUG] [LOCAL ] FLS: Derivative data saved (1352 records). [2025-09-14T20:53:45.668662] [DEBUG] [MAIN ] FLUT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:45.669420] [INFO ] [MAIN ] FLUT: Generated 1352 derivative records from 38069 primary records. [2025-09-14T20:53:45.669462] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-14T20:53:45.669627] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-14T20:53:45.672470] [INFO ] [MAIN ] Derivative Progress: 794/2226 symbols completed. FLS took 1.1s. Estimated remaining: 8m 26s. Rate: 169.9 symbols/min [2025-09-14T20:53:45.685322] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1352 records). [2025-09-14T20:53:45.685405] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-14T20:53:45.687529] [INFO ] [MAIN ] Derivative Progress: 795/2226 symbols completed. FLUT took 1.1s. Estimated remaining: 8m 25s. Rate: 170.1 symbols/min [2025-09-14T20:53:45.688223] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:45.688286] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:45.688325] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:45.696378] [DEBUG] [LOCAL ] FMN: Loaded 3943 existing records from primary storage. [2025-09-14T20:53:45.696573] [INFO ] [MAIN ] FMN: Loaded 3943 primary data records. [2025-09-14T20:53:45.801007] [DEBUG] [LOCAL ] FLXR: Loaded 15326 existing records from primary storage. [2025-09-14T20:53:45.812694] [INFO ] [MAIN ] FLXR: Loaded 15326 primary data records. [2025-09-14T20:53:46.281746] [DEBUG] [LOCAL ] FMC: Loaded 38798 existing records from primary storage. [2025-09-14T20:53:46.290162] [INFO ] [MAIN ] FMC: Loaded 38798 primary data records. [2025-09-14T20:53:46.589411] [DEBUG] [MAIN ] FMN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:46.593332] [INFO ] [MAIN ] FMN: Generated 1352 derivative records from 3943 primary records. [2025-09-14T20:53:46.594093] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-14T20:53:46.614942] [DEBUG] [MAIN ] FLXR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:46.616754] [INFO ] [MAIN ] FLXR: Generated 1352 derivative records from 15326 primary records. [2025-09-14T20:53:46.619147] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-14T20:53:46.620968] [DEBUG] [LOCAL ] FMN: Derivative data saved (1352 records). [2025-09-14T20:53:46.626817] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-14T20:53:46.630478] [INFO ] [MAIN ] Derivative Progress: 796/2226 symbols completed. FMN took 0.9s. Estimated remaining: 8m 25s. Rate: 169.7 symbols/min [2025-09-14T20:53:46.635550] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:46.637118] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1352 records). [2025-09-14T20:53:46.637878] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-14T20:53:46.640509] [INFO ] [MAIN ] Derivative Progress: 797/2226 symbols completed. FLXR took 1.0s. Estimated remaining: 8m 24s. Rate: 170.0 symbols/min [2025-09-14T20:53:46.640926] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:46.664982] [DEBUG] [MAIN ] FMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:46.665995] [INFO ] [MAIN ] FMC: Generated 1352 derivative records from 38798 primary records. [2025-09-14T20:53:46.666156] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-14T20:53:46.685501] [DEBUG] [LOCAL ] FMC: Derivative data saved (1352 records). [2025-09-14T20:53:46.685709] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-14T20:53:46.687778] [INFO ] [MAIN ] Derivative Progress: 798/2226 symbols completed. FMC took 1.0s. Estimated remaining: 8m 24s. Rate: 170.1 symbols/min [2025-09-14T20:53:46.688865] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:46.697318] [DEBUG] [LOCAL ] FMS: Loaded 22575 existing records from primary storage. [2025-09-14T20:53:46.697957] [INFO ] [MAIN ] FMS: Loaded 22575 primary data records. [2025-09-14T20:53:46.711720] [DEBUG] [LOCAL ] FMY: Loaded 1043 existing records from primary storage. [2025-09-14T20:53:46.749723] [INFO ] [MAIN ] FMY: Loaded 1043 primary data records. [2025-09-14T20:53:46.805157] [DEBUG] [LOCAL ] FMX: Loaded 30463 existing records from primary storage. [2025-09-14T20:53:46.875047] [INFO ] [MAIN ] FMX: Loaded 30463 primary data records. [2025-09-14T20:53:47.638455] [DEBUG] [MAIN ] FMY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:47.647487] [INFO ] [MAIN ] FMY: Generated 1352 derivative records from 1043 primary records. [2025-09-14T20:53:47.651605] [DEBUG] [MAIN ] FMS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:47.652001] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-14T20:53:47.652704] [INFO ] [MAIN ] FMS: Generated 1352 derivative records from 22575 primary records. [2025-09-14T20:53:47.653444] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-14T20:53:47.673620] [DEBUG] [MAIN ] FMX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:47.682733] [INFO ] [MAIN ] FMX: Generated 1352 derivative records from 30463 primary records. [2025-09-14T20:53:47.685918] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-14T20:53:47.686531] [DEBUG] [LOCAL ] FMY: Derivative data saved (1352 records). [2025-09-14T20:53:47.687301] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-14T20:53:47.689856] [INFO ] [MAIN ] Derivative Progress: 799/2226 symbols completed. FMY took 1.0s. Estimated remaining: 8m 24s. Rate: 169.7 symbols/min [2025-09-14T20:53:47.692326] [DEBUG] [LOCAL ] FMS: Derivative data saved (1352 records). [2025-09-14T20:53:47.692771] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-14T20:53:47.703077] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:47.705271] [INFO ] [MAIN ] Derivative Progress: 800/2226 symbols completed. FMS took 1.1s. Estimated remaining: 8m 23s. Rate: 169.9 symbols/min [2025-09-14T20:53:47.707853] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:47.710228] [DEBUG] [LOCAL ] FMX: Derivative data saved (1352 records). [2025-09-14T20:53:47.710493] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-14T20:53:47.712618] [INFO ] [MAIN ] Derivative Progress: 801/2226 symbols completed. FMX took 1.1s. Estimated remaining: 8m 22s. Rate: 170.2 symbols/min [2025-09-14T20:53:47.713086] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:47.745981] [DEBUG] [LOCAL ] FN: Loaded 28785 existing records from primary storage. [2025-09-14T20:53:47.746231] [INFO ] [MAIN ] FN: Loaded 28785 primary data records. [2025-09-14T20:53:47.963036] [DEBUG] [LOCAL ] FNB: Loaded 39382 existing records from primary storage. [2025-09-14T20:53:47.974781] [INFO ] [MAIN ] FNB: Loaded 39382 primary data records. [2025-09-14T20:53:48.093275] [DEBUG] [LOCAL ] FND: Loaded 39229 existing records from primary storage. [2025-09-14T20:53:48.116712] [INFO ] [MAIN ] FND: Loaded 39229 primary data records. [2025-09-14T20:53:48.677569] [DEBUG] [MAIN ] FN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:48.679835] [INFO ] [MAIN ] FN: Generated 1352 derivative records from 28785 primary records. [2025-09-14T20:53:48.680536] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-14T20:53:48.700351] [DEBUG] [LOCAL ] FN: Derivative data saved (1352 records). [2025-09-14T20:53:48.711235] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-14T20:53:48.711794] [DEBUG] [MAIN ] FNB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:48.714145] [INFO ] [MAIN ] Derivative Progress: 802/2226 symbols completed. FN took 1.0s. Estimated remaining: 8m 23s. Rate: 169.8 symbols/min [2025-09-14T20:53:48.715130] [INFO ] [MAIN ] FNB: Generated 1352 derivative records from 39382 primary records. [2025-09-14T20:53:48.715459] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:48.715826] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-14T20:53:48.731107] [DEBUG] [LOCAL ] FNB: Derivative data saved (1352 records). [2025-09-14T20:53:48.732445] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-14T20:53:48.737545] [INFO ] [MAIN ] Derivative Progress: 803/2226 symbols completed. FNB took 1.0s. Estimated remaining: 8m 22s. Rate: 170.0 symbols/min [2025-09-14T20:53:48.738367] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:48.749966] [DEBUG] [MAIN ] FND: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:48.751151] [INFO ] [MAIN ] FND: Generated 1352 derivative records from 39229 primary records. [2025-09-14T20:53:48.751239] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-14T20:53:48.764542] [DEBUG] [LOCAL ] FND: Derivative data saved (1352 records). [2025-09-14T20:53:48.765086] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-14T20:53:48.767474] [INFO ] [MAIN ] Derivative Progress: 804/2226 symbols completed. FND took 1.1s. Estimated remaining: 8m 21s. Rate: 170.2 symbols/min [2025-09-14T20:53:48.767875] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:48.788327] [DEBUG] [LOCAL ] FOA: Loaded 9277 existing records from primary storage. [2025-09-14T20:53:48.788734] [INFO ] [MAIN ] FOA: Loaded 9277 primary data records. [2025-09-14T20:53:48.811086] [DEBUG] [LOCAL ] FNF: Loaded 36881 existing records from primary storage. [2025-09-14T20:53:48.860410] [INFO ] [MAIN ] FNF: Loaded 36881 primary data records. [2025-09-14T20:53:49.021833] [DEBUG] [LOCAL ] FNV: Loaded 34341 existing records from primary storage. [2025-09-14T20:53:49.038092] [INFO ] [MAIN ] FNV: Loaded 34341 primary data records. [2025-09-14T20:53:49.689578] [DEBUG] [MAIN ] FOA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:49.692139] [INFO ] [MAIN ] FOA: Generated 1352 derivative records from 9277 primary records. [2025-09-14T20:53:49.692418] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-14T20:53:49.703079] [DEBUG] [MAIN ] FNF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:49.713022] [INFO ] [MAIN ] FNF: Generated 1352 derivative records from 36881 primary records. [2025-09-14T20:53:49.719784] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-14T20:53:49.719862] [DEBUG] [LOCAL ] FOA: Derivative data saved (1352 records). [2025-09-14T20:53:49.723494] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-14T20:53:49.735005] [INFO ] [MAIN ] Derivative Progress: 805/2226 symbols completed. FOA took 1.0s. Estimated remaining: 8m 22s. Rate: 169.8 symbols/min [2025-09-14T20:53:49.747048] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:49.748396] [DEBUG] [MAIN ] FNV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:49.750567] [INFO ] [MAIN ] FNV: Generated 1352 derivative records from 34341 primary records. [2025-09-14T20:53:49.751146] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-14T20:53:49.755402] [DEBUG] [LOCAL ] FNF: Derivative data saved (1352 records). [2025-09-14T20:53:49.755919] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-14T20:53:49.768171] [INFO ] [MAIN ] Derivative Progress: 806/2226 symbols completed. FNF took 1.1s. Estimated remaining: 8m 21s. Rate: 170.0 symbols/min [2025-09-14T20:53:49.770322] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:49.776236] [DEBUG] [LOCAL ] FOF: Loaded 5849 existing records from primary storage. [2025-09-14T20:53:49.776054] [DEBUG] [LOCAL ] FNV: Derivative data saved (1352 records). [2025-09-14T20:53:49.776951] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-14T20:53:49.779356] [INFO ] [MAIN ] Derivative Progress: 807/2226 symbols completed. FNV took 1.0s. Estimated remaining: 8m 20s. Rate: 170.2 symbols/min [2025-09-14T20:53:49.777052] [INFO ] [MAIN ] FOF: Loaded 5849 primary data records. [2025-09-14T20:53:49.779846] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:49.916922] [DEBUG] [LOCAL ] FOR: Loaded 14946 existing records from primary storage. [2025-09-14T20:53:49.938730] [INFO ] [MAIN ] FOR: Loaded 14946 primary data records. [2025-09-14T20:53:50.229470] [DEBUG] [LOCAL ] FOUR: Loaded 36977 existing records from primary storage. [2025-09-14T20:53:50.241517] [INFO ] [MAIN ] FOUR: Loaded 36977 primary data records. [2025-09-14T20:53:50.747808] [DEBUG] [MAIN ] FOF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:50.749168] [INFO ] [MAIN ] FOF: Generated 1352 derivative records from 5849 primary records. [2025-09-14T20:53:50.749484] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-14T20:53:50.763316] [DEBUG] [LOCAL ] FOF: Derivative data saved (1352 records). [2025-09-14T20:53:50.764608] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-14T20:53:50.768796] [INFO ] [MAIN ] Derivative Progress: 808/2226 symbols completed. FOF took 1.0s. Estimated remaining: 8m 21s. Rate: 169.8 symbols/min [2025-09-14T20:53:50.780447] [DEBUG] [MAIN ] FOR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:50.781504] [INFO ] [MAIN ] FOR: Generated 1352 derivative records from 14946 primary records. [2025-09-14T20:53:50.781731] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-14T20:53:50.795409] [DEBUG] [LOCAL ] FOR: Derivative data saved (1352 records). [2025-09-14T20:53:50.797026] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-14T20:53:50.799898] [INFO ] [MAIN ] Derivative Progress: 809/2226 symbols completed. FOR took 1.0s. Estimated remaining: 8m 20s. Rate: 170.0 symbols/min [2025-09-14T20:53:50.810015] [DEBUG] [MAIN ] FOUR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:50.810778] [INFO ] [MAIN ] FOUR: Generated 1352 derivative records from 36977 primary records. [2025-09-14T20:53:50.810900] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-14T20:53:50.823370] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1352 records). [2025-09-14T20:53:50.823481] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-14T20:53:50.825531] [INFO ] [MAIN ] Derivative Progress: 810/2226 symbols completed. FOUR took 1.0s. Estimated remaining: 8m 19s. Rate: 170.2 symbols/min [2025-09-14T20:53:50.826318] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:50.826066] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:50.826383] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:50.850631] [DEBUG] [LOCAL ] FPH: Loaded 14659 existing records from primary storage. [2025-09-14T20:53:50.850933] [DEBUG] [LOCAL ] FPF: Loaded 13063 existing records from primary storage. [2025-09-14T20:53:50.851176] [INFO ] [MAIN ] FPF: Loaded 13063 primary data records. [2025-09-14T20:53:50.851129] [INFO ] [MAIN ] FPH: Loaded 14659 primary data records. [2025-09-14T20:53:51.080158] [DEBUG] [LOCAL ] FPI: Loaded 23691 existing records from primary storage. [2025-09-14T20:53:51.111387] [INFO ] [MAIN ] FPI: Loaded 23691 primary data records. [2025-09-14T20:53:51.720814] [DEBUG] [MAIN ] FPH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:51.721687] [INFO ] [MAIN ] FPH: Generated 1352 derivative records from 14659 primary records. [2025-09-14T20:53:51.722025] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-14T20:53:51.732787] [DEBUG] [MAIN ] FPF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:51.742880] [INFO ] [MAIN ] FPF: Generated 1352 derivative records from 13063 primary records. [2025-09-14T20:53:51.746914] [DEBUG] [LOCAL ] FPH: Derivative data saved (1352 records). [2025-09-14T20:53:51.744896] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-14T20:53:51.747012] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-14T20:53:51.749151] [INFO ] [MAIN ] Derivative Progress: 811/2226 symbols completed. FPH took 0.9s. Estimated remaining: 8m 20s. Rate: 169.9 symbols/min [2025-09-14T20:53:51.749417] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:51.775586] [DEBUG] [LOCAL ] FPF: Derivative data saved (1352 records). [2025-09-14T20:53:51.776111] [DEBUG] [MAIN ] FPI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:51.776346] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-14T20:53:51.777132] [INFO ] [MAIN ] FPI: Generated 1352 derivative records from 23691 primary records. [2025-09-14T20:53:51.777379] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-14T20:53:51.780034] [INFO ] [MAIN ] Derivative Progress: 812/2226 symbols completed. FPF took 1.0s. Estimated remaining: 8m 19s. Rate: 170.0 symbols/min [2025-09-14T20:53:51.781076] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:51.798143] [DEBUG] [LOCAL ] FPI: Derivative data saved (1352 records). [2025-09-14T20:53:51.798528] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-14T20:53:51.800480] [INFO ] [MAIN ] Derivative Progress: 813/2226 symbols completed. FPI took 1.0s. Estimated remaining: 8m 18s. Rate: 170.2 symbols/min [2025-09-14T20:53:51.800926] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:51.815415] [DEBUG] [LOCAL ] FRA: Loaded 10144 existing records from primary storage. [2025-09-14T20:53:51.815599] [INFO ] [MAIN ] FRA: Loaded 10144 primary data records. [2025-09-14T20:53:51.955194] [DEBUG] [LOCAL ] FRGE: Loaded 11995 existing records from primary storage. [2025-09-14T20:53:51.955381] [INFO ] [MAIN ] FRGE: Loaded 11995 primary data records. [2025-09-14T20:53:51.954688] [DEBUG] [LOCAL ] FR: Loaded 35051 existing records from primary storage. [2025-09-14T20:53:51.997851] [INFO ] [MAIN ] FR: Loaded 35051 primary data records. [2025-09-14T20:53:52.789386] [DEBUG] [MAIN ] FRA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:52.790902] [INFO ] [MAIN ] FRA: Generated 1352 derivative records from 10144 primary records. [2025-09-14T20:53:52.791119] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-14T20:53:52.805562] [DEBUG] [LOCAL ] FRA: Derivative data saved (1352 records). [2025-09-14T20:53:52.808799] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-14T20:53:52.812163] [INFO ] [MAIN ] Derivative Progress: 814/2226 symbols completed. FRA took 1.0s. Estimated remaining: 8m 19s. Rate: 169.9 symbols/min [2025-09-14T20:53:52.830821] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:52.831194] [DEBUG] [MAIN ] FRGE: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:53:52.836032] [DEBUG] [MAIN ] FR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:52.837531] [INFO ] [MAIN ] FRGE: Generated 1351 derivative records from 11995 primary records. [2025-09-14T20:53:52.838549] [INFO ] [MAIN ] FR: Generated 1352 derivative records from 35051 primary records. [2025-09-14T20:53:52.838918] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-14T20:53:52.839052] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-14T20:53:52.860160] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1351 records). [2025-09-14T20:53:52.867042] [DEBUG] [LOCAL ] FR: Derivative data saved (1352 records). [2025-09-14T20:53:52.867405] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-14T20:53:52.867159] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-14T20:53:52.870666] [INFO ] [MAIN ] Derivative Progress: 815/2226 symbols completed. FRGE took 1.1s. Estimated remaining: 8m 18s. Rate: 170.0 symbols/min [2025-09-14T20:53:52.872998] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:52.873087] [INFO ] [MAIN ] Derivative Progress: 816/2226 symbols completed. FR took 1.1s. Estimated remaining: 8m 17s. Rate: 170.2 symbols/min [2025-09-14T20:53:52.873555] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:52.922684] [DEBUG] [LOCAL ] FRO: Loaded 38882 existing records from primary storage. [2025-09-14T20:53:52.923120] [INFO ] [MAIN ] FRO: Loaded 38882 primary data records. [2025-09-14T20:53:53.034488] [DEBUG] [LOCAL ] FSCO: Loaded 27469 existing records from primary storage. [2025-09-14T20:53:53.055882] [DEBUG] [LOCAL ] FRT: Loaded 31420 existing records from primary storage. [2025-09-14T20:53:53.055262] [INFO ] [MAIN ] FSCO: Loaded 27469 primary data records. [2025-09-14T20:53:53.061610] [INFO ] [MAIN ] FRT: Loaded 31420 primary data records. [2025-09-14T20:53:54.018833] [DEBUG] [MAIN ] FRO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:54.021566] [INFO ] [MAIN ] FRO: Generated 1352 derivative records from 38882 primary records. [2025-09-14T20:53:54.024156] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-14T20:53:54.046182] [DEBUG] [LOCAL ] FRO: Derivative data saved (1352 records). [2025-09-14T20:53:54.046832] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-14T20:53:54.049266] [INFO ] [MAIN ] Derivative Progress: 817/2226 symbols completed. FRO took 1.2s. Estimated remaining: 8m 18s. Rate: 169.7 symbols/min [2025-09-14T20:53:54.060693] [DEBUG] [MAIN ] FSCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:54.061434] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:54.064007] [INFO ] [MAIN ] FSCO: Generated 1352 derivative records from 27469 primary records. [2025-09-14T20:53:54.064221] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-14T20:53:54.082756] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1352 records). [2025-09-14T20:53:54.082961] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-14T20:53:54.085341] [INFO ] [MAIN ] Derivative Progress: 818/2226 symbols completed. FSCO took 1.2s. Estimated remaining: 8m 17s. Rate: 169.9 symbols/min [2025-09-14T20:53:54.086608] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:54.104670] [DEBUG] [MAIN ] FRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:54.106000] [INFO ] [MAIN ] FRT: Generated 1352 derivative records from 31420 primary records. [2025-09-14T20:53:54.106167] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-14T20:53:54.144671] [DEBUG] [LOCAL ] FRT: Derivative data saved (1352 records). [2025-09-14T20:53:54.145240] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-14T20:53:54.151464] [INFO ] [MAIN ] Derivative Progress: 819/2226 symbols completed. FRT took 1.3s. Estimated remaining: 8m 16s. Rate: 170.1 symbols/min [2025-09-14T20:53:54.152161] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:54.204334] [DEBUG] [LOCAL ] FSK: Loaded 36388 existing records from primary storage. [2025-09-14T20:53:54.205145] [INFO ] [MAIN ] FSK: Loaded 36388 primary data records. [2025-09-14T20:53:54.386570] [DEBUG] [LOCAL ] FSLY: Loaded 38359 existing records from primary storage. [2025-09-14T20:53:54.392987] [INFO ] [MAIN ] FSLY: Loaded 38359 primary data records. [2025-09-14T20:53:54.536403] [DEBUG] [LOCAL ] FSM: Loaded 40060 existing records from primary storage. [2025-09-14T20:53:54.662767] [INFO ] [MAIN ] FSM: Loaded 40060 primary data records. [2025-09-14T20:53:55.294514] [DEBUG] [MAIN ] FSK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:55.297437] [INFO ] [MAIN ] FSK: Generated 1352 derivative records from 36388 primary records. [2025-09-14T20:53:55.298253] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-14T20:53:55.312322] [DEBUG] [LOCAL ] FSK: Derivative data saved (1352 records). [2025-09-14T20:53:55.312477] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-14T20:53:55.314158] [INFO ] [MAIN ] Derivative Progress: 820/2226 symbols completed. FSK took 1.3s. Estimated remaining: 8m 17s. Rate: 169.6 symbols/min [2025-09-14T20:53:55.314705] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:55.330372] [DEBUG] [MAIN ] FSLY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:55.331369] [INFO ] [MAIN ] FSLY: Generated 1352 derivative records from 38359 primary records. [2025-09-14T20:53:55.331575] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-14T20:53:55.363233] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1352 records). [2025-09-14T20:53:55.363617] [DEBUG] [MAIN ] FSM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:55.363688] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-14T20:53:55.367489] [INFO ] [MAIN ] FSM: Generated 1352 derivative records from 40060 primary records. [2025-09-14T20:53:55.367336] [INFO ] [MAIN ] Derivative Progress: 821/2226 symbols completed. FSLY took 1.3s. Estimated remaining: 8m 16s. Rate: 169.8 symbols/min [2025-09-14T20:53:55.367719] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-14T20:53:55.368205] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:55.380719] [DEBUG] [LOCAL ] FSM: Derivative data saved (1352 records). [2025-09-14T20:53:55.381568] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-14T20:53:55.383613] [INFO ] [MAIN ] Derivative Progress: 822/2226 symbols completed. FSM took 1.2s. Estimated remaining: 8m 16s. Rate: 170.0 symbols/min [2025-09-14T20:53:55.393623] [DEBUG] [LOCAL ] FSS: Loaded 25400 existing records from primary storage. [2025-09-14T20:53:55.393739] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:55.393909] [INFO ] [MAIN ] FSS: Loaded 25400 primary data records. [2025-09-14T20:53:55.418168] [DEBUG] [LOCAL ] FT: Loaded 4756 existing records from primary storage. [2025-09-14T20:53:55.468231] [INFO ] [MAIN ] FT: Loaded 4756 primary data records. [2025-09-14T20:53:55.541926] [DEBUG] [LOCAL ] FTHY: Loaded 8675 existing records from primary storage. [2025-09-14T20:53:55.587671] [INFO ] [MAIN ] FTHY: Loaded 8675 primary data records. [2025-09-14T20:53:56.267894] [DEBUG] [MAIN ] FT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:56.278415] [DEBUG] [MAIN ] FSS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:56.279264] [INFO ] [MAIN ] FT: Generated 1352 derivative records from 4756 primary records. [2025-09-14T20:53:56.280126] [INFO ] [MAIN ] FSS: Generated 1352 derivative records from 25400 primary records. [2025-09-14T20:53:56.280256] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-14T20:53:56.282000] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-14T20:53:56.296045] [DEBUG] [LOCAL ] FT: Derivative data saved (1352 records). [2025-09-14T20:53:56.305294] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-14T20:53:56.315996] [INFO ] [MAIN ] Derivative Progress: 823/2226 symbols completed. FT took 0.9s. Estimated remaining: 8m 16s. Rate: 169.7 symbols/min [2025-09-14T20:53:56.321942] [DEBUG] [MAIN ] FTHY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:56.322980] [INFO ] [MAIN ] FTHY: Generated 1352 derivative records from 8675 primary records. [2025-09-14T20:53:56.322119] [DEBUG] [LOCAL ] FSS: Derivative data saved (1352 records). [2025-09-14T20:53:56.323235] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-14T20:53:56.323317] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-14T20:53:56.326184] [INFO ] [MAIN ] Derivative Progress: 824/2226 symbols completed. FSS took 1.0s. Estimated remaining: 8m 15s. Rate: 169.9 symbols/min [2025-09-14T20:53:56.338076] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1352 records). [2025-09-14T20:53:56.338186] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-14T20:53:56.340267] [INFO ] [MAIN ] Derivative Progress: 825/2226 symbols completed. FTHY took 0.9s. Estimated remaining: 8m 14s. Rate: 170.1 symbols/min [2025-09-14T20:53:56.340993] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:56.341345] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:56.341271] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:56.388060] [DEBUG] [LOCAL ] FTK: Loaded 25122 existing records from primary storage. [2025-09-14T20:53:56.388238] [INFO ] [MAIN ] FTK: Loaded 25122 primary data records. [2025-09-14T20:53:56.511525] [DEBUG] [LOCAL ] FTS: Loaded 31771 existing records from primary storage. [2025-09-14T20:53:56.515387] [DEBUG] [LOCAL ] FTI: Loaded 40086 existing records from primary storage. [2025-09-14T20:53:56.521386] [INFO ] [MAIN ] FTS: Loaded 31771 primary data records. [2025-09-14T20:53:56.521496] [INFO ] [MAIN ] FTI: Loaded 40086 primary data records. [2025-09-14T20:53:57.308664] [DEBUG] [MAIN ] FTK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:57.310501] [INFO ] [MAIN ] FTK: Generated 1352 derivative records from 25122 primary records. [2025-09-14T20:53:57.311484] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-14T20:53:57.330107] [DEBUG] [LOCAL ] FTK: Derivative data saved (1352 records). [2025-09-14T20:53:57.331711] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-14T20:53:57.346261] [INFO ] [MAIN ] Derivative Progress: 826/2226 symbols completed. FTK took 1.0s. Estimated remaining: 8m 15s. Rate: 169.7 symbols/min [2025-09-14T20:53:57.347262] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:57.358104] [DEBUG] [MAIN ] FTI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:57.358345] [DEBUG] [MAIN ] FTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:57.360426] [INFO ] [MAIN ] FTI: Generated 1352 derivative records from 40086 primary records. [2025-09-14T20:53:57.361514] [INFO ] [MAIN ] FTS: Generated 1352 derivative records from 31771 primary records. [2025-09-14T20:53:57.360597] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-14T20:53:57.362468] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-14T20:53:57.390744] [DEBUG] [LOCAL ] FTS: Derivative data saved (1352 records). [2025-09-14T20:53:57.387289] [DEBUG] [LOCAL ] FTI: Derivative data saved (1352 records). [2025-09-14T20:53:57.391208] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-14T20:53:57.393762] [INFO ] [MAIN ] Derivative Progress: 827/2226 symbols completed. FTS took 1.1s. Estimated remaining: 8m 14s. Rate: 169.9 symbols/min [2025-09-14T20:53:57.391445] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-14T20:53:57.394256] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:57.398058] [INFO ] [MAIN ] Derivative Progress: 828/2226 symbols completed. FTI took 1.1s. Estimated remaining: 8m 13s. Rate: 170.1 symbols/min [2025-09-14T20:53:57.399105] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:57.403473] [DEBUG] [LOCAL ] FTWO: Loaded 1288 existing records from primary storage. [2025-09-14T20:53:57.403780] [INFO ] [MAIN ] FTWO: Loaded 1288 primary data records. [2025-09-14T20:53:57.621551] [DEBUG] [LOCAL ] FTV: Loaded 39924 existing records from primary storage. [2025-09-14T20:53:57.644313] [INFO ] [MAIN ] FTV: Loaded 39924 primary data records. [2025-09-14T20:53:57.810246] [DEBUG] [LOCAL ] FUBO: Loaded 40467 existing records from primary storage. [2025-09-14T20:53:57.839866] [INFO ] [MAIN ] FUBO: Loaded 40467 primary data records. [2025-09-14T20:53:58.401370] [DEBUG] [MAIN ] FTWO: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:53:58.402501] [INFO ] [MAIN ] FTWO: Generated 1351 derivative records from 1288 primary records. [2025-09-14T20:53:58.403237] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-14T20:53:58.416331] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1351 records). [2025-09-14T20:53:58.416761] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-14T20:53:58.420229] [INFO ] [MAIN ] Derivative Progress: 829/2226 symbols completed. FTWO took 1.0s. Estimated remaining: 8m 14s. Rate: 169.7 symbols/min [2025-09-14T20:53:58.421618] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:58.433464] [DEBUG] [MAIN ] FTV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:58.435280] [INFO ] [MAIN ] FTV: Generated 1352 derivative records from 39924 primary records. [2025-09-14T20:53:58.436362] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-14T20:53:58.464445] [DEBUG] [LOCAL ] FTV: Derivative data saved (1352 records). [2025-09-14T20:53:58.465223] [DEBUG] [MAIN ] FUBO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:58.466296] [INFO ] [MAIN ] FUBO: Generated 1352 derivative records from 40467 primary records. [2025-09-14T20:53:58.465293] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-14T20:53:58.466504] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-14T20:53:58.468587] [INFO ] [MAIN ] Derivative Progress: 830/2226 symbols completed. FTV took 1.1s. Estimated remaining: 8m 13s. Rate: 169.8 symbols/min [2025-09-14T20:53:58.469887] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:58.489678] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1352 records). [2025-09-14T20:53:58.491087] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-14T20:53:58.491671] [DEBUG] [LOCAL ] FUL: Loaded 23457 existing records from primary storage. [2025-09-14T20:53:58.491811] [INFO ] [MAIN ] FUL: Loaded 23457 primary data records. [2025-09-14T20:53:58.494048] [INFO ] [MAIN ] Derivative Progress: 831/2226 symbols completed. FUBO took 1.1s. Estimated remaining: 8m 12s. Rate: 170.0 symbols/min [2025-09-14T20:53:58.523994] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:58.807928] [DEBUG] [LOCAL ] FVR: Loaded 16555 existing records from primary storage. [2025-09-14T20:53:58.816976] [DEBUG] [LOCAL ] FUN: Loaded 39041 existing records from primary storage. [2025-09-14T20:53:58.818014] [INFO ] [MAIN ] FVR: Loaded 16555 primary data records. [2025-09-14T20:53:58.818148] [INFO ] [MAIN ] FUN: Loaded 39041 primary data records. [2025-09-14T20:53:59.402384] [DEBUG] [MAIN ] FUL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:59.403971] [INFO ] [MAIN ] FUL: Generated 1352 derivative records from 23457 primary records. [2025-09-14T20:53:59.404403] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-14T20:53:59.430689] [DEBUG] [MAIN ] FVR: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:53:59.431963] [DEBUG] [LOCAL ] FUL: Derivative data saved (1352 records). [2025-09-14T20:53:59.432974] [INFO ] [MAIN ] FVR: Generated 1351 derivative records from 16555 primary records. [2025-09-14T20:53:59.433053] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-14T20:53:59.433158] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-14T20:53:59.435531] [INFO ] [MAIN ] Derivative Progress: 832/2226 symbols completed. FUL took 1.0s. Estimated remaining: 8m 13s. Rate: 169.7 symbols/min [2025-09-14T20:53:59.437152] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:59.452617] [DEBUG] [LOCAL ] FVR: Derivative data saved (1351 records). [2025-09-14T20:53:59.462730] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-14T20:53:59.463264] [DEBUG] [MAIN ] FUN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:53:59.465592] [INFO ] [MAIN ] Derivative Progress: 833/2226 symbols completed. FVR took 1.0s. Estimated remaining: 8m 12s. Rate: 169.9 symbols/min [2025-09-14T20:53:59.466664] [INFO ] [MAIN ] FUN: Generated 1352 derivative records from 39041 primary records. [2025-09-14T20:53:59.466942] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:59.467011] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-14T20:53:59.479974] [DEBUG] [LOCAL ] FXED: Loaded 881 existing records from primary storage. [2025-09-14T20:53:59.483394] [DEBUG] [LOCAL ] FUN: Derivative data saved (1352 records). [2025-09-14T20:53:59.483467] [INFO ] [MAIN ] FXED: Loaded 881 primary data records. [2025-09-14T20:53:59.483598] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-14T20:53:59.500128] [INFO ] [MAIN ] Derivative Progress: 834/2226 symbols completed. FUN took 1.0s. Estimated remaining: 8m 11s. Rate: 170.1 symbols/min [2025-09-14T20:53:59.533077] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:53:59.619056] [DEBUG] [LOCAL ] FVRR: Loaded 30096 existing records from primary storage. [2025-09-14T20:53:59.635300] [INFO ] [MAIN ] FVRR: Loaded 30096 primary data records. [2025-09-14T20:54:00.114144] [DEBUG] [LOCAL ] G: Loaded 37400 existing records from primary storage. [2025-09-14T20:54:00.138873] [INFO ] [MAIN ] G: Loaded 37400 primary data records. [2025-09-14T20:54:00.433099] [DEBUG] [MAIN ] FXED: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:00.441604] [INFO ] [MAIN ] FXED: Generated 1352 derivative records from 881 primary records. [2025-09-14T20:54:00.442405] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-14T20:54:00.457556] [DEBUG] [LOCAL ] FXED: Derivative data saved (1352 records). [2025-09-14T20:54:00.459699] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-14T20:54:00.468789] [INFO ] [MAIN ] Derivative Progress: 835/2226 symbols completed. FXED took 1.0s. Estimated remaining: 8m 12s. Rate: 169.7 symbols/min [2025-09-14T20:54:00.473687] [DEBUG] [MAIN ] FVRR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:00.474704] [INFO ] [MAIN ] FVRR: Generated 1352 derivative records from 30096 primary records. [2025-09-14T20:54:00.473929] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:00.475169] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-14T20:54:00.492271] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1352 records). [2025-09-14T20:54:00.492618] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-14T20:54:00.495522] [INFO ] [MAIN ] Derivative Progress: 836/2226 symbols completed. FVRR took 1.1s. Estimated remaining: 8m 11s. Rate: 169.9 symbols/min [2025-09-14T20:54:00.501052] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:00.514258] [DEBUG] [LOCAL ] GAB: Loaded 19836 existing records from primary storage. [2025-09-14T20:54:00.518141] [INFO ] [MAIN ] GAB: Loaded 19836 primary data records. [2025-09-14T20:54:00.518282] [DEBUG] [LOCAL ] GAM: Loaded 2802 existing records from primary storage. [2025-09-14T20:54:00.550990] [INFO ] [MAIN ] GAM: Loaded 2802 primary data records. [2025-09-14T20:54:00.551746] [DEBUG] [MAIN ] G: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:00.609086] [INFO ] [MAIN ] G: Generated 1352 derivative records from 37400 primary records. [2025-09-14T20:54:00.676902] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-14T20:54:00.867738] [DEBUG] [LOCAL ] G: Derivative data saved (1352 records). [2025-09-14T20:54:00.873432] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-14T20:54:00.896986] [INFO ] [MAIN ] Derivative Progress: 837/2226 symbols completed. G took 1.4s. Estimated remaining: 8m 11s. Rate: 169.9 symbols/min [2025-09-14T20:54:01.054863] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:01.181566] [DEBUG] [MAIN ] GAB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:01.183675] [INFO ] [MAIN ] GAB: Generated 1352 derivative records from 19836 primary records. [2025-09-14T20:54:01.183855] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-14T20:54:01.194475] [DEBUG] [MAIN ] GAM: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:54:01.213857] [INFO ] [MAIN ] GAM: Generated 1351 derivative records from 2802 primary records. [2025-09-14T20:54:01.217094] [DEBUG] [LOCAL ] GAB: Derivative data saved (1352 records). [2025-09-14T20:54:01.217299] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-14T20:54:01.217442] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-14T20:54:01.219519] [INFO ] [MAIN ] Derivative Progress: 838/2226 symbols completed. GAB took 0.7s. Estimated remaining: 8m 10s. Rate: 169.9 symbols/min [2025-09-14T20:54:01.241812] [DEBUG] [LOCAL ] GAP: Loaded 40398 existing records from primary storage. [2025-09-14T20:54:01.243655] [INFO ] [MAIN ] GAP: Loaded 40398 primary data records. [2025-09-14T20:54:01.244570] [DEBUG] [LOCAL ] GAM: Derivative data saved (1351 records). [2025-09-14T20:54:01.244780] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-14T20:54:01.324330] [INFO ] [MAIN ] Derivative Progress: 839/2226 symbols completed. GAM took 0.8s. Estimated remaining: 8m 9s. Rate: 170.0 symbols/min [2025-09-14T20:54:01.538434] [DEBUG] [MAIN ] GAP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:01.539339] [INFO ] [MAIN ] GAP: Generated 1352 derivative records from 40398 primary records. [2025-09-14T20:54:01.539436] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-14T20:54:01.552607] [DEBUG] [LOCAL ] GAP: Derivative data saved (1352 records). [2025-09-14T20:54:01.552847] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-14T20:54:01.554799] [INFO ] [MAIN ] Derivative Progress: 840/2226 symbols completed. GAP took 0.5s. Estimated remaining: 8m 9s. Rate: 170.1 symbols/min [2025-09-14T20:54:01.555433] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:01.555722] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:01.555632] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:01.573898] [DEBUG] [LOCAL ] GBAB: Loaded 9681 existing records from primary storage. [2025-09-14T20:54:01.574294] [INFO ] [MAIN ] GBAB: Loaded 9681 primary data records. [2025-09-14T20:54:01.715812] [DEBUG] [LOCAL ] GATX: Loaded 13288 existing records from primary storage. [2025-09-14T20:54:01.755591] [INFO ] [MAIN ] GATX: Loaded 13288 primary data records. [2025-09-14T20:54:01.801328] [DEBUG] [LOCAL ] GBCI: Loaded 29959 existing records from primary storage. [2025-09-14T20:54:01.885337] [INFO ] [MAIN ] GBCI: Loaded 29959 primary data records. [2025-09-14T20:54:02.568112] [DEBUG] [MAIN ] GBAB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:02.569349] [INFO ] [MAIN ] GBAB: Generated 1352 derivative records from 9681 primary records. [2025-09-14T20:54:02.570927] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-14T20:54:02.584343] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1352 records). [2025-09-14T20:54:02.584722] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-14T20:54:02.587491] [INFO ] [MAIN ] Derivative Progress: 841/2226 symbols completed. GBAB took 1.0s. Estimated remaining: 8m 10s. Rate: 169.7 symbols/min [2025-09-14T20:54:02.589699] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:02.601291] [DEBUG] [MAIN ] GATX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:02.604817] [INFO ] [MAIN ] GATX: Generated 1352 derivative records from 13288 primary records. [2025-09-14T20:54:02.605128] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-14T20:54:02.616006] [DEBUG] [MAIN ] GBCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:02.623358] [INFO ] [MAIN ] GBCI: Generated 1352 derivative records from 29959 primary records. [2025-09-14T20:54:02.625729] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-14T20:54:02.642210] [DEBUG] [LOCAL ] GATX: Derivative data saved (1352 records). [2025-09-14T20:54:02.653047] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-14T20:54:02.652957] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1352 records). [2025-09-14T20:54:02.656403] [INFO ] [MAIN ] Derivative Progress: 842/2226 symbols completed. GATX took 1.1s. Estimated remaining: 8m 9s. Rate: 169.9 symbols/min [2025-09-14T20:54:02.656893] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:02.656604] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-14T20:54:02.659262] [INFO ] [MAIN ] Derivative Progress: 843/2226 symbols completed. GBCI took 1.1s. Estimated remaining: 8m 8s. Rate: 170.1 symbols/min [2025-09-14T20:54:02.659688] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:02.671524] [DEBUG] [LOCAL ] GBTG: Loaded 30281 existing records from primary storage. [2025-09-14T20:54:02.671751] [INFO ] [MAIN ] GBTG: Loaded 30281 primary data records. [2025-09-14T20:54:02.877321] [DEBUG] [LOCAL ] GBX: Loaded 21172 existing records from primary storage. [2025-09-14T20:54:02.887051] [INFO ] [MAIN ] GBX: Loaded 21172 primary data records. [2025-09-14T20:54:02.977613] [DEBUG] [LOCAL ] GCI: Loaded 33004 existing records from primary storage. [2025-09-14T20:54:03.010489] [INFO ] [MAIN ] GCI: Loaded 33004 primary data records. [2025-09-14T20:54:03.560126] [DEBUG] [MAIN ] GBTG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:03.562340] [INFO ] [MAIN ] GBTG: Generated 1352 derivative records from 30281 primary records. [2025-09-14T20:54:03.563013] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-14T20:54:03.578494] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1352 records). [2025-09-14T20:54:03.588354] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-14T20:54:03.590287] [DEBUG] [MAIN ] GBX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:03.592978] [INFO ] [MAIN ] Derivative Progress: 844/2226 symbols completed. GBTG took 1.0s. Estimated remaining: 8m 8s. Rate: 169.7 symbols/min [2025-09-14T20:54:03.594633] [INFO ] [MAIN ] GBX: Generated 1352 derivative records from 21172 primary records. [2025-09-14T20:54:03.605588] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-14T20:54:03.606005] [DEBUG] [MAIN ] GCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:03.605260] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:03.607437] [INFO ] [MAIN ] GCI: Generated 1352 derivative records from 33004 primary records. [2025-09-14T20:54:03.609288] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-14T20:54:03.637972] [DEBUG] [LOCAL ] GCI: Derivative data saved (1352 records). [2025-09-14T20:54:03.639126] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-14T20:54:03.644978] [INFO ] [MAIN ] Derivative Progress: 845/2226 symbols completed. GCI took 1.0s. Estimated remaining: 8m 8s. Rate: 169.9 symbols/min [2025-09-14T20:54:03.642011] [DEBUG] [LOCAL ] GBX: Derivative data saved (1352 records). [2025-09-14T20:54:03.645451] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-14T20:54:03.645509] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:03.648498] [INFO ] [MAIN ] Derivative Progress: 846/2226 symbols completed. GBX took 1.0s. Estimated remaining: 8m 7s. Rate: 170.1 symbols/min [2025-09-14T20:54:03.649476] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:03.660206] [DEBUG] [LOCAL ] GCO: Loaded 17713 existing records from primary storage. [2025-09-14T20:54:03.661899] [INFO ] [MAIN ] GCO: Loaded 17713 primary data records. [2025-09-14T20:54:03.702497] [DEBUG] [LOCAL ] GCV: Loaded 5535 existing records from primary storage. [2025-09-14T20:54:03.728110] [INFO ] [MAIN ] GCV: Loaded 5535 primary data records. [2025-09-14T20:54:03.910942] [DEBUG] [LOCAL ] GCTS: Loaded 15783 existing records from primary storage. [2025-09-14T20:54:03.938925] [INFO ] [MAIN ] GCTS: Loaded 15783 primary data records. [2025-09-14T20:54:04.551896] [DEBUG] [MAIN ] GCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:04.563527] [INFO ] [MAIN ] GCO: Generated 1352 derivative records from 17713 primary records. [2025-09-14T20:54:04.564579] [DEBUG] [MAIN ] GCV: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:54:04.564814] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-14T20:54:04.565419] [INFO ] [MAIN ] GCV: Generated 1351 derivative records from 5535 primary records. [2025-09-14T20:54:04.566681] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-14T20:54:04.595120] [DEBUG] [LOCAL ] GCV: Derivative data saved (1351 records). [2025-09-14T20:54:04.596874] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-14T20:54:04.600469] [INFO ] [MAIN ] Derivative Progress: 847/2226 symbols completed. GCV took 1.0s. Estimated remaining: 8m 7s. Rate: 169.8 symbols/min [2025-09-14T20:54:04.613474] [DEBUG] [LOCAL ] GCO: Derivative data saved (1352 records). [2025-09-14T20:54:04.614516] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:04.614135] [DEBUG] [MAIN ] GCTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:04.614778] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-14T20:54:04.618920] [INFO ] [MAIN ] Derivative Progress: 848/2226 symbols completed. GCO took 1.0s. Estimated remaining: 8m 6s. Rate: 170.0 symbols/min [2025-09-14T20:54:04.620813] [INFO ] [MAIN ] GCTS: Generated 1352 derivative records from 15783 primary records. [2025-09-14T20:54:04.620981] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:04.621349] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-14T20:54:04.635932] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1352 records). [2025-09-14T20:54:04.636141] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-14T20:54:04.638288] [INFO ] [MAIN ] Derivative Progress: 849/2226 symbols completed. GCTS took 1.0s. Estimated remaining: 8m 6s. Rate: 170.2 symbols/min [2025-09-14T20:54:04.638797] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:04.646325] [DEBUG] [LOCAL ] GDIV: Loaded 2692 existing records from primary storage. [2025-09-14T20:54:04.646548] [INFO ] [MAIN ] GDIV: Loaded 2692 primary data records. [2025-09-14T20:54:04.820891] [DEBUG] [LOCAL ] GD: Loaded 35042 existing records from primary storage. [2025-09-14T20:54:04.826920] [DEBUG] [LOCAL ] GDDY: Loaded 37225 existing records from primary storage. [2025-09-14T20:54:04.877157] [INFO ] [MAIN ] GDDY: Loaded 37225 primary data records. [2025-09-14T20:54:04.877303] [INFO ] [MAIN ] GD: Loaded 35042 primary data records. [2025-09-14T20:54:05.624077] [DEBUG] [MAIN ] GDIV: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:54:05.625526] [INFO ] [MAIN ] GDIV: Generated 1351 derivative records from 2692 primary records. [2025-09-14T20:54:05.626089] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-14T20:54:05.641455] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1351 records). [2025-09-14T20:54:05.642048] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-14T20:54:05.644267] [INFO ] [MAIN ] Derivative Progress: 850/2226 symbols completed. GDIV took 1.0s. Estimated remaining: 8m 6s. Rate: 169.8 symbols/min [2025-09-14T20:54:05.645370] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:05.652164] [DEBUG] [LOCAL ] GDL: Loaded 1759 existing records from primary storage. [2025-09-14T20:54:05.662867] [INFO ] [MAIN ] GDL: Loaded 1759 primary data records. [2025-09-14T20:54:05.663141] [DEBUG] [MAIN ] GDDY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:05.670037] [INFO ] [MAIN ] GDDY: Generated 1352 derivative records from 37225 primary records. [2025-09-14T20:54:05.722681] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-14T20:54:05.769732] [DEBUG] [MAIN ] GD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:05.782934] [INFO ] [MAIN ] GD: Generated 1352 derivative records from 35042 primary records. [2025-09-14T20:54:05.804809] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-14T20:54:05.984043] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1352 records). [2025-09-14T20:54:05.992277] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-14T20:54:05.991770] [DEBUG] [LOCAL ] GD: Derivative data saved (1352 records). [2025-09-14T20:54:05.995461] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-14T20:54:05.995265] [INFO ] [MAIN ] Derivative Progress: 851/2226 symbols completed. GDDY took 1.4s. Estimated remaining: 8m 6s. Rate: 169.8 symbols/min [2025-09-14T20:54:05.995771] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:05.997615] [INFO ] [MAIN ] Derivative Progress: 852/2226 symbols completed. GD took 1.4s. Estimated remaining: 8m 5s. Rate: 170.0 symbols/min [2025-09-14T20:54:05.999401] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:06.012635] [DEBUG] [LOCAL ] GDO: Loaded 4390 existing records from primary storage. [2025-09-14T20:54:06.012997] [INFO ] [MAIN ] GDO: Loaded 4390 primary data records. [2025-09-14T20:54:06.311077] [DEBUG] [LOCAL ] GDOT: Loaded 27838 existing records from primary storage. [2025-09-14T20:54:06.320610] [INFO ] [MAIN ] GDOT: Loaded 27838 primary data records. [2025-09-14T20:54:06.364530] [DEBUG] [MAIN ] GDL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:06.411830] [INFO ] [MAIN ] GDL: Generated 1352 derivative records from 1759 primary records. [2025-09-14T20:54:06.443240] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-14T20:54:06.534705] [DEBUG] [LOCAL ] GDL: Derivative data saved (1352 records). [2025-09-14T20:54:06.627252] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-14T20:54:06.630532] [INFO ] [MAIN ] Derivative Progress: 853/2226 symbols completed. GDL took 1.0s. Estimated remaining: 8m 5s. Rate: 169.8 symbols/min [2025-09-14T20:54:06.647840] [DEBUG] [MAIN ] GDO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:06.649437] [INFO ] [MAIN ] GDO: Generated 1352 derivative records from 4390 primary records. [2025-09-14T20:54:06.649524] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-14T20:54:06.663876] [DEBUG] [LOCAL ] GDO: Derivative data saved (1352 records). [2025-09-14T20:54:06.664057] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-14T20:54:06.666906] [INFO ] [MAIN ] Derivative Progress: 854/2226 symbols completed. GDO took 0.7s. Estimated remaining: 8m 4s. Rate: 170.0 symbols/min [2025-09-14T20:54:06.682411] [DEBUG] [MAIN ] GDOT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:06.683329] [INFO ] [MAIN ] GDOT: Generated 1352 derivative records from 27838 primary records. [2025-09-14T20:54:06.683414] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-14T20:54:06.696541] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1352 records). [2025-09-14T20:54:06.696715] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-14T20:54:06.699790] [INFO ] [MAIN ] Derivative Progress: 855/2226 symbols completed. GDOT took 0.7s. Estimated remaining: 8m 3s. Rate: 170.2 symbols/min [2025-09-14T20:54:06.700678] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:06.700824] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:06.701027] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:06.723670] [DEBUG] [LOCAL ] GEF: Loaded 15434 existing records from primary storage. [2025-09-14T20:54:06.723870] [INFO ] [MAIN ] GEF: Loaded 15434 primary data records. [2025-09-14T20:54:06.851474] [DEBUG] [LOCAL ] GDV: Loaded 14594 existing records from primary storage. [2025-09-14T20:54:06.878038] [INFO ] [MAIN ] GDV: Loaded 14594 primary data records. [2025-09-14T20:54:07.103206] [DEBUG] [LOCAL ] GE: Loaded 40461 existing records from primary storage. [2025-09-14T20:54:07.133571] [INFO ] [MAIN ] GE: Loaded 40461 primary data records. [2025-09-14T20:54:07.703359] [DEBUG] [MAIN ] GEF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:07.704539] [INFO ] [MAIN ] GEF: Generated 1352 derivative records from 15434 primary records. [2025-09-14T20:54:07.704890] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-14T20:54:07.720382] [DEBUG] [LOCAL ] GEF: Derivative data saved (1352 records). [2025-09-14T20:54:07.720796] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-14T20:54:07.723924] [INFO ] [MAIN ] Derivative Progress: 856/2226 symbols completed. GEF took 1.0s. Estimated remaining: 8m 4s. Rate: 169.8 symbols/min [2025-09-14T20:54:07.725109] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:07.741584] [DEBUG] [MAIN ] GDV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:07.745250] [INFO ] [MAIN ] GDV: Generated 1352 derivative records from 14594 primary records. [2025-09-14T20:54:07.746144] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-14T20:54:07.769427] [DEBUG] [LOCAL ] GDV: Derivative data saved (1352 records). [2025-09-14T20:54:07.769622] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-14T20:54:07.772225] [INFO ] [MAIN ] Derivative Progress: 857/2226 symbols completed. GDV took 1.1s. Estimated remaining: 8m 3s. Rate: 170.0 symbols/min [2025-09-14T20:54:07.773328] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:07.783527] [DEBUG] [MAIN ] GE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:07.784713] [INFO ] [MAIN ] GE: Generated 1352 derivative records from 40461 primary records. [2025-09-14T20:54:07.785041] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-14T20:54:07.799485] [DEBUG] [LOCAL ] GE: Derivative data saved (1352 records). [2025-09-14T20:54:07.807407] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-14T20:54:07.810932] [INFO ] [MAIN ] Derivative Progress: 858/2226 symbols completed. GE took 1.1s. Estimated remaining: 8m 2s. Rate: 170.2 symbols/min [2025-09-14T20:54:07.811419] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:07.812408] [DEBUG] [LOCAL ] GEL: Loaded 25309 existing records from primary storage. [2025-09-14T20:54:07.812956] [INFO ] [MAIN ] GEL: Loaded 25309 primary data records. [2025-09-14T20:54:07.999758] [DEBUG] [LOCAL ] GENI: Loaded 39790 existing records from primary storage. [2025-09-14T20:54:08.113693] [INFO ] [MAIN ] GENI: Loaded 39790 primary data records. [2025-09-14T20:54:08.229856] [DEBUG] [LOCAL ] GEO: Loaded 39206 existing records from primary storage. [2025-09-14T20:54:08.254125] [INFO ] [MAIN ] GEO: Loaded 39206 primary data records. [2025-09-14T20:54:08.777076] [DEBUG] [MAIN ] GEL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:08.777973] [INFO ] [MAIN ] GEL: Generated 1352 derivative records from 25309 primary records. [2025-09-14T20:54:08.780256] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-14T20:54:08.797860] [DEBUG] [LOCAL ] GEL: Derivative data saved (1352 records). [2025-09-14T20:54:08.799252] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-14T20:54:08.803403] [INFO ] [MAIN ] Derivative Progress: 859/2226 symbols completed. GEL took 1.1s. Estimated remaining: 8m 3s. Rate: 169.8 symbols/min [2025-09-14T20:54:08.804403] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:08.815757] [DEBUG] [MAIN ] GENI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:08.817359] [INFO ] [MAIN ] GENI: Generated 1352 derivative records from 39790 primary records. [2025-09-14T20:54:08.817793] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-14T20:54:08.834929] [DEBUG] [LOCAL ] GENI: Derivative data saved (1352 records). [2025-09-14T20:54:08.845018] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-14T20:54:08.845447] [DEBUG] [MAIN ] GEO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:08.848779] [INFO ] [MAIN ] Derivative Progress: 860/2226 symbols completed. GENI took 1.1s. Estimated remaining: 8m 2s. Rate: 170.0 symbols/min [2025-09-14T20:54:08.850516] [INFO ] [MAIN ] GEO: Generated 1352 derivative records from 39206 primary records. [2025-09-14T20:54:08.851063] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:08.851105] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-14T20:54:08.866440] [DEBUG] [LOCAL ] GEO: Derivative data saved (1352 records). [2025-09-14T20:54:08.866594] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-14T20:54:08.868821] [INFO ] [MAIN ] Derivative Progress: 861/2226 symbols completed. GEO took 1.1s. Estimated remaining: 8m 1s. Rate: 170.2 symbols/min [2025-09-14T20:54:08.869292] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:08.913219] [DEBUG] [LOCAL ] GETY: Loaded 26329 existing records from primary storage. [2025-09-14T20:54:08.914878] [INFO ] [MAIN ] GETY: Loaded 26329 primary data records. [2025-09-14T20:54:08.927492] [DEBUG] [LOCAL ] GES: Loaded 28871 existing records from primary storage. [2025-09-14T20:54:08.978017] [INFO ] [MAIN ] GES: Loaded 28871 primary data records. [2025-09-14T20:54:09.136943] [DEBUG] [LOCAL ] GEV: Loaded 39972 existing records from primary storage. [2025-09-14T20:54:09.181009] [INFO ] [MAIN ] GEV: Loaded 39972 primary data records. [2025-09-14T20:54:09.879501] [DEBUG] [MAIN ] GETY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:09.882294] [INFO ] [MAIN ] GETY: Generated 1352 derivative records from 26329 primary records. [2025-09-14T20:54:09.883101] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-14T20:54:09.907854] [DEBUG] [MAIN ] GES: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:09.911328] [INFO ] [MAIN ] GES: Generated 1352 derivative records from 28871 primary records. [2025-09-14T20:54:09.912174] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-14T20:54:09.931349] [DEBUG] [LOCAL ] GETY: Derivative data saved (1352 records). [2025-09-14T20:54:09.938054] [DEBUG] [LOCAL ] GES: Derivative data saved (1352 records). [2025-09-14T20:54:09.932958] [DEBUG] [MAIN ] GEV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:09.938466] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-14T20:54:09.938277] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-14T20:54:09.942437] [INFO ] [MAIN ] Derivative Progress: 862/2226 symbols completed. GES took 1.1s. Estimated remaining: 8m 2s. Rate: 169.8 symbols/min [2025-09-14T20:54:09.942753] [INFO ] [MAIN ] GEV: Generated 1352 derivative records from 39972 primary records. [2025-09-14T20:54:09.942994] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-14T20:54:09.943282] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:09.945820] [INFO ] [MAIN ] Derivative Progress: 863/2226 symbols completed. GETY took 1.1s. Estimated remaining: 8m 1s. Rate: 169.9 symbols/min [2025-09-14T20:54:09.947820] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:09.961852] [DEBUG] [LOCAL ] GEV: Derivative data saved (1352 records). [2025-09-14T20:54:09.962107] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-14T20:54:09.964489] [INFO ] [MAIN ] Derivative Progress: 864/2226 symbols completed. GEV took 1.1s. Estimated remaining: 8m 0s. Rate: 170.1 symbols/min [2025-09-14T20:54:09.964975] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:09.967948] [DEBUG] [LOCAL ] GF: Loaded 2145 existing records from primary storage. [2025-09-14T20:54:09.968462] [INFO ] [MAIN ] GF: Loaded 2145 primary data records. [2025-09-14T20:54:10.131136] [DEBUG] [LOCAL ] GFF: Loaded 22815 existing records from primary storage. [2025-09-14T20:54:10.179595] [INFO ] [MAIN ] GFF: Loaded 22815 primary data records. [2025-09-14T20:54:10.404744] [DEBUG] [LOCAL ] GFI: Loaded 39887 existing records from primary storage. [2025-09-14T20:54:10.419682] [INFO ] [MAIN ] GFI: Loaded 39887 primary data records. [2025-09-14T20:54:10.896962] [DEBUG] [MAIN ] GF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:10.911237] [INFO ] [MAIN ] GF: Generated 1352 derivative records from 2145 primary records. [2025-09-14T20:54:10.911691] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-14T20:54:10.929025] [DEBUG] [LOCAL ] GF: Derivative data saved (1352 records). [2025-09-14T20:54:10.930123] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-14T20:54:10.932555] [INFO ] [MAIN ] Derivative Progress: 865/2226 symbols completed. GF took 1.0s. Estimated remaining: 8m 1s. Rate: 169.8 symbols/min [2025-09-14T20:54:10.933093] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:10.950029] [DEBUG] [MAIN ] GFF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:10.951280] [INFO ] [MAIN ] GFF: Generated 1352 derivative records from 22815 primary records. [2025-09-14T20:54:10.951799] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-14T20:54:10.969341] [DEBUG] [LOCAL ] GFF: Derivative data saved (1352 records). [2025-09-14T20:54:10.969709] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-14T20:54:10.980336] [DEBUG] [MAIN ] GFI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:10.993186] [INFO ] [MAIN ] Derivative Progress: 866/2226 symbols completed. GFF took 1.0s. Estimated remaining: 8m 0s. Rate: 170.0 symbols/min [2025-09-14T20:54:10.994903] [INFO ] [MAIN ] GFI: Generated 1352 derivative records from 39887 primary records. [2025-09-14T20:54:10.995271] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:10.995425] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-14T20:54:11.011069] [DEBUG] [LOCAL ] GFI: Derivative data saved (1352 records). [2025-09-14T20:54:11.022386] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-14T20:54:11.025163] [INFO ] [MAIN ] Derivative Progress: 867/2226 symbols completed. GFI took 1.1s. Estimated remaining: 7m 59s. Rate: 170.1 symbols/min [2025-09-14T20:54:11.029508] [DEBUG] [LOCAL ] GFL: Loaded 35480 existing records from primary storage. [2025-09-14T20:54:11.030276] [DEBUG] [LOCAL ] GFR: Loaded 5201 existing records from primary storage. [2025-09-14T20:54:11.030504] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:11.030694] [INFO ] [MAIN ] GFL: Loaded 35480 primary data records. [2025-09-14T20:54:11.031406] [INFO ] [MAIN ] GFR: Loaded 5201 primary data records. [2025-09-14T20:54:11.440797] [DEBUG] [LOCAL ] GGB: Loaded 38585 existing records from primary storage. [2025-09-14T20:54:11.625422] [INFO ] [MAIN ] GGB: Loaded 38585 primary data records. [2025-09-14T20:54:11.950948] [DEBUG] [MAIN ] GFR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:11.957694] [INFO ] [MAIN ] GFR: Generated 1352 derivative records from 5201 primary records. [2025-09-14T20:54:11.956749] [DEBUG] [MAIN ] GFL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:11.958748] [INFO ] [MAIN ] GFL: Generated 1352 derivative records from 35480 primary records. [2025-09-14T20:54:11.958980] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-14T20:54:11.958876] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-14T20:54:11.986235] [DEBUG] [LOCAL ] GFL: Derivative data saved (1352 records). [2025-09-14T20:54:11.987675] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-14T20:54:11.991193] [INFO ] [MAIN ] Derivative Progress: 868/2226 symbols completed. GFL took 1.1s. Estimated remaining: 7m 60s. Rate: 169.8 symbols/min [2025-09-14T20:54:11.994064] [DEBUG] [LOCAL ] GFR: Derivative data saved (1352 records). [2025-09-14T20:54:11.994696] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-14T20:54:11.997615] [INFO ] [MAIN ] Derivative Progress: 869/2226 symbols completed. GFR took 1.0s. Estimated remaining: 7m 59s. Rate: 170.0 symbols/min [2025-09-14T20:54:12.016805] [DEBUG] [MAIN ] GGB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:12.018049] [INFO ] [MAIN ] GGB: Generated 1352 derivative records from 38585 primary records. [2025-09-14T20:54:12.018162] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-14T20:54:12.043097] [DEBUG] [LOCAL ] GGB: Derivative data saved (1352 records). [2025-09-14T20:54:12.043383] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-14T20:54:12.046014] [INFO ] [MAIN ] Derivative Progress: 870/2226 symbols completed. GGB took 1.0s. Estimated remaining: 7m 58s. Rate: 170.2 symbols/min [2025-09-14T20:54:12.047250] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:12.047488] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:12.047335] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:12.053292] [DEBUG] [LOCAL ] GGZ: Loaded 1716 existing records from primary storage. [2025-09-14T20:54:12.053497] [INFO ] [MAIN ] GGZ: Loaded 1716 primary data records. [2025-09-14T20:54:12.186727] [DEBUG] [LOCAL ] GGT: Loaded 11004 existing records from primary storage. [2025-09-14T20:54:12.201861] [INFO ] [MAIN ] GGT: Loaded 11004 primary data records. [2025-09-14T20:54:12.315589] [DEBUG] [LOCAL ] GGG: Loaded 30224 existing records from primary storage. [2025-09-14T20:54:12.416439] [INFO ] [MAIN ] GGG: Loaded 30224 primary data records. [2025-09-14T20:54:13.021956] [DEBUG] [MAIN ] GGZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:13.024205] [INFO ] [MAIN ] GGZ: Generated 1352 derivative records from 1716 primary records. [2025-09-14T20:54:13.024449] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-14T20:54:13.039075] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1352 records). [2025-09-14T20:54:13.040346] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-14T20:54:13.042471] [INFO ] [MAIN ] Derivative Progress: 871/2226 symbols completed. GGZ took 1.0s. Estimated remaining: 7m 59s. Rate: 169.8 symbols/min [2025-09-14T20:54:13.043087] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:13.057536] [DEBUG] [MAIN ] GGT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:13.062668] [INFO ] [MAIN ] GGT: Generated 1352 derivative records from 11004 primary records. [2025-09-14T20:54:13.061798] [DEBUG] [LOCAL ] GHC: Loaded 2078 existing records from primary storage. [2025-09-14T20:54:13.062922] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-14T20:54:13.063182] [INFO ] [MAIN ] GHC: Loaded 2078 primary data records. [2025-09-14T20:54:13.079141] [DEBUG] [MAIN ] GGG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:13.092125] [INFO ] [MAIN ] GGG: Generated 1352 derivative records from 30224 primary records. [2025-09-14T20:54:13.131351] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-14T20:54:13.178274] [DEBUG] [LOCAL ] GGT: Derivative data saved (1352 records). [2025-09-14T20:54:13.189918] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-14T20:54:13.201877] [INFO ] [MAIN ] Derivative Progress: 872/2226 symbols completed. GGT took 1.2s. Estimated remaining: 7m 58s. Rate: 169.9 symbols/min [2025-09-14T20:54:13.217693] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:13.284021] [DEBUG] [LOCAL ] GGG: Derivative data saved (1352 records). [2025-09-14T20:54:13.371541] [DEBUG] [LOCAL ] GHG: Loaded 2514 existing records from primary storage. [2025-09-14T20:54:13.378285] [INFO ] [MAIN ] GHG: Loaded 2514 primary data records. [2025-09-14T20:54:13.371622] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-14T20:54:13.381324] [INFO ] [MAIN ] Derivative Progress: 873/2226 symbols completed. GGG took 1.3s. Estimated remaining: 7m 58s. Rate: 170.0 symbols/min [2025-09-14T20:54:13.419667] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:13.651189] [DEBUG] [LOCAL ] GHI: Loaded 5287 existing records from primary storage. [2025-09-14T20:54:13.651865] [INFO ] [MAIN ] GHI: Loaded 5287 primary data records. [2025-09-14T20:54:13.947531] [DEBUG] [MAIN ] GHC: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T20:54:13.948944] [INFO ] [MAIN ] GHC: Generated 1350 derivative records from 2078 primary records. [2025-09-14T20:54:13.949726] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-14T20:54:13.973882] [DEBUG] [LOCAL ] GHC: Derivative data saved (1350 records). [2025-09-14T20:54:13.978137] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-14T20:54:13.981086] [INFO ] [MAIN ] Derivative Progress: 874/2226 symbols completed. GHC took 0.9s. Estimated remaining: 7m 58s. Rate: 169.9 symbols/min [2025-09-14T20:54:13.978531] [DEBUG] [MAIN ] GHG: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T20:54:13.981498] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:13.983975] [INFO ] [MAIN ] GHG: Generated 1350 derivative records from 2514 primary records. [2025-09-14T20:54:13.984727] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-14T20:54:14.000223] [DEBUG] [LOCAL ] GHLD: Loaded 3308 existing records from primary storage. [2025-09-14T20:54:14.000400] [INFO ] [MAIN ] GHLD: Loaded 3308 primary data records. [2025-09-14T20:54:14.075469] [DEBUG] [LOCAL ] GHG: Derivative data saved (1350 records). [2025-09-14T20:54:14.115705] [DEBUG] [MAIN ] GHI: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:54:14.118782] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-14T20:54:14.122116] [INFO ] [MAIN ] Derivative Progress: 875/2226 symbols completed. GHG took 0.9s. Estimated remaining: 7m 57s. Rate: 170.0 symbols/min [2025-09-14T20:54:14.119456] [INFO ] [MAIN ] GHI: Generated 1351 derivative records from 5287 primary records. [2025-09-14T20:54:14.122417] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:14.122934] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-14T20:54:14.370224] [DEBUG] [LOCAL ] GHM: Loaded 10444 existing records from primary storage. [2025-09-14T20:54:14.371551] [INFO ] [MAIN ] GHM: Loaded 10444 primary data records. [2025-09-14T20:54:14.423286] [DEBUG] [LOCAL ] GHI: Derivative data saved (1351 records). [2025-09-14T20:54:14.447142] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-14T20:54:14.468617] [INFO ] [MAIN ] Derivative Progress: 876/2226 symbols completed. GHI took 1.1s. Estimated remaining: 7m 57s. Rate: 170.0 symbols/min [2025-09-14T20:54:14.486690] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:14.683198] [DEBUG] [LOCAL ] GHY: Loaded 15424 existing records from primary storage. [2025-09-14T20:54:14.684621] [INFO ] [MAIN ] GHY: Loaded 15424 primary data records. [2025-09-14T20:54:14.694926] [DEBUG] [MAIN ] GHLD: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:54:14.717320] [INFO ] [MAIN ] GHLD: Generated 1351 derivative records from 3308 primary records. [2025-09-14T20:54:14.740837] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-14T20:54:14.814851] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1351 records). [2025-09-14T20:54:14.836172] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-14T20:54:14.866496] [INFO ] [MAIN ] Derivative Progress: 877/2226 symbols completed. GHLD took 0.9s. Estimated remaining: 7m 56s. Rate: 170.0 symbols/min [2025-09-14T20:54:14.892403] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:15.008833] [DEBUG] [MAIN ] GHM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:15.009828] [INFO ] [MAIN ] GHM: Generated 1352 derivative records from 10444 primary records. [2025-09-14T20:54:15.009991] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-14T20:54:15.030768] [DEBUG] [LOCAL ] GHM: Derivative data saved (1352 records). [2025-09-14T20:54:15.031508] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-14T20:54:15.034260] [INFO ] [MAIN ] Derivative Progress: 878/2226 symbols completed. GHM took 0.9s. Estimated remaining: 7m 56s. Rate: 170.1 symbols/min [2025-09-14T20:54:15.035809] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:15.047621] [DEBUG] [LOCAL ] GIB: Loaded 23149 existing records from primary storage. [2025-09-14T20:54:15.048017] [INFO ] [MAIN ] GIB: Loaded 23149 primary data records. [2025-09-14T20:54:15.140076] [DEBUG] [MAIN ] GHY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:15.162341] [DEBUG] [LOCAL ] GIC: Loaded 10183 existing records from primary storage. [2025-09-14T20:54:15.163247] [INFO ] [MAIN ] GHY: Generated 1352 derivative records from 15424 primary records. [2025-09-14T20:54:15.163347] [INFO ] [MAIN ] GIC: Loaded 10183 primary data records. [2025-09-14T20:54:15.203734] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-14T20:54:15.389279] [DEBUG] [LOCAL ] GHY: Derivative data saved (1352 records). [2025-09-14T20:54:15.498469] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-14T20:54:15.555716] [INFO ] [MAIN ] Derivative Progress: 879/2226 symbols completed. GHY took 1.1s. Estimated remaining: 7m 55s. Rate: 170.0 symbols/min [2025-09-14T20:54:15.641603] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:15.680822] [DEBUG] [MAIN ] GIB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:15.683344] [INFO ] [MAIN ] GIB: Generated 1352 derivative records from 23149 primary records. [2025-09-14T20:54:15.694456] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-14T20:54:15.730391] [DEBUG] [MAIN ] GIC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:15.733272] [DEBUG] [LOCAL ] GIB: Derivative data saved (1352 records). [2025-09-14T20:54:15.733740] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-14T20:54:15.734582] [INFO ] [MAIN ] GIC: Generated 1352 derivative records from 10183 primary records. [2025-09-14T20:54:15.735369] [DEBUG] [LOCAL ] GIL: Loaded 32288 existing records from primary storage. [2025-09-14T20:54:15.737882] [INFO ] [MAIN ] Derivative Progress: 880/2226 symbols completed. GIB took 0.9s. Estimated remaining: 7m 55s. Rate: 170.1 symbols/min [2025-09-14T20:54:15.738259] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-14T20:54:15.738547] [INFO ] [MAIN ] GIL: Loaded 32288 primary data records. [2025-09-14T20:54:15.738928] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:15.920517] [DEBUG] [LOCAL ] GIC: Derivative data saved (1352 records). [2025-09-14T20:54:15.950062] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-14T20:54:16.054317] [INFO ] [MAIN ] Derivative Progress: 881/2226 symbols completed. GIC took 1.0s. Estimated remaining: 7m 54s. Rate: 170.1 symbols/min [2025-09-14T20:54:16.061472] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:16.080555] [DEBUG] [LOCAL ] GIS: Loaded 40420 existing records from primary storage. [2025-09-14T20:54:16.082509] [INFO ] [MAIN ] GIS: Loaded 40420 primary data records. [2025-09-14T20:54:16.276607] [DEBUG] [LOCAL ] GKOS: Loaded 31951 existing records from primary storage. [2025-09-14T20:54:16.306608] [DEBUG] [MAIN ] GIL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:16.307741] [INFO ] [MAIN ] GKOS: Loaded 31951 primary data records. [2025-09-14T20:54:16.308821] [INFO ] [MAIN ] GIL: Generated 1352 derivative records from 32288 primary records. [2025-09-14T20:54:16.324752] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-14T20:54:16.551519] [DEBUG] [LOCAL ] GIL: Derivative data saved (1352 records). [2025-09-14T20:54:16.562487] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-14T20:54:16.590608] [INFO ] [MAIN ] Derivative Progress: 882/2226 symbols completed. GIL took 1.0s. Estimated remaining: 7m 54s. Rate: 170.0 symbols/min [2025-09-14T20:54:16.632108] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:16.806792] [DEBUG] [MAIN ] GIS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:16.809262] [INFO ] [MAIN ] GIS: Generated 1352 derivative records from 40420 primary records. [2025-09-14T20:54:16.818987] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-14T20:54:16.843870] [DEBUG] [LOCAL ] GIS: Derivative data saved (1352 records). [2025-09-14T20:54:16.844137] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-14T20:54:16.847470] [INFO ] [MAIN ] Derivative Progress: 883/2226 symbols completed. GIS took 1.1s. Estimated remaining: 7m 54s. Rate: 170.0 symbols/min [2025-09-14T20:54:16.851328] [DEBUG] [LOCAL ] GL: Loaded 28207 existing records from primary storage. [2025-09-14T20:54:16.852020] [INFO ] [MAIN ] GL: Loaded 28207 primary data records. [2025-09-14T20:54:16.862502] [DEBUG] [MAIN ] GKOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:16.908997] [INFO ] [MAIN ] GKOS: Generated 1352 derivative records from 31951 primary records. [2025-09-14T20:54:16.936102] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-14T20:54:17.042790] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1352 records). [2025-09-14T20:54:17.060195] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-14T20:54:17.066418] [INFO ] [MAIN ] Derivative Progress: 884/2226 symbols completed. GKOS took 1.0s. Estimated remaining: 7m 53s. Rate: 170.1 symbols/min [2025-09-14T20:54:17.180499] [DEBUG] [MAIN ] GL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:17.181310] [INFO ] [MAIN ] GL: Generated 1352 derivative records from 28207 primary records. [2025-09-14T20:54:17.181393] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-14T20:54:17.194290] [DEBUG] [LOCAL ] GL: Derivative data saved (1352 records). [2025-09-14T20:54:17.194417] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-14T20:54:17.197329] [INFO ] [MAIN ] Derivative Progress: 885/2226 symbols completed. GL took 0.6s. Estimated remaining: 7m 53s. Rate: 170.2 symbols/min [2025-09-14T20:54:17.198171] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:17.198721] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:17.198561] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:17.219483] [DEBUG] [LOCAL ] GLP: Loaded 7000 existing records from primary storage. [2025-09-14T20:54:17.219878] [INFO ] [MAIN ] GLP: Loaded 7000 primary data records. [2025-09-14T20:54:17.551444] [DEBUG] [LOCAL ] GLW: Loaded 40377 existing records from primary storage. [2025-09-14T20:54:17.553961] [DEBUG] [LOCAL ] GLOB: Loaded 35854 existing records from primary storage. [2025-09-14T20:54:17.554367] [INFO ] [MAIN ] GLW: Loaded 40377 primary data records. [2025-09-14T20:54:17.554684] [INFO ] [MAIN ] GLOB: Loaded 35854 primary data records. [2025-09-14T20:54:18.144599] [DEBUG] [MAIN ] GLP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:18.149072] [INFO ] [MAIN ] GLP: Generated 1352 derivative records from 7000 primary records. [2025-09-14T20:54:18.149769] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-14T20:54:18.166162] [DEBUG] [LOCAL ] GLP: Derivative data saved (1352 records). [2025-09-14T20:54:18.167318] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-14T20:54:18.170011] [INFO ] [MAIN ] Derivative Progress: 886/2226 symbols completed. GLP took 1.0s. Estimated remaining: 7m 53s. Rate: 169.9 symbols/min [2025-09-14T20:54:18.170757] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:18.186192] [DEBUG] [MAIN ] GLW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:18.187865] [INFO ] [MAIN ] GLW: Generated 1352 derivative records from 40377 primary records. [2025-09-14T20:54:18.188135] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-14T20:54:18.214512] [DEBUG] [LOCAL ] GLW: Derivative data saved (1352 records). [2025-09-14T20:54:18.214887] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-14T20:54:18.217430] [INFO ] [MAIN ] Derivative Progress: 887/2226 symbols completed. GLW took 1.0s. Estimated remaining: 7m 52s. Rate: 170.1 symbols/min [2025-09-14T20:54:18.218351] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:18.218090] [DEBUG] [MAIN ] GLOB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:18.219720] [INFO ] [MAIN ] GLOB: Generated 1352 derivative records from 35854 primary records. [2025-09-14T20:54:18.220227] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-14T20:54:18.244565] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1352 records). [2025-09-14T20:54:18.244791] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-14T20:54:18.248078] [INFO ] [MAIN ] Derivative Progress: 888/2226 symbols completed. GLOB took 1.1s. Estimated remaining: 7m 52s. Rate: 170.2 symbols/min [2025-09-14T20:54:18.248511] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:18.263530] [DEBUG] [LOCAL ] GM: Loaded 40470 existing records from primary storage. [2025-09-14T20:54:18.263861] [INFO ] [MAIN ] GM: Loaded 40470 primary data records. [2025-09-14T20:54:18.439841] [DEBUG] [LOCAL ] GME: Loaded 40527 existing records from primary storage. [2025-09-14T20:54:18.464998] [INFO ] [MAIN ] GME: Loaded 40527 primary data records. [2025-09-14T20:54:18.501577] [DEBUG] [LOCAL ] GMED: Loaded 36187 existing records from primary storage. [2025-09-14T20:54:18.532340] [INFO ] [MAIN ] GMED: Loaded 36187 primary data records. [2025-09-14T20:54:19.267876] [DEBUG] [MAIN ] GM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:19.269195] [INFO ] [MAIN ] GM: Generated 1352 derivative records from 40470 primary records. [2025-09-14T20:54:19.271290] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-14T20:54:19.296811] [DEBUG] [LOCAL ] GM: Derivative data saved (1352 records). [2025-09-14T20:54:19.296301] [DEBUG] [MAIN ] GME: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:19.298091] [INFO ] [MAIN ] GME: Generated 1352 derivative records from 40527 primary records. [2025-09-14T20:54:19.297258] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-14T20:54:19.300623] [INFO ] [MAIN ] Derivative Progress: 889/2226 symbols completed. GM took 1.1s. Estimated remaining: 7m 52s. Rate: 169.9 symbols/min [2025-09-14T20:54:19.301098] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-14T20:54:19.301613] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:19.318245] [DEBUG] [LOCAL ] GME: Derivative data saved (1352 records). [2025-09-14T20:54:19.324909] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-14T20:54:19.331510] [INFO ] [MAIN ] Derivative Progress: 890/2226 symbols completed. GME took 1.1s. Estimated remaining: 7m 51s. Rate: 170.0 symbols/min [2025-09-14T20:54:19.331874] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:19.332506] [DEBUG] [MAIN ] GMED: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:19.333938] [INFO ] [MAIN ] GMED: Generated 1352 derivative records from 36187 primary records. [2025-09-14T20:54:19.334161] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-14T20:54:19.357366] [DEBUG] [LOCAL ] GMED: Derivative data saved (1352 records). [2025-09-14T20:54:19.357624] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-14T20:54:19.363853] [INFO ] [MAIN ] Derivative Progress: 891/2226 symbols completed. GMED took 1.1s. Estimated remaining: 7m 51s. Rate: 170.2 symbols/min [2025-09-14T20:54:19.373313] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:19.374053] [DEBUG] [LOCAL ] GMRE: Loaded 28453 existing records from primary storage. [2025-09-14T20:54:19.379918] [INFO ] [MAIN ] GMRE: Loaded 28453 primary data records. [2025-09-14T20:54:19.392801] [DEBUG] [LOCAL ] GNE: Loaded 14647 existing records from primary storage. [2025-09-14T20:54:19.424907] [INFO ] [MAIN ] GNE: Loaded 14647 primary data records. [2025-09-14T20:54:19.734730] [DEBUG] [LOCAL ] GNK: Loaded 29950 existing records from primary storage. [2025-09-14T20:54:19.894006] [INFO ] [MAIN ] GNK: Loaded 29950 primary data records. [2025-09-14T20:54:20.311422] [DEBUG] [MAIN ] GMRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:20.315566] [INFO ] [MAIN ] GMRE: Generated 1352 derivative records from 28453 primary records. [2025-09-14T20:54:20.326425] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-14T20:54:20.328137] [DEBUG] [MAIN ] GNE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:20.330122] [INFO ] [MAIN ] GNE: Generated 1352 derivative records from 14647 primary records. [2025-09-14T20:54:20.337776] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-14T20:54:20.344127] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1352 records). [2025-09-14T20:54:20.344525] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-14T20:54:20.347161] [INFO ] [MAIN ] Derivative Progress: 892/2226 symbols completed. GMRE took 1.0s. Estimated remaining: 7m 51s. Rate: 169.9 symbols/min [2025-09-14T20:54:20.354093] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:20.361561] [DEBUG] [LOCAL ] GNE: Derivative data saved (1352 records). [2025-09-14T20:54:20.361935] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-14T20:54:20.364790] [INFO ] [MAIN ] Derivative Progress: 893/2226 symbols completed. GNE took 1.0s. Estimated remaining: 7m 50s. Rate: 170.0 symbols/min [2025-09-14T20:54:20.365764] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:20.381504] [DEBUG] [MAIN ] GNK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:20.382596] [INFO ] [MAIN ] GNK: Generated 1352 derivative records from 29950 primary records. [2025-09-14T20:54:20.382883] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-14T20:54:20.400929] [DEBUG] [LOCAL ] GNK: Derivative data saved (1352 records). [2025-09-14T20:54:20.401282] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-14T20:54:20.403798] [INFO ] [MAIN ] Derivative Progress: 894/2226 symbols completed. GNK took 1.0s. Estimated remaining: 7m 50s. Rate: 170.2 symbols/min [2025-09-14T20:54:20.413663] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:20.442761] [DEBUG] [LOCAL ] GNL: Loaded 35163 existing records from primary storage. [2025-09-14T20:54:20.444344] [INFO ] [MAIN ] GNL: Loaded 35163 primary data records. [2025-09-14T20:54:20.522793] [DEBUG] [LOCAL ] GNT: Loaded 5911 existing records from primary storage. [2025-09-14T20:54:20.567950] [INFO ] [MAIN ] GNT: Loaded 5911 primary data records. [2025-09-14T20:54:20.568941] [DEBUG] [LOCAL ] GNRC: Loaded 33818 existing records from primary storage. [2025-09-14T20:54:20.701947] [INFO ] [MAIN ] GNRC: Loaded 33818 primary data records. [2025-09-14T20:54:21.334380] [DEBUG] [MAIN ] GNL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:21.336019] [INFO ] [MAIN ] GNL: Generated 1352 derivative records from 35163 primary records. [2025-09-14T20:54:21.336321] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-14T20:54:21.351838] [DEBUG] [LOCAL ] GNL: Derivative data saved (1352 records). [2025-09-14T20:54:21.364847] [DEBUG] [MAIN ] GNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:21.365387] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-14T20:54:21.376293] [INFO ] [MAIN ] GNT: Generated 1352 derivative records from 5911 primary records. [2025-09-14T20:54:21.378541] [INFO ] [MAIN ] Derivative Progress: 895/2226 symbols completed. GNL took 1.0s. Estimated remaining: 7m 50s. Rate: 169.9 symbols/min [2025-09-14T20:54:21.379242] [DEBUG] [MAIN ] GNRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:21.380446] [INFO ] [MAIN ] GNRC: Generated 1352 derivative records from 33818 primary records. [2025-09-14T20:54:21.379499] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:21.380621] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-14T20:54:21.379551] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-14T20:54:21.405062] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1352 records). [2025-09-14T20:54:21.409736] [DEBUG] [LOCAL ] GNT: Derivative data saved (1352 records). [2025-09-14T20:54:21.409858] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-14T20:54:21.410105] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-14T20:54:21.413017] [INFO ] [MAIN ] Derivative Progress: 896/2226 symbols completed. GNT took 1.0s. Estimated remaining: 7m 49s. Rate: 170.0 symbols/min [2025-09-14T20:54:21.415423] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:21.415894] [INFO ] [MAIN ] Derivative Progress: 897/2226 symbols completed. GNRC took 1.0s. Estimated remaining: 7m 48s. Rate: 170.2 symbols/min [2025-09-14T20:54:21.419778] [DEBUG] [LOCAL ] GNTY: Loaded 5735 existing records from primary storage. [2025-09-14T20:54:21.420218] [INFO ] [MAIN ] GNTY: Loaded 5735 primary data records. [2025-09-14T20:54:21.420052] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:21.659487] [DEBUG] [LOCAL ] GNW: Loaded 38622 existing records from primary storage. [2025-09-14T20:54:21.803980] [DEBUG] [LOCAL ] GOF: Loaded 31610 existing records from primary storage. [2025-09-14T20:54:21.804269] [INFO ] [MAIN ] GOF: Loaded 31610 primary data records. [2025-09-14T20:54:21.802493] [INFO ] [MAIN ] GNW: Loaded 38622 primary data records. [2025-09-14T20:54:22.439385] [DEBUG] [MAIN ] GNTY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:22.441218] [INFO ] [MAIN ] GNTY: Generated 1352 derivative records from 5735 primary records. [2025-09-14T20:54:22.441662] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-14T20:54:22.456063] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1352 records). [2025-09-14T20:54:22.456195] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-14T20:54:22.458921] [INFO ] [MAIN ] Derivative Progress: 898/2226 symbols completed. GNTY took 1.1s. Estimated remaining: 7m 49s. Rate: 169.9 symbols/min [2025-09-14T20:54:22.476726] [DEBUG] [MAIN ] GNW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:22.478227] [INFO ] [MAIN ] GNW: Generated 1352 derivative records from 38622 primary records. [2025-09-14T20:54:22.479505] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-14T20:54:22.500514] [DEBUG] [MAIN ] GOF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:22.503497] [INFO ] [MAIN ] GOF: Generated 1352 derivative records from 31610 primary records. [2025-09-14T20:54:22.502794] [DEBUG] [LOCAL ] GNW: Derivative data saved (1352 records). [2025-09-14T20:54:22.503654] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-14T20:54:22.505843] [INFO ] [MAIN ] Derivative Progress: 899/2226 symbols completed. GNW took 1.1s. Estimated remaining: 7m 48s. Rate: 170.0 symbols/min [2025-09-14T20:54:22.503688] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-14T20:54:22.518490] [DEBUG] [LOCAL ] GOF: Derivative data saved (1352 records). [2025-09-14T20:54:22.518590] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-14T20:54:22.520804] [INFO ] [MAIN ] Derivative Progress: 900/2226 symbols completed. GOF took 1.1s. Estimated remaining: 7m 47s. Rate: 170.2 symbols/min [2025-09-14T20:54:22.521318] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:22.521445] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:22.521599] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:22.570626] [DEBUG] [LOCAL ] GOTU: Loaded 28001 existing records from primary storage. [2025-09-14T20:54:22.571157] [DEBUG] [LOCAL ] GOLF: Loaded 23261 existing records from primary storage. [2025-09-14T20:54:22.571399] [INFO ] [MAIN ] GOLF: Loaded 23261 primary data records. [2025-09-14T20:54:22.571466] [INFO ] [MAIN ] GOTU: Loaded 28001 primary data records. [2025-09-14T20:54:22.754499] [DEBUG] [LOCAL ] GOOS: Loaded 34330 existing records from primary storage. [2025-09-14T20:54:22.788787] [INFO ] [MAIN ] GOOS: Loaded 34330 primary data records. [2025-09-14T20:54:23.455688] [DEBUG] [MAIN ] GOLF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:23.456529] [INFO ] [MAIN ] GOLF: Generated 1352 derivative records from 23261 primary records. [2025-09-14T20:54:23.457105] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-14T20:54:23.478949] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1352 records). [2025-09-14T20:54:23.483198] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-14T20:54:23.483436] [DEBUG] [MAIN ] GOTU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:23.485510] [INFO ] [MAIN ] Derivative Progress: 901/2226 symbols completed. GOLF took 1.0s. Estimated remaining: 7m 48s. Rate: 169.9 symbols/min [2025-09-14T20:54:23.486902] [INFO ] [MAIN ] GOTU: Generated 1352 derivative records from 28001 primary records. [2025-09-14T20:54:23.487584] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-14T20:54:23.487247] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:23.503714] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1352 records). [2025-09-14T20:54:23.513668] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-14T20:54:23.513913] [DEBUG] [MAIN ] GOOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:23.517606] [INFO ] [MAIN ] Derivative Progress: 902/2226 symbols completed. GOTU took 1.0s. Estimated remaining: 7m 47s. Rate: 170.1 symbols/min [2025-09-14T20:54:23.514967] [INFO ] [MAIN ] GOOS: Generated 1352 derivative records from 34330 primary records. [2025-09-14T20:54:23.517927] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:23.518051] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-14T20:54:23.531748] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1352 records). [2025-09-14T20:54:23.532003] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-14T20:54:23.534318] [INFO ] [MAIN ] Derivative Progress: 903/2226 symbols completed. GOOS took 1.0s. Estimated remaining: 7m 46s. Rate: 170.2 symbols/min [2025-09-14T20:54:23.536026] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:23.546122] [DEBUG] [LOCAL ] GPI: Loaded 10289 existing records from primary storage. [2025-09-14T20:54:23.549033] [DEBUG] [LOCAL ] GPJA: Loaded 3110 existing records from primary storage. [2025-09-14T20:54:23.558436] [INFO ] [MAIN ] GPI: Loaded 10289 primary data records. [2025-09-14T20:54:23.558883] [INFO ] [MAIN ] GPJA: Loaded 3110 primary data records. [2025-09-14T20:54:23.794156] [DEBUG] [LOCAL ] GPC: Loaded 34452 existing records from primary storage. [2025-09-14T20:54:23.800713] [INFO ] [MAIN ] GPC: Loaded 34452 primary data records. [2025-09-14T20:54:24.566039] [DEBUG] [MAIN ] GPJA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:24.567041] [INFO ] [MAIN ] GPJA: Generated 1352 derivative records from 3110 primary records. [2025-09-14T20:54:24.567456] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-14T20:54:24.580476] [DEBUG] [MAIN ] GPI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:24.590568] [INFO ] [MAIN ] GPI: Generated 1352 derivative records from 10289 primary records. [2025-09-14T20:54:24.594036] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1352 records). [2025-09-14T20:54:24.594150] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-14T20:54:24.594230] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-14T20:54:24.597446] [INFO ] [MAIN ] Derivative Progress: 904/2226 symbols completed. GPJA took 1.1s. Estimated remaining: 7m 47s. Rate: 169.9 symbols/min [2025-09-14T20:54:24.619552] [DEBUG] [MAIN ] GPC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:24.612897] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:24.624093] [INFO ] [MAIN ] GPC: Generated 1352 derivative records from 34452 primary records. [2025-09-14T20:54:24.625203] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-14T20:54:24.628396] [DEBUG] [LOCAL ] GPI: Derivative data saved (1352 records). [2025-09-14T20:54:24.629727] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-14T20:54:24.632504] [INFO ] [MAIN ] Derivative Progress: 905/2226 symbols completed. GPI took 1.1s. Estimated remaining: 7m 46s. Rate: 170.0 symbols/min [2025-09-14T20:54:24.638922] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:24.649870] [DEBUG] [LOCAL ] GPC: Derivative data saved (1352 records). [2025-09-14T20:54:24.650266] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-14T20:54:24.653249] [INFO ] [MAIN ] Derivative Progress: 906/2226 symbols completed. GPC took 1.2s. Estimated remaining: 7m 45s. Rate: 170.2 symbols/min [2025-09-14T20:54:24.653813] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:24.702670] [DEBUG] [LOCAL ] GPK: Loaded 39725 existing records from primary storage. [2025-09-14T20:54:24.703385] [DEBUG] [LOCAL ] GPMT: Loaded 20904 existing records from primary storage. [2025-09-14T20:54:24.703468] [INFO ] [MAIN ] GPK: Loaded 39725 primary data records. [2025-09-14T20:54:24.703570] [INFO ] [MAIN ] GPMT: Loaded 20904 primary data records. [2025-09-14T20:54:24.993992] [DEBUG] [LOCAL ] GPN: Loaded 39199 existing records from primary storage. [2025-09-14T20:54:25.020025] [INFO ] [MAIN ] GPN: Loaded 39199 primary data records. [2025-09-14T20:54:25.684177] [DEBUG] [MAIN ] GPN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:25.684442] [DEBUG] [MAIN ] GPK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:25.685279] [DEBUG] [MAIN ] GPMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:25.686313] [INFO ] [MAIN ] GPN: Generated 1352 derivative records from 39199 primary records. [2025-09-14T20:54:25.688351] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-14T20:54:25.687003] [INFO ] [MAIN ] GPK: Generated 1352 derivative records from 39725 primary records. [2025-09-14T20:54:25.688478] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-14T20:54:25.688163] [INFO ] [MAIN ] GPMT: Generated 1352 derivative records from 20904 primary records. [2025-09-14T20:54:25.705492] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-14T20:54:25.714131] [DEBUG] [LOCAL ] GPK: Derivative data saved (1352 records). [2025-09-14T20:54:25.714867] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-14T20:54:25.725033] [INFO ] [MAIN ] Derivative Progress: 907/2226 symbols completed. GPK took 1.1s. Estimated remaining: 7m 46s. Rate: 169.8 symbols/min [2025-09-14T20:54:25.727864] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:25.731878] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1352 records). [2025-09-14T20:54:25.725108] [DEBUG] [LOCAL ] GPN: Derivative data saved (1352 records). [2025-09-14T20:54:25.732603] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-14T20:54:25.732781] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-14T20:54:25.734816] [INFO ] [MAIN ] Derivative Progress: 908/2226 symbols completed. GPN took 1.1s. Estimated remaining: 7m 45s. Rate: 170.0 symbols/min [2025-09-14T20:54:25.737430] [INFO ] [MAIN ] Derivative Progress: 909/2226 symbols completed. GPMT took 1.1s. Estimated remaining: 7m 44s. Rate: 170.2 symbols/min [2025-09-14T20:54:25.738163] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:25.735188] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:25.773225] [DEBUG] [LOCAL ] GPOR: Loaded 16535 existing records from primary storage. [2025-09-14T20:54:25.780550] [INFO ] [MAIN ] GPOR: Loaded 16535 primary data records. [2025-09-14T20:54:25.781155] [DEBUG] [LOCAL ] GRBK: Loaded 19882 existing records from primary storage. [2025-09-14T20:54:25.827698] [INFO ] [MAIN ] GRBK: Loaded 19882 primary data records. [2025-09-14T20:54:25.928818] [DEBUG] [LOCAL ] GPRK: Loaded 28993 existing records from primary storage. [2025-09-14T20:54:25.956084] [INFO ] [MAIN ] GPRK: Loaded 28993 primary data records. [2025-09-14T20:54:26.739804] [DEBUG] [MAIN ] GPOR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:26.742672] [INFO ] [MAIN ] GPOR: Generated 1352 derivative records from 16535 primary records. [2025-09-14T20:54:26.743345] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-14T20:54:26.762702] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1352 records). [2025-09-14T20:54:26.763082] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-14T20:54:26.766519] [INFO ] [MAIN ] Derivative Progress: 910/2226 symbols completed. GPOR took 1.0s. Estimated remaining: 7m 45s. Rate: 169.8 symbols/min [2025-09-14T20:54:26.767162] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:26.779691] [DEBUG] [MAIN ] GRBK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:26.782081] [INFO ] [MAIN ] GRBK: Generated 1352 derivative records from 19882 primary records. [2025-09-14T20:54:26.782263] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-14T20:54:26.809833] [DEBUG] [LOCAL ] GRC: Loaded 6363 existing records from primary storage. [2025-09-14T20:54:26.811057] [DEBUG] [MAIN ] GPRK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:26.811241] [INFO ] [MAIN ] GRC: Loaded 6363 primary data records. [2025-09-14T20:54:26.815499] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1352 records). [2025-09-14T20:54:26.812803] [INFO ] [MAIN ] GPRK: Generated 1352 derivative records from 28993 primary records. [2025-09-14T20:54:26.815780] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-14T20:54:26.828256] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-14T20:54:26.831101] [INFO ] [MAIN ] Derivative Progress: 911/2226 symbols completed. GRBK took 1.1s. Estimated remaining: 7m 44s. Rate: 170.0 symbols/min [2025-09-14T20:54:26.857958] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:26.963629] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1352 records). [2025-09-14T20:54:27.022348] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-14T20:54:27.121141] [INFO ] [MAIN ] Derivative Progress: 912/2226 symbols completed. GPRK took 1.4s. Estimated remaining: 7m 44s. Rate: 170.0 symbols/min [2025-09-14T20:54:27.118934] [DEBUG] [LOCAL ] GRDN: Loaded 15117 existing records from primary storage. [2025-09-14T20:54:27.121932] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:27.122760] [INFO ] [MAIN ] GRDN: Loaded 15117 primary data records. [2025-09-14T20:54:27.447399] [DEBUG] [LOCAL ] GRMN: Loaded 30492 existing records from primary storage. [2025-09-14T20:54:27.448129] [INFO ] [MAIN ] GRMN: Loaded 30492 primary data records. [2025-09-14T20:54:27.592728] [DEBUG] [MAIN ] GRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:27.610135] [INFO ] [MAIN ] GRC: Generated 1352 derivative records from 6363 primary records. [2025-09-14T20:54:27.668184] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-14T20:54:27.798994] [DEBUG] [MAIN ] GRDN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:27.802362] [DEBUG] [LOCAL ] GRC: Derivative data saved (1352 records). [2025-09-14T20:54:27.804361] [INFO ] [MAIN ] GRDN: Generated 1352 derivative records from 15117 primary records. [2025-09-14T20:54:27.804669] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-14T20:54:27.807274] [INFO ] [MAIN ] Derivative Progress: 913/2226 symbols completed. GRC took 1.0s. Estimated remaining: 7m 44s. Rate: 169.8 symbols/min [2025-09-14T20:54:27.807632] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-14T20:54:27.823398] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1352 records). [2025-09-14T20:54:27.823685] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-14T20:54:27.825890] [INFO ] [MAIN ] Derivative Progress: 914/2226 symbols completed. GRDN took 1.0s. Estimated remaining: 7m 43s. Rate: 170.0 symbols/min [2025-09-14T20:54:27.840929] [DEBUG] [MAIN ] GRMN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:27.841730] [INFO ] [MAIN ] GRMN: Generated 1352 derivative records from 30492 primary records. [2025-09-14T20:54:27.841810] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-14T20:54:27.854296] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1352 records). [2025-09-14T20:54:27.854421] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-14T20:54:27.857407] [INFO ] [MAIN ] Derivative Progress: 915/2226 symbols completed. GRMN took 0.7s. Estimated remaining: 7m 42s. Rate: 170.2 symbols/min [2025-09-14T20:54:27.858369] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:27.858631] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:27.858482] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:27.872593] [DEBUG] [LOCAL ] GROV: Loaded 6894 existing records from primary storage. [2025-09-14T20:54:27.872908] [INFO ] [MAIN ] GROV: Loaded 6894 primary data records. [2025-09-14T20:54:28.046233] [DEBUG] [LOCAL ] GRNT: Loaded 25252 existing records from primary storage. [2025-09-14T20:54:28.101958] [INFO ] [MAIN ] GRNT: Loaded 25252 primary data records. [2025-09-14T20:54:28.269522] [DEBUG] [LOCAL ] GRND: Loaded 37643 existing records from primary storage. [2025-09-14T20:54:28.286760] [INFO ] [MAIN ] GRND: Loaded 37643 primary data records. [2025-09-14T20:54:28.886136] [DEBUG] [MAIN ] GROV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:28.888246] [INFO ] [MAIN ] GROV: Generated 1352 derivative records from 6894 primary records. [2025-09-14T20:54:28.888625] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-14T20:54:28.905952] [DEBUG] [LOCAL ] GROV: Derivative data saved (1352 records). [2025-09-14T20:54:28.909825] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-14T20:54:28.913678] [INFO ] [MAIN ] Derivative Progress: 916/2226 symbols completed. GROV took 1.1s. Estimated remaining: 7m 43s. Rate: 169.8 symbols/min [2025-09-14T20:54:28.914491] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:28.933552] [DEBUG] [MAIN ] GRNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:28.935666] [INFO ] [MAIN ] GRNT: Generated 1352 derivative records from 25252 primary records. [2025-09-14T20:54:28.947021] [DEBUG] [MAIN ] GRND: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:28.949326] [INFO ] [MAIN ] GRND: Generated 1352 derivative records from 37643 primary records. [2025-09-14T20:54:28.947187] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-14T20:54:28.949544] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-14T20:54:28.966864] [DEBUG] [LOCAL ] GRX: Loaded 3275 existing records from primary storage. [2025-09-14T20:54:28.974736] [INFO ] [MAIN ] GRX: Loaded 3275 primary data records. [2025-09-14T20:54:28.977568] [DEBUG] [LOCAL ] GRND: Derivative data saved (1352 records). [2025-09-14T20:54:28.977972] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-14T20:54:29.017120] [INFO ] [MAIN ] Derivative Progress: 917/2226 symbols completed. GRND took 1.2s. Estimated remaining: 7m 42s. Rate: 169.9 symbols/min [2025-09-14T20:54:29.033253] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1352 records). [2025-09-14T20:54:29.033583] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:29.063082] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-14T20:54:29.094229] [INFO ] [MAIN ] Derivative Progress: 918/2226 symbols completed. GRNT took 1.2s. Estimated remaining: 7m 41s. Rate: 170.1 symbols/min [2025-09-14T20:54:29.114121] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:29.357445] [DEBUG] [LOCAL ] GS: Loaded 39082 existing records from primary storage. [2025-09-14T20:54:29.358290] [INFO ] [MAIN ] GS: Loaded 39082 primary data records. [2025-09-14T20:54:29.448389] [DEBUG] [LOCAL ] GSBD: Loaded 28373 existing records from primary storage. [2025-09-14T20:54:29.478293] [INFO ] [MAIN ] GSBD: Loaded 28373 primary data records. [2025-09-14T20:54:29.800006] [DEBUG] [MAIN ] GRX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:29.816503] [INFO ] [MAIN ] GRX: Generated 1352 derivative records from 3275 primary records. [2025-09-14T20:54:29.816689] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-14T20:54:29.994837] [DEBUG] [LOCAL ] GRX: Derivative data saved (1352 records). [2025-09-14T20:54:29.996134] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-14T20:54:29.999802] [INFO ] [MAIN ] Derivative Progress: 919/2226 symbols completed. GRX took 1.1s. Estimated remaining: 7m 42s. Rate: 169.8 symbols/min [2025-09-14T20:54:30.000891] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:30.018042] [DEBUG] [MAIN ] GS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:30.019406] [INFO ] [MAIN ] GS: Generated 1352 derivative records from 39082 primary records. [2025-09-14T20:54:30.019727] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-14T20:54:30.037340] [DEBUG] [LOCAL ] GS: Derivative data saved (1352 records). [2025-09-14T20:54:30.048976] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-14T20:54:30.051243] [INFO ] [MAIN ] Derivative Progress: 920/2226 symbols completed. GS took 1.0s. Estimated remaining: 7m 41s. Rate: 170.0 symbols/min [2025-09-14T20:54:30.051970] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:30.052387] [DEBUG] [MAIN ] GSBD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:30.053975] [INFO ] [MAIN ] GSBD: Generated 1352 derivative records from 28373 primary records. [2025-09-14T20:54:30.054182] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-14T20:54:30.079488] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1352 records). [2025-09-14T20:54:30.079952] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-14T20:54:30.082559] [INFO ] [MAIN ] Derivative Progress: 921/2226 symbols completed. GSBD took 1.0s. Estimated remaining: 7m 40s. Rate: 170.1 symbols/min [2025-09-14T20:54:30.083209] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:30.105364] [DEBUG] [LOCAL ] GSK: Loaded 40276 existing records from primary storage. [2025-09-14T20:54:30.105836] [INFO ] [MAIN ] GSK: Loaded 40276 primary data records. [2025-09-14T20:54:30.231597] [DEBUG] [LOCAL ] GSL: Loaded 24791 existing records from primary storage. [2025-09-14T20:54:30.287991] [INFO ] [MAIN ] GSL: Loaded 24791 primary data records. [2025-09-14T20:54:30.523543] [DEBUG] [LOCAL ] GTES: Loaded 37744 existing records from primary storage. [2025-09-14T20:54:30.547324] [INFO ] [MAIN ] GTES: Loaded 37744 primary data records. [2025-09-14T20:54:31.029434] [DEBUG] [MAIN ] GSK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:31.031077] [INFO ] [MAIN ] GSK: Generated 1352 derivative records from 40276 primary records. [2025-09-14T20:54:31.031709] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-14T20:54:31.058983] [DEBUG] [LOCAL ] GSK: Derivative data saved (1352 records). [2025-09-14T20:54:31.059864] [DEBUG] [MAIN ] GSL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:31.059969] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-14T20:54:31.061237] [INFO ] [MAIN ] GSL: Generated 1352 derivative records from 24791 primary records. [2025-09-14T20:54:31.063608] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-14T20:54:31.063460] [INFO ] [MAIN ] Derivative Progress: 922/2226 symbols completed. GSK took 1.1s. Estimated remaining: 7m 41s. Rate: 169.8 symbols/min [2025-09-14T20:54:31.064980] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:31.077875] [DEBUG] [LOCAL ] GSL: Derivative data saved (1352 records). [2025-09-14T20:54:31.079763] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-14T20:54:31.082897] [INFO ] [MAIN ] Derivative Progress: 923/2226 symbols completed. GSL took 1.0s. Estimated remaining: 7m 40s. Rate: 170.0 symbols/min [2025-09-14T20:54:31.083413] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:31.095340] [DEBUG] [MAIN ] GTES: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:31.100535] [INFO ] [MAIN ] GTES: Generated 1352 derivative records from 37744 primary records. [2025-09-14T20:54:31.100927] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-14T20:54:31.123150] [DEBUG] [LOCAL ] GTES: Derivative data saved (1352 records). [2025-09-14T20:54:31.123438] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-14T20:54:31.125725] [INFO ] [MAIN ] Derivative Progress: 924/2226 symbols completed. GTES took 1.0s. Estimated remaining: 7m 39s. Rate: 170.1 symbols/min [2025-09-14T20:54:31.126307] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:31.150111] [DEBUG] [LOCAL ] GTLS: Loaded 32460 existing records from primary storage. [2025-09-14T20:54:31.156227] [INFO ] [MAIN ] GTLS: Loaded 32460 primary data records. [2025-09-14T20:54:31.280395] [DEBUG] [LOCAL ] GTY: Loaded 22048 existing records from primary storage. [2025-09-14T20:54:31.281062] [INFO ] [MAIN ] GTY: Loaded 22048 primary data records. [2025-09-14T20:54:31.281825] [DEBUG] [LOCAL ] GTN: Loaded 33979 existing records from primary storage. [2025-09-14T20:54:31.302636] [INFO ] [MAIN ] GTN: Loaded 33979 primary data records. [2025-09-14T20:54:32.090706] [DEBUG] [MAIN ] GTLS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:32.092444] [INFO ] [MAIN ] GTLS: Generated 1352 derivative records from 32460 primary records. [2025-09-14T20:54:32.092957] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-14T20:54:32.108396] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1352 records). [2025-09-14T20:54:32.111140] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-14T20:54:32.114793] [INFO ] [MAIN ] Derivative Progress: 925/2226 symbols completed. GTLS took 1.0s. Estimated remaining: 7m 40s. Rate: 169.8 symbols/min [2025-09-14T20:54:32.115915] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:32.136260] [DEBUG] [MAIN ] GTY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:32.138094] [INFO ] [MAIN ] GTY: Generated 1352 derivative records from 22048 primary records. [2025-09-14T20:54:32.136865] [DEBUG] [MAIN ] GTN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:32.138314] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-14T20:54:32.140042] [INFO ] [MAIN ] GTN: Generated 1352 derivative records from 33979 primary records. [2025-09-14T20:54:32.140378] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-14T20:54:32.165240] [DEBUG] [LOCAL ] GTY: Derivative data saved (1352 records). [2025-09-14T20:54:32.172480] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-14T20:54:32.172035] [DEBUG] [LOCAL ] GUG: Loaded 9060 existing records from primary storage. [2025-09-14T20:54:32.173907] [DEBUG] [LOCAL ] GTN: Derivative data saved (1352 records). [2025-09-14T20:54:32.175864] [INFO ] [MAIN ] Derivative Progress: 926/2226 symbols completed. GTY took 1.0s. Estimated remaining: 7m 39s. Rate: 170.0 symbols/min [2025-09-14T20:54:32.175995] [INFO ] [MAIN ] GUG: Loaded 9060 primary data records. [2025-09-14T20:54:32.176143] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-14T20:54:32.179246] [INFO ] [MAIN ] Derivative Progress: 927/2226 symbols completed. GTN took 1.1s. Estimated remaining: 7m 38s. Rate: 170.1 symbols/min [2025-09-14T20:54:32.184774] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:32.179326] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:32.350599] [DEBUG] [LOCAL ] GUT: Loaded 11603 existing records from primary storage. [2025-09-14T20:54:32.383618] [INFO ] [MAIN ] GUT: Loaded 11603 primary data records. [2025-09-14T20:54:32.532712] [DEBUG] [LOCAL ] GVA: Loaded 24401 existing records from primary storage. [2025-09-14T20:54:32.562477] [INFO ] [MAIN ] GVA: Loaded 24401 primary data records. [2025-09-14T20:54:33.064198] [DEBUG] [MAIN ] GUG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:33.066011] [INFO ] [MAIN ] GUG: Generated 1352 derivative records from 9060 primary records. [2025-09-14T20:54:33.066989] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-14T20:54:33.082960] [DEBUG] [LOCAL ] GUG: Derivative data saved (1352 records). [2025-09-14T20:54:33.083059] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-14T20:54:33.085117] [INFO ] [MAIN ] Derivative Progress: 928/2226 symbols completed. GUG took 1.0s. Estimated remaining: 7m 39s. Rate: 169.8 symbols/min [2025-09-14T20:54:33.098776] [DEBUG] [MAIN ] GUT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:33.099539] [INFO ] [MAIN ] GUT: Generated 1352 derivative records from 11603 primary records. [2025-09-14T20:54:33.099958] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-14T20:54:33.114631] [DEBUG] [LOCAL ] GUT: Derivative data saved (1352 records). [2025-09-14T20:54:33.124329] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-14T20:54:33.124877] [DEBUG] [MAIN ] GVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:33.127332] [INFO ] [MAIN ] Derivative Progress: 929/2226 symbols completed. GUT took 1.0s. Estimated remaining: 7m 38s. Rate: 170.0 symbols/min [2025-09-14T20:54:33.128188] [INFO ] [MAIN ] GVA: Generated 1352 derivative records from 24401 primary records. [2025-09-14T20:54:33.128466] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-14T20:54:33.140836] [DEBUG] [LOCAL ] GVA: Derivative data saved (1352 records). [2025-09-14T20:54:33.140913] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-14T20:54:33.142919] [INFO ] [MAIN ] Derivative Progress: 930/2226 symbols completed. GVA took 1.0s. Estimated remaining: 7m 37s. Rate: 170.2 symbols/min [2025-09-14T20:54:33.143432] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:33.143635] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:33.143737] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:33.159169] [DEBUG] [LOCAL ] GWH: Loaded 12881 existing records from primary storage. [2025-09-14T20:54:33.159513] [INFO ] [MAIN ] GWH: Loaded 12881 primary data records. [2025-09-14T20:54:33.239926] [DEBUG] [LOCAL ] GWW: Loaded 14121 existing records from primary storage. [2025-09-14T20:54:33.280698] [INFO ] [MAIN ] GWW: Loaded 14121 primary data records. [2025-09-14T20:54:33.440063] [DEBUG] [LOCAL ] GWRE: Loaded 30251 existing records from primary storage. [2025-09-14T20:54:33.479922] [INFO ] [MAIN ] GWRE: Loaded 30251 primary data records. [2025-09-14T20:54:34.145365] [DEBUG] [MAIN ] GWH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:34.147407] [INFO ] [MAIN ] GWH: Generated 1352 derivative records from 12881 primary records. [2025-09-14T20:54:34.147729] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-14T20:54:34.171709] [DEBUG] [MAIN ] GWW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:34.173106] [INFO ] [MAIN ] GWW: Generated 1352 derivative records from 14121 primary records. [2025-09-14T20:54:34.174941] [DEBUG] [LOCAL ] GWH: Derivative data saved (1352 records). [2025-09-14T20:54:34.175036] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-14T20:54:34.175582] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-14T20:54:34.178946] [INFO ] [MAIN ] Derivative Progress: 931/2226 symbols completed. GWH took 1.0s. Estimated remaining: 7m 38s. Rate: 169.8 symbols/min [2025-09-14T20:54:34.189136] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:34.205506] [DEBUG] [MAIN ] GWRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:34.205055] [DEBUG] [LOCAL ] GWW: Derivative data saved (1352 records). [2025-09-14T20:54:34.206571] [INFO ] [MAIN ] GWRE: Generated 1352 derivative records from 30251 primary records. [2025-09-14T20:54:34.206828] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-14T20:54:34.206915] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-14T20:54:34.209318] [INFO ] [MAIN ] Derivative Progress: 932/2226 symbols completed. GWW took 1.1s. Estimated remaining: 7m 37s. Rate: 170.0 symbols/min [2025-09-14T20:54:34.210672] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:34.225384] [DEBUG] [LOCAL ] GYLD: Loaded 1127 existing records from primary storage. [2025-09-14T20:54:34.226582] [INFO ] [MAIN ] GYLD: Loaded 1127 primary data records. [2025-09-14T20:54:34.237895] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1352 records). [2025-09-14T20:54:34.243477] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-14T20:54:34.263117] [INFO ] [MAIN ] Derivative Progress: 933/2226 symbols completed. GWRE took 1.1s. Estimated remaining: 7m 36s. Rate: 170.2 symbols/min [2025-09-14T20:54:34.323514] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:34.338405] [DEBUG] [LOCAL ] GXO: Loaded 34988 existing records from primary storage. [2025-09-14T20:54:34.367392] [INFO ] [MAIN ] GXO: Loaded 34988 primary data records. [2025-09-14T20:54:34.826182] [DEBUG] [LOCAL ] H: Loaded 33612 existing records from primary storage. [2025-09-14T20:54:34.827219] [INFO ] [MAIN ] H: Loaded 33612 primary data records. [2025-09-14T20:54:35.137478] [DEBUG] [MAIN ] GYLD: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:54:35.141969] [INFO ] [MAIN ] GYLD: Generated 1351 derivative records from 1127 primary records. [2025-09-14T20:54:35.143440] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-14T20:54:35.162189] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1351 records). [2025-09-14T20:54:35.166670] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-14T20:54:35.166966] [DEBUG] [MAIN ] GXO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:35.169528] [INFO ] [MAIN ] Derivative Progress: 934/2226 symbols completed. GYLD took 1.0s. Estimated remaining: 7m 36s. Rate: 169.9 symbols/min [2025-09-14T20:54:35.171093] [INFO ] [MAIN ] GXO: Generated 1352 derivative records from 34988 primary records. [2025-09-14T20:54:35.171827] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:35.172210] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-14T20:54:35.187986] [DEBUG] [LOCAL ] GXO: Derivative data saved (1352 records). [2025-09-14T20:54:35.189880] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-14T20:54:35.192719] [INFO ] [MAIN ] Derivative Progress: 935/2226 symbols completed. GXO took 1.0s. Estimated remaining: 7m 36s. Rate: 170.0 symbols/min [2025-09-14T20:54:35.193018] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:35.212420] [DEBUG] [MAIN ] H: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:35.213228] [INFO ] [MAIN ] H: Generated 1352 derivative records from 33612 primary records. [2025-09-14T20:54:35.213464] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-14T20:54:35.235535] [DEBUG] [LOCAL ] H: Derivative data saved (1352 records). [2025-09-14T20:54:35.236879] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-14T20:54:35.239030] [INFO ] [MAIN ] Derivative Progress: 936/2226 symbols completed. H took 0.9s. Estimated remaining: 7m 35s. Rate: 170.2 symbols/min [2025-09-14T20:54:35.239548] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:35.240896] [DEBUG] [LOCAL ] HAE: Loaded 28379 existing records from primary storage. [2025-09-14T20:54:35.249201] [INFO ] [MAIN ] HAE: Loaded 28379 primary data records. [2025-09-14T20:54:35.369528] [DEBUG] [LOCAL ] HAFN: Loaded 32231 existing records from primary storage. [2025-09-14T20:54:35.381026] [INFO ] [MAIN ] HAFN: Loaded 32231 primary data records. [2025-09-14T20:54:35.642307] [DEBUG] [LOCAL ] HAL: Loaded 40458 existing records from primary storage. [2025-09-14T20:54:35.666090] [INFO ] [MAIN ] HAL: Loaded 40458 primary data records. [2025-09-14T20:54:36.247374] [DEBUG] [MAIN ] HAE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:36.249147] [INFO ] [MAIN ] HAE: Generated 1352 derivative records from 28379 primary records. [2025-09-14T20:54:36.249758] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-14T20:54:36.269784] [DEBUG] [LOCAL ] HAE: Derivative data saved (1352 records). [2025-09-14T20:54:36.282009] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-14T20:54:36.282972] [DEBUG] [MAIN ] HAFN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:36.283948] [INFO ] [MAIN ] HAFN: Generated 1352 derivative records from 32231 primary records. [2025-09-14T20:54:36.286387] [INFO ] [MAIN ] Derivative Progress: 937/2226 symbols completed. HAE took 1.1s. Estimated remaining: 7m 35s. Rate: 169.8 symbols/min [2025-09-14T20:54:36.287041] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:36.287104] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-14T20:54:36.309220] [DEBUG] [MAIN ] HAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:36.314016] [INFO ] [MAIN ] HAL: Generated 1352 derivative records from 40458 primary records. [2025-09-14T20:54:36.317453] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1352 records). [2025-09-14T20:54:36.317785] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-14T20:54:36.318247] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-14T20:54:36.322959] [INFO ] [MAIN ] Derivative Progress: 938/2226 symbols completed. HAFN took 1.1s. Estimated remaining: 7m 35s. Rate: 170.0 symbols/min [2025-09-14T20:54:36.323714] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:36.337495] [DEBUG] [LOCAL ] HAL: Derivative data saved (1352 records). [2025-09-14T20:54:36.337697] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-14T20:54:36.339863] [INFO ] [MAIN ] Derivative Progress: 939/2226 symbols completed. HAL took 1.1s. Estimated remaining: 7m 34s. Rate: 170.2 symbols/min [2025-09-14T20:54:36.340471] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:36.357158] [DEBUG] [LOCAL ] HBB: Loaded 4952 existing records from primary storage. [2025-09-14T20:54:36.357411] [INFO ] [MAIN ] HBB: Loaded 4952 primary data records. [2025-09-14T20:54:36.500678] [DEBUG] [LOCAL ] HASI: Loaded 35913 existing records from primary storage. [2025-09-14T20:54:36.518245] [INFO ] [MAIN ] HASI: Loaded 35913 primary data records. [2025-09-14T20:54:36.729995] [DEBUG] [LOCAL ] HAYW: Loaded 36396 existing records from primary storage. [2025-09-14T20:54:36.778568] [INFO ] [MAIN ] HAYW: Loaded 36396 primary data records. [2025-09-14T20:54:37.326064] [DEBUG] [MAIN ] HBB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:37.327496] [INFO ] [MAIN ] HBB: Generated 1352 derivative records from 4952 primary records. [2025-09-14T20:54:37.327732] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-14T20:54:37.343075] [DEBUG] [LOCAL ] HBB: Derivative data saved (1352 records). [2025-09-14T20:54:37.344227] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-14T20:54:37.346999] [INFO ] [MAIN ] Derivative Progress: 940/2226 symbols completed. HBB took 1.0s. Estimated remaining: 7m 34s. Rate: 169.8 symbols/min [2025-09-14T20:54:37.349437] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:37.379155] [DEBUG] [MAIN ] HASI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:37.380021] [DEBUG] [MAIN ] HAYW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:37.381278] [INFO ] [MAIN ] HASI: Generated 1352 derivative records from 35913 primary records. [2025-09-14T20:54:37.381559] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-14T20:54:37.382533] [INFO ] [MAIN ] HAYW: Generated 1352 derivative records from 36396 primary records. [2025-09-14T20:54:37.383682] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-14T20:54:37.407452] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1352 records). [2025-09-14T20:54:37.419988] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-14T20:54:37.422468] [INFO ] [MAIN ] Derivative Progress: 941/2226 symbols completed. HAYW took 1.1s. Estimated remaining: 7m 34s. Rate: 170.0 symbols/min [2025-09-14T20:54:37.423774] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:37.425781] [DEBUG] [LOCAL ] HASI: Derivative data saved (1352 records). [2025-09-14T20:54:37.426191] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-14T20:54:37.429919] [INFO ] [MAIN ] Derivative Progress: 942/2226 symbols completed. HASI took 1.1s. Estimated remaining: 7m 33s. Rate: 170.2 symbols/min [2025-09-14T20:54:37.430931] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:37.449896] [DEBUG] [LOCAL ] HBI: Loaded 39850 existing records from primary storage. [2025-09-14T20:54:37.450487] [INFO ] [MAIN ] HBI: Loaded 39850 primary data records. [2025-09-14T20:54:37.790618] [DEBUG] [LOCAL ] HBM: Loaded 39770 existing records from primary storage. [2025-09-14T20:54:37.788925] [DEBUG] [LOCAL ] HCA: Loaded 35505 existing records from primary storage. [2025-09-14T20:54:37.791371] [INFO ] [MAIN ] HCA: Loaded 35505 primary data records. [2025-09-14T20:54:37.791231] [INFO ] [MAIN ] HBM: Loaded 39770 primary data records. [2025-09-14T20:54:38.371772] [DEBUG] [MAIN ] HBI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:38.373353] [INFO ] [MAIN ] HBI: Generated 1352 derivative records from 39850 primary records. [2025-09-14T20:54:38.373540] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-14T20:54:38.390200] [DEBUG] [LOCAL ] HBI: Derivative data saved (1352 records). [2025-09-14T20:54:38.392391] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-14T20:54:38.395911] [INFO ] [MAIN ] Derivative Progress: 943/2226 symbols completed. HBI took 1.0s. Estimated remaining: 7m 33s. Rate: 169.8 symbols/min [2025-09-14T20:54:38.407904] [DEBUG] [MAIN ] HBM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:38.409507] [INFO ] [MAIN ] HBM: Generated 1352 derivative records from 39770 primary records. [2025-09-14T20:54:38.410627] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-14T20:54:38.431249] [DEBUG] [MAIN ] HCA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:38.435660] [DEBUG] [LOCAL ] HBM: Derivative data saved (1352 records). [2025-09-14T20:54:38.436960] [INFO ] [MAIN ] HCA: Generated 1352 derivative records from 35505 primary records. [2025-09-14T20:54:38.437168] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-14T20:54:38.437355] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-14T20:54:38.439344] [INFO ] [MAIN ] Derivative Progress: 944/2226 symbols completed. HBM took 1.0s. Estimated remaining: 7m 32s. Rate: 170.0 symbols/min [2025-09-14T20:54:38.453076] [DEBUG] [LOCAL ] HCA: Derivative data saved (1352 records). [2025-09-14T20:54:38.453278] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-14T20:54:38.455227] [INFO ] [MAIN ] Derivative Progress: 945/2226 symbols completed. HCA took 1.0s. Estimated remaining: 7m 32s. Rate: 170.2 symbols/min [2025-09-14T20:54:38.455920] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:38.456384] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:38.456491] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:38.472532] [DEBUG] [LOCAL ] HCI: Loaded 10468 existing records from primary storage. [2025-09-14T20:54:38.473062] [INFO ] [MAIN ] HCI: Loaded 10468 primary data records. [2025-09-14T20:54:38.719499] [DEBUG] [LOCAL ] HCC: Loaded 34006 existing records from primary storage. [2025-09-14T20:54:38.851720] [DEBUG] [LOCAL ] HD: Loaded 40285 existing records from primary storage. [2025-09-14T20:54:38.850282] [INFO ] [MAIN ] HCC: Loaded 34006 primary data records. [2025-09-14T20:54:38.851915] [INFO ] [MAIN ] HD: Loaded 40285 primary data records. [2025-09-14T20:54:39.440870] [DEBUG] [MAIN ] HCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:39.442975] [INFO ] [MAIN ] HCI: Generated 1352 derivative records from 10468 primary records. [2025-09-14T20:54:39.443393] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-14T20:54:39.460145] [DEBUG] [LOCAL ] HCI: Derivative data saved (1352 records). [2025-09-14T20:54:39.460980] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-14T20:54:39.463594] [INFO ] [MAIN ] Derivative Progress: 946/2226 symbols completed. HCI took 1.0s. Estimated remaining: 7m 32s. Rate: 169.8 symbols/min [2025-09-14T20:54:39.464401] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:39.489830] [DEBUG] [MAIN ] HD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:39.489989] [DEBUG] [MAIN ] HCC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:39.491502] [INFO ] [MAIN ] HD: Generated 1352 derivative records from 40285 primary records. [2025-09-14T20:54:39.492554] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-14T20:54:39.492447] [INFO ] [MAIN ] HCC: Generated 1352 derivative records from 34006 primary records. [2025-09-14T20:54:39.493006] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-14T20:54:39.516679] [DEBUG] [LOCAL ] HD: Derivative data saved (1352 records). [2025-09-14T20:54:39.518013] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-14T20:54:39.518056] [DEBUG] [LOCAL ] HCC: Derivative data saved (1352 records). [2025-09-14T20:54:39.520024] [INFO ] [MAIN ] Derivative Progress: 947/2226 symbols completed. HD took 1.1s. Estimated remaining: 7m 31s. Rate: 170.0 symbols/min [2025-09-14T20:54:39.520176] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-14T20:54:39.522381] [INFO ] [MAIN ] Derivative Progress: 948/2226 symbols completed. HCC took 1.1s. Estimated remaining: 7m 31s. Rate: 170.2 symbols/min [2025-09-14T20:54:39.520339] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:39.522700] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:39.568894] [DEBUG] [LOCAL ] HDB: Loaded 38803 existing records from primary storage. [2025-09-14T20:54:39.569328] [INFO ] [MAIN ] HDB: Loaded 38803 primary data records. [2025-09-14T20:54:39.684614] [DEBUG] [LOCAL ] HEI: Loaded 23960 existing records from primary storage. [2025-09-14T20:54:39.706962] [INFO ] [MAIN ] HEI: Loaded 23960 primary data records. [2025-09-14T20:54:39.735330] [DEBUG] [LOCAL ] HE: Loaded 36684 existing records from primary storage. [2025-09-14T20:54:39.858031] [INFO ] [MAIN ] HE: Loaded 36684 primary data records. [2025-09-14T20:54:40.577351] [DEBUG] [MAIN ] HDB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:40.580226] [INFO ] [MAIN ] HDB: Generated 1352 derivative records from 38803 primary records. [2025-09-14T20:54:40.580617] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-14T20:54:40.597073] [DEBUG] [LOCAL ] HDB: Derivative data saved (1352 records). [2025-09-14T20:54:40.597348] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-14T20:54:40.601115] [INFO ] [MAIN ] Derivative Progress: 949/2226 symbols completed. HDB took 1.1s. Estimated remaining: 7m 31s. Rate: 169.8 symbols/min [2025-09-14T20:54:40.603077] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:40.631746] [DEBUG] [LOCAL ] HEQ: Loaded 4247 existing records from primary storage. [2025-09-14T20:54:40.630893] [DEBUG] [MAIN ] HEI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:40.632959] [INFO ] [MAIN ] HEI: Generated 1352 derivative records from 23960 primary records. [2025-09-14T20:54:40.638478] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-14T20:54:40.633050] [INFO ] [MAIN ] HEQ: Loaded 4247 primary data records. [2025-09-14T20:54:40.650603] [DEBUG] [MAIN ] HE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:40.700432] [INFO ] [MAIN ] HE: Generated 1352 derivative records from 36684 primary records. [2025-09-14T20:54:40.716095] [DEBUG] [LOCAL ] HEI: Derivative data saved (1352 records). [2025-09-14T20:54:40.748548] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-14T20:54:40.749002] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-14T20:54:40.805007] [INFO ] [MAIN ] Derivative Progress: 950/2226 symbols completed. HEI took 1.3s. Estimated remaining: 7m 31s. Rate: 169.9 symbols/min [2025-09-14T20:54:40.825248] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:40.832872] [DEBUG] [LOCAL ] HE: Derivative data saved (1352 records). [2025-09-14T20:54:40.850180] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-14T20:54:40.882491] [INFO ] [MAIN ] Derivative Progress: 951/2226 symbols completed. HE took 1.4s. Estimated remaining: 7m 30s. Rate: 170.0 symbols/min [2025-09-14T20:54:40.917735] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:41.043698] [DEBUG] [LOCAL ] HFRO: Loaded 12029 existing records from primary storage. [2025-09-14T20:54:41.045671] [INFO ] [MAIN ] HFRO: Loaded 12029 primary data records. [2025-09-14T20:54:41.148687] [DEBUG] [LOCAL ] HESM: Loaded 36270 existing records from primary storage. [2025-09-14T20:54:41.174934] [INFO ] [MAIN ] HESM: Loaded 36270 primary data records. [2025-09-14T20:54:41.553908] [DEBUG] [MAIN ] HEQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:41.566566] [INFO ] [MAIN ] HEQ: Generated 1352 derivative records from 4247 primary records. [2025-09-14T20:54:41.587523] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-14T20:54:41.744889] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1352 records). [2025-09-14T20:54:41.758753] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-14T20:54:41.761017] [INFO ] [MAIN ] Derivative Progress: 952/2226 symbols completed. HEQ took 1.2s. Estimated remaining: 7m 30s. Rate: 169.7 symbols/min [2025-09-14T20:54:41.762585] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:41.791306] [DEBUG] [LOCAL ] HGER: Loaded 10025 existing records from primary storage. [2025-09-14T20:54:41.791596] [DEBUG] [MAIN ] HFRO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:41.792042] [INFO ] [MAIN ] HGER: Loaded 10025 primary data records. [2025-09-14T20:54:41.793756] [INFO ] [MAIN ] HFRO: Generated 1352 derivative records from 12029 primary records. [2025-09-14T20:54:41.838179] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-14T20:54:41.933916] [DEBUG] [MAIN ] HESM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:41.950503] [INFO ] [MAIN ] HESM: Generated 1352 derivative records from 36270 primary records. [2025-09-14T20:54:41.949164] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1352 records). [2025-09-14T20:54:42.006196] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-14T20:54:42.009963] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-14T20:54:42.099573] [INFO ] [MAIN ] Derivative Progress: 953/2226 symbols completed. HFRO took 1.2s. Estimated remaining: 7m 30s. Rate: 169.8 symbols/min [2025-09-14T20:54:42.100879] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:42.119633] [DEBUG] [LOCAL ] HESM: Derivative data saved (1352 records). [2025-09-14T20:54:42.121554] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-14T20:54:42.124195] [INFO ] [MAIN ] Derivative Progress: 954/2226 symbols completed. HESM took 1.3s. Estimated remaining: 7m 29s. Rate: 169.9 symbols/min [2025-09-14T20:54:42.125098] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:42.129651] [DEBUG] [LOCAL ] HGLB: Loaded 6627 existing records from primary storage. [2025-09-14T20:54:42.130958] [INFO ] [MAIN ] HGLB: Loaded 6627 primary data records. [2025-09-14T20:54:42.241945] [DEBUG] [LOCAL ] HGTY: Loaded 9766 existing records from primary storage. [2025-09-14T20:54:42.253045] [INFO ] [MAIN ] HGTY: Loaded 9766 primary data records. [2025-09-14T20:54:42.545137] [DEBUG] [MAIN ] HGER: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:42.565831] [INFO ] [MAIN ] HGER: Generated 1352 derivative records from 10025 primary records. [2025-09-14T20:54:42.583135] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-14T20:54:42.750609] [DEBUG] [LOCAL ] HGER: Derivative data saved (1352 records). [2025-09-14T20:54:42.752673] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-14T20:54:42.755603] [INFO ] [MAIN ] Derivative Progress: 955/2226 symbols completed. HGER took 1.0s. Estimated remaining: 7m 29s. Rate: 169.8 symbols/min [2025-09-14T20:54:42.756539] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:42.777278] [DEBUG] [MAIN ] HGLB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:42.778780] [INFO ] [MAIN ] HGLB: Generated 1352 derivative records from 6627 primary records. [2025-09-14T20:54:42.779006] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-14T20:54:42.815810] [DEBUG] [MAIN ] HGTY: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:54:42.829854] [INFO ] [MAIN ] HGTY: Generated 1351 derivative records from 9766 primary records. [2025-09-14T20:54:42.828869] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1352 records). [2025-09-14T20:54:42.830161] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-14T20:54:42.830311] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-14T20:54:42.833735] [DEBUG] [LOCAL ] HGV: Loaded 35452 existing records from primary storage. [2025-09-14T20:54:42.843152] [INFO ] [MAIN ] Derivative Progress: 956/2226 symbols completed. HGLB took 0.7s. Estimated remaining: 7m 28s. Rate: 169.9 symbols/min [2025-09-14T20:54:42.846797] [INFO ] [MAIN ] HGV: Loaded 35452 primary data records. [2025-09-14T20:54:42.847256] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:42.921275] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1351 records). [2025-09-14T20:54:42.954767] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-14T20:54:42.956989] [INFO ] [MAIN ] Derivative Progress: 957/2226 symbols completed. HGTY took 0.8s. Estimated remaining: 7m 28s. Rate: 170.0 symbols/min [2025-09-14T20:54:42.962962] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:43.144391] [DEBUG] [LOCAL ] HHH: Loaded 25705 existing records from primary storage. [2025-09-14T20:54:43.144700] [INFO ] [MAIN ] HHH: Loaded 25705 primary data records. [2025-09-14T20:54:43.359075] [DEBUG] [LOCAL ] HI: Loaded 26236 existing records from primary storage. [2025-09-14T20:54:43.448192] [INFO ] [MAIN ] HI: Loaded 26236 primary data records. [2025-09-14T20:54:43.780697] [DEBUG] [MAIN ] HGV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:43.787859] [INFO ] [MAIN ] HGV: Generated 1352 derivative records from 35452 primary records. [2025-09-14T20:54:43.788347] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-14T20:54:43.803687] [DEBUG] [LOCAL ] HGV: Derivative data saved (1352 records). [2025-09-14T20:54:43.806923] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-14T20:54:43.809220] [INFO ] [MAIN ] Derivative Progress: 958/2226 symbols completed. HGV took 1.1s. Estimated remaining: 7m 28s. Rate: 169.8 symbols/min [2025-09-14T20:54:43.820107] [DEBUG] [MAIN ] HHH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:43.821338] [INFO ] [MAIN ] HHH: Generated 1352 derivative records from 25705 primary records. [2025-09-14T20:54:43.821529] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-14T20:54:43.834211] [DEBUG] [LOCAL ] HHH: Derivative data saved (1352 records). [2025-09-14T20:54:43.834429] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-14T20:54:43.837236] [INFO ] [MAIN ] Derivative Progress: 959/2226 symbols completed. HHH took 1.0s. Estimated remaining: 7m 27s. Rate: 169.9 symbols/min [2025-09-14T20:54:43.849913] [DEBUG] [MAIN ] HI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:43.850600] [INFO ] [MAIN ] HI: Generated 1352 derivative records from 26236 primary records. [2025-09-14T20:54:43.850697] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-14T20:54:43.862587] [DEBUG] [LOCAL ] HI: Derivative data saved (1352 records). [2025-09-14T20:54:43.862699] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-14T20:54:43.864717] [INFO ] [MAIN ] Derivative Progress: 960/2226 symbols completed. HI took 0.9s. Estimated remaining: 7m 27s. Rate: 170.1 symbols/min [2025-09-14T20:54:43.865486] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:43.865873] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:43.865794] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:43.895214] [DEBUG] [LOCAL ] HII: Loaded 24776 existing records from primary storage. [2025-09-14T20:54:43.895390] [INFO ] [MAIN ] HII: Loaded 24776 primary data records. [2025-09-14T20:54:44.060984] [DEBUG] [LOCAL ] HIMS: Loaded 40557 existing records from primary storage. [2025-09-14T20:54:44.094170] [INFO ] [MAIN ] HIMS: Loaded 40557 primary data records. [2025-09-14T20:54:44.238188] [DEBUG] [LOCAL ] HIG: Loaded 38704 existing records from primary storage. [2025-09-14T20:54:44.262327] [INFO ] [MAIN ] HIG: Loaded 38704 primary data records. [2025-09-14T20:54:44.815889] [DEBUG] [MAIN ] HII: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:44.817191] [INFO ] [MAIN ] HII: Generated 1352 derivative records from 24776 primary records. [2025-09-14T20:54:44.818888] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-14T20:54:44.839198] [DEBUG] [LOCAL ] HII: Derivative data saved (1352 records). [2025-09-14T20:54:44.840379] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-14T20:54:44.845103] [INFO ] [MAIN ] Derivative Progress: 961/2226 symbols completed. HII took 1.0s. Estimated remaining: 7m 27s. Rate: 169.8 symbols/min [2025-09-14T20:54:44.846715] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:44.859112] [DEBUG] [MAIN ] HIMS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:44.860526] [INFO ] [MAIN ] HIMS: Generated 1352 derivative records from 40557 primary records. [2025-09-14T20:54:44.860864] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-14T20:54:44.896606] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1352 records). [2025-09-14T20:54:44.897286] [DEBUG] [LOCAL ] HIO: Loaded 16072 existing records from primary storage. [2025-09-14T20:54:44.897668] [DEBUG] [MAIN ] HIG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:44.898635] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-14T20:54:44.898766] [INFO ] [MAIN ] HIO: Loaded 16072 primary data records. [2025-09-14T20:54:44.898565] [INFO ] [MAIN ] HIG: Generated 1352 derivative records from 38704 primary records. [2025-09-14T20:54:44.901020] [INFO ] [MAIN ] Derivative Progress: 962/2226 symbols completed. HIMS took 1.0s. Estimated remaining: 7m 26s. Rate: 169.9 symbols/min [2025-09-14T20:54:44.932861] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-14T20:54:44.945284] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:45.102224] [DEBUG] [LOCAL ] HIG: Derivative data saved (1352 records). [2025-09-14T20:54:45.195990] [DEBUG] [LOCAL ] HIPO: Loaded 16864 existing records from primary storage. [2025-09-14T20:54:45.201611] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-14T20:54:45.202270] [INFO ] [MAIN ] HIPO: Loaded 16864 primary data records. [2025-09-14T20:54:45.204818] [INFO ] [MAIN ] Derivative Progress: 963/2226 symbols completed. HIG took 1.3s. Estimated remaining: 7m 26s. Rate: 170.0 symbols/min [2025-09-14T20:54:45.247944] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:45.518612] [DEBUG] [MAIN ] HIO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:45.520294] [INFO ] [MAIN ] HIO: Generated 1352 derivative records from 16072 primary records. [2025-09-14T20:54:45.530471] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-14T20:54:45.533146] [DEBUG] [LOCAL ] HIW: Loaded 33336 existing records from primary storage. [2025-09-14T20:54:45.533788] [INFO ] [MAIN ] HIW: Loaded 33336 primary data records. [2025-09-14T20:54:45.630718] [DEBUG] [LOCAL ] HIO: Derivative data saved (1352 records). [2025-09-14T20:54:45.648172] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-14T20:54:45.662368] [INFO ] [MAIN ] Derivative Progress: 964/2226 symbols completed. HIO took 0.8s. Estimated remaining: 7m 26s. Rate: 169.9 symbols/min [2025-09-14T20:54:45.668367] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:45.860031] [DEBUG] [MAIN ] HIPO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:45.861824] [INFO ] [MAIN ] HIPO: Generated 1352 derivative records from 16864 primary records. [2025-09-14T20:54:45.862052] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-14T20:54:45.869684] [DEBUG] [LOCAL ] HIX: Loaded 15096 existing records from primary storage. [2025-09-14T20:54:45.870152] [INFO ] [MAIN ] HIX: Loaded 15096 primary data records. [2025-09-14T20:54:45.928759] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1352 records). [2025-09-14T20:54:45.973867] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-14T20:54:45.996751] [INFO ] [MAIN ] Derivative Progress: 965/2226 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 25s. Rate: 169.9 symbols/min [2025-09-14T20:54:45.997256] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:46.257953] [DEBUG] [LOCAL ] HKD: Loaded 13529 existing records from primary storage. [2025-09-14T20:54:46.256889] [DEBUG] [MAIN ] HIW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:46.259020] [INFO ] [MAIN ] HIW: Generated 1352 derivative records from 33336 primary records. [2025-09-14T20:54:46.259586] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-14T20:54:46.259083] [INFO ] [MAIN ] HKD: Loaded 13529 primary data records. [2025-09-14T20:54:46.410344] [DEBUG] [LOCAL ] HIW: Derivative data saved (1352 records). [2025-09-14T20:54:46.437488] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-14T20:54:46.490336] [INFO ] [MAIN ] Derivative Progress: 966/2226 symbols completed. HIW took 1.2s. Estimated remaining: 7m 25s. Rate: 169.9 symbols/min [2025-09-14T20:54:46.491038] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:46.660994] [DEBUG] [MAIN ] HIX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:46.662319] [INFO ] [MAIN ] HIX: Generated 1352 derivative records from 15096 primary records. [2025-09-14T20:54:46.662501] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-14T20:54:46.682722] [DEBUG] [LOCAL ] HIX: Derivative data saved (1352 records). [2025-09-14T20:54:46.695148] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-14T20:54:46.698609] [INFO ] [MAIN ] Derivative Progress: 967/2226 symbols completed. HIX took 1.0s. Estimated remaining: 7m 25s. Rate: 169.9 symbols/min [2025-09-14T20:54:46.699553] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:46.719624] [DEBUG] [MAIN ] HKD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:46.720480] [INFO ] [MAIN ] HKD: Generated 1352 derivative records from 13529 primary records. [2025-09-14T20:54:46.720566] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-14T20:54:46.752571] [DEBUG] [LOCAL ] HKD: Derivative data saved (1352 records). [2025-09-14T20:54:46.755181] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-14T20:54:46.758696] [INFO ] [MAIN ] Derivative Progress: 968/2226 symbols completed. HKD took 0.8s. Estimated remaining: 7m 24s. Rate: 170.1 symbols/min [2025-09-14T20:54:46.762064] [DEBUG] [LOCAL ] HL: Loaded 40416 existing records from primary storage. [2025-09-14T20:54:46.762824] [INFO ] [MAIN ] HL: Loaded 40416 primary data records. [2025-09-14T20:54:46.762391] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:46.926086] [DEBUG] [LOCAL ] HLF: Loaded 36855 existing records from primary storage. [2025-09-14T20:54:46.954044] [INFO ] [MAIN ] HLF: Loaded 36855 primary data records. [2025-09-14T20:54:47.028319] [DEBUG] [LOCAL ] HLI: Loaded 22943 existing records from primary storage. [2025-09-14T20:54:47.084141] [INFO ] [MAIN ] HLI: Loaded 22943 primary data records. [2025-09-14T20:54:47.874913] [DEBUG] [MAIN ] HL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:47.876551] [INFO ] [MAIN ] HL: Generated 1352 derivative records from 40416 primary records. [2025-09-14T20:54:47.877061] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-14T20:54:47.887683] [DEBUG] [MAIN ] HLF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:47.890155] [INFO ] [MAIN ] HLF: Generated 1352 derivative records from 36855 primary records. [2025-09-14T20:54:47.899272] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-14T20:54:47.917396] [DEBUG] [MAIN ] HLI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:47.921714] [INFO ] [MAIN ] HLI: Generated 1352 derivative records from 22943 primary records. [2025-09-14T20:54:47.923936] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-14T20:54:47.925714] [DEBUG] [LOCAL ] HL: Derivative data saved (1352 records). [2025-09-14T20:54:47.925370] [DEBUG] [LOCAL ] HLF: Derivative data saved (1352 records). [2025-09-14T20:54:47.926465] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-14T20:54:47.926238] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-14T20:54:47.928535] [INFO ] [MAIN ] Derivative Progress: 969/2226 symbols completed. HL took 1.4s. Estimated remaining: 7m 25s. Rate: 169.7 symbols/min [2025-09-14T20:54:47.931744] [INFO ] [MAIN ] Derivative Progress: 970/2226 symbols completed. HLF took 1.2s. Estimated remaining: 7m 24s. Rate: 169.8 symbols/min [2025-09-14T20:54:47.931868] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:47.941462] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:47.949151] [DEBUG] [LOCAL ] HLI: Derivative data saved (1352 records). [2025-09-14T20:54:47.949357] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-14T20:54:47.951888] [INFO ] [MAIN ] Derivative Progress: 971/2226 symbols completed. HLI took 1.2s. Estimated remaining: 7m 23s. Rate: 170.0 symbols/min [2025-09-14T20:54:47.952415] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:47.970998] [DEBUG] [LOCAL ] HLIO: Loaded 22033 existing records from primary storage. [2025-09-14T20:54:47.971312] [INFO ] [MAIN ] HLIO: Loaded 22033 primary data records. [2025-09-14T20:54:48.107004] [DEBUG] [LOCAL ] HLLY: Loaded 24903 existing records from primary storage. [2025-09-14T20:54:48.149571] [INFO ] [MAIN ] HLLY: Loaded 24903 primary data records. [2025-09-14T20:54:48.311115] [DEBUG] [LOCAL ] HLN: Loaded 39960 existing records from primary storage. [2025-09-14T20:54:48.347754] [INFO ] [MAIN ] HLN: Loaded 39960 primary data records. [2025-09-14T20:54:48.911966] [DEBUG] [MAIN ] HLIO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:48.913183] [INFO ] [MAIN ] HLIO: Generated 1352 derivative records from 22033 primary records. [2025-09-14T20:54:48.913407] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-14T20:54:48.929411] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1352 records). [2025-09-14T20:54:48.930250] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-14T20:54:48.933164] [INFO ] [MAIN ] Derivative Progress: 972/2226 symbols completed. HLIO took 1.0s. Estimated remaining: 7m 23s. Rate: 169.7 symbols/min [2025-09-14T20:54:48.933807] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:48.949985] [DEBUG] [MAIN ] HLLY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:48.951808] [INFO ] [MAIN ] HLLY: Generated 1352 derivative records from 24903 primary records. [2025-09-14T20:54:48.952116] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-14T20:54:48.976448] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1352 records). [2025-09-14T20:54:48.976877] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-14T20:54:48.979314] [INFO ] [MAIN ] Derivative Progress: 973/2226 symbols completed. HLLY took 1.0s. Estimated remaining: 7m 23s. Rate: 169.9 symbols/min [2025-09-14T20:54:48.989831] [DEBUG] [MAIN ] HLN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:48.990690] [INFO ] [MAIN ] HLN: Generated 1352 derivative records from 39960 primary records. [2025-09-14T20:54:49.000143] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-14T20:54:49.013013] [DEBUG] [LOCAL ] HLN: Derivative data saved (1352 records). [2025-09-14T20:54:49.013094] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-14T20:54:49.014985] [INFO ] [MAIN ] Derivative Progress: 974/2226 symbols completed. HLN took 1.1s. Estimated remaining: 7m 22s. Rate: 170.0 symbols/min [2025-09-14T20:54:49.028135] [DEBUG] [LOCAL ] HLT: Loaded 37911 existing records from primary storage. [2025-09-14T20:54:49.028364] [INFO ] [MAIN ] HLT: Loaded 37911 primary data records. [2025-09-14T20:54:49.323997] [DEBUG] [MAIN ] HLT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:49.324819] [INFO ] [MAIN ] HLT: Generated 1352 derivative records from 37911 primary records. [2025-09-14T20:54:49.324908] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-14T20:54:49.337812] [DEBUG] [LOCAL ] HLT: Derivative data saved (1352 records). [2025-09-14T20:54:49.338022] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-14T20:54:49.339815] [INFO ] [MAIN ] Derivative Progress: 975/2226 symbols completed. HLT took 0.4s. Estimated remaining: 7m 21s. Rate: 170.0 symbols/min [2025-09-14T20:54:49.340742] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:49.340938] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:49.341011] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:49.362933] [DEBUG] [LOCAL ] HMN: Loaded 18068 existing records from primary storage. [2025-09-14T20:54:49.363103] [INFO ] [MAIN ] HMN: Loaded 18068 primary data records. [2025-09-14T20:54:49.558414] [DEBUG] [LOCAL ] HMC: Loaded 34740 existing records from primary storage. [2025-09-14T20:54:49.590248] [DEBUG] [LOCAL ] HLX: Loaded 35929 existing records from primary storage. [2025-09-14T20:54:49.585511] [INFO ] [MAIN ] HMC: Loaded 34740 primary data records. [2025-09-14T20:54:49.678296] [INFO ] [MAIN ] HLX: Loaded 35929 primary data records. [2025-09-14T20:54:50.303078] [DEBUG] [MAIN ] HMN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:50.304964] [INFO ] [MAIN ] HMN: Generated 1352 derivative records from 18068 primary records. [2025-09-14T20:54:50.305201] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-14T20:54:50.322228] [DEBUG] [LOCAL ] HMN: Derivative data saved (1352 records). [2025-09-14T20:54:50.323019] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-14T20:54:50.325043] [INFO ] [MAIN ] Derivative Progress: 976/2226 symbols completed. HMN took 1.0s. Estimated remaining: 7m 22s. Rate: 169.7 symbols/min [2025-09-14T20:54:50.326465] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:50.358342] [DEBUG] [MAIN ] HLX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:50.358782] [DEBUG] [MAIN ] HMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:50.359895] [INFO ] [MAIN ] HMC: Generated 1352 derivative records from 34740 primary records. [2025-09-14T20:54:50.360572] [INFO ] [MAIN ] HLX: Generated 1352 derivative records from 35929 primary records. [2025-09-14T20:54:50.360848] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-14T20:54:50.360913] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-14T20:54:50.385967] [DEBUG] [LOCAL ] HLX: Derivative data saved (1352 records). [2025-09-14T20:54:50.392583] [DEBUG] [LOCAL ] HMC: Derivative data saved (1352 records). [2025-09-14T20:54:50.392789] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-14T20:54:50.393021] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-14T20:54:50.406960] [INFO ] [MAIN ] Derivative Progress: 977/2226 symbols completed. HMC took 1.1s. Estimated remaining: 7m 21s. Rate: 169.8 symbols/min [2025-09-14T20:54:50.410030] [INFO ] [MAIN ] Derivative Progress: 978/2226 symbols completed. HLX took 1.1s. Estimated remaining: 7m 20s. Rate: 170.0 symbols/min [2025-09-14T20:54:50.410288] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:50.410662] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:50.439173] [DEBUG] [LOCAL ] HMY: Loaded 39927 existing records from primary storage. [2025-09-14T20:54:50.439525] [INFO ] [MAIN ] HMY: Loaded 39927 primary data records. [2025-09-14T20:54:50.544410] [DEBUG] [LOCAL ] HNI: Loaded 21400 existing records from primary storage. [2025-09-14T20:54:50.574384] [INFO ] [MAIN ] HNI: Loaded 21400 primary data records. [2025-09-14T20:54:50.841739] [DEBUG] [LOCAL ] HOG: Loaded 38253 existing records from primary storage. [2025-09-14T20:54:50.868068] [INFO ] [MAIN ] HOG: Loaded 38253 primary data records. [2025-09-14T20:54:51.411983] [DEBUG] [MAIN ] HMY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:51.414064] [INFO ] [MAIN ] HMY: Generated 1352 derivative records from 39927 primary records. [2025-09-14T20:54:51.414724] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-14T20:54:51.435431] [DEBUG] [LOCAL ] HMY: Derivative data saved (1352 records). [2025-09-14T20:54:51.435661] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-14T20:54:51.437978] [INFO ] [MAIN ] Derivative Progress: 979/2226 symbols completed. HMY took 1.1s. Estimated remaining: 7m 21s. Rate: 169.7 symbols/min [2025-09-14T20:54:51.450198] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:51.450401] [DEBUG] [MAIN ] HNI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:51.451517] [INFO ] [MAIN ] HNI: Generated 1352 derivative records from 21400 primary records. [2025-09-14T20:54:51.452289] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-14T20:54:51.469425] [DEBUG] [LOCAL ] HNI: Derivative data saved (1352 records). [2025-09-14T20:54:51.469744] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-14T20:54:51.472286] [INFO ] [MAIN ] Derivative Progress: 980/2226 symbols completed. HNI took 1.1s. Estimated remaining: 7m 20s. Rate: 169.8 symbols/min [2025-09-14T20:54:51.478529] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:51.482873] [DEBUG] [MAIN ] HOG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:51.484554] [INFO ] [MAIN ] HOG: Generated 1352 derivative records from 38253 primary records. [2025-09-14T20:54:51.484818] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-14T20:54:51.518224] [DEBUG] [LOCAL ] HOG: Derivative data saved (1352 records). [2025-09-14T20:54:51.519673] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-14T20:54:51.523090] [INFO ] [MAIN ] Derivative Progress: 981/2226 symbols completed. HOG took 1.1s. Estimated remaining: 7m 19s. Rate: 170.0 symbols/min [2025-09-14T20:54:51.520183] [DEBUG] [LOCAL ] HOMB: Loaded 32060 existing records from primary storage. [2025-09-14T20:54:51.523501] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:51.523301] [INFO ] [MAIN ] HOMB: Loaded 32060 primary data records. [2025-09-14T20:54:51.705525] [DEBUG] [LOCAL ] HOUS: Loaded 33145 existing records from primary storage. [2025-09-14T20:54:51.708599] [DEBUG] [LOCAL ] HOV: Loaded 10650 existing records from primary storage. [2025-09-14T20:54:51.729557] [INFO ] [MAIN ] HOUS: Loaded 33145 primary data records. [2025-09-14T20:54:51.729663] [INFO ] [MAIN ] HOV: Loaded 10650 primary data records. [2025-09-14T20:54:52.372328] [DEBUG] [MAIN ] HOMB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:52.374710] [INFO ] [MAIN ] HOMB: Generated 1352 derivative records from 32060 primary records. [2025-09-14T20:54:52.375034] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-14T20:54:52.390494] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1352 records). [2025-09-14T20:54:52.391054] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-14T20:54:52.393132] [INFO ] [MAIN ] Derivative Progress: 982/2226 symbols completed. HOMB took 0.9s. Estimated remaining: 7m 20s. Rate: 169.7 symbols/min [2025-09-14T20:54:52.393987] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:52.415987] [DEBUG] [MAIN ] HOV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:52.423611] [INFO ] [MAIN ] HOV: Generated 1352 derivative records from 10650 primary records. [2025-09-14T20:54:52.427945] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-14T20:54:52.428248] [DEBUG] [MAIN ] HOUS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:52.440365] [INFO ] [MAIN ] HOUS: Generated 1352 derivative records from 33145 primary records. [2025-09-14T20:54:52.451950] [DEBUG] [LOCAL ] HOV: Derivative data saved (1352 records). [2025-09-14T20:54:52.450678] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-14T20:54:52.452086] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-14T20:54:52.462452] [INFO ] [MAIN ] Derivative Progress: 983/2226 symbols completed. HOV took 0.9s. Estimated remaining: 7m 19s. Rate: 169.9 symbols/min [2025-09-14T20:54:52.486660] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:52.489350] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1352 records). [2025-09-14T20:54:52.490263] [DEBUG] [LOCAL ] HP: Loaded 39084 existing records from primary storage. [2025-09-14T20:54:52.490491] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-14T20:54:52.493584] [INFO ] [MAIN ] Derivative Progress: 984/2226 symbols completed. HOUS took 1.0s. Estimated remaining: 7m 18s. Rate: 170.0 symbols/min [2025-09-14T20:54:52.493690] [INFO ] [MAIN ] HP: Loaded 39084 primary data records. [2025-09-14T20:54:52.494097] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:52.608937] [DEBUG] [LOCAL ] HPF: Loaded 5597 existing records from primary storage. [2025-09-14T20:54:52.609669] [INFO ] [MAIN ] HPF: Loaded 5597 primary data records. [2025-09-14T20:54:52.891278] [DEBUG] [LOCAL ] HPE: Loaded 40437 existing records from primary storage. [2025-09-14T20:54:52.906959] [INFO ] [MAIN ] HPE: Loaded 40437 primary data records. [2025-09-14T20:54:53.367453] [DEBUG] [MAIN ] HP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:53.369536] [INFO ] [MAIN ] HP: Generated 1352 derivative records from 39084 primary records. [2025-09-14T20:54:53.371831] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-14T20:54:53.388956] [DEBUG] [MAIN ] HPF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:53.393925] [INFO ] [MAIN ] HPF: Generated 1352 derivative records from 5597 primary records. [2025-09-14T20:54:53.396569] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-14T20:54:53.396906] [DEBUG] [LOCAL ] HP: Derivative data saved (1352 records). [2025-09-14T20:54:53.397733] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-14T20:54:53.401113] [INFO ] [MAIN ] Derivative Progress: 985/2226 symbols completed. HP took 1.0s. Estimated remaining: 7m 19s. Rate: 169.8 symbols/min [2025-09-14T20:54:53.410369] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:53.424913] [DEBUG] [LOCAL ] HPF: Derivative data saved (1352 records). [2025-09-14T20:54:53.428907] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-14T20:54:53.429189] [DEBUG] [MAIN ] HPE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:53.431709] [INFO ] [MAIN ] Derivative Progress: 986/2226 symbols completed. HPF took 0.9s. Estimated remaining: 7m 18s. Rate: 169.9 symbols/min [2025-09-14T20:54:53.432507] [INFO ] [MAIN ] HPE: Generated 1352 derivative records from 40437 primary records. [2025-09-14T20:54:53.435121] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:53.435029] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-14T20:54:53.450743] [DEBUG] [LOCAL ] HPI: Loaded 7619 existing records from primary storage. [2025-09-14T20:54:53.453552] [INFO ] [MAIN ] HPI: Loaded 7619 primary data records. [2025-09-14T20:54:53.513709] [DEBUG] [LOCAL ] HPE: Derivative data saved (1352 records). [2025-09-14T20:54:53.547889] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-14T20:54:53.568085] [INFO ] [MAIN ] Derivative Progress: 987/2226 symbols completed. HPE took 1.1s. Estimated remaining: 7m 17s. Rate: 170.0 symbols/min [2025-09-14T20:54:53.592802] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:53.723429] [DEBUG] [LOCAL ] HPP: Loaded 38521 existing records from primary storage. [2025-09-14T20:54:53.727895] [INFO ] [MAIN ] HPP: Loaded 38521 primary data records. [2025-09-14T20:54:54.123073] [DEBUG] [LOCAL ] HPQ: Loaded 40412 existing records from primary storage. [2025-09-14T20:54:54.125459] [INFO ] [MAIN ] HPQ: Loaded 40412 primary data records. [2025-09-14T20:54:54.201255] [DEBUG] [MAIN ] HPI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:54.248295] [INFO ] [MAIN ] HPI: Generated 1352 derivative records from 7619 primary records. [2025-09-14T20:54:54.252483] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-14T20:54:54.444558] [DEBUG] [LOCAL ] HPI: Derivative data saved (1352 records). [2025-09-14T20:54:54.445437] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-14T20:54:54.453550] [INFO ] [MAIN ] Derivative Progress: 988/2226 symbols completed. HPI took 1.0s. Estimated remaining: 7m 18s. Rate: 169.8 symbols/min [2025-09-14T20:54:54.464818] [DEBUG] [MAIN ] HPP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:54.465782] [INFO ] [MAIN ] HPP: Generated 1352 derivative records from 38521 primary records. [2025-09-14T20:54:54.466617] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-14T20:54:54.480574] [DEBUG] [LOCAL ] HPP: Derivative data saved (1352 records). [2025-09-14T20:54:54.480814] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-14T20:54:54.484774] [INFO ] [MAIN ] Derivative Progress: 989/2226 symbols completed. HPP took 1.0s. Estimated remaining: 7m 17s. Rate: 169.9 symbols/min [2025-09-14T20:54:54.498386] [DEBUG] [MAIN ] HPQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:54.499193] [INFO ] [MAIN ] HPQ: Generated 1352 derivative records from 40412 primary records. [2025-09-14T20:54:54.499278] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-14T20:54:54.512661] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1352 records). [2025-09-14T20:54:54.512845] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-14T20:54:54.515507] [INFO ] [MAIN ] Derivative Progress: 990/2226 symbols completed. HPQ took 0.9s. Estimated remaining: 7m 16s. Rate: 170.1 symbols/min [2025-09-14T20:54:54.516751] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:54.516932] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:54.516488] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:54.530614] [DEBUG] [LOCAL ] HPS: Loaded 7697 existing records from primary storage. [2025-09-14T20:54:54.534493] [INFO ] [MAIN ] HPS: Loaded 7697 primary data records. [2025-09-14T20:54:54.617158] [DEBUG] [LOCAL ] HQL: Loaded 11831 existing records from primary storage. [2025-09-14T20:54:54.655770] [INFO ] [MAIN ] HQL: Loaded 11831 primary data records. [2025-09-14T20:54:54.667920] [DEBUG] [LOCAL ] HQH: Loaded 18918 existing records from primary storage. [2025-09-14T20:54:54.668195] [INFO ] [MAIN ] HQH: Loaded 18918 primary data records. [2025-09-14T20:54:55.416966] [DEBUG] [MAIN ] HQL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:55.427766] [DEBUG] [MAIN ] HQH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:55.428439] [INFO ] [MAIN ] HQL: Generated 1352 derivative records from 11831 primary records. [2025-09-14T20:54:55.429136] [INFO ] [MAIN ] HQH: Generated 1352 derivative records from 18918 primary records. [2025-09-14T20:54:55.438329] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-14T20:54:55.434827] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-14T20:54:55.438734] [DEBUG] [MAIN ] HPS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:55.439832] [INFO ] [MAIN ] HPS: Generated 1352 derivative records from 7697 primary records. [2025-09-14T20:54:55.440484] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-14T20:54:55.467363] [DEBUG] [LOCAL ] HQL: Derivative data saved (1352 records). [2025-09-14T20:54:55.474726] [DEBUG] [LOCAL ] HQH: Derivative data saved (1352 records). [2025-09-14T20:54:55.477013] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-14T20:54:55.477068] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-14T20:54:55.477392] [DEBUG] [LOCAL ] HPS: Derivative data saved (1352 records). [2025-09-14T20:54:55.480291] [INFO ] [MAIN ] Derivative Progress: 991/2226 symbols completed. HQL took 1.0s. Estimated remaining: 7m 16s. Rate: 169.8 symbols/min [2025-09-14T20:54:55.483041] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-14T20:54:55.483252] [INFO ] [MAIN ] Derivative Progress: 992/2226 symbols completed. HQH took 1.0s. Estimated remaining: 7m 16s. Rate: 170.0 symbols/min [2025-09-14T20:54:55.483568] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:55.483389] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:55.485883] [INFO ] [MAIN ] Derivative Progress: 993/2226 symbols completed. HPS took 1.0s. Estimated remaining: 7m 15s. Rate: 170.1 symbols/min [2025-09-14T20:54:55.486815] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:55.531669] [DEBUG] [LOCAL ] HRI: Loaded 24307 existing records from primary storage. [2025-09-14T20:54:55.531925] [INFO ] [MAIN ] HRI: Loaded 24307 primary data records. [2025-09-14T20:54:55.661412] [DEBUG] [LOCAL ] HRB: Loaded 36481 existing records from primary storage. [2025-09-14T20:54:55.661986] [INFO ] [MAIN ] HRB: Loaded 36481 primary data records. [2025-09-14T20:54:55.667742] [DEBUG] [LOCAL ] HR: Loaded 39162 existing records from primary storage. [2025-09-14T20:54:55.767200] [INFO ] [MAIN ] HR: Loaded 39162 primary data records. [2025-09-14T20:54:56.427827] [DEBUG] [MAIN ] HRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:56.430404] [INFO ] [MAIN ] HRI: Generated 1352 derivative records from 24307 primary records. [2025-09-14T20:54:56.430586] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-14T20:54:56.446405] [DEBUG] [LOCAL ] HRI: Derivative data saved (1352 records). [2025-09-14T20:54:56.448355] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-14T20:54:56.450557] [INFO ] [MAIN ] Derivative Progress: 994/2226 symbols completed. HRI took 1.0s. Estimated remaining: 7m 15s. Rate: 169.8 symbols/min [2025-09-14T20:54:56.451050] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:56.463600] [DEBUG] [MAIN ] HRB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:56.464775] [INFO ] [MAIN ] HRB: Generated 1352 derivative records from 36481 primary records. [2025-09-14T20:54:56.472072] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-14T20:54:56.477664] [DEBUG] [MAIN ] HR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:56.479630] [INFO ] [MAIN ] HR: Generated 1352 derivative records from 39162 primary records. [2025-09-14T20:54:56.480032] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-14T20:54:56.502905] [DEBUG] [LOCAL ] HRB: Derivative data saved (1352 records). [2025-09-14T20:54:56.510059] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-14T20:54:56.509760] [DEBUG] [LOCAL ] HR: Derivative data saved (1352 records). [2025-09-14T20:54:56.510221] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-14T20:54:56.513459] [INFO ] [MAIN ] Derivative Progress: 995/2226 symbols completed. HR took 1.0s. Estimated remaining: 7m 15s. Rate: 170.0 symbols/min [2025-09-14T20:54:56.516661] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:56.516940] [INFO ] [MAIN ] Derivative Progress: 996/2226 symbols completed. HRB took 1.0s. Estimated remaining: 7m 14s. Rate: 170.1 symbols/min [2025-09-14T20:54:56.517506] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:56.550166] [DEBUG] [LOCAL ] HRL: Loaded 39940 existing records from primary storage. [2025-09-14T20:54:56.550668] [INFO ] [MAIN ] HRL: Loaded 39940 primary data records. [2025-09-14T20:54:56.707375] [DEBUG] [LOCAL ] HRTG: Loaded 25534 existing records from primary storage. [2025-09-14T20:54:56.773224] [INFO ] [MAIN ] HRTG: Loaded 25534 primary data records. [2025-09-14T20:54:56.792089] [DEBUG] [LOCAL ] HSBC: Loaded 38237 existing records from primary storage. [2025-09-14T20:54:56.922065] [INFO ] [MAIN ] HSBC: Loaded 38237 primary data records. [2025-09-14T20:54:57.461036] [DEBUG] [MAIN ] HRL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:57.462837] [INFO ] [MAIN ] HRL: Generated 1352 derivative records from 39940 primary records. [2025-09-14T20:54:57.463007] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-14T20:54:57.478057] [DEBUG] [LOCAL ] HRL: Derivative data saved (1352 records). [2025-09-14T20:54:57.478199] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-14T20:54:57.481280] [INFO ] [MAIN ] Derivative Progress: 997/2226 symbols completed. HRL took 1.0s. Estimated remaining: 7m 14s. Rate: 169.8 symbols/min [2025-09-14T20:54:57.481824] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:57.503073] [DEBUG] [MAIN ] HRTG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:57.504168] [INFO ] [MAIN ] HRTG: Generated 1352 derivative records from 25534 primary records. [2025-09-14T20:54:57.505749] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-14T20:54:57.510942] [DEBUG] [LOCAL ] HSHP: Loaded 10277 existing records from primary storage. [2025-09-14T20:54:57.513427] [INFO ] [MAIN ] HSHP: Loaded 10277 primary data records. [2025-09-14T20:54:57.602968] [DEBUG] [MAIN ] HSBC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:57.623901] [INFO ] [MAIN ] HSBC: Generated 1352 derivative records from 38237 primary records. [2025-09-14T20:54:57.647784] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-14T20:54:57.651799] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1352 records). [2025-09-14T20:54:57.700794] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-14T20:54:57.706068] [INFO ] [MAIN ] Derivative Progress: 998/2226 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 14s. Rate: 169.9 symbols/min [2025-09-14T20:54:57.744445] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:57.841457] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1352 records). [2025-09-14T20:54:57.842756] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-14T20:54:57.846399] [INFO ] [MAIN ] Derivative Progress: 999/2226 symbols completed. HSBC took 1.3s. Estimated remaining: 7m 13s. Rate: 170.0 symbols/min [2025-09-14T20:54:57.847127] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:57.864858] [DEBUG] [LOCAL ] HTD: Loaded 9986 existing records from primary storage. [2025-09-14T20:54:57.865460] [INFO ] [MAIN ] HTD: Loaded 9986 primary data records. [2025-09-14T20:54:58.054485] [DEBUG] [LOCAL ] HSY: Loaded 38032 existing records from primary storage. [2025-09-14T20:54:58.096141] [DEBUG] [MAIN ] HSHP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:58.096248] [INFO ] [MAIN ] HSY: Loaded 38032 primary data records. [2025-09-14T20:54:58.252527] [INFO ] [MAIN ] HSHP: Generated 1352 derivative records from 10277 primary records. [2025-09-14T20:54:58.253858] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-14T20:54:58.326481] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1352 records). [2025-09-14T20:54:58.345491] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-14T20:54:58.369764] [INFO ] [MAIN ] Derivative Progress: 1000/2226 symbols completed. HSHP took 0.9s. Estimated remaining: 7m 13s. Rate: 169.9 symbols/min [2025-09-14T20:54:58.408998] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:58.622789] [DEBUG] [MAIN ] HTD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:58.624459] [INFO ] [MAIN ] HTD: Generated 1352 derivative records from 9986 primary records. [2025-09-14T20:54:58.624554] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-14T20:54:58.653342] [DEBUG] [LOCAL ] HTD: Derivative data saved (1352 records). [2025-09-14T20:54:58.655173] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-14T20:54:58.654955] [DEBUG] [LOCAL ] HTGC: Loaded 35510 existing records from primary storage. [2025-09-14T20:54:58.657999] [INFO ] [MAIN ] HTGC: Loaded 35510 primary data records. [2025-09-14T20:54:58.657869] [INFO ] [MAIN ] Derivative Progress: 1001/2226 symbols completed. HTD took 0.8s. Estimated remaining: 7m 12s. Rate: 170.0 symbols/min [2025-09-14T20:54:58.658613] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:58.856150] [DEBUG] [MAIN ] HSY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:58.963436] [INFO ] [MAIN ] HSY: Generated 1352 derivative records from 38032 primary records. [2025-09-14T20:54:58.985352] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-14T20:54:58.986227] [DEBUG] [LOCAL ] HTH: Loaded 25401 existing records from primary storage. [2025-09-14T20:54:58.987117] [INFO ] [MAIN ] HTH: Loaded 25401 primary data records. [2025-09-14T20:54:59.102425] [DEBUG] [LOCAL ] HSY: Derivative data saved (1352 records). [2025-09-14T20:54:59.116895] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-14T20:54:59.135821] [INFO ] [MAIN ] Derivative Progress: 1002/2226 symbols completed. HSY took 1.4s. Estimated remaining: 7m 12s. Rate: 169.9 symbols/min [2025-09-14T20:54:59.201274] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:59.312763] [DEBUG] [MAIN ] HTGC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:59.314429] [INFO ] [MAIN ] HTGC: Generated 1352 derivative records from 35510 primary records. [2025-09-14T20:54:59.314638] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-14T20:54:59.334882] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1352 records). [2025-09-14T20:54:59.343681] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-14T20:54:59.346460] [INFO ] [MAIN ] Derivative Progress: 1003/2226 symbols completed. HTGC took 1.0s. Estimated remaining: 7m 12s. Rate: 170.0 symbols/min [2025-09-14T20:54:59.366046] [DEBUG] [LOCAL ] HUBB: Loaded 27177 existing records from primary storage. [2025-09-14T20:54:59.376429] [INFO ] [MAIN ] HUBB: Loaded 27177 primary data records. [2025-09-14T20:54:59.376916] [DEBUG] [MAIN ] HTH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:59.382851] [INFO ] [MAIN ] HTH: Generated 1352 derivative records from 25401 primary records. [2025-09-14T20:54:59.419941] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-14T20:54:59.567510] [DEBUG] [LOCAL ] HTH: Derivative data saved (1352 records). [2025-09-14T20:54:59.624364] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-14T20:54:59.678885] [INFO ] [MAIN ] Derivative Progress: 1004/2226 symbols completed. HTH took 1.0s. Estimated remaining: 7m 11s. Rate: 170.0 symbols/min [2025-09-14T20:54:59.698713] [DEBUG] [MAIN ] HUBB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:54:59.699373] [INFO ] [MAIN ] HUBB: Generated 1352 derivative records from 27177 primary records. [2025-09-14T20:54:59.699450] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-14T20:54:59.711393] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1352 records). [2025-09-14T20:54:59.711515] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-14T20:54:59.713910] [INFO ] [MAIN ] Derivative Progress: 1005/2226 symbols completed. HUBB took 0.5s. Estimated remaining: 7m 11s. Rate: 170.1 symbols/min [2025-09-14T20:54:59.714543] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:59.714890] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:59.714739] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:54:59.764184] [DEBUG] [LOCAL ] HUN: Loaded 40015 existing records from primary storage. [2025-09-14T20:54:59.772029] [INFO ] [MAIN ] HUN: Loaded 40015 primary data records. [2025-09-14T20:54:59.927347] [DEBUG] [LOCAL ] HUM: Loaded 36925 existing records from primary storage. [2025-09-14T20:54:59.946404] [DEBUG] [LOCAL ] HUBS: Loaded 29603 existing records from primary storage. [2025-09-14T20:54:59.962371] [INFO ] [MAIN ] HUBS: Loaded 29603 primary data records. [2025-09-14T20:54:59.962259] [INFO ] [MAIN ] HUM: Loaded 36925 primary data records. [2025-09-14T20:55:00.806270] [DEBUG] [MAIN ] HUN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:00.808346] [INFO ] [MAIN ] HUN: Generated 1352 derivative records from 40015 primary records. [2025-09-14T20:55:00.809841] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-14T20:55:00.836088] [DEBUG] [MAIN ] HUBS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:00.837968] [INFO ] [MAIN ] HUBS: Generated 1352 derivative records from 29603 primary records. [2025-09-14T20:55:00.840441] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-14T20:55:00.841914] [DEBUG] [LOCAL ] HUN: Derivative data saved (1352 records). [2025-09-14T20:55:00.846438] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-14T20:55:00.869351] [INFO ] [MAIN ] Derivative Progress: 1006/2226 symbols completed. HUN took 1.2s. Estimated remaining: 7m 11s. Rate: 169.7 symbols/min [2025-09-14T20:55:00.869717] [DEBUG] [MAIN ] HUM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:00.873304] [INFO ] [MAIN ] HUM: Generated 1352 derivative records from 36925 primary records. [2025-09-14T20:55:00.872443] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1352 records). [2025-09-14T20:55:00.872383] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:00.873595] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-14T20:55:00.873918] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-14T20:55:00.876407] [INFO ] [MAIN ] Derivative Progress: 1007/2226 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 10s. Rate: 169.9 symbols/min [2025-09-14T20:55:00.877661] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:00.891542] [DEBUG] [LOCAL ] HUM: Derivative data saved (1352 records). [2025-09-14T20:55:00.892103] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-14T20:55:00.894887] [INFO ] [MAIN ] Derivative Progress: 1008/2226 symbols completed. HUM took 1.2s. Estimated remaining: 7m 10s. Rate: 170.1 symbols/min [2025-09-14T20:55:00.898783] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:00.906200] [DEBUG] [LOCAL ] HVT: Loaded 11292 existing records from primary storage. [2025-09-14T20:55:00.906388] [INFO ] [MAIN ] HVT: Loaded 11292 primary data records. [2025-09-14T20:55:01.067191] [DEBUG] [LOCAL ] HUYA: Loaded 32446 existing records from primary storage. [2025-09-14T20:55:01.119508] [INFO ] [MAIN ] HUYA: Loaded 32446 primary data records. [2025-09-14T20:55:01.349542] [DEBUG] [LOCAL ] HWM: Loaded 39910 existing records from primary storage. [2025-09-14T20:55:01.381011] [INFO ] [MAIN ] HWM: Loaded 39910 primary data records. [2025-09-14T20:55:01.962399] [DEBUG] [MAIN ] HVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:01.963948] [INFO ] [MAIN ] HVT: Generated 1352 derivative records from 11292 primary records. [2025-09-14T20:55:01.965549] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-14T20:55:01.986549] [DEBUG] [LOCAL ] HVT: Derivative data saved (1352 records). [2025-09-14T20:55:01.987353] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-14T20:55:01.999104] [DEBUG] [MAIN ] HUYA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:02.001474] [INFO ] [MAIN ] Derivative Progress: 1009/2226 symbols completed. HVT took 1.1s. Estimated remaining: 7m 10s. Rate: 169.7 symbols/min [2025-09-14T20:55:02.002870] [INFO ] [MAIN ] HUYA: Generated 1352 derivative records from 32446 primary records. [2025-09-14T20:55:02.004218] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:02.004532] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-14T20:55:02.041680] [DEBUG] [MAIN ] HWM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:02.043388] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1352 records). [2025-09-14T20:55:02.044416] [INFO ] [MAIN ] HWM: Generated 1352 derivative records from 39910 primary records. [2025-09-14T20:55:02.044582] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-14T20:55:02.047360] [INFO ] [MAIN ] Derivative Progress: 1010/2226 symbols completed. HUYA took 1.2s. Estimated remaining: 7m 10s. Rate: 169.9 symbols/min [2025-09-14T20:55:02.044663] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-14T20:55:02.047743] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:02.090533] [DEBUG] [LOCAL ] HY: Loaded 7350 existing records from primary storage. [2025-09-14T20:55:02.090404] [DEBUG] [LOCAL ] HXL: Loaded 34690 existing records from primary storage. [2025-09-14T20:55:02.090728] [INFO ] [MAIN ] HXL: Loaded 34690 primary data records. [2025-09-14T20:55:02.085927] [DEBUG] [LOCAL ] HWM: Derivative data saved (1352 records). [2025-09-14T20:55:02.091109] [INFO ] [MAIN ] HY: Loaded 7350 primary data records. [2025-09-14T20:55:02.096454] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-14T20:55:02.201269] [INFO ] [MAIN ] Derivative Progress: 1011/2226 symbols completed. HWM took 1.3s. Estimated remaining: 7m 9s. Rate: 169.9 symbols/min [2025-09-14T20:55:02.289315] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:02.421817] [DEBUG] [LOCAL ] HYI: Loaded 6514 existing records from primary storage. [2025-09-14T20:55:02.475137] [INFO ] [MAIN ] HYI: Loaded 6514 primary data records. [2025-09-14T20:55:02.998676] [DEBUG] [MAIN ] HY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:03.003809] [INFO ] [MAIN ] HY: Generated 1352 derivative records from 7350 primary records. [2025-09-14T20:55:03.010736] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-14T20:55:03.026059] [DEBUG] [MAIN ] HXL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:03.032176] [INFO ] [MAIN ] HXL: Generated 1352 derivative records from 34690 primary records. [2025-09-14T20:55:03.033459] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-14T20:55:03.048380] [DEBUG] [LOCAL ] HY: Derivative data saved (1352 records). [2025-09-14T20:55:03.054129] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-14T20:55:03.059343] [DEBUG] [LOCAL ] HXL: Derivative data saved (1352 records). [2025-09-14T20:55:03.061730] [INFO ] [MAIN ] Derivative Progress: 1012/2226 symbols completed. HY took 1.0s. Estimated remaining: 7m 9s. Rate: 169.7 symbols/min [2025-09-14T20:55:03.063972] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:03.062458] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-14T20:55:03.069305] [INFO ] [MAIN ] Derivative Progress: 1013/2226 symbols completed. HXL took 1.1s. Estimated remaining: 7m 8s. Rate: 169.9 symbols/min [2025-09-14T20:55:03.070345] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:03.082682] [DEBUG] [MAIN ] HYI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:03.084133] [INFO ] [MAIN ] HYI: Generated 1352 derivative records from 6514 primary records. [2025-09-14T20:55:03.085366] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-14T20:55:03.089319] [DEBUG] [LOCAL ] HYTR: Loaded 2256 existing records from primary storage. [2025-09-14T20:55:03.089951] [INFO ] [MAIN ] HYTR: Loaded 2256 primary data records. [2025-09-14T20:55:03.150754] [DEBUG] [LOCAL ] HYI: Derivative data saved (1352 records). [2025-09-14T20:55:03.197060] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-14T20:55:03.226401] [INFO ] [MAIN ] Derivative Progress: 1014/2226 symbols completed. HYI took 1.0s. Estimated remaining: 7m 8s. Rate: 170.0 symbols/min [2025-09-14T20:55:03.244634] [DEBUG] [LOCAL ] HYT: Loaded 24744 existing records from primary storage. [2025-09-14T20:55:03.244853] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:03.265840] [INFO ] [MAIN ] HYT: Loaded 24744 primary data records. [2025-09-14T20:55:03.638182] [DEBUG] [LOCAL ] HZO: Loaded 21209 existing records from primary storage. [2025-09-14T20:55:03.691543] [INFO ] [MAIN ] HZO: Loaded 21209 primary data records. [2025-09-14T20:55:04.054499] [DEBUG] [MAIN ] HYTR: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:55:04.055706] [INFO ] [MAIN ] HYTR: Generated 1351 derivative records from 2256 primary records. [2025-09-14T20:55:04.055996] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-14T20:55:04.070881] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1351 records). [2025-09-14T20:55:04.073207] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-14T20:55:04.075990] [INFO ] [MAIN ] Derivative Progress: 1015/2226 symbols completed. HYTR took 1.0s. Estimated remaining: 7m 8s. Rate: 169.7 symbols/min [2025-09-14T20:55:04.083209] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:04.088286] [DEBUG] [MAIN ] HYT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:04.089493] [INFO ] [MAIN ] HYT: Generated 1352 derivative records from 24744 primary records. [2025-09-14T20:55:04.089825] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-14T20:55:04.109457] [DEBUG] [LOCAL ] HYT: Derivative data saved (1352 records). [2025-09-14T20:55:04.109963] [DEBUG] [LOCAL ] IAE: Loaded 4197 existing records from primary storage. [2025-09-14T20:55:04.111976] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-14T20:55:04.112675] [INFO ] [MAIN ] IAE: Loaded 4197 primary data records. [2025-09-14T20:55:04.115601] [INFO ] [MAIN ] Derivative Progress: 1016/2226 symbols completed. HYT took 1.1s. Estimated remaining: 7m 7s. Rate: 169.9 symbols/min [2025-09-14T20:55:04.137502] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:04.158554] [DEBUG] [MAIN ] HZO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:04.193372] [INFO ] [MAIN ] HZO: Generated 1352 derivative records from 21209 primary records. [2025-09-14T20:55:04.216384] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-14T20:55:04.289286] [DEBUG] [LOCAL ] HZO: Derivative data saved (1352 records). [2025-09-14T20:55:04.328796] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-14T20:55:04.419458] [INFO ] [MAIN ] Derivative Progress: 1017/2226 symbols completed. HZO took 1.2s. Estimated remaining: 7m 7s. Rate: 169.9 symbols/min [2025-09-14T20:55:04.419885] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:04.453683] [DEBUG] [MAIN ] IAE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:04.454810] [INFO ] [MAIN ] IAE: Generated 1352 derivative records from 4197 primary records. [2025-09-14T20:55:04.467380] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-14T20:55:04.469763] [DEBUG] [LOCAL ] IAG: Loaded 40237 existing records from primary storage. [2025-09-14T20:55:04.470265] [INFO ] [MAIN ] IAG: Loaded 40237 primary data records. [2025-09-14T20:55:04.581611] [DEBUG] [LOCAL ] IAE: Derivative data saved (1352 records). [2025-09-14T20:55:04.605103] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-14T20:55:04.634925] [INFO ] [MAIN ] Derivative Progress: 1018/2226 symbols completed. IAE took 0.6s. Estimated remaining: 7m 6s. Rate: 170.0 symbols/min [2025-09-14T20:55:04.646438] [DEBUG] [LOCAL ] IBM: Loaded 40393 existing records from primary storage. [2025-09-14T20:55:04.664169] [INFO ] [MAIN ] IBM: Loaded 40393 primary data records. [2025-09-14T20:55:05.100035] [DEBUG] [MAIN ] IAG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:05.100965] [INFO ] [MAIN ] IAG: Generated 1352 derivative records from 40237 primary records. [2025-09-14T20:55:05.101129] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-14T20:55:05.114761] [DEBUG] [LOCAL ] IAG: Derivative data saved (1352 records). [2025-09-14T20:55:05.115056] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-14T20:55:05.116972] [INFO ] [MAIN ] Derivative Progress: 1019/2226 symbols completed. IAG took 1.0s. Estimated remaining: 7m 6s. Rate: 169.9 symbols/min [2025-09-14T20:55:05.129208] [DEBUG] [MAIN ] IBM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:05.129893] [INFO ] [MAIN ] IBM: Generated 1352 derivative records from 40393 primary records. [2025-09-14T20:55:05.129971] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-14T20:55:05.142337] [DEBUG] [LOCAL ] IBM: Derivative data saved (1352 records). [2025-09-14T20:55:05.142460] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-14T20:55:05.144882] [INFO ] [MAIN ] Derivative Progress: 1020/2226 symbols completed. IBM took 0.7s. Estimated remaining: 7m 6s. Rate: 170.1 symbols/min [2025-09-14T20:55:05.145878] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:05.145977] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:05.146174] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:05.188192] [DEBUG] [LOCAL ] IBP: Loaded 21904 existing records from primary storage. [2025-09-14T20:55:05.188524] [INFO ] [MAIN ] IBP: Loaded 21904 primary data records. [2025-09-14T20:55:05.189581] [DEBUG] [LOCAL ] IBTA: Loaded 26676 existing records from primary storage. [2025-09-14T20:55:05.211535] [INFO ] [MAIN ] IBTA: Loaded 26676 primary data records. [2025-09-14T20:55:05.444771] [DEBUG] [LOCAL ] IBN: Loaded 39792 existing records from primary storage. [2025-09-14T20:55:05.519829] [INFO ] [MAIN ] IBN: Loaded 39792 primary data records. [2025-09-14T20:55:06.198350] [DEBUG] [MAIN ] IBP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:06.211037] [DEBUG] [MAIN ] IBTA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:06.210407] [INFO ] [MAIN ] IBP: Generated 1352 derivative records from 21904 primary records. [2025-09-14T20:55:06.211234] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-14T20:55:06.211767] [INFO ] [MAIN ] IBTA: Generated 1352 derivative records from 26676 primary records. [2025-09-14T20:55:06.213006] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-14T20:55:06.241304] [DEBUG] [LOCAL ] IBP: Derivative data saved (1352 records). [2025-09-14T20:55:06.241088] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1352 records). [2025-09-14T20:55:06.241758] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-14T20:55:06.241689] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-14T20:55:06.243817] [INFO ] [MAIN ] Derivative Progress: 1021/2226 symbols completed. IBP took 1.1s. Estimated remaining: 7m 6s. Rate: 169.7 symbols/min [2025-09-14T20:55:06.244255] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:06.246871] [INFO ] [MAIN ] Derivative Progress: 1022/2226 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 5s. Rate: 169.9 symbols/min [2025-09-14T20:55:06.248321] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:06.266102] [DEBUG] [MAIN ] IBN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:06.267189] [INFO ] [MAIN ] IBN: Generated 1352 derivative records from 39792 primary records. [2025-09-14T20:55:06.267679] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-14T20:55:06.280472] [DEBUG] [LOCAL ] IBN: Derivative data saved (1352 records). [2025-09-14T20:55:06.288594] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-14T20:55:06.291125] [INFO ] [MAIN ] Derivative Progress: 1023/2226 symbols completed. IBN took 1.1s. Estimated remaining: 7m 5s. Rate: 170.0 symbols/min [2025-09-14T20:55:06.291699] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:06.314611] [DEBUG] [LOCAL ] ICL: Loaded 28754 existing records from primary storage. [2025-09-14T20:55:06.314906] [INFO ] [MAIN ] ICL: Loaded 28754 primary data records. [2025-09-14T20:55:06.475213] [DEBUG] [LOCAL ] ICE: Loaded 39805 existing records from primary storage. [2025-09-14T20:55:06.518221] [INFO ] [MAIN ] ICE: Loaded 39805 primary data records. [2025-09-14T20:55:06.521169] [DEBUG] [LOCAL ] IDA: Loaded 25071 existing records from primary storage. [2025-09-14T20:55:06.521474] [INFO ] [MAIN ] IDA: Loaded 25071 primary data records. [2025-09-14T20:55:07.236454] [DEBUG] [MAIN ] ICL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:07.237703] [INFO ] [MAIN ] ICL: Generated 1352 derivative records from 28754 primary records. [2025-09-14T20:55:07.238079] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-14T20:55:07.253407] [DEBUG] [LOCAL ] ICL: Derivative data saved (1352 records). [2025-09-14T20:55:07.255068] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-14T20:55:07.267320] [INFO ] [MAIN ] Derivative Progress: 1024/2226 symbols completed. ICL took 1.0s. Estimated remaining: 7m 5s. Rate: 169.7 symbols/min [2025-09-14T20:55:07.268415] [DEBUG] [MAIN ] IDA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:07.268014] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:07.278256] [DEBUG] [MAIN ] ICE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:07.279094] [INFO ] [MAIN ] IDA: Generated 1352 derivative records from 25071 primary records. [2025-09-14T20:55:07.279840] [INFO ] [MAIN ] ICE: Generated 1352 derivative records from 39805 primary records. [2025-09-14T20:55:07.280263] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-14T20:55:07.280180] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-14T20:55:07.305249] [DEBUG] [LOCAL ] ICE: Derivative data saved (1352 records). [2025-09-14T20:55:07.307984] [DEBUG] [LOCAL ] IDA: Derivative data saved (1352 records). [2025-09-14T20:55:07.308120] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-14T20:55:07.310094] [INFO ] [MAIN ] Derivative Progress: 1025/2226 symbols completed. ICE took 1.1s. Estimated remaining: 7m 4s. Rate: 169.9 symbols/min [2025-09-14T20:55:07.310170] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-14T20:55:07.314109] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:07.316859] [DEBUG] [LOCAL ] IDE: Loaded 6576 existing records from primary storage. [2025-09-14T20:55:07.317165] [INFO ] [MAIN ] IDE: Loaded 6576 primary data records. [2025-09-14T20:55:07.316569] [INFO ] [MAIN ] Derivative Progress: 1026/2226 symbols completed. IDA took 1.0s. Estimated remaining: 7m 3s. Rate: 170.0 symbols/min [2025-09-14T20:55:07.329708] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:07.436783] [DEBUG] [LOCAL ] IDT: Loaded 13144 existing records from primary storage. [2025-09-14T20:55:07.463063] [INFO ] [MAIN ] IDT: Loaded 13144 primary data records. [2025-09-14T20:55:07.739906] [DEBUG] [LOCAL ] IEX: Loaded 28982 existing records from primary storage. [2025-09-14T20:55:07.741052] [INFO ] [MAIN ] IEX: Loaded 28982 primary data records. [2025-09-14T20:55:08.276258] [DEBUG] [MAIN ] IDE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:08.277477] [INFO ] [MAIN ] IDE: Generated 1352 derivative records from 6576 primary records. [2025-09-14T20:55:08.279227] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-14T20:55:08.305483] [DEBUG] [MAIN ] IDT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:08.308143] [INFO ] [MAIN ] IDT: Generated 1352 derivative records from 13144 primary records. [2025-09-14T20:55:08.308963] [DEBUG] [LOCAL ] IDE: Derivative data saved (1352 records). [2025-09-14T20:55:08.309049] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-14T20:55:08.310054] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-14T20:55:08.320823] [INFO ] [MAIN ] Derivative Progress: 1027/2226 symbols completed. IDE took 1.1s. Estimated remaining: 7m 4s. Rate: 169.7 symbols/min [2025-09-14T20:55:08.325248] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:08.338310] [DEBUG] [MAIN ] IEX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:08.337600] [DEBUG] [LOCAL ] IDT: Derivative data saved (1352 records). [2025-09-14T20:55:08.339118] [INFO ] [MAIN ] IEX: Generated 1352 derivative records from 28982 primary records. [2025-09-14T20:55:08.339294] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-14T20:55:08.342103] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-14T20:55:08.341896] [INFO ] [MAIN ] Derivative Progress: 1028/2226 symbols completed. IDT took 1.0s. Estimated remaining: 7m 3s. Rate: 169.9 symbols/min [2025-09-14T20:55:08.343360] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:08.362562] [DEBUG] [LOCAL ] IEX: Derivative data saved (1352 records). [2025-09-14T20:55:08.362835] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-14T20:55:08.364967] [INFO ] [MAIN ] Derivative Progress: 1029/2226 symbols completed. IEX took 1.0s. Estimated remaining: 7m 2s. Rate: 170.0 symbols/min [2025-09-14T20:55:08.369316] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:08.385998] [DEBUG] [LOCAL ] IFN: Loaded 13786 existing records from primary storage. [2025-09-14T20:55:08.386268] [INFO ] [MAIN ] IFN: Loaded 13786 primary data records. [2025-09-14T20:55:08.515929] [DEBUG] [LOCAL ] IFF: Loaded 38270 existing records from primary storage. [2025-09-14T20:55:08.516414] [DEBUG] [LOCAL ] IFS: Loaded 16626 existing records from primary storage. [2025-09-14T20:55:08.516963] [INFO ] [MAIN ] IFF: Loaded 38270 primary data records. [2025-09-14T20:55:08.522271] [INFO ] [MAIN ] IFS: Loaded 16626 primary data records. [2025-09-14T20:55:09.288121] [DEBUG] [MAIN ] IFN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:09.289983] [INFO ] [MAIN ] IFN: Generated 1352 derivative records from 13786 primary records. [2025-09-14T20:55:09.290200] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-14T20:55:09.326075] [DEBUG] [MAIN ] IFS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:09.332452] [INFO ] [MAIN ] IFS: Generated 1352 derivative records from 16626 primary records. [2025-09-14T20:55:09.331405] [DEBUG] [MAIN ] IFF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:09.333238] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-14T20:55:09.333060] [DEBUG] [LOCAL ] IFN: Derivative data saved (1352 records). [2025-09-14T20:55:09.334975] [INFO ] [MAIN ] IFF: Generated 1352 derivative records from 38270 primary records. [2025-09-14T20:55:09.336021] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-14T20:55:09.341678] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-14T20:55:09.348317] [INFO ] [MAIN ] Derivative Progress: 1030/2226 symbols completed. IFN took 1.0s. Estimated remaining: 7m 3s. Rate: 169.7 symbols/min [2025-09-14T20:55:09.360421] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:09.364548] [DEBUG] [LOCAL ] IFS: Derivative data saved (1352 records). [2025-09-14T20:55:09.365408] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-14T20:55:09.368056] [INFO ] [MAIN ] Derivative Progress: 1031/2226 symbols completed. IFS took 1.0s. Estimated remaining: 7m 2s. Rate: 169.9 symbols/min [2025-09-14T20:55:09.364667] [DEBUG] [LOCAL ] IFF: Derivative data saved (1352 records). [2025-09-14T20:55:09.369028] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:09.369164] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-14T20:55:09.372175] [INFO ] [MAIN ] Derivative Progress: 1032/2226 symbols completed. IFF took 1.0s. Estimated remaining: 7m 1s. Rate: 170.1 symbols/min [2025-09-14T20:55:09.372540] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:09.386821] [DEBUG] [LOCAL ] IGA: Loaded 6969 existing records from primary storage. [2025-09-14T20:55:09.389838] [DEBUG] [LOCAL ] IGI: Loaded 2744 existing records from primary storage. [2025-09-14T20:55:09.390164] [INFO ] [MAIN ] IGA: Loaded 6969 primary data records. [2025-09-14T20:55:09.390273] [INFO ] [MAIN ] IGI: Loaded 2744 primary data records. [2025-09-14T20:55:09.520378] [DEBUG] [LOCAL ] IGD: Loaded 14033 existing records from primary storage. [2025-09-14T20:55:09.600239] [INFO ] [MAIN ] IGD: Loaded 14033 primary data records. [2025-09-14T20:55:10.281532] [DEBUG] [MAIN ] IGI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:10.295439] [INFO ] [MAIN ] IGI: Generated 1352 derivative records from 2744 primary records. [2025-09-14T20:55:10.296321] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-14T20:55:10.295997] [DEBUG] [MAIN ] IGA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:10.297862] [INFO ] [MAIN ] IGA: Generated 1352 derivative records from 6969 primary records. [2025-09-14T20:55:10.310815] [DEBUG] [LOCAL ] IGI: Derivative data saved (1352 records). [2025-09-14T20:55:10.311155] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-14T20:55:10.311207] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-14T20:55:10.313708] [INFO ] [MAIN ] Derivative Progress: 1033/2226 symbols completed. IGI took 0.9s. Estimated remaining: 7m 2s. Rate: 169.8 symbols/min [2025-09-14T20:55:10.330662] [DEBUG] [MAIN ] IGD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:10.336225] [INFO ] [MAIN ] IGD: Generated 1352 derivative records from 14033 primary records. [2025-09-14T20:55:10.337240] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-14T20:55:10.337813] [DEBUG] [LOCAL ] IGA: Derivative data saved (1352 records). [2025-09-14T20:55:10.338214] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-14T20:55:10.341008] [INFO ] [MAIN ] Derivative Progress: 1034/2226 symbols completed. IGA took 1.0s. Estimated remaining: 7m 1s. Rate: 169.9 symbols/min [2025-09-14T20:55:10.353726] [DEBUG] [LOCAL ] IGD: Derivative data saved (1352 records). [2025-09-14T20:55:10.353822] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-14T20:55:10.355901] [INFO ] [MAIN ] Derivative Progress: 1035/2226 symbols completed. IGD took 1.0s. Estimated remaining: 7m 0s. Rate: 170.1 symbols/min [2025-09-14T20:55:10.356451] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:10.356772] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:10.356606] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:10.364759] [DEBUG] [LOCAL ] IH: Loaded 2015 existing records from primary storage. [2025-09-14T20:55:10.364967] [INFO ] [MAIN ] IH: Loaded 2015 primary data records. [2025-09-14T20:55:10.405313] [DEBUG] [LOCAL ] IHD: Loaded 5208 existing records from primary storage. [2025-09-14T20:55:10.456930] [INFO ] [MAIN ] IHD: Loaded 5208 primary data records. [2025-09-14T20:55:10.541575] [DEBUG] [LOCAL ] IGR: Loaded 22791 existing records from primary storage. [2025-09-14T20:55:10.610589] [INFO ] [MAIN ] IGR: Loaded 22791 primary data records. [2025-09-14T20:55:11.300597] [DEBUG] [MAIN ] IH: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:55:11.301910] [INFO ] [MAIN ] IH: Generated 1351 derivative records from 2015 primary records. [2025-09-14T20:55:11.303167] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-14T20:55:11.328175] [DEBUG] [MAIN ] IGR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:11.327823] [DEBUG] [MAIN ] IHD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:11.336823] [INFO ] [MAIN ] IGR: Generated 1352 derivative records from 22791 primary records. [2025-09-14T20:55:11.338133] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-14T20:55:11.338065] [INFO ] [MAIN ] IHD: Generated 1352 derivative records from 5208 primary records. [2025-09-14T20:55:11.340904] [DEBUG] [LOCAL ] IH: Derivative data saved (1351 records). [2025-09-14T20:55:11.341592] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-14T20:55:11.341719] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-14T20:55:11.352203] [INFO ] [MAIN ] Derivative Progress: 1036/2226 symbols completed. IH took 1.0s. Estimated remaining: 7m 1s. Rate: 169.8 symbols/min [2025-09-14T20:55:11.353750] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:11.367505] [DEBUG] [LOCAL ] IHD: Derivative data saved (1352 records). [2025-09-14T20:55:11.368180] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-14T20:55:11.370607] [INFO ] [MAIN ] Derivative Progress: 1037/2226 symbols completed. IHD took 1.0s. Estimated remaining: 6m 60s. Rate: 170.0 symbols/min [2025-09-14T20:55:11.371307] [DEBUG] [LOCAL ] IGR: Derivative data saved (1352 records). [2025-09-14T20:55:11.371714] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-14T20:55:11.371510] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:11.374009] [INFO ] [MAIN ] Derivative Progress: 1038/2226 symbols completed. IGR took 1.0s. Estimated remaining: 6m 59s. Rate: 170.1 symbols/min [2025-09-14T20:55:11.374441] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:11.392423] [DEBUG] [LOCAL ] IIF: Loaded 4212 existing records from primary storage. [2025-09-14T20:55:11.392596] [INFO ] [MAIN ] IIF: Loaded 4212 primary data records. [2025-09-14T20:55:11.476971] [DEBUG] [LOCAL ] IHG: Loaded 18114 existing records from primary storage. [2025-09-14T20:55:11.499444] [INFO ] [MAIN ] IHG: Loaded 18114 primary data records. [2025-09-14T20:55:11.693591] [DEBUG] [LOCAL ] IHS: Loaded 29543 existing records from primary storage. [2025-09-14T20:55:11.804076] [INFO ] [MAIN ] IHS: Loaded 29543 primary data records. [2025-09-14T20:55:12.290148] [DEBUG] [MAIN ] IIF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:12.291740] [INFO ] [MAIN ] IIF: Generated 1352 derivative records from 4212 primary records. [2025-09-14T20:55:12.292745] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-14T20:55:12.321117] [DEBUG] [MAIN ] IHG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:12.323600] [INFO ] [MAIN ] IHG: Generated 1352 derivative records from 18114 primary records. [2025-09-14T20:55:12.324308] [DEBUG] [LOCAL ] IIF: Derivative data saved (1352 records). [2025-09-14T20:55:12.324502] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-14T20:55:12.326540] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-14T20:55:12.337707] [INFO ] [MAIN ] Derivative Progress: 1039/2226 symbols completed. IIF took 1.0s. Estimated remaining: 6m 59s. Rate: 169.8 symbols/min [2025-09-14T20:55:12.345357] [DEBUG] [LOCAL ] IHG: Derivative data saved (1352 records). [2025-09-14T20:55:12.346430] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-14T20:55:12.345986] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:12.359749] [INFO ] [MAIN ] Derivative Progress: 1040/2226 symbols completed. IHG took 1.0s. Estimated remaining: 6m 59s. Rate: 170.0 symbols/min [2025-09-14T20:55:12.356769] [DEBUG] [MAIN ] IHS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:12.361661] [INFO ] [MAIN ] IHS: Generated 1352 derivative records from 29543 primary records. [2025-09-14T20:55:12.360374] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:12.362445] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-14T20:55:12.376748] [DEBUG] [LOCAL ] IHS: Derivative data saved (1352 records). [2025-09-14T20:55:12.376924] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-14T20:55:12.380236] [INFO ] [MAIN ] Derivative Progress: 1041/2226 symbols completed. IHS took 1.0s. Estimated remaining: 6m 58s. Rate: 170.1 symbols/min [2025-09-14T20:55:12.384290] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:12.401253] [DEBUG] [LOCAL ] IIM: Loaded 11433 existing records from primary storage. [2025-09-14T20:55:12.401848] [DEBUG] [LOCAL ] IIIN: Loaded 12082 existing records from primary storage. [2025-09-14T20:55:12.402334] [INFO ] [MAIN ] IIM: Loaded 11433 primary data records. [2025-09-14T20:55:12.402262] [INFO ] [MAIN ] IIIN: Loaded 12082 primary data records. [2025-09-14T20:55:12.649535] [DEBUG] [LOCAL ] IIPR: Loaded 20957 existing records from primary storage. [2025-09-14T20:55:12.676245] [INFO ] [MAIN ] IIPR: Loaded 20957 primary data records. [2025-09-14T20:55:13.388844] [DEBUG] [MAIN ] IIM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:13.390780] [INFO ] [MAIN ] IIM: Generated 1352 derivative records from 11433 primary records. [2025-09-14T20:55:13.391220] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-14T20:55:13.406438] [DEBUG] [MAIN ] IIIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:13.413307] [INFO ] [MAIN ] IIIN: Generated 1352 derivative records from 12082 primary records. [2025-09-14T20:55:13.419572] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-14T20:55:13.421765] [DEBUG] [LOCAL ] IIM: Derivative data saved (1352 records). [2025-09-14T20:55:13.424199] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-14T20:55:13.431974] [INFO ] [MAIN ] Derivative Progress: 1042/2226 symbols completed. IIM took 1.1s. Estimated remaining: 6m 58s. Rate: 169.8 symbols/min [2025-09-14T20:55:13.436509] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:13.441022] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1352 records). [2025-09-14T20:55:13.443930] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-14T20:55:13.453721] [INFO ] [MAIN ] Derivative Progress: 1043/2226 symbols completed. IIIN took 1.1s. Estimated remaining: 6m 58s. Rate: 170.0 symbols/min [2025-09-14T20:55:13.458774] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:13.459223] [DEBUG] [MAIN ] IIPR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:13.460880] [INFO ] [MAIN ] IIPR: Generated 1352 derivative records from 20957 primary records. [2025-09-14T20:55:13.461157] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-14T20:55:13.476390] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1352 records). [2025-09-14T20:55:13.476684] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-14T20:55:13.479967] [INFO ] [MAIN ] Derivative Progress: 1044/2226 symbols completed. IIPR took 1.1s. Estimated remaining: 6m 57s. Rate: 170.1 symbols/min [2025-09-14T20:55:13.480522] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:13.542440] [DEBUG] [LOCAL ] IMAX: Loaded 32221 existing records from primary storage. [2025-09-14T20:55:13.542775] [INFO ] [MAIN ] IMAX: Loaded 32221 primary data records. [2025-09-14T20:55:13.680125] [DEBUG] [LOCAL ] INFA: Loaded 37626 existing records from primary storage. [2025-09-14T20:55:13.680747] [INFO ] [MAIN ] INFA: Loaded 37626 primary data records. [2025-09-14T20:55:13.681429] [DEBUG] [LOCAL ] INFY: Loaded 40348 existing records from primary storage. [2025-09-14T20:55:13.701701] [INFO ] [MAIN ] INFY: Loaded 40348 primary data records. [2025-09-14T20:55:14.482229] [DEBUG] [MAIN ] IMAX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:14.484071] [INFO ] [MAIN ] IMAX: Generated 1352 derivative records from 32221 primary records. [2025-09-14T20:55:14.484453] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-14T20:55:14.509466] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1352 records). [2025-09-14T20:55:14.513909] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-14T20:55:14.524131] [DEBUG] [MAIN ] INFY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:14.524535] [DEBUG] [MAIN ] INFA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:14.527624] [INFO ] [MAIN ] INFY: Generated 1352 derivative records from 40348 primary records. [2025-09-14T20:55:14.526465] [INFO ] [MAIN ] Derivative Progress: 1045/2226 symbols completed. IMAX took 1.1s. Estimated remaining: 6m 57s. Rate: 169.8 symbols/min [2025-09-14T20:55:14.528827] [INFO ] [MAIN ] INFA: Generated 1352 derivative records from 37626 primary records. [2025-09-14T20:55:14.529190] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:14.529343] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-14T20:55:14.527907] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-14T20:55:14.558867] [DEBUG] [LOCAL ] INFA: Derivative data saved (1352 records). [2025-09-14T20:55:14.560443] [DEBUG] [LOCAL ] INFY: Derivative data saved (1352 records). [2025-09-14T20:55:14.560558] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-14T20:55:14.560790] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-14T20:55:14.563848] [INFO ] [MAIN ] Derivative Progress: 1046/2226 symbols completed. INFA took 1.1s. Estimated remaining: 6m 57s. Rate: 169.9 symbols/min [2025-09-14T20:55:14.567865] [INFO ] [MAIN ] Derivative Progress: 1047/2226 symbols completed. INFY took 1.1s. Estimated remaining: 6m 56s. Rate: 170.1 symbols/min [2025-09-14T20:55:14.567993] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:14.568635] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:14.623850] [DEBUG] [LOCAL ] INGM: Loaded 20645 existing records from primary storage. [2025-09-14T20:55:14.625984] [DEBUG] [LOCAL ] ING: Loaded 38033 existing records from primary storage. [2025-09-14T20:55:14.626071] [INFO ] [MAIN ] INGM: Loaded 20645 primary data records. [2025-09-14T20:55:14.633842] [INFO ] [MAIN ] ING: Loaded 38033 primary data records. [2025-09-14T20:55:14.654944] [DEBUG] [LOCAL ] INGR: Loaded 24281 existing records from primary storage. [2025-09-14T20:55:14.726118] [INFO ] [MAIN ] INGR: Loaded 24281 primary data records. [2025-09-14T20:55:15.575126] [DEBUG] [MAIN ] INGM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:15.577063] [INFO ] [MAIN ] INGM: Generated 1352 derivative records from 20645 primary records. [2025-09-14T20:55:15.578505] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-14T20:55:15.597283] [DEBUG] [LOCAL ] INGM: Derivative data saved (1352 records). [2025-09-14T20:55:15.597774] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-14T20:55:15.606553] [INFO ] [MAIN ] Derivative Progress: 1048/2226 symbols completed. INGM took 1.0s. Estimated remaining: 6m 56s. Rate: 169.8 symbols/min [2025-09-14T20:55:15.618057] [DEBUG] [MAIN ] ING: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:15.623055] [DEBUG] [MAIN ] INGR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:15.624689] [INFO ] [MAIN ] ING: Generated 1352 derivative records from 38033 primary records. [2025-09-14T20:55:15.625668] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-14T20:55:15.625789] [INFO ] [MAIN ] INGR: Generated 1352 derivative records from 24281 primary records. [2025-09-14T20:55:15.627058] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-14T20:55:15.651955] [DEBUG] [LOCAL ] INGR: Derivative data saved (1352 records). [2025-09-14T20:55:15.654058] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-14T20:55:15.653864] [DEBUG] [LOCAL ] ING: Derivative data saved (1352 records). [2025-09-14T20:55:15.656856] [INFO ] [MAIN ] Derivative Progress: 1049/2226 symbols completed. INGR took 1.1s. Estimated remaining: 6m 56s. Rate: 169.9 symbols/min [2025-09-14T20:55:15.657132] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-14T20:55:15.660481] [INFO ] [MAIN ] Derivative Progress: 1050/2226 symbols completed. ING took 1.1s. Estimated remaining: 6m 55s. Rate: 170.1 symbols/min [2025-09-14T20:55:15.661687] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:15.661366] [INFO ] [MAIN ] INR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:15.661590] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:15.702088] [DEBUG] [LOCAL ] INR: Loaded 19412 existing records from primary storage. [2025-09-14T20:55:15.721784] [INFO ] [MAIN ] INR: Loaded 19412 primary data records. [2025-09-14T20:55:15.722530] [DEBUG] [LOCAL ] INN: Loaded 31920 existing records from primary storage. [2025-09-14T20:55:15.728415] [DEBUG] [LOCAL ] INSP: Loaded 28161 existing records from primary storage. [2025-09-14T20:55:15.767531] [INFO ] [MAIN ] INSP: Loaded 28161 primary data records. [2025-09-14T20:55:15.767775] [INFO ] [MAIN ] INN: Loaded 31920 primary data records. [2025-09-14T20:55:16.572892] [DEBUG] [MAIN ] INR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:16.583706] [INFO ] [MAIN ] INR: Generated 1352 derivative records from 19412 primary records. [2025-09-14T20:55:16.585719] [DEBUG] [LOCAL ] INR: Saving derivative data. [2025-09-14T20:55:16.584082] [DEBUG] [MAIN ] INN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:16.586894] [INFO ] [MAIN ] INN: Generated 1352 derivative records from 31920 primary records. [2025-09-14T20:55:16.587794] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-14T20:55:16.607803] [DEBUG] [MAIN ] INSP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:16.609666] [INFO ] [MAIN ] INSP: Generated 1352 derivative records from 28161 primary records. [2025-09-14T20:55:16.610003] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-14T20:55:16.627705] [DEBUG] [LOCAL ] INR: Derivative data saved (1352 records). [2025-09-14T20:55:16.633027] [DEBUG] [LOCAL ] INN: Derivative data saved (1352 records). [2025-09-14T20:55:16.635001] [INFO ] [MAIN ] INR: Successfully saved derivative data. [2025-09-14T20:55:16.636572] [DEBUG] [LOCAL ] INSP: Derivative data saved (1352 records). [2025-09-14T20:55:16.636684] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-14T20:55:16.636920] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-14T20:55:16.638512] [INFO ] [MAIN ] Derivative Progress: 1051/2226 symbols completed. INR took 1.0s. Estimated remaining: 6m 55s. Rate: 169.8 symbols/min [2025-09-14T20:55:16.643571] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:16.643613] [INFO ] [MAIN ] Derivative Progress: 1052/2226 symbols completed. INN took 1.0s. Estimated remaining: 6m 54s. Rate: 170.0 symbols/min [2025-09-14T20:55:16.643956] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:16.644439] [INFO ] [MAIN ] Derivative Progress: 1053/2226 symbols completed. INSP took 1.0s. Estimated remaining: 6m 54s. Rate: 170.1 symbols/min [2025-09-14T20:55:16.644952] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:16.689851] [DEBUG] [LOCAL ] INVX: Loaded 21811 existing records from primary storage. [2025-09-14T20:55:16.690547] [INFO ] [MAIN ] INVX: Loaded 21811 primary data records. [2025-09-14T20:55:16.765977] [DEBUG] [LOCAL ] INSW: Loaded 29866 existing records from primary storage. [2025-09-14T20:55:16.783702] [INFO ] [MAIN ] INSW: Loaded 29866 primary data records. [2025-09-14T20:55:16.933620] [DEBUG] [LOCAL ] INVH: Loaded 39992 existing records from primary storage. [2025-09-14T20:55:16.984786] [INFO ] [MAIN ] INVH: Loaded 39992 primary data records. [2025-09-14T20:55:17.646657] [DEBUG] [MAIN ] INVX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:17.651536] [INFO ] [MAIN ] INVX: Generated 1352 derivative records from 21811 primary records. [2025-09-14T20:55:17.662592] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-14T20:55:17.662477] [DEBUG] [MAIN ] INSW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:17.663672] [INFO ] [MAIN ] INSW: Generated 1352 derivative records from 29866 primary records. [2025-09-14T20:55:17.663840] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-14T20:55:17.687489] [DEBUG] [LOCAL ] INVX: Derivative data saved (1352 records). [2025-09-14T20:55:17.689456] [DEBUG] [LOCAL ] INSW: Derivative data saved (1352 records). [2025-09-14T20:55:17.689574] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-14T20:55:17.689635] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-14T20:55:17.691412] [INFO ] [MAIN ] Derivative Progress: 1054/2226 symbols completed. INVX took 1.0s. Estimated remaining: 6m 54s. Rate: 169.8 symbols/min [2025-09-14T20:55:17.696752] [INFO ] [MAIN ] Derivative Progress: 1055/2226 symbols completed. INSW took 1.1s. Estimated remaining: 6m 53s. Rate: 170.0 symbols/min [2025-09-14T20:55:17.696913] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:17.697752] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:17.710173] [DEBUG] [MAIN ] INVH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:17.711125] [INFO ] [MAIN ] INVH: Generated 1352 derivative records from 39992 primary records. [2025-09-14T20:55:17.711348] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-14T20:55:17.724551] [DEBUG] [LOCAL ] INVH: Derivative data saved (1352 records). [2025-09-14T20:55:17.724847] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-14T20:55:17.727543] [INFO ] [MAIN ] Derivative Progress: 1056/2226 symbols completed. INVH took 1.1s. Estimated remaining: 6m 53s. Rate: 170.1 symbols/min [2025-09-14T20:55:17.727928] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:17.794715] [DEBUG] [LOCAL ] IOT: Loaded 40234 existing records from primary storage. [2025-09-14T20:55:17.795348] [DEBUG] [LOCAL ] IONQ: Loaded 40528 existing records from primary storage. [2025-09-14T20:55:17.795588] [INFO ] [MAIN ] IONQ: Loaded 40528 primary data records. [2025-09-14T20:55:17.795728] [INFO ] [MAIN ] IOT: Loaded 40234 primary data records. [2025-09-14T20:55:18.003609] [DEBUG] [LOCAL ] IP: Loaded 40086 existing records from primary storage. [2025-09-14T20:55:18.018787] [INFO ] [MAIN ] IP: Loaded 40086 primary data records. [2025-09-14T20:55:18.664104] [DEBUG] [MAIN ] IONQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:18.664584] [DEBUG] [MAIN ] IOT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:18.665301] [INFO ] [MAIN ] IONQ: Generated 1352 derivative records from 40528 primary records. [2025-09-14T20:55:18.665462] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-14T20:55:18.666550] [INFO ] [MAIN ] IOT: Generated 1352 derivative records from 40234 primary records. [2025-09-14T20:55:18.669227] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-14T20:55:18.697074] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1352 records). [2025-09-14T20:55:18.697013] [DEBUG] [MAIN ] IP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:18.713798] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-14T20:55:18.715166] [INFO ] [MAIN ] IP: Generated 1352 derivative records from 40086 primary records. [2025-09-14T20:55:18.718107] [INFO ] [MAIN ] Derivative Progress: 1057/2226 symbols completed. IONQ took 1.0s. Estimated remaining: 6m 53s. Rate: 169.8 symbols/min [2025-09-14T20:55:18.718453] [DEBUG] [LOCAL ] IOT: Derivative data saved (1352 records). [2025-09-14T20:55:18.718939] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:18.719043] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-14T20:55:18.719166] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-14T20:55:18.721962] [INFO ] [MAIN ] Derivative Progress: 1058/2226 symbols completed. IOT took 1.0s. Estimated remaining: 6m 52s. Rate: 170.0 symbols/min [2025-09-14T20:55:18.723620] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:18.736200] [DEBUG] [LOCAL ] IP: Derivative data saved (1352 records). [2025-09-14T20:55:18.736747] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-14T20:55:18.739219] [INFO ] [MAIN ] Derivative Progress: 1059/2226 symbols completed. IP took 1.0s. Estimated remaining: 6m 52s. Rate: 170.1 symbols/min [2025-09-14T20:55:18.739666] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:18.759994] [DEBUG] [LOCAL ] IPI: Loaded 15746 existing records from primary storage. [2025-09-14T20:55:18.765362] [INFO ] [MAIN ] IPI: Loaded 15746 primary data records. [2025-09-14T20:55:18.765897] [DEBUG] [LOCAL ] IQI: Loaded 13766 existing records from primary storage. [2025-09-14T20:55:18.787167] [INFO ] [MAIN ] IQI: Loaded 13766 primary data records. [2025-09-14T20:55:19.008866] [DEBUG] [LOCAL ] IPG: Loaded 40092 existing records from primary storage. [2025-09-14T20:55:19.051995] [INFO ] [MAIN ] IPG: Loaded 40092 primary data records. [2025-09-14T20:55:19.699357] [DEBUG] [MAIN ] IPI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:19.702694] [INFO ] [MAIN ] IPI: Generated 1352 derivative records from 15746 primary records. [2025-09-14T20:55:19.702976] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-14T20:55:19.714914] [DEBUG] [MAIN ] IQI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:19.716676] [INFO ] [MAIN ] IQI: Generated 1352 derivative records from 13766 primary records. [2025-09-14T20:55:19.728949] [DEBUG] [LOCAL ] IPI: Derivative data saved (1352 records). [2025-09-14T20:55:19.728774] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-14T20:55:19.729099] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-14T20:55:19.731753] [INFO ] [MAIN ] Derivative Progress: 1060/2226 symbols completed. IPI took 1.0s. Estimated remaining: 6m 52s. Rate: 169.8 symbols/min [2025-09-14T20:55:19.732780] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:19.746685] [DEBUG] [LOCAL ] IQI: Derivative data saved (1352 records). [2025-09-14T20:55:19.747053] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-14T20:55:19.749711] [INFO ] [MAIN ] Derivative Progress: 1061/2226 symbols completed. IQI took 1.0s. Estimated remaining: 6m 51s. Rate: 170.0 symbols/min [2025-09-14T20:55:19.750682] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:19.767689] [DEBUG] [MAIN ] IPG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:19.768816] [INFO ] [MAIN ] IPG: Generated 1352 derivative records from 40092 primary records. [2025-09-14T20:55:19.768926] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-14T20:55:19.793054] [DEBUG] [LOCAL ] IPG: Derivative data saved (1352 records). [2025-09-14T20:55:19.793383] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-14T20:55:19.795598] [INFO ] [MAIN ] Derivative Progress: 1062/2226 symbols completed. IPG took 1.1s. Estimated remaining: 6m 51s. Rate: 170.1 symbols/min [2025-09-14T20:55:19.796070] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:19.827208] [DEBUG] [LOCAL ] IQV: Loaded 37989 existing records from primary storage. [2025-09-14T20:55:19.828075] [INFO ] [MAIN ] IQV: Loaded 37989 primary data records. [2025-09-14T20:55:19.863285] [DEBUG] [LOCAL ] IR: Loaded 39643 existing records from primary storage. [2025-09-14T20:55:19.934371] [INFO ] [MAIN ] IR: Loaded 39643 primary data records. [2025-09-14T20:55:20.106398] [DEBUG] [LOCAL ] IRM: Loaded 36689 existing records from primary storage. [2025-09-14T20:55:20.149680] [INFO ] [MAIN ] IRM: Loaded 36689 primary data records. [2025-09-14T20:55:20.835202] [DEBUG] [MAIN ] IQV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:20.846819] [INFO ] [MAIN ] IQV: Generated 1352 derivative records from 37989 primary records. [2025-09-14T20:55:20.847328] [DEBUG] [MAIN ] IR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:20.847996] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-14T20:55:20.849731] [INFO ] [MAIN ] IR: Generated 1352 derivative records from 39643 primary records. [2025-09-14T20:55:20.850858] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-14T20:55:20.876996] [DEBUG] [LOCAL ] IQV: Derivative data saved (1352 records). [2025-09-14T20:55:20.877484] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-14T20:55:20.879799] [INFO ] [MAIN ] Derivative Progress: 1063/2226 symbols completed. IQV took 1.1s. Estimated remaining: 6m 51s. Rate: 169.8 symbols/min [2025-09-14T20:55:20.881670] [DEBUG] [LOCAL ] IR: Derivative data saved (1352 records). [2025-09-14T20:55:20.881851] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-14T20:55:20.884512] [INFO ] [MAIN ] Derivative Progress: 1064/2226 symbols completed. IR took 1.1s. Estimated remaining: 6m 50s. Rate: 170.0 symbols/min [2025-09-14T20:55:20.894687] [DEBUG] [MAIN ] IRM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:20.895420] [INFO ] [MAIN ] IRM: Generated 1352 derivative records from 36689 primary records. [2025-09-14T20:55:20.895546] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-14T20:55:20.908344] [DEBUG] [LOCAL ] IRM: Derivative data saved (1352 records). [2025-09-14T20:55:20.908428] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-14T20:55:20.910566] [INFO ] [MAIN ] Derivative Progress: 1065/2226 symbols completed. IRM took 1.1s. Estimated remaining: 6m 50s. Rate: 170.1 symbols/min [2025-09-14T20:55:20.911429] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:20.911317] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:20.911516] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:20.934855] [DEBUG] [LOCAL ] ISD: Loaded 11353 existing records from primary storage. [2025-09-14T20:55:20.935041] [INFO ] [MAIN ] ISD: Loaded 11353 primary data records. [2025-09-14T20:55:21.006927] [DEBUG] [LOCAL ] IRS: Loaded 16383 existing records from primary storage. [2025-09-14T20:55:21.044086] [INFO ] [MAIN ] IRS: Loaded 16383 primary data records. [2025-09-14T20:55:21.232819] [DEBUG] [LOCAL ] IRT: Loaded 37875 existing records from primary storage. [2025-09-14T20:55:21.339561] [INFO ] [MAIN ] IRT: Loaded 37875 primary data records. [2025-09-14T20:55:21.823707] [DEBUG] [MAIN ] ISD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:21.826458] [INFO ] [MAIN ] ISD: Generated 1352 derivative records from 11353 primary records. [2025-09-14T20:55:21.828112] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-14T20:55:21.849672] [DEBUG] [MAIN ] IRS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:21.853530] [INFO ] [MAIN ] IRS: Generated 1352 derivative records from 16383 primary records. [2025-09-14T20:55:21.854563] [DEBUG] [LOCAL ] ISD: Derivative data saved (1352 records). [2025-09-14T20:55:21.854935] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-14T20:55:21.855099] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-14T20:55:21.857978] [INFO ] [MAIN ] Derivative Progress: 1066/2226 symbols completed. ISD took 0.9s. Estimated remaining: 6m 50s. Rate: 169.8 symbols/min [2025-09-14T20:55:21.864695] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:21.872775] [DEBUG] [LOCAL ] IRS: Derivative data saved (1352 records). [2025-09-14T20:55:21.874595] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-14T20:55:21.877623] [INFO ] [MAIN ] Derivative Progress: 1067/2226 symbols completed. IRS took 1.0s. Estimated remaining: 6m 49s. Rate: 170.0 symbols/min [2025-09-14T20:55:21.878229] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:21.889035] [DEBUG] [MAIN ] IRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:21.890262] [INFO ] [MAIN ] IRT: Generated 1352 derivative records from 37875 primary records. [2025-09-14T20:55:21.891065] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-14T20:55:21.905067] [DEBUG] [LOCAL ] IRT: Derivative data saved (1352 records). [2025-09-14T20:55:21.905301] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-14T20:55:21.907345] [INFO ] [MAIN ] Derivative Progress: 1068/2226 symbols completed. IRT took 1.0s. Estimated remaining: 6m 48s. Rate: 170.1 symbols/min [2025-09-14T20:55:21.907656] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:21.942746] [DEBUG] [LOCAL ] IT: Loaded 31043 existing records from primary storage. [2025-09-14T20:55:21.943383] [DEBUG] [LOCAL ] ITGR: Loaded 22907 existing records from primary storage. [2025-09-14T20:55:21.943724] [INFO ] [MAIN ] ITGR: Loaded 22907 primary data records. [2025-09-14T20:55:21.943608] [INFO ] [MAIN ] IT: Loaded 31043 primary data records. [2025-09-14T20:55:22.174362] [DEBUG] [LOCAL ] ITT: Loaded 24053 existing records from primary storage. [2025-09-14T20:55:22.215759] [INFO ] [MAIN ] ITT: Loaded 24053 primary data records. [2025-09-14T20:55:22.871484] [DEBUG] [MAIN ] ITGR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:22.884393] [DEBUG] [MAIN ] IT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:22.882719] [INFO ] [MAIN ] ITGR: Generated 1352 derivative records from 22907 primary records. [2025-09-14T20:55:22.885436] [INFO ] [MAIN ] IT: Generated 1352 derivative records from 31043 primary records. [2025-09-14T20:55:22.885714] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-14T20:55:22.885817] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-14T20:55:22.897129] [DEBUG] [MAIN ] ITT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:22.904579] [INFO ] [MAIN ] ITT: Generated 1352 derivative records from 24053 primary records. [2025-09-14T20:55:22.910266] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-14T20:55:22.922467] [DEBUG] [LOCAL ] IT: Derivative data saved (1352 records). [2025-09-14T20:55:22.920816] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1352 records). [2025-09-14T20:55:22.923500] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-14T20:55:22.923973] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-14T20:55:22.927236] [INFO ] [MAIN ] Derivative Progress: 1069/2226 symbols completed. IT took 1.1s. Estimated remaining: 6m 49s. Rate: 169.8 symbols/min [2025-09-14T20:55:22.929180] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:22.941580] [DEBUG] [LOCAL ] ITT: Derivative data saved (1352 records). [2025-09-14T20:55:22.929225] [INFO ] [MAIN ] Derivative Progress: 1070/2226 symbols completed. ITGR took 1.1s. Estimated remaining: 6m 48s. Rate: 170.0 symbols/min [2025-09-14T20:55:22.942205] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-14T20:55:22.942352] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:22.944221] [INFO ] [MAIN ] Derivative Progress: 1071/2226 symbols completed. ITT took 1.0s. Estimated remaining: 6m 47s. Rate: 170.1 symbols/min [2025-09-14T20:55:22.944967] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:23.010319] [DEBUG] [LOCAL ] IVR: Loaded 35633 existing records from primary storage. [2025-09-14T20:55:23.011061] [DEBUG] [LOCAL ] ITW: Loaded 34479 existing records from primary storage. [2025-09-14T20:55:23.011706] [INFO ] [MAIN ] ITW: Loaded 34479 primary data records. [2025-09-14T20:55:23.011553] [INFO ] [MAIN ] IVR: Loaded 35633 primary data records. [2025-09-14T20:55:23.167929] [DEBUG] [LOCAL ] ITUB: Loaded 40153 existing records from primary storage. [2025-09-14T20:55:23.201708] [INFO ] [MAIN ] ITUB: Loaded 40153 primary data records. [2025-09-14T20:55:23.939893] [DEBUG] [MAIN ] IVR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:23.952915] [INFO ] [MAIN ] IVR: Generated 1352 derivative records from 35633 primary records. [2025-09-14T20:55:23.953269] [DEBUG] [MAIN ] ITW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:23.953739] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-14T20:55:23.954458] [INFO ] [MAIN ] ITW: Generated 1352 derivative records from 34479 primary records. [2025-09-14T20:55:23.965518] [DEBUG] [MAIN ] ITUB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:23.966255] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-14T20:55:23.967289] [INFO ] [MAIN ] ITUB: Generated 1352 derivative records from 40153 primary records. [2025-09-14T20:55:23.977440] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-14T20:55:23.988949] [DEBUG] [LOCAL ] IVR: Derivative data saved (1352 records). [2025-09-14T20:55:23.996730] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-14T20:55:24.004614] [INFO ] [MAIN ] Derivative Progress: 1072/2226 symbols completed. IVR took 1.1s. Estimated remaining: 6m 48s. Rate: 169.8 symbols/min [2025-09-14T20:55:24.006758] [DEBUG] [LOCAL ] ITW: Derivative data saved (1352 records). [2025-09-14T20:55:24.008711] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1352 records). [2025-09-14T20:55:24.009094] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-14T20:55:24.009023] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-14T20:55:24.011344] [INFO ] [MAIN ] Derivative Progress: 1073/2226 symbols completed. ITUB took 1.1s. Estimated remaining: 6m 47s. Rate: 170.0 symbols/min [2025-09-14T20:55:24.014284] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:24.014407] [INFO ] [MAIN ] Derivative Progress: 1074/2226 symbols completed. ITW took 1.1s. Estimated remaining: 6m 46s. Rate: 170.1 symbols/min [2025-09-14T20:55:24.014178] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:24.014831] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:24.065207] [DEBUG] [LOCAL ] IX: Loaded 16716 existing records from primary storage. [2025-09-14T20:55:24.073262] [INFO ] [MAIN ] IX: Loaded 16716 primary data records. [2025-09-14T20:55:24.109400] [DEBUG] [LOCAL ] IVT: Loaded 22821 existing records from primary storage. [2025-09-14T20:55:24.131825] [INFO ] [MAIN ] IVT: Loaded 22821 primary data records. [2025-09-14T20:55:24.327266] [DEBUG] [LOCAL ] IVZ: Loaded 39955 existing records from primary storage. [2025-09-14T20:55:24.404603] [INFO ] [MAIN ] IVZ: Loaded 39955 primary data records. [2025-09-14T20:55:25.053063] [DEBUG] [MAIN ] IX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:25.054224] [INFO ] [MAIN ] IX: Generated 1352 derivative records from 16716 primary records. [2025-09-14T20:55:25.054731] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-14T20:55:25.081203] [DEBUG] [MAIN ] IVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:25.082545] [DEBUG] [LOCAL ] IX: Derivative data saved (1352 records). [2025-09-14T20:55:25.083452] [INFO ] [MAIN ] IVT: Generated 1352 derivative records from 22821 primary records. [2025-09-14T20:55:25.083636] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-14T20:55:25.086684] [INFO ] [MAIN ] Derivative Progress: 1075/2226 symbols completed. IX took 1.1s. Estimated remaining: 6m 47s. Rate: 169.8 symbols/min [2025-09-14T20:55:25.087663] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-14T20:55:25.088878] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:25.116591] [DEBUG] [LOCAL ] IVT: Derivative data saved (1352 records). [2025-09-14T20:55:25.117046] [DEBUG] [MAIN ] IVZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:25.117370] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-14T20:55:25.120618] [INFO ] [MAIN ] Derivative Progress: 1076/2226 symbols completed. IVT took 1.1s. Estimated remaining: 6m 46s. Rate: 170.0 symbols/min [2025-09-14T20:55:25.121635] [INFO ] [MAIN ] IVZ: Generated 1352 derivative records from 39955 primary records. [2025-09-14T20:55:25.122205] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:25.122260] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-14T20:55:25.137904] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1352 records). [2025-09-14T20:55:25.138124] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-14T20:55:25.140103] [INFO ] [MAIN ] Derivative Progress: 1077/2226 symbols completed. IVZ took 1.1s. Estimated remaining: 6m 45s. Rate: 170.1 symbols/min [2025-09-14T20:55:25.140504] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:25.189923] [DEBUG] [LOCAL ] J: Loaded 29890 existing records from primary storage. [2025-09-14T20:55:25.198837] [INFO ] [MAIN ] J: Loaded 29890 primary data records. [2025-09-14T20:55:25.199406] [DEBUG] [LOCAL ] JBGS: Loaded 31869 existing records from primary storage. [2025-09-14T20:55:25.221049] [INFO ] [MAIN ] JBGS: Loaded 31869 primary data records. [2025-09-14T20:55:25.439926] [DEBUG] [LOCAL ] JBI: Loaded 32393 existing records from primary storage. [2025-09-14T20:55:25.455911] [INFO ] [MAIN ] JBI: Loaded 32393 primary data records. [2025-09-14T20:55:26.127120] [DEBUG] [MAIN ] JBGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:26.138056] [INFO ] [MAIN ] JBGS: Generated 1352 derivative records from 31869 primary records. [2025-09-14T20:55:26.137153] [DEBUG] [MAIN ] J: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:26.138251] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-14T20:55:26.138838] [INFO ] [MAIN ] J: Generated 1352 derivative records from 29890 primary records. [2025-09-14T20:55:26.139959] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-14T20:55:26.171861] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1352 records). [2025-09-14T20:55:26.183055] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-14T20:55:26.183600] [DEBUG] [MAIN ] JBI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:26.187362] [INFO ] [MAIN ] JBI: Generated 1352 derivative records from 32393 primary records. [2025-09-14T20:55:26.187441] [DEBUG] [LOCAL ] J: Derivative data saved (1352 records). [2025-09-14T20:55:26.186477] [INFO ] [MAIN ] Derivative Progress: 1078/2226 symbols completed. JBGS took 1.1s. Estimated remaining: 6m 46s. Rate: 169.8 symbols/min [2025-09-14T20:55:26.187621] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-14T20:55:26.190304] [INFO ] [MAIN ] Derivative Progress: 1079/2226 symbols completed. J took 1.1s. Estimated remaining: 6m 45s. Rate: 170.0 symbols/min [2025-09-14T20:55:26.190086] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-14T20:55:26.203060] [DEBUG] [LOCAL ] JBI: Derivative data saved (1352 records). [2025-09-14T20:55:26.203228] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-14T20:55:26.205850] [INFO ] [MAIN ] Derivative Progress: 1080/2226 symbols completed. JBI took 1.1s. Estimated remaining: 6m 44s. Rate: 170.1 symbols/min [2025-09-14T20:55:26.206478] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:26.206672] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:26.206610] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:26.263379] [DEBUG] [LOCAL ] JBND: Loaded 19070 existing records from primary storage. [2025-09-14T20:55:26.272507] [INFO ] [MAIN ] JBND: Loaded 19070 primary data records. [2025-09-14T20:55:26.278459] [DEBUG] [LOCAL ] JBTM: Loaded 24291 existing records from primary storage. [2025-09-14T20:55:26.322522] [INFO ] [MAIN ] JBTM: Loaded 24291 primary data records. [2025-09-14T20:55:26.368435] [DEBUG] [LOCAL ] JBL: Loaded 35773 existing records from primary storage. [2025-09-14T20:55:26.448419] [INFO ] [MAIN ] JBL: Loaded 35773 primary data records. [2025-09-14T20:55:27.196321] [DEBUG] [MAIN ] JBND: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:27.197604] [INFO ] [MAIN ] JBND: Generated 1352 derivative records from 19070 primary records. [2025-09-14T20:55:27.198580] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-14T20:55:27.214687] [DEBUG] [LOCAL ] JBND: Derivative data saved (1352 records). [2025-09-14T20:55:27.215594] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-14T20:55:27.217748] [INFO ] [MAIN ] Derivative Progress: 1081/2226 symbols completed. JBND took 1.0s. Estimated remaining: 6m 45s. Rate: 169.8 symbols/min [2025-09-14T20:55:27.228171] [DEBUG] [MAIN ] JBTM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:27.228456] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:27.230588] [INFO ] [MAIN ] JBTM: Generated 1352 derivative records from 24291 primary records. [2025-09-14T20:55:27.232483] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-09-14T20:55:27.245808] [DEBUG] [MAIN ] JBL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:27.258391] [INFO ] [MAIN ] JBL: Generated 1352 derivative records from 35773 primary records. [2025-09-14T20:55:27.258873] [DEBUG] [LOCAL ] JCE: Loaded 4706 existing records from primary storage. [2025-09-14T20:55:27.259661] [INFO ] [MAIN ] JCE: Loaded 4706 primary data records. [2025-09-14T20:55:27.259964] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-14T20:55:27.273514] [DEBUG] [LOCAL ] JBTM: Derivative data saved (1352 records). [2025-09-14T20:55:27.334347] [INFO ] [MAIN ] JBTM: Successfully saved derivative data. [2025-09-14T20:55:27.354139] [INFO ] [MAIN ] Derivative Progress: 1082/2226 symbols completed. JBTM took 1.1s. Estimated remaining: 6m 44s. Rate: 169.9 symbols/min [2025-09-14T20:55:27.376200] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:27.382976] [DEBUG] [LOCAL ] JBL: Derivative data saved (1352 records). [2025-09-14T20:55:27.389119] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-14T20:55:27.432892] [INFO ] [MAIN ] Derivative Progress: 1083/2226 symbols completed. JBL took 1.2s. Estimated remaining: 6m 43s. Rate: 170.0 symbols/min [2025-09-14T20:55:27.448920] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:27.655513] [DEBUG] [LOCAL ] JCI: Loaded 40310 existing records from primary storage. [2025-09-14T20:55:27.656024] [INFO ] [MAIN ] JCI: Loaded 40310 primary data records. [2025-09-14T20:55:27.780126] [DEBUG] [MAIN ] JCE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:27.793659] [DEBUG] [LOCAL ] JEF: Loaded 37153 existing records from primary storage. [2025-09-14T20:55:27.793075] [INFO ] [MAIN ] JCE: Generated 1352 derivative records from 4706 primary records. [2025-09-14T20:55:27.809451] [INFO ] [MAIN ] JEF: Loaded 37153 primary data records. [2025-09-14T20:55:27.809583] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-14T20:55:28.083087] [DEBUG] [LOCAL ] JCE: Derivative data saved (1352 records). [2025-09-14T20:55:28.089027] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-14T20:55:28.128622] [INFO ] [MAIN ] Derivative Progress: 1084/2226 symbols completed. JCE took 0.9s. Estimated remaining: 6m 43s. Rate: 169.9 symbols/min [2025-09-14T20:55:28.163502] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:28.287797] [DEBUG] [MAIN ] JCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:28.288985] [INFO ] [MAIN ] JCI: Generated 1352 derivative records from 40310 primary records. [2025-09-14T20:55:28.289306] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-14T20:55:28.323225] [DEBUG] [MAIN ] JEF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:28.324882] [DEBUG] [LOCAL ] JCI: Derivative data saved (1352 records). [2025-09-14T20:55:28.325701] [INFO ] [MAIN ] JEF: Generated 1352 derivative records from 37153 primary records. [2025-09-14T20:55:28.326450] [DEBUG] [LOCAL ] JELD: Loaded 34820 existing records from primary storage. [2025-09-14T20:55:28.326546] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-14T20:55:28.326591] [INFO ] [MAIN ] JELD: Loaded 34820 primary data records. [2025-09-14T20:55:28.326627] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-14T20:55:28.329403] [INFO ] [MAIN ] Derivative Progress: 1085/2226 symbols completed. JCI took 1.0s. Estimated remaining: 6m 43s. Rate: 169.9 symbols/min [2025-09-14T20:55:28.371159] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:28.463278] [DEBUG] [LOCAL ] JEQ: Loaded 5984 existing records from primary storage. [2025-09-14T20:55:28.463353] [DEBUG] [LOCAL ] JEF: Derivative data saved (1352 records). [2025-09-14T20:55:28.525983] [INFO ] [MAIN ] JEQ: Loaded 5984 primary data records. [2025-09-14T20:55:28.502031] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-14T20:55:28.631826] [INFO ] [MAIN ] Derivative Progress: 1086/2226 symbols completed. JEF took 1.2s. Estimated remaining: 6m 42s. Rate: 170.0 symbols/min [2025-09-14T20:55:28.676666] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:28.939575] [DEBUG] [LOCAL ] JFR: Loaded 21807 existing records from primary storage. [2025-09-14T20:55:28.943011] [INFO ] [MAIN ] JFR: Loaded 21807 primary data records. [2025-09-14T20:55:29.001052] [DEBUG] [MAIN ] JELD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:29.065419] [INFO ] [MAIN ] JELD: Generated 1352 derivative records from 34820 primary records. [2025-09-14T20:55:29.071872] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-14T20:55:29.161339] [DEBUG] [LOCAL ] JELD: Derivative data saved (1352 records). [2025-09-14T20:55:29.251431] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-14T20:55:29.254544] [INFO ] [MAIN ] Derivative Progress: 1087/2226 symbols completed. JELD took 1.1s. Estimated remaining: 6m 42s. Rate: 169.8 symbols/min [2025-09-14T20:55:29.255259] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:29.266629] [DEBUG] [MAIN ] JEQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:29.268526] [INFO ] [MAIN ] JEQ: Generated 1352 derivative records from 5984 primary records. [2025-09-14T20:55:29.269214] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-14T20:55:29.284089] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1352 records). [2025-09-14T20:55:29.284309] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-14T20:55:29.286124] [INFO ] [MAIN ] Derivative Progress: 1088/2226 symbols completed. JEQ took 0.9s. Estimated remaining: 6m 42s. Rate: 170.0 symbols/min [2025-09-14T20:55:29.287632] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:29.291715] [DEBUG] [LOCAL ] JGH: Loaded 8181 existing records from primary storage. [2025-09-14T20:55:29.292031] [INFO ] [MAIN ] JGH: Loaded 8181 primary data records. [2025-09-14T20:55:29.515748] [DEBUG] [MAIN ] JFR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:29.609254] [INFO ] [MAIN ] JFR: Generated 1352 derivative records from 21807 primary records. [2025-09-14T20:55:29.610955] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-14T20:55:29.610755] [DEBUG] [LOCAL ] JHG: Loaded 35896 existing records from primary storage. [2025-09-14T20:55:29.612379] [INFO ] [MAIN ] JHG: Loaded 35896 primary data records. [2025-09-14T20:55:29.705391] [DEBUG] [LOCAL ] JFR: Derivative data saved (1352 records). [2025-09-14T20:55:29.735193] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-14T20:55:29.789454] [INFO ] [MAIN ] Derivative Progress: 1089/2226 symbols completed. JFR took 1.1s. Estimated remaining: 6m 41s. Rate: 169.9 symbols/min [2025-09-14T20:55:29.931939] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:29.952906] [DEBUG] [LOCAL ] JHI: Loaded 2528 existing records from primary storage. [2025-09-14T20:55:29.953657] [INFO ] [MAIN ] JHI: Loaded 2528 primary data records. [2025-09-14T20:55:30.047305] [DEBUG] [MAIN ] JGH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:30.072760] [INFO ] [MAIN ] JGH: Generated 1352 derivative records from 8181 primary records. [2025-09-14T20:55:30.078474] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-14T20:55:30.165577] [DEBUG] [LOCAL ] JGH: Derivative data saved (1352 records). [2025-09-14T20:55:30.255444] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-14T20:55:30.260231] [INFO ] [MAIN ] Derivative Progress: 1090/2226 symbols completed. JGH took 1.0s. Estimated remaining: 6m 41s. Rate: 169.9 symbols/min [2025-09-14T20:55:30.261663] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:30.272391] [DEBUG] [MAIN ] JHG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:30.274277] [INFO ] [MAIN ] JHG: Generated 1352 derivative records from 35896 primary records. [2025-09-14T20:55:30.274586] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-14T20:55:30.288238] [DEBUG] [LOCAL ] JHS: Loaded 2243 existing records from primary storage. [2025-09-14T20:55:30.289705] [INFO ] [MAIN ] JHS: Loaded 2243 primary data records. [2025-09-14T20:55:30.363502] [DEBUG] [LOCAL ] JHG: Derivative data saved (1352 records). [2025-09-14T20:55:30.398489] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-14T20:55:30.411852] [INFO ] [MAIN ] Derivative Progress: 1091/2226 symbols completed. JHG took 1.1s. Estimated remaining: 6m 41s. Rate: 170.0 symbols/min [2025-09-14T20:55:30.490801] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:30.509420] [DEBUG] [MAIN ] JHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:30.602784] [INFO ] [MAIN ] JHI: Generated 1352 derivative records from 2528 primary records. [2025-09-14T20:55:30.603125] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-14T20:55:30.618297] [DEBUG] [LOCAL ] JHI: Derivative data saved (1352 records). [2025-09-14T20:55:30.618672] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-14T20:55:30.621692] [INFO ] [MAIN ] Derivative Progress: 1092/2226 symbols completed. JHI took 0.7s. Estimated remaining: 6m 40s. Rate: 170.0 symbols/min [2025-09-14T20:55:30.621980] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:30.638840] [DEBUG] [LOCAL ] JILL: Loaded 11746 existing records from primary storage. [2025-09-14T20:55:30.650454] [INFO ] [MAIN ] JILL: Loaded 11746 primary data records. [2025-09-14T20:55:30.692598] [DEBUG] [MAIN ] JHS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:30.728595] [INFO ] [MAIN ] JHS: Generated 1352 derivative records from 2243 primary records. [2025-09-14T20:55:30.780348] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-14T20:55:30.792788] [DEBUG] [LOCAL ] JHX: Loaded 39971 existing records from primary storage. [2025-09-14T20:55:30.804250] [INFO ] [MAIN ] JHX: Loaded 39971 primary data records. [2025-09-14T20:55:30.901048] [DEBUG] [LOCAL ] JHS: Derivative data saved (1352 records). [2025-09-14T20:55:30.933028] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-14T20:55:30.958125] [INFO ] [MAIN ] Derivative Progress: 1093/2226 symbols completed. JHS took 0.7s. Estimated remaining: 6m 40s. Rate: 170.0 symbols/min [2025-09-14T20:55:31.288780] [DEBUG] [MAIN ] JILL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:31.289636] [INFO ] [MAIN ] JILL: Generated 1352 derivative records from 11746 primary records. [2025-09-14T20:55:31.290789] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-14T20:55:31.304408] [DEBUG] [LOCAL ] JILL: Derivative data saved (1352 records). [2025-09-14T20:55:31.304631] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-14T20:55:31.306675] [INFO ] [MAIN ] Derivative Progress: 1094/2226 symbols completed. JILL took 0.7s. Estimated remaining: 6m 39s. Rate: 170.0 symbols/min [2025-09-14T20:55:31.320491] [DEBUG] [MAIN ] JHX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:31.321174] [INFO ] [MAIN ] JHX: Generated 1352 derivative records from 39971 primary records. [2025-09-14T20:55:31.321249] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-14T20:55:31.333359] [DEBUG] [LOCAL ] JHX: Derivative data saved (1352 records). [2025-09-14T20:55:31.333438] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-14T20:55:31.335434] [INFO ] [MAIN ] Derivative Progress: 1095/2226 symbols completed. JHX took 0.9s. Estimated remaining: 6m 39s. Rate: 170.2 symbols/min [2025-09-14T20:55:31.335970] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:31.336146] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:31.336191] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:31.343239] [DEBUG] [LOCAL ] JLS: Loaded 2934 existing records from primary storage. [2025-09-14T20:55:31.343768] [INFO ] [MAIN ] JLS: Loaded 2934 primary data records. [2025-09-14T20:55:31.531716] [DEBUG] [LOCAL ] JLL: Loaded 24398 existing records from primary storage. [2025-09-14T20:55:31.567605] [INFO ] [MAIN ] JLL: Loaded 24398 primary data records. [2025-09-14T20:55:31.644193] [DEBUG] [LOCAL ] JKS: Loaded 28986 existing records from primary storage. [2025-09-14T20:55:31.655722] [INFO ] [MAIN ] JKS: Loaded 28986 primary data records. [2025-09-14T20:55:32.293773] [DEBUG] [MAIN ] JLS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:32.294966] [INFO ] [MAIN ] JLS: Generated 1352 derivative records from 2934 primary records. [2025-09-14T20:55:32.295702] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-14T20:55:32.309214] [DEBUG] [LOCAL ] JLS: Derivative data saved (1352 records). [2025-09-14T20:55:32.309341] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-14T20:55:32.311147] [INFO ] [MAIN ] Derivative Progress: 1096/2226 symbols completed. JLS took 1.0s. Estimated remaining: 6m 39s. Rate: 169.9 symbols/min [2025-09-14T20:55:32.311616] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:32.327946] [DEBUG] [MAIN ] JLL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:32.329629] [INFO ] [MAIN ] JLL: Generated 1352 derivative records from 24398 primary records. [2025-09-14T20:55:32.339441] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-14T20:55:32.339848] [DEBUG] [MAIN ] JKS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:32.341178] [INFO ] [MAIN ] JKS: Generated 1352 derivative records from 28986 primary records. [2025-09-14T20:55:32.348113] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-14T20:55:32.375758] [DEBUG] [LOCAL ] JLL: Derivative data saved (1352 records). [2025-09-14T20:55:32.376983] [DEBUG] [LOCAL ] JKS: Derivative data saved (1352 records). [2025-09-14T20:55:32.377035] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-14T20:55:32.377227] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-14T20:55:32.379290] [INFO ] [MAIN ] Derivative Progress: 1097/2226 symbols completed. JLL took 1.0s. Estimated remaining: 6m 38s. Rate: 170.0 symbols/min [2025-09-14T20:55:32.382453] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:32.382516] [INFO ] [MAIN ] Derivative Progress: 1098/2226 symbols completed. JKS took 1.0s. Estimated remaining: 6m 38s. Rate: 170.2 symbols/min [2025-09-14T20:55:32.394557] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:32.395478] [DEBUG] [LOCAL ] JNJ: Loaded 40493 existing records from primary storage. [2025-09-14T20:55:32.395747] [INFO ] [MAIN ] JNJ: Loaded 40493 primary data records. [2025-09-14T20:55:32.536272] [DEBUG] [LOCAL ] JOE: Loaded 17984 existing records from primary storage. [2025-09-14T20:55:32.579599] [INFO ] [MAIN ] JOE: Loaded 17984 primary data records. [2025-09-14T20:55:32.819113] [DEBUG] [LOCAL ] JOBY: Loaded 40550 existing records from primary storage. [2025-09-14T20:55:32.834142] [INFO ] [MAIN ] JOBY: Loaded 40550 primary data records. [2025-09-14T20:55:33.412518] [DEBUG] [MAIN ] JNJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:33.414038] [INFO ] [MAIN ] JNJ: Generated 1352 derivative records from 40493 primary records. [2025-09-14T20:55:33.414352] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-14T20:55:33.432146] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1352 records). [2025-09-14T20:55:33.434065] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-14T20:55:33.436194] [INFO ] [MAIN ] Derivative Progress: 1099/2226 symbols completed. JNJ took 1.1s. Estimated remaining: 6m 38s. Rate: 169.9 symbols/min [2025-09-14T20:55:33.437063] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:33.450391] [DEBUG] [MAIN ] JOE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:33.451389] [INFO ] [MAIN ] JOE: Generated 1352 derivative records from 17984 primary records. [2025-09-14T20:55:33.451828] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-14T20:55:33.466687] [DEBUG] [LOCAL ] JOF: Loaded 5158 existing records from primary storage. [2025-09-14T20:55:33.468028] [INFO ] [MAIN ] JOF: Loaded 5158 primary data records. [2025-09-14T20:55:33.504558] [DEBUG] [LOCAL ] JOE: Derivative data saved (1352 records). [2025-09-14T20:55:33.540032] [DEBUG] [MAIN ] JOBY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:33.572027] [INFO ] [MAIN ] JOBY: Generated 1352 derivative records from 40550 primary records. [2025-09-14T20:55:33.539666] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-14T20:55:33.592892] [INFO ] [MAIN ] Derivative Progress: 1100/2226 symbols completed. JOE took 1.2s. Estimated remaining: 6m 38s. Rate: 170.0 symbols/min [2025-09-14T20:55:33.593089] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-14T20:55:33.593523] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:33.786011] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1352 records). [2025-09-14T20:55:33.787064] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-14T20:55:33.789515] [INFO ] [MAIN ] Derivative Progress: 1101/2226 symbols completed. JOBY took 1.4s. Estimated remaining: 6m 37s. Rate: 170.0 symbols/min [2025-09-14T20:55:33.790195] [INFO ] [MAIN ] JPI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:33.808075] [DEBUG] [LOCAL ] JPI: Loaded 4000 existing records from primary storage. [2025-09-14T20:55:33.809095] [INFO ] [MAIN ] JPI: Loaded 4000 primary data records. [2025-09-14T20:55:33.864207] [DEBUG] [LOCAL ] JPC: Loaded 27300 existing records from primary storage. [2025-09-14T20:55:33.898269] [INFO ] [MAIN ] JPC: Loaded 27300 primary data records. [2025-09-14T20:55:34.297266] [DEBUG] [MAIN ] JOF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:34.441787] [INFO ] [MAIN ] JOF: Generated 1352 derivative records from 5158 primary records. [2025-09-14T20:55:34.454338] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-14T20:55:34.471957] [DEBUG] [LOCAL ] JOF: Derivative data saved (1352 records). [2025-09-14T20:55:34.472514] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-14T20:55:34.475198] [INFO ] [MAIN ] Derivative Progress: 1102/2226 symbols completed. JOF took 1.0s. Estimated remaining: 6m 37s. Rate: 169.9 symbols/min [2025-09-14T20:55:34.476342] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:34.493717] [DEBUG] [MAIN ] JPI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:34.494802] [INFO ] [MAIN ] JPI: Generated 1352 derivative records from 4000 primary records. [2025-09-14T20:55:34.495095] [DEBUG] [LOCAL ] JPI: Saving derivative data. [2025-09-14T20:55:34.513287] [DEBUG] [LOCAL ] JPI: Derivative data saved (1352 records). [2025-09-14T20:55:34.513627] [INFO ] [MAIN ] JPI: Successfully saved derivative data. [2025-09-14T20:55:34.515902] [INFO ] [MAIN ] Derivative Progress: 1103/2226 symbols completed. JPI took 0.7s. Estimated remaining: 6m 36s. Rate: 170.0 symbols/min [2025-09-14T20:55:34.526284] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:34.526848] [DEBUG] [MAIN ] JPC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:34.527671] [INFO ] [MAIN ] JPC: Generated 1352 derivative records from 27300 primary records. [2025-09-14T20:55:34.528128] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-14T20:55:34.550393] [DEBUG] [LOCAL ] JPC: Derivative data saved (1352 records). [2025-09-14T20:55:34.550749] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-14T20:55:34.552738] [INFO ] [MAIN ] Derivative Progress: 1104/2226 symbols completed. JPC took 1.0s. Estimated remaining: 6m 36s. Rate: 170.2 symbols/min [2025-09-14T20:55:34.553074] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:34.573272] [DEBUG] [LOCAL ] JPM: Loaded 40534 existing records from primary storage. [2025-09-14T20:55:34.573604] [INFO ] [MAIN ] JPM: Loaded 40534 primary data records. [2025-09-14T20:55:34.676251] [DEBUG] [LOCAL ] JQC: Loaded 24817 existing records from primary storage. [2025-09-14T20:55:34.689443] [DEBUG] [LOCAL ] JRI: Loaded 11176 existing records from primary storage. [2025-09-14T20:55:34.701449] [INFO ] [MAIN ] JRI: Loaded 11176 primary data records. [2025-09-14T20:55:34.701764] [INFO ] [MAIN ] JQC: Loaded 24817 primary data records. [2025-09-14T20:55:35.476185] [DEBUG] [MAIN ] JPM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:35.477791] [INFO ] [MAIN ] JPM: Generated 1352 derivative records from 40534 primary records. [2025-09-14T20:55:35.490750] [DEBUG] [MAIN ] JRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:35.490875] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-14T20:55:35.492634] [INFO ] [MAIN ] JRI: Generated 1352 derivative records from 11176 primary records. [2025-09-14T20:55:35.510103] [DEBUG] [MAIN ] JQC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:35.517275] [DEBUG] [LOCAL ] JPM: Derivative data saved (1352 records). [2025-09-14T20:55:35.514346] [INFO ] [MAIN ] JQC: Generated 1352 derivative records from 24817 primary records. [2025-09-14T20:55:35.517439] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-14T20:55:35.510169] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-14T20:55:35.520111] [INFO ] [MAIN ] Derivative Progress: 1105/2226 symbols completed. JPM took 1.0s. Estimated remaining: 6m 36s. Rate: 169.9 symbols/min [2025-09-14T20:55:35.517542] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-14T20:55:35.528213] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:35.536509] [DEBUG] [LOCAL ] JRI: Derivative data saved (1352 records). [2025-09-14T20:55:35.537188] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-14T20:55:35.539534] [INFO ] [MAIN ] Derivative Progress: 1106/2226 symbols completed. JRI took 1.0s. Estimated remaining: 6m 35s. Rate: 170.0 symbols/min [2025-09-14T20:55:35.549001] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:35.556232] [DEBUG] [LOCAL ] JQC: Derivative data saved (1352 records). [2025-09-14T20:55:35.556706] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-14T20:55:35.562993] [INFO ] [MAIN ] Derivative Progress: 1107/2226 symbols completed. JQC took 1.0s. Estimated remaining: 6m 35s. Rate: 170.2 symbols/min [2025-09-14T20:55:35.563515] [DEBUG] [LOCAL ] JRS: Loaded 8399 existing records from primary storage. [2025-09-14T20:55:35.564034] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:35.564238] [INFO ] [MAIN ] JRS: Loaded 8399 primary data records. [2025-09-14T20:55:35.875024] [DEBUG] [LOCAL ] JXN: Loaded 33633 existing records from primary storage. [2025-09-14T20:55:35.887484] [INFO ] [MAIN ] JXN: Loaded 33633 primary data records. [2025-09-14T20:55:36.014965] [DEBUG] [LOCAL ] K: Loaded 37697 existing records from primary storage. [2025-09-14T20:55:36.063077] [INFO ] [MAIN ] K: Loaded 37697 primary data records. [2025-09-14T20:55:36.466222] [DEBUG] [MAIN ] JRS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:36.467657] [INFO ] [MAIN ] JRS: Generated 1352 derivative records from 8399 primary records. [2025-09-14T20:55:36.468242] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-14T20:55:36.485843] [DEBUG] [LOCAL ] JRS: Derivative data saved (1352 records). [2025-09-14T20:55:36.486384] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-14T20:55:36.496327] [DEBUG] [MAIN ] JXN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:36.498388] [INFO ] [MAIN ] Derivative Progress: 1108/2226 symbols completed. JRS took 1.0s. Estimated remaining: 6m 35s. Rate: 169.9 symbols/min [2025-09-14T20:55:36.499112] [INFO ] [MAIN ] JXN: Generated 1352 derivative records from 33633 primary records. [2025-09-14T20:55:36.499750] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-14T20:55:36.522600] [DEBUG] [MAIN ] K: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:36.524616] [INFO ] [MAIN ] K: Generated 1352 derivative records from 37697 primary records. [2025-09-14T20:55:36.525251] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-14T20:55:36.525757] [DEBUG] [LOCAL ] JXN: Derivative data saved (1352 records). [2025-09-14T20:55:36.525902] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-14T20:55:36.528241] [INFO ] [MAIN ] Derivative Progress: 1109/2226 symbols completed. JXN took 1.0s. Estimated remaining: 6m 34s. Rate: 170.1 symbols/min [2025-09-14T20:55:36.539900] [DEBUG] [LOCAL ] K: Derivative data saved (1352 records). [2025-09-14T20:55:36.539980] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-14T20:55:36.541912] [INFO ] [MAIN ] Derivative Progress: 1110/2226 symbols completed. K took 1.0s. Estimated remaining: 6m 33s. Rate: 170.2 symbols/min [2025-09-14T20:55:36.542511] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:36.542545] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:36.542709] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:36.556768] [DEBUG] [LOCAL ] KAI: Loaded 9945 existing records from primary storage. [2025-09-14T20:55:36.557179] [INFO ] [MAIN ] KAI: Loaded 9945 primary data records. [2025-09-14T20:55:36.682779] [DEBUG] [LOCAL ] KB: Loaded 18330 existing records from primary storage. [2025-09-14T20:55:36.698443] [INFO ] [MAIN ] KB: Loaded 18330 primary data records. [2025-09-14T20:55:36.929764] [DEBUG] [LOCAL ] KAR: Loaded 29952 existing records from primary storage. [2025-09-14T20:55:36.977449] [INFO ] [MAIN ] KAR: Loaded 29952 primary data records. [2025-09-14T20:55:37.477678] [DEBUG] [MAIN ] KAI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:37.478961] [INFO ] [MAIN ] KAI: Generated 1352 derivative records from 9945 primary records. [2025-09-14T20:55:37.479098] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-14T20:55:37.507942] [DEBUG] [MAIN ] KB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:37.503797] [DEBUG] [LOCAL ] KAI: Derivative data saved (1352 records). [2025-09-14T20:55:37.508969] [INFO ] [MAIN ] KB: Generated 1352 derivative records from 18330 primary records. [2025-09-14T20:55:37.509080] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-14T20:55:37.509187] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-14T20:55:37.511366] [INFO ] [MAIN ] Derivative Progress: 1111/2226 symbols completed. KAI took 1.0s. Estimated remaining: 6m 34s. Rate: 169.9 symbols/min [2025-09-14T20:55:37.513570] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:37.525455] [DEBUG] [LOCAL ] KB: Derivative data saved (1352 records). [2025-09-14T20:55:37.527961] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-14T20:55:37.530175] [INFO ] [MAIN ] Derivative Progress: 1112/2226 symbols completed. KB took 1.0s. Estimated remaining: 6m 33s. Rate: 170.1 symbols/min [2025-09-14T20:55:37.536690] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:37.541075] [DEBUG] [MAIN ] KAR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:37.542312] [INFO ] [MAIN ] KAR: Generated 1352 derivative records from 29952 primary records. [2025-09-14T20:55:37.542577] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-14T20:55:37.566247] [DEBUG] [LOCAL ] KAR: Derivative data saved (1352 records). [2025-09-14T20:55:37.572156] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-14T20:55:37.572520] [DEBUG] [LOCAL ] KBDC: Loaded 14766 existing records from primary storage. [2025-09-14T20:55:37.575548] [INFO ] [MAIN ] KBDC: Loaded 14766 primary data records. [2025-09-14T20:55:37.575441] [INFO ] [MAIN ] Derivative Progress: 1113/2226 symbols completed. KAR took 1.0s. Estimated remaining: 6m 32s. Rate: 170.2 symbols/min [2025-09-14T20:55:37.587862] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:37.825513] [DEBUG] [LOCAL ] KBH: Loaded 36402 existing records from primary storage. [2025-09-14T20:55:37.917258] [INFO ] [MAIN ] KBH: Loaded 36402 primary data records. [2025-09-14T20:55:38.042928] [DEBUG] [LOCAL ] KBR: Loaded 36186 existing records from primary storage. [2025-09-14T20:55:38.071465] [INFO ] [MAIN ] KBR: Loaded 36186 primary data records. [2025-09-14T20:55:38.525206] [DEBUG] [MAIN ] KBDC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:38.543298] [INFO ] [MAIN ] KBDC: Generated 1352 derivative records from 14766 primary records. [2025-09-14T20:55:38.543620] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-14T20:55:38.562811] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1352 records). [2025-09-14T20:55:38.563952] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-14T20:55:38.567577] [INFO ] [MAIN ] Derivative Progress: 1114/2226 symbols completed. KBDC took 1.1s. Estimated remaining: 6m 33s. Rate: 169.9 symbols/min [2025-09-14T20:55:38.568295] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:38.586041] [DEBUG] [MAIN ] KBH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:38.587365] [INFO ] [MAIN ] KBH: Generated 1352 derivative records from 36402 primary records. [2025-09-14T20:55:38.588254] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-14T20:55:38.602383] [DEBUG] [LOCAL ] KBH: Derivative data saved (1352 records). [2025-09-14T20:55:38.602880] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-14T20:55:38.605758] [INFO ] [MAIN ] Derivative Progress: 1115/2226 symbols completed. KBH took 1.1s. Estimated remaining: 6m 32s. Rate: 170.1 symbols/min [2025-09-14T20:55:38.606772] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:38.632913] [DEBUG] [MAIN ] KBR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:38.633928] [INFO ] [MAIN ] KBR: Generated 1352 derivative records from 36186 primary records. [2025-09-14T20:55:38.637611] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-14T20:55:38.637933] [DEBUG] [LOCAL ] KEN: Loaded 3435 existing records from primary storage. [2025-09-14T20:55:38.639019] [INFO ] [MAIN ] KEN: Loaded 3435 primary data records. [2025-09-14T20:55:38.760881] [DEBUG] [LOCAL ] KBR: Derivative data saved (1352 records). [2025-09-14T20:55:38.769779] [DEBUG] [LOCAL ] KD: Loaded 39273 existing records from primary storage. [2025-09-14T20:55:38.775047] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-14T20:55:38.778557] [INFO ] [MAIN ] KD: Loaded 39273 primary data records. [2025-09-14T20:55:38.778412] [INFO ] [MAIN ] Derivative Progress: 1116/2226 symbols completed. KBR took 1.2s. Estimated remaining: 6m 31s. Rate: 170.2 symbols/min [2025-09-14T20:55:38.784791] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:39.314739] [DEBUG] [LOCAL ] KEP: Loaded 24446 existing records from primary storage. [2025-09-14T20:55:39.315011] [INFO ] [MAIN ] KEP: Loaded 24446 primary data records. [2025-09-14T20:55:39.629247] [DEBUG] [MAIN ] KEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:39.631395] [INFO ] [MAIN ] KEN: Generated 1352 derivative records from 3435 primary records. [2025-09-14T20:55:39.631596] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-14T20:55:39.647075] [DEBUG] [LOCAL ] KEN: Derivative data saved (1352 records). [2025-09-14T20:55:39.648713] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-14T20:55:39.651193] [INFO ] [MAIN ] Derivative Progress: 1117/2226 symbols completed. KEN took 1.0s. Estimated remaining: 6m 32s. Rate: 169.9 symbols/min [2025-09-14T20:55:39.651781] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:39.663426] [DEBUG] [MAIN ] KD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:39.665832] [INFO ] [MAIN ] KD: Generated 1352 derivative records from 39273 primary records. [2025-09-14T20:55:39.666776] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-14T20:55:39.681770] [DEBUG] [LOCAL ] KD: Derivative data saved (1352 records). [2025-09-14T20:55:39.682207] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-14T20:55:39.684303] [INFO ] [MAIN ] Derivative Progress: 1118/2226 symbols completed. KD took 1.1s. Estimated remaining: 6m 31s. Rate: 170.1 symbols/min [2025-09-14T20:55:39.685025] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:39.710526] [DEBUG] [MAIN ] KEP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:39.712161] [INFO ] [MAIN ] KEP: Generated 1352 derivative records from 24446 primary records. [2025-09-14T20:55:39.720283] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-14T20:55:39.723212] [DEBUG] [LOCAL ] KEX: Loaded 28008 existing records from primary storage. [2025-09-14T20:55:39.732440] [INFO ] [MAIN ] KEX: Loaded 28008 primary data records. [2025-09-14T20:55:39.736015] [DEBUG] [LOCAL ] KEP: Derivative data saved (1352 records). [2025-09-14T20:55:39.805465] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-14T20:55:39.842764] [INFO ] [MAIN ] Derivative Progress: 1119/2226 symbols completed. KEP took 1.1s. Estimated remaining: 6m 30s. Rate: 170.2 symbols/min [2025-09-14T20:55:39.855010] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:40.036698] [DEBUG] [LOCAL ] KEYS: Loaded 32034 existing records from primary storage. [2025-09-14T20:55:40.039460] [DEBUG] [LOCAL ] KF: Loaded 1764 existing records from primary storage. [2025-09-14T20:55:40.037126] [INFO ] [MAIN ] KEYS: Loaded 32034 primary data records. [2025-09-14T20:55:40.039793] [INFO ] [MAIN ] KF: Loaded 1764 primary data records. [2025-09-14T20:55:40.614755] [DEBUG] [MAIN ] KEX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:40.616046] [INFO ] [MAIN ] KEX: Generated 1352 derivative records from 28008 primary records. [2025-09-14T20:55:40.616230] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-14T20:55:40.633721] [DEBUG] [LOCAL ] KEX: Derivative data saved (1352 records). [2025-09-14T20:55:40.634282] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-14T20:55:40.636821] [INFO ] [MAIN ] Derivative Progress: 1120/2226 symbols completed. KEX took 1.0s. Estimated remaining: 6m 30s. Rate: 170.0 symbols/min [2025-09-14T20:55:40.637803] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:40.665544] [DEBUG] [MAIN ] KF: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:55:40.677503] [INFO ] [MAIN ] KF: Generated 1351 derivative records from 1764 primary records. [2025-09-14T20:55:40.676510] [DEBUG] [MAIN ] KEYS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:40.677799] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-14T20:55:40.678366] [INFO ] [MAIN ] KEYS: Generated 1352 derivative records from 32034 primary records. [2025-09-14T20:55:40.685239] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-14T20:55:40.696795] [DEBUG] [LOCAL ] KFRC: Loaded 14958 existing records from primary storage. [2025-09-14T20:55:40.697136] [DEBUG] [LOCAL ] KF: Derivative data saved (1351 records). [2025-09-14T20:55:40.698846] [INFO ] [MAIN ] KFRC: Loaded 14958 primary data records. [2025-09-14T20:55:40.698910] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-14T20:55:40.733395] [INFO ] [MAIN ] Derivative Progress: 1121/2226 symbols completed. KF took 0.9s. Estimated remaining: 6m 30s. Rate: 170.1 symbols/min [2025-09-14T20:55:40.773872] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:40.762129] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1352 records). [2025-09-14T20:55:40.836034] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-14T20:55:40.860064] [INFO ] [MAIN ] Derivative Progress: 1122/2226 symbols completed. KEYS took 1.2s. Estimated remaining: 6m 29s. Rate: 170.2 symbols/min [2025-09-14T20:55:40.874425] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:40.937773] [DEBUG] [LOCAL ] KFS: Loaded 6394 existing records from primary storage. [2025-09-14T20:55:40.983295] [INFO ] [MAIN ] KFS: Loaded 6394 primary data records. [2025-09-14T20:55:41.244446] [DEBUG] [LOCAL ] KFY: Loaded 22010 existing records from primary storage. [2025-09-14T20:55:41.289979] [INFO ] [MAIN ] KFY: Loaded 22010 primary data records. [2025-09-14T20:55:41.770000] [DEBUG] [MAIN ] KFRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:41.810302] [INFO ] [MAIN ] KFRC: Generated 1352 derivative records from 14958 primary records. [2025-09-14T20:55:41.836785] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-14T20:55:42.062129] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1352 records). [2025-09-14T20:55:42.062322] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-14T20:55:42.064425] [INFO ] [MAIN ] Derivative Progress: 1123/2226 symbols completed. KFRC took 1.4s. Estimated remaining: 6m 30s. Rate: 169.8 symbols/min [2025-09-14T20:55:42.095438] [DEBUG] [MAIN ] KFS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:42.097596] [INFO ] [MAIN ] KFS: Generated 1352 derivative records from 6394 primary records. [2025-09-14T20:55:42.097904] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-14T20:55:42.112112] [DEBUG] [LOCAL ] KFS: Derivative data saved (1352 records). [2025-09-14T20:55:42.112299] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-14T20:55:42.114535] [INFO ] [MAIN ] Derivative Progress: 1124/2226 symbols completed. KFS took 1.3s. Estimated remaining: 6m 29s. Rate: 169.9 symbols/min [2025-09-14T20:55:42.127893] [DEBUG] [MAIN ] KFY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:42.128820] [INFO ] [MAIN ] KFY: Generated 1352 derivative records from 22010 primary records. [2025-09-14T20:55:42.128905] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-14T20:55:42.141571] [DEBUG] [LOCAL ] KFY: Derivative data saved (1352 records). [2025-09-14T20:55:42.141765] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-14T20:55:42.144523] [INFO ] [MAIN ] Derivative Progress: 1125/2226 symbols completed. KFY took 1.3s. Estimated remaining: 6m 28s. Rate: 170.1 symbols/min [2025-09-14T20:55:42.145099] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:42.145585] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:42.145791] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:42.219606] [DEBUG] [LOCAL ] KGS: Loaded 34220 existing records from primary storage. [2025-09-14T20:55:42.220795] [DEBUG] [LOCAL ] KIM: Loaded 39911 existing records from primary storage. [2025-09-14T20:55:42.221226] [INFO ] [MAIN ] KGS: Loaded 34220 primary data records. [2025-09-14T20:55:42.221377] [INFO ] [MAIN ] KIM: Loaded 39911 primary data records. [2025-09-14T20:55:42.450461] [DEBUG] [LOCAL ] KGC: Loaded 40440 existing records from primary storage. [2025-09-14T20:55:42.499958] [INFO ] [MAIN ] KGC: Loaded 40440 primary data records. [2025-09-14T20:55:43.132708] [DEBUG] [MAIN ] KGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:43.136109] [INFO ] [MAIN ] KGS: Generated 1352 derivative records from 34220 primary records. [2025-09-14T20:55:43.136341] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-14T20:55:43.159036] [DEBUG] [MAIN ] KIM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:43.162076] [DEBUG] [LOCAL ] KGS: Derivative data saved (1352 records). [2025-09-14T20:55:43.163001] [INFO ] [MAIN ] KIM: Generated 1352 derivative records from 39911 primary records. [2025-09-14T20:55:43.163736] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-14T20:55:43.163627] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-14T20:55:43.166538] [INFO ] [MAIN ] Derivative Progress: 1126/2226 symbols completed. KGS took 1.0s. Estimated remaining: 6m 29s. Rate: 169.8 symbols/min [2025-09-14T20:55:43.176360] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:43.179906] [DEBUG] [LOCAL ] KIM: Derivative data saved (1352 records). [2025-09-14T20:55:43.180914] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-14T20:55:43.183461] [INFO ] [MAIN ] Derivative Progress: 1127/2226 symbols completed. KIM took 1.0s. Estimated remaining: 6m 28s. Rate: 169.9 symbols/min [2025-09-14T20:55:43.184555] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:43.201072] [DEBUG] [MAIN ] KGC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:43.207685] [INFO ] [MAIN ] KGC: Generated 1352 derivative records from 40440 primary records. [2025-09-14T20:55:43.207967] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-14T20:55:43.227870] [DEBUG] [LOCAL ] KIO: Loaded 15563 existing records from primary storage. [2025-09-14T20:55:43.229795] [INFO ] [MAIN ] KIO: Loaded 15563 primary data records. [2025-09-14T20:55:43.230827] [DEBUG] [LOCAL ] KGC: Derivative data saved (1352 records). [2025-09-14T20:55:43.236395] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-14T20:55:43.245761] [INFO ] [MAIN ] Derivative Progress: 1128/2226 symbols completed. KGC took 1.1s. Estimated remaining: 6m 27s. Rate: 170.1 symbols/min [2025-09-14T20:55:43.267416] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:43.448935] [DEBUG] [LOCAL ] KKRS: Loaded 4649 existing records from primary storage. [2025-09-14T20:55:43.524295] [DEBUG] [LOCAL ] KKR: Loaded 40272 existing records from primary storage. [2025-09-14T20:55:43.449141] [INFO ] [MAIN ] KKRS: Loaded 4649 primary data records. [2025-09-14T20:55:43.535541] [INFO ] [MAIN ] KKR: Loaded 40272 primary data records. [2025-09-14T20:55:44.122515] [DEBUG] [MAIN ] KIO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:44.124480] [INFO ] [MAIN ] KIO: Generated 1352 derivative records from 15563 primary records. [2025-09-14T20:55:44.124786] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-14T20:55:44.139602] [DEBUG] [LOCAL ] KIO: Derivative data saved (1352 records). [2025-09-14T20:55:44.139705] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-14T20:55:44.141868] [INFO ] [MAIN ] Derivative Progress: 1129/2226 symbols completed. KIO took 1.0s. Estimated remaining: 6m 28s. Rate: 169.8 symbols/min [2025-09-14T20:55:44.142727] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:44.158424] [DEBUG] [MAIN ] KKRS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:44.167970] [DEBUG] [MAIN ] KKR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:44.168828] [INFO ] [MAIN ] KKRS: Generated 1352 derivative records from 4649 primary records. [2025-09-14T20:55:44.169358] [INFO ] [MAIN ] KKR: Generated 1352 derivative records from 40272 primary records. [2025-09-14T20:55:44.169515] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-14T20:55:44.169995] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-14T20:55:44.201374] [DEBUG] [LOCAL ] KKR: Derivative data saved (1352 records). [2025-09-14T20:55:44.202479] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1352 records). [2025-09-14T20:55:44.202528] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-14T20:55:44.211956] [INFO ] [MAIN ] Derivative Progress: 1130/2226 symbols completed. KKR took 1.0s. Estimated remaining: 6m 27s. Rate: 169.9 symbols/min [2025-09-14T20:55:44.202796] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-14T20:55:44.215556] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:44.215668] [INFO ] [MAIN ] Derivative Progress: 1131/2226 symbols completed. KKRS took 0.9s. Estimated remaining: 6m 26s. Rate: 170.1 symbols/min [2025-09-14T20:55:44.216056] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:44.216860] [DEBUG] [LOCAL ] KLC: Loaded 26667 existing records from primary storage. [2025-09-14T20:55:44.217488] [INFO ] [MAIN ] KLC: Loaded 26667 primary data records. [2025-09-14T20:55:44.559048] [DEBUG] [LOCAL ] KLG: Loaded 31211 existing records from primary storage. [2025-09-14T20:55:44.559340] [INFO ] [MAIN ] KLG: Loaded 31211 primary data records. [2025-09-14T20:55:44.676547] [DEBUG] [LOCAL ] KMI: Loaded 40433 existing records from primary storage. [2025-09-14T20:55:44.703017] [INFO ] [MAIN ] KMI: Loaded 40433 primary data records. [2025-09-14T20:55:45.131097] [DEBUG] [MAIN ] KLC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:45.132244] [INFO ] [MAIN ] KLC: Generated 1352 derivative records from 26667 primary records. [2025-09-14T20:55:45.132777] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-14T20:55:45.148322] [DEBUG] [LOCAL ] KLC: Derivative data saved (1352 records). [2025-09-14T20:55:45.149003] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-14T20:55:45.152419] [INFO ] [MAIN ] Derivative Progress: 1132/2226 symbols completed. KLC took 1.0s. Estimated remaining: 6m 26s. Rate: 169.8 symbols/min [2025-09-14T20:55:45.153607] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:45.170736] [DEBUG] [LOCAL ] KMPB: Loaded 2589 existing records from primary storage. [2025-09-14T20:55:45.171030] [INFO ] [MAIN ] KMPB: Loaded 2589 primary data records. [2025-09-14T20:55:45.171399] [DEBUG] [MAIN ] KLG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:45.184376] [INFO ] [MAIN ] KLG: Generated 1352 derivative records from 31211 primary records. [2025-09-14T20:55:45.209603] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-14T20:55:45.288117] [DEBUG] [LOCAL ] KLG: Derivative data saved (1352 records). [2025-09-14T20:55:45.288823] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-14T20:55:45.302150] [INFO ] [MAIN ] Derivative Progress: 1133/2226 symbols completed. KLG took 1.1s. Estimated remaining: 6m 26s. Rate: 169.9 symbols/min [2025-09-14T20:55:45.334024] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:45.454160] [DEBUG] [MAIN ] KMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:45.465869] [INFO ] [MAIN ] KMI: Generated 1352 derivative records from 40433 primary records. [2025-09-14T20:55:45.466114] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-14T20:55:45.480893] [DEBUG] [LOCAL ] KMI: Derivative data saved (1352 records). [2025-09-14T20:55:45.481222] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-14T20:55:45.483502] [INFO ] [MAIN ] Derivative Progress: 1134/2226 symbols completed. KMI took 1.3s. Estimated remaining: 6m 25s. Rate: 170.0 symbols/min [2025-09-14T20:55:45.484001] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:45.516072] [DEBUG] [LOCAL ] KMPR: Loaded 29412 existing records from primary storage. [2025-09-14T20:55:45.534695] [INFO ] [MAIN ] KMPR: Loaded 29412 primary data records. [2025-09-14T20:55:45.535302] [DEBUG] [MAIN ] KMPB: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:55:45.566924] [INFO ] [MAIN ] KMPB: Generated 1351 derivative records from 2589 primary records. [2025-09-14T20:55:45.572341] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-14T20:55:45.659844] [DEBUG] [LOCAL ] KMT: Loaded 32243 existing records from primary storage. [2025-09-14T20:55:45.673199] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1351 records). [2025-09-14T20:55:45.678478] [INFO ] [MAIN ] KMT: Loaded 32243 primary data records. [2025-09-14T20:55:45.694008] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-14T20:55:45.709546] [INFO ] [MAIN ] Derivative Progress: 1135/2226 symbols completed. KMPB took 0.6s. Estimated remaining: 6m 25s. Rate: 170.1 symbols/min [2025-09-14T20:55:45.749349] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:46.150801] [DEBUG] [LOCAL ] KMX: Loaded 40060 existing records from primary storage. [2025-09-14T20:55:46.151813] [INFO ] [MAIN ] KMX: Loaded 40060 primary data records. [2025-09-14T20:55:46.272402] [DEBUG] [MAIN ] KMPR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:46.290637] [INFO ] [MAIN ] KMPR: Generated 1352 derivative records from 29412 primary records. [2025-09-14T20:55:46.302199] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-14T20:55:46.380551] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1352 records). [2025-09-14T20:55:46.377661] [DEBUG] [MAIN ] KMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:46.465551] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-14T20:55:46.469278] [INFO ] [MAIN ] Derivative Progress: 1136/2226 symbols completed. KMPR took 1.1s. Estimated remaining: 6m 25s. Rate: 169.9 symbols/min [2025-09-14T20:55:46.467061] [INFO ] [MAIN ] KMT: Generated 1352 derivative records from 32243 primary records. [2025-09-14T20:55:46.470027] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:46.469732] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-14T20:55:46.487212] [DEBUG] [LOCAL ] KMT: Derivative data saved (1352 records). [2025-09-14T20:55:46.487783] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-14T20:55:46.491070] [INFO ] [MAIN ] Derivative Progress: 1137/2226 symbols completed. KMT took 1.0s. Estimated remaining: 6m 24s. Rate: 170.0 symbols/min [2025-09-14T20:55:46.491523] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:46.521736] [DEBUG] [MAIN ] KMX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:46.522734] [INFO ] [MAIN ] KMX: Generated 1352 derivative records from 40060 primary records. [2025-09-14T20:55:46.530712] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-14T20:55:46.542399] [DEBUG] [LOCAL ] KN: Loaded 28476 existing records from primary storage. [2025-09-14T20:55:46.551809] [INFO ] [MAIN ] KN: Loaded 28476 primary data records. [2025-09-14T20:55:46.565468] [DEBUG] [LOCAL ] KMX: Derivative data saved (1352 records). [2025-09-14T20:55:46.587622] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-14T20:55:46.602457] [INFO ] [MAIN ] Derivative Progress: 1138/2226 symbols completed. KMX took 0.9s. Estimated remaining: 6m 24s. Rate: 170.1 symbols/min [2025-09-14T20:55:46.613703] [DEBUG] [LOCAL ] KNF: Loaded 26885 existing records from primary storage. [2025-09-14T20:55:46.655944] [INFO ] [MAIN ] KNF: Loaded 26885 primary data records. [2025-09-14T20:55:47.222332] [DEBUG] [MAIN ] KN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:47.223454] [INFO ] [MAIN ] KN: Generated 1352 derivative records from 28476 primary records. [2025-09-14T20:55:47.223748] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-14T20:55:47.239359] [DEBUG] [LOCAL ] KN: Derivative data saved (1352 records). [2025-09-14T20:55:47.239597] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-14T20:55:47.241657] [INFO ] [MAIN ] Derivative Progress: 1139/2226 symbols completed. KN took 0.8s. Estimated remaining: 6m 24s. Rate: 170.0 symbols/min [2025-09-14T20:55:47.252742] [DEBUG] [MAIN ] KNF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:47.253693] [INFO ] [MAIN ] KNF: Generated 1352 derivative records from 26885 primary records. [2025-09-14T20:55:47.253789] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-14T20:55:47.268565] [DEBUG] [LOCAL ] KNF: Derivative data saved (1352 records). [2025-09-14T20:55:47.268780] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-14T20:55:47.271198] [INFO ] [MAIN ] Derivative Progress: 1140/2226 symbols completed. KNF took 0.8s. Estimated remaining: 6m 23s. Rate: 170.1 symbols/min [2025-09-14T20:55:47.271921] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:47.272199] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:47.272422] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:47.288495] [DEBUG] [LOCAL ] KNOP: Loaded 6675 existing records from primary storage. [2025-09-14T20:55:47.289213] [INFO ] [MAIN ] KNOP: Loaded 6675 primary data records. [2025-09-14T20:55:47.354099] [DEBUG] [LOCAL ] KNSL: Loaded 13657 existing records from primary storage. [2025-09-14T20:55:47.391208] [INFO ] [MAIN ] KNSL: Loaded 13657 primary data records. [2025-09-14T20:55:47.633478] [DEBUG] [LOCAL ] KNTK: Loaded 35256 existing records from primary storage. [2025-09-14T20:55:47.747469] [INFO ] [MAIN ] KNTK: Loaded 35256 primary data records. [2025-09-14T20:55:48.254422] [DEBUG] [MAIN ] KNOP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:48.256815] [INFO ] [MAIN ] KNOP: Generated 1352 derivative records from 6675 primary records. [2025-09-14T20:55:48.256958] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-14T20:55:48.272014] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1352 records). [2025-09-14T20:55:48.273075] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-14T20:55:48.276440] [INFO ] [MAIN ] Derivative Progress: 1141/2226 symbols completed. KNOP took 1.0s. Estimated remaining: 6m 23s. Rate: 169.9 symbols/min [2025-09-14T20:55:48.276771] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:48.292707] [DEBUG] [MAIN ] KNSL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:48.294121] [INFO ] [MAIN ] KNSL: Generated 1352 derivative records from 13657 primary records. [2025-09-14T20:55:48.295534] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-14T20:55:48.315767] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1352 records). [2025-09-14T20:55:48.333693] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-14T20:55:48.337621] [INFO ] [MAIN ] Derivative Progress: 1142/2226 symbols completed. KNSL took 1.1s. Estimated remaining: 6m 23s. Rate: 170.0 symbols/min [2025-09-14T20:55:48.335061] [DEBUG] [MAIN ] KNTK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:48.338121] [INFO ] [MAIN ] KO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:48.339157] [INFO ] [MAIN ] KNTK: Generated 1352 derivative records from 35256 primary records. [2025-09-14T20:55:48.339484] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-14T20:55:48.368186] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1352 records). [2025-09-14T20:55:48.379996] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-14T20:55:48.384824] [INFO ] [MAIN ] Derivative Progress: 1143/2226 symbols completed. KNTK took 1.1s. Estimated remaining: 6m 22s. Rate: 170.1 symbols/min [2025-09-14T20:55:48.387083] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:48.386676] [DEBUG] [LOCAL ] KNX: Loaded 39453 existing records from primary storage. [2025-09-14T20:55:48.387919] [INFO ] [MAIN ] KNX: Loaded 39453 primary data records. [2025-09-14T20:55:48.580420] [DEBUG] [LOCAL ] KO: Loaded 40558 existing records from primary storage. [2025-09-14T20:55:48.617157] [INFO ] [MAIN ] KO: Loaded 40558 primary data records. [2025-09-14T20:55:48.768179] [DEBUG] [LOCAL ] KODK: Loaded 32592 existing records from primary storage. [2025-09-14T20:55:48.803845] [INFO ] [MAIN ] KODK: Loaded 32592 primary data records. [2025-09-14T20:55:49.375316] [DEBUG] [MAIN ] KNX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:49.377945] [INFO ] [MAIN ] KNX: Generated 1352 derivative records from 39453 primary records. [2025-09-14T20:55:49.378803] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-14T20:55:49.393484] [DEBUG] [LOCAL ] KNX: Derivative data saved (1352 records). [2025-09-14T20:55:49.395317] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-14T20:55:49.397856] [INFO ] [MAIN ] Derivative Progress: 1144/2226 symbols completed. KNX took 1.1s. Estimated remaining: 6m 22s. Rate: 169.8 symbols/min [2025-09-14T20:55:49.398503] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:49.417606] [DEBUG] [MAIN ] KO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:49.426956] [INFO ] [MAIN ] KO: Generated 1352 derivative records from 40558 primary records. [2025-09-14T20:55:49.437350] [DEBUG] [LOCAL ] KO: Saving derivative data. [2025-09-14T20:55:49.438034] [DEBUG] [MAIN ] KODK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:49.439236] [INFO ] [MAIN ] KODK: Generated 1352 derivative records from 32592 primary records. [2025-09-14T20:55:49.439813] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-14T20:55:49.476417] [DEBUG] [LOCAL ] KOF: Loaded 19800 existing records from primary storage. [2025-09-14T20:55:49.478523] [INFO ] [MAIN ] KOF: Loaded 19800 primary data records. [2025-09-14T20:55:49.478581] [DEBUG] [LOCAL ] KO: Derivative data saved (1352 records). [2025-09-14T20:55:49.504493] [INFO ] [MAIN ] KO: Successfully saved derivative data. [2025-09-14T20:55:49.516310] [DEBUG] [LOCAL ] KODK: Derivative data saved (1352 records). [2025-09-14T20:55:49.559196] [INFO ] [MAIN ] Derivative Progress: 1145/2226 symbols completed. KO took 1.2s. Estimated remaining: 6m 22s. Rate: 169.9 symbols/min [2025-09-14T20:55:49.585281] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-14T20:55:49.593969] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:49.600782] [INFO ] [MAIN ] Derivative Progress: 1146/2226 symbols completed. KODK took 1.2s. Estimated remaining: 6m 21s. Rate: 170.1 symbols/min [2025-09-14T20:55:49.623058] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:49.782529] [DEBUG] [LOCAL ] KOP: Loaded 12894 existing records from primary storage. [2025-09-14T20:55:49.783171] [DEBUG] [LOCAL ] KORE: Loaded 1563 existing records from primary storage. [2025-09-14T20:55:49.783518] [INFO ] [MAIN ] KOP: Loaded 12894 primary data records. [2025-09-14T20:55:49.783575] [INFO ] [MAIN ] KORE: Loaded 1563 primary data records. [2025-09-14T20:55:50.360168] [DEBUG] [MAIN ] KOF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:50.362219] [INFO ] [MAIN ] KOF: Generated 1352 derivative records from 19800 primary records. [2025-09-14T20:55:50.362694] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-14T20:55:50.379318] [DEBUG] [LOCAL ] KOF: Derivative data saved (1352 records). [2025-09-14T20:55:50.379767] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-14T20:55:50.382131] [INFO ] [MAIN ] Derivative Progress: 1147/2226 symbols completed. KOF took 1.0s. Estimated remaining: 6m 21s. Rate: 169.9 symbols/min [2025-09-14T20:55:50.382725] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:50.399222] [DEBUG] [MAIN ] KORE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:50.402665] [INFO ] [MAIN ] KORE: Generated 1352 derivative records from 1563 primary records. [2025-09-14T20:55:50.402986] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-14T20:55:50.423908] [DEBUG] [MAIN ] KOP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:50.427007] [INFO ] [MAIN ] KOP: Generated 1352 derivative records from 12894 primary records. [2025-09-14T20:55:50.428543] [DEBUG] [LOCAL ] KORE: Derivative data saved (1352 records). [2025-09-14T20:55:50.428893] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-14T20:55:50.428976] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-14T20:55:50.431916] [INFO ] [MAIN ] Derivative Progress: 1148/2226 symbols completed. KORE took 0.8s. Estimated remaining: 6m 20s. Rate: 170.0 symbols/min [2025-09-14T20:55:50.440039] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:50.458148] [DEBUG] [LOCAL ] KOP: Derivative data saved (1352 records). [2025-09-14T20:55:50.458532] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-14T20:55:50.461144] [INFO ] [MAIN ] Derivative Progress: 1149/2226 symbols completed. KOP took 0.9s. Estimated remaining: 6m 20s. Rate: 170.1 symbols/min [2025-09-14T20:55:50.461690] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:50.477107] [DEBUG] [LOCAL ] KOS: Loaded 39954 existing records from primary storage. [2025-09-14T20:55:50.477761] [INFO ] [MAIN ] KOS: Loaded 39954 primary data records. [2025-09-14T20:55:50.779520] [DEBUG] [LOCAL ] KRC: Loaded 36061 existing records from primary storage. [2025-09-14T20:55:50.791959] [DEBUG] [LOCAL ] KR: Loaded 40423 existing records from primary storage. [2025-09-14T20:55:50.799590] [INFO ] [MAIN ] KR: Loaded 40423 primary data records. [2025-09-14T20:55:50.799493] [INFO ] [MAIN ] KRC: Loaded 36061 primary data records. [2025-09-14T20:55:51.462007] [DEBUG] [MAIN ] KOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:51.464223] [INFO ] [MAIN ] KOS: Generated 1352 derivative records from 39954 primary records. [2025-09-14T20:55:51.464568] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-14T20:55:51.482758] [DEBUG] [LOCAL ] KOS: Derivative data saved (1352 records). [2025-09-14T20:55:51.482943] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-14T20:55:51.485779] [INFO ] [MAIN ] Derivative Progress: 1150/2226 symbols completed. KOS took 1.1s. Estimated remaining: 6m 20s. Rate: 169.9 symbols/min [2025-09-14T20:55:51.486281] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:51.515784] [DEBUG] [MAIN ] KR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:51.516314] [DEBUG] [MAIN ] KRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:51.517191] [INFO ] [MAIN ] KR: Generated 1352 derivative records from 40423 primary records. [2025-09-14T20:55:51.517903] [INFO ] [MAIN ] KRC: Generated 1352 derivative records from 36061 primary records. [2025-09-14T20:55:51.517341] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-14T20:55:51.518134] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-14T20:55:51.541478] [DEBUG] [LOCAL ] KR: Derivative data saved (1352 records). [2025-09-14T20:55:51.541967] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-14T20:55:51.553655] [INFO ] [MAIN ] Derivative Progress: 1151/2226 symbols completed. KR took 1.1s. Estimated remaining: 6m 19s. Rate: 170.0 symbols/min [2025-09-14T20:55:51.555563] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:51.566021] [DEBUG] [LOCAL ] KRC: Derivative data saved (1352 records). [2025-09-14T20:55:51.567435] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-14T20:55:51.569893] [INFO ] [MAIN ] Derivative Progress: 1152/2226 symbols completed. KRC took 1.1s. Estimated remaining: 6m 19s. Rate: 170.1 symbols/min [2025-09-14T20:55:51.570279] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:51.571819] [DEBUG] [LOCAL ] KREF: Loaded 27613 existing records from primary storage. [2025-09-14T20:55:51.572556] [INFO ] [MAIN ] KREF: Loaded 27613 primary data records. [2025-09-14T20:55:51.861462] [DEBUG] [LOCAL ] KRO: Loaded 19761 existing records from primary storage. [2025-09-14T20:55:51.885028] [DEBUG] [LOCAL ] KRG: Loaded 36852 existing records from primary storage. [2025-09-14T20:55:51.883957] [INFO ] [MAIN ] KRO: Loaded 19761 primary data records. [2025-09-14T20:55:51.885209] [INFO ] [MAIN ] KRG: Loaded 36852 primary data records. [2025-09-14T20:55:52.445555] [DEBUG] [MAIN ] KREF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:52.447575] [INFO ] [MAIN ] KREF: Generated 1352 derivative records from 27613 primary records. [2025-09-14T20:55:52.447778] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-14T20:55:52.464435] [DEBUG] [LOCAL ] KREF: Derivative data saved (1352 records). [2025-09-14T20:55:52.464742] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-14T20:55:52.467373] [INFO ] [MAIN ] Derivative Progress: 1153/2226 symbols completed. KREF took 1.0s. Estimated remaining: 6m 19s. Rate: 169.9 symbols/min [2025-09-14T20:55:52.484508] [DEBUG] [MAIN ] KRO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:52.494735] [INFO ] [MAIN ] KRO: Generated 1352 derivative records from 19761 primary records. [2025-09-14T20:55:52.493984] [DEBUG] [MAIN ] KRG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:52.495312] [INFO ] [MAIN ] KRG: Generated 1352 derivative records from 36852 primary records. [2025-09-14T20:55:52.495356] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-14T20:55:52.495496] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-14T20:55:52.518216] [DEBUG] [LOCAL ] KRG: Derivative data saved (1352 records). [2025-09-14T20:55:52.518844] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-14T20:55:52.521625] [INFO ] [MAIN ] Derivative Progress: 1154/2226 symbols completed. KRG took 1.0s. Estimated remaining: 6m 18s. Rate: 170.0 symbols/min [2025-09-14T20:55:52.524690] [DEBUG] [LOCAL ] KRO: Derivative data saved (1352 records). [2025-09-14T20:55:52.524798] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-14T20:55:52.527073] [INFO ] [MAIN ] Derivative Progress: 1155/2226 symbols completed. KRO took 1.0s. Estimated remaining: 6m 18s. Rate: 170.2 symbols/min [2025-09-14T20:55:52.527853] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:52.527751] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:52.528022] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:52.631499] [DEBUG] [LOCAL ] KRP: Loaded 27131 existing records from primary storage. [2025-09-14T20:55:52.632726] [DEBUG] [LOCAL ] KT: Loaded 33903 existing records from primary storage. [2025-09-14T20:55:52.632851] [INFO ] [MAIN ] KRP: Loaded 27131 primary data records. [2025-09-14T20:55:52.633143] [INFO ] [MAIN ] KT: Loaded 33903 primary data records. [2025-09-14T20:55:52.870161] [DEBUG] [LOCAL ] KSS: Loaded 40357 existing records from primary storage. [2025-09-14T20:55:52.908330] [INFO ] [MAIN ] KSS: Loaded 40357 primary data records. [2025-09-14T20:55:53.521168] [DEBUG] [MAIN ] KRP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:53.523420] [INFO ] [MAIN ] KRP: Generated 1352 derivative records from 27131 primary records. [2025-09-14T20:55:53.523715] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-14T20:55:53.535003] [DEBUG] [MAIN ] KT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:53.536863] [INFO ] [MAIN ] KT: Generated 1352 derivative records from 33903 primary records. [2025-09-14T20:55:53.548795] [DEBUG] [LOCAL ] KRP: Derivative data saved (1352 records). [2025-09-14T20:55:53.548858] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-14T20:55:53.549228] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-14T20:55:53.552035] [INFO ] [MAIN ] Derivative Progress: 1156/2226 symbols completed. KRP took 1.0s. Estimated remaining: 6m 18s. Rate: 169.9 symbols/min [2025-09-14T20:55:53.552788] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:53.570404] [DEBUG] [LOCAL ] KT: Derivative data saved (1352 records). [2025-09-14T20:55:53.580773] [DEBUG] [MAIN ] KSS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:53.581523] [INFO ] [MAIN ] KSS: Generated 1352 derivative records from 40357 primary records. [2025-09-14T20:55:53.580502] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-14T20:55:53.583899] [INFO ] [MAIN ] Derivative Progress: 1157/2226 symbols completed. KT took 1.1s. Estimated remaining: 6m 17s. Rate: 170.0 symbols/min [2025-09-14T20:55:53.581666] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-14T20:55:53.584223] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:53.601497] [DEBUG] [LOCAL ] KSS: Derivative data saved (1352 records). [2025-09-14T20:55:53.603972] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-14T20:55:53.606524] [INFO ] [MAIN ] Derivative Progress: 1158/2226 symbols completed. KSS took 1.1s. Estimated remaining: 6m 17s. Rate: 170.2 symbols/min [2025-09-14T20:55:53.611694] [DEBUG] [LOCAL ] KTF: Loaded 8981 existing records from primary storage. [2025-09-14T20:55:53.611930] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:53.612172] [INFO ] [MAIN ] KTF: Loaded 8981 primary data records. [2025-09-14T20:55:53.809171] [DEBUG] [LOCAL ] KTB: Loaded 30714 existing records from primary storage. [2025-09-14T20:55:53.823596] [INFO ] [MAIN ] KTB: Loaded 30714 primary data records. [2025-09-14T20:55:54.064485] [DEBUG] [LOCAL ] KVUE: Loaded 40407 existing records from primary storage. [2025-09-14T20:55:54.068393] [INFO ] [MAIN ] KVUE: Loaded 40407 primary data records. [2025-09-14T20:55:54.536807] [DEBUG] [MAIN ] KTF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:54.538892] [INFO ] [MAIN ] KTF: Generated 1352 derivative records from 8981 primary records. [2025-09-14T20:55:54.539382] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-14T20:55:54.554083] [DEBUG] [LOCAL ] KTF: Derivative data saved (1352 records). [2025-09-14T20:55:54.555270] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-14T20:55:54.557500] [INFO ] [MAIN ] Derivative Progress: 1159/2226 symbols completed. KTF took 1.0s. Estimated remaining: 6m 17s. Rate: 169.9 symbols/min [2025-09-14T20:55:54.557872] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:54.572288] [DEBUG] [MAIN ] KTB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:54.573201] [INFO ] [MAIN ] KTB: Generated 1352 derivative records from 30714 primary records. [2025-09-14T20:55:54.573482] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-14T20:55:54.589228] [DEBUG] [LOCAL ] KTB: Derivative data saved (1352 records). [2025-09-14T20:55:54.589483] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-14T20:55:54.592445] [INFO ] [MAIN ] Derivative Progress: 1160/2226 symbols completed. KTB took 1.0s. Estimated remaining: 6m 16s. Rate: 170.0 symbols/min [2025-09-14T20:55:54.603933] [DEBUG] [MAIN ] KVUE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:54.603493] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:54.604974] [INFO ] [MAIN ] KVUE: Generated 1352 derivative records from 40407 primary records. [2025-09-14T20:55:54.605676] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-14T20:55:54.633030] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1352 records). [2025-09-14T20:55:54.644594] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-14T20:55:54.647208] [INFO ] [MAIN ] Derivative Progress: 1161/2226 symbols completed. KVUE took 1.0s. Estimated remaining: 6m 16s. Rate: 170.2 symbols/min [2025-09-14T20:55:54.648551] [DEBUG] [LOCAL ] KVYO: Loaded 37922 existing records from primary storage. [2025-09-14T20:55:54.648978] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:54.649050] [INFO ] [MAIN ] KVYO: Loaded 37922 primary data records. [2025-09-14T20:55:54.798387] [DEBUG] [LOCAL ] KW: Loaded 30508 existing records from primary storage. [2025-09-14T20:55:54.824579] [INFO ] [MAIN ] KW: Loaded 30508 primary data records. [2025-09-14T20:55:54.863229] [DEBUG] [LOCAL ] KWR: Loaded 12557 existing records from primary storage. [2025-09-14T20:55:54.925802] [INFO ] [MAIN ] KWR: Loaded 12557 primary data records. [2025-09-14T20:55:55.514364] [DEBUG] [MAIN ] KVYO: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:55:55.515678] [INFO ] [MAIN ] KVYO: Generated 1351 derivative records from 37922 primary records. [2025-09-14T20:55:55.516564] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-14T20:55:55.531197] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1351 records). [2025-09-14T20:55:55.531417] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-14T20:55:55.533576] [INFO ] [MAIN ] Derivative Progress: 1162/2226 symbols completed. KVYO took 1.0s. Estimated remaining: 6m 16s. Rate: 169.9 symbols/min [2025-09-14T20:55:55.534602] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:55.559663] [DEBUG] [MAIN ] KWR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:55.559408] [DEBUG] [MAIN ] KW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:55.560569] [INFO ] [MAIN ] KWR: Generated 1352 derivative records from 12557 primary records. [2025-09-14T20:55:55.561157] [INFO ] [MAIN ] KW: Generated 1352 derivative records from 30508 primary records. [2025-09-14T20:55:55.561267] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-14T20:55:55.561783] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-14T20:55:55.583963] [DEBUG] [LOCAL ] KWR: Derivative data saved (1352 records). [2025-09-14T20:55:55.592886] [DEBUG] [LOCAL ] KW: Derivative data saved (1352 records). [2025-09-14T20:55:55.593004] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-14T20:55:55.595704] [INFO ] [MAIN ] Derivative Progress: 1163/2226 symbols completed. KWR took 0.9s. Estimated remaining: 6m 15s. Rate: 170.1 symbols/min [2025-09-14T20:55:55.593181] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-14T20:55:55.598379] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:55.598459] [INFO ] [MAIN ] Derivative Progress: 1164/2226 symbols completed. KW took 1.0s. Estimated remaining: 6m 14s. Rate: 170.2 symbols/min [2025-09-14T20:55:55.599107] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:55.609127] [DEBUG] [LOCAL ] KYN: Loaded 22403 existing records from primary storage. [2025-09-14T20:55:55.609355] [INFO ] [MAIN ] KYN: Loaded 22403 primary data records. [2025-09-14T20:55:55.905930] [DEBUG] [LOCAL ] L: Loaded 30602 existing records from primary storage. [2025-09-14T20:55:55.917553] [INFO ] [MAIN ] L: Loaded 30602 primary data records. [2025-09-14T20:55:55.950500] [DEBUG] [LOCAL ] LAC: Loaded 39364 existing records from primary storage. [2025-09-14T20:55:55.987704] [INFO ] [MAIN ] LAC: Loaded 39364 primary data records. [2025-09-14T20:55:56.525132] [DEBUG] [MAIN ] KYN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:56.526435] [INFO ] [MAIN ] KYN: Generated 1352 derivative records from 22403 primary records. [2025-09-14T20:55:56.526587] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-14T20:55:56.540762] [DEBUG] [LOCAL ] KYN: Derivative data saved (1352 records). [2025-09-14T20:55:56.541305] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-14T20:55:56.543657] [INFO ] [MAIN ] Derivative Progress: 1165/2226 symbols completed. KYN took 1.0s. Estimated remaining: 6m 15s. Rate: 170.0 symbols/min [2025-09-14T20:55:56.544086] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:56.560580] [DEBUG] [MAIN ] L: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:56.576197] [INFO ] [MAIN ] L: Generated 1352 derivative records from 30602 primary records. [2025-09-14T20:55:56.576452] [DEBUG] [MAIN ] LAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:56.576608] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-14T20:55:56.577143] [INFO ] [MAIN ] LAC: Generated 1352 derivative records from 39364 primary records. [2025-09-14T20:55:56.577904] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-14T20:55:56.593843] [DEBUG] [LOCAL ] LAD: Loaded 17159 existing records from primary storage. [2025-09-14T20:55:56.594870] [INFO ] [MAIN ] LAD: Loaded 17159 primary data records. [2025-09-14T20:55:56.643429] [DEBUG] [LOCAL ] L: Derivative data saved (1352 records). [2025-09-14T20:55:56.665548] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-14T20:55:56.665712] [DEBUG] [LOCAL ] LAC: Derivative data saved (1352 records). [2025-09-14T20:55:56.688163] [INFO ] [MAIN ] Derivative Progress: 1166/2226 symbols completed. L took 1.1s. Estimated remaining: 6m 14s. Rate: 170.0 symbols/min [2025-09-14T20:55:56.714859] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:56.704263] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-14T20:55:56.719044] [INFO ] [MAIN ] Derivative Progress: 1167/2226 symbols completed. LAC took 1.1s. Estimated remaining: 6m 13s. Rate: 170.2 symbols/min [2025-09-14T20:55:56.725635] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:56.802450] [DEBUG] [LOCAL ] LANV: Loaded 1944 existing records from primary storage. [2025-09-14T20:55:56.898202] [INFO ] [MAIN ] LANV: Loaded 1944 primary data records. [2025-09-14T20:55:57.055297] [DEBUG] [LOCAL ] LADR: Loaded 28952 existing records from primary storage. [2025-09-14T20:55:57.088243] [INFO ] [MAIN ] LADR: Loaded 28952 primary data records. [2025-09-14T20:55:57.463908] [DEBUG] [MAIN ] LAD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:57.465341] [INFO ] [MAIN ] LAD: Generated 1352 derivative records from 17159 primary records. [2025-09-14T20:55:57.465829] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-14T20:55:57.484362] [DEBUG] [LOCAL ] LAD: Derivative data saved (1352 records). [2025-09-14T20:55:57.495184] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-14T20:55:57.497532] [INFO ] [MAIN ] Derivative Progress: 1168/2226 symbols completed. LAD took 1.0s. Estimated remaining: 6m 13s. Rate: 170.0 symbols/min [2025-09-14T20:55:57.498339] [DEBUG] [MAIN ] LANV: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T20:55:57.499244] [INFO ] [MAIN ] LANV: Generated 1349 derivative records from 1944 primary records. [2025-09-14T20:55:57.499356] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-14T20:55:57.514951] [DEBUG] [LOCAL ] LANV: Derivative data saved (1349 records). [2025-09-14T20:55:57.515047] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-14T20:55:57.517443] [INFO ] [MAIN ] Derivative Progress: 1169/2226 symbols completed. LANV took 0.8s. Estimated remaining: 6m 13s. Rate: 170.1 symbols/min [2025-09-14T20:55:57.531315] [DEBUG] [MAIN ] LADR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:57.532047] [INFO ] [MAIN ] LADR: Generated 1352 derivative records from 28952 primary records. [2025-09-14T20:55:57.532133] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-14T20:55:57.544467] [DEBUG] [LOCAL ] LADR: Derivative data saved (1352 records). [2025-09-14T20:55:57.544555] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-14T20:55:57.547376] [INFO ] [MAIN ] Derivative Progress: 1170/2226 symbols completed. LADR took 0.8s. Estimated remaining: 6m 12s. Rate: 170.3 symbols/min [2025-09-14T20:55:57.548020] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:57.547955] [INFO ] [MAIN ] LAR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:57.548175] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:57.564921] [DEBUG] [LOCAL ] LAW: Loaded 10652 existing records from primary storage. [2025-09-14T20:55:57.565292] [INFO ] [MAIN ] LAW: Loaded 10652 primary data records. [2025-09-14T20:55:57.870807] [DEBUG] [LOCAL ] LAR: Loaded 33941 existing records from primary storage. [2025-09-14T20:55:57.870274] [DEBUG] [LOCAL ] LAZ: Loaded 33715 existing records from primary storage. [2025-09-14T20:55:57.870997] [INFO ] [MAIN ] LAZ: Loaded 33715 primary data records. [2025-09-14T20:55:57.871051] [INFO ] [MAIN ] LAR: Loaded 33941 primary data records. [2025-09-14T20:55:58.534315] [DEBUG] [MAIN ] LAW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:58.536761] [INFO ] [MAIN ] LAW: Generated 1352 derivative records from 10652 primary records. [2025-09-14T20:55:58.538600] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-14T20:55:58.552857] [DEBUG] [LOCAL ] LAW: Derivative data saved (1352 records). [2025-09-14T20:55:58.553326] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-14T20:55:58.556630] [INFO ] [MAIN ] Derivative Progress: 1171/2226 symbols completed. LAW took 1.0s. Estimated remaining: 6m 12s. Rate: 170.0 symbols/min [2025-09-14T20:55:58.560356] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:58.574212] [DEBUG] [MAIN ] LAR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:58.575505] [INFO ] [MAIN ] LAR: Generated 1352 derivative records from 33941 primary records. [2025-09-14T20:55:58.585272] [DEBUG] [LOCAL ] LAR: Saving derivative data. [2025-09-14T20:55:58.586071] [DEBUG] [MAIN ] LAZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:58.587057] [INFO ] [MAIN ] LAZ: Generated 1352 derivative records from 33715 primary records. [2025-09-14T20:55:58.587381] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-14T20:55:58.611553] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1352 records). [2025-09-14T20:55:58.612185] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-14T20:55:58.614668] [INFO ] [MAIN ] Derivative Progress: 1172/2226 symbols completed. LAZ took 1.1s. Estimated remaining: 6m 12s. Rate: 170.1 symbols/min [2025-09-14T20:55:58.612091] [DEBUG] [LOCAL ] LAR: Derivative data saved (1352 records). [2025-09-14T20:55:58.615223] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:58.615668] [INFO ] [MAIN ] LAR: Successfully saved derivative data. [2025-09-14T20:55:58.618167] [INFO ] [MAIN ] Derivative Progress: 1173/2226 symbols completed. LAR took 1.1s. Estimated remaining: 6m 11s. Rate: 170.3 symbols/min [2025-09-14T20:55:58.618665] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:58.644983] [DEBUG] [LOCAL ] LB: Loaded 27942 existing records from primary storage. [2025-09-14T20:55:58.645309] [INFO ] [MAIN ] LB: Loaded 27942 primary data records. [2025-09-14T20:55:58.950782] [DEBUG] [LOCAL ] LC: Loaded 35913 existing records from primary storage. [2025-09-14T20:55:58.952822] [INFO ] [MAIN ] LC: Loaded 35913 primary data records. [2025-09-14T20:55:58.966034] [DEBUG] [LOCAL ] LBRT: Loaded 39791 existing records from primary storage. [2025-09-14T20:55:59.020226] [INFO ] [MAIN ] LBRT: Loaded 39791 primary data records. [2025-09-14T20:55:59.525153] [DEBUG] [MAIN ] LB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:59.526097] [INFO ] [MAIN ] LB: Generated 1352 derivative records from 27942 primary records. [2025-09-14T20:55:59.526614] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-14T20:55:59.541082] [DEBUG] [LOCAL ] LB: Derivative data saved (1352 records). [2025-09-14T20:55:59.543107] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-14T20:55:59.546092] [INFO ] [MAIN ] Derivative Progress: 1174/2226 symbols completed. LB took 1.0s. Estimated remaining: 6m 11s. Rate: 170.0 symbols/min [2025-09-14T20:55:59.546403] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:59.558274] [DEBUG] [MAIN ] LC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:59.559168] [INFO ] [MAIN ] LC: Generated 1352 derivative records from 35913 primary records. [2025-09-14T20:55:59.559264] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-14T20:55:59.587142] [DEBUG] [MAIN ] LBRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:55:59.594662] [INFO ] [MAIN ] LBRT: Generated 1352 derivative records from 39791 primary records. [2025-09-14T20:55:59.596792] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-14T20:55:59.597383] [DEBUG] [LOCAL ] LC: Derivative data saved (1352 records). [2025-09-14T20:55:59.598367] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-14T20:55:59.600938] [INFO ] [MAIN ] Derivative Progress: 1175/2226 symbols completed. LC took 1.0s. Estimated remaining: 6m 11s. Rate: 170.2 symbols/min [2025-09-14T20:55:59.601243] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:59.609215] [DEBUG] [LOCAL ] LCII: Loaded 20847 existing records from primary storage. [2025-09-14T20:55:59.617825] [INFO ] [MAIN ] LCII: Loaded 20847 primary data records. [2025-09-14T20:55:59.679371] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1352 records). [2025-09-14T20:55:59.728226] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-14T20:55:59.748847] [INFO ] [MAIN ] Derivative Progress: 1176/2226 symbols completed. LBRT took 1.1s. Estimated remaining: 6m 10s. Rate: 170.2 symbols/min [2025-09-14T20:55:59.760365] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:55:59.928193] [DEBUG] [LOCAL ] LDI: Loaded 32413 existing records from primary storage. [2025-09-14T20:55:59.928774] [INFO ] [MAIN ] LDI: Loaded 32413 primary data records. [2025-09-14T20:56:00.135112] [DEBUG] [LOCAL ] LDOS: Loaded 33900 existing records from primary storage. [2025-09-14T20:56:00.141152] [INFO ] [MAIN ] LDOS: Loaded 33900 primary data records. [2025-09-14T20:56:00.465944] [DEBUG] [MAIN ] LCII: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:00.534277] [INFO ] [MAIN ] LCII: Generated 1352 derivative records from 20847 primary records. [2025-09-14T20:56:00.534612] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-14T20:56:00.550037] [DEBUG] [LOCAL ] LCII: Derivative data saved (1352 records). [2025-09-14T20:56:00.550168] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-14T20:56:00.552571] [INFO ] [MAIN ] Derivative Progress: 1177/2226 symbols completed. LCII took 1.0s. Estimated remaining: 6m 10s. Rate: 170.1 symbols/min [2025-09-14T20:56:00.554201] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:00.571133] [DEBUG] [MAIN ] LDI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:00.576091] [INFO ] [MAIN ] LDI: Generated 1352 derivative records from 32413 primary records. [2025-09-14T20:56:00.576275] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-14T20:56:00.589264] [DEBUG] [LOCAL ] LDP: Loaded 9487 existing records from primary storage. [2025-09-14T20:56:00.594342] [INFO ] [MAIN ] LDP: Loaded 9487 primary data records. [2025-09-14T20:56:00.595537] [DEBUG] [LOCAL ] LDI: Derivative data saved (1352 records). [2025-09-14T20:56:00.607189] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-14T20:56:00.634984] [INFO ] [MAIN ] Derivative Progress: 1178/2226 symbols completed. LDI took 1.0s. Estimated remaining: 6m 10s. Rate: 170.2 symbols/min [2025-09-14T20:56:00.700823] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:00.794561] [DEBUG] [MAIN ] LDOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:00.921804] [INFO ] [MAIN ] LDOS: Generated 1352 derivative records from 33900 primary records. [2025-09-14T20:56:00.933338] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-14T20:56:00.958085] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1352 records). [2025-09-14T20:56:00.959271] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-14T20:56:00.962732] [INFO ] [MAIN ] Derivative Progress: 1179/2226 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 9s. Rate: 170.2 symbols/min [2025-09-14T20:56:00.965174] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:00.976438] [DEBUG] [LOCAL ] LEA: Loaded 30762 existing records from primary storage. [2025-09-14T20:56:00.978006] [INFO ] [MAIN ] LEA: Loaded 30762 primary data records. [2025-09-14T20:56:01.208231] [DEBUG] [MAIN ] LDP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:01.289220] [INFO ] [MAIN ] LDP: Generated 1352 derivative records from 9487 primary records. [2025-09-14T20:56:01.303204] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-14T20:56:01.301556] [DEBUG] [LOCAL ] LEG: Loaded 37656 existing records from primary storage. [2025-09-14T20:56:01.304038] [INFO ] [MAIN ] LEG: Loaded 37656 primary data records. [2025-09-14T20:56:01.434681] [DEBUG] [LOCAL ] LDP: Derivative data saved (1352 records). [2025-09-14T20:56:01.476824] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-14T20:56:01.554992] [INFO ] [MAIN ] Derivative Progress: 1180/2226 symbols completed. LDP took 1.0s. Estimated remaining: 6m 9s. Rate: 170.1 symbols/min [2025-09-14T20:56:01.620363] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:01.640049] [DEBUG] [MAIN ] LEA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:01.641601] [INFO ] [MAIN ] LEA: Generated 1352 derivative records from 30762 primary records. [2025-09-14T20:56:01.641851] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-14T20:56:01.656828] [DEBUG] [LOCAL ] LEA: Derivative data saved (1352 records). [2025-09-14T20:56:01.657021] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-14T20:56:01.659367] [INFO ] [MAIN ] Derivative Progress: 1181/2226 symbols completed. LEA took 1.0s. Estimated remaining: 6m 8s. Rate: 170.2 symbols/min [2025-09-14T20:56:01.659818] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:01.686627] [DEBUG] [MAIN ] LEG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:01.687670] [INFO ] [MAIN ] LEG: Generated 1352 derivative records from 37656 primary records. [2025-09-14T20:56:01.687853] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-14T20:56:01.704476] [DEBUG] [LOCAL ] LEG: Derivative data saved (1352 records). [2025-09-14T20:56:01.710577] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-14T20:56:01.713115] [INFO ] [MAIN ] Derivative Progress: 1182/2226 symbols completed. LEG took 0.7s. Estimated remaining: 6m 8s. Rate: 170.3 symbols/min [2025-09-14T20:56:01.713497] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:01.728805] [DEBUG] [LOCAL ] LEO: Loaded 12504 existing records from primary storage. [2025-09-14T20:56:01.729067] [INFO ] [MAIN ] LEO: Loaded 12504 primary data records. [2025-09-14T20:56:01.737119] [DEBUG] [LOCAL ] LEN: Loaded 39992 existing records from primary storage. [2025-09-14T20:56:01.796663] [INFO ] [MAIN ] LEN: Loaded 39992 primary data records. [2025-09-14T20:56:02.154135] [DEBUG] [LOCAL ] LEVI: Loaded 38710 existing records from primary storage. [2025-09-14T20:56:02.186041] [INFO ] [MAIN ] LEVI: Loaded 38710 primary data records. [2025-09-14T20:56:02.593460] [DEBUG] [MAIN ] LEO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:02.594553] [INFO ] [MAIN ] LEO: Generated 1352 derivative records from 12504 primary records. [2025-09-14T20:56:02.595890] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-14T20:56:02.623013] [DEBUG] [MAIN ] LEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:02.622398] [DEBUG] [LOCAL ] LEO: Derivative data saved (1352 records). [2025-09-14T20:56:02.623579] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-14T20:56:02.624518] [INFO ] [MAIN ] LEN: Generated 1352 derivative records from 39992 primary records. [2025-09-14T20:56:02.626847] [INFO ] [MAIN ] Derivative Progress: 1183/2226 symbols completed. LEO took 1.0s. Estimated remaining: 6m 8s. Rate: 170.1 symbols/min [2025-09-14T20:56:02.627346] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-14T20:56:02.642900] [DEBUG] [LOCAL ] LEN: Derivative data saved (1352 records). [2025-09-14T20:56:02.643095] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-14T20:56:02.645924] [INFO ] [MAIN ] Derivative Progress: 1184/2226 symbols completed. LEN took 1.0s. Estimated remaining: 6m 7s. Rate: 170.2 symbols/min [2025-09-14T20:56:02.656163] [DEBUG] [MAIN ] LEVI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:02.656905] [INFO ] [MAIN ] LEVI: Generated 1352 derivative records from 38710 primary records. [2025-09-14T20:56:02.656983] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-14T20:56:02.669439] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1352 records). [2025-09-14T20:56:02.669518] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-14T20:56:02.673764] [INFO ] [MAIN ] Derivative Progress: 1185/2226 symbols completed. LEVI took 1.0s. Estimated remaining: 6m 7s. Rate: 170.3 symbols/min [2025-09-14T20:56:02.674457] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:02.674819] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:02.674962] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:02.700393] [DEBUG] [LOCAL ] LGI: Loaded 7499 existing records from primary storage. [2025-09-14T20:56:02.700854] [DEBUG] [LOCAL ] LFT: Loaded 14281 existing records from primary storage. [2025-09-14T20:56:02.701206] [INFO ] [MAIN ] LGI: Loaded 7499 primary data records. [2025-09-14T20:56:02.701242] [INFO ] [MAIN ] LFT: Loaded 14281 primary data records. [2025-09-14T20:56:03.178382] [DEBUG] [LOCAL ] LH: Loaded 28629 existing records from primary storage. [2025-09-14T20:56:03.309448] [INFO ] [MAIN ] LH: Loaded 28629 primary data records. [2025-09-14T20:56:03.614758] [DEBUG] [MAIN ] LGI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:03.625906] [INFO ] [MAIN ] LGI: Generated 1352 derivative records from 7499 primary records. [2025-09-14T20:56:03.625044] [DEBUG] [MAIN ] LFT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:03.626672] [INFO ] [MAIN ] LFT: Generated 1352 derivative records from 14281 primary records. [2025-09-14T20:56:03.626021] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-14T20:56:03.628552] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-14T20:56:03.654611] [DEBUG] [LOCAL ] LGI: Derivative data saved (1352 records). [2025-09-14T20:56:03.653741] [DEBUG] [LOCAL ] LFT: Derivative data saved (1352 records). [2025-09-14T20:56:03.654827] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-14T20:56:03.654928] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-14T20:56:03.657041] [INFO ] [MAIN ] Derivative Progress: 1186/2226 symbols completed. LGI took 1.0s. Estimated remaining: 6m 7s. Rate: 170.1 symbols/min [2025-09-14T20:56:03.660602] [INFO ] [MAIN ] Derivative Progress: 1187/2226 symbols completed. LFT took 1.0s. Estimated remaining: 6m 6s. Rate: 170.2 symbols/min [2025-09-14T20:56:03.660510] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:03.662092] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:03.676820] [DEBUG] [MAIN ] LH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:03.677858] [INFO ] [MAIN ] LH: Generated 1352 derivative records from 28629 primary records. [2025-09-14T20:56:03.678033] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-14T20:56:03.697953] [DEBUG] [LOCAL ] LH: Derivative data saved (1352 records). [2025-09-14T20:56:03.698190] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-14T20:56:03.701355] [INFO ] [MAIN ] Derivative Progress: 1188/2226 symbols completed. LH took 1.0s. Estimated remaining: 6m 6s. Rate: 170.3 symbols/min [2025-09-14T20:56:03.701742] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:03.716549] [DEBUG] [LOCAL ] LII: Loaded 20548 existing records from primary storage. [2025-09-14T20:56:03.727497] [INFO ] [MAIN ] LII: Loaded 20548 primary data records. [2025-09-14T20:56:03.866435] [DEBUG] [LOCAL ] LHX: Loaded 36949 existing records from primary storage. [2025-09-14T20:56:03.910409] [INFO ] [MAIN ] LHX: Loaded 36949 primary data records. [2025-09-14T20:56:03.984311] [DEBUG] [LOCAL ] LION: Loaded 35561 existing records from primary storage. [2025-09-14T20:56:04.106717] [INFO ] [MAIN ] LION: Loaded 35561 primary data records. [2025-09-14T20:56:04.612540] [DEBUG] [MAIN ] LII: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:04.613794] [INFO ] [MAIN ] LII: Generated 1352 derivative records from 20548 primary records. [2025-09-14T20:56:04.614518] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-14T20:56:04.631821] [DEBUG] [LOCAL ] LII: Derivative data saved (1352 records). [2025-09-14T20:56:04.641948] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-14T20:56:04.642740] [DEBUG] [MAIN ] LHX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:04.645148] [INFO ] [MAIN ] Derivative Progress: 1189/2226 symbols completed. LII took 1.0s. Estimated remaining: 6m 6s. Rate: 170.1 symbols/min [2025-09-14T20:56:04.646778] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:04.646195] [INFO ] [MAIN ] LHX: Generated 1352 derivative records from 36949 primary records. [2025-09-14T20:56:04.647604] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-14T20:56:04.673455] [DEBUG] [MAIN ] LION: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:04.671112] [DEBUG] [LOCAL ] LITB: Loaded 2497 existing records from primary storage. [2025-09-14T20:56:04.679326] [INFO ] [MAIN ] LION: Generated 1352 derivative records from 35561 primary records. [2025-09-14T20:56:04.678530] [DEBUG] [LOCAL ] LHX: Derivative data saved (1352 records). [2025-09-14T20:56:04.679633] [INFO ] [MAIN ] LITB: Loaded 2497 primary data records. [2025-09-14T20:56:04.679965] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-14T20:56:04.700810] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-14T20:56:04.740189] [INFO ] [MAIN ] Derivative Progress: 1190/2226 symbols completed. LHX took 1.1s. Estimated remaining: 6m 5s. Rate: 170.2 symbols/min [2025-09-14T20:56:04.780039] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:04.805880] [DEBUG] [LOCAL ] LION: Derivative data saved (1352 records). [2025-09-14T20:56:04.822149] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-14T20:56:04.860483] [INFO ] [MAIN ] Derivative Progress: 1191/2226 symbols completed. LION took 1.2s. Estimated remaining: 6m 5s. Rate: 170.3 symbols/min [2025-09-14T20:56:04.871069] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:05.031322] [DEBUG] [MAIN ] LITB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:05.033025] [INFO ] [MAIN ] LITB: Generated 1352 derivative records from 2497 primary records. [2025-09-14T20:56:05.045683] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-14T20:56:05.059043] [DEBUG] [LOCAL ] LLY: Loaded 40112 existing records from primary storage. [2025-09-14T20:56:05.059560] [INFO ] [MAIN ] LLY: Loaded 40112 primary data records. [2025-09-14T20:56:05.068068] [DEBUG] [LOCAL ] LMND: Loaded 39073 existing records from primary storage. [2025-09-14T20:56:05.101744] [INFO ] [MAIN ] LMND: Loaded 39073 primary data records. [2025-09-14T20:56:05.164595] [DEBUG] [LOCAL ] LITB: Derivative data saved (1352 records). [2025-09-14T20:56:05.199391] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-14T20:56:05.206813] [INFO ] [MAIN ] Derivative Progress: 1192/2226 symbols completed. LITB took 0.6s. Estimated remaining: 6m 4s. Rate: 170.3 symbols/min [2025-09-14T20:56:05.260804] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:05.735673] [DEBUG] [MAIN ] LLY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:05.737421] [INFO ] [MAIN ] LLY: Generated 1352 derivative records from 40112 primary records. [2025-09-14T20:56:05.738099] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-14T20:56:05.751760] [DEBUG] [LOCAL ] LMT: Loaded 37406 existing records from primary storage. [2025-09-14T20:56:05.762752] [INFO ] [MAIN ] LMT: Loaded 37406 primary data records. [2025-09-14T20:56:05.765584] [DEBUG] [LOCAL ] LLY: Derivative data saved (1352 records). [2025-09-14T20:56:05.771459] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-14T20:56:05.790989] [INFO ] [MAIN ] Derivative Progress: 1193/2226 symbols completed. LLY took 1.0s. Estimated remaining: 6m 4s. Rate: 170.2 symbols/min [2025-09-14T20:56:05.834829] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:05.875044] [DEBUG] [MAIN ] LMND: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:05.889582] [INFO ] [MAIN ] LMND: Generated 1352 derivative records from 39073 primary records. [2025-09-14T20:56:05.916848] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-14T20:56:05.996845] [DEBUG] [LOCAL ] LMND: Derivative data saved (1352 records). [2025-09-14T20:56:06.087778] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-14T20:56:06.089858] [INFO ] [MAIN ] Derivative Progress: 1194/2226 symbols completed. LMND took 1.2s. Estimated remaining: 6m 4s. Rate: 170.2 symbols/min [2025-09-14T20:56:06.091172] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:06.105869] [DEBUG] [LOCAL ] LNC: Loaded 38705 existing records from primary storage. [2025-09-14T20:56:06.106900] [INFO ] [MAIN ] LNC: Loaded 38705 primary data records. [2025-09-14T20:56:06.189074] [DEBUG] [LOCAL ] LND: Loaded 3677 existing records from primary storage. [2025-09-14T20:56:06.215341] [INFO ] [MAIN ] LND: Loaded 3677 primary data records. [2025-09-14T20:56:06.691764] [DEBUG] [MAIN ] LMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:06.694132] [INFO ] [MAIN ] LMT: Generated 1352 derivative records from 37406 primary records. [2025-09-14T20:56:06.694600] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-14T20:56:06.712184] [DEBUG] [LOCAL ] LMT: Derivative data saved (1352 records). [2025-09-14T20:56:06.712804] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-14T20:56:06.715121] [INFO ] [MAIN ] Derivative Progress: 1195/2226 symbols completed. LMT took 1.5s. Estimated remaining: 6m 4s. Rate: 170.1 symbols/min [2025-09-14T20:56:06.715737] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:06.734713] [DEBUG] [MAIN ] LNC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:06.740278] [INFO ] [MAIN ] LNC: Generated 1352 derivative records from 38705 primary records. [2025-09-14T20:56:06.740774] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-14T20:56:06.752354] [DEBUG] [MAIN ] LND: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:06.773617] [INFO ] [MAIN ] LND: Generated 1352 derivative records from 3677 primary records. [2025-09-14T20:56:06.774043] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-14T20:56:06.790196] [DEBUG] [LOCAL ] LND: Derivative data saved (1352 records). [2025-09-14T20:56:06.790352] [DEBUG] [LOCAL ] LNC: Derivative data saved (1352 records). [2025-09-14T20:56:06.790613] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-14T20:56:06.802154] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-14T20:56:06.806403] [INFO ] [MAIN ] Derivative Progress: 1196/2226 symbols completed. LND took 0.7s. Estimated remaining: 6m 3s. Rate: 170.2 symbols/min [2025-09-14T20:56:06.806767] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:06.808979] [INFO ] [MAIN ] Derivative Progress: 1197/2226 symbols completed. LNC took 1.0s. Estimated remaining: 6m 2s. Rate: 170.4 symbols/min [2025-09-14T20:56:06.812365] [DEBUG] [LOCAL ] LNG: Loaded 38725 existing records from primary storage. [2025-09-14T20:56:06.812726] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:06.812964] [INFO ] [MAIN ] LNG: Loaded 38725 primary data records. [2025-09-14T20:56:06.905351] [DEBUG] [LOCAL ] LNN: Loaded 8309 existing records from primary storage. [2025-09-14T20:56:06.935210] [INFO ] [MAIN ] LNN: Loaded 8309 primary data records. [2025-09-14T20:56:07.158783] [DEBUG] [LOCAL ] LOAR: Loaded 32743 existing records from primary storage. [2025-09-14T20:56:07.163498] [INFO ] [MAIN ] LOAR: Loaded 32743 primary data records. [2025-09-14T20:56:07.746210] [DEBUG] [MAIN ] LNG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:07.747181] [INFO ] [MAIN ] LNG: Generated 1352 derivative records from 38725 primary records. [2025-09-14T20:56:07.749517] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-14T20:56:07.770297] [DEBUG] [MAIN ] LNN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:07.774242] [INFO ] [MAIN ] LNN: Generated 1352 derivative records from 8309 primary records. [2025-09-14T20:56:07.776238] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-14T20:56:07.777557] [DEBUG] [LOCAL ] LNG: Derivative data saved (1352 records). [2025-09-14T20:56:07.779112] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-14T20:56:07.790045] [INFO ] [MAIN ] Derivative Progress: 1198/2226 symbols completed. LNG took 1.1s. Estimated remaining: 6m 3s. Rate: 170.1 symbols/min [2025-09-14T20:56:07.794390] [DEBUG] [LOCAL ] LNN: Derivative data saved (1352 records). [2025-09-14T20:56:07.796030] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-14T20:56:07.798448] [INFO ] [MAIN ] Derivative Progress: 1199/2226 symbols completed. LNN took 1.0s. Estimated remaining: 6m 2s. Rate: 170.3 symbols/min [2025-09-14T20:56:07.809098] [DEBUG] [MAIN ] LOAR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:07.809905] [INFO ] [MAIN ] LOAR: Generated 1352 derivative records from 32743 primary records. [2025-09-14T20:56:07.809984] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-14T20:56:07.822275] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1352 records). [2025-09-14T20:56:07.822355] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-14T20:56:07.824478] [INFO ] [MAIN ] Derivative Progress: 1200/2226 symbols completed. LOAR took 1.0s. Estimated remaining: 6m 1s. Rate: 170.4 symbols/min [2025-09-14T20:56:07.825037] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:07.825242] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:07.825362] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:07.831997] [DEBUG] [LOCAL ] LOCL: Loaded 2141 existing records from primary storage. [2025-09-14T20:56:07.832256] [INFO ] [MAIN ] LOCL: Loaded 2141 primary data records. [2025-09-14T20:56:08.088191] [DEBUG] [LOCAL ] LOMA: Loaded 23254 existing records from primary storage. [2025-09-14T20:56:08.088309] [DEBUG] [LOCAL ] LOB: Loaded 19624 existing records from primary storage. [2025-09-14T20:56:08.181304] [INFO ] [MAIN ] LOMA: Loaded 23254 primary data records. [2025-09-14T20:56:08.175985] [INFO ] [MAIN ] LOB: Loaded 19624 primary data records. [2025-09-14T20:56:08.815907] [DEBUG] [MAIN ] LOCL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:08.818366] [INFO ] [MAIN ] LOCL: Generated 1352 derivative records from 2141 primary records. [2025-09-14T20:56:08.819328] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-14T20:56:08.835062] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1352 records). [2025-09-14T20:56:08.835448] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-14T20:56:08.837978] [INFO ] [MAIN ] Derivative Progress: 1201/2226 symbols completed. LOCL took 1.0s. Estimated remaining: 6m 2s. Rate: 170.1 symbols/min [2025-09-14T20:56:08.838530] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:08.855818] [DEBUG] [MAIN ] LOB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:08.858118] [INFO ] [MAIN ] LOB: Generated 1352 derivative records from 19624 primary records. [2025-09-14T20:56:08.859589] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-14T20:56:08.885109] [DEBUG] [MAIN ] LOMA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:08.888857] [INFO ] [MAIN ] LOMA: Generated 1352 derivative records from 23254 primary records. [2025-09-14T20:56:08.888965] [DEBUG] [LOCAL ] LOB: Derivative data saved (1352 records). [2025-09-14T20:56:08.889489] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-14T20:56:08.889992] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-14T20:56:08.903493] [INFO ] [MAIN ] Derivative Progress: 1202/2226 symbols completed. LOB took 1.1s. Estimated remaining: 6m 1s. Rate: 170.2 symbols/min [2025-09-14T20:56:08.904091] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:08.924083] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1352 records). [2025-09-14T20:56:08.924525] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-14T20:56:08.939029] [INFO ] [MAIN ] Derivative Progress: 1203/2226 symbols completed. LOMA took 1.1s. Estimated remaining: 6m 0s. Rate: 170.4 symbols/min [2025-09-14T20:56:08.939481] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:08.941422] [DEBUG] [LOCAL ] LOW: Loaded 39883 existing records from primary storage. [2025-09-14T20:56:08.942161] [INFO ] [MAIN ] LOW: Loaded 39883 primary data records. [2025-09-14T20:56:09.074250] [DEBUG] [LOCAL ] LPL: Loaded 19157 existing records from primary storage. [2025-09-14T20:56:09.125134] [INFO ] [MAIN ] LPL: Loaded 19157 primary data records. [2025-09-14T20:56:09.257397] [DEBUG] [LOCAL ] LPG: Loaded 30148 existing records from primary storage. [2025-09-14T20:56:09.299544] [INFO ] [MAIN ] LPG: Loaded 30148 primary data records. [2025-09-14T20:56:09.873242] [DEBUG] [MAIN ] LOW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:09.874387] [INFO ] [MAIN ] LOW: Generated 1352 derivative records from 39883 primary records. [2025-09-14T20:56:09.876175] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-14T20:56:09.892985] [DEBUG] [LOCAL ] LOW: Derivative data saved (1352 records). [2025-09-14T20:56:09.895088] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-14T20:56:09.898713] [INFO ] [MAIN ] Derivative Progress: 1204/2226 symbols completed. LOW took 1.1s. Estimated remaining: 6m 0s. Rate: 170.1 symbols/min [2025-09-14T20:56:09.900335] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:09.912679] [DEBUG] [MAIN ] LPL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:09.923833] [DEBUG] [MAIN ] LPG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:09.924755] [INFO ] [MAIN ] LPL: Generated 1352 derivative records from 19157 primary records. [2025-09-14T20:56:09.925700] [INFO ] [MAIN ] LPG: Generated 1352 derivative records from 30148 primary records. [2025-09-14T20:56:09.925804] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-14T20:56:09.925997] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-14T20:56:09.949733] [DEBUG] [LOCAL ] LPL: Derivative data saved (1352 records). [2025-09-14T20:56:09.951295] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-14T20:56:09.954953] [INFO ] [MAIN ] Derivative Progress: 1205/2226 symbols completed. LPL took 1.0s. Estimated remaining: 5m 60s. Rate: 170.2 symbols/min [2025-09-14T20:56:09.956762] [DEBUG] [LOCAL ] LPG: Derivative data saved (1352 records). [2025-09-14T20:56:09.955972] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:09.956937] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-14T20:56:09.967400] [INFO ] [MAIN ] Derivative Progress: 1206/2226 symbols completed. LPG took 1.1s. Estimated remaining: 5m 59s. Rate: 170.4 symbols/min [2025-09-14T20:56:09.968089] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:09.982748] [DEBUG] [LOCAL ] LPX: Loaded 29818 existing records from primary storage. [2025-09-14T20:56:09.982949] [INFO ] [MAIN ] LPX: Loaded 29818 primary data records. [2025-09-14T20:56:10.322885] [DEBUG] [LOCAL ] LRN: Loaded 29698 existing records from primary storage. [2025-09-14T20:56:10.340445] [DEBUG] [LOCAL ] LSPD: Loaded 31705 existing records from primary storage. [2025-09-14T20:56:10.346272] [INFO ] [MAIN ] LRN: Loaded 29698 primary data records. [2025-09-14T20:56:10.347022] [INFO ] [MAIN ] LSPD: Loaded 31705 primary data records. [2025-09-14T20:56:10.952356] [DEBUG] [MAIN ] LPX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:10.953605] [INFO ] [MAIN ] LPX: Generated 1352 derivative records from 29818 primary records. [2025-09-14T20:56:10.953729] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-14T20:56:10.968757] [DEBUG] [LOCAL ] LPX: Derivative data saved (1352 records). [2025-09-14T20:56:10.968927] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-14T20:56:10.971039] [INFO ] [MAIN ] Derivative Progress: 1207/2226 symbols completed. LPX took 1.1s. Estimated remaining: 5m 59s. Rate: 170.1 symbols/min [2025-09-14T20:56:10.971582] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:11.008112] [DEBUG] [MAIN ] LSPD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:11.007713] [DEBUG] [MAIN ] LRN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:11.010227] [INFO ] [MAIN ] LSPD: Generated 1352 derivative records from 31705 primary records. [2025-09-14T20:56:11.008924] [INFO ] [MAIN ] LRN: Generated 1352 derivative records from 29698 primary records. [2025-09-14T20:56:11.010354] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-14T20:56:11.010579] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-14T20:56:11.021823] [DEBUG] [LOCAL ] LTC: Loaded 22507 existing records from primary storage. [2025-09-14T20:56:11.022417] [INFO ] [MAIN ] LTC: Loaded 22507 primary data records. [2025-09-14T20:56:11.139519] [DEBUG] [LOCAL ] LRN: Derivative data saved (1352 records). [2025-09-14T20:56:11.161043] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1352 records). [2025-09-14T20:56:11.160544] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-14T20:56:11.189591] [INFO ] [MAIN ] Derivative Progress: 1208/2226 symbols completed. LRN took 1.2s. Estimated remaining: 5m 59s. Rate: 170.2 symbols/min [2025-09-14T20:56:11.205599] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-14T20:56:11.216703] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:11.216809] [INFO ] [MAIN ] Derivative Progress: 1209/2226 symbols completed. LSPD took 1.2s. Estimated remaining: 5m 58s. Rate: 170.3 symbols/min [2025-09-14T20:56:11.243882] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:11.370701] [DEBUG] [LOCAL ] LTM: Loaded 28107 existing records from primary storage. [2025-09-14T20:56:11.381694] [INFO ] [MAIN ] LTM: Loaded 28107 primary data records. [2025-09-14T20:56:11.527084] [DEBUG] [LOCAL ] LTH: Loaded 38977 existing records from primary storage. [2025-09-14T20:56:11.528506] [DEBUG] [MAIN ] LTC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:11.555045] [INFO ] [MAIN ] LTH: Loaded 38977 primary data records. [2025-09-14T20:56:11.561308] [INFO ] [MAIN ] LTC: Generated 1352 derivative records from 22507 primary records. [2025-09-14T20:56:11.621594] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-14T20:56:11.846856] [DEBUG] [LOCAL ] LTC: Derivative data saved (1352 records). [2025-09-14T20:56:11.847691] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-14T20:56:11.850416] [INFO ] [MAIN ] Derivative Progress: 1210/2226 symbols completed. LTC took 0.9s. Estimated remaining: 5m 58s. Rate: 170.2 symbols/min [2025-09-14T20:56:11.892547] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:12.071376] [DEBUG] [MAIN ] LTM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:12.072571] [INFO ] [MAIN ] LTM: Generated 1352 derivative records from 28107 primary records. [2025-09-14T20:56:12.083739] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-14T20:56:12.100774] [DEBUG] [LOCAL ] LTM: Derivative data saved (1352 records). [2025-09-14T20:56:12.101082] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-14T20:56:12.114480] [INFO ] [MAIN ] Derivative Progress: 1211/2226 symbols completed. LTM took 0.9s. Estimated remaining: 5m 58s. Rate: 170.2 symbols/min [2025-09-14T20:56:12.115038] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:12.116147] [DEBUG] [LOCAL ] LU: Loaded 36936 existing records from primary storage. [2025-09-14T20:56:12.116415] [INFO ] [MAIN ] LU: Loaded 36936 primary data records. [2025-09-14T20:56:12.244791] [DEBUG] [MAIN ] LTH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:12.256451] [INFO ] [MAIN ] LTH: Generated 1352 derivative records from 38977 primary records. [2025-09-14T20:56:12.303621] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-14T20:56:12.417477] [DEBUG] [LOCAL ] LUCK: Loaded 17981 existing records from primary storage. [2025-09-14T20:56:12.418501] [INFO ] [MAIN ] LUCK: Loaded 17981 primary data records. [2025-09-14T20:56:12.513350] [DEBUG] [LOCAL ] LTH: Derivative data saved (1352 records). [2025-09-14T20:56:12.538843] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-14T20:56:12.544750] [INFO ] [MAIN ] Derivative Progress: 1212/2226 symbols completed. LTH took 1.3s. Estimated remaining: 5m 57s. Rate: 170.2 symbols/min [2025-09-14T20:56:12.545571] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:12.801965] [DEBUG] [MAIN ] LU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:12.803711] [INFO ] [MAIN ] LU: Generated 1352 derivative records from 36936 primary records. [2025-09-14T20:56:12.804047] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-14T20:56:12.829093] [DEBUG] [LOCAL ] LU: Derivative data saved (1352 records). [2025-09-14T20:56:12.830404] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-14T20:56:12.833203] [INFO ] [MAIN ] Derivative Progress: 1213/2226 symbols completed. LU took 1.0s. Estimated remaining: 5m 57s. Rate: 170.2 symbols/min [2025-09-14T20:56:12.847626] [DEBUG] [LOCAL ] LUMN: Loaded 40397 existing records from primary storage. [2025-09-14T20:56:12.848231] [INFO ] [MAIN ] LUMN: Loaded 40397 primary data records. [2025-09-14T20:56:13.041395] [DEBUG] [MAIN ] LUCK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:13.131196] [INFO ] [MAIN ] LUCK: Generated 1352 derivative records from 17981 primary records. [2025-09-14T20:56:13.131810] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-09-14T20:56:13.146436] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1352 records). [2025-09-14T20:56:13.146887] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-09-14T20:56:13.149597] [INFO ] [MAIN ] Derivative Progress: 1214/2226 symbols completed. LUCK took 1.0s. Estimated remaining: 5m 57s. Rate: 170.2 symbols/min [2025-09-14T20:56:13.166106] [DEBUG] [MAIN ] LUMN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:13.166894] [INFO ] [MAIN ] LUMN: Generated 1352 derivative records from 40397 primary records. [2025-09-14T20:56:13.166971] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-14T20:56:13.178959] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1352 records). [2025-09-14T20:56:13.179059] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-14T20:56:13.181121] [INFO ] [MAIN ] Derivative Progress: 1215/2226 symbols completed. LUMN took 0.6s. Estimated remaining: 5m 56s. Rate: 170.4 symbols/min [2025-09-14T20:56:13.181622] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:13.181817] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:13.181922] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:13.203418] [DEBUG] [LOCAL ] LVWR: Loaded 15617 existing records from primary storage. [2025-09-14T20:56:13.203779] [INFO ] [MAIN ] LVWR: Loaded 15617 primary data records. [2025-09-14T20:56:13.437634] [DEBUG] [LOCAL ] LVS: Loaded 40317 existing records from primary storage. [2025-09-14T20:56:13.444274] [DEBUG] [LOCAL ] LUV: Loaded 40429 existing records from primary storage. [2025-09-14T20:56:13.444483] [INFO ] [MAIN ] LVS: Loaded 40317 primary data records. [2025-09-14T20:56:13.532876] [INFO ] [MAIN ] LUV: Loaded 40429 primary data records. [2025-09-14T20:56:14.158456] [DEBUG] [MAIN ] LVWR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:14.160893] [INFO ] [MAIN ] LVWR: Generated 1352 derivative records from 15617 primary records. [2025-09-14T20:56:14.161664] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-14T20:56:14.178128] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1352 records). [2025-09-14T20:56:14.179190] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-14T20:56:14.181597] [INFO ] [MAIN ] Derivative Progress: 1216/2226 symbols completed. LVWR took 1.0s. Estimated remaining: 5m 56s. Rate: 170.1 symbols/min [2025-09-14T20:56:14.182382] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:14.193553] [DEBUG] [MAIN ] LVS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:14.194790] [INFO ] [MAIN ] LVS: Generated 1352 derivative records from 40317 primary records. [2025-09-14T20:56:14.197293] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-14T20:56:14.220623] [DEBUG] [MAIN ] LUV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:14.226666] [DEBUG] [LOCAL ] LVS: Derivative data saved (1352 records). [2025-09-14T20:56:14.226821] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-14T20:56:14.225338] [INFO ] [MAIN ] LUV: Generated 1352 derivative records from 40429 primary records. [2025-09-14T20:56:14.230156] [INFO ] [MAIN ] Derivative Progress: 1217/2226 symbols completed. LVS took 1.0s. Estimated remaining: 5m 56s. Rate: 170.2 symbols/min [2025-09-14T20:56:14.230541] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:14.230275] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-14T20:56:14.244591] [DEBUG] [LOCAL ] LUV: Derivative data saved (1352 records). [2025-09-14T20:56:14.244842] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-14T20:56:14.247436] [INFO ] [MAIN ] Derivative Progress: 1218/2226 symbols completed. LUV took 1.1s. Estimated remaining: 5m 55s. Rate: 170.4 symbols/min [2025-09-14T20:56:14.259229] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:14.266275] [DEBUG] [LOCAL ] LXFR: Loaded 12577 existing records from primary storage. [2025-09-14T20:56:14.266462] [INFO ] [MAIN ] LXFR: Loaded 12577 primary data records. [2025-09-14T20:56:14.384312] [DEBUG] [LOCAL ] LW: Loaded 38350 existing records from primary storage. [2025-09-14T20:56:14.384699] [INFO ] [MAIN ] LW: Loaded 38350 primary data records. [2025-09-14T20:56:14.591410] [DEBUG] [LOCAL ] LXP: Loaded 38192 existing records from primary storage. [2025-09-14T20:56:14.683196] [INFO ] [MAIN ] LXP: Loaded 38192 primary data records. [2025-09-14T20:56:15.219604] [DEBUG] [MAIN ] LXFR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:15.223215] [INFO ] [MAIN ] LXFR: Generated 1352 derivative records from 12577 primary records. [2025-09-14T20:56:15.224387] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-14T20:56:15.242582] [DEBUG] [MAIN ] LW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:15.248193] [INFO ] [MAIN ] LW: Generated 1352 derivative records from 38350 primary records. [2025-09-14T20:56:15.249846] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-14T20:56:15.252232] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1352 records). [2025-09-14T20:56:15.262851] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-14T20:56:15.266364] [DEBUG] [LOCAL ] LW: Derivative data saved (1352 records). [2025-09-14T20:56:15.268847] [INFO ] [MAIN ] Derivative Progress: 1219/2226 symbols completed. LXFR took 1.0s. Estimated remaining: 5m 55s. Rate: 170.1 symbols/min [2025-09-14T20:56:15.269247] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-14T20:56:15.275422] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:15.281832] [INFO ] [MAIN ] Derivative Progress: 1220/2226 symbols completed. LW took 1.1s. Estimated remaining: 5m 55s. Rate: 170.2 symbols/min [2025-09-14T20:56:15.282104] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:15.282550] [DEBUG] [MAIN ] LXP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:15.283864] [INFO ] [MAIN ] LXP: Generated 1352 derivative records from 38192 primary records. [2025-09-14T20:56:15.284174] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-14T20:56:15.298911] [DEBUG] [LOCAL ] LXP: Derivative data saved (1352 records). [2025-09-14T20:56:15.299240] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-14T20:56:15.301283] [INFO ] [MAIN ] Derivative Progress: 1221/2226 symbols completed. LXP took 1.0s. Estimated remaining: 5m 54s. Rate: 170.4 symbols/min [2025-09-14T20:56:15.301675] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:15.322409] [DEBUG] [LOCAL ] LXU: Loaded 24142 existing records from primary storage. [2025-09-14T20:56:15.322724] [INFO ] [MAIN ] LXU: Loaded 24142 primary data records. [2025-09-14T20:56:15.541245] [DEBUG] [LOCAL ] LYB: Loaded 40365 existing records from primary storage. [2025-09-14T20:56:15.558123] [INFO ] [MAIN ] LYB: Loaded 40365 primary data records. [2025-09-14T20:56:15.665892] [DEBUG] [LOCAL ] LYG: Loaded 39753 existing records from primary storage. [2025-09-14T20:56:15.697655] [INFO ] [MAIN ] LYG: Loaded 39753 primary data records. [2025-09-14T20:56:16.232265] [DEBUG] [MAIN ] LXU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:16.234001] [INFO ] [MAIN ] LXU: Generated 1352 derivative records from 24142 primary records. [2025-09-14T20:56:16.234555] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-14T20:56:16.248394] [DEBUG] [LOCAL ] LXU: Derivative data saved (1352 records). [2025-09-14T20:56:16.248683] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-14T20:56:16.250838] [INFO ] [MAIN ] Derivative Progress: 1222/2226 symbols completed. LXU took 1.0s. Estimated remaining: 5m 54s. Rate: 170.1 symbols/min [2025-09-14T20:56:16.251855] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:16.267537] [DEBUG] [MAIN ] LYB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:16.268413] [INFO ] [MAIN ] LYB: Generated 1352 derivative records from 40365 primary records. [2025-09-14T20:56:16.268924] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-14T20:56:16.289762] [DEBUG] [MAIN ] LYG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:16.295348] [INFO ] [MAIN ] LYG: Generated 1352 derivative records from 39753 primary records. [2025-09-14T20:56:16.296195] [DEBUG] [LOCAL ] LYB: Derivative data saved (1352 records). [2025-09-14T20:56:16.296467] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-14T20:56:16.296576] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-14T20:56:16.299746] [INFO ] [MAIN ] Derivative Progress: 1223/2226 symbols completed. LYB took 1.0s. Estimated remaining: 5m 53s. Rate: 170.2 symbols/min [2025-09-14T20:56:16.301332] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:16.323897] [DEBUG] [LOCAL ] LYG: Derivative data saved (1352 records). [2025-09-14T20:56:16.324096] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-14T20:56:16.326362] [INFO ] [MAIN ] Derivative Progress: 1224/2226 symbols completed. LYG took 1.0s. Estimated remaining: 5m 53s. Rate: 170.4 symbols/min [2025-09-14T20:56:16.326875] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:16.350478] [DEBUG] [LOCAL ] LYV: Loaded 38333 existing records from primary storage. [2025-09-14T20:56:16.350760] [INFO ] [MAIN ] LYV: Loaded 38333 primary data records. [2025-09-14T20:56:16.436053] [DEBUG] [LOCAL ] LZM: Loaded 9361 existing records from primary storage. [2025-09-14T20:56:16.460503] [DEBUG] [LOCAL ] LZB: Loaded 26397 existing records from primary storage. [2025-09-14T20:56:16.471718] [INFO ] [MAIN ] LZM: Loaded 9361 primary data records. [2025-09-14T20:56:16.472333] [INFO ] [MAIN ] LZB: Loaded 26397 primary data records. [2025-09-14T20:56:17.219674] [DEBUG] [MAIN ] LYV: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:56:17.220621] [INFO ] [MAIN ] LYV: Generated 1351 derivative records from 38333 primary records. [2025-09-14T20:56:17.221057] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-14T20:56:17.248569] [DEBUG] [MAIN ] LZM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:17.251392] [INFO ] [MAIN ] LZM: Generated 1352 derivative records from 9361 primary records. [2025-09-14T20:56:17.248671] [DEBUG] [LOCAL ] LYV: Derivative data saved (1351 records). [2025-09-14T20:56:17.252212] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-14T20:56:17.252154] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-14T20:56:17.255091] [INFO ] [MAIN ] Derivative Progress: 1225/2226 symbols completed. LYV took 1.0s. Estimated remaining: 5m 53s. Rate: 170.1 symbols/min [2025-09-14T20:56:17.261664] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:17.265884] [DEBUG] [MAIN ] LZB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:17.275636] [INFO ] [MAIN ] LZB: Generated 1352 derivative records from 26397 primary records. [2025-09-14T20:56:17.275859] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-14T20:56:17.279244] [DEBUG] [LOCAL ] LZM: Derivative data saved (1352 records). [2025-09-14T20:56:17.279975] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-14T20:56:17.291036] [INFO ] [MAIN ] Derivative Progress: 1226/2226 symbols completed. LZM took 1.0s. Estimated remaining: 5m 52s. Rate: 170.3 symbols/min [2025-09-14T20:56:17.293761] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:17.294693] [DEBUG] [LOCAL ] LZB: Derivative data saved (1352 records). [2025-09-14T20:56:17.295396] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-14T20:56:17.297478] [INFO ] [MAIN ] Derivative Progress: 1227/2226 symbols completed. LZB took 1.0s. Estimated remaining: 5m 52s. Rate: 170.4 symbols/min [2025-09-14T20:56:17.297916] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:17.379349] [DEBUG] [LOCAL ] M: Loaded 40298 existing records from primary storage. [2025-09-14T20:56:17.381712] [INFO ] [MAIN ] M: Loaded 40298 primary data records. [2025-09-14T20:56:17.382418] [DEBUG] [LOCAL ] MA: Loaded 39448 existing records from primary storage. [2025-09-14T20:56:17.381387] [DEBUG] [LOCAL ] MAA: Loaded 32420 existing records from primary storage. [2025-09-14T20:56:17.388008] [INFO ] [MAIN ] MAA: Loaded 32420 primary data records. [2025-09-14T20:56:17.404230] [INFO ] [MAIN ] MA: Loaded 39448 primary data records. [2025-09-14T20:56:18.335690] [DEBUG] [MAIN ] M: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:18.336607] [INFO ] [MAIN ] M: Generated 1352 derivative records from 40298 primary records. [2025-09-14T20:56:18.337112] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-14T20:56:18.373948] [DEBUG] [MAIN ] MA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:18.373430] [DEBUG] [LOCAL ] M: Derivative data saved (1352 records). [2025-09-14T20:56:18.374385] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-14T20:56:18.374181] [DEBUG] [MAIN ] MAA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:18.375037] [INFO ] [MAIN ] MA: Generated 1352 derivative records from 39448 primary records. [2025-09-14T20:56:18.375710] [INFO ] [MAIN ] MAA: Generated 1352 derivative records from 32420 primary records. [2025-09-14T20:56:18.377380] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-14T20:56:18.377497] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-14T20:56:18.377227] [INFO ] [MAIN ] Derivative Progress: 1228/2226 symbols completed. M took 1.1s. Estimated remaining: 5m 52s. Rate: 170.1 symbols/min [2025-09-14T20:56:18.401104] [DEBUG] [LOCAL ] MA: Derivative data saved (1352 records). [2025-09-14T20:56:18.402149] [DEBUG] [LOCAL ] MAA: Derivative data saved (1352 records). [2025-09-14T20:56:18.402270] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-14T20:56:18.402347] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-14T20:56:18.404695] [INFO ] [MAIN ] Derivative Progress: 1229/2226 symbols completed. MA took 1.1s. Estimated remaining: 5m 51s. Rate: 170.2 symbols/min [2025-09-14T20:56:18.407040] [INFO ] [MAIN ] Derivative Progress: 1230/2226 symbols completed. MAA took 1.1s. Estimated remaining: 5m 51s. Rate: 170.4 symbols/min [2025-09-14T20:56:18.407749] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:18.407635] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:18.408040] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:18.465504] [DEBUG] [LOCAL ] MAGN: Loaded 26412 existing records from primary storage. [2025-09-14T20:56:18.466738] [INFO ] [MAIN ] MAGN: Loaded 26412 primary data records. [2025-09-14T20:56:18.467207] [DEBUG] [LOCAL ] MAIN: Loaded 30873 existing records from primary storage. [2025-09-14T20:56:18.523040] [INFO ] [MAIN ] MAIN: Loaded 30873 primary data records. [2025-09-14T20:56:18.598963] [DEBUG] [LOCAL ] MAC: Loaded 37163 existing records from primary storage. [2025-09-14T20:56:18.645130] [INFO ] [MAIN ] MAC: Loaded 37163 primary data records. [2025-09-14T20:56:19.379997] [DEBUG] [MAIN ] MAGN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:19.391084] [DEBUG] [MAIN ] MAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:19.396310] [INFO ] [MAIN ] MAC: Generated 1352 derivative records from 37163 primary records. [2025-09-14T20:56:19.392508] [INFO ] [MAIN ] MAGN: Generated 1352 derivative records from 26412 primary records. [2025-09-14T20:56:19.396959] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-14T20:56:19.397071] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-14T20:56:19.432734] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1352 records). [2025-09-14T20:56:19.433580] [DEBUG] [LOCAL ] MAC: Derivative data saved (1352 records). [2025-09-14T20:56:19.433936] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-14T20:56:19.434309] [DEBUG] [MAIN ] MAIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:19.434569] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-14T20:56:19.437471] [INFO ] [MAIN ] Derivative Progress: 1231/2226 symbols completed. MAGN took 1.0s. Estimated remaining: 5m 51s. Rate: 170.1 symbols/min [2025-09-14T20:56:19.441145] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:19.441971] [INFO ] [MAIN ] MAIN: Generated 1352 derivative records from 30873 primary records. [2025-09-14T20:56:19.442153] [INFO ] [MAIN ] Derivative Progress: 1232/2226 symbols completed. MAC took 1.0s. Estimated remaining: 5m 50s. Rate: 170.3 symbols/min [2025-09-14T20:56:19.442894] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:19.443346] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-14T20:56:19.459410] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1352 records). [2025-09-14T20:56:19.459759] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-14T20:56:19.461873] [INFO ] [MAIN ] Derivative Progress: 1233/2226 symbols completed. MAIN took 1.1s. Estimated remaining: 5m 50s. Rate: 170.4 symbols/min [2025-09-14T20:56:19.462310] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:19.483538] [DEBUG] [LOCAL ] MANU: Loaded 19444 existing records from primary storage. [2025-09-14T20:56:19.493360] [INFO ] [MAIN ] MANU: Loaded 19444 primary data records. [2025-09-14T20:56:19.630096] [DEBUG] [LOCAL ] MAN: Loaded 33038 existing records from primary storage. [2025-09-14T20:56:19.630590] [INFO ] [MAIN ] MAN: Loaded 33038 primary data records. [2025-09-14T20:56:19.798233] [DEBUG] [LOCAL ] MAS: Loaded 39365 existing records from primary storage. [2025-09-14T20:56:19.842682] [INFO ] [MAIN ] MAS: Loaded 39365 primary data records. [2025-09-14T20:56:20.496980] [DEBUG] [MAIN ] MANU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:20.498559] [INFO ] [MAIN ] MANU: Generated 1352 derivative records from 19444 primary records. [2025-09-14T20:56:20.499405] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-14T20:56:20.525334] [DEBUG] [LOCAL ] MANU: Derivative data saved (1352 records). [2025-09-14T20:56:20.526391] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-14T20:56:20.526297] [DEBUG] [MAIN ] MAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:20.528998] [INFO ] [MAIN ] Derivative Progress: 1234/2226 symbols completed. MANU took 1.1s. Estimated remaining: 5m 50s. Rate: 170.1 symbols/min [2025-09-14T20:56:20.529940] [INFO ] [MAIN ] MAN: Generated 1352 derivative records from 33038 primary records. [2025-09-14T20:56:20.532036] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-14T20:56:20.531929] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:20.544340] [DEBUG] [MAIN ] MAS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:20.555961] [INFO ] [MAIN ] MAS: Generated 1352 derivative records from 39365 primary records. [2025-09-14T20:56:20.561800] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-14T20:56:20.562036] [DEBUG] [LOCAL ] MAN: Derivative data saved (1352 records). [2025-09-14T20:56:20.562568] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-14T20:56:20.565415] [INFO ] [MAIN ] Derivative Progress: 1235/2226 symbols completed. MAN took 1.1s. Estimated remaining: 5m 49s. Rate: 170.2 symbols/min [2025-09-14T20:56:20.566655] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:20.582432] [DEBUG] [LOCAL ] MAS: Derivative data saved (1352 records). [2025-09-14T20:56:20.582808] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-14T20:56:20.586100] [INFO ] [MAIN ] Derivative Progress: 1236/2226 symbols completed. MAS took 1.1s. Estimated remaining: 5m 49s. Rate: 170.4 symbols/min [2025-09-14T20:56:20.586794] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:20.626053] [DEBUG] [LOCAL ] MATX: Loaded 24183 existing records from primary storage. [2025-09-14T20:56:20.627232] [INFO ] [MAIN ] MATX: Loaded 24183 primary data records. [2025-09-14T20:56:20.626831] [DEBUG] [LOCAL ] MATV: Loaded 27232 existing records from primary storage. [2025-09-14T20:56:20.637373] [INFO ] [MAIN ] MATV: Loaded 27232 primary data records. [2025-09-14T20:56:20.796666] [DEBUG] [LOCAL ] MAX: Loaded 22509 existing records from primary storage. [2025-09-14T20:56:20.865423] [INFO ] [MAIN ] MAX: Loaded 22509 primary data records. [2025-09-14T20:56:21.515102] [DEBUG] [MAIN ] MATX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:21.516247] [INFO ] [MAIN ] MATX: Generated 1352 derivative records from 24183 primary records. [2025-09-14T20:56:21.519138] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-14T20:56:21.540554] [DEBUG] [MAIN ] MATV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:21.543184] [INFO ] [MAIN ] MATV: Generated 1352 derivative records from 27232 primary records. [2025-09-14T20:56:21.543760] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-14T20:56:21.547569] [DEBUG] [LOCAL ] MATX: Derivative data saved (1352 records). [2025-09-14T20:56:21.557153] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-14T20:56:21.559859] [INFO ] [MAIN ] Derivative Progress: 1237/2226 symbols completed. MATX took 1.0s. Estimated remaining: 5m 49s. Rate: 170.1 symbols/min [2025-09-14T20:56:21.567006] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:21.572193] [DEBUG] [MAIN ] MAX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:21.573895] [INFO ] [MAIN ] MAX: Generated 1352 derivative records from 22509 primary records. [2025-09-14T20:56:21.574337] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-14T20:56:21.574945] [DEBUG] [LOCAL ] MATV: Derivative data saved (1352 records). [2025-09-14T20:56:21.576198] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-14T20:56:21.587459] [INFO ] [MAIN ] Derivative Progress: 1238/2226 symbols completed. MATV took 1.1s. Estimated remaining: 5m 48s. Rate: 170.2 symbols/min [2025-09-14T20:56:21.591259] [DEBUG] [LOCAL ] MAX: Derivative data saved (1352 records). [2025-09-14T20:56:21.591915] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-14T20:56:21.594562] [INFO ] [MAIN ] Derivative Progress: 1239/2226 symbols completed. MAX took 1.0s. Estimated remaining: 5m 48s. Rate: 170.4 symbols/min [2025-09-14T20:56:21.594699] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:21.595694] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:21.636195] [DEBUG] [LOCAL ] MBI: Loaded 17956 existing records from primary storage. [2025-09-14T20:56:21.636382] [INFO ] [MAIN ] MBI: Loaded 17956 primary data records. [2025-09-14T20:56:21.720567] [DEBUG] [LOCAL ] MC: Loaded 33022 existing records from primary storage. [2025-09-14T20:56:21.765434] [INFO ] [MAIN ] MC: Loaded 33022 primary data records. [2025-09-14T20:56:21.770538] [DEBUG] [LOCAL ] MBC: Loaded 32070 existing records from primary storage. [2025-09-14T20:56:21.776551] [INFO ] [MAIN ] MBC: Loaded 32070 primary data records. [2025-09-14T20:56:22.592583] [DEBUG] [MAIN ] MBI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:22.596007] [INFO ] [MAIN ] MBI: Generated 1352 derivative records from 17956 primary records. [2025-09-14T20:56:22.599092] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-14T20:56:22.612017] [DEBUG] [MAIN ] MC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:22.621911] [INFO ] [MAIN ] MC: Generated 1352 derivative records from 33022 primary records. [2025-09-14T20:56:22.624446] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-14T20:56:22.626290] [DEBUG] [LOCAL ] MBI: Derivative data saved (1352 records). [2025-09-14T20:56:22.637570] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-14T20:56:22.640513] [DEBUG] [LOCAL ] MC: Derivative data saved (1352 records). [2025-09-14T20:56:22.642345] [INFO ] [MAIN ] Derivative Progress: 1240/2226 symbols completed. MBI took 1.1s. Estimated remaining: 5m 48s. Rate: 170.1 symbols/min [2025-09-14T20:56:22.643899] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-14T20:56:22.643806] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:22.654504] [DEBUG] [MAIN ] MBC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:22.657126] [INFO ] [MAIN ] Derivative Progress: 1241/2226 symbols completed. MC took 1.1s. Estimated remaining: 5m 47s. Rate: 170.2 symbols/min [2025-09-14T20:56:22.658294] [INFO ] [MAIN ] MBC: Generated 1352 derivative records from 32070 primary records. [2025-09-14T20:56:22.658777] [INFO ] [MAIN ] MCD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:22.659073] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-14T20:56:22.681002] [DEBUG] [LOCAL ] MBC: Derivative data saved (1352 records). [2025-09-14T20:56:22.681704] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-14T20:56:22.681300] [DEBUG] [LOCAL ] MCB: Loaded 8245 existing records from primary storage. [2025-09-14T20:56:22.683711] [INFO ] [MAIN ] Derivative Progress: 1242/2226 symbols completed. MBC took 1.1s. Estimated remaining: 5m 47s. Rate: 170.4 symbols/min [2025-09-14T20:56:22.683973] [INFO ] [MAIN ] MCB: Loaded 8245 primary data records. [2025-09-14T20:56:22.684262] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:22.784832] [DEBUG] [LOCAL ] MCI: Loaded 4648 existing records from primary storage. [2025-09-14T20:56:22.829485] [INFO ] [MAIN ] MCI: Loaded 4648 primary data records. [2025-09-14T20:56:23.097852] [DEBUG] [LOCAL ] MCD: Loaded 40241 existing records from primary storage. [2025-09-14T20:56:23.123508] [INFO ] [MAIN ] MCD: Loaded 40241 primary data records. [2025-09-14T20:56:23.611785] [DEBUG] [MAIN ] MCB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:23.613945] [INFO ] [MAIN ] MCB: Generated 1352 derivative records from 8245 primary records. [2025-09-14T20:56:23.614465] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-14T20:56:23.635665] [DEBUG] [LOCAL ] MCB: Derivative data saved (1352 records). [2025-09-14T20:56:23.636681] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-14T20:56:23.638970] [INFO ] [MAIN ] Derivative Progress: 1243/2226 symbols completed. MCB took 1.0s. Estimated remaining: 5m 47s. Rate: 170.1 symbols/min [2025-09-14T20:56:23.657371] [DEBUG] [MAIN ] MCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:23.660123] [INFO ] [MAIN ] MCI: Generated 1352 derivative records from 4648 primary records. [2025-09-14T20:56:23.660738] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-14T20:56:23.681745] [DEBUG] [MAIN ] MCD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:23.684535] [DEBUG] [LOCAL ] MCI: Derivative data saved (1352 records). [2025-09-14T20:56:23.684798] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-14T20:56:23.685738] [INFO ] [MAIN ] MCD: Generated 1352 derivative records from 40241 primary records. [2025-09-14T20:56:23.688101] [INFO ] [MAIN ] Derivative Progress: 1244/2226 symbols completed. MCI took 1.0s. Estimated remaining: 5m 46s. Rate: 170.2 symbols/min [2025-09-14T20:56:23.685961] [DEBUG] [LOCAL ] MCD: Saving derivative data. [2025-09-14T20:56:23.700862] [DEBUG] [LOCAL ] MCD: Derivative data saved (1352 records). [2025-09-14T20:56:23.700964] [INFO ] [MAIN ] MCD: Successfully saved derivative data. [2025-09-14T20:56:23.703454] [INFO ] [MAIN ] Derivative Progress: 1245/2226 symbols completed. MCD took 1.0s. Estimated remaining: 5m 45s. Rate: 170.4 symbols/min [2025-09-14T20:56:23.704337] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:23.704246] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:23.704426] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:23.716450] [DEBUG] [LOCAL ] MCN: Loaded 6090 existing records from primary storage. [2025-09-14T20:56:23.716726] [INFO ] [MAIN ] MCN: Loaded 6090 primary data records. [2025-09-14T20:56:24.025901] [DEBUG] [LOCAL ] MCO: Loaded 28401 existing records from primary storage. [2025-09-14T20:56:24.026759] [INFO ] [MAIN ] MCO: Loaded 28401 primary data records. [2025-09-14T20:56:24.026482] [DEBUG] [LOCAL ] MCK: Loaded 28906 existing records from primary storage. [2025-09-14T20:56:24.027214] [INFO ] [MAIN ] MCK: Loaded 28906 primary data records. [2025-09-14T20:56:24.617472] [DEBUG] [MAIN ] MCN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:24.620257] [INFO ] [MAIN ] MCN: Generated 1352 derivative records from 6090 primary records. [2025-09-14T20:56:24.620577] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-14T20:56:24.635006] [DEBUG] [LOCAL ] MCN: Derivative data saved (1352 records). [2025-09-14T20:56:24.636099] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-14T20:56:24.638070] [INFO ] [MAIN ] Derivative Progress: 1246/2226 symbols completed. MCN took 0.9s. Estimated remaining: 5m 46s. Rate: 170.2 symbols/min [2025-09-14T20:56:24.640894] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:24.654552] [DEBUG] [LOCAL ] MCR: Loaded 6717 existing records from primary storage. [2025-09-14T20:56:24.662516] [INFO ] [MAIN ] MCR: Loaded 6717 primary data records. [2025-09-14T20:56:24.686630] [DEBUG] [MAIN ] MCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:24.749609] [INFO ] [MAIN ] MCO: Generated 1352 derivative records from 28401 primary records. [2025-09-14T20:56:24.779773] [DEBUG] [MAIN ] MCK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:24.787832] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-14T20:56:24.792821] [INFO ] [MAIN ] MCK: Generated 1352 derivative records from 28906 primary records. [2025-09-14T20:56:24.858723] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-14T20:56:24.902979] [DEBUG] [LOCAL ] MCO: Derivative data saved (1352 records). [2025-09-14T20:56:25.060094] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-14T20:56:25.063487] [DEBUG] [LOCAL ] MCK: Derivative data saved (1352 records). [2025-09-14T20:56:25.066291] [INFO ] [MAIN ] Derivative Progress: 1247/2226 symbols completed. MCO took 1.4s. Estimated remaining: 5m 45s. Rate: 170.1 symbols/min [2025-09-14T20:56:25.066704] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-14T20:56:25.066969] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:25.068869] [INFO ] [MAIN ] Derivative Progress: 1248/2226 symbols completed. MCK took 1.4s. Estimated remaining: 5m 45s. Rate: 170.3 symbols/min [2025-09-14T20:56:25.069956] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:25.102072] [DEBUG] [LOCAL ] MCY: Loaded 17957 existing records from primary storage. [2025-09-14T20:56:25.102817] [DEBUG] [LOCAL ] MCS: Loaded 15625 existing records from primary storage. [2025-09-14T20:56:25.113216] [INFO ] [MAIN ] MCY: Loaded 17957 primary data records. [2025-09-14T20:56:25.113145] [INFO ] [MAIN ] MCS: Loaded 15625 primary data records. [2025-09-14T20:56:25.113788] [DEBUG] [MAIN ] MCR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:25.114706] [INFO ] [MAIN ] MCR: Generated 1352 derivative records from 6717 primary records. [2025-09-14T20:56:25.126600] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-14T20:56:25.359432] [DEBUG] [LOCAL ] MCR: Derivative data saved (1352 records). [2025-09-14T20:56:25.405671] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-14T20:56:25.468846] [INFO ] [MAIN ] Derivative Progress: 1249/2226 symbols completed. MCR took 0.8s. Estimated remaining: 5m 44s. Rate: 170.2 symbols/min [2025-09-14T20:56:25.572343] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:25.741558] [DEBUG] [LOCAL ] MD: Loaded 29282 existing records from primary storage. [2025-09-14T20:56:25.748155] [DEBUG] [MAIN ] MCS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:25.752855] [DEBUG] [MAIN ] MCY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:25.753007] [INFO ] [MAIN ] MD: Loaded 29282 primary data records. [2025-09-14T20:56:25.753953] [INFO ] [MAIN ] MCS: Generated 1352 derivative records from 15625 primary records. [2025-09-14T20:56:25.755961] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-14T20:56:25.755636] [INFO ] [MAIN ] MCY: Generated 1352 derivative records from 17957 primary records. [2025-09-14T20:56:25.821892] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-14T20:56:25.889964] [DEBUG] [LOCAL ] MCS: Derivative data saved (1352 records). [2025-09-14T20:56:25.893899] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-14T20:56:25.907063] [INFO ] [MAIN ] Derivative Progress: 1250/2226 symbols completed. MCS took 0.8s. Estimated remaining: 5m 44s. Rate: 170.2 symbols/min [2025-09-14T20:56:25.915858] [DEBUG] [LOCAL ] MCY: Derivative data saved (1352 records). [2025-09-14T20:56:25.949848] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-14T20:56:25.912840] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:25.976771] [INFO ] [MAIN ] Derivative Progress: 1251/2226 symbols completed. MCY took 0.9s. Estimated remaining: 5m 43s. Rate: 170.3 symbols/min [2025-09-14T20:56:25.982635] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:26.078698] [DEBUG] [LOCAL ] MDST: Loaded 4014 existing records from primary storage. [2025-09-14T20:56:26.078936] [INFO ] [MAIN ] MDST: Loaded 4014 primary data records. [2025-09-14T20:56:26.388826] [DEBUG] [LOCAL ] MDT: Loaded 40418 existing records from primary storage. [2025-09-14T20:56:26.389779] [INFO ] [MAIN ] MDT: Loaded 40418 primary data records. [2025-09-14T20:56:26.511571] [DEBUG] [MAIN ] MD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:26.533792] [INFO ] [MAIN ] MD: Generated 1352 derivative records from 29282 primary records. [2025-09-14T20:56:26.554235] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-14T20:56:26.700587] [DEBUG] [LOCAL ] MD: Derivative data saved (1352 records). [2025-09-14T20:56:26.701891] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-14T20:56:26.705573] [INFO ] [MAIN ] Derivative Progress: 1252/2226 symbols completed. MD took 1.2s. Estimated remaining: 5m 43s. Rate: 170.2 symbols/min [2025-09-14T20:56:26.716854] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:26.717553] [DEBUG] [MAIN ] MDST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:26.719494] [INFO ] [MAIN ] MDST: Generated 1352 derivative records from 4014 primary records. [2025-09-14T20:56:26.720285] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-14T20:56:26.734934] [DEBUG] [LOCAL ] MDST: Derivative data saved (1352 records). [2025-09-14T20:56:26.735399] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-14T20:56:26.738349] [INFO ] [MAIN ] Derivative Progress: 1253/2226 symbols completed. MDST took 0.8s. Estimated remaining: 5m 43s. Rate: 170.3 symbols/min [2025-09-14T20:56:26.739160] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:26.768784] [DEBUG] [MAIN ] MDT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:26.773190] [DEBUG] [LOCAL ] MDV: Loaded 6596 existing records from primary storage. [2025-09-14T20:56:26.774441] [INFO ] [MAIN ] MDT: Generated 1352 derivative records from 40418 primary records. [2025-09-14T20:56:26.774724] [INFO ] [MAIN ] MDV: Loaded 6596 primary data records. [2025-09-14T20:56:26.774894] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-14T20:56:26.896583] [DEBUG] [LOCAL ] MDU: Loaded 35398 existing records from primary storage. [2025-09-14T20:56:26.909429] [INFO ] [MAIN ] MDU: Loaded 35398 primary data records. [2025-09-14T20:56:26.965496] [DEBUG] [LOCAL ] MDT: Derivative data saved (1352 records). [2025-09-14T20:56:26.997312] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-14T20:56:27.005685] [INFO ] [MAIN ] Derivative Progress: 1254/2226 symbols completed. MDT took 1.0s. Estimated remaining: 5m 42s. Rate: 170.3 symbols/min [2025-09-14T20:56:27.083438] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:27.470855] [DEBUG] [LOCAL ] MEC: Loaded 12468 existing records from primary storage. [2025-09-14T20:56:27.471279] [INFO ] [MAIN ] MEC: Loaded 12468 primary data records. [2025-09-14T20:56:27.737771] [DEBUG] [MAIN ] MDV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:27.828041] [INFO ] [MAIN ] MDV: Generated 1352 derivative records from 6596 primary records. [2025-09-14T20:56:27.834848] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-14T20:56:27.853826] [DEBUG] [LOCAL ] MDV: Derivative data saved (1352 records). [2025-09-14T20:56:27.865348] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-14T20:56:27.868296] [INFO ] [MAIN ] Derivative Progress: 1255/2226 symbols completed. MDV took 1.1s. Estimated remaining: 5m 42s. Rate: 170.1 symbols/min [2025-09-14T20:56:27.866122] [DEBUG] [MAIN ] MDU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:27.869551] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:27.870472] [INFO ] [MAIN ] MDU: Generated 1352 derivative records from 35398 primary records. [2025-09-14T20:56:27.871359] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-14T20:56:27.893698] [DEBUG] [LOCAL ] MDU: Derivative data saved (1352 records). [2025-09-14T20:56:27.894058] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-14T20:56:27.912977] [INFO ] [MAIN ] Derivative Progress: 1256/2226 symbols completed. MDU took 1.2s. Estimated remaining: 5m 42s. Rate: 170.2 symbols/min [2025-09-14T20:56:27.909803] [DEBUG] [MAIN ] MEC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:27.913995] [INFO ] [MAIN ] MEC: Generated 1352 derivative records from 12468 primary records. [2025-09-14T20:56:27.914969] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-14T20:56:27.914210] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:27.914903] [DEBUG] [LOCAL ] MED: Loaded 16010 existing records from primary storage. [2025-09-14T20:56:27.922008] [INFO ] [MAIN ] MED: Loaded 16010 primary data records. [2025-09-14T20:56:27.969029] [DEBUG] [LOCAL ] MEC: Derivative data saved (1352 records). [2025-09-14T20:56:28.044103] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-14T20:56:28.074715] [INFO ] [MAIN ] Derivative Progress: 1257/2226 symbols completed. MEC took 1.0s. Estimated remaining: 5m 41s. Rate: 170.3 symbols/min [2025-09-14T20:56:28.109089] [DEBUG] [LOCAL ] MEGI: Loaded 14929 existing records from primary storage. [2025-09-14T20:56:28.134095] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:28.134240] [INFO ] [MAIN ] MEGI: Loaded 14929 primary data records. [2025-09-14T20:56:28.406966] [DEBUG] [LOCAL ] MEI: Loaded 23507 existing records from primary storage. [2025-09-14T20:56:28.435524] [INFO ] [MAIN ] MEI: Loaded 23507 primary data records. [2025-09-14T20:56:28.773047] [DEBUG] [MAIN ] MED: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:28.836013] [INFO ] [MAIN ] MED: Generated 1352 derivative records from 16010 primary records. [2025-09-14T20:56:28.836238] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-14T20:56:28.856748] [DEBUG] [LOCAL ] MED: Derivative data saved (1352 records). [2025-09-14T20:56:28.872921] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-14T20:56:28.873705] [DEBUG] [MAIN ] MEGI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:28.875807] [INFO ] [MAIN ] Derivative Progress: 1258/2226 symbols completed. MED took 1.0s. Estimated remaining: 5m 41s. Rate: 170.1 symbols/min [2025-09-14T20:56:28.877078] [INFO ] [MAIN ] MEGI: Generated 1352 derivative records from 14929 primary records. [2025-09-14T20:56:28.878168] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-14T20:56:28.891677] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1352 records). [2025-09-14T20:56:28.891908] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-14T20:56:28.894304] [INFO ] [MAIN ] Derivative Progress: 1259/2226 symbols completed. MEGI took 1.0s. Estimated remaining: 5m 41s. Rate: 170.3 symbols/min [2025-09-14T20:56:28.910552] [DEBUG] [MAIN ] MEI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:28.911387] [INFO ] [MAIN ] MEI: Generated 1352 derivative records from 23507 primary records. [2025-09-14T20:56:28.911470] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-14T20:56:28.923568] [DEBUG] [LOCAL ] MEI: Derivative data saved (1352 records). [2025-09-14T20:56:28.923673] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-14T20:56:28.925854] [INFO ] [MAIN ] Derivative Progress: 1260/2226 symbols completed. MEI took 0.8s. Estimated remaining: 5m 40s. Rate: 170.4 symbols/min [2025-09-14T20:56:28.927025] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:28.927155] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:28.927447] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:28.933800] [DEBUG] [LOCAL ] MFAN: Loaded 3076 existing records from primary storage. [2025-09-14T20:56:28.933935] [INFO ] [MAIN ] MFAN: Loaded 3076 primary data records. [2025-09-14T20:56:29.269141] [DEBUG] [LOCAL ] MFA: Loaded 33621 existing records from primary storage. [2025-09-14T20:56:29.270113] [INFO ] [MAIN ] MFA: Loaded 33621 primary data records. [2025-09-14T20:56:29.282468] [DEBUG] [LOCAL ] MET: Loaded 40097 existing records from primary storage. [2025-09-14T20:56:29.292868] [INFO ] [MAIN ] MET: Loaded 40097 primary data records. [2025-09-14T20:56:29.917572] [DEBUG] [MAIN ] MFAN: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:56:29.920568] [INFO ] [MAIN ] MFAN: Generated 1351 derivative records from 3076 primary records. [2025-09-14T20:56:29.922169] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-14T20:56:29.936977] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1351 records). [2025-09-14T20:56:29.937671] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-14T20:56:29.940268] [INFO ] [MAIN ] Derivative Progress: 1261/2226 symbols completed. MFAN took 1.0s. Estimated remaining: 5m 40s. Rate: 170.1 symbols/min [2025-09-14T20:56:29.941188] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:29.957367] [DEBUG] [MAIN ] MFA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:29.958568] [INFO ] [MAIN ] MFA: Generated 1352 derivative records from 33621 primary records. [2025-09-14T20:56:29.959768] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-14T20:56:29.964454] [DEBUG] [LOCAL ] MFAO: Loaded 2960 existing records from primary storage. [2025-09-14T20:56:29.973121] [INFO ] [MAIN ] MFAO: Loaded 2960 primary data records. [2025-09-14T20:56:29.997044] [DEBUG] [LOCAL ] MFA: Derivative data saved (1352 records). [2025-09-14T20:56:30.023318] [DEBUG] [MAIN ] MET: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:30.057916] [INFO ] [MAIN ] MET: Generated 1352 derivative records from 40097 primary records. [2025-09-14T20:56:30.028733] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-14T20:56:30.075138] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-14T20:56:30.089235] [INFO ] [MAIN ] Derivative Progress: 1262/2226 symbols completed. MFA took 1.2s. Estimated remaining: 5m 40s. Rate: 170.2 symbols/min [2025-09-14T20:56:30.102791] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:30.197786] [DEBUG] [LOCAL ] MET: Derivative data saved (1352 records). [2025-09-14T20:56:30.287319] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-14T20:56:30.289848] [INFO ] [MAIN ] Derivative Progress: 1263/2226 symbols completed. MET took 1.4s. Estimated remaining: 5m 39s. Rate: 170.3 symbols/min [2025-09-14T20:56:30.290151] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:30.323229] [DEBUG] [MAIN ] MFAO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:30.335059] [INFO ] [MAIN ] MFAO: Generated 1352 derivative records from 2960 primary records. [2025-09-14T20:56:30.344306] [DEBUG] [LOCAL ] MFC: Loaded 38397 existing records from primary storage. [2025-09-14T20:56:30.344527] [INFO ] [MAIN ] MFC: Loaded 38397 primary data records. [2025-09-14T20:56:30.344442] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-14T20:56:30.486062] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1352 records). [2025-09-14T20:56:30.502190] [DEBUG] [LOCAL ] MFG: Loaded 37293 existing records from primary storage. [2025-09-14T20:56:30.517353] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-14T20:56:30.557687] [INFO ] [MAIN ] Derivative Progress: 1264/2226 symbols completed. MFAO took 0.6s. Estimated remaining: 5m 39s. Rate: 170.3 symbols/min [2025-09-14T20:56:30.552898] [INFO ] [MAIN ] MFG: Loaded 37293 primary data records. [2025-09-14T20:56:30.558006] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:30.822120] [DEBUG] [LOCAL ] MFM: Loaded 10158 existing records from primary storage. [2025-09-14T20:56:30.861175] [INFO ] [MAIN ] MFM: Loaded 10158 primary data records. [2025-09-14T20:56:31.262578] [DEBUG] [MAIN ] MFC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:31.263690] [INFO ] [MAIN ] MFC: Generated 1352 derivative records from 38397 primary records. [2025-09-14T20:56:31.264007] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-14T20:56:31.283137] [DEBUG] [LOCAL ] MFC: Derivative data saved (1352 records). [2025-09-14T20:56:31.283412] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-14T20:56:31.296926] [INFO ] [MAIN ] Derivative Progress: 1265/2226 symbols completed. MFC took 1.2s. Estimated remaining: 5m 39s. Rate: 170.2 symbols/min [2025-09-14T20:56:31.297613] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:31.298071] [DEBUG] [MAIN ] MFG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:31.300126] [INFO ] [MAIN ] MFG: Generated 1352 derivative records from 37293 primary records. [2025-09-14T20:56:31.300791] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-14T20:56:31.319410] [DEBUG] [LOCAL ] MFSG: Loaded 3948 existing records from primary storage. [2025-09-14T20:56:31.316266] [DEBUG] [LOCAL ] MFG: Derivative data saved (1352 records). [2025-09-14T20:56:31.320890] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-14T20:56:31.320806] [INFO ] [MAIN ] MFSG: Loaded 3948 primary data records. [2025-09-14T20:56:31.329848] [INFO ] [MAIN ] Derivative Progress: 1266/2226 symbols completed. MFG took 1.0s. Estimated remaining: 5m 38s. Rate: 170.3 symbols/min [2025-09-14T20:56:31.372567] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:31.386079] [DEBUG] [MAIN ] MFM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:31.408897] [INFO ] [MAIN ] MFM: Generated 1352 derivative records from 10158 primary records. [2025-09-14T20:56:31.439864] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-14T20:56:31.543001] [DEBUG] [LOCAL ] MFM: Derivative data saved (1352 records). [2025-09-14T20:56:31.547380] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-14T20:56:31.545504] [DEBUG] [LOCAL ] MFSI: Loaded 8941 existing records from primary storage. [2025-09-14T20:56:31.549535] [INFO ] [MAIN ] Derivative Progress: 1267/2226 symbols completed. MFM took 1.0s. Estimated remaining: 5m 38s. Rate: 170.3 symbols/min [2025-09-14T20:56:31.592895] [INFO ] [MAIN ] MFSI: Loaded 8941 primary data records. [2025-09-14T20:56:31.629657] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:31.740575] [DEBUG] [LOCAL ] MFSV: Loaded 1655 existing records from primary storage. [2025-09-14T20:56:31.764676] [INFO ] [MAIN ] MFSV: Loaded 1655 primary data records. [2025-09-14T20:56:32.271558] [DEBUG] [MAIN ] MFSG: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:56:32.273151] [INFO ] [MAIN ] MFSG: Generated 1351 derivative records from 3948 primary records. [2025-09-14T20:56:32.273621] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-14T20:56:32.290297] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1351 records). [2025-09-14T20:56:32.291730] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-14T20:56:32.295390] [INFO ] [MAIN ] Derivative Progress: 1268/2226 symbols completed. MFSG took 1.0s. Estimated remaining: 5m 38s. Rate: 170.2 symbols/min [2025-09-14T20:56:32.296756] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:32.308616] [DEBUG] [MAIN ] MFSI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:32.309943] [INFO ] [MAIN ] MFSI: Generated 1352 derivative records from 8941 primary records. [2025-09-14T20:56:32.310143] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-14T20:56:32.329421] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1352 records). [2025-09-14T20:56:32.334617] [DEBUG] [LOCAL ] MG: Loaded 11650 existing records from primary storage. [2025-09-14T20:56:32.334209] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-14T20:56:32.345209] [DEBUG] [MAIN ] MFSV: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:56:32.344895] [INFO ] [MAIN ] MG: Loaded 11650 primary data records. [2025-09-14T20:56:32.348309] [INFO ] [MAIN ] MFSV: Generated 1351 derivative records from 1655 primary records. [2025-09-14T20:56:32.347456] [INFO ] [MAIN ] Derivative Progress: 1269/2226 symbols completed. MFSI took 1.0s. Estimated remaining: 5m 37s. Rate: 170.3 symbols/min [2025-09-14T20:56:32.369990] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-14T20:56:32.385906] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:32.473668] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1351 records). [2025-09-14T20:56:32.473960] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-14T20:56:32.476333] [INFO ] [MAIN ] Derivative Progress: 1270/2226 symbols completed. MFSV took 0.9s. Estimated remaining: 5m 37s. Rate: 170.4 symbols/min [2025-09-14T20:56:32.477118] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:32.665597] [DEBUG] [LOCAL ] MGF: Loaded 3212 existing records from primary storage. [2025-09-14T20:56:32.665909] [INFO ] [MAIN ] MGF: Loaded 3212 primary data records. [2025-09-14T20:56:32.789197] [DEBUG] [LOCAL ] MGA: Loaded 37796 existing records from primary storage. [2025-09-14T20:56:32.868165] [INFO ] [MAIN ] MGA: Loaded 37796 primary data records. [2025-09-14T20:56:33.245475] [DEBUG] [MAIN ] MG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:33.246807] [INFO ] [MAIN ] MG: Generated 1352 derivative records from 11650 primary records. [2025-09-14T20:56:33.247871] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-14T20:56:33.261528] [DEBUG] [LOCAL ] MG: Derivative data saved (1352 records). [2025-09-14T20:56:33.264086] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-14T20:56:33.266239] [INFO ] [MAIN ] Derivative Progress: 1271/2226 symbols completed. MG took 1.0s. Estimated remaining: 5m 37s. Rate: 170.2 symbols/min [2025-09-14T20:56:33.277680] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:33.278089] [DEBUG] [MAIN ] MGF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:33.279503] [INFO ] [MAIN ] MGF: Generated 1352 derivative records from 3212 primary records. [2025-09-14T20:56:33.280121] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-14T20:56:33.292318] [DEBUG] [LOCAL ] MGF: Derivative data saved (1352 records). [2025-09-14T20:56:33.293274] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-14T20:56:33.295138] [INFO ] [MAIN ] Derivative Progress: 1272/2226 symbols completed. MGF took 0.8s. Estimated remaining: 5m 36s. Rate: 170.3 symbols/min [2025-09-14T20:56:33.295482] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:33.309805] [DEBUG] [MAIN ] MGA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:33.313115] [INFO ] [MAIN ] MGA: Generated 1352 derivative records from 37796 primary records. [2025-09-14T20:56:33.316048] [DEBUG] [LOCAL ] MGR: Loaded 4180 existing records from primary storage. [2025-09-14T20:56:33.313289] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-14T20:56:33.316188] [INFO ] [MAIN ] MGR: Loaded 4180 primary data records. [2025-09-14T20:56:33.422413] [DEBUG] [LOCAL ] MGA: Derivative data saved (1352 records). [2025-09-14T20:56:33.442188] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-14T20:56:33.459729] [INFO ] [MAIN ] Derivative Progress: 1273/2226 symbols completed. MGA took 1.1s. Estimated remaining: 5m 36s. Rate: 170.4 symbols/min [2025-09-14T20:56:33.501875] [DEBUG] [LOCAL ] MGM: Loaded 40354 existing records from primary storage. [2025-09-14T20:56:33.538366] [INFO ] [MAIN ] MGM: Loaded 40354 primary data records. [2025-09-14T20:56:33.918619] [DEBUG] [MAIN ] MGR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:33.919529] [INFO ] [MAIN ] MGR: Generated 1352 derivative records from 4180 primary records. [2025-09-14T20:56:33.919964] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-14T20:56:33.933400] [DEBUG] [LOCAL ] MGR: Derivative data saved (1352 records). [2025-09-14T20:56:33.933501] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-14T20:56:33.935534] [INFO ] [MAIN ] Derivative Progress: 1274/2226 symbols completed. MGR took 0.6s. Estimated remaining: 5m 35s. Rate: 170.4 symbols/min [2025-09-14T20:56:33.947663] [DEBUG] [MAIN ] MGM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:33.948263] [INFO ] [MAIN ] MGM: Generated 1352 derivative records from 40354 primary records. [2025-09-14T20:56:33.948346] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-14T20:56:33.960399] [DEBUG] [LOCAL ] MGM: Derivative data saved (1352 records). [2025-09-14T20:56:33.960491] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-14T20:56:33.962344] [INFO ] [MAIN ] Derivative Progress: 1275/2226 symbols completed. MGM took 0.7s. Estimated remaining: 5m 35s. Rate: 170.5 symbols/min [2025-09-14T20:56:33.962859] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:33.962972] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:33.963088] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:33.967987] [DEBUG] [LOCAL ] MGRD: Loaded 1695 existing records from primary storage. [2025-09-14T20:56:33.970225] [INFO ] [MAIN ] MGRD: Loaded 1695 primary data records. [2025-09-14T20:56:34.019139] [DEBUG] [LOCAL ] MGRB: Loaded 3220 existing records from primary storage. [2025-09-14T20:56:34.024329] [DEBUG] [LOCAL ] MGRE: Loaded 4935 existing records from primary storage. [2025-09-14T20:56:34.079504] [INFO ] [MAIN ] MGRE: Loaded 4935 primary data records. [2025-09-14T20:56:34.058275] [INFO ] [MAIN ] MGRB: Loaded 3220 primary data records. [2025-09-14T20:56:34.870164] [DEBUG] [MAIN ] MGRD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:34.871848] [INFO ] [MAIN ] MGRD: Generated 1352 derivative records from 1695 primary records. [2025-09-14T20:56:34.875245] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-14T20:56:34.895715] [DEBUG] [MAIN ] MGRB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:34.897031] [INFO ] [MAIN ] MGRB: Generated 1352 derivative records from 3220 primary records. [2025-09-14T20:56:34.904803] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-14T20:56:34.904703] [DEBUG] [MAIN ] MGRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:34.907259] [INFO ] [MAIN ] MGRE: Generated 1352 derivative records from 4935 primary records. [2025-09-14T20:56:34.908092] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-14T20:56:34.924883] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1352 records). [2025-09-14T20:56:34.934136] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-14T20:56:34.935391] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1352 records). [2025-09-14T20:56:34.933946] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1352 records). [2025-09-14T20:56:34.935558] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-14T20:56:34.937811] [INFO ] [MAIN ] Derivative Progress: 1276/2226 symbols completed. MGRD took 1.0s. Estimated remaining: 5m 35s. Rate: 170.3 symbols/min [2025-09-14T20:56:34.935662] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-14T20:56:34.940436] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:34.940604] [INFO ] [MAIN ] Derivative Progress: 1277/2226 symbols completed. MGRB took 1.0s. Estimated remaining: 5m 34s. Rate: 170.4 symbols/min [2025-09-14T20:56:34.943695] [INFO ] [MAIN ] Derivative Progress: 1278/2226 symbols completed. MGRE took 1.0s. Estimated remaining: 5m 34s. Rate: 170.5 symbols/min [2025-09-14T20:56:34.943927] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:34.944421] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:34.959921] [DEBUG] [LOCAL ] MHF: Loaded 6860 existing records from primary storage. [2025-09-14T20:56:34.964058] [INFO ] [MAIN ] MHF: Loaded 6860 primary data records. [2025-09-14T20:56:34.964281] [DEBUG] [LOCAL ] MHD: Loaded 8816 existing records from primary storage. [2025-09-14T20:56:34.976827] [INFO ] [MAIN ] MHD: Loaded 8816 primary data records. [2025-09-14T20:56:35.306810] [DEBUG] [LOCAL ] MGY: Loaded 39371 existing records from primary storage. [2025-09-14T20:56:35.376993] [INFO ] [MAIN ] MGY: Loaded 39371 primary data records. [2025-09-14T20:56:35.900975] [DEBUG] [MAIN ] MHF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:35.905432] [DEBUG] [MAIN ] MHD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:35.906388] [INFO ] [MAIN ] MHF: Generated 1352 derivative records from 6860 primary records. [2025-09-14T20:56:35.907034] [INFO ] [MAIN ] MHD: Generated 1352 derivative records from 8816 primary records. [2025-09-14T20:56:35.907119] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-14T20:56:35.907783] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-14T20:56:35.931489] [DEBUG] [LOCAL ] MHD: Derivative data saved (1352 records). [2025-09-14T20:56:35.931726] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-14T20:56:35.934048] [INFO ] [MAIN ] Derivative Progress: 1279/2226 symbols completed. MHD took 1.0s. Estimated remaining: 5m 34s. Rate: 170.3 symbols/min [2025-09-14T20:56:35.936824] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:35.939518] [DEBUG] [LOCAL ] MHF: Derivative data saved (1352 records). [2025-09-14T20:56:35.940138] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-14T20:56:35.942488] [INFO ] [MAIN ] Derivative Progress: 1280/2226 symbols completed. MHF took 1.0s. Estimated remaining: 5m 33s. Rate: 170.4 symbols/min [2025-09-14T20:56:35.953732] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:35.953577] [DEBUG] [MAIN ] MGY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:35.954694] [INFO ] [MAIN ] MGY: Generated 1352 derivative records from 39371 primary records. [2025-09-14T20:56:35.954868] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-14T20:56:35.975932] [DEBUG] [LOCAL ] MHN: Loaded 5568 existing records from primary storage. [2025-09-14T20:56:35.987816] [INFO ] [MAIN ] MHN: Loaded 5568 primary data records. [2025-09-14T20:56:35.987916] [DEBUG] [LOCAL ] MGY: Derivative data saved (1352 records). [2025-09-14T20:56:35.988150] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-14T20:56:36.036344] [INFO ] [MAIN ] Derivative Progress: 1281/2226 symbols completed. MGY took 1.1s. Estimated remaining: 5m 33s. Rate: 170.5 symbols/min [2025-09-14T20:56:36.092606] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:36.135760] [DEBUG] [LOCAL ] MHK: Loaded 31851 existing records from primary storage. [2025-09-14T20:56:36.160699] [INFO ] [MAIN ] MHK: Loaded 31851 primary data records. [2025-09-14T20:56:36.398893] [DEBUG] [LOCAL ] MHO: Loaded 17950 existing records from primary storage. [2025-09-14T20:56:36.465134] [INFO ] [MAIN ] MHO: Loaded 17950 primary data records. [2025-09-14T20:56:36.891045] [DEBUG] [MAIN ] MHN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:36.892833] [INFO ] [MAIN ] MHN: Generated 1352 derivative records from 5568 primary records. [2025-09-14T20:56:36.893843] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-14T20:56:36.909996] [DEBUG] [LOCAL ] MHN: Derivative data saved (1352 records). [2025-09-14T20:56:36.921041] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-14T20:56:36.922017] [DEBUG] [MAIN ] MHK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:36.924860] [INFO ] [MAIN ] Derivative Progress: 1282/2226 symbols completed. MHN took 1.0s. Estimated remaining: 5m 33s. Rate: 170.3 symbols/min [2025-09-14T20:56:36.926445] [INFO ] [MAIN ] MHK: Generated 1352 derivative records from 31851 primary records. [2025-09-14T20:56:36.927075] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:36.927293] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-14T20:56:36.961090] [DEBUG] [LOCAL ] MHK: Derivative data saved (1352 records). [2025-09-14T20:56:36.960176] [DEBUG] [MAIN ] MHO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:36.966202] [INFO ] [MAIN ] MHO: Generated 1352 derivative records from 17950 primary records. [2025-09-14T20:56:36.966253] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-14T20:56:36.968937] [INFO ] [MAIN ] Derivative Progress: 1283/2226 symbols completed. MHK took 1.0s. Estimated remaining: 5m 32s. Rate: 170.4 symbols/min [2025-09-14T20:56:36.969021] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-14T20:56:36.969343] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:36.966504] [DEBUG] [LOCAL ] MIN: Loaded 10736 existing records from primary storage. [2025-09-14T20:56:36.970979] [INFO ] [MAIN ] MIN: Loaded 10736 primary data records. [2025-09-14T20:56:37.089520] [DEBUG] [LOCAL ] MHO: Derivative data saved (1352 records). [2025-09-14T20:56:37.108707] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-14T20:56:37.177548] [INFO ] [MAIN ] Derivative Progress: 1284/2226 symbols completed. MHO took 1.1s. Estimated remaining: 5m 32s. Rate: 170.5 symbols/min [2025-09-14T20:56:37.256619] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:37.286515] [DEBUG] [LOCAL ] MIR: Loaded 38381 existing records from primary storage. [2025-09-14T20:56:37.287500] [INFO ] [MAIN ] MIR: Loaded 38381 primary data records. [2025-09-14T20:56:37.305698] [DEBUG] [LOCAL ] MITP: Loaded 1677 existing records from primary storage. [2025-09-14T20:56:37.332361] [INFO ] [MAIN ] MITP: Loaded 1677 primary data records. [2025-09-14T20:56:37.868507] [DEBUG] [MAIN ] MIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:37.871355] [INFO ] [MAIN ] MIN: Generated 1352 derivative records from 10736 primary records. [2025-09-14T20:56:37.873788] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-14T20:56:37.895156] [DEBUG] [LOCAL ] MIN: Derivative data saved (1352 records). [2025-09-14T20:56:37.895366] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-14T20:56:37.898343] [INFO ] [MAIN ] Derivative Progress: 1285/2226 symbols completed. MIN took 1.0s. Estimated remaining: 5m 31s. Rate: 170.3 symbols/min [2025-09-14T20:56:37.899361] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:37.915184] [DEBUG] [MAIN ] MIR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:37.918473] [INFO ] [MAIN ] MIR: Generated 1352 derivative records from 38381 primary records. [2025-09-14T20:56:37.919378] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-14T20:56:37.947336] [DEBUG] [MAIN ] MITP: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:56:37.957562] [INFO ] [MAIN ] MITP: Generated 1351 derivative records from 1677 primary records. [2025-09-14T20:56:37.954910] [DEBUG] [LOCAL ] MIR: Derivative data saved (1352 records). [2025-09-14T20:56:37.956612] [DEBUG] [LOCAL ] MITT: Loaded 16045 existing records from primary storage. [2025-09-14T20:56:37.957877] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-14T20:56:37.957988] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-14T20:56:37.958819] [INFO ] [MAIN ] MITT: Loaded 16045 primary data records. [2025-09-14T20:56:37.966956] [INFO ] [MAIN ] Derivative Progress: 1286/2226 symbols completed. MIR took 1.0s. Estimated remaining: 5m 31s. Rate: 170.4 symbols/min [2025-09-14T20:56:37.983204] [DEBUG] [LOCAL ] MITP: Derivative data saved (1351 records). [2025-09-14T20:56:38.008536] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-14T20:56:38.014064] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:38.051710] [INFO ] [MAIN ] Derivative Progress: 1287/2226 symbols completed. MITP took 0.8s. Estimated remaining: 5m 30s. Rate: 170.5 symbols/min [2025-09-14T20:56:38.078766] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:38.086219] [DEBUG] [LOCAL ] MIY: Loaded 4348 existing records from primary storage. [2025-09-14T20:56:38.098358] [INFO ] [MAIN ] MIY: Loaded 4348 primary data records. [2025-09-14T20:56:38.552072] [DEBUG] [LOCAL ] MKC: Loaded 39477 existing records from primary storage. [2025-09-14T20:56:38.552563] [INFO ] [MAIN ] MKC: Loaded 39477 primary data records. [2025-09-14T20:56:38.899616] [DEBUG] [MAIN ] MITT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:38.907991] [INFO ] [MAIN ] MITT: Generated 1352 derivative records from 16045 primary records. [2025-09-14T20:56:38.910923] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-14T20:56:38.936377] [DEBUG] [MAIN ] MIY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:38.939456] [INFO ] [MAIN ] MIY: Generated 1352 derivative records from 4348 primary records. [2025-09-14T20:56:38.941185] [DEBUG] [LOCAL ] MITT: Derivative data saved (1352 records). [2025-09-14T20:56:38.941290] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-14T20:56:38.942554] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-14T20:56:38.945900] [INFO ] [MAIN ] Derivative Progress: 1288/2226 symbols completed. MITT took 1.0s. Estimated remaining: 5m 30s. Rate: 170.3 symbols/min [2025-09-14T20:56:38.960245] [DEBUG] [LOCAL ] MIY: Derivative data saved (1352 records). [2025-09-14T20:56:38.960523] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-14T20:56:38.963235] [INFO ] [MAIN ] Derivative Progress: 1289/2226 symbols completed. MIY took 1.0s. Estimated remaining: 5m 30s. Rate: 170.5 symbols/min [2025-09-14T20:56:38.975539] [DEBUG] [MAIN ] MKC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:38.976254] [INFO ] [MAIN ] MKC: Generated 1352 derivative records from 39477 primary records. [2025-09-14T20:56:38.976344] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-14T20:56:38.988635] [DEBUG] [LOCAL ] MKC: Derivative data saved (1352 records). [2025-09-14T20:56:38.988733] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-14T20:56:38.991440] [INFO ] [MAIN ] Derivative Progress: 1290/2226 symbols completed. MKC took 0.9s. Estimated remaining: 5m 29s. Rate: 170.6 symbols/min [2025-09-14T20:56:38.991936] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:38.992127] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:38.992194] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:39.053322] [DEBUG] [LOCAL ] MKL: Loaded 25665 existing records from primary storage. [2025-09-14T20:56:39.054225] [DEBUG] [LOCAL ] MLM: Loaded 21830 existing records from primary storage. [2025-09-14T20:56:39.054480] [INFO ] [MAIN ] MLM: Loaded 21830 primary data records. [2025-09-14T20:56:39.054407] [INFO ] [MAIN ] MKL: Loaded 25665 primary data records. [2025-09-14T20:56:39.138526] [DEBUG] [LOCAL ] MLI: Loaded 32624 existing records from primary storage. [2025-09-14T20:56:39.201054] [INFO ] [MAIN ] MLI: Loaded 32624 primary data records. [2025-09-14T20:56:40.000101] [DEBUG] [MAIN ] MKL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:40.013126] [INFO ] [MAIN ] MKL: Generated 1352 derivative records from 25665 primary records. [2025-09-14T20:56:40.013829] [DEBUG] [MAIN ] MLI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:40.015902] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-14T20:56:40.016847] [INFO ] [MAIN ] MLI: Generated 1352 derivative records from 32624 primary records. [2025-09-14T20:56:40.017222] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-14T20:56:40.035533] [DEBUG] [MAIN ] MLM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:40.045830] [INFO ] [MAIN ] MLM: Generated 1352 derivative records from 21830 primary records. [2025-09-14T20:56:40.052300] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-14T20:56:40.053114] [DEBUG] [LOCAL ] MLI: Derivative data saved (1352 records). [2025-09-14T20:56:40.054998] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-14T20:56:40.056917] [DEBUG] [LOCAL ] MKL: Derivative data saved (1352 records). [2025-09-14T20:56:40.060323] [INFO ] [MAIN ] Derivative Progress: 1291/2226 symbols completed. MLI took 1.1s. Estimated remaining: 5m 29s. Rate: 170.3 symbols/min [2025-09-14T20:56:40.061014] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-14T20:56:40.061252] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:40.073311] [INFO ] [MAIN ] Derivative Progress: 1292/2226 symbols completed. MKL took 1.1s. Estimated remaining: 5m 29s. Rate: 170.4 symbols/min [2025-09-14T20:56:40.074401] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:40.077746] [DEBUG] [LOCAL ] MLM: Derivative data saved (1352 records). [2025-09-14T20:56:40.078158] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-14T20:56:40.080502] [INFO ] [MAIN ] Derivative Progress: 1293/2226 symbols completed. MLM took 1.1s. Estimated remaining: 5m 28s. Rate: 170.6 symbols/min [2025-09-14T20:56:40.081610] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:40.086016] [DEBUG] [LOCAL ] MLP: Loaded 2297 existing records from primary storage. [2025-09-14T20:56:40.086394] [INFO ] [MAIN ] MLP: Loaded 2297 primary data records. [2025-09-14T20:56:40.201485] [DEBUG] [LOCAL ] MLR: Loaded 8560 existing records from primary storage. [2025-09-14T20:56:40.211553] [INFO ] [MAIN ] MLR: Loaded 8560 primary data records. [2025-09-14T20:56:40.239532] [DEBUG] [LOCAL ] MLNK: Loaded 19044 existing records from primary storage. [2025-09-14T20:56:40.316419] [INFO ] [MAIN ] MLNK: Loaded 19044 primary data records. [2025-09-14T20:56:41.042847] [DEBUG] [MAIN ] MLP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:41.044121] [INFO ] [MAIN ] MLP: Generated 1352 derivative records from 2297 primary records. [2025-09-14T20:56:41.045179] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-14T20:56:41.058236] [DEBUG] [LOCAL ] MLP: Derivative data saved (1352 records). [2025-09-14T20:56:41.059749] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-14T20:56:41.063170] [INFO ] [MAIN ] Derivative Progress: 1294/2226 symbols completed. MLP took 1.0s. Estimated remaining: 5m 28s. Rate: 170.3 symbols/min [2025-09-14T20:56:41.064713] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:41.078220] [DEBUG] [MAIN ] MLR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:41.079886] [INFO ] [MAIN ] MLR: Generated 1352 derivative records from 8560 primary records. [2025-09-14T20:56:41.081195] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-14T20:56:41.096942] [DEBUG] [LOCAL ] MLR: Derivative data saved (1352 records). [2025-09-14T20:56:41.107970] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-14T20:56:41.108310] [DEBUG] [MAIN ] MLNK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:41.110876] [INFO ] [MAIN ] Derivative Progress: 1295/2226 symbols completed. MLR took 1.0s. Estimated remaining: 5m 28s. Rate: 170.5 symbols/min [2025-09-14T20:56:41.111802] [INFO ] [MAIN ] MLNK: Generated 1352 derivative records from 19044 primary records. [2025-09-14T20:56:41.111938] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-14T20:56:41.112114] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:41.125988] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1352 records). [2025-09-14T20:56:41.126155] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-14T20:56:41.128435] [INFO ] [MAIN ] Derivative Progress: 1296/2226 symbols completed. MLNK took 1.1s. Estimated remaining: 5m 27s. Rate: 170.6 symbols/min [2025-09-14T20:56:41.139865] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:41.144725] [DEBUG] [LOCAL ] MMD: Loaded 7956 existing records from primary storage. [2025-09-14T20:56:41.144972] [INFO ] [MAIN ] MMD: Loaded 7956 primary data records. [2025-09-14T20:56:41.273344] [DEBUG] [LOCAL ] MMI: Loaded 11093 existing records from primary storage. [2025-09-14T20:56:41.279127] [INFO ] [MAIN ] MMI: Loaded 11093 primary data records. [2025-09-14T20:56:41.290670] [DEBUG] [LOCAL ] MMC: Loaded 38946 existing records from primary storage. [2025-09-14T20:56:41.419068] [INFO ] [MAIN ] MMC: Loaded 38946 primary data records. [2025-09-14T20:56:42.095699] [DEBUG] [MAIN ] MMD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:42.097835] [INFO ] [MAIN ] MMD: Generated 1352 derivative records from 7956 primary records. [2025-09-14T20:56:42.099019] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-14T20:56:42.124372] [DEBUG] [LOCAL ] MMD: Derivative data saved (1352 records). [2025-09-14T20:56:42.124907] [DEBUG] [MAIN ] MMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:42.125767] [INFO ] [MAIN ] MMI: Generated 1352 derivative records from 11093 primary records. [2025-09-14T20:56:42.126204] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-14T20:56:42.126134] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-14T20:56:42.128228] [INFO ] [MAIN ] Derivative Progress: 1297/2226 symbols completed. MMD took 1.0s. Estimated remaining: 5m 27s. Rate: 170.3 symbols/min [2025-09-14T20:56:42.128802] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:42.145768] [DEBUG] [LOCAL ] MMI: Derivative data saved (1352 records). [2025-09-14T20:56:42.146319] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-14T20:56:42.159617] [INFO ] [MAIN ] Derivative Progress: 1298/2226 symbols completed. MMI took 1.0s. Estimated remaining: 5m 27s. Rate: 170.5 symbols/min [2025-09-14T20:56:42.160470] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:42.160093] [DEBUG] [MAIN ] MMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:42.162193] [INFO ] [MAIN ] MMC: Generated 1352 derivative records from 38946 primary records. [2025-09-14T20:56:42.162692] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-14T20:56:42.177129] [DEBUG] [LOCAL ] MMC: Derivative data saved (1352 records). [2025-09-14T20:56:42.177300] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-14T20:56:42.179861] [INFO ] [MAIN ] Derivative Progress: 1299/2226 symbols completed. MMC took 1.1s. Estimated remaining: 5m 26s. Rate: 170.6 symbols/min [2025-09-14T20:56:42.180195] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:42.204939] [DEBUG] [LOCAL ] MMT: Loaded 7827 existing records from primary storage. [2025-09-14T20:56:42.205113] [INFO ] [MAIN ] MMT: Loaded 7827 primary data records. [2025-09-14T20:56:42.315753] [DEBUG] [LOCAL ] MMS: Loaded 24667 existing records from primary storage. [2025-09-14T20:56:42.340310] [INFO ] [MAIN ] MMS: Loaded 24667 primary data records. [2025-09-14T20:56:42.421324] [DEBUG] [LOCAL ] MMM: Loaded 40041 existing records from primary storage. [2025-09-14T20:56:42.490132] [INFO ] [MAIN ] MMM: Loaded 40041 primary data records. [2025-09-14T20:56:43.097966] [DEBUG] [MAIN ] MMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:43.099337] [INFO ] [MAIN ] MMT: Generated 1352 derivative records from 7827 primary records. [2025-09-14T20:56:43.099514] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-14T20:56:43.113383] [DEBUG] [LOCAL ] MMT: Derivative data saved (1352 records). [2025-09-14T20:56:43.113618] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-14T20:56:43.115680] [INFO ] [MAIN ] Derivative Progress: 1300/2226 symbols completed. MMT took 0.9s. Estimated remaining: 5m 26s. Rate: 170.4 symbols/min [2025-09-14T20:56:43.117082] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:43.132119] [DEBUG] [MAIN ] MMS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:43.133626] [INFO ] [MAIN ] MMS: Generated 1352 derivative records from 24667 primary records. [2025-09-14T20:56:43.137246] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-14T20:56:43.163606] [DEBUG] [LOCAL ] MMU: Loaded 12504 existing records from primary storage. [2025-09-14T20:56:43.170190] [DEBUG] [LOCAL ] MMS: Derivative data saved (1352 records). [2025-09-14T20:56:43.170416] [INFO ] [MAIN ] MMU: Loaded 12504 primary data records. [2025-09-14T20:56:43.170660] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-14T20:56:43.170091] [DEBUG] [MAIN ] MMM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:43.173575] [INFO ] [MAIN ] Derivative Progress: 1301/2226 symbols completed. MMS took 1.0s. Estimated remaining: 5m 26s. Rate: 170.5 symbols/min [2025-09-14T20:56:43.179877] [INFO ] [MAIN ] MMM: Generated 1352 derivative records from 40041 primary records. [2025-09-14T20:56:43.204459] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:43.204551] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-14T20:56:43.345281] [DEBUG] [LOCAL ] MMM: Derivative data saved (1352 records). [2025-09-14T20:56:43.355539] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-14T20:56:43.363145] [INFO ] [MAIN ] Derivative Progress: 1302/2226 symbols completed. MMM took 1.2s. Estimated remaining: 5m 25s. Rate: 170.5 symbols/min [2025-09-14T20:56:43.391908] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:43.392070] [DEBUG] [LOCAL ] MNR: Loaded 18817 existing records from primary storage. [2025-09-14T20:56:43.479898] [INFO ] [MAIN ] MNR: Loaded 18817 primary data records. [2025-09-14T20:56:43.827147] [DEBUG] [LOCAL ] MNSO: Loaded 32461 existing records from primary storage. [2025-09-14T20:56:43.828361] [INFO ] [MAIN ] MNSO: Loaded 32461 primary data records. [2025-09-14T20:56:43.917316] [DEBUG] [MAIN ] MMU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:43.935456] [INFO ] [MAIN ] MMU: Generated 1352 derivative records from 12504 primary records. [2025-09-14T20:56:43.953493] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-14T20:56:44.016574] [DEBUG] [LOCAL ] MMU: Derivative data saved (1352 records). [2025-09-14T20:56:44.044379] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-14T20:56:44.137741] [INFO ] [MAIN ] Derivative Progress: 1303/2226 symbols completed. MMU took 1.0s. Estimated remaining: 5m 25s. Rate: 170.4 symbols/min [2025-09-14T20:56:44.153402] [DEBUG] [MAIN ] MNR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:44.154628] [INFO ] [MAIN ] MNR: Generated 1352 derivative records from 18817 primary records. [2025-09-14T20:56:44.155173] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-14T20:56:44.169270] [DEBUG] [LOCAL ] MNR: Derivative data saved (1352 records). [2025-09-14T20:56:44.169420] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-14T20:56:44.172080] [INFO ] [MAIN ] Derivative Progress: 1304/2226 symbols completed. MNR took 1.0s. Estimated remaining: 5m 24s. Rate: 170.5 symbols/min [2025-09-14T20:56:44.187431] [DEBUG] [MAIN ] MNSO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:44.188179] [INFO ] [MAIN ] MNSO: Generated 1352 derivative records from 32461 primary records. [2025-09-14T20:56:44.188259] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-14T20:56:44.200417] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1352 records). [2025-09-14T20:56:44.200494] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-14T20:56:44.202692] [INFO ] [MAIN ] Derivative Progress: 1305/2226 symbols completed. MNSO took 0.8s. Estimated remaining: 5m 24s. Rate: 170.6 symbols/min [2025-09-14T20:56:44.203553] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:44.203348] [INFO ] [MAIN ] MO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:44.203601] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:44.269657] [DEBUG] [LOCAL ] MODG: Loaded 38900 existing records from primary storage. [2025-09-14T20:56:44.281681] [INFO ] [MAIN ] MODG: Loaded 38900 primary data records. [2025-09-14T20:56:44.282361] [DEBUG] [LOCAL ] MOD: Loaded 33695 existing records from primary storage. [2025-09-14T20:56:44.303567] [INFO ] [MAIN ] MOD: Loaded 33695 primary data records. [2025-09-14T20:56:44.327519] [DEBUG] [LOCAL ] MO: Loaded 40494 existing records from primary storage. [2025-09-14T20:56:44.362013] [INFO ] [MAIN ] MO: Loaded 40494 primary data records. [2025-09-14T20:56:45.149233] [DEBUG] [MAIN ] MODG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:45.152742] [INFO ] [MAIN ] MODG: Generated 1352 derivative records from 38900 primary records. [2025-09-14T20:56:45.153581] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-14T20:56:45.188692] [DEBUG] [MAIN ] MOD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:45.189450] [DEBUG] [MAIN ] MO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:45.190613] [DEBUG] [LOCAL ] MODG: Derivative data saved (1352 records). [2025-09-14T20:56:45.191392] [INFO ] [MAIN ] MO: Generated 1352 derivative records from 40494 primary records. [2025-09-14T20:56:45.192490] [DEBUG] [LOCAL ] MO: Saving derivative data. [2025-09-14T20:56:45.192412] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-14T20:56:45.192185] [INFO ] [MAIN ] MOD: Generated 1352 derivative records from 33695 primary records. [2025-09-14T20:56:45.195276] [INFO ] [MAIN ] Derivative Progress: 1306/2226 symbols completed. MODG took 1.0s. Estimated remaining: 5m 24s. Rate: 170.4 symbols/min [2025-09-14T20:56:45.201895] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:45.196091] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-14T20:56:45.223577] [DEBUG] [LOCAL ] MO: Derivative data saved (1352 records). [2025-09-14T20:56:45.222345] [DEBUG] [LOCAL ] MOD: Derivative data saved (1352 records). [2025-09-14T20:56:45.224038] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-14T20:56:45.223915] [INFO ] [MAIN ] MO: Successfully saved derivative data. [2025-09-14T20:56:45.226784] [INFO ] [MAIN ] Derivative Progress: 1307/2226 symbols completed. MO took 1.0s. Estimated remaining: 5m 23s. Rate: 170.5 symbols/min [2025-09-14T20:56:45.229822] [INFO ] [MAIN ] Derivative Progress: 1308/2226 symbols completed. MOD took 1.0s. Estimated remaining: 5m 23s. Rate: 170.6 symbols/min [2025-09-14T20:56:45.229783] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:45.230474] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:45.258226] [DEBUG] [LOCAL ] MOV: Loaded 15954 existing records from primary storage. [2025-09-14T20:56:45.258593] [INFO ] [MAIN ] MOV: Loaded 15954 primary data records. [2025-09-14T20:56:45.384101] [DEBUG] [LOCAL ] MOH: Loaded 32109 existing records from primary storage. [2025-09-14T20:56:45.388478] [INFO ] [MAIN ] MOH: Loaded 32109 primary data records. [2025-09-14T20:56:45.663456] [DEBUG] [LOCAL ] MOS: Loaded 40283 existing records from primary storage. [2025-09-14T20:56:45.690794] [INFO ] [MAIN ] MOS: Loaded 40283 primary data records. [2025-09-14T20:56:46.193346] [DEBUG] [MAIN ] MOV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:46.194962] [INFO ] [MAIN ] MOV: Generated 1352 derivative records from 15954 primary records. [2025-09-14T20:56:46.196303] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-14T20:56:46.221680] [DEBUG] [MAIN ] MOH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:46.221881] [DEBUG] [LOCAL ] MOV: Derivative data saved (1352 records). [2025-09-14T20:56:46.223028] [INFO ] [MAIN ] MOH: Generated 1352 derivative records from 32109 primary records. [2025-09-14T20:56:46.223165] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-14T20:56:46.223229] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-14T20:56:46.225967] [INFO ] [MAIN ] Derivative Progress: 1309/2226 symbols completed. MOV took 1.0s. Estimated remaining: 5m 23s. Rate: 170.4 symbols/min [2025-09-14T20:56:46.232604] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:46.239260] [DEBUG] [LOCAL ] MOH: Derivative data saved (1352 records). [2025-09-14T20:56:46.242697] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-14T20:56:46.245176] [INFO ] [MAIN ] Derivative Progress: 1310/2226 symbols completed. MOH took 1.0s. Estimated remaining: 5m 22s. Rate: 170.5 symbols/min [2025-09-14T20:56:46.245843] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:46.261310] [DEBUG] [MAIN ] MOS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:46.263211] [INFO ] [MAIN ] MOS: Generated 1352 derivative records from 40283 primary records. [2025-09-14T20:56:46.263518] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-14T20:56:46.275867] [DEBUG] [LOCAL ] MPA: Loaded 4029 existing records from primary storage. [2025-09-14T20:56:46.278197] [INFO ] [MAIN ] MPA: Loaded 4029 primary data records. [2025-09-14T20:56:46.293250] [DEBUG] [LOCAL ] MOS: Derivative data saved (1352 records). [2025-09-14T20:56:46.326531] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-14T20:56:46.343792] [INFO ] [MAIN ] Derivative Progress: 1311/2226 symbols completed. MOS took 1.1s. Estimated remaining: 5m 22s. Rate: 170.6 symbols/min [2025-09-14T20:56:46.377162] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:46.494508] [DEBUG] [LOCAL ] MP: Loaded 40484 existing records from primary storage. [2025-09-14T20:56:46.576350] [INFO ] [MAIN ] MP: Loaded 40484 primary data records. [2025-09-14T20:56:46.802847] [DEBUG] [LOCAL ] MPC: Loaded 39139 existing records from primary storage. [2025-09-14T20:56:46.891236] [INFO ] [MAIN ] MPC: Loaded 39139 primary data records. [2025-09-14T20:56:47.041770] [DEBUG] [MAIN ] MPA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:47.091743] [INFO ] [MAIN ] MPA: Generated 1352 derivative records from 4029 primary records. [2025-09-14T20:56:47.097678] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-14T20:56:47.201059] [DEBUG] [LOCAL ] MPA: Derivative data saved (1352 records). [2025-09-14T20:56:47.201232] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-14T20:56:47.202956] [INFO ] [MAIN ] Derivative Progress: 1312/2226 symbols completed. MPA took 1.0s. Estimated remaining: 5m 22s. Rate: 170.4 symbols/min [2025-09-14T20:56:47.205567] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:47.221177] [DEBUG] [MAIN ] MP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:47.223056] [INFO ] [MAIN ] MP: Generated 1352 derivative records from 40484 primary records. [2025-09-14T20:56:47.223453] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-14T20:56:47.239605] [DEBUG] [LOCAL ] MP: Derivative data saved (1352 records). [2025-09-14T20:56:47.239844] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-14T20:56:47.242345] [INFO ] [MAIN ] Derivative Progress: 1313/2226 symbols completed. MP took 1.0s. Estimated remaining: 5m 21s. Rate: 170.5 symbols/min [2025-09-14T20:56:47.243257] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:47.250539] [DEBUG] [LOCAL ] MPV: Loaded 3390 existing records from primary storage. [2025-09-14T20:56:47.251959] [INFO ] [MAIN ] MPV: Loaded 3390 primary data records. [2025-09-14T20:56:47.365935] [DEBUG] [MAIN ] MPC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:47.396373] [INFO ] [MAIN ] MPC: Generated 1352 derivative records from 39139 primary records. [2025-09-14T20:56:47.397190] [DEBUG] [LOCAL ] MPLX: Loaded 37896 existing records from primary storage. [2025-09-14T20:56:47.396564] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-14T20:56:47.414224] [INFO ] [MAIN ] MPLX: Loaded 37896 primary data records. [2025-09-14T20:56:47.563734] [DEBUG] [LOCAL ] MPC: Derivative data saved (1352 records). [2025-09-14T20:56:47.692716] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-14T20:56:47.696214] [INFO ] [MAIN ] Derivative Progress: 1314/2226 symbols completed. MPC took 1.3s. Estimated remaining: 5m 21s. Rate: 170.5 symbols/min [2025-09-14T20:56:47.712173] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:47.888358] [DEBUG] [MAIN ] MPV: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:56:47.889625] [INFO ] [MAIN ] MPV: Generated 1351 derivative records from 3390 primary records. [2025-09-14T20:56:47.890412] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-14T20:56:47.913951] [DEBUG] [LOCAL ] MPV: Derivative data saved (1351 records). [2025-09-14T20:56:47.914319] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-14T20:56:47.916447] [INFO ] [MAIN ] Derivative Progress: 1315/2226 symbols completed. MPV took 0.7s. Estimated remaining: 5m 21s. Rate: 170.5 symbols/min [2025-09-14T20:56:47.919573] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:47.944086] [DEBUG] [MAIN ] MPLX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:47.946208] [INFO ] [MAIN ] MPLX: Generated 1352 derivative records from 37896 primary records. [2025-09-14T20:56:47.947304] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-14T20:56:47.947088] [DEBUG] [LOCAL ] MPW: Loaded 40288 existing records from primary storage. [2025-09-14T20:56:47.951004] [INFO ] [MAIN ] MPW: Loaded 40288 primary data records. [2025-09-14T20:56:47.949982] [DEBUG] [LOCAL ] MPX: Loaded 2890 existing records from primary storage. [2025-09-14T20:56:47.951879] [INFO ] [MAIN ] MPX: Loaded 2890 primary data records. [2025-09-14T20:56:48.175810] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1352 records). [2025-09-14T20:56:48.195741] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-14T20:56:48.243874] [INFO ] [MAIN ] Derivative Progress: 1316/2226 symbols completed. MPLX took 1.0s. Estimated remaining: 5m 20s. Rate: 170.5 symbols/min [2025-09-14T20:56:48.312399] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:48.567610] [DEBUG] [LOCAL ] MQT: Loaded 5655 existing records from primary storage. [2025-09-14T20:56:48.568781] [INFO ] [MAIN ] MQT: Loaded 5655 primary data records. [2025-09-14T20:56:48.818338] [DEBUG] [MAIN ] MPW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:48.919487] [INFO ] [MAIN ] MPW: Generated 1352 derivative records from 40288 primary records. [2025-09-14T20:56:48.925962] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-14T20:56:48.931632] [DEBUG] [MAIN ] MPX: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:56:48.946662] [DEBUG] [LOCAL ] MPW: Derivative data saved (1352 records). [2025-09-14T20:56:48.943620] [INFO ] [MAIN ] MPX: Generated 1351 derivative records from 2890 primary records. [2025-09-14T20:56:48.946782] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-14T20:56:48.948618] [INFO ] [MAIN ] Derivative Progress: 1317/2226 symbols completed. MPW took 1.2s. Estimated remaining: 5m 20s. Rate: 170.4 symbols/min [2025-09-14T20:56:48.949409] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-14T20:56:48.949818] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:48.962586] [DEBUG] [LOCAL ] MPX: Derivative data saved (1351 records). [2025-09-14T20:56:48.963390] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-14T20:56:48.966549] [INFO ] [MAIN ] Derivative Progress: 1318/2226 symbols completed. MPX took 1.0s. Estimated remaining: 5m 19s. Rate: 170.5 symbols/min [2025-09-14T20:56:48.977351] [DEBUG] [LOCAL ] MQY: Loaded 11827 existing records from primary storage. [2025-09-14T20:56:48.979244] [INFO ] [MAIN ] MQY: Loaded 11827 primary data records. [2025-09-14T20:56:49.098028] [DEBUG] [MAIN ] MQT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:49.099367] [INFO ] [MAIN ] MQT: Generated 1352 derivative records from 5655 primary records. [2025-09-14T20:56:49.110011] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-14T20:56:49.186693] [DEBUG] [LOCAL ] MQT: Derivative data saved (1352 records). [2025-09-14T20:56:49.213791] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-14T20:56:49.240221] [INFO ] [MAIN ] Derivative Progress: 1319/2226 symbols completed. MQT took 0.9s. Estimated remaining: 5m 19s. Rate: 170.6 symbols/min [2025-09-14T20:56:49.298937] [DEBUG] [MAIN ] MQY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:49.299747] [INFO ] [MAIN ] MQY: Generated 1352 derivative records from 11827 primary records. [2025-09-14T20:56:49.299830] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-14T20:56:49.312528] [DEBUG] [LOCAL ] MQY: Derivative data saved (1352 records). [2025-09-14T20:56:49.312945] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-14T20:56:49.314873] [INFO ] [MAIN ] Derivative Progress: 1320/2226 symbols completed. MQY took 0.4s. Estimated remaining: 5m 19s. Rate: 170.7 symbols/min [2025-09-14T20:56:49.315562] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:49.315694] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:49.316277] [INFO ] [MAIN ] MRP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:49.347597] [DEBUG] [LOCAL ] MRC: Loaded 27384 existing records from primary storage. [2025-09-14T20:56:49.347792] [INFO ] [MAIN ] MRC: Loaded 27384 primary data records. [2025-09-14T20:56:49.499220] [DEBUG] [LOCAL ] MRP: Loaded 34842 existing records from primary storage. [2025-09-14T20:56:49.570409] [DEBUG] [LOCAL ] MRK: Loaded 40530 existing records from primary storage. [2025-09-14T20:56:49.569762] [INFO ] [MAIN ] MRP: Loaded 34842 primary data records. [2025-09-14T20:56:49.573984] [INFO ] [MAIN ] MRK: Loaded 40530 primary data records. [2025-09-14T20:56:50.225497] [DEBUG] [MAIN ] MRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:50.228012] [INFO ] [MAIN ] MRC: Generated 1352 derivative records from 27384 primary records. [2025-09-14T20:56:50.228722] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-14T20:56:50.243892] [DEBUG] [LOCAL ] MRC: Derivative data saved (1352 records). [2025-09-14T20:56:50.244767] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-14T20:56:50.246786] [INFO ] [MAIN ] Derivative Progress: 1321/2226 symbols completed. MRC took 0.9s. Estimated remaining: 5m 19s. Rate: 170.5 symbols/min [2025-09-14T20:56:50.248379] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:50.270227] [DEBUG] [MAIN ] MRP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:50.274741] [DEBUG] [MAIN ] MRK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:50.276229] [INFO ] [MAIN ] MRP: Generated 1352 derivative records from 34842 primary records. [2025-09-14T20:56:50.277218] [INFO ] [MAIN ] MRK: Generated 1352 derivative records from 40530 primary records. [2025-09-14T20:56:50.277659] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-14T20:56:50.277503] [DEBUG] [LOCAL ] MRP: Saving derivative data. [2025-09-14T20:56:50.302780] [DEBUG] [LOCAL ] MRK: Derivative data saved (1352 records). [2025-09-14T20:56:50.306326] [DEBUG] [LOCAL ] MRP: Derivative data saved (1352 records). [2025-09-14T20:56:50.306553] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-14T20:56:50.306926] [INFO ] [MAIN ] MRP: Successfully saved derivative data. [2025-09-14T20:56:50.320021] [INFO ] [MAIN ] Derivative Progress: 1322/2226 symbols completed. MRK took 1.0s. Estimated remaining: 5m 18s. Rate: 170.6 symbols/min [2025-09-14T20:56:50.323168] [INFO ] [MAIN ] Derivative Progress: 1323/2226 symbols completed. MRP took 1.0s. Estimated remaining: 5m 17s. Rate: 170.7 symbols/min [2025-09-14T20:56:50.323453] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:50.323847] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:50.340815] [DEBUG] [LOCAL ] MS: Loaded 40437 existing records from primary storage. [2025-09-14T20:56:50.342748] [INFO ] [MAIN ] MS: Loaded 40437 primary data records. [2025-09-14T20:56:50.397703] [DEBUG] [LOCAL ] MSB: Loaded 6124 existing records from primary storage. [2025-09-14T20:56:50.446418] [INFO ] [MAIN ] MSB: Loaded 6124 primary data records. [2025-09-14T20:56:50.452369] [DEBUG] [LOCAL ] MSA: Loaded 14092 existing records from primary storage. [2025-09-14T20:56:50.506789] [INFO ] [MAIN ] MSA: Loaded 14092 primary data records. [2025-09-14T20:56:51.334356] [DEBUG] [MAIN ] MSB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:51.344589] [DEBUG] [MAIN ] MS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:51.347173] [INFO ] [MAIN ] MS: Generated 1352 derivative records from 40437 primary records. [2025-09-14T20:56:51.346368] [INFO ] [MAIN ] MSB: Generated 1352 derivative records from 6124 primary records. [2025-09-14T20:56:51.347315] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-14T20:56:51.345238] [DEBUG] [MAIN ] MSA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:51.348218] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-14T20:56:51.350380] [INFO ] [MAIN ] MSA: Generated 1352 derivative records from 14092 primary records. [2025-09-14T20:56:51.363374] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-14T20:56:51.374879] [DEBUG] [LOCAL ] MS: Derivative data saved (1352 records). [2025-09-14T20:56:51.384863] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-14T20:56:51.387628] [INFO ] [MAIN ] Derivative Progress: 1324/2226 symbols completed. MS took 1.1s. Estimated remaining: 5m 18s. Rate: 170.4 symbols/min [2025-09-14T20:56:51.389946] [DEBUG] [LOCAL ] MSA: Derivative data saved (1352 records). [2025-09-14T20:56:51.390853] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:51.391548] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-14T20:56:51.395471] [INFO ] [MAIN ] Derivative Progress: 1325/2226 symbols completed. MSA took 1.1s. Estimated remaining: 5m 17s. Rate: 170.6 symbols/min [2025-09-14T20:56:51.396282] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:51.397566] [DEBUG] [LOCAL ] MSB: Derivative data saved (1352 records). [2025-09-14T20:56:51.398906] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-14T20:56:51.401529] [INFO ] [MAIN ] Derivative Progress: 1326/2226 symbols completed. MSB took 1.1s. Estimated remaining: 5m 16s. Rate: 170.7 symbols/min [2025-09-14T20:56:51.402399] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:51.416232] [DEBUG] [LOCAL ] MSD: Loaded 12044 existing records from primary storage. [2025-09-14T20:56:51.416808] [INFO ] [MAIN ] MSD: Loaded 12044 primary data records. [2025-09-14T20:56:51.574420] [DEBUG] [LOCAL ] MSCI: Loaded 25461 existing records from primary storage. [2025-09-14T20:56:51.585933] [INFO ] [MAIN ] MSCI: Loaded 25461 primary data records. [2025-09-14T20:56:51.592518] [DEBUG] [LOCAL ] MSDL: Loaded 27502 existing records from primary storage. [2025-09-14T20:56:51.642128] [INFO ] [MAIN ] MSDL: Loaded 27502 primary data records. [2025-09-14T20:56:52.349296] [DEBUG] [MAIN ] MSD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:52.350230] [INFO ] [MAIN ] MSD: Generated 1352 derivative records from 12044 primary records. [2025-09-14T20:56:52.350502] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-14T20:56:52.365370] [DEBUG] [LOCAL ] MSD: Derivative data saved (1352 records). [2025-09-14T20:56:52.365920] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-14T20:56:52.367757] [INFO ] [MAIN ] Derivative Progress: 1327/2226 symbols completed. MSD took 1.0s. Estimated remaining: 5m 16s. Rate: 170.5 symbols/min [2025-09-14T20:56:52.368788] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:52.386952] [DEBUG] [MAIN ] MSCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:52.387966] [INFO ] [MAIN ] MSCI: Generated 1352 derivative records from 25461 primary records. [2025-09-14T20:56:52.397271] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-14T20:56:52.397657] [DEBUG] [MAIN ] MSDL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:52.398298] [INFO ] [MAIN ] MSDL: Generated 1352 derivative records from 27502 primary records. [2025-09-14T20:56:52.412655] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-14T20:56:52.421829] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1352 records). [2025-09-14T20:56:52.422890] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-14T20:56:52.428763] [DEBUG] [LOCAL ] MSGE: Loaded 19384 existing records from primary storage. [2025-09-14T20:56:52.435753] [INFO ] [MAIN ] MSGE: Loaded 19384 primary data records. [2025-09-14T20:56:52.433973] [INFO ] [MAIN ] Derivative Progress: 1328/2226 symbols completed. MSCI took 1.0s. Estimated remaining: 5m 16s. Rate: 170.6 symbols/min [2025-09-14T20:56:52.437051] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:52.442209] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1352 records). [2025-09-14T20:56:52.458678] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-14T20:56:52.518678] [INFO ] [MAIN ] Derivative Progress: 1329/2226 symbols completed. MSDL took 1.1s. Estimated remaining: 5m 15s. Rate: 170.7 symbols/min [2025-09-14T20:56:52.551532] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:52.563978] [DEBUG] [LOCAL ] MSGS: Loaded 12313 existing records from primary storage. [2025-09-14T20:56:52.595247] [INFO ] [MAIN ] MSGS: Loaded 12313 primary data records. [2025-09-14T20:56:52.888163] [DEBUG] [LOCAL ] MSI: Loaded 30154 existing records from primary storage. [2025-09-14T20:56:52.925293] [INFO ] [MAIN ] MSI: Loaded 30154 primary data records. [2025-09-14T20:56:53.388331] [DEBUG] [MAIN ] MSGE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:53.390263] [INFO ] [MAIN ] MSGE: Generated 1352 derivative records from 19384 primary records. [2025-09-14T20:56:53.390425] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-14T20:56:53.407954] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1352 records). [2025-09-14T20:56:53.410565] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-14T20:56:53.413325] [INFO ] [MAIN ] Derivative Progress: 1330/2226 symbols completed. MSGE took 1.0s. Estimated remaining: 5m 15s. Rate: 170.5 symbols/min [2025-09-14T20:56:53.413800] [INFO ] [MAIN ] MSIF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:53.426281] [DEBUG] [MAIN ] MSGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:53.427218] [INFO ] [MAIN ] MSGS: Generated 1352 derivative records from 12313 primary records. [2025-09-14T20:56:53.427349] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-14T20:56:53.454436] [DEBUG] [MAIN ] MSI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:53.461104] [INFO ] [MAIN ] MSI: Generated 1352 derivative records from 30154 primary records. [2025-09-14T20:56:53.460050] [DEBUG] [LOCAL ] MSIF: Loaded 10482 existing records from primary storage. [2025-09-14T20:56:53.461455] [INFO ] [MAIN ] MSIF: Loaded 10482 primary data records. [2025-09-14T20:56:53.461611] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-14T20:56:53.510621] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1352 records). [2025-09-14T20:56:53.557785] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-14T20:56:53.582541] [DEBUG] [LOCAL ] MSI: Derivative data saved (1352 records). [2025-09-14T20:56:53.585191] [INFO ] [MAIN ] Derivative Progress: 1331/2226 symbols completed. MSGS took 1.1s. Estimated remaining: 5m 15s. Rate: 170.5 symbols/min [2025-09-14T20:56:53.585874] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-14T20:56:53.591310] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:53.616947] [INFO ] [MAIN ] Derivative Progress: 1332/2226 symbols completed. MSI took 1.1s. Estimated remaining: 5m 14s. Rate: 170.6 symbols/min [2025-09-14T20:56:53.672428] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:53.802122] [DEBUG] [MAIN ] MSIF: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:56:53.811040] [INFO ] [MAIN ] MSIF: Generated 1351 derivative records from 10482 primary records. [2025-09-14T20:56:53.811805] [DEBUG] [LOCAL ] MSM: Loaded 25777 existing records from primary storage. [2025-09-14T20:56:53.812082] [INFO ] [MAIN ] MSM: Loaded 25777 primary data records. [2025-09-14T20:56:53.811952] [DEBUG] [LOCAL ] MSIF: Saving derivative data. [2025-09-14T20:56:53.946781] [DEBUG] [LOCAL ] MT: Loaded 37882 existing records from primary storage. [2025-09-14T20:56:53.947352] [INFO ] [MAIN ] MT: Loaded 37882 primary data records. [2025-09-14T20:56:54.086970] [DEBUG] [LOCAL ] MSIF: Derivative data saved (1351 records). [2025-09-14T20:56:54.212929] [INFO ] [MAIN ] MSIF: Successfully saved derivative data. [2025-09-14T20:56:54.240831] [INFO ] [MAIN ] Derivative Progress: 1333/2226 symbols completed. MSIF took 0.8s. Estimated remaining: 5m 14s. Rate: 170.5 symbols/min [2025-09-14T20:56:54.511427] [DEBUG] [MAIN ] MSM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:54.513140] [INFO ] [MAIN ] MSM: Generated 1352 derivative records from 25777 primary records. [2025-09-14T20:56:54.513280] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-14T20:56:54.534102] [DEBUG] [LOCAL ] MSM: Derivative data saved (1352 records). [2025-09-14T20:56:54.534449] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-14T20:56:54.537394] [INFO ] [MAIN ] Derivative Progress: 1334/2226 symbols completed. MSM took 0.9s. Estimated remaining: 5m 14s. Rate: 170.6 symbols/min [2025-09-14T20:56:54.560009] [DEBUG] [MAIN ] MT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:54.560899] [INFO ] [MAIN ] MT: Generated 1352 derivative records from 37882 primary records. [2025-09-14T20:56:54.560998] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-14T20:56:54.578177] [DEBUG] [LOCAL ] MT: Derivative data saved (1352 records). [2025-09-14T20:56:54.578398] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-14T20:56:54.580499] [INFO ] [MAIN ] Derivative Progress: 1335/2226 symbols completed. MT took 0.9s. Estimated remaining: 5m 13s. Rate: 170.7 symbols/min [2025-09-14T20:56:54.581754] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:54.582049] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:54.582406] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:54.614543] [DEBUG] [LOCAL ] MTD: Loaded 11405 existing records from primary storage. [2025-09-14T20:56:54.615128] [INFO ] [MAIN ] MTD: Loaded 11405 primary data records. [2025-09-14T20:56:54.743611] [DEBUG] [LOCAL ] MTAL: Loaded 27726 existing records from primary storage. [2025-09-14T20:56:54.771945] [INFO ] [MAIN ] MTAL: Loaded 27726 primary data records. [2025-09-14T20:56:54.895457] [DEBUG] [LOCAL ] MTB: Loaded 35024 existing records from primary storage. [2025-09-14T20:56:54.956713] [INFO ] [MAIN ] MTB: Loaded 35024 primary data records. [2025-09-14T20:56:55.831779] [DEBUG] [MAIN ] MTD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:55.833539] [INFO ] [MAIN ] MTD: Generated 1352 derivative records from 11405 primary records. [2025-09-14T20:56:55.833714] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-14T20:56:55.856658] [DEBUG] [MAIN ] MTAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:55.858733] [DEBUG] [LOCAL ] MTD: Derivative data saved (1352 records). [2025-09-14T20:56:55.859567] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-14T20:56:55.860171] [INFO ] [MAIN ] MTAL: Generated 1352 derivative records from 27726 primary records. [2025-09-14T20:56:55.862719] [INFO ] [MAIN ] Derivative Progress: 1336/2226 symbols completed. MTD took 1.3s. Estimated remaining: 5m 13s. Rate: 170.3 symbols/min [2025-09-14T20:56:55.862868] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-14T20:56:55.863704] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:55.883876] [DEBUG] [MAIN ] MTB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:55.887144] [INFO ] [MAIN ] MTB: Generated 1352 derivative records from 35024 primary records. [2025-09-14T20:56:55.886216] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1352 records). [2025-09-14T20:56:55.887230] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-14T20:56:55.887318] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-14T20:56:55.890301] [INFO ] [MAIN ] Derivative Progress: 1337/2226 symbols completed. MTAL took 1.3s. Estimated remaining: 5m 13s. Rate: 170.5 symbols/min [2025-09-14T20:56:55.897481] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:55.903568] [DEBUG] [LOCAL ] MTB: Derivative data saved (1352 records). [2025-09-14T20:56:55.903716] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-14T20:56:55.906231] [INFO ] [MAIN ] Derivative Progress: 1338/2226 symbols completed. MTB took 1.3s. Estimated remaining: 5m 12s. Rate: 170.6 symbols/min [2025-09-14T20:56:55.906469] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:55.947349] [DEBUG] [LOCAL ] MTDR: Loaded 38772 existing records from primary storage. [2025-09-14T20:56:55.947574] [INFO ] [MAIN ] MTDR: Loaded 38772 primary data records. [2025-09-14T20:56:56.099012] [DEBUG] [LOCAL ] MTH: Loaded 32732 existing records from primary storage. [2025-09-14T20:56:56.161400] [INFO ] [MAIN ] MTH: Loaded 32732 primary data records. [2025-09-14T20:56:56.229857] [DEBUG] [LOCAL ] MTG: Loaded 38305 existing records from primary storage. [2025-09-14T20:56:56.300732] [INFO ] [MAIN ] MTG: Loaded 38305 primary data records. [2025-09-14T20:56:56.887012] [DEBUG] [MAIN ] MTDR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:56.888416] [INFO ] [MAIN ] MTDR: Generated 1352 derivative records from 38772 primary records. [2025-09-14T20:56:56.889506] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-14T20:56:56.903949] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1352 records). [2025-09-14T20:56:56.904519] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-14T20:56:56.906781] [INFO ] [MAIN ] Derivative Progress: 1339/2226 symbols completed. MTDR took 1.0s. Estimated remaining: 5m 12s. Rate: 170.3 symbols/min [2025-09-14T20:56:56.907350] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:56.923928] [DEBUG] [MAIN ] MTH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:56.925376] [INFO ] [MAIN ] MTH: Generated 1352 derivative records from 32732 primary records. [2025-09-14T20:56:56.935034] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-14T20:56:56.935765] [DEBUG] [MAIN ] MTG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:56.936687] [INFO ] [MAIN ] MTG: Generated 1352 derivative records from 38305 primary records. [2025-09-14T20:56:56.937065] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-14T20:56:56.970255] [DEBUG] [LOCAL ] MTG: Derivative data saved (1352 records). [2025-09-14T20:56:56.972910] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-14T20:56:56.972676] [DEBUG] [LOCAL ] MTH: Derivative data saved (1352 records). [2025-09-14T20:56:56.976271] [INFO ] [MAIN ] Derivative Progress: 1340/2226 symbols completed. MTG took 1.1s. Estimated remaining: 5m 12s. Rate: 170.4 symbols/min [2025-09-14T20:56:56.973141] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-14T20:56:56.979273] [INFO ] [MAIN ] MTR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:56.979167] [INFO ] [MAIN ] Derivative Progress: 1341/2226 symbols completed. MTH took 1.1s. Estimated remaining: 5m 11s. Rate: 170.6 symbols/min [2025-09-14T20:56:56.979604] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:56.990185] [DEBUG] [LOCAL ] MTN: Loaded 29044 existing records from primary storage. [2025-09-14T20:56:56.990377] [INFO ] [MAIN ] MTN: Loaded 29044 primary data records. [2025-09-14T20:56:57.055710] [DEBUG] [LOCAL ] MTR: Loaded 1606 existing records from primary storage. [2025-09-14T20:56:57.097314] [INFO ] [MAIN ] MTR: Loaded 1606 primary data records. [2025-09-14T20:56:57.267112] [DEBUG] [LOCAL ] MTRN: Loaded 13788 existing records from primary storage. [2025-09-14T20:56:57.366230] [INFO ] [MAIN ] MTRN: Loaded 13788 primary data records. [2025-09-14T20:56:57.846773] [DEBUG] [MAIN ] MTN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:57.848256] [INFO ] [MAIN ] MTN: Generated 1352 derivative records from 29044 primary records. [2025-09-14T20:56:57.849301] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-14T20:56:57.867174] [DEBUG] [LOCAL ] MTN: Derivative data saved (1352 records). [2025-09-14T20:56:57.869292] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-14T20:56:57.882015] [INFO ] [MAIN ] Derivative Progress: 1342/2226 symbols completed. MTN took 1.0s. Estimated remaining: 5m 11s. Rate: 170.4 symbols/min [2025-09-14T20:56:57.882631] [DEBUG] [MAIN ] MTR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:57.883188] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:57.893296] [INFO ] [MAIN ] MTR: Generated 1352 derivative records from 1606 primary records. [2025-09-14T20:56:57.893998] [DEBUG] [MAIN ] MTRN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:57.894278] [DEBUG] [LOCAL ] MTR: Saving derivative data. [2025-09-14T20:56:57.895192] [INFO ] [MAIN ] MTRN: Generated 1352 derivative records from 13788 primary records. [2025-09-14T20:56:57.895809] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-14T20:56:57.916105] [DEBUG] [LOCAL ] MTR: Derivative data saved (1352 records). [2025-09-14T20:56:57.917123] [INFO ] [MAIN ] MTR: Successfully saved derivative data. [2025-09-14T20:56:57.920100] [INFO ] [MAIN ] Derivative Progress: 1343/2226 symbols completed. MTR took 0.9s. Estimated remaining: 5m 11s. Rate: 170.5 symbols/min [2025-09-14T20:56:57.927626] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1352 records). [2025-09-14T20:56:57.928049] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-14T20:56:57.931161] [INFO ] [MAIN ] Derivative Progress: 1344/2226 symbols completed. MTRN took 1.0s. Estimated remaining: 5m 10s. Rate: 170.6 symbols/min [2025-09-14T20:56:57.931423] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:57.927845] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:57.950010] [DEBUG] [LOCAL ] MTUS: Loaded 21091 existing records from primary storage. [2025-09-14T20:56:57.950290] [INFO ] [MAIN ] MTUS: Loaded 21091 primary data records. [2025-09-14T20:56:58.083504] [DEBUG] [LOCAL ] MTW: Loaded 20093 existing records from primary storage. [2025-09-14T20:56:58.084069] [DEBUG] [LOCAL ] MTX: Loaded 17744 existing records from primary storage. [2025-09-14T20:56:58.100209] [INFO ] [MAIN ] MTW: Loaded 20093 primary data records. [2025-09-14T20:56:58.100349] [INFO ] [MAIN ] MTX: Loaded 17744 primary data records. [2025-09-14T20:56:58.901476] [DEBUG] [MAIN ] MTUS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:58.903354] [INFO ] [MAIN ] MTUS: Generated 1352 derivative records from 21091 primary records. [2025-09-14T20:56:58.904458] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-14T20:56:58.934168] [DEBUG] [MAIN ] MTX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:58.934242] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1352 records). [2025-09-14T20:56:58.945871] [INFO ] [MAIN ] MTX: Generated 1352 derivative records from 17744 primary records. [2025-09-14T20:56:58.945989] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-14T20:56:58.946579] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-14T20:56:58.946335] [DEBUG] [MAIN ] MTW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:58.949128] [INFO ] [MAIN ] Derivative Progress: 1345/2226 symbols completed. MTUS took 1.1s. Estimated remaining: 5m 10s. Rate: 170.4 symbols/min [2025-09-14T20:56:58.950897] [INFO ] [MAIN ] MTW: Generated 1352 derivative records from 20093 primary records. [2025-09-14T20:56:58.951367] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-14T20:56:58.958451] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:58.977694] [DEBUG] [LOCAL ] MTW: Derivative data saved (1352 records). [2025-09-14T20:56:58.978258] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-14T20:56:58.981754] [INFO ] [MAIN ] Derivative Progress: 1346/2226 symbols completed. MTW took 1.1s. Estimated remaining: 5m 10s. Rate: 170.5 symbols/min [2025-09-14T20:56:58.983750] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:58.985800] [DEBUG] [LOCAL ] MTX: Derivative data saved (1352 records). [2025-09-14T20:56:58.986127] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-14T20:56:58.988838] [INFO ] [MAIN ] Derivative Progress: 1347/2226 symbols completed. MTX took 1.1s. Estimated remaining: 5m 9s. Rate: 170.6 symbols/min [2025-09-14T20:56:58.989635] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:56:59.001270] [DEBUG] [LOCAL ] MUA: Loaded 8490 existing records from primary storage. [2025-09-14T20:56:59.001736] [INFO ] [MAIN ] MUA: Loaded 8490 primary data records. [2025-09-14T20:56:59.159459] [DEBUG] [LOCAL ] MTZ: Loaded 32078 existing records from primary storage. [2025-09-14T20:56:59.146942] [DEBUG] [LOCAL ] MUC: Loaded 14665 existing records from primary storage. [2025-09-14T20:56:59.170055] [INFO ] [MAIN ] MTZ: Loaded 32078 primary data records. [2025-09-14T20:56:59.192684] [INFO ] [MAIN ] MUC: Loaded 14665 primary data records. [2025-09-14T20:56:59.961223] [DEBUG] [MAIN ] MUA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:56:59.962503] [INFO ] [MAIN ] MUA: Generated 1352 derivative records from 8490 primary records. [2025-09-14T20:56:59.962999] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-14T20:56:59.980762] [DEBUG] [LOCAL ] MUA: Derivative data saved (1352 records). [2025-09-14T20:56:59.981473] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-14T20:56:59.983873] [INFO ] [MAIN ] Derivative Progress: 1348/2226 symbols completed. MUA took 1.0s. Estimated remaining: 5m 9s. Rate: 170.4 symbols/min [2025-09-14T20:57:00.004897] [DEBUG] [MAIN ] MTZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:00.006432] [INFO ] [MAIN ] MTZ: Generated 1352 derivative records from 32078 primary records. [2025-09-14T20:57:00.006828] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-14T20:57:00.020858] [DEBUG] [MAIN ] MUC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:00.033739] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1352 records). [2025-09-14T20:57:00.033628] [INFO ] [MAIN ] MUC: Generated 1352 derivative records from 14665 primary records. [2025-09-14T20:57:00.034007] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-14T20:57:00.034100] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-14T20:57:00.037554] [INFO ] [MAIN ] Derivative Progress: 1349/2226 symbols completed. MTZ took 1.1s. Estimated remaining: 5m 9s. Rate: 170.5 symbols/min [2025-09-14T20:57:00.050280] [DEBUG] [LOCAL ] MUC: Derivative data saved (1352 records). [2025-09-14T20:57:00.050487] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-14T20:57:00.053168] [INFO ] [MAIN ] Derivative Progress: 1350/2226 symbols completed. MUC took 1.1s. Estimated remaining: 5m 8s. Rate: 170.6 symbols/min [2025-09-14T20:57:00.054246] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:00.053991] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:00.054379] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:00.073474] [DEBUG] [LOCAL ] MUE: Loaded 9473 existing records from primary storage. [2025-09-14T20:57:00.079240] [DEBUG] [LOCAL ] MUJ: Loaded 10212 existing records from primary storage. [2025-09-14T20:57:00.079949] [INFO ] [MAIN ] MUJ: Loaded 10212 primary data records. [2025-09-14T20:57:00.080063] [INFO ] [MAIN ] MUE: Loaded 9473 primary data records. [2025-09-14T20:57:00.400095] [DEBUG] [LOCAL ] MUFG: Loaded 39562 existing records from primary storage. [2025-09-14T20:57:00.449877] [INFO ] [MAIN ] MUFG: Loaded 39562 primary data records. [2025-09-14T20:57:01.073988] [DEBUG] [MAIN ] MUE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:01.080503] [INFO ] [MAIN ] MUE: Generated 1352 derivative records from 9473 primary records. [2025-09-14T20:57:01.081222] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-14T20:57:01.095671] [DEBUG] [MAIN ] MUJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:01.105015] [INFO ] [MAIN ] MUJ: Generated 1352 derivative records from 10212 primary records. [2025-09-14T20:57:01.115010] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-14T20:57:01.114469] [DEBUG] [LOCAL ] MUE: Derivative data saved (1352 records). [2025-09-14T20:57:01.117056] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-14T20:57:01.136808] [INFO ] [MAIN ] Derivative Progress: 1351/2226 symbols completed. MUE took 1.1s. Estimated remaining: 5m 8s. Rate: 170.3 symbols/min [2025-09-14T20:57:01.136938] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1352 records). [2025-09-14T20:57:01.137957] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:01.149120] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-14T20:57:01.151983] [INFO ] [MAIN ] Derivative Progress: 1352/2226 symbols completed. MUJ took 1.1s. Estimated remaining: 5m 8s. Rate: 170.5 symbols/min [2025-09-14T20:57:01.152218] [DEBUG] [MAIN ] MUFG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:01.152738] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:01.153808] [INFO ] [MAIN ] MUFG: Generated 1352 derivative records from 39562 primary records. [2025-09-14T20:57:01.154076] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-14T20:57:01.169619] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1352 records). [2025-09-14T20:57:01.169845] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-14T20:57:01.173854] [INFO ] [MAIN ] Derivative Progress: 1353/2226 symbols completed. MUFG took 1.1s. Estimated remaining: 5m 7s. Rate: 170.6 symbols/min [2025-09-14T20:57:01.174277] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:01.220007] [DEBUG] [LOCAL ] MUSA: Loaded 18803 existing records from primary storage. [2025-09-14T20:57:01.231094] [INFO ] [MAIN ] MUSA: Loaded 18803 primary data records. [2025-09-14T20:57:01.378222] [DEBUG] [LOCAL ] MUR: Loaded 39754 existing records from primary storage. [2025-09-14T20:57:01.424353] [DEBUG] [LOCAL ] MUX: Loaded 31410 existing records from primary storage. [2025-09-14T20:57:01.433725] [INFO ] [MAIN ] MUR: Loaded 39754 primary data records. [2025-09-14T20:57:01.449599] [INFO ] [MAIN ] MUX: Loaded 31410 primary data records. [2025-09-14T20:57:02.181869] [DEBUG] [MAIN ] MUSA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:02.183112] [INFO ] [MAIN ] MUSA: Generated 1352 derivative records from 18803 primary records. [2025-09-14T20:57:02.183221] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-14T20:57:02.199478] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1352 records). [2025-09-14T20:57:02.200193] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-14T20:57:02.202100] [INFO ] [MAIN ] Derivative Progress: 1354/2226 symbols completed. MUSA took 1.0s. Estimated remaining: 5m 7s. Rate: 170.3 symbols/min [2025-09-14T20:57:02.202538] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:02.220075] [DEBUG] [MAIN ] MUX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:02.221096] [INFO ] [MAIN ] MUX: Generated 1352 derivative records from 31410 primary records. [2025-09-14T20:57:02.230534] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-14T20:57:02.231949] [DEBUG] [MAIN ] MUR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:02.235912] [DEBUG] [LOCAL ] MVF: Loaded 9100 existing records from primary storage. [2025-09-14T20:57:02.236545] [INFO ] [MAIN ] MUR: Generated 1352 derivative records from 39754 primary records. [2025-09-14T20:57:02.236691] [INFO ] [MAIN ] MVF: Loaded 9100 primary data records. [2025-09-14T20:57:02.242246] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-14T20:57:02.302372] [DEBUG] [LOCAL ] MUX: Derivative data saved (1352 records). [2025-09-14T20:57:02.326465] [DEBUG] [LOCAL ] MUR: Derivative data saved (1352 records). [2025-09-14T20:57:02.318744] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-14T20:57:02.338933] [INFO ] [MAIN ] Derivative Progress: 1355/2226 symbols completed. MUX took 1.2s. Estimated remaining: 5m 7s. Rate: 170.4 symbols/min [2025-09-14T20:57:02.347251] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-14T20:57:02.357826] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:02.374365] [INFO ] [MAIN ] Derivative Progress: 1356/2226 symbols completed. MUR took 1.2s. Estimated remaining: 5m 6s. Rate: 170.5 symbols/min [2025-09-14T20:57:02.374890] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:02.491501] [DEBUG] [LOCAL ] MVT: Loaded 7495 existing records from primary storage. [2025-09-14T20:57:02.568756] [DEBUG] [LOCAL ] MVO: Loaded 6506 existing records from primary storage. [2025-09-14T20:57:02.580968] [INFO ] [MAIN ] MVT: Loaded 7495 primary data records. [2025-09-14T20:57:02.581441] [INFO ] [MAIN ] MVO: Loaded 6506 primary data records. [2025-09-14T20:57:03.215897] [DEBUG] [MAIN ] MVF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:03.218441] [INFO ] [MAIN ] MVF: Generated 1352 derivative records from 9100 primary records. [2025-09-14T20:57:03.219257] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-14T20:57:03.234957] [DEBUG] [LOCAL ] MVF: Derivative data saved (1352 records). [2025-09-14T20:57:03.237050] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-14T20:57:03.239004] [INFO ] [MAIN ] Derivative Progress: 1357/2226 symbols completed. MVF took 1.0s. Estimated remaining: 5m 6s. Rate: 170.3 symbols/min [2025-09-14T20:57:03.240142] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:03.259600] [DEBUG] [MAIN ] MVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:03.262689] [INFO ] [MAIN ] MVT: Generated 1352 derivative records from 7495 primary records. [2025-09-14T20:57:03.263293] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-14T20:57:03.276459] [DEBUG] [MAIN ] MVO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:03.288339] [DEBUG] [LOCAL ] MVT: Derivative data saved (1352 records). [2025-09-14T20:57:03.289581] [INFO ] [MAIN ] MVO: Generated 1352 derivative records from 6506 primary records. [2025-09-14T20:57:03.298795] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-14T20:57:03.302293] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-14T20:57:03.302051] [INFO ] [MAIN ] Derivative Progress: 1358/2226 symbols completed. MVT took 0.9s. Estimated remaining: 5m 6s. Rate: 170.4 symbols/min [2025-09-14T20:57:03.304060] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:03.316868] [DEBUG] [LOCAL ] MVO: Derivative data saved (1352 records). [2025-09-14T20:57:03.327047] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-14T20:57:03.328097] [DEBUG] [LOCAL ] MWA: Loaded 34538 existing records from primary storage. [2025-09-14T20:57:03.330454] [INFO ] [MAIN ] Derivative Progress: 1359/2226 symbols completed. MVO took 1.0s. Estimated remaining: 5m 5s. Rate: 170.6 symbols/min [2025-09-14T20:57:03.330838] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:03.330990] [INFO ] [MAIN ] MWA: Loaded 34538 primary data records. [2025-09-14T20:57:03.404554] [DEBUG] [LOCAL ] MXF: Loaded 4251 existing records from primary storage. [2025-09-14T20:57:03.447462] [INFO ] [MAIN ] MXF: Loaded 4251 primary data records. [2025-09-14T20:57:03.459217] [DEBUG] [LOCAL ] MX: Loaded 16829 existing records from primary storage. [2025-09-14T20:57:03.465003] [INFO ] [MAIN ] MX: Loaded 16829 primary data records. [2025-09-14T20:57:04.210847] [DEBUG] [MAIN ] MWA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:04.212271] [INFO ] [MAIN ] MWA: Generated 1352 derivative records from 34538 primary records. [2025-09-14T20:57:04.212663] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-14T20:57:04.248712] [DEBUG] [LOCAL ] MWA: Derivative data saved (1352 records). [2025-09-14T20:57:04.249272] [DEBUG] [MAIN ] MX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:04.249472] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-14T20:57:04.249751] [DEBUG] [MAIN ] MXF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:04.251587] [INFO ] [MAIN ] Derivative Progress: 1360/2226 symbols completed. MWA took 1.0s. Estimated remaining: 5m 5s. Rate: 170.4 symbols/min [2025-09-14T20:57:04.252312] [INFO ] [MAIN ] MX: Generated 1352 derivative records from 16829 primary records. [2025-09-14T20:57:04.252979] [INFO ] [MAIN ] MXF: Generated 1352 derivative records from 4251 primary records. [2025-09-14T20:57:04.253233] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:04.253307] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-14T20:57:04.253417] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-14T20:57:04.276626] [DEBUG] [LOCAL ] MXF: Derivative data saved (1352 records). [2025-09-14T20:57:04.280734] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-14T20:57:04.282188] [DEBUG] [LOCAL ] MX: Derivative data saved (1352 records). [2025-09-14T20:57:04.284725] [INFO ] [MAIN ] Derivative Progress: 1361/2226 symbols completed. MXF took 1.0s. Estimated remaining: 5m 4s. Rate: 170.5 symbols/min [2025-09-14T20:57:04.284920] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-14T20:57:04.287456] [INFO ] [MAIN ] Derivative Progress: 1362/2226 symbols completed. MX took 1.0s. Estimated remaining: 5m 4s. Rate: 170.6 symbols/min [2025-09-14T20:57:04.285140] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:04.292111] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:04.292518] [DEBUG] [LOCAL ] MYD: Loaded 9439 existing records from primary storage. [2025-09-14T20:57:04.292944] [INFO ] [MAIN ] MYD: Loaded 9439 primary data records. [2025-09-14T20:57:04.432959] [DEBUG] [LOCAL ] MYI: Loaded 13687 existing records from primary storage. [2025-09-14T20:57:04.443864] [INFO ] [MAIN ] MYI: Loaded 13687 primary data records. [2025-09-14T20:57:04.490450] [DEBUG] [LOCAL ] MYE: Loaded 17877 existing records from primary storage. [2025-09-14T20:57:04.546293] [INFO ] [MAIN ] MYE: Loaded 17877 primary data records. [2025-09-14T20:57:05.212530] [DEBUG] [MAIN ] MYD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:05.214201] [INFO ] [MAIN ] MYD: Generated 1352 derivative records from 9439 primary records. [2025-09-14T20:57:05.214608] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-14T20:57:05.237239] [DEBUG] [LOCAL ] MYD: Derivative data saved (1352 records). [2025-09-14T20:57:05.241461] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-14T20:57:05.241798] [DEBUG] [MAIN ] MYI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:05.243767] [INFO ] [MAIN ] Derivative Progress: 1363/2226 symbols completed. MYD took 1.0s. Estimated remaining: 5m 4s. Rate: 170.4 symbols/min [2025-09-14T20:57:05.244942] [INFO ] [MAIN ] MYI: Generated 1352 derivative records from 13687 primary records. [2025-09-14T20:57:05.245447] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-14T20:57:05.259893] [DEBUG] [LOCAL ] MYI: Derivative data saved (1352 records). [2025-09-14T20:57:05.260165] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-14T20:57:05.262856] [INFO ] [MAIN ] Derivative Progress: 1364/2226 symbols completed. MYI took 1.0s. Estimated remaining: 5m 3s. Rate: 170.5 symbols/min [2025-09-14T20:57:05.272829] [DEBUG] [MAIN ] MYE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:05.273467] [INFO ] [MAIN ] MYE: Generated 1352 derivative records from 17877 primary records. [2025-09-14T20:57:05.273543] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-14T20:57:05.285539] [DEBUG] [LOCAL ] MYE: Derivative data saved (1352 records). [2025-09-14T20:57:05.285697] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-14T20:57:05.287748] [INFO ] [MAIN ] Derivative Progress: 1365/2226 symbols completed. MYE took 1.0s. Estimated remaining: 5m 3s. Rate: 170.6 symbols/min [2025-09-14T20:57:05.288484] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:05.288299] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:05.288351] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:05.301895] [DEBUG] [LOCAL ] MYN: Loaded 7456 existing records from primary storage. [2025-09-14T20:57:05.306429] [INFO ] [MAIN ] MYN: Loaded 7456 primary data records. [2025-09-14T20:57:05.409885] [DEBUG] [LOCAL ] NAC: Loaded 17941 existing records from primary storage. [2025-09-14T20:57:05.426936] [INFO ] [MAIN ] NAC: Loaded 17941 primary data records. [2025-09-14T20:57:05.493598] [DEBUG] [LOCAL ] NABL: Loaded 29693 existing records from primary storage. [2025-09-14T20:57:05.559207] [INFO ] [MAIN ] NABL: Loaded 29693 primary data records. [2025-09-14T20:57:06.196547] [DEBUG] [MAIN ] MYN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:06.198229] [INFO ] [MAIN ] MYN: Generated 1352 derivative records from 7456 primary records. [2025-09-14T20:57:06.208239] [DEBUG] [MAIN ] NAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:06.207876] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-14T20:57:06.208903] [INFO ] [MAIN ] NAC: Generated 1352 derivative records from 17941 primary records. [2025-09-14T20:57:06.210067] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-14T20:57:06.234438] [DEBUG] [LOCAL ] MYN: Derivative data saved (1352 records). [2025-09-14T20:57:06.237018] [DEBUG] [LOCAL ] NAC: Derivative data saved (1352 records). [2025-09-14T20:57:06.237984] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-14T20:57:06.244426] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-14T20:57:06.251185] [INFO ] [MAIN ] Derivative Progress: 1366/2226 symbols completed. MYN took 1.0s. Estimated remaining: 5m 3s. Rate: 170.4 symbols/min [2025-09-14T20:57:06.249126] [DEBUG] [MAIN ] NABL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:06.254396] [INFO ] [MAIN ] Derivative Progress: 1367/2226 symbols completed. NAC took 1.0s. Estimated remaining: 5m 2s. Rate: 170.5 symbols/min [2025-09-14T20:57:06.254329] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:06.255435] [INFO ] [MAIN ] NABL: Generated 1352 derivative records from 29693 primary records. [2025-09-14T20:57:06.255944] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:06.256549] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-14T20:57:06.275991] [DEBUG] [LOCAL ] NAN: Loaded 6288 existing records from primary storage. [2025-09-14T20:57:06.276232] [INFO ] [MAIN ] NAN: Loaded 6288 primary data records. [2025-09-14T20:57:06.384674] [DEBUG] [LOCAL ] NABL: Derivative data saved (1352 records). [2025-09-14T20:57:06.388775] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-14T20:57:06.452968] [INFO ] [MAIN ] Derivative Progress: 1368/2226 symbols completed. NABL took 1.2s. Estimated remaining: 5m 2s. Rate: 170.6 symbols/min [2025-09-14T20:57:06.460274] [DEBUG] [LOCAL ] NAD: Loaded 25561 existing records from primary storage. [2025-09-14T20:57:06.479379] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:06.570407] [INFO ] [MAIN ] NAD: Loaded 25561 primary data records. [2025-09-14T20:57:06.882327] [DEBUG] [LOCAL ] NAT: Loaded 36541 existing records from primary storage. [2025-09-14T20:57:06.895539] [INFO ] [MAIN ] NAT: Loaded 36541 primary data records. [2025-09-14T20:57:07.004277] [DEBUG] [MAIN ] NAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:07.026399] [INFO ] [MAIN ] NAN: Generated 1352 derivative records from 6288 primary records. [2025-09-14T20:57:07.048772] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-14T20:57:07.208269] [DEBUG] [LOCAL ] NAN: Derivative data saved (1352 records). [2025-09-14T20:57:07.208622] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-14T20:57:07.210600] [INFO ] [MAIN ] Derivative Progress: 1369/2226 symbols completed. NAN took 1.0s. Estimated remaining: 5m 2s. Rate: 170.4 symbols/min [2025-09-14T20:57:07.212220] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:07.228842] [DEBUG] [MAIN ] NAD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:07.230127] [INFO ] [MAIN ] NAD: Generated 1352 derivative records from 25561 primary records. [2025-09-14T20:57:07.230561] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-14T20:57:07.249976] [DEBUG] [LOCAL ] NAD: Derivative data saved (1352 records). [2025-09-14T20:57:07.252553] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-14T20:57:07.255874] [INFO ] [MAIN ] Derivative Progress: 1370/2226 symbols completed. NAD took 1.0s. Estimated remaining: 5m 1s. Rate: 170.5 symbols/min [2025-09-14T20:57:07.266899] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:07.275046] [DEBUG] [MAIN ] NAT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:07.277427] [DEBUG] [LOCAL ] NATL: Loaded 24453 existing records from primary storage. [2025-09-14T20:57:07.276545] [INFO ] [MAIN ] NAT: Generated 1352 derivative records from 36541 primary records. [2025-09-14T20:57:07.277778] [INFO ] [MAIN ] NATL: Loaded 24453 primary data records. [2025-09-14T20:57:07.277964] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-14T20:57:07.366899] [DEBUG] [LOCAL ] NAZ: Loaded 1977 existing records from primary storage. [2025-09-14T20:57:07.374245] [INFO ] [MAIN ] NAZ: Loaded 1977 primary data records. [2025-09-14T20:57:07.426580] [DEBUG] [LOCAL ] NAT: Derivative data saved (1352 records). [2025-09-14T20:57:07.444037] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-14T20:57:07.499101] [INFO ] [MAIN ] Derivative Progress: 1371/2226 symbols completed. NAT took 1.0s. Estimated remaining: 5m 1s. Rate: 170.6 symbols/min [2025-09-14T20:57:07.554749] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:07.807839] [DEBUG] [LOCAL ] NBB: Loaded 6533 existing records from primary storage. [2025-09-14T20:57:07.930845] [INFO ] [MAIN ] NBB: Loaded 6533 primary data records. [2025-09-14T20:57:08.241004] [DEBUG] [MAIN ] NATL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:08.244080] [INFO ] [MAIN ] NATL: Generated 1352 derivative records from 24453 primary records. [2025-09-14T20:57:08.244311] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-14T20:57:08.255675] [DEBUG] [MAIN ] NAZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:08.256635] [INFO ] [MAIN ] NAZ: Generated 1352 derivative records from 1977 primary records. [2025-09-14T20:57:08.256959] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-14T20:57:08.279517] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1352 records). [2025-09-14T20:57:08.277136] [DEBUG] [LOCAL ] NATL: Derivative data saved (1352 records). [2025-09-14T20:57:08.279905] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-14T20:57:08.281844] [INFO ] [MAIN ] Derivative Progress: 1372/2226 symbols completed. NATL took 1.1s. Estimated remaining: 5m 1s. Rate: 170.4 symbols/min [2025-09-14T20:57:08.279972] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-14T20:57:08.284716] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:08.284787] [INFO ] [MAIN ] Derivative Progress: 1373/2226 symbols completed. NAZ took 1.0s. Estimated remaining: 5m 0s. Rate: 170.6 symbols/min [2025-09-14T20:57:08.285364] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:08.304955] [DEBUG] [MAIN ] NBB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:08.306133] [INFO ] [MAIN ] NBB: Generated 1352 derivative records from 6533 primary records. [2025-09-14T20:57:08.306358] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-14T20:57:08.323364] [DEBUG] [LOCAL ] NBB: Derivative data saved (1352 records). [2025-09-14T20:57:08.335526] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-14T20:57:08.338661] [INFO ] [MAIN ] Derivative Progress: 1374/2226 symbols completed. NBB took 0.8s. Estimated remaining: 4m 60s. Rate: 170.7 symbols/min [2025-09-14T20:57:08.339233] [DEBUG] [LOCAL ] NBHC: Loaded 16605 existing records from primary storage. [2025-09-14T20:57:08.339814] [INFO ] [MAIN ] NBHC: Loaded 16605 primary data records. [2025-09-14T20:57:08.339741] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:08.432291] [DEBUG] [LOCAL ] NBR: Loaded 26348 existing records from primary storage. [2025-09-14T20:57:08.460523] [INFO ] [MAIN ] NBR: Loaded 26348 primary data records. [2025-09-14T20:57:08.659571] [DEBUG] [LOCAL ] NBXG: Loaded 16249 existing records from primary storage. [2025-09-14T20:57:08.771847] [INFO ] [MAIN ] NBXG: Loaded 16249 primary data records. [2025-09-14T20:57:09.228684] [DEBUG] [MAIN ] NBHC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:09.230230] [INFO ] [MAIN ] NBHC: Generated 1352 derivative records from 16605 primary records. [2025-09-14T20:57:09.230499] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-14T20:57:09.246994] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1352 records). [2025-09-14T20:57:09.248256] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-14T20:57:09.251931] [INFO ] [MAIN ] Derivative Progress: 1375/2226 symbols completed. NBHC took 1.0s. Estimated remaining: 4m 60s. Rate: 170.5 symbols/min [2025-09-14T20:57:09.252376] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:09.264025] [DEBUG] [MAIN ] NBR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:09.265795] [INFO ] [MAIN ] NBR: Generated 1352 derivative records from 26348 primary records. [2025-09-14T20:57:09.266088] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-14T20:57:09.267909] [DEBUG] [LOCAL ] NC: Loaded 1225 existing records from primary storage. [2025-09-14T20:57:09.269181] [INFO ] [MAIN ] NC: Loaded 1225 primary data records. [2025-09-14T20:57:09.400287] [DEBUG] [MAIN ] NBXG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:09.401231] [INFO ] [MAIN ] NBXG: Generated 1352 derivative records from 16249 primary records. [2025-09-14T20:57:09.399762] [DEBUG] [LOCAL ] NBR: Derivative data saved (1352 records). [2025-09-14T20:57:09.422092] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-14T20:57:09.454297] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-14T20:57:09.572524] [INFO ] [MAIN ] Derivative Progress: 1376/2226 symbols completed. NBR took 1.3s. Estimated remaining: 4m 59s. Rate: 170.5 symbols/min [2025-09-14T20:57:09.582736] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:09.587612] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1352 records). [2025-09-14T20:57:09.588092] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-14T20:57:09.590930] [INFO ] [MAIN ] Derivative Progress: 1377/2226 symbols completed. NBXG took 1.3s. Estimated remaining: 4m 59s. Rate: 170.6 symbols/min [2025-09-14T20:57:09.593391] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:09.599918] [DEBUG] [LOCAL ] NCA: Loaded 7389 existing records from primary storage. [2025-09-14T20:57:09.600089] [INFO ] [MAIN ] NCA: Loaded 7389 primary data records. [2025-09-14T20:57:09.717700] [DEBUG] [LOCAL ] NCDL: Loaded 15159 existing records from primary storage. [2025-09-14T20:57:09.723351] [INFO ] [MAIN ] NCDL: Loaded 15159 primary data records. [2025-09-14T20:57:10.012687] [DEBUG] [MAIN ] NC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:10.036011] [INFO ] [MAIN ] NC: Generated 1352 derivative records from 1225 primary records. [2025-09-14T20:57:10.094606] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-14T20:57:10.252331] [DEBUG] [LOCAL ] NC: Derivative data saved (1352 records). [2025-09-14T20:57:10.253890] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-14T20:57:10.256842] [INFO ] [MAIN ] Derivative Progress: 1378/2226 symbols completed. NC took 1.0s. Estimated remaining: 4m 58s. Rate: 170.5 symbols/min [2025-09-14T20:57:10.272743] [DEBUG] [MAIN ] NCA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:10.273703] [INFO ] [MAIN ] NCA: Generated 1352 derivative records from 7389 primary records. [2025-09-14T20:57:10.273955] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-14T20:57:10.289037] [DEBUG] [LOCAL ] NCA: Derivative data saved (1352 records). [2025-09-14T20:57:10.299279] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-14T20:57:10.299564] [DEBUG] [MAIN ] NCDL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:10.302482] [INFO ] [MAIN ] Derivative Progress: 1379/2226 symbols completed. NCA took 0.7s. Estimated remaining: 4m 58s. Rate: 170.6 symbols/min [2025-09-14T20:57:10.303412] [INFO ] [MAIN ] NCDL: Generated 1352 derivative records from 15159 primary records. [2025-09-14T20:57:10.303681] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-14T20:57:10.321760] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1352 records). [2025-09-14T20:57:10.321952] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-14T20:57:10.324133] [INFO ] [MAIN ] Derivative Progress: 1380/2226 symbols completed. NCDL took 0.7s. Estimated remaining: 4m 57s. Rate: 170.7 symbols/min [2025-09-14T20:57:10.324880] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:10.324776] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:10.325000] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:10.339697] [DEBUG] [LOCAL ] NCZ: Loaded 8192 existing records from primary storage. [2025-09-14T20:57:10.339989] [INFO ] [MAIN ] NCZ: Loaded 8192 primary data records. [2025-09-14T20:57:10.403245] [DEBUG] [LOCAL ] NCV: Loaded 9633 existing records from primary storage. [2025-09-14T20:57:10.461953] [INFO ] [MAIN ] NCV: Loaded 9633 primary data records. [2025-09-14T20:57:10.775569] [DEBUG] [LOCAL ] NCLH: Loaded 40493 existing records from primary storage. [2025-09-14T20:57:10.831944] [INFO ] [MAIN ] NCLH: Loaded 40493 primary data records. [2025-09-14T20:57:11.241873] [DEBUG] [MAIN ] NCZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:11.243889] [INFO ] [MAIN ] NCZ: Generated 1352 derivative records from 8192 primary records. [2025-09-14T20:57:11.244636] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-14T20:57:11.260929] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1352 records). [2025-09-14T20:57:11.261290] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-14T20:57:11.265264] [INFO ] [MAIN ] Derivative Progress: 1381/2226 symbols completed. NCZ took 0.9s. Estimated remaining: 4m 57s. Rate: 170.5 symbols/min [2025-09-14T20:57:11.267006] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:11.279999] [DEBUG] [MAIN ] NCV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:11.280958] [INFO ] [MAIN ] NCV: Generated 1352 derivative records from 9633 primary records. [2025-09-14T20:57:11.281311] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-14T20:57:11.307598] [DEBUG] [LOCAL ] NDMO: Loaded 12663 existing records from primary storage. [2025-09-14T20:57:11.308196] [INFO ] [MAIN ] NDMO: Loaded 12663 primary data records. [2025-09-14T20:57:11.307308] [DEBUG] [LOCAL ] NCV: Derivative data saved (1352 records). [2025-09-14T20:57:11.309553] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-14T20:57:11.341593] [INFO ] [MAIN ] Derivative Progress: 1382/2226 symbols completed. NCV took 1.0s. Estimated remaining: 4m 57s. Rate: 170.6 symbols/min [2025-09-14T20:57:11.400533] [DEBUG] [MAIN ] NCLH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:11.441120] [INFO ] [MAIN ] NCLH: Generated 1352 derivative records from 40493 primary records. [2025-09-14T20:57:11.411181] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:11.462516] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-14T20:57:11.626199] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1352 records). [2025-09-14T20:57:11.626903] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-14T20:57:11.628857] [INFO ] [MAIN ] Derivative Progress: 1383/2226 symbols completed. NCLH took 1.3s. Estimated remaining: 4m 56s. Rate: 170.6 symbols/min [2025-09-14T20:57:11.629353] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:11.648425] [DEBUG] [MAIN ] NDMO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:11.649379] [INFO ] [MAIN ] NDMO: Generated 1352 derivative records from 12663 primary records. [2025-09-14T20:57:11.649621] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-14T20:57:11.681208] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1352 records). [2025-09-14T20:57:11.689938] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-14T20:57:11.690539] [DEBUG] [LOCAL ] NEA: Loaded 26449 existing records from primary storage. [2025-09-14T20:57:11.690669] [INFO ] [MAIN ] NEA: Loaded 26449 primary data records. [2025-09-14T20:57:11.702779] [INFO ] [MAIN ] Derivative Progress: 1384/2226 symbols completed. NDMO took 0.4s. Estimated remaining: 4m 56s. Rate: 170.7 symbols/min [2025-09-14T20:57:11.715434] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:11.755217] [DEBUG] [LOCAL ] NE: Loaded 39328 existing records from primary storage. [2025-09-14T20:57:11.791121] [INFO ] [MAIN ] NE: Loaded 39328 primary data records. [2025-09-14T20:57:12.289337] [DEBUG] [LOCAL ] NEE: Loaded 40447 existing records from primary storage. [2025-09-14T20:57:12.290490] [INFO ] [MAIN ] NEE: Loaded 40447 primary data records. [2025-09-14T20:57:12.475693] [DEBUG] [MAIN ] NEA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:12.499475] [INFO ] [MAIN ] NEA: Generated 1352 derivative records from 26449 primary records. [2025-09-14T20:57:12.640819] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-14T20:57:12.670455] [DEBUG] [LOCAL ] NEA: Derivative data saved (1352 records). [2025-09-14T20:57:12.671196] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-14T20:57:12.673504] [INFO ] [MAIN ] Derivative Progress: 1385/2226 symbols completed. NEA took 1.0s. Estimated remaining: 4m 56s. Rate: 170.5 symbols/min [2025-09-14T20:57:12.674293] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:12.690635] [DEBUG] [MAIN ] NE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:12.691547] [INFO ] [MAIN ] NE: Generated 1352 derivative records from 39328 primary records. [2025-09-14T20:57:12.692126] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-14T20:57:12.705870] [DEBUG] [LOCAL ] NE: Derivative data saved (1352 records). [2025-09-14T20:57:12.706022] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-14T20:57:12.709074] [INFO ] [MAIN ] Derivative Progress: 1386/2226 symbols completed. NE took 1.3s. Estimated remaining: 4m 55s. Rate: 170.6 symbols/min [2025-09-14T20:57:12.709563] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:12.724056] [DEBUG] [MAIN ] NEE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:12.724928] [INFO ] [MAIN ] NEE: Generated 1352 derivative records from 40447 primary records. [2025-09-14T20:57:12.725098] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-14T20:57:12.747292] [DEBUG] [LOCAL ] NEE: Derivative data saved (1352 records). [2025-09-14T20:57:12.747685] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-14T20:57:12.749584] [INFO ] [MAIN ] Derivative Progress: 1387/2226 symbols completed. NEE took 1.0s. Estimated remaining: 4m 55s. Rate: 170.7 symbols/min [2025-09-14T20:57:12.750092] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:12.767476] [DEBUG] [LOCAL ] NEM: Loaded 40448 existing records from primary storage. [2025-09-14T20:57:12.769796] [INFO ] [MAIN ] NEM: Loaded 40448 primary data records. [2025-09-14T20:57:12.875391] [DEBUG] [LOCAL ] NEU: Loaded 6817 existing records from primary storage. [2025-09-14T20:57:12.887171] [INFO ] [MAIN ] NEU: Loaded 6817 primary data records. [2025-09-14T20:57:13.019081] [DEBUG] [LOCAL ] NET: Loaded 39881 existing records from primary storage. [2025-09-14T20:57:13.072135] [INFO ] [MAIN ] NET: Loaded 39881 primary data records. [2025-09-14T20:57:13.669278] [DEBUG] [MAIN ] NEM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:13.670442] [INFO ] [MAIN ] NEM: Generated 1352 derivative records from 40448 primary records. [2025-09-14T20:57:13.671865] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-14T20:57:13.686613] [DEBUG] [LOCAL ] NEM: Derivative data saved (1352 records). [2025-09-14T20:57:13.688538] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-14T20:57:13.690605] [INFO ] [MAIN ] Derivative Progress: 1388/2226 symbols completed. NEM took 1.0s. Estimated remaining: 4m 55s. Rate: 170.5 symbols/min [2025-09-14T20:57:13.701900] [DEBUG] [MAIN ] NEU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:13.701412] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:13.702909] [INFO ] [MAIN ] NEU: Generated 1352 derivative records from 6817 primary records. [2025-09-14T20:57:13.703007] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-14T20:57:13.727482] [DEBUG] [LOCAL ] NEUE: Loaded 1229 existing records from primary storage. [2025-09-14T20:57:13.729194] [DEBUG] [MAIN ] NET: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:13.729491] [INFO ] [MAIN ] NEUE: Loaded 1229 primary data records. [2025-09-14T20:57:13.736943] [INFO ] [MAIN ] NET: Generated 1352 derivative records from 39881 primary records. [2025-09-14T20:57:13.754361] [DEBUG] [LOCAL ] NEU: Derivative data saved (1352 records). [2025-09-14T20:57:13.777597] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-14T20:57:13.805251] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-14T20:57:13.843331] [INFO ] [MAIN ] Derivative Progress: 1389/2226 symbols completed. NEU took 1.1s. Estimated remaining: 4m 54s. Rate: 170.6 symbols/min [2025-09-14T20:57:13.870888] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:13.871751] [DEBUG] [LOCAL ] NET: Derivative data saved (1352 records). [2025-09-14T20:57:13.877311] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-14T20:57:13.885335] [INFO ] [MAIN ] Derivative Progress: 1390/2226 symbols completed. NET took 1.2s. Estimated remaining: 4m 54s. Rate: 170.7 symbols/min [2025-09-14T20:57:13.957613] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:13.957715] [DEBUG] [LOCAL ] NEXA: Loaded 2867 existing records from primary storage. [2025-09-14T20:57:14.042061] [INFO ] [MAIN ] NEXA: Loaded 2867 primary data records. [2025-09-14T20:57:14.254022] [DEBUG] [LOCAL ] NFG: Loaded 28591 existing records from primary storage. [2025-09-14T20:57:14.342840] [INFO ] [MAIN ] NFG: Loaded 28591 primary data records. [2025-09-14T20:57:14.473177] [DEBUG] [MAIN ] NEUE: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:57:14.515393] [INFO ] [MAIN ] NEUE: Generated 1351 derivative records from 1229 primary records. [2025-09-14T20:57:14.553845] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-14T20:57:14.661775] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1351 records). [2025-09-14T20:57:14.662677] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-14T20:57:14.665056] [INFO ] [MAIN ] Derivative Progress: 1391/2226 symbols completed. NEUE took 1.0s. Estimated remaining: 4m 54s. Rate: 170.5 symbols/min [2025-09-14T20:57:14.676139] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:14.675566] [DEBUG] [MAIN ] NEXA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:14.677842] [INFO ] [MAIN ] NEXA: Generated 1352 derivative records from 2867 primary records. [2025-09-14T20:57:14.678357] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-14T20:57:14.690441] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1352 records). [2025-09-14T20:57:14.690632] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-14T20:57:14.693011] [INFO ] [MAIN ] Derivative Progress: 1392/2226 symbols completed. NEXA took 0.8s. Estimated remaining: 4m 53s. Rate: 170.6 symbols/min [2025-09-14T20:57:14.693743] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:14.717820] [DEBUG] [MAIN ] NFG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:14.718291] [DEBUG] [LOCAL ] NFJ: Loaded 14566 existing records from primary storage. [2025-09-14T20:57:14.719042] [INFO ] [MAIN ] NFG: Generated 1352 derivative records from 28591 primary records. [2025-09-14T20:57:14.719131] [INFO ] [MAIN ] NFJ: Loaded 14566 primary data records. [2025-09-14T20:57:14.719341] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-14T20:57:14.966872] [DEBUG] [LOCAL ] NFG: Derivative data saved (1352 records). [2025-09-14T20:57:15.065231] [DEBUG] [LOCAL ] NGG: Loaded 35319 existing records from primary storage. [2025-09-14T20:57:15.065413] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-14T20:57:15.080027] [INFO ] [MAIN ] NGG: Loaded 35319 primary data records. [2025-09-14T20:57:15.082161] [INFO ] [MAIN ] Derivative Progress: 1393/2226 symbols completed. NFG took 1.1s. Estimated remaining: 4m 53s. Rate: 170.6 symbols/min [2025-09-14T20:57:15.390314] [DEBUG] [MAIN ] NFJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:15.392511] [INFO ] [MAIN ] NFJ: Generated 1352 derivative records from 14566 primary records. [2025-09-14T20:57:15.392813] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-14T20:57:15.407695] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1352 records). [2025-09-14T20:57:15.407945] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-14T20:57:15.410208] [INFO ] [MAIN ] Derivative Progress: 1394/2226 symbols completed. NFJ took 0.7s. Estimated remaining: 4m 53s. Rate: 170.6 symbols/min [2025-09-14T20:57:15.424069] [DEBUG] [MAIN ] NGG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:15.424804] [INFO ] [MAIN ] NGG: Generated 1352 derivative records from 35319 primary records. [2025-09-14T20:57:15.424887] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-14T20:57:15.437190] [DEBUG] [LOCAL ] NGG: Derivative data saved (1352 records). [2025-09-14T20:57:15.437268] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-14T20:57:15.439850] [INFO ] [MAIN ] Derivative Progress: 1395/2226 symbols completed. NGG took 0.7s. Estimated remaining: 4m 52s. Rate: 170.8 symbols/min [2025-09-14T20:57:15.440733] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:15.440962] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:15.440831] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:15.455435] [DEBUG] [LOCAL ] NGS: Loaded 8254 existing records from primary storage. [2025-09-14T20:57:15.455853] [INFO ] [MAIN ] NGS: Loaded 8254 primary data records. [2025-09-14T20:57:15.575768] [DEBUG] [LOCAL ] NGVC: Loaded 17464 existing records from primary storage. [2025-09-14T20:57:15.588249] [DEBUG] [LOCAL ] NGL: Loaded 23004 existing records from primary storage. [2025-09-14T20:57:15.593929] [INFO ] [MAIN ] NGL: Loaded 23004 primary data records. [2025-09-14T20:57:15.593671] [INFO ] [MAIN ] NGVC: Loaded 17464 primary data records. [2025-09-14T20:57:16.364317] [DEBUG] [MAIN ] NGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:16.365804] [INFO ] [MAIN ] NGS: Generated 1352 derivative records from 8254 primary records. [2025-09-14T20:57:16.367033] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-14T20:57:16.394219] [DEBUG] [MAIN ] NGL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:16.405098] [INFO ] [MAIN ] NGL: Generated 1352 derivative records from 23004 primary records. [2025-09-14T20:57:16.394290] [DEBUG] [LOCAL ] NGS: Derivative data saved (1352 records). [2025-09-14T20:57:16.405281] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-14T20:57:16.405356] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-14T20:57:16.407171] [DEBUG] [MAIN ] NGVC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:16.414728] [INFO ] [MAIN ] Derivative Progress: 1396/2226 symbols completed. NGS took 1.0s. Estimated remaining: 4m 52s. Rate: 170.5 symbols/min [2025-09-14T20:57:16.415761] [INFO ] [MAIN ] NGVC: Generated 1352 derivative records from 17464 primary records. [2025-09-14T20:57:16.417215] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-14T20:57:16.415996] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:16.429930] [DEBUG] [LOCAL ] NGL: Derivative data saved (1352 records). [2025-09-14T20:57:16.435962] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1352 records). [2025-09-14T20:57:16.436053] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-14T20:57:16.436151] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-14T20:57:16.438261] [INFO ] [MAIN ] Derivative Progress: 1397/2226 symbols completed. NGVC took 1.0s. Estimated remaining: 4m 51s. Rate: 170.7 symbols/min [2025-09-14T20:57:16.438546] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:16.441182] [INFO ] [MAIN ] Derivative Progress: 1398/2226 symbols completed. NGL took 1.0s. Estimated remaining: 4m 51s. Rate: 170.8 symbols/min [2025-09-14T20:57:16.442075] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:16.459850] [DEBUG] [LOCAL ] NGVT: Loaded 18193 existing records from primary storage. [2025-09-14T20:57:16.463835] [INFO ] [MAIN ] NGVT: Loaded 18193 primary data records. [2025-09-14T20:57:16.561850] [DEBUG] [LOCAL ] NHI: Loaded 16738 existing records from primary storage. [2025-09-14T20:57:16.597378] [INFO ] [MAIN ] NHI: Loaded 16738 primary data records. [2025-09-14T20:57:16.919878] [DEBUG] [LOCAL ] NI: Loaded 40187 existing records from primary storage. [2025-09-14T20:57:16.940304] [INFO ] [MAIN ] NI: Loaded 40187 primary data records. [2025-09-14T20:57:17.453579] [DEBUG] [MAIN ] NGVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:17.454961] [INFO ] [MAIN ] NGVT: Generated 1352 derivative records from 18193 primary records. [2025-09-14T20:57:17.455498] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-14T20:57:17.475591] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1352 records). [2025-09-14T20:57:17.477205] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-14T20:57:17.486331] [INFO ] [MAIN ] Derivative Progress: 1399/2226 symbols completed. NGVT took 1.1s. Estimated remaining: 4m 51s. Rate: 170.5 symbols/min [2025-09-14T20:57:17.490867] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:17.491904] [DEBUG] [MAIN ] NHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:17.493622] [INFO ] [MAIN ] NHI: Generated 1352 derivative records from 16738 primary records. [2025-09-14T20:57:17.494185] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-14T20:57:17.513232] [DEBUG] [LOCAL ] NHI: Derivative data saved (1352 records). [2025-09-14T20:57:17.513815] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-14T20:57:17.516734] [INFO ] [MAIN ] Derivative Progress: 1400/2226 symbols completed. NHI took 1.1s. Estimated remaining: 4m 50s. Rate: 170.6 symbols/min [2025-09-14T20:57:17.521175] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:17.521381] [DEBUG] [LOCAL ] NIC: Loaded 6573 existing records from primary storage. [2025-09-14T20:57:17.533267] [INFO ] [MAIN ] NIC: Loaded 6573 primary data records. [2025-09-14T20:57:17.534079] [DEBUG] [MAIN ] NI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:17.575075] [INFO ] [MAIN ] NI: Generated 1352 derivative records from 40187 primary records. [2025-09-14T20:57:17.607751] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-09-14T20:57:17.660457] [DEBUG] [LOCAL ] NIE: Loaded 8228 existing records from primary storage. [2025-09-14T20:57:17.679485] [INFO ] [MAIN ] NIE: Loaded 8228 primary data records. [2025-09-14T20:57:17.729376] [DEBUG] [LOCAL ] NI: Derivative data saved (1352 records). [2025-09-14T20:57:17.748293] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-14T20:57:17.789067] [INFO ] [MAIN ] Derivative Progress: 1401/2226 symbols completed. NI took 1.3s. Estimated remaining: 4m 50s. Rate: 170.7 symbols/min [2025-09-14T20:57:17.934110] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:18.035006] [DEBUG] [LOCAL ] NIM: Loaded 2843 existing records from primary storage. [2025-09-14T20:57:18.123677] [INFO ] [MAIN ] NIM: Loaded 2843 primary data records. [2025-09-14T20:57:18.450633] [DEBUG] [MAIN ] NIC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:18.453294] [INFO ] [MAIN ] NIC: Generated 1352 derivative records from 6573 primary records. [2025-09-14T20:57:18.453967] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-14T20:57:18.466107] [DEBUG] [MAIN ] NIE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:18.477490] [INFO ] [MAIN ] NIE: Generated 1352 derivative records from 8228 primary records. [2025-09-14T20:57:18.479398] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-14T20:57:18.480794] [DEBUG] [LOCAL ] NIC: Derivative data saved (1352 records). [2025-09-14T20:57:18.482021] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-14T20:57:18.484257] [INFO ] [MAIN ] Derivative Progress: 1402/2226 symbols completed. NIC took 1.0s. Estimated remaining: 4m 50s. Rate: 170.6 symbols/min [2025-09-14T20:57:18.494279] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:18.499992] [DEBUG] [LOCAL ] NIE: Derivative data saved (1352 records). [2025-09-14T20:57:18.501251] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-14T20:57:18.504496] [INFO ] [MAIN ] Derivative Progress: 1403/2226 symbols completed. NIE took 1.0s. Estimated remaining: 4m 49s. Rate: 170.7 symbols/min [2025-09-14T20:57:18.505005] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:18.516441] [DEBUG] [MAIN ] NIM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:18.517313] [INFO ] [MAIN ] NIM: Generated 1352 derivative records from 2843 primary records. [2025-09-14T20:57:18.517468] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-14T20:57:18.535326] [DEBUG] [LOCAL ] NIM: Derivative data saved (1352 records). [2025-09-14T20:57:18.535795] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-14T20:57:18.537963] [INFO ] [MAIN ] Derivative Progress: 1404/2226 symbols completed. NIM took 0.6s. Estimated remaining: 4m 49s. Rate: 170.8 symbols/min [2025-09-14T20:57:18.538305] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:18.548236] [DEBUG] [LOCAL ] NINE: Loaded 22068 existing records from primary storage. [2025-09-14T20:57:18.548590] [INFO ] [MAIN ] NINE: Loaded 22068 primary data records. [2025-09-14T20:57:18.735194] [DEBUG] [LOCAL ] NIO: Loaded 40542 existing records from primary storage. [2025-09-14T20:57:18.783348] [INFO ] [MAIN ] NIO: Loaded 40542 primary data records. [2025-09-14T20:57:18.873237] [DEBUG] [LOCAL ] NJR: Loaded 28259 existing records from primary storage. [2025-09-14T20:57:18.905239] [INFO ] [MAIN ] NJR: Loaded 28259 primary data records. [2025-09-14T20:57:19.542480] [DEBUG] [MAIN ] NINE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:19.544716] [INFO ] [MAIN ] NINE: Generated 1352 derivative records from 22068 primary records. [2025-09-14T20:57:19.546667] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-14T20:57:19.580738] [DEBUG] [LOCAL ] NINE: Derivative data saved (1352 records). [2025-09-14T20:57:19.582038] [DEBUG] [MAIN ] NIO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:19.583379] [INFO ] [MAIN ] NIO: Generated 1352 derivative records from 40542 primary records. [2025-09-14T20:57:19.583543] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-14T20:57:19.583635] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-14T20:57:19.586480] [INFO ] [MAIN ] Derivative Progress: 1405/2226 symbols completed. NINE took 1.1s. Estimated remaining: 4m 49s. Rate: 170.5 symbols/min [2025-09-14T20:57:19.598793] [DEBUG] [MAIN ] NJR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:19.599198] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:19.605661] [INFO ] [MAIN ] NJR: Generated 1352 derivative records from 28259 primary records. [2025-09-14T20:57:19.610303] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-14T20:57:19.616660] [DEBUG] [LOCAL ] NIO: Derivative data saved (1352 records). [2025-09-14T20:57:19.625372] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-14T20:57:19.627854] [INFO ] [MAIN ] Derivative Progress: 1406/2226 symbols completed. NIO took 1.1s. Estimated remaining: 4m 48s. Rate: 170.6 symbols/min [2025-09-14T20:57:19.631572] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:19.639712] [DEBUG] [LOCAL ] NKX: Loaded 10334 existing records from primary storage. [2025-09-14T20:57:19.640766] [INFO ] [MAIN ] NKX: Loaded 10334 primary data records. [2025-09-14T20:57:19.654594] [DEBUG] [LOCAL ] NJR: Derivative data saved (1352 records). [2025-09-14T20:57:19.699720] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-14T20:57:19.719852] [DEBUG] [LOCAL ] NLOP: Loaded 8503 existing records from primary storage. [2025-09-14T20:57:19.747519] [INFO ] [MAIN ] NLOP: Loaded 8503 primary data records. [2025-09-14T20:57:19.735232] [INFO ] [MAIN ] Derivative Progress: 1407/2226 symbols completed. NJR took 1.2s. Estimated remaining: 4m 48s. Rate: 170.7 symbols/min [2025-09-14T20:57:19.779842] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:20.230953] [DEBUG] [MAIN ] NKX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:20.232767] [INFO ] [MAIN ] NKX: Generated 1352 derivative records from 10334 primary records. [2025-09-14T20:57:20.233306] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-14T20:57:20.250486] [DEBUG] [LOCAL ] NKX: Derivative data saved (1352 records). [2025-09-14T20:57:20.262656] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-14T20:57:20.264553] [INFO ] [MAIN ] Derivative Progress: 1408/2226 symbols completed. NKX took 0.7s. Estimated remaining: 4m 48s. Rate: 170.7 symbols/min [2025-09-14T20:57:20.265945] [DEBUG] [LOCAL ] NLY: Loaded 40330 existing records from primary storage. [2025-09-14T20:57:20.266427] [INFO ] [MAIN ] NLY: Loaded 40330 primary data records. [2025-09-14T20:57:20.463477] [DEBUG] [MAIN ] NLOP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:20.469499] [INFO ] [MAIN ] NLOP: Generated 1352 derivative records from 8503 primary records. [2025-09-14T20:57:20.558055] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-14T20:57:20.572567] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1352 records). [2025-09-14T20:57:20.573081] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-14T20:57:20.576043] [INFO ] [MAIN ] Derivative Progress: 1409/2226 symbols completed. NLOP took 0.9s. Estimated remaining: 4m 47s. Rate: 170.7 symbols/min [2025-09-14T20:57:20.592269] [DEBUG] [MAIN ] NLY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:20.593012] [INFO ] [MAIN ] NLY: Generated 1352 derivative records from 40330 primary records. [2025-09-14T20:57:20.593090] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-14T20:57:20.605333] [DEBUG] [LOCAL ] NLY: Derivative data saved (1352 records). [2025-09-14T20:57:20.605450] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-14T20:57:20.607570] [INFO ] [MAIN ] Derivative Progress: 1410/2226 symbols completed. NLY took 0.8s. Estimated remaining: 4m 47s. Rate: 170.8 symbols/min [2025-09-14T20:57:20.608191] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:20.608348] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:20.608719] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:20.616467] [DEBUG] [LOCAL ] NMG: Loaded 5919 existing records from primary storage. [2025-09-14T20:57:20.618851] [INFO ] [MAIN ] NMG: Loaded 5919 primary data records. [2025-09-14T20:57:20.741076] [DEBUG] [LOCAL ] NMAI: Loaded 9356 existing records from primary storage. [2025-09-14T20:57:20.745621] [INFO ] [MAIN ] NMAI: Loaded 9356 primary data records. [2025-09-14T20:57:20.745253] [DEBUG] [LOCAL ] NMCO: Loaded 12649 existing records from primary storage. [2025-09-14T20:57:20.772539] [INFO ] [MAIN ] NMCO: Loaded 12649 primary data records. [2025-09-14T20:57:21.508111] [DEBUG] [MAIN ] NMG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:21.509320] [INFO ] [MAIN ] NMG: Generated 1352 derivative records from 5919 primary records. [2025-09-14T20:57:21.510972] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-14T20:57:21.535408] [DEBUG] [MAIN ] NMAI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:21.535476] [DEBUG] [LOCAL ] NMG: Derivative data saved (1352 records). [2025-09-14T20:57:21.536968] [INFO ] [MAIN ] NMAI: Generated 1352 derivative records from 9356 primary records. [2025-09-14T20:57:21.537072] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-14T20:57:21.537150] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-14T20:57:21.539790] [INFO ] [MAIN ] Derivative Progress: 1411/2226 symbols completed. NMG took 0.9s. Estimated remaining: 4m 47s. Rate: 170.6 symbols/min [2025-09-14T20:57:21.540242] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:21.559830] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1352 records). [2025-09-14T20:57:21.562711] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-14T20:57:21.565539] [INFO ] [MAIN ] Derivative Progress: 1412/2226 symbols completed. NMAI took 1.0s. Estimated remaining: 4m 46s. Rate: 170.7 symbols/min [2025-09-14T20:57:21.562957] [DEBUG] [LOCAL ] NMI: Loaded 3384 existing records from primary storage. [2025-09-14T20:57:21.566076] [INFO ] [MAIN ] NMI: Loaded 3384 primary data records. [2025-09-14T20:57:21.577097] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:21.583076] [DEBUG] [MAIN ] NMCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:21.638345] [INFO ] [MAIN ] NMCO: Generated 1352 derivative records from 12649 primary records. [2025-09-14T20:57:21.680815] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-14T20:57:21.728327] [DEBUG] [LOCAL ] NMM: Loaded 10048 existing records from primary storage. [2025-09-14T20:57:21.742003] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1352 records). [2025-09-14T20:57:21.768810] [INFO ] [MAIN ] NMM: Loaded 10048 primary data records. [2025-09-14T20:57:21.795696] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-14T20:57:21.982049] [INFO ] [MAIN ] Derivative Progress: 1413/2226 symbols completed. NMCO took 1.4s. Estimated remaining: 4m 46s. Rate: 170.7 symbols/min [2025-09-14T20:57:22.014555] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:22.255130] [DEBUG] [LOCAL ] NMR: Loaded 25901 existing records from primary storage. [2025-09-14T20:57:22.256745] [INFO ] [MAIN ] NMR: Loaded 25901 primary data records. [2025-09-14T20:57:22.372120] [DEBUG] [MAIN ] NMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:22.379374] [INFO ] [MAIN ] NMI: Generated 1352 derivative records from 3384 primary records. [2025-09-14T20:57:22.379904] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-14T20:57:22.475484] [DEBUG] [LOCAL ] NMI: Derivative data saved (1352 records). [2025-09-14T20:57:22.477259] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-14T20:57:22.568418] [INFO ] [MAIN ] Derivative Progress: 1414/2226 symbols completed. NMI took 1.0s. Estimated remaining: 4m 46s. Rate: 170.6 symbols/min [2025-09-14T20:57:22.575594] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:22.581705] [DEBUG] [MAIN ] NMM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:22.582995] [INFO ] [MAIN ] NMM: Generated 1352 derivative records from 10048 primary records. [2025-09-14T20:57:22.584178] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-14T20:57:22.595888] [DEBUG] [LOCAL ] NMS: Loaded 2290 existing records from primary storage. [2025-09-14T20:57:22.599095] [INFO ] [MAIN ] NMS: Loaded 2290 primary data records. [2025-09-14T20:57:22.637527] [DEBUG] [LOCAL ] NMM: Derivative data saved (1352 records). [2025-09-14T20:57:22.656284] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-14T20:57:22.704148] [INFO ] [MAIN ] Derivative Progress: 1415/2226 symbols completed. NMM took 1.1s. Estimated remaining: 4m 45s. Rate: 170.7 symbols/min [2025-09-14T20:57:22.708730] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:22.880536] [DEBUG] [LOCAL ] NMT: Loaded 2165 existing records from primary storage. [2025-09-14T20:57:22.880834] [INFO ] [MAIN ] NMT: Loaded 2165 primary data records. [2025-09-14T20:57:22.999147] [DEBUG] [MAIN ] NMR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:23.026098] [INFO ] [MAIN ] NMR: Generated 1352 derivative records from 25901 primary records. [2025-09-14T20:57:23.066383] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-14T20:57:23.213292] [DEBUG] [LOCAL ] NMR: Derivative data saved (1352 records). [2025-09-14T20:57:23.223120] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-14T20:57:23.224933] [INFO ] [MAIN ] Derivative Progress: 1416/2226 symbols completed. NMR took 1.2s. Estimated remaining: 4m 45s. Rate: 170.6 symbols/min [2025-09-14T20:57:23.227088] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:23.242805] [DEBUG] [MAIN ] NMS: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T20:57:23.244087] [INFO ] [MAIN ] NMS: Generated 1350 derivative records from 2290 primary records. [2025-09-14T20:57:23.244348] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-14T20:57:23.265534] [DEBUG] [LOCAL ] NMS: Derivative data saved (1350 records). [2025-09-14T20:57:23.265774] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-14T20:57:23.269498] [INFO ] [MAIN ] Derivative Progress: 1417/2226 symbols completed. NMS took 0.7s. Estimated remaining: 4m 44s. Rate: 170.7 symbols/min [2025-09-14T20:57:23.270185] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:23.278036] [DEBUG] [LOCAL ] NMZ: Loaded 15769 existing records from primary storage. [2025-09-14T20:57:23.278731] [INFO ] [MAIN ] NMZ: Loaded 15769 primary data records. [2025-09-14T20:57:23.380952] [DEBUG] [LOCAL ] NNI: Loaded 7915 existing records from primary storage. [2025-09-14T20:57:23.392410] [INFO ] [MAIN ] NNI: Loaded 7915 primary data records. [2025-09-14T20:57:23.469662] [DEBUG] [MAIN ] NMT: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T20:57:23.583896] [INFO ] [MAIN ] NMT: Generated 1350 derivative records from 2165 primary records. [2025-09-14T20:57:23.652871] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-14T20:57:23.817992] [DEBUG] [LOCAL ] NMT: Derivative data saved (1350 records). [2025-09-14T20:57:23.916264] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-14T20:57:23.920592] [INFO ] [MAIN ] Derivative Progress: 1418/2226 symbols completed. NMT took 1.2s. Estimated remaining: 4m 44s. Rate: 170.6 symbols/min [2025-09-14T20:57:23.922003] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:23.953055] [DEBUG] [MAIN ] NMZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:23.954663] [INFO ] [MAIN ] NMZ: Generated 1352 derivative records from 15769 primary records. [2025-09-14T20:57:23.956531] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-14T20:57:23.992477] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1352 records). [2025-09-14T20:57:23.999126] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-14T20:57:24.002062] [INFO ] [MAIN ] Derivative Progress: 1419/2226 symbols completed. NMZ took 0.8s. Estimated remaining: 4m 44s. Rate: 170.7 symbols/min [2025-09-14T20:57:24.014195] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:24.013674] [DEBUG] [MAIN ] NNI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:24.015337] [INFO ] [MAIN ] NNI: Generated 1352 derivative records from 7915 primary records. [2025-09-14T20:57:24.016037] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-14T20:57:24.016664] [DEBUG] [LOCAL ] NNN: Loaded 36174 existing records from primary storage. [2025-09-14T20:57:24.017978] [INFO ] [MAIN ] NNN: Loaded 36174 primary data records. [2025-09-14T20:57:24.064040] [DEBUG] [LOCAL ] NNI: Derivative data saved (1352 records). [2025-09-14T20:57:24.117227] [DEBUG] [LOCAL ] NNY: Loaded 4138 existing records from primary storage. [2025-09-14T20:57:24.122511] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-14T20:57:24.142727] [INFO ] [MAIN ] NNY: Loaded 4138 primary data records. [2025-09-14T20:57:24.144623] [INFO ] [MAIN ] Derivative Progress: 1420/2226 symbols completed. NNI took 0.9s. Estimated remaining: 4m 43s. Rate: 170.8 symbols/min [2025-09-14T20:57:24.165961] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:24.551820] [DEBUG] [LOCAL ] NOA: Loaded 11606 existing records from primary storage. [2025-09-14T20:57:24.643785] [INFO ] [MAIN ] NOA: Loaded 11606 primary data records. [2025-09-14T20:57:24.942176] [DEBUG] [MAIN ] NNN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:24.944406] [INFO ] [MAIN ] NNN: Generated 1352 derivative records from 36174 primary records. [2025-09-14T20:57:24.944593] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-14T20:57:24.966530] [DEBUG] [LOCAL ] NNN: Derivative data saved (1352 records). [2025-09-14T20:57:24.966814] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-14T20:57:24.970008] [INFO ] [MAIN ] Derivative Progress: 1421/2226 symbols completed. NNN took 1.0s. Estimated remaining: 4m 43s. Rate: 170.6 symbols/min [2025-09-14T20:57:24.980757] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:24.981571] [DEBUG] [MAIN ] NNY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:24.983028] [INFO ] [MAIN ] NNY: Generated 1352 derivative records from 4138 primary records. [2025-09-14T20:57:24.983909] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-14T20:57:24.996847] [DEBUG] [LOCAL ] NNY: Derivative data saved (1352 records). [2025-09-14T20:57:24.997376] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-14T20:57:25.000514] [INFO ] [MAIN ] Derivative Progress: 1422/2226 symbols completed. NNY took 1.0s. Estimated remaining: 4m 43s. Rate: 170.7 symbols/min [2025-09-14T20:57:25.005707] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:25.016744] [DEBUG] [LOCAL ] NOAH: Loaded 14703 existing records from primary storage. [2025-09-14T20:57:25.027496] [INFO ] [MAIN ] NOAH: Loaded 14703 primary data records. [2025-09-14T20:57:25.027807] [DEBUG] [MAIN ] NOA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:25.050712] [INFO ] [MAIN ] NOA: Generated 1352 derivative records from 11606 primary records. [2025-09-14T20:57:25.073892] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-14T20:57:25.177905] [DEBUG] [LOCAL ] NOA: Derivative data saved (1352 records). [2025-09-14T20:57:25.260449] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-14T20:57:25.270398] [INFO ] [MAIN ] Derivative Progress: 1423/2226 symbols completed. NOA took 1.1s. Estimated remaining: 4m 42s. Rate: 170.8 symbols/min [2025-09-14T20:57:25.265032] [DEBUG] [LOCAL ] NOC: Loaded 31770 existing records from primary storage. [2025-09-14T20:57:25.375155] [INFO ] [MAIN ] NOC: Loaded 31770 primary data records. [2025-09-14T20:57:25.686153] [DEBUG] [MAIN ] NOAH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:25.688739] [INFO ] [MAIN ] NOAH: Generated 1352 derivative records from 14703 primary records. [2025-09-14T20:57:25.688899] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-14T20:57:25.704129] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1352 records). [2025-09-14T20:57:25.704535] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-14T20:57:25.707204] [INFO ] [MAIN ] Derivative Progress: 1424/2226 symbols completed. NOAH took 0.7s. Estimated remaining: 4m 42s. Rate: 170.7 symbols/min [2025-09-14T20:57:25.722706] [DEBUG] [MAIN ] NOC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:25.723595] [INFO ] [MAIN ] NOC: Generated 1352 derivative records from 31770 primary records. [2025-09-14T20:57:25.723703] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-14T20:57:25.736436] [DEBUG] [LOCAL ] NOC: Derivative data saved (1352 records). [2025-09-14T20:57:25.736534] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-14T20:57:25.739225] [INFO ] [MAIN ] Derivative Progress: 1425/2226 symbols completed. NOC took 0.7s. Estimated remaining: 4m 41s. Rate: 170.8 symbols/min [2025-09-14T20:57:25.739787] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:25.740114] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:25.740338] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:25.830361] [DEBUG] [LOCAL ] NOMD: Loaded 31505 existing records from primary storage. [2025-09-14T20:57:25.830604] [INFO ] [MAIN ] NOMD: Loaded 31505 primary data records. [2025-09-14T20:57:25.831942] [DEBUG] [LOCAL ] NOG: Loaded 38382 existing records from primary storage. [2025-09-14T20:57:25.831399] [DEBUG] [LOCAL ] NOK: Loaded 40362 existing records from primary storage. [2025-09-14T20:57:25.870113] [INFO ] [MAIN ] NOG: Loaded 38382 primary data records. [2025-09-14T20:57:25.870209] [INFO ] [MAIN ] NOK: Loaded 40362 primary data records. [2025-09-14T20:57:26.777578] [DEBUG] [MAIN ] NOMD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:26.778848] [INFO ] [MAIN ] NOMD: Generated 1352 derivative records from 31505 primary records. [2025-09-14T20:57:26.779318] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-14T20:57:26.801891] [DEBUG] [MAIN ] NOG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:26.805026] [INFO ] [MAIN ] NOG: Generated 1352 derivative records from 38382 primary records. [2025-09-14T20:57:26.805864] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-14T20:57:26.817168] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1352 records). [2025-09-14T20:57:26.818113] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-14T20:57:26.820339] [DEBUG] [LOCAL ] NOG: Derivative data saved (1352 records). [2025-09-14T20:57:26.827978] [INFO ] [MAIN ] Derivative Progress: 1426/2226 symbols completed. NOMD took 1.1s. Estimated remaining: 4m 41s. Rate: 170.6 symbols/min [2025-09-14T20:57:26.832432] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:26.832236] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-14T20:57:26.835629] [INFO ] [MAIN ] Derivative Progress: 1427/2226 symbols completed. NOG took 1.1s. Estimated remaining: 4m 41s. Rate: 170.7 symbols/min [2025-09-14T20:57:26.833100] [DEBUG] [MAIN ] NOK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:26.836988] [INFO ] [MAIN ] NOK: Generated 1352 derivative records from 40362 primary records. [2025-09-14T20:57:26.837119] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-14T20:57:26.837548] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:26.850662] [DEBUG] [LOCAL ] NOK: Derivative data saved (1352 records). [2025-09-14T20:57:26.850797] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-14T20:57:26.853103] [INFO ] [MAIN ] Derivative Progress: 1428/2226 symbols completed. NOK took 1.1s. Estimated remaining: 4m 40s. Rate: 170.8 symbols/min [2025-09-14T20:57:26.853580] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:26.915629] [DEBUG] [LOCAL ] NOTE: Loaded 33164 existing records from primary storage. [2025-09-14T20:57:26.937308] [DEBUG] [LOCAL ] NOW: Loaded 36186 existing records from primary storage. [2025-09-14T20:57:26.937429] [INFO ] [MAIN ] NOTE: Loaded 33164 primary data records. [2025-09-14T20:57:26.938277] [DEBUG] [LOCAL ] NOV: Loaded 39981 existing records from primary storage. [2025-09-14T20:57:26.943750] [INFO ] [MAIN ] NOV: Loaded 39981 primary data records. [2025-09-14T20:57:26.943911] [INFO ] [MAIN ] NOW: Loaded 36186 primary data records. [2025-09-14T20:57:27.807706] [DEBUG] [MAIN ] NOV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:27.810428] [INFO ] [MAIN ] NOV: Generated 1352 derivative records from 39981 primary records. [2025-09-14T20:57:27.810563] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-14T20:57:27.839089] [DEBUG] [MAIN ] NOW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:27.846286] [DEBUG] [LOCAL ] NOV: Derivative data saved (1352 records). [2025-09-14T20:57:27.845385] [DEBUG] [MAIN ] NOTE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:27.847066] [INFO ] [MAIN ] NOW: Generated 1352 derivative records from 36186 primary records. [2025-09-14T20:57:27.847810] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-14T20:57:27.847702] [INFO ] [MAIN ] NOTE: Generated 1352 derivative records from 33164 primary records. [2025-09-14T20:57:27.850215] [INFO ] [MAIN ] Derivative Progress: 1429/2226 symbols completed. NOV took 1.0s. Estimated remaining: 4m 40s. Rate: 170.6 symbols/min [2025-09-14T20:57:27.847860] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-09-14T20:57:27.850286] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-14T20:57:27.851151] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:27.872999] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1352 records). [2025-09-14T20:57:27.876116] [DEBUG] [LOCAL ] NOW: Derivative data saved (1352 records). [2025-09-14T20:57:27.876229] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-14T20:57:27.876375] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-14T20:57:27.878421] [INFO ] [MAIN ] Derivative Progress: 1430/2226 symbols completed. NOTE took 1.0s. Estimated remaining: 4m 40s. Rate: 170.7 symbols/min [2025-09-14T20:57:27.883975] [INFO ] [MAIN ] Derivative Progress: 1431/2226 symbols completed. NOW took 1.0s. Estimated remaining: 4m 39s. Rate: 170.8 symbols/min [2025-09-14T20:57:27.883900] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:27.884213] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:27.893040] [DEBUG] [LOCAL ] NPCT: Loaded 12879 existing records from primary storage. [2025-09-14T20:57:27.893249] [INFO ] [MAIN ] NPCT: Loaded 12879 primary data records. [2025-09-14T20:57:27.977989] [DEBUG] [LOCAL ] NPK: Loaded 6405 existing records from primary storage. [2025-09-14T20:57:27.986453] [DEBUG] [LOCAL ] NPFD: Loaded 7027 existing records from primary storage. [2025-09-14T20:57:28.009470] [INFO ] [MAIN ] NPK: Loaded 6405 primary data records. [2025-09-14T20:57:27.991707] [INFO ] [MAIN ] NPFD: Loaded 7027 primary data records. [2025-09-14T20:57:28.750105] [DEBUG] [MAIN ] NPCT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:28.751162] [INFO ] [MAIN ] NPCT: Generated 1352 derivative records from 12879 primary records. [2025-09-14T20:57:28.751449] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-14T20:57:28.780822] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1352 records). [2025-09-14T20:57:28.789066] [DEBUG] [MAIN ] NPK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:28.789273] [DEBUG] [MAIN ] NPFD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:28.790813] [INFO ] [MAIN ] NPFD: Generated 1352 derivative records from 7027 primary records. [2025-09-14T20:57:28.789329] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-14T20:57:28.790095] [INFO ] [MAIN ] NPK: Generated 1352 derivative records from 6405 primary records. [2025-09-14T20:57:28.791162] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-14T20:57:28.792848] [INFO ] [MAIN ] Derivative Progress: 1432/2226 symbols completed. NPCT took 0.9s. Estimated remaining: 4m 39s. Rate: 170.6 symbols/min [2025-09-14T20:57:28.793967] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:28.793028] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-14T20:57:28.806979] [DEBUG] [LOCAL ] NPK: Derivative data saved (1352 records). [2025-09-14T20:57:28.813841] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-14T20:57:28.818528] [INFO ] [MAIN ] Derivative Progress: 1433/2226 symbols completed. NPK took 0.9s. Estimated remaining: 4m 39s. Rate: 170.7 symbols/min [2025-09-14T20:57:28.821961] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1352 records). [2025-09-14T20:57:28.824342] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:28.824455] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-14T20:57:28.826701] [INFO ] [MAIN ] Derivative Progress: 1434/2226 symbols completed. NPFD took 0.9s. Estimated remaining: 4m 38s. Rate: 170.9 symbols/min [2025-09-14T20:57:28.827418] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:28.832905] [DEBUG] [LOCAL ] NPO: Loaded 9549 existing records from primary storage. [2025-09-14T20:57:28.833337] [INFO ] [MAIN ] NPO: Loaded 9549 primary data records. [2025-09-14T20:57:28.933781] [DEBUG] [LOCAL ] NQP: Loaded 6844 existing records from primary storage. [2025-09-14T20:57:28.953335] [INFO ] [MAIN ] NQP: Loaded 6844 primary data records. [2025-09-14T20:57:29.293765] [DEBUG] [LOCAL ] NPWR: Loaded 32423 existing records from primary storage. [2025-09-14T20:57:29.323822] [INFO ] [MAIN ] NPWR: Loaded 32423 primary data records. [2025-09-14T20:57:29.739818] [DEBUG] [MAIN ] NPO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:29.741701] [INFO ] [MAIN ] NPO: Generated 1352 derivative records from 9549 primary records. [2025-09-14T20:57:29.742570] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-14T20:57:29.768074] [DEBUG] [MAIN ] NQP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:29.770619] [INFO ] [MAIN ] NQP: Generated 1352 derivative records from 6844 primary records. [2025-09-14T20:57:29.771563] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-14T20:57:29.773072] [DEBUG] [LOCAL ] NPO: Derivative data saved (1352 records). [2025-09-14T20:57:29.783785] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-14T20:57:29.786475] [INFO ] [MAIN ] Derivative Progress: 1435/2226 symbols completed. NPO took 1.0s. Estimated remaining: 4m 38s. Rate: 170.7 symbols/min [2025-09-14T20:57:29.787114] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:29.799534] [DEBUG] [MAIN ] NPWR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:29.801314] [INFO ] [MAIN ] NPWR: Generated 1352 derivative records from 32423 primary records. [2025-09-14T20:57:29.800563] [DEBUG] [LOCAL ] NQP: Derivative data saved (1352 records). [2025-09-14T20:57:29.801527] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-14T20:57:29.801492] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-14T20:57:29.804583] [INFO ] [MAIN ] Derivative Progress: 1436/2226 symbols completed. NQP took 1.0s. Estimated remaining: 4m 38s. Rate: 170.8 symbols/min [2025-09-14T20:57:29.810799] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:29.817235] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1352 records). [2025-09-14T20:57:29.823958] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-14T20:57:29.826329] [INFO ] [MAIN ] Derivative Progress: 1437/2226 symbols completed. NPWR took 1.0s. Estimated remaining: 4m 37s. Rate: 170.9 symbols/min [2025-09-14T20:57:29.826668] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:29.833269] [DEBUG] [LOCAL ] NREF: Loaded 5581 existing records from primary storage. [2025-09-14T20:57:29.833499] [INFO ] [MAIN ] NREF: Loaded 5581 primary data records. [2025-09-14T20:57:29.938241] [DEBUG] [LOCAL ] NRDY: Loaded 24286 existing records from primary storage. [2025-09-14T20:57:29.950679] [INFO ] [MAIN ] NRDY: Loaded 24286 primary data records. [2025-09-14T20:57:30.305148] [DEBUG] [LOCAL ] NRG: Loaded 39817 existing records from primary storage. [2025-09-14T20:57:30.321374] [INFO ] [MAIN ] NRG: Loaded 39817 primary data records. [2025-09-14T20:57:30.719191] [DEBUG] [MAIN ] NREF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:30.720329] [INFO ] [MAIN ] NREF: Generated 1352 derivative records from 5581 primary records. [2025-09-14T20:57:30.720691] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-14T20:57:30.747243] [DEBUG] [LOCAL ] NREF: Derivative data saved (1352 records). [2025-09-14T20:57:30.747715] [DEBUG] [MAIN ] NRDY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:30.748804] [INFO ] [MAIN ] NRDY: Generated 1352 derivative records from 24286 primary records. [2025-09-14T20:57:30.748011] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-14T20:57:30.751098] [INFO ] [MAIN ] Derivative Progress: 1438/2226 symbols completed. NREF took 0.9s. Estimated remaining: 4m 37s. Rate: 170.7 symbols/min [2025-09-14T20:57:30.751421] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-14T20:57:30.773619] [DEBUG] [MAIN ] NRG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:30.775433] [INFO ] [MAIN ] NRG: Generated 1352 derivative records from 39817 primary records. [2025-09-14T20:57:30.776138] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-09-14T20:57:30.776080] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1352 records). [2025-09-14T20:57:30.776794] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-14T20:57:30.779087] [INFO ] [MAIN ] Derivative Progress: 1439/2226 symbols completed. NRDY took 1.0s. Estimated remaining: 4m 36s. Rate: 170.8 symbols/min [2025-09-14T20:57:30.790752] [DEBUG] [LOCAL ] NRG: Derivative data saved (1352 records). [2025-09-14T20:57:30.790832] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-09-14T20:57:30.792679] [INFO ] [MAIN ] Derivative Progress: 1440/2226 symbols completed. NRG took 1.0s. Estimated remaining: 4m 36s. Rate: 170.9 symbols/min [2025-09-14T20:57:30.793124] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:30.793290] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:30.793332] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:30.799919] [DEBUG] [LOCAL ] NRP: Loaded 2786 existing records from primary storage. [2025-09-14T20:57:30.800260] [INFO ] [MAIN ] NRP: Loaded 2786 primary data records. [2025-09-14T20:57:30.941981] [DEBUG] [LOCAL ] NRK: Loaded 15230 existing records from primary storage. [2025-09-14T20:57:30.981273] [INFO ] [MAIN ] NRK: Loaded 15230 primary data records. [2025-09-14T20:57:31.196254] [DEBUG] [LOCAL ] NRGV: Loaded 31505 existing records from primary storage. [2025-09-14T20:57:31.228840] [INFO ] [MAIN ] NRGV: Loaded 31505 primary data records. [2025-09-14T20:57:31.777961] [DEBUG] [MAIN ] NRP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:31.779877] [INFO ] [MAIN ] NRP: Generated 1352 derivative records from 2786 primary records. [2025-09-14T20:57:31.780574] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-14T20:57:31.796216] [DEBUG] [LOCAL ] NRP: Derivative data saved (1352 records). [2025-09-14T20:57:31.797125] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-14T20:57:31.799281] [INFO ] [MAIN ] Derivative Progress: 1441/2226 symbols completed. NRP took 1.0s. Estimated remaining: 4m 36s. Rate: 170.7 symbols/min [2025-09-14T20:57:31.801956] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:31.814492] [DEBUG] [MAIN ] NRK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:31.817004] [INFO ] [MAIN ] NRK: Generated 1352 derivative records from 15230 primary records. [2025-09-14T20:57:31.817247] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-14T20:57:31.829867] [DEBUG] [LOCAL ] NRT: Loaded 3685 existing records from primary storage. [2025-09-14T20:57:31.836236] [INFO ] [MAIN ] NRT: Loaded 3685 primary data records. [2025-09-14T20:57:31.836309] [DEBUG] [LOCAL ] NRK: Derivative data saved (1352 records). [2025-09-14T20:57:31.865261] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-14T20:57:31.890470] [INFO ] [MAIN ] Derivative Progress: 1442/2226 symbols completed. NRK took 1.1s. Estimated remaining: 4m 35s. Rate: 170.8 symbols/min [2025-09-14T20:57:31.917236] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:31.960235] [DEBUG] [MAIN ] NRGV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:31.961383] [INFO ] [MAIN ] NRGV: Generated 1352 derivative records from 31505 primary records. [2025-09-14T20:57:31.988213] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-14T20:57:32.044232] [DEBUG] [LOCAL ] NRUC: Loaded 2274 existing records from primary storage. [2025-09-14T20:57:32.044823] [INFO ] [MAIN ] NRUC: Loaded 2274 primary data records. [2025-09-14T20:57:32.221829] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1352 records). [2025-09-14T20:57:32.250279] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-14T20:57:32.268934] [INFO ] [MAIN ] Derivative Progress: 1443/2226 symbols completed. NRGV took 1.5s. Estimated remaining: 4m 35s. Rate: 170.8 symbols/min [2025-09-14T20:57:32.294152] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:32.441743] [DEBUG] [MAIN ] NRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:32.443263] [INFO ] [MAIN ] NRT: Generated 1352 derivative records from 3685 primary records. [2025-09-14T20:57:32.443837] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-14T20:57:32.466823] [DEBUG] [LOCAL ] NRT: Derivative data saved (1352 records). [2025-09-14T20:57:32.468748] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-14T20:57:32.470856] [INFO ] [MAIN ] Derivative Progress: 1444/2226 symbols completed. NRT took 0.7s. Estimated remaining: 4m 35s. Rate: 170.8 symbols/min [2025-09-14T20:57:32.471329] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:32.483766] [DEBUG] [MAIN ] NRUC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:32.495629] [INFO ] [MAIN ] NRUC: Generated 1352 derivative records from 2274 primary records. [2025-09-14T20:57:32.496484] [DEBUG] [LOCAL ] NSA: Loaded 33958 existing records from primary storage. [2025-09-14T20:57:32.496807] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-14T20:57:32.496865] [INFO ] [MAIN ] NSA: Loaded 33958 primary data records. [2025-09-14T20:57:32.585466] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1352 records). [2025-09-14T20:57:32.614849] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-14T20:57:32.620914] [INFO ] [MAIN ] Derivative Progress: 1445/2226 symbols completed. NRUC took 0.7s. Estimated remaining: 4m 34s. Rate: 170.9 symbols/min [2025-09-14T20:57:32.679016] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:32.809789] [DEBUG] [LOCAL ] NSC: Loaded 36869 existing records from primary storage. [2025-09-14T20:57:32.810145] [INFO ] [MAIN ] NSC: Loaded 36869 primary data records. [2025-09-14T20:57:33.001133] [DEBUG] [LOCAL ] NSP: Loaded 26649 existing records from primary storage. [2025-09-14T20:57:33.019792] [INFO ] [MAIN ] NSP: Loaded 26649 primary data records. [2025-09-14T20:57:33.322286] [DEBUG] [MAIN ] NSA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:33.409846] [INFO ] [MAIN ] NSA: Generated 1352 derivative records from 33958 primary records. [2025-09-14T20:57:33.410394] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-14T20:57:33.439485] [DEBUG] [MAIN ] NSC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:33.440820] [INFO ] [MAIN ] NSC: Generated 1352 derivative records from 36869 primary records. [2025-09-14T20:57:33.441169] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-09-14T20:57:33.442952] [DEBUG] [LOCAL ] NSA: Derivative data saved (1352 records). [2025-09-14T20:57:33.449252] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-14T20:57:33.454756] [INFO ] [MAIN ] Derivative Progress: 1446/2226 symbols completed. NSA took 1.2s. Estimated remaining: 4m 34s. Rate: 170.7 symbols/min [2025-09-14T20:57:33.455805] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:33.463377] [DEBUG] [LOCAL ] NSC: Derivative data saved (1352 records). [2025-09-14T20:57:33.467633] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-09-14T20:57:33.478763] [DEBUG] [MAIN ] NSP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:33.479513] [INFO ] [MAIN ] NSP: Generated 1352 derivative records from 26649 primary records. [2025-09-14T20:57:33.485271] [DEBUG] [LOCAL ] NTB: Loaded 14874 existing records from primary storage. [2025-09-14T20:57:33.487614] [INFO ] [MAIN ] Derivative Progress: 1447/2226 symbols completed. NSC took 1.0s. Estimated remaining: 4m 34s. Rate: 170.8 symbols/min [2025-09-14T20:57:33.487788] [INFO ] [MAIN ] NTB: Loaded 14874 primary data records. [2025-09-14T20:57:33.488026] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-14T20:57:33.493717] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:33.595852] [DEBUG] [LOCAL ] NSP: Derivative data saved (1352 records). [2025-09-14T20:57:33.615774] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-14T20:57:33.630540] [INFO ] [MAIN ] Derivative Progress: 1448/2226 symbols completed. NSP took 1.0s. Estimated remaining: 4m 33s. Rate: 170.9 symbols/min [2025-09-14T20:57:33.641352] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:33.842491] [DEBUG] [LOCAL ] NTR: Loaded 39519 existing records from primary storage. [2025-09-14T20:57:33.843534] [INFO ] [MAIN ] NTR: Loaded 39519 primary data records. [2025-09-14T20:57:34.058916] [DEBUG] [LOCAL ] NTST: Loaded 32619 existing records from primary storage. [2025-09-14T20:57:34.059391] [INFO ] [MAIN ] NTST: Loaded 32619 primary data records. [2025-09-14T20:57:34.203596] [DEBUG] [MAIN ] NTB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:34.238663] [INFO ] [MAIN ] NTB: Generated 1352 derivative records from 14874 primary records. [2025-09-14T20:57:34.255763] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-14T20:57:34.358534] [DEBUG] [LOCAL ] NTB: Derivative data saved (1352 records). [2025-09-14T20:57:34.359077] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-14T20:57:34.449536] [INFO ] [MAIN ] Derivative Progress: 1449/2226 symbols completed. NTB took 1.0s. Estimated remaining: 4m 33s. Rate: 170.7 symbols/min [2025-09-14T20:57:34.450222] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:34.475820] [DEBUG] [MAIN ] NTR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:34.477122] [INFO ] [MAIN ] NTR: Generated 1352 derivative records from 39519 primary records. [2025-09-14T20:57:34.491349] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-14T20:57:34.520846] [DEBUG] [LOCAL ] NTR: Derivative data saved (1352 records). [2025-09-14T20:57:34.522823] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-14T20:57:34.527756] [INFO ] [MAIN ] Derivative Progress: 1450/2226 symbols completed. NTR took 1.0s. Estimated remaining: 4m 33s. Rate: 170.8 symbols/min [2025-09-14T20:57:34.529470] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:34.541956] [DEBUG] [MAIN ] NTST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:34.543161] [INFO ] [MAIN ] NTST: Generated 1352 derivative records from 32619 primary records. [2025-09-14T20:57:34.543435] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-14T20:57:34.573715] [DEBUG] [LOCAL ] NU: Loaded 40486 existing records from primary storage. [2025-09-14T20:57:34.582615] [DEBUG] [LOCAL ] NTST: Derivative data saved (1352 records). [2025-09-14T20:57:34.583048] [INFO ] [MAIN ] NU: Loaded 40486 primary data records. [2025-09-14T20:57:34.583305] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-14T20:57:34.587017] [INFO ] [MAIN ] Derivative Progress: 1451/2226 symbols completed. NTST took 0.9s. Estimated remaining: 4m 32s. Rate: 170.9 symbols/min [2025-09-14T20:57:34.644793] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:34.772559] [DEBUG] [LOCAL ] NUS: Loaded 27086 existing records from primary storage. [2025-09-14T20:57:34.804490] [INFO ] [MAIN ] NUS: Loaded 27086 primary data records. [2025-09-14T20:57:35.029008] [DEBUG] [LOCAL ] NUV: Loaded 16682 existing records from primary storage. [2025-09-14T20:57:35.056621] [INFO ] [MAIN ] NUV: Loaded 16682 primary data records. [2025-09-14T20:57:35.545915] [DEBUG] [MAIN ] NU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:35.548327] [INFO ] [MAIN ] NU: Generated 1352 derivative records from 40486 primary records. [2025-09-14T20:57:35.549705] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-14T20:57:35.584529] [DEBUG] [MAIN ] NUS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:35.584092] [DEBUG] [LOCAL ] NU: Derivative data saved (1352 records). [2025-09-14T20:57:35.587099] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-14T20:57:35.588885] [INFO ] [MAIN ] NUS: Generated 1352 derivative records from 27086 primary records. [2025-09-14T20:57:35.591057] [INFO ] [MAIN ] Derivative Progress: 1452/2226 symbols completed. NU took 1.1s. Estimated remaining: 4m 32s. Rate: 170.7 symbols/min [2025-09-14T20:57:35.591710] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:35.591789] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-14T20:57:35.610514] [DEBUG] [MAIN ] NUV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:35.621209] [INFO ] [MAIN ] NUV: Generated 1352 derivative records from 16682 primary records. [2025-09-14T20:57:35.621829] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-14T20:57:35.640523] [DEBUG] [LOCAL ] NUV: Derivative data saved (1352 records). [2025-09-14T20:57:35.641044] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-14T20:57:35.643591] [INFO ] [MAIN ] Derivative Progress: 1453/2226 symbols completed. NUV took 1.0s. Estimated remaining: 4m 32s. Rate: 170.8 symbols/min [2025-09-14T20:57:35.646164] [DEBUG] [LOCAL ] NUS: Derivative data saved (1352 records). [2025-09-14T20:57:35.646363] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-14T20:57:35.648717] [INFO ] [MAIN ] Derivative Progress: 1454/2226 symbols completed. NUS took 1.1s. Estimated remaining: 4m 31s. Rate: 170.9 symbols/min [2025-09-14T20:57:35.676885] [DEBUG] [LOCAL ] NUVB: Loaded 38758 existing records from primary storage. [2025-09-14T20:57:35.677090] [INFO ] [MAIN ] NUVB: Loaded 38758 primary data records. [2025-09-14T20:57:36.028004] [DEBUG] [MAIN ] NUVB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:36.028795] [INFO ] [MAIN ] NUVB: Generated 1352 derivative records from 38758 primary records. [2025-09-14T20:57:36.028883] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-14T20:57:36.042097] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1352 records). [2025-09-14T20:57:36.042248] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-14T20:57:36.044028] [INFO ] [MAIN ] Derivative Progress: 1455/2226 symbols completed. NUVB took 0.5s. Estimated remaining: 4m 31s. Rate: 170.9 symbols/min [2025-09-14T20:57:36.044841] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:36.045035] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:36.045204] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:36.054665] [DEBUG] [LOCAL ] NUW: Loaded 5128 existing records from primary storage. [2025-09-14T20:57:36.054834] [INFO ] [MAIN ] NUW: Loaded 5128 primary data records. [2025-09-14T20:57:36.232697] [DEBUG] [LOCAL ] NVG: Loaded 20268 existing records from primary storage. [2025-09-14T20:57:36.256720] [INFO ] [MAIN ] NVG: Loaded 20268 primary data records. [2025-09-14T20:57:36.283672] [DEBUG] [LOCAL ] NVGS: Loaded 23625 existing records from primary storage. [2025-09-14T20:57:36.284035] [INFO ] [MAIN ] NVGS: Loaded 23625 primary data records. [2025-09-14T20:57:36.989348] [DEBUG] [MAIN ] NUW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:36.990748] [INFO ] [MAIN ] NUW: Generated 1352 derivative records from 5128 primary records. [2025-09-14T20:57:36.990948] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-14T20:57:37.005692] [DEBUG] [LOCAL ] NUW: Derivative data saved (1352 records). [2025-09-14T20:57:37.007253] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-14T20:57:37.009122] [INFO ] [MAIN ] Derivative Progress: 1456/2226 symbols completed. NUW took 1.0s. Estimated remaining: 4m 31s. Rate: 170.7 symbols/min [2025-09-14T20:57:37.009912] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:37.022105] [DEBUG] [MAIN ] NVG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:37.023308] [INFO ] [MAIN ] NVG: Generated 1352 derivative records from 20268 primary records. [2025-09-14T20:57:37.023796] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-14T20:57:37.040895] [DEBUG] [LOCAL ] NVG: Derivative data saved (1352 records). [2025-09-14T20:57:37.041424] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-14T20:57:37.050593] [INFO ] [MAIN ] Derivative Progress: 1457/2226 symbols completed. NVG took 1.0s. Estimated remaining: 4m 30s. Rate: 170.8 symbols/min [2025-09-14T20:57:37.058190] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:37.057977] [DEBUG] [MAIN ] NVGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:37.059446] [INFO ] [MAIN ] NVGS: Generated 1352 derivative records from 23625 primary records. [2025-09-14T20:57:37.059879] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-14T20:57:37.086983] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1352 records). [2025-09-14T20:57:37.087242] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-14T20:57:37.089411] [INFO ] [MAIN ] Derivative Progress: 1458/2226 symbols completed. NVGS took 1.0s. Estimated remaining: 4m 30s. Rate: 170.9 symbols/min [2025-09-14T20:57:37.090023] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:37.107963] [DEBUG] [LOCAL ] NVR: Loaded 13330 existing records from primary storage. [2025-09-14T20:57:37.109206] [INFO ] [MAIN ] NVR: Loaded 13330 primary data records. [2025-09-14T20:57:37.109927] [DEBUG] [LOCAL ] NVO: Loaded 40524 existing records from primary storage. [2025-09-14T20:57:37.143031] [INFO ] [MAIN ] NVO: Loaded 40524 primary data records. [2025-09-14T20:57:37.534319] [DEBUG] [LOCAL ] NVRI: Loaded 28503 existing records from primary storage. [2025-09-14T20:57:37.588554] [INFO ] [MAIN ] NVRI: Loaded 28503 primary data records. [2025-09-14T20:57:37.997021] [DEBUG] [MAIN ] NVR: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:57:37.999038] [INFO ] [MAIN ] NVR: Generated 1351 derivative records from 13330 primary records. [2025-09-14T20:57:38.001786] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-14T20:57:38.023248] [DEBUG] [LOCAL ] NVR: Derivative data saved (1351 records). [2025-09-14T20:57:38.029199] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-14T20:57:38.029707] [DEBUG] [MAIN ] NVO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:38.031580] [INFO ] [MAIN ] Derivative Progress: 1459/2226 symbols completed. NVR took 1.0s. Estimated remaining: 4m 30s. Rate: 170.7 symbols/min [2025-09-14T20:57:38.032767] [INFO ] [MAIN ] NVO: Generated 1352 derivative records from 40524 primary records. [2025-09-14T20:57:38.033190] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:38.033624] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-14T20:57:38.047538] [DEBUG] [LOCAL ] NVO: Derivative data saved (1352 records). [2025-09-14T20:57:38.048046] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-14T20:57:38.051079] [INFO ] [MAIN ] Derivative Progress: 1460/2226 symbols completed. NVO took 1.0s. Estimated remaining: 4m 29s. Rate: 170.8 symbols/min [2025-09-14T20:57:38.051886] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:38.066136] [DEBUG] [MAIN ] NVRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:38.067039] [INFO ] [MAIN ] NVRI: Generated 1352 derivative records from 28503 primary records. [2025-09-14T20:57:38.067147] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-14T20:57:38.080124] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1352 records). [2025-09-14T20:57:38.080429] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-14T20:57:38.082398] [INFO ] [MAIN ] Derivative Progress: 1461/2226 symbols completed. NVRI took 1.0s. Estimated remaining: 4m 29s. Rate: 170.9 symbols/min [2025-09-14T20:57:38.082796] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:38.122420] [DEBUG] [LOCAL ] NVS: Loaded 38688 existing records from primary storage. [2025-09-14T20:57:38.122678] [INFO ] [MAIN ] NVS: Loaded 38688 primary data records. [2025-09-14T20:57:38.261083] [DEBUG] [LOCAL ] NVST: Loaded 38634 existing records from primary storage. [2025-09-14T20:57:38.274941] [INFO ] [MAIN ] NVST: Loaded 38634 primary data records. [2025-09-14T20:57:38.333821] [DEBUG] [LOCAL ] NVT: Loaded 38635 existing records from primary storage. [2025-09-14T20:57:38.418074] [INFO ] [MAIN ] NVT: Loaded 38635 primary data records. [2025-09-14T20:57:39.103897] [DEBUG] [MAIN ] NVS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:39.105698] [INFO ] [MAIN ] NVS: Generated 1352 derivative records from 38688 primary records. [2025-09-14T20:57:39.105964] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-14T20:57:39.120751] [DEBUG] [LOCAL ] NVS: Derivative data saved (1352 records). [2025-09-14T20:57:39.123771] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-14T20:57:39.126687] [INFO ] [MAIN ] Derivative Progress: 1462/2226 symbols completed. NVS took 1.1s. Estimated remaining: 4m 29s. Rate: 170.7 symbols/min [2025-09-14T20:57:39.127243] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:39.139481] [DEBUG] [MAIN ] NVST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:39.140790] [INFO ] [MAIN ] NVST: Generated 1352 derivative records from 38634 primary records. [2025-09-14T20:57:39.152433] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-14T20:57:39.152734] [DEBUG] [MAIN ] NVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:39.154625] [INFO ] [MAIN ] NVT: Generated 1352 derivative records from 38635 primary records. [2025-09-14T20:57:39.154822] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-14T20:57:39.169171] [DEBUG] [LOCAL ] NVST: Derivative data saved (1352 records). [2025-09-14T20:57:39.178950] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-14T20:57:39.182664] [INFO ] [MAIN ] Derivative Progress: 1463/2226 symbols completed. NVST took 1.1s. Estimated remaining: 4m 28s. Rate: 170.8 symbols/min [2025-09-14T20:57:39.183054] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:39.188229] [DEBUG] [LOCAL ] NVT: Derivative data saved (1352 records). [2025-09-14T20:57:39.188414] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-14T20:57:39.190502] [INFO ] [MAIN ] Derivative Progress: 1464/2226 symbols completed. NVT took 1.1s. Estimated remaining: 4m 27s. Rate: 170.9 symbols/min [2025-09-14T20:57:39.190942] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:39.219600] [DEBUG] [LOCAL ] NWN: Loaded 20525 existing records from primary storage. [2025-09-14T20:57:39.219874] [INFO ] [MAIN ] NWN: Loaded 20525 primary data records. [2025-09-14T20:57:39.359531] [DEBUG] [LOCAL ] NWG: Loaded 38809 existing records from primary storage. [2025-09-14T20:57:39.395456] [INFO ] [MAIN ] NWG: Loaded 38809 primary data records. [2025-09-14T20:57:39.411284] [DEBUG] [LOCAL ] NX: Loaded 24369 existing records from primary storage. [2025-09-14T20:57:39.464591] [INFO ] [MAIN ] NX: Loaded 24369 primary data records. [2025-09-14T20:57:40.114893] [DEBUG] [MAIN ] NWN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:40.116892] [INFO ] [MAIN ] NWN: Generated 1352 derivative records from 20525 primary records. [2025-09-14T20:57:40.118285] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-14T20:57:40.133659] [DEBUG] [LOCAL ] NWN: Derivative data saved (1352 records). [2025-09-14T20:57:40.134195] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-14T20:57:40.136070] [INFO ] [MAIN ] Derivative Progress: 1465/2226 symbols completed. NWN took 1.0s. Estimated remaining: 4m 27s. Rate: 170.7 symbols/min [2025-09-14T20:57:40.140034] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:40.162746] [DEBUG] [MAIN ] NX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:40.161603] [DEBUG] [MAIN ] NWG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:40.163713] [INFO ] [MAIN ] NWG: Generated 1352 derivative records from 38809 primary records. [2025-09-14T20:57:40.164246] [INFO ] [MAIN ] NX: Generated 1352 derivative records from 24369 primary records. [2025-09-14T20:57:40.164375] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-14T20:57:40.167452] [DEBUG] [LOCAL ] NXC: Loaded 3040 existing records from primary storage. [2025-09-14T20:57:40.164601] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-14T20:57:40.167562] [INFO ] [MAIN ] NXC: Loaded 3040 primary data records. [2025-09-14T20:57:40.280655] [DEBUG] [LOCAL ] NX: Derivative data saved (1352 records). [2025-09-14T20:57:40.280582] [DEBUG] [LOCAL ] NWG: Derivative data saved (1352 records). [2025-09-14T20:57:40.305044] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-14T20:57:40.308476] [INFO ] [MAIN ] Derivative Progress: 1466/2226 symbols completed. NX took 1.1s. Estimated remaining: 4m 27s. Rate: 170.8 symbols/min [2025-09-14T20:57:40.305172] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-14T20:57:40.319389] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:40.362260] [INFO ] [MAIN ] Derivative Progress: 1467/2226 symbols completed. NWG took 1.2s. Estimated remaining: 4m 27s. Rate: 170.9 symbols/min [2025-09-14T20:57:40.393734] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:40.496120] [DEBUG] [LOCAL ] NXDT: Loaded 11045 existing records from primary storage. [2025-09-14T20:57:40.497035] [INFO ] [MAIN ] NXDT: Loaded 11045 primary data records. [2025-09-14T20:57:40.720076] [DEBUG] [LOCAL ] NXE: Loaded 39838 existing records from primary storage. [2025-09-14T20:57:40.833513] [INFO ] [MAIN ] NXE: Loaded 39838 primary data records. [2025-09-14T20:57:40.913571] [DEBUG] [MAIN ] NXC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:40.945424] [INFO ] [MAIN ] NXC: Generated 1352 derivative records from 3040 primary records. [2025-09-14T20:57:40.969095] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-14T20:57:41.007118] [DEBUG] [LOCAL ] NXC: Derivative data saved (1352 records). [2025-09-14T20:57:41.013477] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-14T20:57:41.031210] [INFO ] [MAIN ] Derivative Progress: 1468/2226 symbols completed. NXC took 0.9s. Estimated remaining: 4m 26s. Rate: 170.8 symbols/min [2025-09-14T20:57:41.191032] [DEBUG] [MAIN ] NXDT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:41.191816] [INFO ] [MAIN ] NXDT: Generated 1352 derivative records from 11045 primary records. [2025-09-14T20:57:41.192040] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-14T20:57:41.206495] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1352 records). [2025-09-14T20:57:41.206758] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-14T20:57:41.209306] [INFO ] [MAIN ] Derivative Progress: 1469/2226 symbols completed. NXDT took 0.9s. Estimated remaining: 4m 26s. Rate: 170.8 symbols/min [2025-09-14T20:57:41.224752] [DEBUG] [MAIN ] NXE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:41.225461] [INFO ] [MAIN ] NXE: Generated 1352 derivative records from 39838 primary records. [2025-09-14T20:57:41.225543] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-14T20:57:41.237426] [DEBUG] [LOCAL ] NXE: Derivative data saved (1352 records). [2025-09-14T20:57:41.237508] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-14T20:57:41.240280] [INFO ] [MAIN ] Derivative Progress: 1470/2226 symbols completed. NXE took 0.8s. Estimated remaining: 4m 25s. Rate: 170.9 symbols/min [2025-09-14T20:57:41.241043] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:41.241168] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:41.241306] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:41.246766] [DEBUG] [LOCAL ] NXN: Loaded 1753 existing records from primary storage. [2025-09-14T20:57:41.247264] [INFO ] [MAIN ] NXN: Loaded 1753 primary data records. [2025-09-14T20:57:41.353732] [DEBUG] [LOCAL ] NXJ: Loaded 11754 existing records from primary storage. [2025-09-14T20:57:41.347942] [DEBUG] [LOCAL ] NXG: Loaded 7526 existing records from primary storage. [2025-09-14T20:57:41.368730] [INFO ] [MAIN ] NXJ: Loaded 11754 primary data records. [2025-09-14T20:57:41.373197] [INFO ] [MAIN ] NXG: Loaded 7526 primary data records. [2025-09-14T20:57:42.164537] [DEBUG] [MAIN ] NXN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:42.171491] [INFO ] [MAIN ] NXN: Generated 1352 derivative records from 1753 primary records. [2025-09-14T20:57:42.171940] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-14T20:57:42.201843] [DEBUG] [MAIN ] NXG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:42.198128] [DEBUG] [MAIN ] NXJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:42.203380] [INFO ] [MAIN ] NXG: Generated 1352 derivative records from 7526 primary records. [2025-09-14T20:57:42.202882] [INFO ] [MAIN ] NXJ: Generated 1352 derivative records from 11754 primary records. [2025-09-14T20:57:42.205675] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-14T20:57:42.206766] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-14T20:57:42.206853] [DEBUG] [LOCAL ] NXN: Derivative data saved (1352 records). [2025-09-14T20:57:42.207933] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-14T20:57:42.215729] [INFO ] [MAIN ] Derivative Progress: 1471/2226 symbols completed. NXN took 1.0s. Estimated remaining: 4m 25s. Rate: 170.7 symbols/min [2025-09-14T20:57:42.224939] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:42.228347] [DEBUG] [LOCAL ] NXG: Derivative data saved (1352 records). [2025-09-14T20:57:42.234940] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-14T20:57:42.238542] [INFO ] [MAIN ] Derivative Progress: 1472/2226 symbols completed. NXG took 1.0s. Estimated remaining: 4m 25s. Rate: 170.8 symbols/min [2025-09-14T20:57:42.236267] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1352 records). [2025-09-14T20:57:42.239023] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:42.239153] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-14T20:57:42.242898] [INFO ] [MAIN ] Derivative Progress: 1473/2226 symbols completed. NXJ took 1.0s. Estimated remaining: 4m 24s. Rate: 171.0 symbols/min [2025-09-14T20:57:42.246767] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:42.253167] [DEBUG] [LOCAL ] NXP: Loaded 9211 existing records from primary storage. [2025-09-14T20:57:42.253613] [INFO ] [MAIN ] NXP: Loaded 9211 primary data records. [2025-09-14T20:57:42.376705] [DEBUG] [LOCAL ] NXRT: Loaded 13774 existing records from primary storage. [2025-09-14T20:57:42.413538] [INFO ] [MAIN ] NXRT: Loaded 13774 primary data records. [2025-09-14T20:57:42.689488] [DEBUG] [LOCAL ] NYT: Loaded 37498 existing records from primary storage. [2025-09-14T20:57:42.702300] [INFO ] [MAIN ] NYT: Loaded 37498 primary data records. [2025-09-14T20:57:43.276487] [DEBUG] [MAIN ] NXP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:43.279228] [INFO ] [MAIN ] NXP: Generated 1352 derivative records from 9211 primary records. [2025-09-14T20:57:43.279805] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-14T20:57:43.295620] [DEBUG] [LOCAL ] NXP: Derivative data saved (1352 records). [2025-09-14T20:57:43.295972] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-14T20:57:43.297882] [INFO ] [MAIN ] Derivative Progress: 1474/2226 symbols completed. NXP took 1.1s. Estimated remaining: 4m 24s. Rate: 170.7 symbols/min [2025-09-14T20:57:43.298534] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:43.321610] [DEBUG] [MAIN ] NXRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:43.333256] [DEBUG] [MAIN ] NYT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:43.332740] [INFO ] [MAIN ] NXRT: Generated 1352 derivative records from 13774 primary records. [2025-09-14T20:57:43.340156] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-14T20:57:43.340034] [INFO ] [MAIN ] NYT: Generated 1352 derivative records from 37498 primary records. [2025-09-14T20:57:43.341424] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-14T20:57:43.360480] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1352 records). [2025-09-14T20:57:43.374233] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-14T20:57:43.377014] [INFO ] [MAIN ] Derivative Progress: 1475/2226 symbols completed. NXRT took 1.1s. Estimated remaining: 4m 24s. Rate: 170.8 symbols/min [2025-09-14T20:57:43.374364] [DEBUG] [LOCAL ] NYT: Derivative data saved (1352 records). [2025-09-14T20:57:43.377535] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:43.377625] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-14T20:57:43.378913] [DEBUG] [LOCAL ] NZF: Loaded 21505 existing records from primary storage. [2025-09-14T20:57:43.379713] [INFO ] [MAIN ] NZF: Loaded 21505 primary data records. [2025-09-14T20:57:43.383157] [INFO ] [MAIN ] Derivative Progress: 1476/2226 symbols completed. NYT took 1.1s. Estimated remaining: 4m 23s. Rate: 170.9 symbols/min [2025-09-14T20:57:43.426158] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:43.568659] [DEBUG] [LOCAL ] OBK: Loaded 11930 existing records from primary storage. [2025-09-14T20:57:43.590468] [INFO ] [MAIN ] OBK: Loaded 11930 primary data records. [2025-09-14T20:57:43.732270] [DEBUG] [LOCAL ] OBDC: Loaded 38542 existing records from primary storage. [2025-09-14T20:57:43.767701] [INFO ] [MAIN ] OBDC: Loaded 38542 primary data records. [2025-09-14T20:57:44.275492] [DEBUG] [MAIN ] NZF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:44.277270] [INFO ] [MAIN ] NZF: Generated 1352 derivative records from 21505 primary records. [2025-09-14T20:57:44.278275] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-14T20:57:44.294510] [DEBUG] [LOCAL ] NZF: Derivative data saved (1352 records). [2025-09-14T20:57:44.294833] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-14T20:57:44.296803] [INFO ] [MAIN ] Derivative Progress: 1477/2226 symbols completed. NZF took 1.0s. Estimated remaining: 4m 23s. Rate: 170.7 symbols/min [2025-09-14T20:57:44.297446] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:44.312471] [DEBUG] [MAIN ] OBK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:44.313210] [INFO ] [MAIN ] OBK: Generated 1352 derivative records from 11930 primary records. [2025-09-14T20:57:44.313427] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-14T20:57:44.328542] [DEBUG] [LOCAL ] OBK: Derivative data saved (1352 records). [2025-09-14T20:57:44.339297] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-14T20:57:44.339861] [DEBUG] [MAIN ] OBDC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:44.342171] [INFO ] [MAIN ] Derivative Progress: 1478/2226 symbols completed. OBK took 0.9s. Estimated remaining: 4m 23s. Rate: 170.8 symbols/min [2025-09-14T20:57:44.343221] [INFO ] [MAIN ] OBDC: Generated 1352 derivative records from 38542 primary records. [2025-09-14T20:57:44.343483] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-14T20:57:44.343532] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:44.367276] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1352 records). [2025-09-14T20:57:44.367676] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-14T20:57:44.371302] [DEBUG] [LOCAL ] OCFT: Loaded 5798 existing records from primary storage. [2025-09-14T20:57:44.373659] [INFO ] [MAIN ] Derivative Progress: 1479/2226 symbols completed. OBDC took 1.0s. Estimated remaining: 4m 22s. Rate: 170.9 symbols/min [2025-09-14T20:57:44.373886] [INFO ] [MAIN ] OCFT: Loaded 5798 primary data records. [2025-09-14T20:57:44.374075] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:44.474442] [DEBUG] [LOCAL ] OC: Loaded 33188 existing records from primary storage. [2025-09-14T20:57:44.502756] [INFO ] [MAIN ] OC: Loaded 33188 primary data records. [2025-09-14T20:57:44.502968] [DEBUG] [LOCAL ] ODC: Loaded 6453 existing records from primary storage. [2025-09-14T20:57:44.555948] [INFO ] [MAIN ] ODC: Loaded 6453 primary data records. [2025-09-14T20:57:45.275552] [DEBUG] [MAIN ] OCFT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:45.276539] [INFO ] [MAIN ] OCFT: Generated 1352 derivative records from 5798 primary records. [2025-09-14T20:57:45.277014] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-14T20:57:45.313085] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1352 records). [2025-09-14T20:57:45.311699] [DEBUG] [MAIN ] ODC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:45.313293] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-14T20:57:45.314130] [INFO ] [MAIN ] ODC: Generated 1352 derivative records from 6453 primary records. [2025-09-14T20:57:45.314370] [DEBUG] [MAIN ] OC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:45.316343] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-14T20:57:45.317347] [INFO ] [MAIN ] OC: Generated 1352 derivative records from 33188 primary records. [2025-09-14T20:57:45.316201] [INFO ] [MAIN ] Derivative Progress: 1480/2226 symbols completed. OCFT took 1.0s. Estimated remaining: 4m 22s. Rate: 170.8 symbols/min [2025-09-14T20:57:45.318178] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:45.317691] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-14T20:57:45.341711] [DEBUG] [LOCAL ] ODC: Derivative data saved (1352 records). [2025-09-14T20:57:45.344063] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-14T20:57:45.351751] [DEBUG] [LOCAL ] OC: Derivative data saved (1352 records). [2025-09-14T20:57:45.350627] [INFO ] [MAIN ] Derivative Progress: 1481/2226 symbols completed. ODC took 1.0s. Estimated remaining: 4m 22s. Rate: 170.9 symbols/min [2025-09-14T20:57:45.352131] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:45.351903] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-14T20:57:45.354928] [INFO ] [MAIN ] Derivative Progress: 1482/2226 symbols completed. OC took 1.1s. Estimated remaining: 4m 21s. Rate: 171.0 symbols/min [2025-09-14T20:57:45.355285] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:45.364027] [DEBUG] [LOCAL ] ODV: Loaded 20014 existing records from primary storage. [2025-09-14T20:57:45.364305] [INFO ] [MAIN ] ODV: Loaded 20014 primary data records. [2025-09-14T20:57:45.511096] [DEBUG] [LOCAL ] OFG: Loaded 15623 existing records from primary storage. [2025-09-14T20:57:45.536178] [INFO ] [MAIN ] OFG: Loaded 15623 primary data records. [2025-09-14T20:57:45.662010] [DEBUG] [LOCAL ] OEC: Loaded 27729 existing records from primary storage. [2025-09-14T20:57:45.756264] [INFO ] [MAIN ] OEC: Loaded 27729 primary data records. [2025-09-14T20:57:46.303746] [DEBUG] [MAIN ] ODV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:46.306428] [INFO ] [MAIN ] ODV: Generated 1352 derivative records from 20014 primary records. [2025-09-14T20:57:46.307177] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-14T20:57:46.321757] [DEBUG] [LOCAL ] ODV: Derivative data saved (1352 records). [2025-09-14T20:57:46.322319] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-14T20:57:46.325034] [INFO ] [MAIN ] Derivative Progress: 1483/2226 symbols completed. ODV took 1.0s. Estimated remaining: 4m 21s. Rate: 170.8 symbols/min [2025-09-14T20:57:46.339143] [DEBUG] [MAIN ] OFG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:46.340747] [INFO ] [MAIN ] OFG: Generated 1352 derivative records from 15623 primary records. [2025-09-14T20:57:46.340877] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-14T20:57:46.352585] [DEBUG] [MAIN ] OEC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:46.362917] [INFO ] [MAIN ] OEC: Generated 1352 derivative records from 27729 primary records. [2025-09-14T20:57:46.364408] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-14T20:57:46.365321] [DEBUG] [LOCAL ] OFG: Derivative data saved (1352 records). [2025-09-14T20:57:46.365936] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-14T20:57:46.368878] [INFO ] [MAIN ] Derivative Progress: 1484/2226 symbols completed. OFG took 1.0s. Estimated remaining: 4m 21s. Rate: 170.9 symbols/min [2025-09-14T20:57:46.380933] [DEBUG] [LOCAL ] OEC: Derivative data saved (1352 records). [2025-09-14T20:57:46.381031] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-14T20:57:46.383115] [INFO ] [MAIN ] Derivative Progress: 1485/2226 symbols completed. OEC took 1.0s. Estimated remaining: 4m 20s. Rate: 171.0 symbols/min [2025-09-14T20:57:46.383733] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:46.383816] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:46.383892] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:46.412509] [DEBUG] [LOCAL ] OGS: Loaded 26261 existing records from primary storage. [2025-09-14T20:57:46.412716] [INFO ] [MAIN ] OGS: Loaded 26261 primary data records. [2025-09-14T20:57:46.607619] [DEBUG] [LOCAL ] OGE: Loaded 34641 existing records from primary storage. [2025-09-14T20:57:46.640211] [INFO ] [MAIN ] OGE: Loaded 34641 primary data records. [2025-09-14T20:57:46.643921] [DEBUG] [LOCAL ] OGN: Loaded 39992 existing records from primary storage. [2025-09-14T20:57:46.736283] [INFO ] [MAIN ] OGN: Loaded 39992 primary data records. [2025-09-14T20:57:47.365374] [DEBUG] [MAIN ] OGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:47.367218] [INFO ] [MAIN ] OGS: Generated 1352 derivative records from 26261 primary records. [2025-09-14T20:57:47.367777] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-14T20:57:47.385711] [DEBUG] [LOCAL ] OGS: Derivative data saved (1352 records). [2025-09-14T20:57:47.386731] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-14T20:57:47.390203] [INFO ] [MAIN ] Derivative Progress: 1486/2226 symbols completed. OGS took 1.0s. Estimated remaining: 4m 20s. Rate: 170.8 symbols/min [2025-09-14T20:57:47.391169] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:47.414550] [DEBUG] [MAIN ] OGE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:47.426866] [INFO ] [MAIN ] OGE: Generated 1352 derivative records from 34641 primary records. [2025-09-14T20:57:47.427441] [DEBUG] [MAIN ] OGN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:47.427655] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-14T20:57:47.430278] [INFO ] [MAIN ] OGN: Generated 1352 derivative records from 39992 primary records. [2025-09-14T20:57:47.431264] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-14T20:57:47.446588] [DEBUG] [LOCAL ] OGE: Derivative data saved (1352 records). [2025-09-14T20:57:47.447985] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-14T20:57:47.474029] [DEBUG] [LOCAL ] OGN: Derivative data saved (1352 records). [2025-09-14T20:57:47.473812] [INFO ] [MAIN ] Derivative Progress: 1487/2226 symbols completed. OGE took 1.1s. Estimated remaining: 4m 20s. Rate: 170.9 symbols/min [2025-09-14T20:57:47.474373] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:47.474799] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-14T20:57:47.477898] [INFO ] [MAIN ] Derivative Progress: 1488/2226 symbols completed. OGN took 1.1s. Estimated remaining: 4m 19s. Rate: 171.0 symbols/min [2025-09-14T20:57:47.478707] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:47.499852] [DEBUG] [LOCAL ] OHI: Loaded 39212 existing records from primary storage. [2025-09-14T20:57:47.500253] [INFO ] [MAIN ] OHI: Loaded 39212 primary data records. [2025-09-14T20:57:47.526975] [DEBUG] [LOCAL ] OIA: Loaded 9906 existing records from primary storage. [2025-09-14T20:57:47.588888] [INFO ] [MAIN ] OIA: Loaded 9906 primary data records. [2025-09-14T20:57:48.079208] [DEBUG] [LOCAL ] OI: Loaded 35376 existing records from primary storage. [2025-09-14T20:57:48.110104] [INFO ] [MAIN ] OI: Loaded 35376 primary data records. [2025-09-14T20:57:48.443536] [DEBUG] [MAIN ] OHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:48.531752] [INFO ] [MAIN ] OHI: Generated 1352 derivative records from 39212 primary records. [2025-09-14T20:57:48.602147] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-14T20:57:48.716829] [DEBUG] [LOCAL ] OHI: Derivative data saved (1352 records). [2025-09-14T20:57:48.723830] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-14T20:57:48.829330] [INFO ] [MAIN ] Derivative Progress: 1489/2226 symbols completed. OHI took 1.4s. Estimated remaining: 4m 19s. Rate: 170.6 symbols/min [2025-09-14T20:57:48.831559] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:48.853939] [DEBUG] [MAIN ] OIA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:48.855244] [INFO ] [MAIN ] OIA: Generated 1352 derivative records from 9906 primary records. [2025-09-14T20:57:48.855724] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-14T20:57:48.883135] [DEBUG] [LOCAL ] OIA: Derivative data saved (1352 records). [2025-09-14T20:57:48.884805] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-14T20:57:48.887815] [INFO ] [MAIN ] Derivative Progress: 1490/2226 symbols completed. OIA took 1.4s. Estimated remaining: 4m 19s. Rate: 170.7 symbols/min [2025-09-14T20:57:48.888362] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:48.906988] [DEBUG] [MAIN ] OI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:48.920095] [INFO ] [MAIN ] OI: Generated 1352 derivative records from 35376 primary records. [2025-09-14T20:57:48.920236] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-14T20:57:48.921174] [DEBUG] [LOCAL ] OII: Loaded 31748 existing records from primary storage. [2025-09-14T20:57:48.922584] [INFO ] [MAIN ] OII: Loaded 31748 primary data records. [2025-09-14T20:57:48.995216] [DEBUG] [LOCAL ] OI: Derivative data saved (1352 records). [2025-09-14T20:57:49.035127] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-14T20:57:49.056102] [INFO ] [MAIN ] Derivative Progress: 1491/2226 symbols completed. OI took 1.6s. Estimated remaining: 4m 18s. Rate: 170.8 symbols/min [2025-09-14T20:57:49.091753] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:49.146411] [DEBUG] [LOCAL ] OIS: Loaded 30281 existing records from primary storage. [2025-09-14T20:57:49.153568] [INFO ] [MAIN ] OIS: Loaded 30281 primary data records. [2025-09-14T20:57:49.569483] [DEBUG] [LOCAL ] OKE: Loaded 40329 existing records from primary storage. [2025-09-14T20:57:49.572425] [INFO ] [MAIN ] OKE: Loaded 40329 primary data records. [2025-09-14T20:57:49.635153] [DEBUG] [MAIN ] OII: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:49.686022] [INFO ] [MAIN ] OII: Generated 1352 derivative records from 31748 primary records. [2025-09-14T20:57:49.707454] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-14T20:57:49.803153] [DEBUG] [LOCAL ] OII: Derivative data saved (1352 records). [2025-09-14T20:57:49.891310] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-14T20:57:49.896103] [INFO ] [MAIN ] Derivative Progress: 1492/2226 symbols completed. OII took 1.1s. Estimated remaining: 4m 18s. Rate: 170.6 symbols/min [2025-09-14T20:57:49.897038] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:49.909561] [DEBUG] [MAIN ] OIS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:49.911244] [INFO ] [MAIN ] OIS: Generated 1352 derivative records from 30281 primary records. [2025-09-14T20:57:49.911672] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-14T20:57:49.926557] [DEBUG] [LOCAL ] OIS: Derivative data saved (1352 records). [2025-09-14T20:57:49.926958] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-14T20:57:49.929695] [INFO ] [MAIN ] Derivative Progress: 1493/2226 symbols completed. OIS took 1.0s. Estimated remaining: 4m 18s. Rate: 170.7 symbols/min [2025-09-14T20:57:49.930271] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:49.949334] [DEBUG] [MAIN ] OKE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:49.963137] [DEBUG] [LOCAL ] OLP: Loaded 6945 existing records from primary storage. [2025-09-14T20:57:49.963404] [INFO ] [MAIN ] OLP: Loaded 6945 primary data records. [2025-09-14T20:57:49.964241] [INFO ] [MAIN ] OKE: Generated 1352 derivative records from 40329 primary records. [2025-09-14T20:57:50.001220] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-14T20:57:50.100702] [DEBUG] [LOCAL ] OKLO: Loaded 40559 existing records from primary storage. [2025-09-14T20:57:50.119556] [INFO ] [MAIN ] OKLO: Loaded 40559 primary data records. [2025-09-14T20:57:50.124880] [DEBUG] [LOCAL ] OKE: Derivative data saved (1352 records). [2025-09-14T20:57:50.221899] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-14T20:57:50.319173] [INFO ] [MAIN ] Derivative Progress: 1494/2226 symbols completed. OKE took 1.2s. Estimated remaining: 4m 17s. Rate: 170.7 symbols/min [2025-09-14T20:57:50.359506] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:50.572383] [DEBUG] [MAIN ] OLP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:50.583073] [INFO ] [MAIN ] OLP: Generated 1352 derivative records from 6945 primary records. [2025-09-14T20:57:50.583382] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-14T20:57:50.597271] [DEBUG] [LOCAL ] OLP: Derivative data saved (1352 records). [2025-09-14T20:57:50.609312] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-14T20:57:50.612668] [DEBUG] [LOCAL ] OMC: Loaded 40064 existing records from primary storage. [2025-09-14T20:57:50.611704] [INFO ] [MAIN ] Derivative Progress: 1495/2226 symbols completed. OLP took 0.7s. Estimated remaining: 4m 17s. Rate: 170.7 symbols/min [2025-09-14T20:57:50.615002] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:50.615677] [INFO ] [MAIN ] OMC: Loaded 40064 primary data records. [2025-09-14T20:57:50.713169] [DEBUG] [MAIN ] OKLO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:50.738423] [INFO ] [MAIN ] OKLO: Generated 1352 derivative records from 40559 primary records. [2025-09-14T20:57:50.739081] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-09-14T20:57:50.842117] [DEBUG] [LOCAL ] OKLO: Derivative data saved (1352 records). [2025-09-14T20:57:50.984334] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-09-14T20:57:50.988321] [INFO ] [MAIN ] Derivative Progress: 1496/2226 symbols completed. OKLO took 1.1s. Estimated remaining: 4m 17s. Rate: 170.7 symbols/min [2025-09-14T20:57:50.990452] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:50.989616] [DEBUG] [LOCAL ] OMF: Loaded 34325 existing records from primary storage. [2025-09-14T20:57:50.990778] [INFO ] [MAIN ] OMF: Loaded 34325 primary data records. [2025-09-14T20:57:51.289337] [DEBUG] [LOCAL ] OMI: Loaded 34185 existing records from primary storage. [2025-09-14T20:57:51.291367] [INFO ] [MAIN ] OMI: Loaded 34185 primary data records. [2025-09-14T20:57:51.414705] [DEBUG] [MAIN ] OMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:51.457453] [INFO ] [MAIN ] OMC: Generated 1352 derivative records from 40064 primary records. [2025-09-14T20:57:51.495798] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-14T20:57:51.608525] [DEBUG] [LOCAL ] OMC: Derivative data saved (1352 records). [2025-09-14T20:57:51.609339] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-14T20:57:51.611443] [INFO ] [MAIN ] Derivative Progress: 1497/2226 symbols completed. OMC took 1.3s. Estimated remaining: 4m 16s. Rate: 170.6 symbols/min [2025-09-14T20:57:51.622061] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:51.623286] [DEBUG] [MAIN ] OMF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:51.625008] [INFO ] [MAIN ] OMF: Generated 1352 derivative records from 34325 primary records. [2025-09-14T20:57:51.625261] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-14T20:57:51.639757] [DEBUG] [LOCAL ] OMF: Derivative data saved (1352 records). [2025-09-14T20:57:51.640107] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-14T20:57:51.642741] [INFO ] [MAIN ] Derivative Progress: 1498/2226 symbols completed. OMF took 1.0s. Estimated remaining: 4m 16s. Rate: 170.8 symbols/min [2025-09-14T20:57:51.646606] [DEBUG] [LOCAL ] ONIT: Loaded 5818 existing records from primary storage. [2025-09-14T20:57:51.647073] [INFO ] [MAIN ] ONIT: Loaded 5818 primary data records. [2025-09-14T20:57:51.823280] [DEBUG] [MAIN ] OMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:51.840987] [INFO ] [MAIN ] OMI: Generated 1352 derivative records from 34185 primary records. [2025-09-14T20:57:51.920536] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-14T20:57:51.946925] [DEBUG] [LOCAL ] OMI: Derivative data saved (1352 records). [2025-09-14T20:57:51.947538] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-14T20:57:51.949434] [INFO ] [MAIN ] Derivative Progress: 1499/2226 symbols completed. OMI took 1.0s. Estimated remaining: 4m 15s. Rate: 170.8 symbols/min [2025-09-14T20:57:51.966073] [DEBUG] [MAIN ] ONIT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:51.966862] [INFO ] [MAIN ] ONIT: Generated 1352 derivative records from 5818 primary records. [2025-09-14T20:57:51.966943] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-14T20:57:51.978770] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1352 records). [2025-09-14T20:57:51.978877] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-14T20:57:51.980763] [INFO ] [MAIN ] Derivative Progress: 1500/2226 symbols completed. ONIT took 0.4s. Estimated remaining: 4m 15s. Rate: 170.9 symbols/min [2025-09-14T20:57:51.981431] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:51.981681] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:51.981865] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:52.019606] [DEBUG] [LOCAL ] OOMA: Loaded 13939 existing records from primary storage. [2025-09-14T20:57:52.020216] [DEBUG] [LOCAL ] ONL: Loaded 22844 existing records from primary storage. [2025-09-14T20:57:52.020549] [INFO ] [MAIN ] OOMA: Loaded 13939 primary data records. [2025-09-14T20:57:52.020634] [INFO ] [MAIN ] ONL: Loaded 22844 primary data records. [2025-09-14T20:57:52.281675] [DEBUG] [LOCAL ] ONTO: Loaded 35192 existing records from primary storage. [2025-09-14T20:57:52.324246] [INFO ] [MAIN ] ONTO: Loaded 35192 primary data records. [2025-09-14T20:57:52.959906] [DEBUG] [MAIN ] ONL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:52.961165] [INFO ] [MAIN ] ONL: Generated 1352 derivative records from 22844 primary records. [2025-09-14T20:57:52.967191] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-14T20:57:52.971566] [DEBUG] [MAIN ] OOMA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:52.973095] [INFO ] [MAIN ] OOMA: Generated 1352 derivative records from 13939 primary records. [2025-09-14T20:57:52.988254] [DEBUG] [LOCAL ] ONL: Derivative data saved (1352 records). [2025-09-14T20:57:52.987206] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-14T20:57:52.988706] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-14T20:57:53.001680] [INFO ] [MAIN ] Derivative Progress: 1501/2226 symbols completed. ONL took 1.0s. Estimated remaining: 4m 15s. Rate: 170.7 symbols/min [2025-09-14T20:57:53.003081] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:53.003412] [DEBUG] [MAIN ] ONTO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:53.014689] [INFO ] [MAIN ] ONTO: Generated 1352 derivative records from 35192 primary records. [2025-09-14T20:57:53.017906] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-14T20:57:53.018450] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1352 records). [2025-09-14T20:57:53.019148] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-14T20:57:53.022134] [INFO ] [MAIN ] Derivative Progress: 1502/2226 symbols completed. OOMA took 1.0s. Estimated remaining: 4m 14s. Rate: 170.8 symbols/min [2025-09-14T20:57:53.036785] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:53.039989] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1352 records). [2025-09-14T20:57:53.040244] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-14T20:57:53.042525] [INFO ] [MAIN ] Derivative Progress: 1503/2226 symbols completed. ONTO took 1.1s. Estimated remaining: 4m 14s. Rate: 170.9 symbols/min [2025-09-14T20:57:53.043130] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:53.050509] [DEBUG] [LOCAL ] OPAD: Loaded 16216 existing records from primary storage. [2025-09-14T20:57:53.050974] [INFO ] [MAIN ] OPAD: Loaded 16216 primary data records. [2025-09-14T20:57:53.153829] [DEBUG] [LOCAL ] OPP: Loaded 8746 existing records from primary storage. [2025-09-14T20:57:53.178421] [INFO ] [MAIN ] OPP: Loaded 8746 primary data records. [2025-09-14T20:57:53.418500] [DEBUG] [LOCAL ] OPFI: Loaded 34815 existing records from primary storage. [2025-09-14T20:57:53.543351] [INFO ] [MAIN ] OPFI: Loaded 34815 primary data records. [2025-09-14T20:57:54.062675] [DEBUG] [MAIN ] OPAD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:54.063882] [INFO ] [MAIN ] OPAD: Generated 1352 derivative records from 16216 primary records. [2025-09-14T20:57:54.065660] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-14T20:57:54.083060] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1352 records). [2025-09-14T20:57:54.096229] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-14T20:57:54.096568] [DEBUG] [MAIN ] OPP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:54.097814] [INFO ] [MAIN ] OPP: Generated 1352 derivative records from 8746 primary records. [2025-09-14T20:57:54.100007] [INFO ] [MAIN ] Derivative Progress: 1504/2226 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 14s. Rate: 170.6 symbols/min [2025-09-14T20:57:54.106125] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-14T20:57:54.112328] [DEBUG] [MAIN ] OPFI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:54.112388] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:54.123055] [INFO ] [MAIN ] OPFI: Generated 1352 derivative records from 34815 primary records. [2025-09-14T20:57:54.124839] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-14T20:57:54.126841] [DEBUG] [LOCAL ] OPP: Derivative data saved (1352 records). [2025-09-14T20:57:54.127244] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-14T20:57:54.130755] [INFO ] [MAIN ] Derivative Progress: 1505/2226 symbols completed. OPP took 1.1s. Estimated remaining: 4m 13s. Rate: 170.7 symbols/min [2025-09-14T20:57:54.131724] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:54.146970] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1352 records). [2025-09-14T20:57:54.147209] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-14T20:57:54.150989] [INFO ] [MAIN ] Derivative Progress: 1506/2226 symbols completed. OPFI took 1.1s. Estimated remaining: 4m 13s. Rate: 170.8 symbols/min [2025-09-14T20:57:54.151830] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:54.180388] [DEBUG] [LOCAL ] ORA: Loaded 24057 existing records from primary storage. [2025-09-14T20:57:54.192258] [INFO ] [MAIN ] ORA: Loaded 24057 primary data records. [2025-09-14T20:57:54.193866] [DEBUG] [LOCAL ] OR: Loaded 34207 existing records from primary storage. [2025-09-14T20:57:54.199699] [INFO ] [MAIN ] OR: Loaded 34207 primary data records. [2025-09-14T20:57:54.685335] [DEBUG] [LOCAL ] ORC: Loaded 39449 existing records from primary storage. [2025-09-14T20:57:54.788181] [INFO ] [MAIN ] ORC: Loaded 39449 primary data records. [2025-09-14T20:57:55.107067] [DEBUG] [MAIN ] ORA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:55.109450] [INFO ] [MAIN ] ORA: Generated 1352 derivative records from 24057 primary records. [2025-09-14T20:57:55.109765] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-14T20:57:55.121505] [DEBUG] [MAIN ] OR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:55.122355] [INFO ] [MAIN ] OR: Generated 1352 derivative records from 34207 primary records. [2025-09-14T20:57:55.123926] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-14T20:57:55.146885] [DEBUG] [LOCAL ] ORA: Derivative data saved (1352 records). [2025-09-14T20:57:55.150320] [DEBUG] [LOCAL ] OR: Derivative data saved (1352 records). [2025-09-14T20:57:55.150568] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-14T20:57:55.151238] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-14T20:57:55.153308] [INFO ] [MAIN ] Derivative Progress: 1507/2226 symbols completed. ORA took 1.0s. Estimated remaining: 4m 13s. Rate: 170.6 symbols/min [2025-09-14T20:57:55.157556] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:55.157620] [INFO ] [MAIN ] Derivative Progress: 1508/2226 symbols completed. OR took 1.0s. Estimated remaining: 4m 12s. Rate: 170.8 symbols/min [2025-09-14T20:57:55.160289] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:55.172258] [DEBUG] [MAIN ] ORC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:55.173410] [INFO ] [MAIN ] ORC: Generated 1352 derivative records from 39449 primary records. [2025-09-14T20:57:55.173614] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-14T20:57:55.192822] [DEBUG] [LOCAL ] ORC: Derivative data saved (1352 records). [2025-09-14T20:57:55.193219] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-14T20:57:55.195220] [INFO ] [MAIN ] Derivative Progress: 1509/2226 symbols completed. ORC took 1.0s. Estimated remaining: 4m 12s. Rate: 170.9 symbols/min [2025-09-14T20:57:55.195772] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:55.210311] [DEBUG] [LOCAL ] ORN: Loaded 23351 existing records from primary storage. [2025-09-14T20:57:55.210676] [INFO ] [MAIN ] ORN: Loaded 23351 primary data records. [2025-09-14T20:57:55.413151] [DEBUG] [LOCAL ] OSCR: Loaded 40515 existing records from primary storage. [2025-09-14T20:57:55.441874] [INFO ] [MAIN ] OSCR: Loaded 40515 primary data records. [2025-09-14T20:57:55.579033] [DEBUG] [LOCAL ] OTIS: Loaded 39660 existing records from primary storage. [2025-09-14T20:57:55.616214] [INFO ] [MAIN ] OTIS: Loaded 39660 primary data records. [2025-09-14T20:57:56.197785] [DEBUG] [MAIN ] ORN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:56.199353] [INFO ] [MAIN ] ORN: Generated 1352 derivative records from 23351 primary records. [2025-09-14T20:57:56.199690] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-14T20:57:56.214700] [DEBUG] [LOCAL ] ORN: Derivative data saved (1352 records). [2025-09-14T20:57:56.217398] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-14T20:57:56.219853] [INFO ] [MAIN ] Derivative Progress: 1510/2226 symbols completed. ORN took 1.1s. Estimated remaining: 4m 12s. Rate: 170.6 symbols/min [2025-09-14T20:57:56.220296] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:56.231177] [DEBUG] [MAIN ] OSCR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:56.232125] [INFO ] [MAIN ] OSCR: Generated 1352 derivative records from 40515 primary records. [2025-09-14T20:57:56.232440] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-14T20:57:56.258147] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1352 records). [2025-09-14T20:57:56.258594] [DEBUG] [MAIN ] OTIS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:56.258793] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-14T20:57:56.259546] [INFO ] [MAIN ] OTIS: Generated 1352 derivative records from 39660 primary records. [2025-09-14T20:57:56.259769] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-14T20:57:56.261683] [INFO ] [MAIN ] Derivative Progress: 1511/2226 symbols completed. OSCR took 1.1s. Estimated remaining: 4m 11s. Rate: 170.7 symbols/min [2025-09-14T20:57:56.263290] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:56.278094] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1352 records). [2025-09-14T20:57:56.286766] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-14T20:57:56.288739] [INFO ] [MAIN ] Derivative Progress: 1512/2226 symbols completed. OTIS took 1.1s. Estimated remaining: 4m 11s. Rate: 170.8 symbols/min [2025-09-14T20:57:56.289274] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:56.305463] [DEBUG] [LOCAL ] OUT: Loaded 36209 existing records from primary storage. [2025-09-14T20:57:56.305851] [INFO ] [MAIN ] OUT: Loaded 36209 primary data records. [2025-09-14T20:57:56.468808] [DEBUG] [LOCAL ] OVV: Loaded 40277 existing records from primary storage. [2025-09-14T20:57:56.474413] [INFO ] [MAIN ] OVV: Loaded 40277 primary data records. [2025-09-14T20:57:56.602183] [DEBUG] [LOCAL ] OWL: Loaded 40303 existing records from primary storage. [2025-09-14T20:57:56.728291] [INFO ] [MAIN ] OWL: Loaded 40303 primary data records. [2025-09-14T20:57:57.224961] [DEBUG] [MAIN ] OUT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:57.226380] [INFO ] [MAIN ] OUT: Generated 1352 derivative records from 36209 primary records. [2025-09-14T20:57:57.227346] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-14T20:57:57.243217] [DEBUG] [LOCAL ] OUT: Derivative data saved (1352 records). [2025-09-14T20:57:57.243909] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-14T20:57:57.246462] [INFO ] [MAIN ] Derivative Progress: 1513/2226 symbols completed. OUT took 1.0s. Estimated remaining: 4m 11s. Rate: 170.6 symbols/min [2025-09-14T20:57:57.261663] [DEBUG] [MAIN ] OVV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:57.263974] [INFO ] [MAIN ] OVV: Generated 1352 derivative records from 40277 primary records. [2025-09-14T20:57:57.264198] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-14T20:57:57.275150] [DEBUG] [MAIN ] OWL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:57.287457] [INFO ] [MAIN ] OWL: Generated 1352 derivative records from 40303 primary records. [2025-09-14T20:57:57.287925] [DEBUG] [LOCAL ] OVV: Derivative data saved (1352 records). [2025-09-14T20:57:57.288098] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-14T20:57:57.288156] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-14T20:57:57.290948] [INFO ] [MAIN ] Derivative Progress: 1514/2226 symbols completed. OVV took 1.0s. Estimated remaining: 4m 10s. Rate: 170.7 symbols/min [2025-09-14T20:57:57.305768] [DEBUG] [LOCAL ] OWL: Derivative data saved (1352 records). [2025-09-14T20:57:57.305996] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-14T20:57:57.308117] [INFO ] [MAIN ] Derivative Progress: 1515/2226 symbols completed. OWL took 1.0s. Estimated remaining: 4m 10s. Rate: 170.9 symbols/min [2025-09-14T20:57:57.308914] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:57.309100] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:57.309251] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:57.322308] [DEBUG] [LOCAL ] OWLT: Loaded 6949 existing records from primary storage. [2025-09-14T20:57:57.323180] [INFO ] [MAIN ] OWLT: Loaded 6949 primary data records. [2025-09-14T20:57:57.509126] [DEBUG] [LOCAL ] OXM: Loaded 24739 existing records from primary storage. [2025-09-14T20:57:57.540712] [INFO ] [MAIN ] OXM: Loaded 24739 primary data records. [2025-09-14T20:57:57.673542] [DEBUG] [LOCAL ] PAAS: Loaded 40365 existing records from primary storage. [2025-09-14T20:57:57.709111] [INFO ] [MAIN ] PAAS: Loaded 40365 primary data records. [2025-09-14T20:57:58.278711] [DEBUG] [MAIN ] OWLT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:58.280385] [INFO ] [MAIN ] OWLT: Generated 1352 derivative records from 6949 primary records. [2025-09-14T20:57:58.280710] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-14T20:57:58.298273] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1352 records). [2025-09-14T20:57:58.298694] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-14T20:57:58.311154] [INFO ] [MAIN ] Derivative Progress: 1516/2226 symbols completed. OWLT took 1.0s. Estimated remaining: 4m 10s. Rate: 170.6 symbols/min [2025-09-14T20:57:58.311572] [DEBUG] [MAIN ] OXM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:58.312364] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:58.313481] [INFO ] [MAIN ] OXM: Generated 1352 derivative records from 24739 primary records. [2025-09-14T20:57:58.314061] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-14T20:57:58.328889] [DEBUG] [LOCAL ] OXM: Derivative data saved (1352 records). [2025-09-14T20:57:58.334569] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-14T20:57:58.337379] [INFO ] [MAIN ] Derivative Progress: 1517/2226 symbols completed. OXM took 1.0s. Estimated remaining: 4m 9s. Rate: 170.7 symbols/min [2025-09-14T20:57:58.337811] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:58.352939] [DEBUG] [MAIN ] PAAS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:58.353621] [DEBUG] [LOCAL ] PAC: Loaded 8602 existing records from primary storage. [2025-09-14T20:57:58.354951] [INFO ] [MAIN ] PAAS: Generated 1352 derivative records from 40365 primary records. [2025-09-14T20:57:58.355117] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-14T20:57:58.355428] [INFO ] [MAIN ] PAC: Loaded 8602 primary data records. [2025-09-14T20:57:58.448705] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1352 records). [2025-09-14T20:57:58.467266] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-14T20:57:58.486934] [INFO ] [MAIN ] Derivative Progress: 1518/2226 symbols completed. PAAS took 1.2s. Estimated remaining: 4m 9s. Rate: 170.8 symbols/min [2025-09-14T20:57:58.509134] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:58.583848] [DEBUG] [LOCAL ] PACK: Loaded 23281 existing records from primary storage. [2025-09-14T20:57:58.588443] [INFO ] [MAIN ] PACK: Loaded 23281 primary data records. [2025-09-14T20:57:58.838384] [DEBUG] [LOCAL ] PACS: Loaded 25091 existing records from primary storage. [2025-09-14T20:57:58.867158] [INFO ] [MAIN ] PACS: Loaded 25091 primary data records. [2025-09-14T20:57:59.210256] [DEBUG] [MAIN ] PAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:59.300910] [INFO ] [MAIN ] PAC: Generated 1352 derivative records from 8602 primary records. [2025-09-14T20:57:59.301434] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-14T20:57:59.317522] [DEBUG] [LOCAL ] PAC: Derivative data saved (1352 records). [2025-09-14T20:57:59.321538] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-14T20:57:59.324548] [INFO ] [MAIN ] Derivative Progress: 1519/2226 symbols completed. PAC took 1.0s. Estimated remaining: 4m 9s. Rate: 170.7 symbols/min [2025-09-14T20:57:59.336534] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:59.338119] [DEBUG] [MAIN ] PACK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:59.339222] [INFO ] [MAIN ] PACK: Generated 1352 derivative records from 23281 primary records. [2025-09-14T20:57:59.340681] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-14T20:57:59.354409] [DEBUG] [LOCAL ] PACK: Derivative data saved (1352 records). [2025-09-14T20:57:59.360357] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-14T20:57:59.363354] [INFO ] [MAIN ] Derivative Progress: 1520/2226 symbols completed. PACK took 1.0s. Estimated remaining: 4m 8s. Rate: 170.8 symbols/min [2025-09-14T20:57:59.364174] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:59.374885] [DEBUG] [LOCAL ] PAG: Loaded 15705 existing records from primary storage. [2025-09-14T20:57:59.385098] [INFO ] [MAIN ] PAG: Loaded 15705 primary data records. [2025-09-14T20:57:59.385562] [DEBUG] [MAIN ] PACS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:57:59.399386] [INFO ] [MAIN ] PACS: Generated 1352 derivative records from 25091 primary records. [2025-09-14T20:57:59.425307] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-14T20:57:59.509144] [DEBUG] [LOCAL ] PACS: Derivative data saved (1352 records). [2025-09-14T20:57:59.521132] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-14T20:57:59.524305] [INFO ] [MAIN ] Derivative Progress: 1521/2226 symbols completed. PACS took 1.0s. Estimated remaining: 4m 8s. Rate: 170.8 symbols/min [2025-09-14T20:57:59.530570] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:57:59.713722] [DEBUG] [LOCAL ] PAGS: Loaded 39690 existing records from primary storage. [2025-09-14T20:57:59.713598] [DEBUG] [LOCAL ] PAI: Loaded 1976 existing records from primary storage. [2025-09-14T20:57:59.714691] [INFO ] [MAIN ] PAGS: Loaded 39690 primary data records. [2025-09-14T20:57:59.714803] [INFO ] [MAIN ] PAI: Loaded 1976 primary data records. [2025-09-14T20:58:00.409459] [DEBUG] [MAIN ] PAG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:00.411920] [INFO ] [MAIN ] PAG: Generated 1352 derivative records from 15705 primary records. [2025-09-14T20:58:00.412961] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-14T20:58:00.429025] [DEBUG] [LOCAL ] PAG: Derivative data saved (1352 records). [2025-09-14T20:58:00.430734] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-14T20:58:00.433056] [INFO ] [MAIN ] Derivative Progress: 1522/2226 symbols completed. PAG took 1.1s. Estimated remaining: 4m 8s. Rate: 170.6 symbols/min [2025-09-14T20:58:00.434535] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:00.471306] [DEBUG] [MAIN ] PAGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:00.472815] [INFO ] [MAIN ] PAGS: Generated 1352 derivative records from 39690 primary records. [2025-09-14T20:58:00.471783] [DEBUG] [MAIN ] PAI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:00.473081] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-14T20:58:00.474028] [INFO ] [MAIN ] PAI: Generated 1352 derivative records from 1976 primary records. [2025-09-14T20:58:00.475088] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-14T20:58:00.498216] [DEBUG] [LOCAL ] PAI: Derivative data saved (1352 records). [2025-09-14T20:58:00.506135] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-14T20:58:00.510061] [INFO ] [MAIN ] Derivative Progress: 1523/2226 symbols completed. PAI took 1.0s. Estimated remaining: 4m 7s. Rate: 170.7 symbols/min [2025-09-14T20:58:00.507593] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1352 records). [2025-09-14T20:58:00.510952] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:00.511277] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-14T20:58:00.515018] [INFO ] [MAIN ] Derivative Progress: 1524/2226 symbols completed. PAGS took 1.2s. Estimated remaining: 4m 7s. Rate: 170.8 symbols/min [2025-09-14T20:58:00.510851] [DEBUG] [LOCAL ] PAM: Loaded 20366 existing records from primary storage. [2025-09-14T20:58:00.515731] [INFO ] [MAIN ] PAM: Loaded 20366 primary data records. [2025-09-14T20:58:00.516038] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:00.730948] [DEBUG] [LOCAL ] PAR: Loaded 24234 existing records from primary storage. [2025-09-14T20:58:00.819005] [INFO ] [MAIN ] PAR: Loaded 24234 primary data records. [2025-09-14T20:58:00.940205] [DEBUG] [LOCAL ] PARR: Loaded 36297 existing records from primary storage. [2025-09-14T20:58:00.967506] [INFO ] [MAIN ] PARR: Loaded 36297 primary data records. [2025-09-14T20:58:01.330764] [DEBUG] [MAIN ] PAM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:01.428410] [INFO ] [MAIN ] PAM: Generated 1352 derivative records from 20366 primary records. [2025-09-14T20:58:01.428553] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-14T20:58:01.444662] [DEBUG] [LOCAL ] PAM: Derivative data saved (1352 records). [2025-09-14T20:58:01.446525] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-14T20:58:01.450635] [INFO ] [MAIN ] Derivative Progress: 1525/2226 symbols completed. PAM took 1.0s. Estimated remaining: 4m 6s. Rate: 170.6 symbols/min [2025-09-14T20:58:01.457469] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:01.461757] [DEBUG] [MAIN ] PAR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:01.463046] [INFO ] [MAIN ] PAR: Generated 1352 derivative records from 24234 primary records. [2025-09-14T20:58:01.463563] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-14T20:58:01.479056] [DEBUG] [LOCAL ] PAR: Derivative data saved (1352 records). [2025-09-14T20:58:01.479225] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-14T20:58:01.481569] [INFO ] [MAIN ] Derivative Progress: 1526/2226 symbols completed. PAR took 1.0s. Estimated remaining: 4m 6s. Rate: 170.8 symbols/min [2025-09-14T20:58:01.482453] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:01.497974] [DEBUG] [MAIN ] PARR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:01.498809] [INFO ] [MAIN ] PARR: Generated 1352 derivative records from 36297 primary records. [2025-09-14T20:58:01.498923] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-14T20:58:01.527023] [DEBUG] [LOCAL ] PARR: Derivative data saved (1352 records). [2025-09-14T20:58:01.533596] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-14T20:58:01.536451] [INFO ] [MAIN ] Derivative Progress: 1527/2226 symbols completed. PARR took 1.0s. Estimated remaining: 4m 5s. Rate: 170.8 symbols/min [2025-09-14T20:58:01.534145] [DEBUG] [LOCAL ] PAXS: Loaded 15963 existing records from primary storage. [2025-09-14T20:58:01.536826] [INFO ] [MAIN ] PAXS: Loaded 15963 primary data records. [2025-09-14T20:58:01.537048] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:01.661417] [DEBUG] [LOCAL ] PATH: Loaded 40422 existing records from primary storage. [2025-09-14T20:58:01.661967] [INFO ] [MAIN ] PATH: Loaded 40422 primary data records. [2025-09-14T20:58:01.834341] [DEBUG] [LOCAL ] PAY: Loaded 28848 existing records from primary storage. [2025-09-14T20:58:01.948223] [INFO ] [MAIN ] PAY: Loaded 28848 primary data records. [2025-09-14T20:58:02.444956] [DEBUG] [MAIN ] PAXS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:02.446312] [INFO ] [MAIN ] PAXS: Generated 1352 derivative records from 15963 primary records. [2025-09-14T20:58:02.447126] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-14T20:58:02.463020] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1352 records). [2025-09-14T20:58:02.464618] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-14T20:58:02.466658] [INFO ] [MAIN ] Derivative Progress: 1528/2226 symbols completed. PAXS took 1.0s. Estimated remaining: 4m 5s. Rate: 170.7 symbols/min [2025-09-14T20:58:02.477307] [DEBUG] [MAIN ] PATH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:02.478055] [INFO ] [MAIN ] PATH: Generated 1352 derivative records from 40422 primary records. [2025-09-14T20:58:02.478327] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-14T20:58:02.491040] [DEBUG] [LOCAL ] PATH: Derivative data saved (1352 records). [2025-09-14T20:58:02.492449] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-14T20:58:02.494968] [INFO ] [MAIN ] Derivative Progress: 1529/2226 symbols completed. PATH took 1.0s. Estimated remaining: 4m 5s. Rate: 170.8 symbols/min [2025-09-14T20:58:02.506042] [DEBUG] [MAIN ] PAY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:02.506680] [INFO ] [MAIN ] PAY: Generated 1352 derivative records from 28848 primary records. [2025-09-14T20:58:02.506758] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-14T20:58:02.518727] [DEBUG] [LOCAL ] PAY: Derivative data saved (1352 records). [2025-09-14T20:58:02.518807] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-14T20:58:02.521052] [INFO ] [MAIN ] Derivative Progress: 1530/2226 symbols completed. PAY took 1.0s. Estimated remaining: 4m 4s. Rate: 170.9 symbols/min [2025-09-14T20:58:02.521525] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:02.521627] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:02.521958] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:02.580058] [DEBUG] [LOCAL ] PAYC: Loaded 26500 existing records from primary storage. [2025-09-14T20:58:02.580405] [INFO ] [MAIN ] PAYC: Loaded 26500 primary data records. [2025-09-14T20:58:02.580900] [DEBUG] [LOCAL ] PB: Loaded 31174 existing records from primary storage. [2025-09-14T20:58:02.592817] [INFO ] [MAIN ] PB: Loaded 31174 primary data records. [2025-09-14T20:58:02.822225] [DEBUG] [LOCAL ] PBA: Loaded 36908 existing records from primary storage. [2025-09-14T20:58:02.860528] [INFO ] [MAIN ] PBA: Loaded 36908 primary data records. [2025-09-14T20:58:03.487803] [DEBUG] [MAIN ] PAYC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:03.489217] [INFO ] [MAIN ] PAYC: Generated 1352 derivative records from 26500 primary records. [2025-09-14T20:58:03.489816] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-14T20:58:03.508210] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1352 records). [2025-09-14T20:58:03.519361] [DEBUG] [MAIN ] PB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:03.518419] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-14T20:58:03.522834] [INFO ] [MAIN ] PB: Generated 1352 derivative records from 31174 primary records. [2025-09-14T20:58:03.521719] [INFO ] [MAIN ] Derivative Progress: 1531/2226 symbols completed. PAYC took 1.0s. Estimated remaining: 4m 4s. Rate: 170.7 symbols/min [2025-09-14T20:58:03.530022] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-14T20:58:03.530112] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:03.549232] [DEBUG] [MAIN ] PBA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:03.554831] [INFO ] [MAIN ] PBA: Generated 1352 derivative records from 36908 primary records. [2025-09-14T20:58:03.557355] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-14T20:58:03.557276] [DEBUG] [LOCAL ] PB: Derivative data saved (1352 records). [2025-09-14T20:58:03.558508] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-14T20:58:03.568523] [INFO ] [MAIN ] Derivative Progress: 1532/2226 symbols completed. PB took 1.0s. Estimated remaining: 4m 4s. Rate: 170.8 symbols/min [2025-09-14T20:58:03.574166] [DEBUG] [LOCAL ] PBA: Derivative data saved (1352 records). [2025-09-14T20:58:03.574608] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:03.574693] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-14T20:58:03.578984] [INFO ] [MAIN ] Derivative Progress: 1533/2226 symbols completed. PBA took 1.1s. Estimated remaining: 4m 3s. Rate: 170.9 symbols/min [2025-09-14T20:58:03.580542] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:03.617170] [DEBUG] [LOCAL ] PBH: Loaded 23964 existing records from primary storage. [2025-09-14T20:58:03.617465] [INFO ] [MAIN ] PBH: Loaded 23964 primary data records. [2025-09-14T20:58:03.765427] [DEBUG] [LOCAL ] PBF: Loaded 40016 existing records from primary storage. [2025-09-14T20:58:03.782045] [DEBUG] [LOCAL ] PBI: Loaded 37490 existing records from primary storage. [2025-09-14T20:58:03.787602] [INFO ] [MAIN ] PBF: Loaded 40016 primary data records. [2025-09-14T20:58:03.822206] [INFO ] [MAIN ] PBI: Loaded 37490 primary data records. [2025-09-14T20:58:04.547311] [DEBUG] [MAIN ] PBH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:04.549522] [INFO ] [MAIN ] PBH: Generated 1352 derivative records from 23964 primary records. [2025-09-14T20:58:04.550955] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-14T20:58:04.567623] [DEBUG] [LOCAL ] PBH: Derivative data saved (1352 records). [2025-09-14T20:58:04.568032] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-14T20:58:04.569937] [INFO ] [MAIN ] Derivative Progress: 1534/2226 symbols completed. PBH took 1.0s. Estimated remaining: 4m 3s. Rate: 170.7 symbols/min [2025-09-14T20:58:04.580684] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:04.582239] [DEBUG] [MAIN ] PBF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:04.583620] [INFO ] [MAIN ] PBF: Generated 1352 derivative records from 40016 primary records. [2025-09-14T20:58:04.583955] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-14T20:58:04.609993] [DEBUG] [LOCAL ] PBF: Derivative data saved (1352 records). [2025-09-14T20:58:04.610401] [DEBUG] [MAIN ] PBI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:04.610635] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-14T20:58:04.611628] [INFO ] [MAIN ] PBI: Generated 1352 derivative records from 37490 primary records. [2025-09-14T20:58:04.617064] [INFO ] [MAIN ] Derivative Progress: 1535/2226 symbols completed. PBF took 1.1s. Estimated remaining: 4m 3s. Rate: 170.8 symbols/min [2025-09-14T20:58:04.617173] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-14T20:58:04.618079] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:04.641451] [DEBUG] [LOCAL ] PBI: Derivative data saved (1352 records). [2025-09-14T20:58:04.641756] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-14T20:58:04.643964] [INFO ] [MAIN ] Derivative Progress: 1536/2226 symbols completed. PBI took 1.1s. Estimated remaining: 4m 2s. Rate: 170.9 symbols/min [2025-09-14T20:58:04.644410] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:04.656380] [DEBUG] [LOCAL ] PBT: Loaded 13455 existing records from primary storage. [2025-09-14T20:58:04.670923] [INFO ] [MAIN ] PBT: Loaded 13455 primary data records. [2025-09-14T20:58:04.684162] [DEBUG] [LOCAL ] PBR: Loaded 40462 existing records from primary storage. [2025-09-14T20:58:04.743593] [DEBUG] [LOCAL ] PCF: Loaded 6661 existing records from primary storage. [2025-09-14T20:58:04.730262] [INFO ] [MAIN ] PBR: Loaded 40462 primary data records. [2025-09-14T20:58:04.767806] [INFO ] [MAIN ] PCF: Loaded 6661 primary data records. [2025-09-14T20:58:05.580363] [DEBUG] [MAIN ] PBT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:05.581510] [INFO ] [MAIN ] PBT: Generated 1352 derivative records from 13455 primary records. [2025-09-14T20:58:05.582125] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-14T20:58:05.618852] [DEBUG] [MAIN ] PCF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:05.619087] [DEBUG] [MAIN ] PBR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:05.619378] [DEBUG] [LOCAL ] PBT: Derivative data saved (1352 records). [2025-09-14T20:58:05.619695] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-14T20:58:05.620375] [INFO ] [MAIN ] PCF: Generated 1352 derivative records from 6661 primary records. [2025-09-14T20:58:05.621020] [INFO ] [MAIN ] PBR: Generated 1352 derivative records from 40462 primary records. [2025-09-14T20:58:05.622698] [INFO ] [MAIN ] Derivative Progress: 1537/2226 symbols completed. PBT took 1.0s. Estimated remaining: 4m 2s. Rate: 170.7 symbols/min [2025-09-14T20:58:05.622994] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-14T20:58:05.622946] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-14T20:58:05.624445] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:05.647235] [DEBUG] [LOCAL ] PBR: Derivative data saved (1352 records). [2025-09-14T20:58:05.648781] [DEBUG] [LOCAL ] PCF: Derivative data saved (1352 records). [2025-09-14T20:58:05.649033] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-14T20:58:05.648966] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-14T20:58:05.651825] [INFO ] [MAIN ] Derivative Progress: 1538/2226 symbols completed. PCF took 1.0s. Estimated remaining: 4m 2s. Rate: 170.8 symbols/min [2025-09-14T20:58:05.654900] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:05.654990] [INFO ] [MAIN ] Derivative Progress: 1539/2226 symbols completed. PBR took 1.1s. Estimated remaining: 4m 1s. Rate: 170.9 symbols/min [2025-09-14T20:58:05.655439] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:05.662810] [DEBUG] [LOCAL ] PCM: Loaded 4859 existing records from primary storage. [2025-09-14T20:58:05.663051] [INFO ] [MAIN ] PCM: Loaded 4859 primary data records. [2025-09-14T20:58:05.811404] [DEBUG] [LOCAL ] PCN: Loaded 18310 existing records from primary storage. [2025-09-14T20:58:05.827066] [INFO ] [MAIN ] PCN: Loaded 18310 primary data records. [2025-09-14T20:58:06.002911] [DEBUG] [LOCAL ] PCG: Loaded 40459 existing records from primary storage. [2025-09-14T20:58:06.086834] [INFO ] [MAIN ] PCG: Loaded 40459 primary data records. [2025-09-14T20:58:06.575748] [DEBUG] [MAIN ] PCM: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:58:06.577483] [INFO ] [MAIN ] PCM: Generated 1351 derivative records from 4859 primary records. [2025-09-14T20:58:06.577626] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-14T20:58:06.590932] [DEBUG] [LOCAL ] PCM: Derivative data saved (1351 records). [2025-09-14T20:58:06.591510] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-14T20:58:06.593227] [INFO ] [MAIN ] Derivative Progress: 1540/2226 symbols completed. PCM took 0.9s. Estimated remaining: 4m 1s. Rate: 170.7 symbols/min [2025-09-14T20:58:06.593729] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:06.608665] [DEBUG] [MAIN ] PCN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:06.609501] [INFO ] [MAIN ] PCN: Generated 1352 derivative records from 18310 primary records. [2025-09-14T20:58:06.611450] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-14T20:58:06.631091] [DEBUG] [MAIN ] PCG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:06.635235] [INFO ] [MAIN ] PCG: Generated 1352 derivative records from 40459 primary records. [2025-09-14T20:58:06.636037] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-09-14T20:58:06.651349] [DEBUG] [LOCAL ] PCG: Derivative data saved (1352 records). [2025-09-14T20:58:06.660358] [DEBUG] [LOCAL ] PCN: Derivative data saved (1352 records). [2025-09-14T20:58:06.660464] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-09-14T20:58:06.660743] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-14T20:58:06.663325] [INFO ] [MAIN ] Derivative Progress: 1541/2226 symbols completed. PCG took 1.0s. Estimated remaining: 4m 1s. Rate: 170.8 symbols/min [2025-09-14T20:58:06.666598] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:06.666788] [INFO ] [MAIN ] Derivative Progress: 1542/2226 symbols completed. PCN took 1.0s. Estimated remaining: 4m 0s. Rate: 170.9 symbols/min [2025-09-14T20:58:06.667354] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:06.685524] [DEBUG] [LOCAL ] PCOR: Loaded 35891 existing records from primary storage. [2025-09-14T20:58:06.686859] [INFO ] [MAIN ] PCOR: Loaded 35891 primary data records. [2025-09-14T20:58:06.739165] [DEBUG] [LOCAL ] PCQ: Loaded 8802 existing records from primary storage. [2025-09-14T20:58:06.778844] [INFO ] [MAIN ] PCQ: Loaded 8802 primary data records. [2025-09-14T20:58:07.021324] [DEBUG] [LOCAL ] PD: Loaded 35887 existing records from primary storage. [2025-09-14T20:58:07.133839] [INFO ] [MAIN ] PD: Loaded 35887 primary data records. [2025-09-14T20:58:07.662345] [DEBUG] [MAIN ] PCOR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:07.664280] [INFO ] [MAIN ] PCOR: Generated 1352 derivative records from 35891 primary records. [2025-09-14T20:58:07.664623] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-14T20:58:07.689633] [DEBUG] [MAIN ] PCQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:07.692481] [INFO ] [MAIN ] PCQ: Generated 1352 derivative records from 8802 primary records. [2025-09-14T20:58:07.693190] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-14T20:58:07.694513] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1352 records). [2025-09-14T20:58:07.695124] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-14T20:58:07.697361] [INFO ] [MAIN ] Derivative Progress: 1543/2226 symbols completed. PCOR took 1.1s. Estimated remaining: 4m 0s. Rate: 170.7 symbols/min [2025-09-14T20:58:07.710441] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1352 records). [2025-09-14T20:58:07.711884] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-14T20:58:07.714819] [INFO ] [MAIN ] Derivative Progress: 1544/2226 symbols completed. PCQ took 1.0s. Estimated remaining: 3m 60s. Rate: 170.8 symbols/min [2025-09-14T20:58:07.726768] [DEBUG] [MAIN ] PD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:07.727632] [INFO ] [MAIN ] PD: Generated 1352 derivative records from 35887 primary records. [2025-09-14T20:58:07.727753] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-14T20:58:07.742708] [DEBUG] [LOCAL ] PD: Derivative data saved (1352 records). [2025-09-14T20:58:07.742884] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-14T20:58:07.745173] [INFO ] [MAIN ] Derivative Progress: 1545/2226 symbols completed. PD took 1.1s. Estimated remaining: 3m 59s. Rate: 170.9 symbols/min [2025-09-14T20:58:07.746267] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:07.746080] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:07.745901] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:07.801280] [DEBUG] [LOCAL ] PDO: Loaded 23018 existing records from primary storage. [2025-09-14T20:58:07.801552] [INFO ] [MAIN ] PDO: Loaded 23018 primary data records. [2025-09-14T20:58:07.818452] [DEBUG] [LOCAL ] PDM: Loaded 29797 existing records from primary storage. [2025-09-14T20:58:07.847822] [INFO ] [MAIN ] PDM: Loaded 29797 primary data records. [2025-09-14T20:58:08.117994] [DEBUG] [LOCAL ] PDI: Loaded 37523 existing records from primary storage. [2025-09-14T20:58:08.215047] [INFO ] [MAIN ] PDI: Loaded 37523 primary data records. [2025-09-14T20:58:08.707264] [DEBUG] [MAIN ] PDO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:08.709668] [INFO ] [MAIN ] PDO: Generated 1352 derivative records from 23018 primary records. [2025-09-14T20:58:08.710822] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-14T20:58:08.736033] [DEBUG] [LOCAL ] PDO: Derivative data saved (1352 records). [2025-09-14T20:58:08.736809] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-14T20:58:08.736387] [DEBUG] [MAIN ] PDM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:08.739678] [INFO ] [MAIN ] PDM: Generated 1352 derivative records from 29797 primary records. [2025-09-14T20:58:08.738780] [INFO ] [MAIN ] Derivative Progress: 1546/2226 symbols completed. PDO took 1.0s. Estimated remaining: 3m 59s. Rate: 170.7 symbols/min [2025-09-14T20:58:08.740278] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:08.740321] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-14T20:58:08.754035] [DEBUG] [LOCAL ] PDM: Derivative data saved (1352 records). [2025-09-14T20:58:08.754393] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-14T20:58:08.756771] [INFO ] [MAIN ] Derivative Progress: 1547/2226 symbols completed. PDM took 1.0s. Estimated remaining: 3m 59s. Rate: 170.8 symbols/min [2025-09-14T20:58:08.760169] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:08.778821] [DEBUG] [MAIN ] PDI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:08.779248] [DEBUG] [LOCAL ] PDS: Loaded 12577 existing records from primary storage. [2025-09-14T20:58:08.780041] [INFO ] [MAIN ] PDI: Generated 1352 derivative records from 37523 primary records. [2025-09-14T20:58:08.780248] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-14T20:58:08.780938] [INFO ] [MAIN ] PDS: Loaded 12577 primary data records. [2025-09-14T20:58:08.887690] [DEBUG] [LOCAL ] PDT: Loaded 13012 existing records from primary storage. [2025-09-14T20:58:08.907355] [INFO ] [MAIN ] PDT: Loaded 13012 primary data records. [2025-09-14T20:58:08.911484] [DEBUG] [LOCAL ] PDI: Derivative data saved (1352 records). [2025-09-14T20:58:08.927755] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-14T20:58:08.986843] [INFO ] [MAIN ] Derivative Progress: 1548/2226 symbols completed. PDI took 1.2s. Estimated remaining: 3m 58s. Rate: 170.8 symbols/min [2025-09-14T20:58:09.026455] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:09.395368] [DEBUG] [LOCAL ] PEB: Loaded 38074 existing records from primary storage. [2025-09-14T20:58:09.406699] [INFO ] [MAIN ] PEB: Loaded 38074 primary data records. [2025-09-14T20:58:09.407290] [DEBUG] [MAIN ] PDS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:09.434593] [INFO ] [MAIN ] PDS: Generated 1352 derivative records from 12577 primary records. [2025-09-14T20:58:09.486369] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-14T20:58:09.546262] [DEBUG] [MAIN ] PDT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:09.560514] [DEBUG] [LOCAL ] PDS: Derivative data saved (1352 records). [2025-09-14T20:58:09.561750] [INFO ] [MAIN ] PDT: Generated 1352 derivative records from 13012 primary records. [2025-09-14T20:58:09.572456] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-14T20:58:09.577772] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-14T20:58:09.606043] [INFO ] [MAIN ] Derivative Progress: 1549/2226 symbols completed. PDS took 0.9s. Estimated remaining: 3m 58s. Rate: 170.7 symbols/min [2025-09-14T20:58:09.645028] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:09.732236] [DEBUG] [LOCAL ] PDT: Derivative data saved (1352 records). [2025-09-14T20:58:09.744682] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-14T20:58:09.747696] [INFO ] [MAIN ] Derivative Progress: 1550/2226 symbols completed. PDT took 1.0s. Estimated remaining: 3m 57s. Rate: 170.8 symbols/min [2025-09-14T20:58:09.748264] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:09.794735] [DEBUG] [MAIN ] PEB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:09.795881] [INFO ] [MAIN ] PEB: Generated 1352 derivative records from 38074 primary records. [2025-09-14T20:58:09.796606] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-14T20:58:09.806030] [DEBUG] [LOCAL ] PEN: Loaded 22890 existing records from primary storage. [2025-09-14T20:58:09.813856] [INFO ] [MAIN ] PEN: Loaded 22890 primary data records. [2025-09-14T20:58:09.889557] [DEBUG] [LOCAL ] PEB: Derivative data saved (1352 records). [2025-09-14T20:58:09.880568] [DEBUG] [LOCAL ] PEG: Loaded 40001 existing records from primary storage. [2025-09-14T20:58:09.920618] [INFO ] [MAIN ] PEG: Loaded 40001 primary data records. [2025-09-14T20:58:09.920534] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-14T20:58:09.939790] [INFO ] [MAIN ] Derivative Progress: 1551/2226 symbols completed. PEB took 0.9s. Estimated remaining: 3m 57s. Rate: 170.9 symbols/min [2025-09-14T20:58:10.010564] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:10.350630] [DEBUG] [LOCAL ] PEO: Loaded 8194 existing records from primary storage. [2025-09-14T20:58:10.440217] [INFO ] [MAIN ] PEO: Loaded 8194 primary data records. [2025-09-14T20:58:10.736871] [DEBUG] [MAIN ] PEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:10.740378] [INFO ] [MAIN ] PEN: Generated 1352 derivative records from 22890 primary records. [2025-09-14T20:58:10.740938] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-14T20:58:10.759623] [DEBUG] [MAIN ] PEG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:10.763571] [INFO ] [MAIN ] PEG: Generated 1352 derivative records from 40001 primary records. [2025-09-14T20:58:10.764256] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-09-14T20:58:10.773415] [DEBUG] [LOCAL ] PEN: Derivative data saved (1352 records). [2025-09-14T20:58:10.778005] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-14T20:58:10.779547] [DEBUG] [LOCAL ] PEG: Derivative data saved (1352 records). [2025-09-14T20:58:10.781789] [INFO ] [MAIN ] Derivative Progress: 1552/2226 symbols completed. PEN took 1.0s. Estimated remaining: 3m 57s. Rate: 170.7 symbols/min [2025-09-14T20:58:10.781910] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-09-14T20:58:10.782227] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:10.784531] [INFO ] [MAIN ] Derivative Progress: 1553/2226 symbols completed. PEG took 1.1s. Estimated remaining: 3m 56s. Rate: 170.8 symbols/min [2025-09-14T20:58:10.785100] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:10.810307] [DEBUG] [MAIN ] PEO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:10.811580] [INFO ] [MAIN ] PEO: Generated 1352 derivative records from 8194 primary records. [2025-09-14T20:58:10.814373] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-14T20:58:10.814303] [DEBUG] [LOCAL ] PFD: Loaded 3832 existing records from primary storage. [2025-09-14T20:58:10.814609] [INFO ] [MAIN ] PFD: Loaded 3832 primary data records. [2025-09-14T20:58:10.865699] [DEBUG] [LOCAL ] PERF: Loaded 11386 existing records from primary storage. [2025-09-14T20:58:10.911582] [INFO ] [MAIN ] PERF: Loaded 11386 primary data records. [2025-09-14T20:58:11.138589] [DEBUG] [LOCAL ] PEO: Derivative data saved (1352 records). [2025-09-14T20:58:11.238043] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-14T20:58:11.282835] [INFO ] [MAIN ] Derivative Progress: 1554/2226 symbols completed. PEO took 1.3s. Estimated remaining: 3m 56s. Rate: 170.8 symbols/min [2025-09-14T20:58:11.337586] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:11.428014] [DEBUG] [MAIN ] PFD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:11.429034] [INFO ] [MAIN ] PFD: Generated 1352 derivative records from 3832 primary records. [2025-09-14T20:58:11.429218] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-14T20:58:11.452003] [DEBUG] [MAIN ] PERF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:11.454268] [INFO ] [MAIN ] PERF: Generated 1352 derivative records from 11386 primary records. [2025-09-14T20:58:11.467622] [DEBUG] [LOCAL ] PFD: Derivative data saved (1352 records). [2025-09-14T20:58:11.467183] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-14T20:58:11.468802] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-14T20:58:11.470731] [INFO ] [MAIN ] Derivative Progress: 1555/2226 symbols completed. PFD took 0.7s. Estimated remaining: 3m 56s. Rate: 170.8 symbols/min [2025-09-14T20:58:11.471361] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:11.484411] [DEBUG] [LOCAL ] PERF: Derivative data saved (1352 records). [2025-09-14T20:58:11.484585] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-14T20:58:11.503874] [INFO ] [MAIN ] Derivative Progress: 1556/2226 symbols completed. PERF took 0.7s. Estimated remaining: 3m 55s. Rate: 170.9 symbols/min [2025-09-14T20:58:11.504314] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:11.505574] [DEBUG] [LOCAL ] PFE: Loaded 40553 existing records from primary storage. [2025-09-14T20:58:11.506072] [INFO ] [MAIN ] PFE: Loaded 40553 primary data records. [2025-09-14T20:58:11.604847] [DEBUG] [LOCAL ] PFH: Loaded 5261 existing records from primary storage. [2025-09-14T20:58:11.640073] [INFO ] [MAIN ] PFH: Loaded 5261 primary data records. [2025-09-14T20:58:11.804634] [DEBUG] [LOCAL ] PFGC: Loaded 35492 existing records from primary storage. [2025-09-14T20:58:11.845468] [INFO ] [MAIN ] PFGC: Loaded 35492 primary data records. [2025-09-14T20:58:12.497535] [DEBUG] [MAIN ] PFE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:12.499256] [INFO ] [MAIN ] PFE: Generated 1352 derivative records from 40553 primary records. [2025-09-14T20:58:12.499786] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-09-14T20:58:12.533983] [DEBUG] [MAIN ] PFH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:12.532497] [DEBUG] [LOCAL ] PFE: Derivative data saved (1352 records). [2025-09-14T20:58:12.537034] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-09-14T20:58:12.536765] [INFO ] [MAIN ] PFH: Generated 1352 derivative records from 5261 primary records. [2025-09-14T20:58:12.539831] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-14T20:58:12.539446] [INFO ] [MAIN ] Derivative Progress: 1557/2226 symbols completed. PFE took 1.2s. Estimated remaining: 3m 55s. Rate: 170.7 symbols/min [2025-09-14T20:58:12.540282] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:12.552680] [DEBUG] [MAIN ] PFGC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:12.567629] [INFO ] [MAIN ] PFGC: Generated 1352 derivative records from 35492 primary records. [2025-09-14T20:58:12.569765] [DEBUG] [LOCAL ] PFH: Derivative data saved (1352 records). [2025-09-14T20:58:12.569841] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-14T20:58:12.569989] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-14T20:58:12.573743] [INFO ] [MAIN ] Derivative Progress: 1558/2226 symbols completed. PFH took 1.1s. Estimated remaining: 3m 55s. Rate: 170.8 symbols/min [2025-09-14T20:58:12.589739] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1352 records). [2025-09-14T20:58:12.589873] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-14T20:58:12.591594] [INFO ] [MAIN ] Derivative Progress: 1559/2226 symbols completed. PFGC took 1.1s. Estimated remaining: 3m 54s. Rate: 170.9 symbols/min [2025-09-14T20:58:12.597074] [DEBUG] [LOCAL ] PFL: Loaded 9928 existing records from primary storage. [2025-09-14T20:58:12.597268] [INFO ] [MAIN ] PFL: Loaded 9928 primary data records. [2025-09-14T20:58:12.881436] [DEBUG] [MAIN ] PFL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:12.882220] [INFO ] [MAIN ] PFL: Generated 1352 derivative records from 9928 primary records. [2025-09-14T20:58:12.882312] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-14T20:58:12.894300] [DEBUG] [LOCAL ] PFL: Derivative data saved (1352 records). [2025-09-14T20:58:12.894467] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-14T20:58:12.896240] [INFO ] [MAIN ] Derivative Progress: 1560/2226 symbols completed. PFL took 0.4s. Estimated remaining: 3m 54s. Rate: 170.9 symbols/min [2025-09-14T20:58:12.897383] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:12.896952] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:12.897496] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:12.909098] [DEBUG] [LOCAL ] PFO: Loaded 4456 existing records from primary storage. [2025-09-14T20:58:12.914058] [INFO ] [MAIN ] PFO: Loaded 4456 primary data records. [2025-09-14T20:58:13.038026] [DEBUG] [LOCAL ] PFN: Loaded 15751 existing records from primary storage. [2025-09-14T20:58:13.042213] [INFO ] [MAIN ] PFN: Loaded 15751 primary data records. [2025-09-14T20:58:13.236907] [DEBUG] [LOCAL ] PFLT: Loaded 31971 existing records from primary storage. [2025-09-14T20:58:13.336279] [INFO ] [MAIN ] PFLT: Loaded 31971 primary data records. [2025-09-14T20:58:13.844723] [DEBUG] [MAIN ] PFO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:13.847068] [INFO ] [MAIN ] PFO: Generated 1352 derivative records from 4456 primary records. [2025-09-14T20:58:13.847753] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-14T20:58:13.861871] [DEBUG] [LOCAL ] PFO: Derivative data saved (1352 records). [2025-09-14T20:58:13.865888] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-14T20:58:13.868219] [INFO ] [MAIN ] Derivative Progress: 1561/2226 symbols completed. PFO took 1.0s. Estimated remaining: 3m 54s. Rate: 170.7 symbols/min [2025-09-14T20:58:13.868852] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:13.880897] [DEBUG] [MAIN ] PFN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:13.882169] [INFO ] [MAIN ] PFN: Generated 1352 derivative records from 15751 primary records. [2025-09-14T20:58:13.882777] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-14T20:58:13.899095] [DEBUG] [LOCAL ] PFN: Derivative data saved (1352 records). [2025-09-14T20:58:13.900062] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-14T20:58:13.908676] [INFO ] [MAIN ] Derivative Progress: 1562/2226 symbols completed. PFN took 1.0s. Estimated remaining: 3m 53s. Rate: 170.8 symbols/min [2025-09-14T20:58:13.913672] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:13.914284] [DEBUG] [MAIN ] PFLT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:13.915342] [INFO ] [MAIN ] PFLT: Generated 1352 derivative records from 31971 primary records. [2025-09-14T20:58:13.915793] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-14T20:58:13.929206] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1352 records). [2025-09-14T20:58:13.937107] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-14T20:58:13.939198] [INFO ] [MAIN ] Derivative Progress: 1563/2226 symbols completed. PFLT took 1.0s. Estimated remaining: 3m 53s. Rate: 170.9 symbols/min [2025-09-14T20:58:13.939656] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:13.955464] [DEBUG] [LOCAL ] PFS: Loaded 26037 existing records from primary storage. [2025-09-14T20:58:13.955683] [INFO ] [MAIN ] PFS: Loaded 26037 primary data records. [2025-09-14T20:58:14.034493] [DEBUG] [LOCAL ] PFSI: Loaded 21119 existing records from primary storage. [2025-09-14T20:58:14.066779] [INFO ] [MAIN ] PFSI: Loaded 21119 primary data records. [2025-09-14T20:58:14.390111] [DEBUG] [LOCAL ] PG: Loaded 40493 existing records from primary storage. [2025-09-14T20:58:14.417415] [INFO ] [MAIN ] PG: Loaded 40493 primary data records. [2025-09-14T20:58:14.914906] [DEBUG] [MAIN ] PFS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:14.916597] [INFO ] [MAIN ] PFS: Generated 1352 derivative records from 26037 primary records. [2025-09-14T20:58:14.917142] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-14T20:58:14.933312] [DEBUG] [LOCAL ] PFS: Derivative data saved (1352 records). [2025-09-14T20:58:14.933717] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-14T20:58:14.946415] [INFO ] [MAIN ] Derivative Progress: 1564/2226 symbols completed. PFS took 1.1s. Estimated remaining: 3m 53s. Rate: 170.7 symbols/min [2025-09-14T20:58:14.946789] [DEBUG] [MAIN ] PFSI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:14.947814] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:14.947593] [INFO ] [MAIN ] PFSI: Generated 1352 derivative records from 21119 primary records. [2025-09-14T20:58:14.948380] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-14T20:58:14.963412] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1352 records). [2025-09-14T20:58:14.963661] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-14T20:58:14.965980] [INFO ] [MAIN ] Derivative Progress: 1565/2226 symbols completed. PFSI took 1.1s. Estimated remaining: 3m 52s. Rate: 170.8 symbols/min [2025-09-14T20:58:14.966626] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:14.970410] [DEBUG] [LOCAL ] PGP: Loaded 4011 existing records from primary storage. [2025-09-14T20:58:14.971303] [INFO ] [MAIN ] PGP: Loaded 4011 primary data records. [2025-09-14T20:58:15.079227] [DEBUG] [MAIN ] PG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:15.094537] [INFO ] [MAIN ] PG: Generated 1352 derivative records from 40493 primary records. [2025-09-14T20:58:15.098276] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-09-14T20:58:15.303029] [DEBUG] [LOCAL ] PG: Derivative data saved (1352 records). [2025-09-14T20:58:15.303215] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-09-14T20:58:15.305710] [INFO ] [MAIN ] Derivative Progress: 1566/2226 symbols completed. PG took 1.4s. Estimated remaining: 3m 52s. Rate: 170.8 symbols/min [2025-09-14T20:58:15.307903] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:15.323538] [DEBUG] [LOCAL ] PGR: Loaded 39822 existing records from primary storage. [2025-09-14T20:58:15.324107] [INFO ] [MAIN ] PGR: Loaded 39822 primary data records. [2025-09-14T20:58:15.627668] [DEBUG] [LOCAL ] PGRE: Loaded 35261 existing records from primary storage. [2025-09-14T20:58:15.628071] [INFO ] [MAIN ] PGRE: Loaded 35261 primary data records. [2025-09-14T20:58:15.641147] [DEBUG] [MAIN ] PGP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:15.689122] [INFO ] [MAIN ] PGP: Generated 1352 derivative records from 4011 primary records. [2025-09-14T20:58:15.738169] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-14T20:58:15.963926] [DEBUG] [LOCAL ] PGP: Derivative data saved (1352 records). [2025-09-14T20:58:15.964410] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-14T20:58:15.978776] [INFO ] [MAIN ] Derivative Progress: 1567/2226 symbols completed. PGP took 1.0s. Estimated remaining: 3m 52s. Rate: 170.7 symbols/min [2025-09-14T20:58:15.979823] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:15.980610] [DEBUG] [MAIN ] PGR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:15.983036] [INFO ] [MAIN ] PGR: Generated 1352 derivative records from 39822 primary records. [2025-09-14T20:58:15.983435] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-09-14T20:58:16.002579] [DEBUG] [LOCAL ] PGZ: Loaded 4131 existing records from primary storage. [2025-09-14T20:58:16.003178] [INFO ] [MAIN ] PGZ: Loaded 4131 primary data records. [2025-09-14T20:58:16.092849] [DEBUG] [LOCAL ] PGR: Derivative data saved (1352 records). [2025-09-14T20:58:16.111387] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-09-14T20:58:16.119256] [INFO ] [MAIN ] Derivative Progress: 1568/2226 symbols completed. PGR took 1.2s. Estimated remaining: 3m 51s. Rate: 170.8 symbols/min [2025-09-14T20:58:16.131187] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:16.305327] [DEBUG] [MAIN ] PGRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:16.306708] [INFO ] [MAIN ] PGRE: Generated 1352 derivative records from 35261 primary records. [2025-09-14T20:58:16.307149] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-14T20:58:16.321490] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1352 records). [2025-09-14T20:58:16.332602] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-14T20:58:16.335240] [INFO ] [MAIN ] Derivative Progress: 1569/2226 symbols completed. PGRE took 1.0s. Estimated remaining: 3m 51s. Rate: 170.8 symbols/min [2025-09-14T20:58:16.336066] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:16.356236] [DEBUG] [LOCAL ] PH: Loaded 28162 existing records from primary storage. [2025-09-14T20:58:16.356831] [INFO ] [MAIN ] PH: Loaded 28162 primary data records. [2025-09-14T20:58:16.390586] [DEBUG] [LOCAL ] PHD: Loaded 6860 existing records from primary storage. [2025-09-14T20:58:16.390289] [DEBUG] [MAIN ] PGZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:16.415308] [INFO ] [MAIN ] PHD: Loaded 6860 primary data records. [2025-09-14T20:58:16.421753] [INFO ] [MAIN ] PGZ: Generated 1352 derivative records from 4131 primary records. [2025-09-14T20:58:16.494429] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-14T20:58:16.904367] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1352 records). [2025-09-14T20:58:16.907724] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-14T20:58:17.000401] [INFO ] [MAIN ] Derivative Progress: 1570/2226 symbols completed. PGZ took 1.0s. Estimated remaining: 3m 51s. Rate: 170.7 symbols/min [2025-09-14T20:58:17.002196] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:17.090315] [DEBUG] [MAIN ] PHD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:17.091269] [INFO ] [MAIN ] PHD: Generated 1352 derivative records from 6860 primary records. [2025-09-14T20:58:17.092083] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-14T20:58:17.125849] [DEBUG] [LOCAL ] PHG: Loaded 34714 existing records from primary storage. [2025-09-14T20:58:17.126740] [INFO ] [MAIN ] PHG: Loaded 34714 primary data records. [2025-09-14T20:58:17.124231] [DEBUG] [MAIN ] PH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:17.128892] [INFO ] [MAIN ] PH: Generated 1352 derivative records from 28162 primary records. [2025-09-14T20:58:17.140610] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-14T20:58:17.186328] [DEBUG] [LOCAL ] PHD: Derivative data saved (1352 records). [2025-09-14T20:58:17.217378] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-14T20:58:17.238639] [INFO ] [MAIN ] Derivative Progress: 1571/2226 symbols completed. PHD took 0.9s. Estimated remaining: 3m 50s. Rate: 170.8 symbols/min [2025-09-14T20:58:17.245252] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:17.332937] [DEBUG] [LOCAL ] PH: Derivative data saved (1352 records). [2025-09-14T20:58:17.469555] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-14T20:58:17.474717] [DEBUG] [LOCAL ] PHI: Loaded 10886 existing records from primary storage. [2025-09-14T20:58:17.477406] [INFO ] [MAIN ] Derivative Progress: 1572/2226 symbols completed. PH took 1.3s. Estimated remaining: 3m 50s. Rate: 170.8 symbols/min [2025-09-14T20:58:17.474967] [INFO ] [MAIN ] PHI: Loaded 10886 primary data records. [2025-09-14T20:58:17.477706] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:17.793169] [DEBUG] [LOCAL ] PHIN: Loaded 23699 existing records from primary storage. [2025-09-14T20:58:17.793837] [INFO ] [MAIN ] PHIN: Loaded 23699 primary data records. [2025-09-14T20:58:17.977163] [DEBUG] [MAIN ] PHG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:18.001826] [INFO ] [MAIN ] PHG: Generated 1352 derivative records from 34714 primary records. [2025-09-14T20:58:18.091508] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-14T20:58:18.113306] [DEBUG] [LOCAL ] PHG: Derivative data saved (1352 records). [2025-09-14T20:58:18.114544] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-14T20:58:18.127588] [INFO ] [MAIN ] Derivative Progress: 1573/2226 symbols completed. PHG took 1.1s. Estimated remaining: 3m 50s. Rate: 170.7 symbols/min [2025-09-14T20:58:18.130199] [DEBUG] [MAIN ] PHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:18.131130] [INFO ] [MAIN ] PHI: Generated 1352 derivative records from 10886 primary records. [2025-09-14T20:58:18.131585] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-14T20:58:18.144478] [DEBUG] [LOCAL ] PHI: Derivative data saved (1352 records). [2025-09-14T20:58:18.144602] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-14T20:58:18.147317] [INFO ] [MAIN ] Derivative Progress: 1574/2226 symbols completed. PHI took 0.9s. Estimated remaining: 3m 49s. Rate: 170.8 symbols/min [2025-09-14T20:58:18.159749] [DEBUG] [MAIN ] PHIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:18.160364] [INFO ] [MAIN ] PHIN: Generated 1352 derivative records from 23699 primary records. [2025-09-14T20:58:18.160440] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-14T20:58:18.172849] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1352 records). [2025-09-14T20:58:18.172948] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-14T20:58:18.175550] [INFO ] [MAIN ] Derivative Progress: 1575/2226 symbols completed. PHIN took 0.7s. Estimated remaining: 3m 49s. Rate: 170.9 symbols/min [2025-09-14T20:58:18.176178] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:18.176320] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:18.176549] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:18.211583] [DEBUG] [LOCAL ] PHK: Loaded 19411 existing records from primary storage. [2025-09-14T20:58:18.211872] [INFO ] [MAIN ] PHK: Loaded 19411 primary data records. [2025-09-14T20:58:18.390518] [DEBUG] [LOCAL ] PHR: Loaded 27578 existing records from primary storage. [2025-09-14T20:58:18.424525] [INFO ] [MAIN ] PHR: Loaded 27578 primary data records. [2025-09-14T20:58:18.424455] [DEBUG] [LOCAL ] PHM: Loaded 38859 existing records from primary storage. [2025-09-14T20:58:18.430111] [INFO ] [MAIN ] PHM: Loaded 38859 primary data records. [2025-09-14T20:58:19.111210] [DEBUG] [MAIN ] PHK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:19.113514] [INFO ] [MAIN ] PHK: Generated 1352 derivative records from 19411 primary records. [2025-09-14T20:58:19.113667] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-14T20:58:19.135070] [DEBUG] [LOCAL ] PHK: Derivative data saved (1352 records). [2025-09-14T20:58:19.137771] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-14T20:58:19.142409] [INFO ] [MAIN ] Derivative Progress: 1576/2226 symbols completed. PHK took 1.0s. Estimated remaining: 3m 48s. Rate: 170.7 symbols/min [2025-09-14T20:58:19.149143] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:19.154829] [DEBUG] [MAIN ] PHM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:19.156319] [INFO ] [MAIN ] PHM: Generated 1352 derivative records from 38859 primary records. [2025-09-14T20:58:19.162842] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-09-14T20:58:19.169163] [DEBUG] [MAIN ] PHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:19.182823] [INFO ] [MAIN ] PHR: Generated 1352 derivative records from 27578 primary records. [2025-09-14T20:58:19.187915] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-14T20:58:19.208759] [DEBUG] [LOCAL ] PHM: Derivative data saved (1352 records). [2025-09-14T20:58:19.209541] [DEBUG] [LOCAL ] PHT: Loaded 12120 existing records from primary storage. [2025-09-14T20:58:19.209870] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-09-14T20:58:19.215171] [INFO ] [MAIN ] Derivative Progress: 1577/2226 symbols completed. PHM took 1.0s. Estimated remaining: 3m 48s. Rate: 170.8 symbols/min [2025-09-14T20:58:19.217067] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:19.215975] [INFO ] [MAIN ] PHT: Loaded 12120 primary data records. [2025-09-14T20:58:19.245337] [DEBUG] [LOCAL ] PHR: Derivative data saved (1352 records). [2025-09-14T20:58:19.288779] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-14T20:58:19.302605] [INFO ] [MAIN ] Derivative Progress: 1578/2226 symbols completed. PHR took 1.1s. Estimated remaining: 3m 48s. Rate: 170.9 symbols/min [2025-09-14T20:58:19.326249] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:19.404153] [DEBUG] [LOCAL ] PIM: Loaded 3668 existing records from primary storage. [2025-09-14T20:58:19.416300] [INFO ] [MAIN ] PIM: Loaded 3668 primary data records. [2025-09-14T20:58:19.643262] [DEBUG] [LOCAL ] PII: Loaded 37006 existing records from primary storage. [2025-09-14T20:58:19.644681] [INFO ] [MAIN ] PII: Loaded 37006 primary data records. [2025-09-14T20:58:20.203695] [DEBUG] [MAIN ] PHT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:20.204866] [INFO ] [MAIN ] PHT: Generated 1352 derivative records from 12120 primary records. [2025-09-14T20:58:20.206844] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-14T20:58:20.223143] [DEBUG] [LOCAL ] PHT: Derivative data saved (1352 records). [2025-09-14T20:58:20.224911] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-14T20:58:20.227194] [INFO ] [MAIN ] Derivative Progress: 1579/2226 symbols completed. PHT took 1.1s. Estimated remaining: 3m 47s. Rate: 170.7 symbols/min [2025-09-14T20:58:20.227530] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:20.249661] [DEBUG] [MAIN ] PIM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:20.250916] [INFO ] [MAIN ] PIM: Generated 1352 derivative records from 3668 primary records. [2025-09-14T20:58:20.251255] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-14T20:58:20.257358] [DEBUG] [LOCAL ] PINE: Loaded 10663 existing records from primary storage. [2025-09-14T20:58:20.266576] [INFO ] [MAIN ] PINE: Loaded 10663 primary data records. [2025-09-14T20:58:20.271911] [DEBUG] [LOCAL ] PIM: Derivative data saved (1352 records). [2025-09-14T20:58:20.317436] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-14T20:58:20.352580] [INFO ] [MAIN ] Derivative Progress: 1580/2226 symbols completed. PIM took 1.0s. Estimated remaining: 3m 47s. Rate: 170.8 symbols/min [2025-09-14T20:58:20.376682] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:20.391659] [DEBUG] [MAIN ] PII: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:20.404509] [INFO ] [MAIN ] PII: Generated 1352 derivative records from 37006 primary records. [2025-09-14T20:58:20.420167] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-14T20:58:20.492762] [DEBUG] [LOCAL ] PII: Derivative data saved (1352 records). [2025-09-14T20:58:20.492986] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-14T20:58:20.588175] [INFO ] [MAIN ] Derivative Progress: 1581/2226 symbols completed. PII took 1.4s. Estimated remaining: 3m 47s. Rate: 170.8 symbols/min [2025-09-14T20:58:20.589104] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:20.615670] [DEBUG] [LOCAL ] PIPR: Loaded 10990 existing records from primary storage. [2025-09-14T20:58:20.616938] [INFO ] [MAIN ] PIPR: Loaded 10990 primary data records. [2025-09-14T20:58:20.631322] [DEBUG] [LOCAL ] PINS: Loaded 40433 existing records from primary storage. [2025-09-14T20:58:20.688779] [INFO ] [MAIN ] PINS: Loaded 40433 primary data records. [2025-09-14T20:58:20.953096] [DEBUG] [MAIN ] PINE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:21.067560] [INFO ] [MAIN ] PINE: Generated 1352 derivative records from 10663 primary records. [2025-09-14T20:58:21.161240] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-14T20:58:21.268236] [DEBUG] [LOCAL ] PINE: Derivative data saved (1352 records). [2025-09-14T20:58:21.269859] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-14T20:58:21.274111] [INFO ] [MAIN ] Derivative Progress: 1582/2226 symbols completed. PINE took 1.0s. Estimated remaining: 3m 46s. Rate: 170.7 symbols/min [2025-09-14T20:58:21.275029] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:21.296619] [DEBUG] [MAIN ] PIPR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:21.298533] [INFO ] [MAIN ] PIPR: Generated 1352 derivative records from 10990 primary records. [2025-09-14T20:58:21.303404] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-14T20:58:21.327458] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1352 records). [2025-09-14T20:58:21.333896] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-14T20:58:21.341141] [INFO ] [MAIN ] Derivative Progress: 1583/2226 symbols completed. PIPR took 0.8s. Estimated remaining: 3m 46s. Rate: 170.8 symbols/min [2025-09-14T20:58:21.341934] [DEBUG] [MAIN ] PINS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:21.342500] [DEBUG] [LOCAL ] PJT: Loaded 16167 existing records from primary storage. [2025-09-14T20:58:21.343774] [INFO ] [MAIN ] PINS: Generated 1352 derivative records from 40433 primary records. [2025-09-14T20:58:21.343862] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:21.344025] [INFO ] [MAIN ] PJT: Loaded 16167 primary data records. [2025-09-14T20:58:21.344177] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-14T20:58:21.537438] [DEBUG] [LOCAL ] PINS: Derivative data saved (1352 records). [2025-09-14T20:58:21.542947] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-14T20:58:21.642050] [INFO ] [MAIN ] Derivative Progress: 1584/2226 symbols completed. PINS took 1.3s. Estimated remaining: 3m 46s. Rate: 170.8 symbols/min [2025-09-14T20:58:21.642937] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:21.662600] [DEBUG] [LOCAL ] PK: Loaded 39726 existing records from primary storage. [2025-09-14T20:58:21.665081] [INFO ] [MAIN ] PK: Loaded 39726 primary data records. [2025-09-14T20:58:21.729673] [DEBUG] [LOCAL ] PKE: Loaded 9995 existing records from primary storage. [2025-09-14T20:58:21.751264] [INFO ] [MAIN ] PKE: Loaded 9995 primary data records. [2025-09-14T20:58:21.987435] [DEBUG] [MAIN ] PJT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:22.086785] [INFO ] [MAIN ] PJT: Generated 1352 derivative records from 16167 primary records. [2025-09-14T20:58:22.109684] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-14T20:58:22.319287] [DEBUG] [LOCAL ] PJT: Derivative data saved (1352 records). [2025-09-14T20:58:22.320856] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-14T20:58:22.323034] [INFO ] [MAIN ] Derivative Progress: 1585/2226 symbols completed. PJT took 1.0s. Estimated remaining: 3m 45s. Rate: 170.7 symbols/min [2025-09-14T20:58:22.323702] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:22.350213] [DEBUG] [MAIN ] PK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:22.351426] [INFO ] [MAIN ] PK: Generated 1352 derivative records from 39726 primary records. [2025-09-14T20:58:22.351781] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-14T20:58:22.384972] [DEBUG] [MAIN ] PKE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:22.386806] [DEBUG] [LOCAL ] PK: Derivative data saved (1352 records). [2025-09-14T20:58:22.388249] [INFO ] [MAIN ] PKE: Generated 1352 derivative records from 9995 primary records. [2025-09-14T20:58:22.388334] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-14T20:58:22.397301] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-14T20:58:22.399428] [INFO ] [MAIN ] Derivative Progress: 1586/2226 symbols completed. PK took 1.1s. Estimated remaining: 3m 45s. Rate: 170.8 symbols/min [2025-09-14T20:58:22.402608] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:22.409449] [DEBUG] [LOCAL ] PKG: Loaded 29138 existing records from primary storage. [2025-09-14T20:58:22.413162] [INFO ] [MAIN ] PKG: Loaded 29138 primary data records. [2025-09-14T20:58:22.484030] [DEBUG] [LOCAL ] PKE: Derivative data saved (1352 records). [2025-09-14T20:58:22.510463] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-14T20:58:22.537226] [INFO ] [MAIN ] Derivative Progress: 1587/2226 symbols completed. PKE took 0.9s. Estimated remaining: 3m 44s. Rate: 170.9 symbols/min [2025-09-14T20:58:22.535420] [DEBUG] [LOCAL ] PKST: Loaded 13160 existing records from primary storage. [2025-09-14T20:58:22.543357] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:22.543266] [INFO ] [MAIN ] PKST: Loaded 13160 primary data records. [2025-09-14T20:58:22.867041] [DEBUG] [LOCAL ] PKX: Loaded 17013 existing records from primary storage. [2025-09-14T20:58:22.899999] [INFO ] [MAIN ] PKX: Loaded 17013 primary data records. [2025-09-14T20:58:23.289494] [DEBUG] [MAIN ] PKG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:23.290482] [INFO ] [MAIN ] PKG: Generated 1352 derivative records from 29138 primary records. [2025-09-14T20:58:23.290982] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-14T20:58:23.308275] [DEBUG] [LOCAL ] PKG: Derivative data saved (1352 records). [2025-09-14T20:58:23.308654] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-14T20:58:23.319251] [DEBUG] [MAIN ] PKST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:23.321237] [INFO ] [MAIN ] Derivative Progress: 1588/2226 symbols completed. PKG took 1.0s. Estimated remaining: 3m 44s. Rate: 170.7 symbols/min [2025-09-14T20:58:23.322518] [INFO ] [MAIN ] PKST: Generated 1352 derivative records from 13160 primary records. [2025-09-14T20:58:23.323535] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-14T20:58:23.336598] [DEBUG] [LOCAL ] PKST: Derivative data saved (1352 records). [2025-09-14T20:58:23.336873] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-14T20:58:23.339122] [INFO ] [MAIN ] Derivative Progress: 1589/2226 symbols completed. PKST took 0.9s. Estimated remaining: 3m 44s. Rate: 170.8 symbols/min [2025-09-14T20:58:23.352195] [DEBUG] [MAIN ] PKX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:23.352851] [INFO ] [MAIN ] PKX: Generated 1352 derivative records from 17013 primary records. [2025-09-14T20:58:23.352931] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-14T20:58:23.365052] [DEBUG] [LOCAL ] PKX: Derivative data saved (1352 records). [2025-09-14T20:58:23.365150] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-14T20:58:23.367024] [INFO ] [MAIN ] Derivative Progress: 1590/2226 symbols completed. PKX took 0.8s. Estimated remaining: 3m 43s. Rate: 170.9 symbols/min [2025-09-14T20:58:23.367475] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:23.367634] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:23.367733] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:23.388623] [DEBUG] [LOCAL ] PLOW: Loaded 15707 existing records from primary storage. [2025-09-14T20:58:23.388839] [INFO ] [MAIN ] PLOW: Loaded 15707 primary data records. [2025-09-14T20:58:23.561165] [DEBUG] [LOCAL ] PL: Loaded 39968 existing records from primary storage. [2025-09-14T20:58:23.623628] [INFO ] [MAIN ] PL: Loaded 39968 primary data records. [2025-09-14T20:58:23.741105] [DEBUG] [LOCAL ] PLD: Loaded 40247 existing records from primary storage. [2025-09-14T20:58:23.790176] [INFO ] [MAIN ] PLD: Loaded 40247 primary data records. [2025-09-14T20:58:24.291793] [DEBUG] [MAIN ] PLOW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:24.293843] [INFO ] [MAIN ] PLOW: Generated 1352 derivative records from 15707 primary records. [2025-09-14T20:58:24.294521] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-14T20:58:24.311506] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1352 records). [2025-09-14T20:58:24.311746] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-14T20:58:24.314465] [INFO ] [MAIN ] Derivative Progress: 1591/2226 symbols completed. PLOW took 0.9s. Estimated remaining: 3m 43s. Rate: 170.8 symbols/min [2025-09-14T20:58:24.315093] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:24.329569] [DEBUG] [MAIN ] PL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:24.330491] [INFO ] [MAIN ] PL: Generated 1352 derivative records from 39968 primary records. [2025-09-14T20:58:24.332565] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-14T20:58:24.357524] [DEBUG] [LOCAL ] PL: Derivative data saved (1352 records). [2025-09-14T20:58:24.363762] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-14T20:58:24.364112] [DEBUG] [MAIN ] PLD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:24.366882] [INFO ] [MAIN ] Derivative Progress: 1592/2226 symbols completed. PL took 1.0s. Estimated remaining: 3m 43s. Rate: 170.8 symbols/min [2025-09-14T20:58:24.364952] [INFO ] [MAIN ] PLD: Generated 1352 derivative records from 40247 primary records. [2025-09-14T20:58:24.367102] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-14T20:58:24.367240] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:24.389238] [DEBUG] [LOCAL ] PLD: Derivative data saved (1352 records). [2025-09-14T20:58:24.389909] [DEBUG] [LOCAL ] PLYM: Loaded 24636 existing records from primary storage. [2025-09-14T20:58:24.390069] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-14T20:58:24.392102] [INFO ] [MAIN ] Derivative Progress: 1593/2226 symbols completed. PLD took 1.0s. Estimated remaining: 3m 42s. Rate: 170.9 symbols/min [2025-09-14T20:58:24.392428] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:24.390190] [INFO ] [MAIN ] PLYM: Loaded 24636 primary data records. [2025-09-14T20:58:24.600122] [DEBUG] [LOCAL ] PML: Loaded 15514 existing records from primary storage. [2025-09-14T20:58:24.647022] [INFO ] [MAIN ] PML: Loaded 15514 primary data records. [2025-09-14T20:58:24.758275] [DEBUG] [LOCAL ] PM: Loaded 40417 existing records from primary storage. [2025-09-14T20:58:24.808841] [INFO ] [MAIN ] PM: Loaded 40417 primary data records. [2025-09-14T20:58:25.325257] [DEBUG] [MAIN ] PLYM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:25.326301] [INFO ] [MAIN ] PLYM: Generated 1352 derivative records from 24636 primary records. [2025-09-14T20:58:25.328179] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-14T20:58:25.344163] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1352 records). [2025-09-14T20:58:25.344303] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-14T20:58:25.346438] [INFO ] [MAIN ] Derivative Progress: 1594/2226 symbols completed. PLYM took 1.0s. Estimated remaining: 3m 42s. Rate: 170.8 symbols/min [2025-09-14T20:58:25.347606] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:25.365090] [DEBUG] [MAIN ] PML: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:25.367424] [INFO ] [MAIN ] PML: Generated 1352 derivative records from 15514 primary records. [2025-09-14T20:58:25.367666] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-14T20:58:25.371674] [DEBUG] [LOCAL ] PMM: Loaded 6973 existing records from primary storage. [2025-09-14T20:58:25.372101] [INFO ] [MAIN ] PMM: Loaded 6973 primary data records. [2025-09-14T20:58:25.439817] [DEBUG] [MAIN ] PM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:25.455458] [INFO ] [MAIN ] PM: Generated 1352 derivative records from 40417 primary records. [2025-09-14T20:58:25.472080] [DEBUG] [LOCAL ] PML: Derivative data saved (1352 records). [2025-09-14T20:58:25.479514] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-09-14T20:58:25.509750] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-14T20:58:25.512986] [INFO ] [MAIN ] Derivative Progress: 1595/2226 symbols completed. PML took 1.1s. Estimated remaining: 3m 42s. Rate: 170.8 symbols/min [2025-09-14T20:58:25.572150] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:25.620804] [DEBUG] [LOCAL ] PM: Derivative data saved (1352 records). [2025-09-14T20:58:25.719118] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-09-14T20:58:25.721366] [INFO ] [MAIN ] Derivative Progress: 1596/2226 symbols completed. PM took 1.4s. Estimated remaining: 3m 41s. Rate: 170.9 symbols/min [2025-09-14T20:58:25.721987] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:25.729934] [DEBUG] [LOCAL ] PMO: Loaded 7053 existing records from primary storage. [2025-09-14T20:58:25.730368] [INFO ] [MAIN ] PMO: Loaded 7053 primary data records. [2025-09-14T20:58:25.937693] [DEBUG] [LOCAL ] PMT: Loaded 29928 existing records from primary storage. [2025-09-14T20:58:25.943304] [INFO ] [MAIN ] PMT: Loaded 29928 primary data records. [2025-09-14T20:58:26.201908] [DEBUG] [MAIN ] PMM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:26.240685] [INFO ] [MAIN ] PMM: Generated 1352 derivative records from 6973 primary records. [2025-09-14T20:58:26.328987] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-14T20:58:26.343112] [DEBUG] [LOCAL ] PMM: Derivative data saved (1352 records). [2025-09-14T20:58:26.344071] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-14T20:58:26.347921] [INFO ] [MAIN ] Derivative Progress: 1597/2226 symbols completed. PMM took 1.0s. Estimated remaining: 3m 41s. Rate: 170.8 symbols/min [2025-09-14T20:58:26.350354] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:26.362261] [DEBUG] [MAIN ] PMO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:26.364420] [INFO ] [MAIN ] PMO: Generated 1352 derivative records from 7053 primary records. [2025-09-14T20:58:26.364728] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-14T20:58:26.386099] [DEBUG] [LOCAL ] PMO: Derivative data saved (1352 records). [2025-09-14T20:58:26.388176] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-14T20:58:26.390677] [INFO ] [MAIN ] Derivative Progress: 1598/2226 symbols completed. PMO took 0.9s. Estimated remaining: 3m 41s. Rate: 170.9 symbols/min [2025-09-14T20:58:26.402004] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:26.401779] [DEBUG] [MAIN ] PMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:26.403368] [INFO ] [MAIN ] PMT: Generated 1352 derivative records from 29928 primary records. [2025-09-14T20:58:26.403759] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-14T20:58:26.429859] [DEBUG] [LOCAL ] PMT: Derivative data saved (1352 records). [2025-09-14T20:58:26.433086] [DEBUG] [LOCAL ] PNI: Loaded 4942 existing records from primary storage. [2025-09-14T20:58:26.433605] [INFO ] [MAIN ] PNI: Loaded 4942 primary data records. [2025-09-14T20:58:26.433473] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-14T20:58:26.457346] [INFO ] [MAIN ] Derivative Progress: 1599/2226 symbols completed. PMT took 0.7s. Estimated remaining: 3m 40s. Rate: 171.0 symbols/min [2025-09-14T20:58:26.473621] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:26.544565] [DEBUG] [LOCAL ] PNC: Loaded 39287 existing records from primary storage. [2025-09-14T20:58:26.562620] [INFO ] [MAIN ] PNC: Loaded 39287 primary data records. [2025-09-14T20:58:26.901173] [DEBUG] [LOCAL ] PNNT: Loaded 24207 existing records from primary storage. [2025-09-14T20:58:26.950993] [INFO ] [MAIN ] PNNT: Loaded 24207 primary data records. [2025-09-14T20:58:27.379243] [DEBUG] [MAIN ] PNI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:27.381706] [INFO ] [MAIN ] PNI: Generated 1352 derivative records from 4942 primary records. [2025-09-14T20:58:27.382188] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-14T20:58:27.395852] [DEBUG] [LOCAL ] PNI: Derivative data saved (1352 records). [2025-09-14T20:58:27.396079] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-14T20:58:27.398188] [INFO ] [MAIN ] Derivative Progress: 1600/2226 symbols completed. PNI took 1.0s. Estimated remaining: 3m 40s. Rate: 170.8 symbols/min [2025-09-14T20:58:27.399598] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:27.413452] [DEBUG] [MAIN ] PNC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:27.414632] [INFO ] [MAIN ] PNC: Generated 1352 derivative records from 39287 primary records. [2025-09-14T20:58:27.414940] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-09-14T20:58:27.440170] [DEBUG] [LOCAL ] PNC: Derivative data saved (1352 records). [2025-09-14T20:58:27.440832] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-09-14T20:58:27.440719] [DEBUG] [MAIN ] PNNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:27.444274] [INFO ] [MAIN ] Derivative Progress: 1601/2226 symbols completed. PNC took 1.1s. Estimated remaining: 3m 39s. Rate: 170.9 symbols/min [2025-09-14T20:58:27.444812] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:27.446033] [INFO ] [MAIN ] PNNT: Generated 1352 derivative records from 24207 primary records. [2025-09-14T20:58:27.446598] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-14T20:58:27.468422] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1352 records). [2025-09-14T20:58:27.468756] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-14T20:58:27.470693] [INFO ] [MAIN ] Derivative Progress: 1602/2226 symbols completed. PNNT took 1.0s. Estimated remaining: 3m 39s. Rate: 171.0 symbols/min [2025-09-14T20:58:27.471102] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:27.486887] [DEBUG] [LOCAL ] PNR: Loaded 35810 existing records from primary storage. [2025-09-14T20:58:27.487323] [INFO ] [MAIN ] PNR: Loaded 35810 primary data records. [2025-09-14T20:58:27.722810] [DEBUG] [LOCAL ] PNW: Loaded 34616 existing records from primary storage. [2025-09-14T20:58:27.806334] [DEBUG] [LOCAL ] POR: Loaded 35115 existing records from primary storage. [2025-09-14T20:58:27.813083] [INFO ] [MAIN ] PNW: Loaded 34616 primary data records. [2025-09-14T20:58:27.813210] [INFO ] [MAIN ] POR: Loaded 35115 primary data records. [2025-09-14T20:58:28.400580] [DEBUG] [MAIN ] PNR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:28.401850] [INFO ] [MAIN ] PNR: Generated 1352 derivative records from 35810 primary records. [2025-09-14T20:58:28.402218] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-09-14T20:58:28.433068] [DEBUG] [LOCAL ] PNR: Derivative data saved (1352 records). [2025-09-14T20:58:28.438178] [DEBUG] [MAIN ] POR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:28.439793] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-09-14T20:58:28.441005] [INFO ] [MAIN ] POR: Generated 1352 derivative records from 35115 primary records. [2025-09-14T20:58:28.444322] [INFO ] [MAIN ] Derivative Progress: 1603/2226 symbols completed. PNR took 1.0s. Estimated remaining: 3m 39s. Rate: 170.8 symbols/min [2025-09-14T20:58:28.444779] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-14T20:58:28.455328] [DEBUG] [MAIN ] PNW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:28.456399] [INFO ] [MAIN ] PNW: Generated 1352 derivative records from 34616 primary records. [2025-09-14T20:58:28.456691] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-14T20:58:28.481766] [DEBUG] [LOCAL ] PNW: Derivative data saved (1352 records). [2025-09-14T20:58:28.482549] [DEBUG] [LOCAL ] POR: Derivative data saved (1352 records). [2025-09-14T20:58:28.482739] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-14T20:58:28.482791] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-14T20:58:28.484606] [INFO ] [MAIN ] Derivative Progress: 1604/2226 symbols completed. PNW took 1.0s. Estimated remaining: 3m 38s. Rate: 170.9 symbols/min [2025-09-14T20:58:28.487102] [INFO ] [MAIN ] Derivative Progress: 1605/2226 symbols completed. POR took 1.0s. Estimated remaining: 3m 38s. Rate: 171.0 symbols/min [2025-09-14T20:58:28.487940] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:28.488056] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:28.488215] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:28.553976] [DEBUG] [LOCAL ] POST: Loaded 29045 existing records from primary storage. [2025-09-14T20:58:28.554663] [DEBUG] [LOCAL ] PPL: Loaded 40279 existing records from primary storage. [2025-09-14T20:58:28.555005] [INFO ] [MAIN ] POST: Loaded 29045 primary data records. [2025-09-14T20:58:28.563710] [INFO ] [MAIN ] PPL: Loaded 40279 primary data records. [2025-09-14T20:58:28.853206] [DEBUG] [LOCAL ] PPG: Loaded 37868 existing records from primary storage. [2025-09-14T20:58:28.916519] [INFO ] [MAIN ] PPG: Loaded 37868 primary data records. [2025-09-14T20:58:29.503254] [DEBUG] [MAIN ] POST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:29.508298] [DEBUG] [MAIN ] PPL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:29.510589] [INFO ] [MAIN ] POST: Generated 1352 derivative records from 29045 primary records. [2025-09-14T20:58:29.511636] [INFO ] [MAIN ] PPL: Generated 1352 derivative records from 40279 primary records. [2025-09-14T20:58:29.512102] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-09-14T20:58:29.513217] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-14T20:58:29.526289] [DEBUG] [LOCAL ] PPL: Derivative data saved (1352 records). [2025-09-14T20:58:29.526929] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-09-14T20:58:29.530562] [INFO ] [MAIN ] Derivative Progress: 1606/2226 symbols completed. PPL took 1.0s. Estimated remaining: 3m 38s. Rate: 170.8 symbols/min [2025-09-14T20:58:29.537065] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:29.545588] [DEBUG] [LOCAL ] POST: Derivative data saved (1352 records). [2025-09-14T20:58:29.546010] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-14T20:58:29.547789] [INFO ] [MAIN ] Derivative Progress: 1607/2226 symbols completed. POST took 1.1s. Estimated remaining: 3m 37s. Rate: 170.9 symbols/min [2025-09-14T20:58:29.549451] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:29.567466] [DEBUG] [MAIN ] PPG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:29.568332] [INFO ] [MAIN ] PPG: Generated 1352 derivative records from 37868 primary records. [2025-09-14T20:58:29.568909] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-14T20:58:29.582391] [DEBUG] [LOCAL ] PPT: Loaded 15034 existing records from primary storage. [2025-09-14T20:58:29.588882] [INFO ] [MAIN ] PPT: Loaded 15034 primary data records. [2025-09-14T20:58:29.624080] [DEBUG] [LOCAL ] PPG: Derivative data saved (1352 records). [2025-09-14T20:58:29.703003] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-14T20:58:29.729579] [INFO ] [MAIN ] Derivative Progress: 1608/2226 symbols completed. PPG took 1.2s. Estimated remaining: 3m 37s. Rate: 170.9 symbols/min [2025-09-14T20:58:29.770175] [DEBUG] [LOCAL ] PR: Loaded 40354 existing records from primary storage. [2025-09-14T20:58:29.796469] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:29.806166] [INFO ] [MAIN ] PR: Loaded 40354 primary data records. [2025-09-14T20:58:30.128180] [DEBUG] [LOCAL ] PRA: Loaded 26274 existing records from primary storage. [2025-09-14T20:58:30.213488] [INFO ] [MAIN ] PRA: Loaded 26274 primary data records. [2025-09-14T20:58:30.449527] [DEBUG] [MAIN ] PPT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:30.547069] [INFO ] [MAIN ] PPT: Generated 1352 derivative records from 15034 primary records. [2025-09-14T20:58:30.547544] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-14T20:58:30.564060] [DEBUG] [LOCAL ] PPT: Derivative data saved (1352 records). [2025-09-14T20:58:30.567685] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-14T20:58:30.571130] [INFO ] [MAIN ] Derivative Progress: 1609/2226 symbols completed. PPT took 1.0s. Estimated remaining: 3m 37s. Rate: 170.8 symbols/min [2025-09-14T20:58:30.579124] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:30.584060] [DEBUG] [MAIN ] PR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:30.585924] [INFO ] [MAIN ] PR: Generated 1352 derivative records from 40354 primary records. [2025-09-14T20:58:30.586922] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-14T20:58:30.591008] [DEBUG] [LOCAL ] PRCS: Loaded 2019 existing records from primary storage. [2025-09-14T20:58:30.600363] [INFO ] [MAIN ] PRCS: Loaded 2019 primary data records. [2025-09-14T20:58:30.603356] [DEBUG] [LOCAL ] PR: Derivative data saved (1352 records). [2025-09-14T20:58:30.640592] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-14T20:58:30.673129] [INFO ] [MAIN ] Derivative Progress: 1610/2226 symbols completed. PR took 1.1s. Estimated remaining: 3m 36s. Rate: 170.9 symbols/min [2025-09-14T20:58:30.691401] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:30.822565] [DEBUG] [MAIN ] PRA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:30.918065] [INFO ] [MAIN ] PRA: Generated 1352 derivative records from 26274 primary records. [2025-09-14T20:58:30.926395] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-14T20:58:30.928055] [DEBUG] [LOCAL ] PRG: Loaded 22008 existing records from primary storage. [2025-09-14T20:58:30.929520] [INFO ] [MAIN ] PRG: Loaded 22008 primary data records. [2025-09-14T20:58:31.009197] [DEBUG] [LOCAL ] PRA: Derivative data saved (1352 records). [2025-09-14T20:58:31.058550] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-14T20:58:31.064665] [INFO ] [MAIN ] Derivative Progress: 1611/2226 symbols completed. PRA took 1.3s. Estimated remaining: 3m 36s. Rate: 170.8 symbols/min [2025-09-14T20:58:31.092699] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:31.254267] [DEBUG] [MAIN ] PRCS: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:58:31.256807] [INFO ] [MAIN ] PRCS: Generated 1351 derivative records from 2019 primary records. [2025-09-14T20:58:31.257663] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-09-14T20:58:31.270150] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1351 records). [2025-09-14T20:58:31.278922] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-09-14T20:58:31.280957] [INFO ] [MAIN ] Derivative Progress: 1612/2226 symbols completed. PRCS took 0.7s. Estimated remaining: 3m 36s. Rate: 170.9 symbols/min [2025-09-14T20:58:31.281721] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:31.301768] [DEBUG] [LOCAL ] PRGO: Loaded 34678 existing records from primary storage. [2025-09-14T20:58:31.301005] [DEBUG] [LOCAL ] PRH: Loaded 3644 existing records from primary storage. [2025-09-14T20:58:31.301945] [INFO ] [MAIN ] PRGO: Loaded 34678 primary data records. [2025-09-14T20:58:31.346688] [DEBUG] [MAIN ] PRG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:31.317806] [INFO ] [MAIN ] PRH: Loaded 3644 primary data records. [2025-09-14T20:58:31.364884] [INFO ] [MAIN ] PRG: Generated 1352 derivative records from 22008 primary records. [2025-09-14T20:58:31.409366] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-14T20:58:31.548786] [DEBUG] [LOCAL ] PRG: Derivative data saved (1352 records). [2025-09-14T20:58:31.585862] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-14T20:58:31.687229] [INFO ] [MAIN ] Derivative Progress: 1613/2226 symbols completed. PRG took 1.0s. Estimated remaining: 3m 35s. Rate: 170.9 symbols/min [2025-09-14T20:58:31.949228] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:31.969964] [DEBUG] [LOCAL ] PRI: Loaded 13321 existing records from primary storage. [2025-09-14T20:58:31.970677] [INFO ] [MAIN ] PRI: Loaded 13321 primary data records. [2025-09-14T20:58:32.196349] [DEBUG] [MAIN ] PRGO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:32.197024] [DEBUG] [MAIN ] PRH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:32.287315] [INFO ] [MAIN ] PRGO: Generated 1352 derivative records from 34678 primary records. [2025-09-14T20:58:32.288823] [INFO ] [MAIN ] PRH: Generated 1352 derivative records from 3644 primary records. [2025-09-14T20:58:32.289255] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-14T20:58:32.289386] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-14T20:58:32.311566] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1352 records). [2025-09-14T20:58:32.314595] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-14T20:58:32.317147] [DEBUG] [LOCAL ] PRH: Derivative data saved (1352 records). [2025-09-14T20:58:32.319336] [INFO ] [MAIN ] Derivative Progress: 1614/2226 symbols completed. PRGO took 1.2s. Estimated remaining: 3m 35s. Rate: 170.8 symbols/min [2025-09-14T20:58:32.319930] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-14T20:58:32.320310] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:32.323737] [INFO ] [MAIN ] Derivative Progress: 1615/2226 symbols completed. PRH took 1.0s. Estimated remaining: 3m 35s. Rate: 170.9 symbols/min [2025-09-14T20:58:32.324079] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:32.344181] [DEBUG] [MAIN ] PRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:32.345073] [INFO ] [MAIN ] PRI: Generated 1352 derivative records from 13321 primary records. [2025-09-14T20:58:32.345154] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-14T20:58:32.358634] [DEBUG] [LOCAL ] PRI: Derivative data saved (1352 records). [2025-09-14T20:58:32.367114] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-14T20:58:32.369753] [INFO ] [MAIN ] Derivative Progress: 1616/2226 symbols completed. PRI took 0.5s. Estimated remaining: 3m 34s. Rate: 171.0 symbols/min [2025-09-14T20:58:32.377393] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:32.400334] [DEBUG] [LOCAL ] PRIM: Loaded 33406 existing records from primary storage. [2025-09-14T20:58:32.405562] [INFO ] [MAIN ] PRIM: Loaded 33406 primary data records. [2025-09-14T20:58:32.406681] [DEBUG] [LOCAL ] PRKS: Loaded 31624 existing records from primary storage. [2025-09-14T20:58:32.427872] [INFO ] [MAIN ] PRKS: Loaded 31624 primary data records. [2025-09-14T20:58:32.593494] [DEBUG] [LOCAL ] PRLB: Loaded 15442 existing records from primary storage. [2025-09-14T20:58:32.633164] [INFO ] [MAIN ] PRLB: Loaded 15442 primary data records. [2025-09-14T20:58:33.322797] [DEBUG] [MAIN ] PRKS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:33.328500] [INFO ] [MAIN ] PRKS: Generated 1352 derivative records from 31624 primary records. [2025-09-14T20:58:33.327388] [DEBUG] [MAIN ] PRIM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:33.328703] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-14T20:58:33.329267] [INFO ] [MAIN ] PRIM: Generated 1352 derivative records from 33406 primary records. [2025-09-14T20:58:33.330087] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-14T20:58:33.355486] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1352 records). [2025-09-14T20:58:33.356463] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-14T20:58:33.360538] [INFO ] [MAIN ] Derivative Progress: 1617/2226 symbols completed. PRKS took 1.0s. Estimated remaining: 3m 34s. Rate: 170.8 symbols/min [2025-09-14T20:58:33.372743] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1352 records). [2025-09-14T20:58:33.373528] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-14T20:58:33.373446] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:33.373110] [DEBUG] [MAIN ] PRLB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:33.375464] [INFO ] [MAIN ] Derivative Progress: 1618/2226 symbols completed. PRIM took 1.1s. Estimated remaining: 3m 33s. Rate: 170.9 symbols/min [2025-09-14T20:58:33.376616] [INFO ] [MAIN ] PRLB: Generated 1352 derivative records from 15442 primary records. [2025-09-14T20:58:33.377386] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-14T20:58:33.390522] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1352 records). [2025-09-14T20:58:33.390665] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-14T20:58:33.392771] [INFO ] [MAIN ] Derivative Progress: 1619/2226 symbols completed. PRLB took 1.0s. Estimated remaining: 3m 33s. Rate: 171.0 symbols/min [2025-09-14T20:58:33.422195] [DEBUG] [LOCAL ] PRM: Loaded 33203 existing records from primary storage. [2025-09-14T20:58:33.422429] [INFO ] [MAIN ] PRM: Loaded 33203 primary data records. [2025-09-14T20:58:33.743971] [DEBUG] [MAIN ] PRM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:33.744833] [INFO ] [MAIN ] PRM: Generated 1352 derivative records from 33203 primary records. [2025-09-14T20:58:33.744916] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-14T20:58:33.758791] [DEBUG] [LOCAL ] PRM: Derivative data saved (1352 records). [2025-09-14T20:58:33.758978] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-14T20:58:33.761152] [INFO ] [MAIN ] Derivative Progress: 1620/2226 symbols completed. PRM took 0.4s. Estimated remaining: 3m 33s. Rate: 171.0 symbols/min [2025-09-14T20:58:33.762173] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:33.762451] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:33.762905] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:33.783597] [DEBUG] [LOCAL ] PRSU: Loaded 17935 existing records from primary storage. [2025-09-14T20:58:33.793999] [INFO ] [MAIN ] PRSU: Loaded 17935 primary data records. [2025-09-14T20:58:33.923172] [DEBUG] [LOCAL ] PRO: Loaded 28932 existing records from primary storage. [2025-09-14T20:58:33.950015] [INFO ] [MAIN ] PRO: Loaded 28932 primary data records. [2025-09-14T20:58:34.028718] [DEBUG] [LOCAL ] PRMB: Loaded 40051 existing records from primary storage. [2025-09-14T20:58:34.196338] [INFO ] [MAIN ] PRMB: Loaded 40051 primary data records. [2025-09-14T20:58:34.790457] [DEBUG] [MAIN ] PRSU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:34.792222] [INFO ] [MAIN ] PRSU: Generated 1352 derivative records from 17935 primary records. [2025-09-14T20:58:34.792624] [DEBUG] [LOCAL ] PRSU: Saving derivative data. [2025-09-14T20:58:34.809300] [DEBUG] [LOCAL ] PRSU: Derivative data saved (1352 records). [2025-09-14T20:58:34.810112] [INFO ] [MAIN ] PRSU: Successfully saved derivative data. [2025-09-14T20:58:34.811991] [INFO ] [MAIN ] Derivative Progress: 1621/2226 symbols completed. PRSU took 1.0s. Estimated remaining: 3m 33s. Rate: 170.8 symbols/min [2025-09-14T20:58:34.813070] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:34.830901] [DEBUG] [LOCAL ] PRT: Loaded 3655 existing records from primary storage. [2025-09-14T20:58:34.835978] [DEBUG] [MAIN ] PRO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:34.836198] [INFO ] [MAIN ] PRT: Loaded 3655 primary data records. [2025-09-14T20:58:34.837424] [INFO ] [MAIN ] PRO: Generated 1352 derivative records from 28932 primary records. [2025-09-14T20:58:34.900807] [DEBUG] [MAIN ] PRMB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:34.890024] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-14T20:58:34.926075] [INFO ] [MAIN ] PRMB: Generated 1352 derivative records from 40051 primary records. [2025-09-14T20:58:34.969748] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-14T20:58:35.078909] [DEBUG] [LOCAL ] PRO: Derivative data saved (1352 records). [2025-09-14T20:58:35.168870] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-14T20:58:35.171308] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1352 records). [2025-09-14T20:58:35.173930] [INFO ] [MAIN ] Derivative Progress: 1622/2226 symbols completed. PRO took 1.4s. Estimated remaining: 3m 32s. Rate: 170.8 symbols/min [2025-09-14T20:58:35.175271] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:35.174921] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-14T20:58:35.177881] [INFO ] [MAIN ] Derivative Progress: 1623/2226 symbols completed. PRMB took 1.4s. Estimated remaining: 3m 32s. Rate: 170.9 symbols/min [2025-09-14T20:58:35.179161] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:35.198740] [DEBUG] [MAIN ] PRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:35.199511] [INFO ] [MAIN ] PRT: Generated 1352 derivative records from 3655 primary records. [2025-09-14T20:58:35.199623] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-14T20:58:35.332496] [DEBUG] [LOCAL ] PRT: Derivative data saved (1352 records). [2025-09-14T20:58:35.332862] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-14T20:58:35.335182] [INFO ] [MAIN ] Derivative Progress: 1624/2226 symbols completed. PRT took 0.5s. Estimated remaining: 3m 31s. Rate: 170.9 symbols/min [2025-09-14T20:58:35.336115] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:35.359318] [DEBUG] [LOCAL ] PSA: Loaded 31590 existing records from primary storage. [2025-09-14T20:58:35.359586] [INFO ] [MAIN ] PSA: Loaded 31590 primary data records. [2025-09-14T20:58:35.385575] [DEBUG] [LOCAL ] PSBD: Loaded 5174 existing records from primary storage. [2025-09-14T20:58:35.408304] [INFO ] [MAIN ] PSBD: Loaded 5174 primary data records. [2025-09-14T20:58:35.598825] [DEBUG] [LOCAL ] PRU: Loaded 38574 existing records from primary storage. [2025-09-14T20:58:35.652540] [INFO ] [MAIN ] PRU: Loaded 38574 primary data records. [2025-09-14T20:58:36.274931] [DEBUG] [MAIN ] PSBD: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:58:36.284581] [DEBUG] [MAIN ] PSA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:36.285524] [INFO ] [MAIN ] PSBD: Generated 1351 derivative records from 5174 primary records. [2025-09-14T20:58:36.286763] [INFO ] [MAIN ] PSA: Generated 1352 derivative records from 31590 primary records. [2025-09-14T20:58:36.286890] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-14T20:58:36.288834] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-14T20:58:36.312217] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1351 records). [2025-09-14T20:58:36.314321] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-14T20:58:36.323949] [INFO ] [MAIN ] Derivative Progress: 1625/2226 symbols completed. PSBD took 1.0s. Estimated remaining: 3m 31s. Rate: 170.7 symbols/min [2025-09-14T20:58:36.328403] [DEBUG] [MAIN ] PRU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:36.328583] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:36.329301] [INFO ] [MAIN ] PRU: Generated 1352 derivative records from 38574 primary records. [2025-09-14T20:58:36.329552] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-14T20:58:36.327890] [DEBUG] [LOCAL ] PSA: Derivative data saved (1352 records). [2025-09-14T20:58:36.330689] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-14T20:58:36.332702] [INFO ] [MAIN ] Derivative Progress: 1626/2226 symbols completed. PSA took 1.2s. Estimated remaining: 3m 31s. Rate: 170.8 symbols/min [2025-09-14T20:58:36.333305] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:36.347384] [DEBUG] [LOCAL ] PRU: Derivative data saved (1352 records). [2025-09-14T20:58:36.347705] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-14T20:58:36.350772] [INFO ] [MAIN ] Derivative Progress: 1627/2226 symbols completed. PRU took 1.2s. Estimated remaining: 3m 30s. Rate: 170.9 symbols/min [2025-09-14T20:58:36.351346] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:36.354808] [DEBUG] [LOCAL ] PSF: Loaded 5000 existing records from primary storage. [2025-09-14T20:58:36.355040] [INFO ] [MAIN ] PSF: Loaded 5000 primary data records. [2025-09-14T20:58:36.514801] [DEBUG] [LOCAL ] PSFE: Loaded 22960 existing records from primary storage. [2025-09-14T20:58:36.561218] [INFO ] [MAIN ] PSFE: Loaded 22960 primary data records. [2025-09-14T20:58:36.763580] [DEBUG] [LOCAL ] PSN: Loaded 34321 existing records from primary storage. [2025-09-14T20:58:36.817261] [INFO ] [MAIN ] PSN: Loaded 34321 primary data records. [2025-09-14T20:58:37.317823] [DEBUG] [MAIN ] PSF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:37.319922] [INFO ] [MAIN ] PSF: Generated 1352 derivative records from 5000 primary records. [2025-09-14T20:58:37.320354] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-14T20:58:37.336188] [DEBUG] [LOCAL ] PSF: Derivative data saved (1352 records). [2025-09-14T20:58:37.337804] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-14T20:58:37.340205] [INFO ] [MAIN ] Derivative Progress: 1628/2226 symbols completed. PSF took 1.0s. Estimated remaining: 3m 30s. Rate: 170.7 symbols/min [2025-09-14T20:58:37.340932] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:37.351973] [DEBUG] [MAIN ] PSFE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:37.353124] [INFO ] [MAIN ] PSFE: Generated 1352 derivative records from 22960 primary records. [2025-09-14T20:58:37.353418] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-14T20:58:37.376100] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1352 records). [2025-09-14T20:58:37.380768] [DEBUG] [MAIN ] PSN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:37.380490] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-14T20:58:37.381865] [INFO ] [MAIN ] PSN: Generated 1352 derivative records from 34321 primary records. [2025-09-14T20:58:37.384100] [INFO ] [MAIN ] Derivative Progress: 1629/2226 symbols completed. PSFE took 1.1s. Estimated remaining: 3m 30s. Rate: 170.8 symbols/min [2025-09-14T20:58:37.384198] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-14T20:58:37.393031] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:37.406365] [DEBUG] [LOCAL ] PSN: Derivative data saved (1352 records). [2025-09-14T20:58:37.407804] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-14T20:58:37.418809] [INFO ] [MAIN ] Derivative Progress: 1630/2226 symbols completed. PSN took 1.1s. Estimated remaining: 3m 29s. Rate: 170.9 symbols/min [2025-09-14T20:58:37.419904] [DEBUG] [LOCAL ] PSO: Loaded 27438 existing records from primary storage. [2025-09-14T20:58:37.420230] [INFO ] [MAIN ] PSO: Loaded 27438 primary data records. [2025-09-14T20:58:37.420605] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:37.608192] [DEBUG] [LOCAL ] PSQH: Loaded 25231 existing records from primary storage. [2025-09-14T20:58:37.641574] [INFO ] [MAIN ] PSQH: Loaded 25231 primary data records. [2025-09-14T20:58:37.856328] [DEBUG] [LOCAL ] PSTG: Loaded 39671 existing records from primary storage. [2025-09-14T20:58:37.877575] [INFO ] [MAIN ] PSTG: Loaded 39671 primary data records. [2025-09-14T20:58:38.332587] [DEBUG] [MAIN ] PSO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:38.333498] [INFO ] [MAIN ] PSO: Generated 1352 derivative records from 27438 primary records. [2025-09-14T20:58:38.333982] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-14T20:58:38.349618] [DEBUG] [LOCAL ] PSO: Derivative data saved (1352 records). [2025-09-14T20:58:38.350162] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-14T20:58:38.352531] [INFO ] [MAIN ] Derivative Progress: 1631/2226 symbols completed. PSO took 1.0s. Estimated remaining: 3m 29s. Rate: 170.8 symbols/min [2025-09-14T20:58:38.353721] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:38.370093] [DEBUG] [MAIN ] PSQH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:38.371449] [INFO ] [MAIN ] PSQH: Generated 1352 derivative records from 25231 primary records. [2025-09-14T20:58:38.371679] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-14T20:58:38.395469] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1352 records). [2025-09-14T20:58:38.395970] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-14T20:58:38.398303] [INFO ] [MAIN ] Derivative Progress: 1632/2226 symbols completed. PSQH took 1.0s. Estimated remaining: 3m 29s. Rate: 170.9 symbols/min [2025-09-14T20:58:38.399039] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:38.411196] [DEBUG] [LOCAL ] PSTL: Loaded 15028 existing records from primary storage. [2025-09-14T20:58:38.411583] [INFO ] [MAIN ] PSTL: Loaded 15028 primary data records. [2025-09-14T20:58:38.446212] [DEBUG] [MAIN ] PSTG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:38.477105] [INFO ] [MAIN ] PSTG: Generated 1352 derivative records from 39671 primary records. [2025-09-14T20:58:38.515505] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-14T20:58:38.673118] [DEBUG] [LOCAL ] PSX: Loaded 40017 existing records from primary storage. [2025-09-14T20:58:38.671983] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1352 records). [2025-09-14T20:58:38.745844] [INFO ] [MAIN ] PSX: Loaded 40017 primary data records. [2025-09-14T20:58:38.759726] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-14T20:58:38.768174] [INFO ] [MAIN ] Derivative Progress: 1633/2226 symbols completed. PSTG took 1.3s. Estimated remaining: 3m 28s. Rate: 170.8 symbols/min [2025-09-14T20:58:39.121251] [DEBUG] [MAIN ] PSTL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:39.122893] [INFO ] [MAIN ] PSTL: Generated 1352 derivative records from 15028 primary records. [2025-09-14T20:58:39.123420] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-14T20:58:39.137691] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1352 records). [2025-09-14T20:58:39.138929] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-14T20:58:39.140888] [INFO ] [MAIN ] Derivative Progress: 1634/2226 symbols completed. PSTL took 0.8s. Estimated remaining: 3m 28s. Rate: 170.8 symbols/min [2025-09-14T20:58:39.156095] [DEBUG] [MAIN ] PSX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:39.157043] [INFO ] [MAIN ] PSX: Generated 1352 derivative records from 40017 primary records. [2025-09-14T20:58:39.157139] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-14T20:58:39.171777] [DEBUG] [LOCAL ] PSX: Derivative data saved (1352 records). [2025-09-14T20:58:39.171997] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-14T20:58:39.175988] [INFO ] [MAIN ] Derivative Progress: 1635/2226 symbols completed. PSX took 0.8s. Estimated remaining: 3m 27s. Rate: 170.9 symbols/min [2025-09-14T20:58:39.177091] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:39.177173] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:39.176999] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:39.194162] [DEBUG] [LOCAL ] PTA: Loaded 10651 existing records from primary storage. [2025-09-14T20:58:39.194507] [INFO ] [MAIN ] PTA: Loaded 10651 primary data records. [2025-09-14T20:58:39.338911] [DEBUG] [LOCAL ] PTY: Loaded 27619 existing records from primary storage. [2025-09-14T20:58:39.354986] [INFO ] [MAIN ] PTY: Loaded 27619 primary data records. [2025-09-14T20:58:39.474952] [DEBUG] [LOCAL ] PUK: Loaded 32908 existing records from primary storage. [2025-09-14T20:58:39.603224] [INFO ] [MAIN ] PUK: Loaded 32908 primary data records. [2025-09-14T20:58:40.088941] [DEBUG] [MAIN ] PTA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:40.090152] [INFO ] [MAIN ] PTA: Generated 1352 derivative records from 10651 primary records. [2025-09-14T20:58:40.090764] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-14T20:58:40.116673] [DEBUG] [LOCAL ] PTA: Derivative data saved (1352 records). [2025-09-14T20:58:40.117284] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-14T20:58:40.119101] [INFO ] [MAIN ] Derivative Progress: 1636/2226 symbols completed. PTA took 0.9s. Estimated remaining: 3m 27s. Rate: 170.8 symbols/min [2025-09-14T20:58:40.119494] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:40.117083] [DEBUG] [MAIN ] PTY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:40.120988] [INFO ] [MAIN ] PTY: Generated 1352 derivative records from 27619 primary records. [2025-09-14T20:58:40.122606] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-14T20:58:40.148428] [DEBUG] [MAIN ] PUK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:40.150787] [INFO ] [MAIN ] PUK: Generated 1352 derivative records from 32908 primary records. [2025-09-14T20:58:40.151312] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-14T20:58:40.170065] [DEBUG] [LOCAL ] PTY: Derivative data saved (1352 records). [2025-09-14T20:58:40.171599] [DEBUG] [LOCAL ] PUK: Derivative data saved (1352 records). [2025-09-14T20:58:40.180287] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-14T20:58:40.182983] [INFO ] [MAIN ] Derivative Progress: 1637/2226 symbols completed. PTY took 1.0s. Estimated remaining: 3m 27s. Rate: 170.8 symbols/min [2025-09-14T20:58:40.180495] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-14T20:58:40.184981] [INFO ] [MAIN ] Derivative Progress: 1638/2226 symbols completed. PUK took 1.0s. Estimated remaining: 3m 26s. Rate: 170.9 symbols/min [2025-09-14T20:58:40.183320] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:40.185243] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:40.202416] [DEBUG] [LOCAL ] PVL: Loaded 3548 existing records from primary storage. [2025-09-14T20:58:40.203333] [DEBUG] [LOCAL ] PUMP: Loaded 37018 existing records from primary storage. [2025-09-14T20:58:40.203517] [INFO ] [MAIN ] PVL: Loaded 3548 primary data records. [2025-09-14T20:58:40.203568] [INFO ] [MAIN ] PUMP: Loaded 37018 primary data records. [2025-09-14T20:58:40.562829] [DEBUG] [LOCAL ] PVH: Loaded 38089 existing records from primary storage. [2025-09-14T20:58:40.695091] [INFO ] [MAIN ] PVH: Loaded 38089 primary data records. [2025-09-14T20:58:41.355933] [DEBUG] [MAIN ] PVL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:41.357136] [INFO ] [MAIN ] PVL: Generated 1352 derivative records from 3548 primary records. [2025-09-14T20:58:41.357548] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-14T20:58:41.381920] [DEBUG] [LOCAL ] PVL: Derivative data saved (1352 records). [2025-09-14T20:58:41.383240] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-14T20:58:41.386011] [INFO ] [MAIN ] Derivative Progress: 1639/2226 symbols completed. PVL took 1.2s. Estimated remaining: 3m 26s. Rate: 170.7 symbols/min [2025-09-14T20:58:41.386767] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:41.402295] [DEBUG] [MAIN ] PUMP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:41.404424] [INFO ] [MAIN ] PUMP: Generated 1352 derivative records from 37018 primary records. [2025-09-14T20:58:41.405097] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-14T20:58:41.426853] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1352 records). [2025-09-14T20:58:41.427518] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-14T20:58:41.430894] [INFO ] [MAIN ] Derivative Progress: 1640/2226 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 26s. Rate: 170.8 symbols/min [2025-09-14T20:58:41.431918] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:41.450566] [DEBUG] [MAIN ] PVH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:41.451592] [INFO ] [MAIN ] PVH: Generated 1352 derivative records from 38089 primary records. [2025-09-14T20:58:41.451771] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-14T20:58:41.490591] [DEBUG] [LOCAL ] PVH: Derivative data saved (1352 records). [2025-09-14T20:58:41.490846] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-14T20:58:41.493606] [INFO ] [MAIN ] Derivative Progress: 1641/2226 symbols completed. PVH took 1.3s. Estimated remaining: 3m 25s. Rate: 170.9 symbols/min [2025-09-14T20:58:41.497333] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:41.526897] [DEBUG] [LOCAL ] PWR: Loaded 35178 existing records from primary storage. [2025-09-14T20:58:41.527581] [INFO ] [MAIN ] PWR: Loaded 35178 primary data records. [2025-09-14T20:58:41.528719] [DEBUG] [LOCAL ] PX: Loaded 26389 existing records from primary storage. [2025-09-14T20:58:41.528830] [INFO ] [MAIN ] PX: Loaded 26389 primary data records. [2025-09-14T20:58:42.089588] [DEBUG] [LOCAL ] QBTS: Loaded 40560 existing records from primary storage. [2025-09-14T20:58:42.284726] [INFO ] [MAIN ] QBTS: Loaded 40560 primary data records. [2025-09-14T20:58:42.587334] [DEBUG] [MAIN ] PWR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:42.597165] [DEBUG] [MAIN ] PX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:42.598069] [INFO ] [MAIN ] PWR: Generated 1352 derivative records from 35178 primary records. [2025-09-14T20:58:42.599217] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-14T20:58:42.600423] [INFO ] [MAIN ] PX: Generated 1352 derivative records from 26389 primary records. [2025-09-14T20:58:42.606935] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-14T20:58:42.625201] [DEBUG] [LOCAL ] PWR: Derivative data saved (1352 records). [2025-09-14T20:58:42.627374] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-14T20:58:42.629881] [INFO ] [MAIN ] Derivative Progress: 1642/2226 symbols completed. PWR took 1.2s. Estimated remaining: 3m 25s. Rate: 170.6 symbols/min [2025-09-14T20:58:42.626858] [DEBUG] [LOCAL ] PX: Derivative data saved (1352 records). [2025-09-14T20:58:42.630085] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-14T20:58:42.632353] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:42.632533] [INFO ] [MAIN ] Derivative Progress: 1643/2226 symbols completed. PX took 1.2s. Estimated remaining: 3m 25s. Rate: 170.7 symbols/min [2025-09-14T20:58:42.635903] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:42.647356] [DEBUG] [MAIN ] QBTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:42.648137] [INFO ] [MAIN ] QBTS: Generated 1352 derivative records from 40560 primary records. [2025-09-14T20:58:42.648323] [DEBUG] [LOCAL ] QBTS: Saving derivative data. [2025-09-14T20:58:42.666801] [DEBUG] [LOCAL ] QBTS: Derivative data saved (1352 records). [2025-09-14T20:58:42.666973] [INFO ] [MAIN ] QBTS: Successfully saved derivative data. [2025-09-14T20:58:42.669098] [INFO ] [MAIN ] Derivative Progress: 1644/2226 symbols completed. QBTS took 1.2s. Estimated remaining: 3m 24s. Rate: 170.8 symbols/min [2025-09-14T20:58:42.670404] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:42.678038] [DEBUG] [LOCAL ] QD: Loaded 20705 existing records from primary storage. [2025-09-14T20:58:42.678465] [INFO ] [MAIN ] QD: Loaded 20705 primary data records. [2025-09-14T20:58:42.886701] [DEBUG] [LOCAL ] QGEN: Loaded 37071 existing records from primary storage. [2025-09-14T20:58:42.902867] [INFO ] [MAIN ] QGEN: Loaded 37071 primary data records. [2025-09-14T20:58:43.030944] [DEBUG] [LOCAL ] QS: Loaded 40500 existing records from primary storage. [2025-09-14T20:58:43.125850] [INFO ] [MAIN ] QS: Loaded 40500 primary data records. [2025-09-14T20:58:43.671756] [DEBUG] [MAIN ] QD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:43.673458] [INFO ] [MAIN ] QD: Generated 1352 derivative records from 20705 primary records. [2025-09-14T20:58:43.674264] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-14T20:58:43.694754] [DEBUG] [LOCAL ] QD: Derivative data saved (1352 records). [2025-09-14T20:58:43.695465] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-14T20:58:43.708107] [INFO ] [MAIN ] Derivative Progress: 1645/2226 symbols completed. QD took 1.1s. Estimated remaining: 3m 24s. Rate: 170.6 symbols/min [2025-09-14T20:58:43.709043] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:43.708666] [DEBUG] [MAIN ] QGEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:43.710011] [INFO ] [MAIN ] QGEN: Generated 1352 derivative records from 37071 primary records. [2025-09-14T20:58:43.710273] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-14T20:58:43.726244] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1352 records). [2025-09-14T20:58:43.726481] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-14T20:58:43.734853] [INFO ] [MAIN ] Derivative Progress: 1646/2226 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 24s. Rate: 170.7 symbols/min [2025-09-14T20:58:43.739509] [DEBUG] [MAIN ] QS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:43.739846] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:43.740759] [INFO ] [MAIN ] QS: Generated 1352 derivative records from 40500 primary records. [2025-09-14T20:58:43.741310] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-14T20:58:43.755735] [DEBUG] [LOCAL ] QS: Derivative data saved (1352 records). [2025-09-14T20:58:43.759171] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-14T20:58:43.761365] [INFO ] [MAIN ] Derivative Progress: 1647/2226 symbols completed. QS took 1.1s. Estimated remaining: 3m 23s. Rate: 170.8 symbols/min [2025-09-14T20:58:43.771579] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:43.808007] [DEBUG] [LOCAL ] QSR: Loaded 39436 existing records from primary storage. [2025-09-14T20:58:43.812632] [DEBUG] [LOCAL ] QTWO: Loaded 28213 existing records from primary storage. [2025-09-14T20:58:43.812835] [INFO ] [MAIN ] QSR: Loaded 39436 primary data records. [2025-09-14T20:58:43.812947] [INFO ] [MAIN ] QTWO: Loaded 28213 primary data records. [2025-09-14T20:58:44.048831] [DEBUG] [LOCAL ] QUAD: Loaded 18029 existing records from primary storage. [2025-09-14T20:58:44.073615] [INFO ] [MAIN ] QUAD: Loaded 18029 primary data records. [2025-09-14T20:58:44.796105] [DEBUG] [MAIN ] QSR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:44.800499] [DEBUG] [MAIN ] QTWO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:44.801262] [INFO ] [MAIN ] QSR: Generated 1352 derivative records from 39436 primary records. [2025-09-14T20:58:44.801410] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-14T20:58:44.801932] [INFO ] [MAIN ] QTWO: Generated 1352 derivative records from 28213 primary records. [2025-09-14T20:58:44.803118] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-14T20:58:44.839475] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1352 records). [2025-09-14T20:58:44.841546] [DEBUG] [LOCAL ] QSR: Derivative data saved (1352 records). [2025-09-14T20:58:44.841717] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-14T20:58:44.844002] [INFO ] [MAIN ] Derivative Progress: 1648/2226 symbols completed. QSR took 1.1s. Estimated remaining: 3m 23s. Rate: 170.6 symbols/min [2025-09-14T20:58:44.840866] [DEBUG] [MAIN ] QUAD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:44.841662] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-14T20:58:44.845077] [INFO ] [MAIN ] QUAD: Generated 1352 derivative records from 18029 primary records. [2025-09-14T20:58:44.847614] [INFO ] [MAIN ] Derivative Progress: 1649/2226 symbols completed. QTWO took 1.1s. Estimated remaining: 3m 23s. Rate: 170.7 symbols/min [2025-09-14T20:58:44.847774] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-14T20:58:44.860625] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1352 records). [2025-09-14T20:58:44.860769] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-14T20:58:44.862632] [INFO ] [MAIN ] Derivative Progress: 1650/2226 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 22s. Rate: 170.8 symbols/min [2025-09-14T20:58:44.863159] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:44.863655] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:44.863293] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:44.870534] [DEBUG] [LOCAL ] QVCD: Loaded 3433 existing records from primary storage. [2025-09-14T20:58:44.870788] [INFO ] [MAIN ] QVCD: Loaded 3433 primary data records. [2025-09-14T20:58:44.963606] [DEBUG] [LOCAL ] QVCC: Loaded 6548 existing records from primary storage. [2025-09-14T20:58:44.996609] [INFO ] [MAIN ] QVCC: Loaded 6548 primary data records. [2025-09-14T20:58:45.288527] [DEBUG] [LOCAL ] QXO: Loaded 40263 existing records from primary storage. [2025-09-14T20:58:45.305839] [INFO ] [MAIN ] QXO: Loaded 40263 primary data records. [2025-09-14T20:58:45.784734] [DEBUG] [MAIN ] QVCD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:45.786684] [INFO ] [MAIN ] QVCD: Generated 1352 derivative records from 3433 primary records. [2025-09-14T20:58:45.787367] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-14T20:58:45.805857] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1352 records). [2025-09-14T20:58:45.806089] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-14T20:58:45.808428] [INFO ] [MAIN ] Derivative Progress: 1651/2226 symbols completed. QVCD took 0.9s. Estimated remaining: 3m 22s. Rate: 170.6 symbols/min [2025-09-14T20:58:45.819082] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:45.820182] [DEBUG] [MAIN ] QVCC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:45.821120] [INFO ] [MAIN ] QVCC: Generated 1352 derivative records from 6548 primary records. [2025-09-14T20:58:45.821718] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-14T20:58:45.844847] [DEBUG] [MAIN ] QXO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:45.847952] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1352 records). [2025-09-14T20:58:45.848913] [INFO ] [MAIN ] QXO: Generated 1352 derivative records from 40263 primary records. [2025-09-14T20:58:45.849076] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-14T20:58:45.851711] [INFO ] [MAIN ] Derivative Progress: 1652/2226 symbols completed. QVCC took 1.0s. Estimated remaining: 3m 22s. Rate: 170.7 symbols/min [2025-09-14T20:58:45.851818] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-14T20:58:45.853102] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:45.871554] [DEBUG] [LOCAL ] QXO: Derivative data saved (1352 records). [2025-09-14T20:58:45.871687] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-14T20:58:45.873462] [INFO ] [MAIN ] Derivative Progress: 1653/2226 symbols completed. QXO took 1.0s. Estimated remaining: 3m 21s. Rate: 170.8 symbols/min [2025-09-14T20:58:45.873827] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:45.882410] [DEBUG] [LOCAL ] R: Loaded 20906 existing records from primary storage. [2025-09-14T20:58:45.887169] [INFO ] [MAIN ] R: Loaded 20906 primary data records. [2025-09-14T20:58:46.004383] [DEBUG] [LOCAL ] RA: Loaded 15948 existing records from primary storage. [2025-09-14T20:58:46.010257] [INFO ] [MAIN ] RA: Loaded 15948 primary data records. [2025-09-14T20:58:46.132811] [DEBUG] [LOCAL ] RACE: Loaded 23019 existing records from primary storage. [2025-09-14T20:58:46.188616] [INFO ] [MAIN ] RACE: Loaded 23019 primary data records. [2025-09-14T20:58:46.844453] [DEBUG] [MAIN ] R: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:46.846516] [INFO ] [MAIN ] R: Generated 1352 derivative records from 20906 primary records. [2025-09-14T20:58:46.846695] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-14T20:58:46.862772] [DEBUG] [LOCAL ] R: Derivative data saved (1352 records). [2025-09-14T20:58:46.869257] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-14T20:58:46.875588] [DEBUG] [MAIN ] RA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:46.875259] [INFO ] [MAIN ] Derivative Progress: 1654/2226 symbols completed. R took 1.1s. Estimated remaining: 3m 21s. Rate: 170.6 symbols/min [2025-09-14T20:58:46.879124] [INFO ] [MAIN ] RA: Generated 1352 derivative records from 15948 primary records. [2025-09-14T20:58:46.879611] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:46.889381] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-14T20:58:46.891247] [DEBUG] [MAIN ] RACE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:46.893066] [INFO ] [MAIN ] RACE: Generated 1352 derivative records from 23019 primary records. [2025-09-14T20:58:46.902299] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-14T20:58:46.906582] [DEBUG] [LOCAL ] RA: Derivative data saved (1352 records). [2025-09-14T20:58:46.916364] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-14T20:58:46.920342] [INFO ] [MAIN ] Derivative Progress: 1655/2226 symbols completed. RA took 1.1s. Estimated remaining: 3m 21s. Rate: 170.7 symbols/min [2025-09-14T20:58:46.921121] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:46.925195] [DEBUG] [LOCAL ] RACE: Derivative data saved (1352 records). [2025-09-14T20:58:46.933286] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-14T20:58:46.936069] [INFO ] [MAIN ] Derivative Progress: 1656/2226 symbols completed. RACE took 1.1s. Estimated remaining: 3m 20s. Rate: 170.8 symbols/min [2025-09-14T20:58:46.936620] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:46.950627] [DEBUG] [LOCAL ] RAMP: Loaded 27463 existing records from primary storage. [2025-09-14T20:58:46.950998] [INFO ] [MAIN ] RAMP: Loaded 27463 primary data records. [2025-09-14T20:58:47.025716] [DEBUG] [LOCAL ] RBC: Loaded 11038 existing records from primary storage. [2025-09-14T20:58:47.049293] [INFO ] [MAIN ] RBC: Loaded 11038 primary data records. [2025-09-14T20:58:47.303564] [DEBUG] [LOCAL ] RBA: Loaded 34408 existing records from primary storage. [2025-09-14T20:58:47.445179] [INFO ] [MAIN ] RBA: Loaded 34408 primary data records. [2025-09-14T20:58:47.901785] [DEBUG] [MAIN ] RBC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:47.903014] [INFO ] [MAIN ] RBC: Generated 1352 derivative records from 11038 primary records. [2025-09-14T20:58:47.914860] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-14T20:58:47.915680] [DEBUG] [MAIN ] RAMP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:47.916607] [INFO ] [MAIN ] RAMP: Generated 1352 derivative records from 27463 primary records. [2025-09-14T20:58:47.917907] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-14T20:58:47.942798] [DEBUG] [LOCAL ] RBC: Derivative data saved (1352 records). [2025-09-14T20:58:47.945988] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1352 records). [2025-09-14T20:58:47.946574] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-14T20:58:47.948628] [INFO ] [MAIN ] Derivative Progress: 1657/2226 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 20s. Rate: 170.6 symbols/min [2025-09-14T20:58:47.946105] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-14T20:58:47.952857] [INFO ] [MAIN ] Derivative Progress: 1658/2226 symbols completed. RBC took 1.0s. Estimated remaining: 3m 20s. Rate: 170.7 symbols/min [2025-09-14T20:58:47.950006] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:47.955105] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:47.970754] [DEBUG] [MAIN ] RBA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:47.975141] [DEBUG] [LOCAL ] RBOT: Loaded 3824 existing records from primary storage. [2025-09-14T20:58:47.971911] [INFO ] [MAIN ] RBA: Generated 1352 derivative records from 34408 primary records. [2025-09-14T20:58:47.975370] [INFO ] [MAIN ] RBOT: Loaded 3824 primary data records. [2025-09-14T20:58:47.975429] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-14T20:58:48.082374] [DEBUG] [LOCAL ] RBA: Derivative data saved (1352 records). [2025-09-14T20:58:48.099544] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-14T20:58:48.101421] [INFO ] [MAIN ] Derivative Progress: 1659/2226 symbols completed. RBA took 1.2s. Estimated remaining: 3m 19s. Rate: 170.8 symbols/min [2025-09-14T20:58:48.102167] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:48.297338] [DEBUG] [LOCAL ] RBLX: Loaded 40472 existing records from primary storage. [2025-09-14T20:58:48.297811] [INFO ] [MAIN ] RBLX: Loaded 40472 primary data records. [2025-09-14T20:58:48.437711] [DEBUG] [LOCAL ] RBRK: Loaded 39987 existing records from primary storage. [2025-09-14T20:58:48.479625] [INFO ] [MAIN ] RBRK: Loaded 39987 primary data records. [2025-09-14T20:58:48.778357] [DEBUG] [MAIN ] RBOT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:48.779984] [INFO ] [MAIN ] RBOT: Generated 1352 derivative records from 3824 primary records. [2025-09-14T20:58:48.785867] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-14T20:58:49.054669] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1352 records). [2025-09-14T20:58:49.055350] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-14T20:58:49.069551] [INFO ] [MAIN ] Derivative Progress: 1660/2226 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 19s. Rate: 170.6 symbols/min [2025-09-14T20:58:49.067328] [DEBUG] [MAIN ] RBLX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:49.072053] [INFO ] [MAIN ] RBLX: Generated 1352 derivative records from 40472 primary records. [2025-09-14T20:58:49.072431] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:49.072609] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-14T20:58:49.088833] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1352 records). [2025-09-14T20:58:49.089520] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-14T20:58:49.091995] [INFO ] [MAIN ] Derivative Progress: 1661/2226 symbols completed. RBLX took 1.1s. Estimated remaining: 3m 19s. Rate: 170.7 symbols/min [2025-09-14T20:58:49.092909] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:49.101130] [DEBUG] [LOCAL ] RCD: Loaded 2632 existing records from primary storage. [2025-09-14T20:58:49.101437] [INFO ] [MAIN ] RCD: Loaded 2632 primary data records. [2025-09-14T20:58:49.118185] [DEBUG] [MAIN ] RBRK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:49.155357] [INFO ] [MAIN ] RBRK: Generated 1352 derivative records from 39987 primary records. [2025-09-14T20:58:49.212362] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-14T20:58:49.291672] [DEBUG] [LOCAL ] RC: Loaded 36469 existing records from primary storage. [2025-09-14T20:58:49.323387] [INFO ] [MAIN ] RC: Loaded 36469 primary data records. [2025-09-14T20:58:49.460582] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1352 records). [2025-09-14T20:58:49.514220] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-14T20:58:49.547656] [INFO ] [MAIN ] Derivative Progress: 1662/2226 symbols completed. RBRK took 1.4s. Estimated remaining: 3m 18s. Rate: 170.7 symbols/min [2025-09-14T20:58:49.572047] [INFO ] [MAIN ] RCL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:49.765627] [DEBUG] [MAIN ] RCD: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:58:49.776360] [INFO ] [MAIN ] RCD: Generated 1351 derivative records from 2632 primary records. [2025-09-14T20:58:49.776562] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-09-14T20:58:49.789851] [DEBUG] [LOCAL ] RCD: Derivative data saved (1351 records). [2025-09-14T20:58:49.790964] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-09-14T20:58:49.805383] [INFO ] [MAIN ] Derivative Progress: 1663/2226 symbols completed. RCD took 0.7s. Estimated remaining: 3m 18s. Rate: 170.7 symbols/min [2025-09-14T20:58:49.807488] [DEBUG] [LOCAL ] RCL: Loaded 39084 existing records from primary storage. [2025-09-14T20:58:49.809029] [INFO ] [MAIN ] RCL: Loaded 39084 primary data records. [2025-09-14T20:58:49.916429] [DEBUG] [MAIN ] RC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:49.929118] [INFO ] [MAIN ] RC: Generated 1352 derivative records from 36469 primary records. [2025-09-14T20:58:49.929480] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-14T20:58:50.018325] [DEBUG] [LOCAL ] RC: Derivative data saved (1352 records). [2025-09-14T20:58:50.067939] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-14T20:58:50.114995] [INFO ] [MAIN ] Derivative Progress: 1664/2226 symbols completed. RC took 1.0s. Estimated remaining: 3m 18s. Rate: 170.7 symbols/min [2025-09-14T20:58:50.135386] [DEBUG] [MAIN ] RCL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:50.136188] [INFO ] [MAIN ] RCL: Generated 1352 derivative records from 39084 primary records. [2025-09-14T20:58:50.136270] [DEBUG] [LOCAL ] RCL: Saving derivative data. [2025-09-14T20:58:50.148439] [DEBUG] [LOCAL ] RCL: Derivative data saved (1352 records). [2025-09-14T20:58:50.148559] [INFO ] [MAIN ] RCL: Successfully saved derivative data. [2025-09-14T20:58:50.150452] [INFO ] [MAIN ] Derivative Progress: 1665/2226 symbols completed. RCL took 0.6s. Estimated remaining: 3m 17s. Rate: 170.8 symbols/min [2025-09-14T20:58:50.150993] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:50.151134] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:50.151168] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:50.162590] [DEBUG] [LOCAL ] RCS: Loaded 8525 existing records from primary storage. [2025-09-14T20:58:50.162951] [INFO ] [MAIN ] RCS: Loaded 8525 primary data records. [2025-09-14T20:58:50.378246] [DEBUG] [LOCAL ] RCUS: Loaded 32146 existing records from primary storage. [2025-09-14T20:58:50.378950] [INFO ] [MAIN ] RCUS: Loaded 32146 primary data records. [2025-09-14T20:58:50.533271] [DEBUG] [LOCAL ] RDDT: Loaded 40527 existing records from primary storage. [2025-09-14T20:58:50.577035] [INFO ] [MAIN ] RDDT: Loaded 40527 primary data records. [2025-09-14T20:58:51.080678] [DEBUG] [MAIN ] RCS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:51.082850] [INFO ] [MAIN ] RCS: Generated 1352 derivative records from 8525 primary records. [2025-09-14T20:58:51.083122] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-14T20:58:51.096629] [DEBUG] [LOCAL ] RCS: Derivative data saved (1352 records). [2025-09-14T20:58:51.096916] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-14T20:58:51.099456] [INFO ] [MAIN ] Derivative Progress: 1666/2226 symbols completed. RCS took 0.9s. Estimated remaining: 3m 17s. Rate: 170.6 symbols/min [2025-09-14T20:58:51.101063] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:51.115351] [DEBUG] [MAIN ] RCUS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:51.121751] [INFO ] [MAIN ] RCUS: Generated 1352 derivative records from 32146 primary records. [2025-09-14T20:58:51.122337] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-14T20:58:51.151773] [DEBUG] [MAIN ] RDDT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:51.161547] [INFO ] [MAIN ] RDDT: Generated 1352 derivative records from 40527 primary records. [2025-09-14T20:58:51.162354] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-14T20:58:51.163797] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1352 records). [2025-09-14T20:58:51.163895] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-14T20:58:51.166472] [INFO ] [MAIN ] Derivative Progress: 1667/2226 symbols completed. RCUS took 1.0s. Estimated remaining: 3m 16s. Rate: 170.7 symbols/min [2025-09-14T20:58:51.185349] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:51.188597] [DEBUG] [LOCAL ] RDN: Loaded 33040 existing records from primary storage. [2025-09-14T20:58:51.189272] [INFO ] [MAIN ] RDN: Loaded 33040 primary data records. [2025-09-14T20:58:51.258378] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1352 records). [2025-09-14T20:58:51.299107] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-14T20:58:51.302731] [INFO ] [MAIN ] Derivative Progress: 1668/2226 symbols completed. RDDT took 1.2s. Estimated remaining: 3m 16s. Rate: 170.8 symbols/min [2025-09-14T20:58:51.314863] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:51.543828] [DEBUG] [LOCAL ] RDW: Loaded 39148 existing records from primary storage. [2025-09-14T20:58:51.544162] [INFO ] [MAIN ] RDW: Loaded 39148 primary data records. [2025-09-14T20:58:51.862809] [DEBUG] [LOCAL ] RDY: Loaded 35140 existing records from primary storage. [2025-09-14T20:58:51.863839] [INFO ] [MAIN ] RDY: Loaded 35140 primary data records. [2025-09-14T20:58:52.077890] [DEBUG] [MAIN ] RDN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:52.170062] [INFO ] [MAIN ] RDN: Generated 1352 derivative records from 33040 primary records. [2025-09-14T20:58:52.182473] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-14T20:58:52.202075] [DEBUG] [LOCAL ] RDN: Derivative data saved (1352 records). [2025-09-14T20:58:52.203078] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-14T20:58:52.214060] [DEBUG] [MAIN ] RDW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:52.218679] [INFO ] [MAIN ] Derivative Progress: 1669/2226 symbols completed. RDN took 1.1s. Estimated remaining: 3m 16s. Rate: 170.6 symbols/min [2025-09-14T20:58:52.215001] [INFO ] [MAIN ] RDW: Generated 1352 derivative records from 39148 primary records. [2025-09-14T20:58:52.219375] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-14T20:58:52.219725] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:52.237703] [DEBUG] [LOCAL ] RDW: Derivative data saved (1352 records). [2025-09-14T20:58:52.238074] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-14T20:58:52.242715] [INFO ] [MAIN ] Derivative Progress: 1670/2226 symbols completed. RDW took 1.1s. Estimated remaining: 3m 15s. Rate: 170.7 symbols/min [2025-09-14T20:58:52.244056] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:52.254937] [DEBUG] [MAIN ] RDY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:52.255876] [INFO ] [MAIN ] RDY: Generated 1352 derivative records from 35140 primary records. [2025-09-14T20:58:52.256143] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-14T20:58:52.271008] [DEBUG] [LOCAL ] RDY: Derivative data saved (1352 records). [2025-09-14T20:58:52.271192] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-14T20:58:52.273196] [INFO ] [MAIN ] Derivative Progress: 1671/2226 symbols completed. RDY took 1.0s. Estimated remaining: 3m 15s. Rate: 170.8 symbols/min [2025-09-14T20:58:52.273794] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:52.304325] [DEBUG] [LOCAL ] RERE: Loaded 31030 existing records from primary storage. [2025-09-14T20:58:52.304589] [INFO ] [MAIN ] RERE: Loaded 31030 primary data records. [2025-09-14T20:58:52.436297] [DEBUG] [LOCAL ] RELX: Loaded 36245 existing records from primary storage. [2025-09-14T20:58:52.495842] [INFO ] [MAIN ] RELX: Loaded 36245 primary data records. [2025-09-14T20:58:52.666773] [DEBUG] [LOCAL ] RES: Loaded 35403 existing records from primary storage. [2025-09-14T20:58:52.703545] [INFO ] [MAIN ] RES: Loaded 35403 primary data records. [2025-09-14T20:58:53.224137] [DEBUG] [MAIN ] RERE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:53.225237] [INFO ] [MAIN ] RERE: Generated 1352 derivative records from 31030 primary records. [2025-09-14T20:58:53.226382] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-14T20:58:53.241809] [DEBUG] [LOCAL ] RERE: Derivative data saved (1352 records). [2025-09-14T20:58:53.242207] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-14T20:58:53.244261] [INFO ] [MAIN ] Derivative Progress: 1672/2226 symbols completed. RERE took 1.0s. Estimated remaining: 3m 15s. Rate: 170.6 symbols/min [2025-09-14T20:58:53.248152] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:53.269767] [DEBUG] [MAIN ] RELX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:53.270236] [DEBUG] [MAIN ] RES: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:53.271061] [INFO ] [MAIN ] RES: Generated 1352 derivative records from 35403 primary records. [2025-09-14T20:58:53.271618] [INFO ] [MAIN ] RELX: Generated 1352 derivative records from 36245 primary records. [2025-09-14T20:58:53.271871] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-14T20:58:53.271909] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-14T20:58:53.298323] [DEBUG] [LOCAL ] RELX: Derivative data saved (1352 records). [2025-09-14T20:58:53.297965] [DEBUG] [LOCAL ] RES: Derivative data saved (1352 records). [2025-09-14T20:58:53.298486] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-14T20:58:53.298530] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-14T20:58:53.300486] [INFO ] [MAIN ] Derivative Progress: 1673/2226 symbols completed. RES took 1.0s. Estimated remaining: 3m 14s. Rate: 170.7 symbols/min [2025-09-14T20:58:53.303160] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:53.303205] [INFO ] [MAIN ] Derivative Progress: 1674/2226 symbols completed. RELX took 1.1s. Estimated remaining: 3m 14s. Rate: 170.8 symbols/min [2025-09-14T20:58:53.311983] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:53.329350] [DEBUG] [LOCAL ] REVG: Loaded 30564 existing records from primary storage. [2025-09-14T20:58:53.329544] [INFO ] [MAIN ] REVG: Loaded 30564 primary data records. [2025-09-14T20:58:53.421686] [DEBUG] [LOCAL ] REX: Loaded 9452 existing records from primary storage. [2025-09-14T20:58:53.458537] [INFO ] [MAIN ] REX: Loaded 9452 primary data records. [2025-09-14T20:58:53.716316] [DEBUG] [LOCAL ] REXR: Loaded 39194 existing records from primary storage. [2025-09-14T20:58:53.748251] [INFO ] [MAIN ] REXR: Loaded 39194 primary data records. [2025-09-14T20:58:54.321918] [DEBUG] [MAIN ] REVG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:54.323146] [INFO ] [MAIN ] REVG: Generated 1352 derivative records from 30564 primary records. [2025-09-14T20:58:54.323701] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-14T20:58:54.341108] [DEBUG] [LOCAL ] REVG: Derivative data saved (1352 records). [2025-09-14T20:58:54.351538] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-14T20:58:54.351942] [DEBUG] [MAIN ] REX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:54.354204] [INFO ] [MAIN ] Derivative Progress: 1675/2226 symbols completed. REVG took 1.1s. Estimated remaining: 3m 14s. Rate: 170.6 symbols/min [2025-09-14T20:58:54.355185] [INFO ] [MAIN ] REX: Generated 1352 derivative records from 9452 primary records. [2025-09-14T20:58:54.355530] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:54.356414] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-14T20:58:54.381634] [DEBUG] [LOCAL ] REX: Derivative data saved (1352 records). [2025-09-14T20:58:54.379457] [DEBUG] [MAIN ] REXR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:54.382450] [INFO ] [MAIN ] REXR: Generated 1352 derivative records from 39194 primary records. [2025-09-14T20:58:54.382743] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-14T20:58:54.382804] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-14T20:58:54.385214] [INFO ] [MAIN ] Derivative Progress: 1676/2226 symbols completed. REX took 1.1s. Estimated remaining: 3m 13s. Rate: 170.7 symbols/min [2025-09-14T20:58:54.393289] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:54.398747] [DEBUG] [LOCAL ] REXR: Derivative data saved (1352 records). [2025-09-14T20:58:54.399044] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-14T20:58:54.401186] [INFO ] [MAIN ] Derivative Progress: 1677/2226 symbols completed. REXR took 1.1s. Estimated remaining: 3m 13s. Rate: 170.8 symbols/min [2025-09-14T20:58:54.402101] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:54.424965] [DEBUG] [LOCAL ] RFI: Loaded 7764 existing records from primary storage. [2025-09-14T20:58:54.425258] [INFO ] [MAIN ] RFI: Loaded 7764 primary data records. [2025-09-14T20:58:54.462517] [DEBUG] [LOCAL ] REZI: Loaded 35073 existing records from primary storage. [2025-09-14T20:58:54.485492] [INFO ] [MAIN ] REZI: Loaded 35073 primary data records. [2025-09-14T20:58:54.888130] [DEBUG] [LOCAL ] RF: Loaded 40373 existing records from primary storage. [2025-09-14T20:58:54.924141] [INFO ] [MAIN ] RF: Loaded 40373 primary data records. [2025-09-14T20:58:55.349113] [DEBUG] [MAIN ] RFI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:55.352228] [INFO ] [MAIN ] RFI: Generated 1352 derivative records from 7764 primary records. [2025-09-14T20:58:55.353275] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-14T20:58:55.374405] [DEBUG] [MAIN ] REZI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:55.379907] [INFO ] [MAIN ] REZI: Generated 1352 derivative records from 35073 primary records. [2025-09-14T20:58:55.380177] [DEBUG] [LOCAL ] RFI: Derivative data saved (1352 records). [2025-09-14T20:58:55.380349] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-14T20:58:55.381388] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-14T20:58:55.383822] [INFO ] [MAIN ] Derivative Progress: 1678/2226 symbols completed. RFI took 1.0s. Estimated remaining: 3m 13s. Rate: 170.6 symbols/min [2025-09-14T20:58:55.396523] [DEBUG] [LOCAL ] REZI: Derivative data saved (1352 records). [2025-09-14T20:58:55.396662] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-14T20:58:55.398888] [INFO ] [MAIN ] Derivative Progress: 1679/2226 symbols completed. REZI took 1.0s. Estimated remaining: 3m 12s. Rate: 170.7 symbols/min [2025-09-14T20:58:55.413963] [DEBUG] [MAIN ] RF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:55.414742] [INFO ] [MAIN ] RF: Generated 1352 derivative records from 40373 primary records. [2025-09-14T20:58:55.414832] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-14T20:58:55.428528] [DEBUG] [LOCAL ] RF: Derivative data saved (1352 records). [2025-09-14T20:58:55.428634] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-14T20:58:55.430681] [INFO ] [MAIN ] Derivative Progress: 1680/2226 symbols completed. RF took 1.0s. Estimated remaining: 3m 12s. Rate: 170.8 symbols/min [2025-09-14T20:58:55.431443] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:55.431691] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:55.431603] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:55.442138] [DEBUG] [LOCAL ] RFM: Loaded 2930 existing records from primary storage. [2025-09-14T20:58:55.442384] [INFO ] [MAIN ] RFM: Loaded 2930 primary data records. [2025-09-14T20:58:55.491995] [DEBUG] [LOCAL ] RFMZ: Loaded 6214 existing records from primary storage. [2025-09-14T20:58:55.519088] [INFO ] [MAIN ] RFMZ: Loaded 6214 primary data records. [2025-09-14T20:58:55.518937] [DEBUG] [LOCAL ] RFL: Loaded 8876 existing records from primary storage. [2025-09-14T20:58:55.593087] [INFO ] [MAIN ] RFL: Loaded 8876 primary data records. [2025-09-14T20:58:56.375112] [DEBUG] [MAIN ] RFM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:56.376147] [INFO ] [MAIN ] RFM: Generated 1352 derivative records from 2930 primary records. [2025-09-14T20:58:56.376347] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-14T20:58:56.388825] [DEBUG] [MAIN ] RFMZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:56.399041] [INFO ] [MAIN ] RFMZ: Generated 1352 derivative records from 6214 primary records. [2025-09-14T20:58:56.402214] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-14T20:58:56.402153] [DEBUG] [LOCAL ] RFM: Derivative data saved (1352 records). [2025-09-14T20:58:56.403095] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-14T20:58:56.411263] [INFO ] [MAIN ] Derivative Progress: 1681/2226 symbols completed. RFM took 1.0s. Estimated remaining: 3m 12s. Rate: 170.6 symbols/min [2025-09-14T20:58:56.424671] [DEBUG] [MAIN ] RFL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:56.425848] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:56.426772] [INFO ] [MAIN ] RFL: Generated 1352 derivative records from 8876 primary records. [2025-09-14T20:58:56.428727] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-14T20:58:56.430233] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1352 records). [2025-09-14T20:58:56.430748] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-14T20:58:56.433348] [INFO ] [MAIN ] Derivative Progress: 1682/2226 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 11s. Rate: 170.7 symbols/min [2025-09-14T20:58:56.441917] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:56.446343] [DEBUG] [LOCAL ] RFL: Derivative data saved (1352 records). [2025-09-14T20:58:56.446752] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-14T20:58:56.448535] [INFO ] [MAIN ] Derivative Progress: 1683/2226 symbols completed. RFL took 1.0s. Estimated remaining: 3m 11s. Rate: 170.8 symbols/min [2025-09-14T20:58:56.454015] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:56.466552] [DEBUG] [LOCAL ] RGT: Loaded 2040 existing records from primary storage. [2025-09-14T20:58:56.466829] [INFO ] [MAIN ] RGT: Loaded 2040 primary data records. [2025-09-14T20:58:56.575530] [DEBUG] [LOCAL ] RGA: Loaded 21448 existing records from primary storage. [2025-09-14T20:58:56.586698] [INFO ] [MAIN ] RGA: Loaded 21448 primary data records. [2025-09-14T20:58:56.583069] [DEBUG] [LOCAL ] RGR: Loaded 15444 existing records from primary storage. [2025-09-14T20:58:56.586888] [INFO ] [MAIN ] RGR: Loaded 15444 primary data records. [2025-09-14T20:58:57.338953] [DEBUG] [MAIN ] RGT: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:58:57.340376] [INFO ] [MAIN ] RGT: Generated 1351 derivative records from 2040 primary records. [2025-09-14T20:58:57.340569] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-14T20:58:57.352348] [DEBUG] [LOCAL ] RGT: Derivative data saved (1351 records). [2025-09-14T20:58:57.352915] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-14T20:58:57.354660] [INFO ] [MAIN ] Derivative Progress: 1684/2226 symbols completed. RGT took 0.9s. Estimated remaining: 3m 11s. Rate: 170.6 symbols/min [2025-09-14T20:58:57.355038] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:57.376615] [DEBUG] [MAIN ] RGA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:57.381098] [DEBUG] [MAIN ] RGR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:57.381934] [INFO ] [MAIN ] RGA: Generated 1352 derivative records from 21448 primary records. [2025-09-14T20:58:57.382748] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-14T20:58:57.382683] [INFO ] [MAIN ] RGR: Generated 1352 derivative records from 15444 primary records. [2025-09-14T20:58:57.383598] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-14T20:58:57.412012] [DEBUG] [LOCAL ] RGA: Derivative data saved (1352 records). [2025-09-14T20:58:57.412968] [DEBUG] [LOCAL ] RGR: Derivative data saved (1352 records). [2025-09-14T20:58:57.421836] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-14T20:58:57.421978] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-14T20:58:57.425296] [INFO ] [MAIN ] Derivative Progress: 1685/2226 symbols completed. RGR took 1.0s. Estimated remaining: 3m 10s. Rate: 170.7 symbols/min [2025-09-14T20:58:57.428416] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:57.428506] [INFO ] [MAIN ] Derivative Progress: 1686/2226 symbols completed. RGA took 1.0s. Estimated remaining: 3m 10s. Rate: 170.8 symbols/min [2025-09-14T20:58:57.428975] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:57.445817] [DEBUG] [LOCAL ] RH: Loaded 35612 existing records from primary storage. [2025-09-14T20:58:57.446238] [INFO ] [MAIN ] RH: Loaded 35612 primary data records. [2025-09-14T20:58:57.645772] [DEBUG] [LOCAL ] RHP: Loaded 30244 existing records from primary storage. [2025-09-14T20:58:57.656307] [INFO ] [MAIN ] RHP: Loaded 30244 primary data records. [2025-09-14T20:58:57.696428] [DEBUG] [LOCAL ] RHI: Loaded 37368 existing records from primary storage. [2025-09-14T20:58:57.749522] [INFO ] [MAIN ] RHI: Loaded 37368 primary data records. [2025-09-14T20:58:58.432264] [DEBUG] [MAIN ] RH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:58.436305] [INFO ] [MAIN ] RH: Generated 1352 derivative records from 35612 primary records. [2025-09-14T20:58:58.436990] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-14T20:58:58.455353] [DEBUG] [LOCAL ] RH: Derivative data saved (1352 records). [2025-09-14T20:58:58.459170] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-14T20:58:58.463325] [INFO ] [MAIN ] Derivative Progress: 1687/2226 symbols completed. RH took 1.1s. Estimated remaining: 3m 10s. Rate: 170.6 symbols/min [2025-09-14T20:58:58.481446] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:58.486486] [DEBUG] [MAIN ] RHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:58.486934] [DEBUG] [MAIN ] RHP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:58.488949] [INFO ] [MAIN ] RHI: Generated 1352 derivative records from 37368 primary records. [2025-09-14T20:58:58.489507] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-14T20:58:58.490093] [INFO ] [MAIN ] RHP: Generated 1352 derivative records from 30244 primary records. [2025-09-14T20:58:58.490286] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-14T20:58:58.521459] [DEBUG] [LOCAL ] RHI: Derivative data saved (1352 records). [2025-09-14T20:58:58.521252] [DEBUG] [LOCAL ] RHP: Derivative data saved (1352 records). [2025-09-14T20:58:58.521955] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-14T20:58:58.522258] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-14T20:58:58.524822] [INFO ] [MAIN ] Derivative Progress: 1688/2226 symbols completed. RHP took 1.1s. Estimated remaining: 3m 9s. Rate: 170.7 symbols/min [2025-09-14T20:58:58.527296] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:58.527358] [INFO ] [MAIN ] Derivative Progress: 1689/2226 symbols completed. RHI took 1.1s. Estimated remaining: 3m 9s. Rate: 170.8 symbols/min [2025-09-14T20:58:58.528525] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:58.580200] [DEBUG] [LOCAL ] RIG: Loaded 40421 existing records from primary storage. [2025-09-14T20:58:58.580472] [INFO ] [MAIN ] RIG: Loaded 40421 primary data records. [2025-09-14T20:58:58.729556] [DEBUG] [LOCAL ] RIO: Loaded 40165 existing records from primary storage. [2025-09-14T20:58:58.738118] [DEBUG] [LOCAL ] RITM: Loaded 39747 existing records from primary storage. [2025-09-14T20:58:58.731568] [INFO ] [MAIN ] RIO: Loaded 40165 primary data records. [2025-09-14T20:58:58.754034] [INFO ] [MAIN ] RITM: Loaded 39747 primary data records. [2025-09-14T20:58:59.562459] [DEBUG] [MAIN ] RIO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:59.568117] [DEBUG] [MAIN ] RIG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:59.571680] [INFO ] [MAIN ] RIO: Generated 1352 derivative records from 40165 primary records. [2025-09-14T20:58:59.572436] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-14T20:58:59.583620] [INFO ] [MAIN ] RIG: Generated 1352 derivative records from 40421 primary records. [2025-09-14T20:58:59.584800] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-14T20:58:59.585138] [DEBUG] [MAIN ] RITM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:58:59.588433] [INFO ] [MAIN ] RITM: Generated 1352 derivative records from 39747 primary records. [2025-09-14T20:58:59.597543] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-14T20:58:59.611744] [DEBUG] [LOCAL ] RIG: Derivative data saved (1352 records). [2025-09-14T20:58:59.623562] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-14T20:58:59.629740] [INFO ] [MAIN ] Derivative Progress: 1690/2226 symbols completed. RIG took 1.2s. Estimated remaining: 3m 9s. Rate: 170.6 symbols/min [2025-09-14T20:58:59.632561] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:59.637333] [DEBUG] [LOCAL ] RIO: Derivative data saved (1352 records). [2025-09-14T20:58:59.637456] [DEBUG] [LOCAL ] RITM: Derivative data saved (1352 records). [2025-09-14T20:58:59.638285] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-14T20:58:59.641227] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-14T20:58:59.641120] [INFO ] [MAIN ] Derivative Progress: 1691/2226 symbols completed. RIO took 1.1s. Estimated remaining: 3m 8s. Rate: 170.7 symbols/min [2025-09-14T20:58:59.644265] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:59.644109] [INFO ] [MAIN ] Derivative Progress: 1692/2226 symbols completed. RITM took 1.1s. Estimated remaining: 3m 8s. Rate: 170.8 symbols/min [2025-09-14T20:58:59.644760] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:58:59.654359] [DEBUG] [LOCAL ] RIV: Loaded 8659 existing records from primary storage. [2025-09-14T20:58:59.654638] [INFO ] [MAIN ] RIV: Loaded 8659 primary data records. [2025-09-14T20:58:59.965125] [DEBUG] [LOCAL ] RJF: Loaded 34710 existing records from primary storage. [2025-09-14T20:58:59.965788] [INFO ] [MAIN ] RJF: Loaded 34710 primary data records. [2025-09-14T20:59:00.051764] [DEBUG] [LOCAL ] RKT: Loaded 40469 existing records from primary storage. [2025-09-14T20:59:00.074512] [INFO ] [MAIN ] RKT: Loaded 40469 primary data records. [2025-09-14T20:59:00.587819] [DEBUG] [MAIN ] RIV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:00.591286] [INFO ] [MAIN ] RIV: Generated 1352 derivative records from 8659 primary records. [2025-09-14T20:59:00.591980] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-14T20:59:00.606864] [DEBUG] [LOCAL ] RIV: Derivative data saved (1352 records). [2025-09-14T20:59:00.607250] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-14T20:59:00.610447] [INFO ] [MAIN ] Derivative Progress: 1693/2226 symbols completed. RIV took 1.0s. Estimated remaining: 3m 7s. Rate: 170.6 symbols/min [2025-09-14T20:59:00.628700] [DEBUG] [MAIN ] RJF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:00.631315] [INFO ] [MAIN ] RJF: Generated 1352 derivative records from 34710 primary records. [2025-09-14T20:59:00.631989] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-14T20:59:00.655557] [DEBUG] [LOCAL ] RJF: Derivative data saved (1352 records). [2025-09-14T20:59:00.656102] [DEBUG] [MAIN ] RKT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:00.656428] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-14T20:59:00.657213] [INFO ] [MAIN ] RKT: Generated 1352 derivative records from 40469 primary records. [2025-09-14T20:59:00.659499] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-14T20:59:00.659275] [INFO ] [MAIN ] Derivative Progress: 1694/2226 symbols completed. RJF took 1.0s. Estimated remaining: 3m 7s. Rate: 170.7 symbols/min [2025-09-14T20:59:00.672078] [DEBUG] [LOCAL ] RKT: Derivative data saved (1352 records). [2025-09-14T20:59:00.672180] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-14T20:59:00.675434] [INFO ] [MAIN ] Derivative Progress: 1695/2226 symbols completed. RKT took 1.0s. Estimated remaining: 3m 7s. Rate: 170.8 symbols/min [2025-09-14T20:59:00.676152] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:00.676307] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:00.676417] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:00.716703] [DEBUG] [LOCAL ] RLI: Loaded 25165 existing records from primary storage. [2025-09-14T20:59:00.725196] [INFO ] [MAIN ] RLI: Loaded 25165 primary data records. [2025-09-14T20:59:00.833481] [DEBUG] [LOCAL ] RL: Loaded 30364 existing records from primary storage. [2025-09-14T20:59:00.856504] [INFO ] [MAIN ] RL: Loaded 30364 primary data records. [2025-09-14T20:59:00.857541] [DEBUG] [LOCAL ] RLJ: Loaded 35839 existing records from primary storage. [2025-09-14T20:59:00.868798] [INFO ] [MAIN ] RLJ: Loaded 35839 primary data records. [2025-09-14T20:59:01.708432] [DEBUG] [MAIN ] RLI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:01.709892] [INFO ] [MAIN ] RLI: Generated 1352 derivative records from 25165 primary records. [2025-09-14T20:59:01.712775] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-14T20:59:01.734500] [DEBUG] [MAIN ] RLJ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:01.745847] [INFO ] [MAIN ] RLJ: Generated 1352 derivative records from 35839 primary records. [2025-09-14T20:59:01.759381] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-14T20:59:01.760736] [DEBUG] [MAIN ] RL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:01.760394] [DEBUG] [LOCAL ] RLI: Derivative data saved (1352 records). [2025-09-14T20:59:01.762186] [INFO ] [MAIN ] RL: Generated 1352 derivative records from 30364 primary records. [2025-09-14T20:59:01.762696] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-14T20:59:01.762837] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-14T20:59:01.764825] [INFO ] [MAIN ] Derivative Progress: 1696/2226 symbols completed. RLI took 1.1s. Estimated remaining: 3m 6s. Rate: 170.6 symbols/min [2025-09-14T20:59:01.778986] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:01.796307] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1352 records). [2025-09-14T20:59:01.795287] [DEBUG] [LOCAL ] RL: Derivative data saved (1352 records). [2025-09-14T20:59:01.796585] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-14T20:59:01.796637] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-14T20:59:01.799374] [INFO ] [MAIN ] Derivative Progress: 1697/2226 symbols completed. RLJ took 1.1s. Estimated remaining: 3m 6s. Rate: 170.7 symbols/min [2025-09-14T20:59:01.804378] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:01.804236] [INFO ] [MAIN ] Derivative Progress: 1698/2226 symbols completed. RL took 1.1s. Estimated remaining: 3m 5s. Rate: 170.8 symbols/min [2025-09-14T20:59:01.804871] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:01.811890] [DEBUG] [LOCAL ] RLTY: Loaded 8084 existing records from primary storage. [2025-09-14T20:59:01.812214] [INFO ] [MAIN ] RLTY: Loaded 8084 primary data records. [2025-09-14T20:59:02.009714] [DEBUG] [LOCAL ] RMAX: Loaded 16702 existing records from primary storage. [2025-09-14T20:59:02.040116] [INFO ] [MAIN ] RMAX: Loaded 16702 primary data records. [2025-09-14T20:59:02.179427] [DEBUG] [LOCAL ] RLX: Loaded 35814 existing records from primary storage. [2025-09-14T20:59:02.216267] [INFO ] [MAIN ] RLX: Loaded 35814 primary data records. [2025-09-14T20:59:02.771269] [DEBUG] [MAIN ] RLTY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:02.772247] [INFO ] [MAIN ] RLTY: Generated 1352 derivative records from 8084 primary records. [2025-09-14T20:59:02.772920] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-14T20:59:02.791788] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1352 records). [2025-09-14T20:59:02.792459] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-14T20:59:02.794720] [INFO ] [MAIN ] Derivative Progress: 1699/2226 symbols completed. RLTY took 1.0s. Estimated remaining: 3m 5s. Rate: 170.6 symbols/min [2025-09-14T20:59:02.795030] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:02.811955] [DEBUG] [MAIN ] RMAX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:02.813670] [INFO ] [MAIN ] RMAX: Generated 1352 derivative records from 16702 primary records. [2025-09-14T20:59:02.815206] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-14T20:59:02.833151] [DEBUG] [MAIN ] RLX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:02.836162] [INFO ] [MAIN ] RLX: Generated 1352 derivative records from 35814 primary records. [2025-09-14T20:59:02.847210] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1352 records). [2025-09-14T20:59:02.844387] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-14T20:59:02.847379] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-14T20:59:02.850587] [INFO ] [MAIN ] Derivative Progress: 1700/2226 symbols completed. RMAX took 1.0s. Estimated remaining: 3m 5s. Rate: 170.7 symbols/min [2025-09-14T20:59:02.851255] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:02.863395] [DEBUG] [LOCAL ] RLX: Derivative data saved (1352 records). [2025-09-14T20:59:02.864401] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-14T20:59:02.866500] [INFO ] [MAIN ] Derivative Progress: 1701/2226 symbols completed. RLX took 1.1s. Estimated remaining: 3m 4s. Rate: 170.8 symbols/min [2025-09-14T20:59:02.867075] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:02.880263] [DEBUG] [LOCAL ] RMD: Loaded 31549 existing records from primary storage. [2025-09-14T20:59:02.880731] [INFO ] [MAIN ] RMD: Loaded 31549 primary data records. [2025-09-14T20:59:02.884198] [DEBUG] [LOCAL ] RMI: Loaded 3564 existing records from primary storage. [2025-09-14T20:59:02.905366] [INFO ] [MAIN ] RMI: Loaded 3564 primary data records. [2025-09-14T20:59:03.053205] [DEBUG] [LOCAL ] RMM: Loaded 7621 existing records from primary storage. [2025-09-14T20:59:03.113509] [INFO ] [MAIN ] RMM: Loaded 7621 primary data records. [2025-09-14T20:59:03.837627] [DEBUG] [MAIN ] RMD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:03.838717] [INFO ] [MAIN ] RMD: Generated 1352 derivative records from 31549 primary records. [2025-09-14T20:59:03.839200] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-14T20:59:03.857634] [DEBUG] [LOCAL ] RMD: Derivative data saved (1352 records). [2025-09-14T20:59:03.858140] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-14T20:59:03.878021] [DEBUG] [MAIN ] RMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:03.880193] [INFO ] [MAIN ] Derivative Progress: 1702/2226 symbols completed. RMD took 1.1s. Estimated remaining: 3m 4s. Rate: 170.6 symbols/min [2025-09-14T20:59:03.880671] [DEBUG] [MAIN ] RMM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:03.881629] [INFO ] [MAIN ] RMI: Generated 1352 derivative records from 3564 primary records. [2025-09-14T20:59:03.881807] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-14T20:59:03.883129] [INFO ] [MAIN ] RMM: Generated 1352 derivative records from 7621 primary records. [2025-09-14T20:59:03.883036] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:03.883593] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-14T20:59:03.895546] [DEBUG] [LOCAL ] RMI: Derivative data saved (1352 records). [2025-09-14T20:59:03.901594] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-14T20:59:03.909317] [INFO ] [MAIN ] Derivative Progress: 1703/2226 symbols completed. RMI took 1.1s. Estimated remaining: 3m 4s. Rate: 170.7 symbols/min [2025-09-14T20:59:03.911584] [DEBUG] [LOCAL ] RMM: Derivative data saved (1352 records). [2025-09-14T20:59:03.911914] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:03.912082] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-14T20:59:03.914135] [INFO ] [MAIN ] Derivative Progress: 1704/2226 symbols completed. RMM took 1.0s. Estimated remaining: 3m 3s. Rate: 170.8 symbols/min [2025-09-14T20:59:03.917242] [DEBUG] [LOCAL ] RMMZ: Loaded 3746 existing records from primary storage. [2025-09-14T20:59:03.917538] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:03.917708] [INFO ] [MAIN ] RMMZ: Loaded 3746 primary data records. [2025-09-14T20:59:04.036806] [DEBUG] [LOCAL ] RMT: Loaded 12915 existing records from primary storage. [2025-09-14T20:59:04.061170] [INFO ] [MAIN ] RMT: Loaded 12915 primary data records. [2025-09-14T20:59:04.346917] [DEBUG] [LOCAL ] RNG: Loaded 35802 existing records from primary storage. [2025-09-14T20:59:04.359289] [INFO ] [MAIN ] RNG: Loaded 35802 primary data records. [2025-09-14T20:59:04.844959] [DEBUG] [MAIN ] RMMZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:04.847665] [INFO ] [MAIN ] RMMZ: Generated 1352 derivative records from 3746 primary records. [2025-09-14T20:59:04.848492] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-14T20:59:04.869603] [DEBUG] [MAIN ] RMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:04.870600] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1352 records). [2025-09-14T20:59:04.871488] [INFO ] [MAIN ] RMT: Generated 1352 derivative records from 12915 primary records. [2025-09-14T20:59:04.871699] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-14T20:59:04.871620] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-14T20:59:04.874106] [INFO ] [MAIN ] Derivative Progress: 1705/2226 symbols completed. RMMZ took 1.0s. Estimated remaining: 3m 3s. Rate: 170.6 symbols/min [2025-09-14T20:59:04.874756] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:04.890092] [DEBUG] [LOCAL ] RMT: Derivative data saved (1352 records). [2025-09-14T20:59:04.890491] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-14T20:59:04.894010] [INFO ] [MAIN ] Derivative Progress: 1706/2226 symbols completed. RMT took 1.0s. Estimated remaining: 3m 3s. Rate: 170.7 symbols/min [2025-09-14T20:59:04.906397] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:04.911109] [DEBUG] [MAIN ] RNG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:04.912488] [INFO ] [MAIN ] RNG: Generated 1352 derivative records from 35802 primary records. [2025-09-14T20:59:04.912748] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-14T20:59:04.936037] [DEBUG] [LOCAL ] RNG: Derivative data saved (1352 records). [2025-09-14T20:59:04.937207] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-14T20:59:04.937541] [DEBUG] [LOCAL ] RNGR: Loaded 15606 existing records from primary storage. [2025-09-14T20:59:04.939900] [INFO ] [MAIN ] Derivative Progress: 1707/2226 symbols completed. RNG took 1.0s. Estimated remaining: 3m 2s. Rate: 170.8 symbols/min [2025-09-14T20:59:04.944886] [INFO ] [MAIN ] RNGR: Loaded 15606 primary data records. [2025-09-14T20:59:04.944755] [DEBUG] [LOCAL ] RNP: Loaded 11789 existing records from primary storage. [2025-09-14T20:59:04.956849] [INFO ] [MAIN ] RNP: Loaded 11789 primary data records. [2025-09-14T20:59:04.945232] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:05.487168] [DEBUG] [LOCAL ] RNR: Loaded 25420 existing records from primary storage. [2025-09-14T20:59:05.499778] [INFO ] [MAIN ] RNR: Loaded 25420 primary data records. [2025-09-14T20:59:05.799536] [DEBUG] [MAIN ] RNP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:05.811298] [INFO ] [MAIN ] RNP: Generated 1352 derivative records from 11789 primary records. [2025-09-14T20:59:05.810095] [DEBUG] [MAIN ] RNGR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:05.812884] [INFO ] [MAIN ] RNGR: Generated 1352 derivative records from 15606 primary records. [2025-09-14T20:59:05.813140] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-14T20:59:05.814058] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-14T20:59:05.833187] [DEBUG] [LOCAL ] RNP: Derivative data saved (1352 records). [2025-09-14T20:59:05.838904] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1352 records). [2025-09-14T20:59:05.839015] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-14T20:59:05.841543] [INFO ] [MAIN ] Derivative Progress: 1708/2226 symbols completed. RNP took 0.9s. Estimated remaining: 3m 2s. Rate: 170.6 symbols/min [2025-09-14T20:59:05.839508] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-14T20:59:05.844302] [INFO ] [MAIN ] Derivative Progress: 1709/2226 symbols completed. RNGR took 1.0s. Estimated remaining: 3m 2s. Rate: 170.7 symbols/min [2025-09-14T20:59:05.857889] [DEBUG] [MAIN ] RNR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:05.858716] [INFO ] [MAIN ] RNR: Generated 1352 derivative records from 25420 primary records. [2025-09-14T20:59:05.858797] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-14T20:59:05.871544] [DEBUG] [LOCAL ] RNR: Derivative data saved (1352 records). [2025-09-14T20:59:05.871692] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-14T20:59:05.873460] [INFO ] [MAIN ] Derivative Progress: 1710/2226 symbols completed. RNR took 0.9s. Estimated remaining: 3m 1s. Rate: 170.8 symbols/min [2025-09-14T20:59:05.874207] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:05.874356] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:05.874005] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:05.902803] [DEBUG] [LOCAL ] ROG: Loaded 17081 existing records from primary storage. [2025-09-14T20:59:05.902994] [INFO ] [MAIN ] ROG: Loaded 17081 primary data records. [2025-09-14T20:59:06.032379] [DEBUG] [LOCAL ] RNST: Loaded 27088 existing records from primary storage. [2025-09-14T20:59:06.038932] [INFO ] [MAIN ] RNST: Loaded 27088 primary data records. [2025-09-14T20:59:06.103520] [DEBUG] [LOCAL ] ROK: Loaded 32763 existing records from primary storage. [2025-09-14T20:59:06.214112] [INFO ] [MAIN ] ROK: Loaded 32763 primary data records. [2025-09-14T20:59:06.849115] [DEBUG] [MAIN ] ROG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:06.850324] [INFO ] [MAIN ] ROG: Generated 1352 derivative records from 17081 primary records. [2025-09-14T20:59:06.851004] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-14T20:59:06.866928] [DEBUG] [LOCAL ] ROG: Derivative data saved (1352 records). [2025-09-14T20:59:06.867138] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-14T20:59:06.869337] [INFO ] [MAIN ] Derivative Progress: 1711/2226 symbols completed. ROG took 1.0s. Estimated remaining: 3m 1s. Rate: 170.6 symbols/min [2025-09-14T20:59:06.881663] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:06.881948] [DEBUG] [MAIN ] RNST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:06.884568] [INFO ] [MAIN ] RNST: Generated 1352 derivative records from 27088 primary records. [2025-09-14T20:59:06.885007] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-14T20:59:06.907120] [DEBUG] [MAIN ] ROK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:06.910933] [INFO ] [MAIN ] ROK: Generated 1352 derivative records from 32763 primary records. [2025-09-14T20:59:06.912113] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-14T20:59:06.912451] [DEBUG] [LOCAL ] RNST: Derivative data saved (1352 records). [2025-09-14T20:59:06.913714] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-14T20:59:06.923102] [INFO ] [MAIN ] Derivative Progress: 1712/2226 symbols completed. RNST took 1.0s. Estimated remaining: 3m 1s. Rate: 170.7 symbols/min [2025-09-14T20:59:06.930341] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:06.930440] [DEBUG] [LOCAL ] ROK: Derivative data saved (1352 records). [2025-09-14T20:59:06.930889] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-14T20:59:06.934150] [INFO ] [MAIN ] Derivative Progress: 1713/2226 symbols completed. ROK took 1.1s. Estimated remaining: 3m 0s. Rate: 170.8 symbols/min [2025-09-14T20:59:06.934858] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:06.961358] [DEBUG] [LOCAL ] ROL: Loaded 37448 existing records from primary storage. [2025-09-14T20:59:06.961576] [INFO ] [MAIN ] ROL: Loaded 37448 primary data records. [2025-09-14T20:59:07.091102] [DEBUG] [LOCAL ] RPT: Loaded 14770 existing records from primary storage. [2025-09-14T20:59:07.091684] [INFO ] [MAIN ] RPT: Loaded 14770 primary data records. [2025-09-14T20:59:07.211708] [DEBUG] [LOCAL ] RPM: Loaded 31152 existing records from primary storage. [2025-09-14T20:59:07.222899] [INFO ] [MAIN ] RPM: Loaded 31152 primary data records. [2025-09-14T20:59:07.856375] [DEBUG] [MAIN ] ROL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:07.858776] [INFO ] [MAIN ] ROL: Generated 1352 derivative records from 37448 primary records. [2025-09-14T20:59:07.859223] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-14T20:59:07.874059] [DEBUG] [LOCAL ] ROL: Derivative data saved (1352 records). [2025-09-14T20:59:07.875326] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-14T20:59:07.887571] [INFO ] [MAIN ] Derivative Progress: 1714/2226 symbols completed. ROL took 1.0s. Estimated remaining: 3m 0s. Rate: 170.7 symbols/min [2025-09-14T20:59:07.888063] [DEBUG] [MAIN ] RPT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:07.888555] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:07.889634] [INFO ] [MAIN ] RPT: Generated 1352 derivative records from 14770 primary records. [2025-09-14T20:59:07.891063] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-14T20:59:07.911033] [DEBUG] [LOCAL ] RPT: Derivative data saved (1352 records). [2025-09-14T20:59:07.915258] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-14T20:59:07.915196] [DEBUG] [MAIN ] RPM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:07.917800] [INFO ] [MAIN ] Derivative Progress: 1715/2226 symbols completed. RPT took 1.0s. Estimated remaining: 2m 60s. Rate: 170.7 symbols/min [2025-09-14T20:59:07.918599] [INFO ] [MAIN ] RPM: Generated 1352 derivative records from 31152 primary records. [2025-09-14T20:59:07.918930] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:07.919259] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-14T20:59:07.939071] [DEBUG] [LOCAL ] RPM: Derivative data saved (1352 records). [2025-09-14T20:59:07.946975] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-14T20:59:07.949346] [INFO ] [MAIN ] Derivative Progress: 1716/2226 symbols completed. RPM took 1.0s. Estimated remaining: 2m 59s. Rate: 170.8 symbols/min [2025-09-14T20:59:07.949762] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:07.950493] [DEBUG] [LOCAL ] RQI: Loaded 21324 existing records from primary storage. [2025-09-14T20:59:07.951091] [INFO ] [MAIN ] RQI: Loaded 21324 primary data records. [2025-09-14T20:59:08.188404] [DEBUG] [LOCAL ] RRC: Loaded 39706 existing records from primary storage. [2025-09-14T20:59:08.189107] [DEBUG] [LOCAL ] RRX: Loaded 30539 existing records from primary storage. [2025-09-14T20:59:08.276026] [INFO ] [MAIN ] RRX: Loaded 30539 primary data records. [2025-09-14T20:59:08.276338] [INFO ] [MAIN ] RRC: Loaded 39706 primary data records. [2025-09-14T20:59:08.915435] [DEBUG] [MAIN ] RQI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:08.916512] [INFO ] [MAIN ] RQI: Generated 1352 derivative records from 21324 primary records. [2025-09-14T20:59:08.919013] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-14T20:59:08.933046] [DEBUG] [LOCAL ] RQI: Derivative data saved (1352 records). [2025-09-14T20:59:08.933458] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-14T20:59:08.935296] [INFO ] [MAIN ] Derivative Progress: 1717/2226 symbols completed. RQI took 1.0s. Estimated remaining: 2m 59s. Rate: 170.7 symbols/min [2025-09-14T20:59:08.935805] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:08.963706] [DEBUG] [MAIN ] RRX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:08.963443] [DEBUG] [MAIN ] RRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:08.964805] [INFO ] [MAIN ] RRX: Generated 1352 derivative records from 30539 primary records. [2025-09-14T20:59:08.965373] [INFO ] [MAIN ] RRC: Generated 1352 derivative records from 39706 primary records. [2025-09-14T20:59:08.970438] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-14T20:59:08.970323] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-14T20:59:08.999820] [DEBUG] [LOCAL ] RS: Loaded 18263 existing records from primary storage. [2025-09-14T20:59:09.003145] [DEBUG] [LOCAL ] RRX: Derivative data saved (1352 records). [2025-09-14T20:59:09.004754] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-14T20:59:09.007007] [DEBUG] [LOCAL ] RRC: Derivative data saved (1352 records). [2025-09-14T20:59:09.009169] [INFO ] [MAIN ] RS: Loaded 18263 primary data records. [2025-09-14T20:59:09.009079] [INFO ] [MAIN ] Derivative Progress: 1718/2226 symbols completed. RRX took 1.1s. Estimated remaining: 2m 59s. Rate: 170.7 symbols/min [2025-09-14T20:59:09.009522] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-14T20:59:09.024698] [INFO ] [MAIN ] Derivative Progress: 1719/2226 symbols completed. RRC took 1.1s. Estimated remaining: 2m 58s. Rate: 170.8 symbols/min [2025-09-14T20:59:09.034101] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:09.050368] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:09.140835] [DEBUG] [LOCAL ] RSF: Loaded 3410 existing records from primary storage. [2025-09-14T20:59:09.174466] [INFO ] [MAIN ] RSF: Loaded 3410 primary data records. [2025-09-14T20:59:09.454223] [DEBUG] [LOCAL ] RSG: Loaded 35548 existing records from primary storage. [2025-09-14T20:59:09.527463] [INFO ] [MAIN ] RSG: Loaded 35548 primary data records. [2025-09-14T20:59:09.815041] [DEBUG] [MAIN ] RS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:09.918799] [INFO ] [MAIN ] RS: Generated 1352 derivative records from 18263 primary records. [2025-09-14T20:59:09.930474] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-14T20:59:09.945316] [DEBUG] [LOCAL ] RS: Derivative data saved (1352 records). [2025-09-14T20:59:09.945946] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-14T20:59:09.948340] [INFO ] [MAIN ] Derivative Progress: 1720/2226 symbols completed. RS took 1.0s. Estimated remaining: 2m 58s. Rate: 170.7 symbols/min [2025-09-14T20:59:09.949124] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:09.964149] [DEBUG] [MAIN ] RSF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:09.965296] [INFO ] [MAIN ] RSF: Generated 1352 derivative records from 3410 primary records. [2025-09-14T20:59:09.965829] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-14T20:59:09.978914] [DEBUG] [LOCAL ] RSF: Derivative data saved (1352 records). [2025-09-14T20:59:09.979293] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-14T20:59:09.981558] [INFO ] [MAIN ] Derivative Progress: 1721/2226 symbols completed. RSF took 1.0s. Estimated remaining: 2m 57s. Rate: 170.8 symbols/min [2025-09-14T20:59:09.982502] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:10.005393] [DEBUG] [MAIN ] RSG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:10.006351] [INFO ] [MAIN ] RSG: Generated 1352 derivative records from 35548 primary records. [2025-09-14T20:59:10.006623] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-14T20:59:10.020225] [DEBUG] [LOCAL ] RSG: Derivative data saved (1352 records). [2025-09-14T20:59:10.037284] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-14T20:59:10.039480] [INFO ] [MAIN ] Derivative Progress: 1722/2226 symbols completed. RSG took 1.0s. Estimated remaining: 2m 57s. Rate: 170.8 symbols/min [2025-09-14T20:59:10.040975] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:10.040591] [DEBUG] [LOCAL ] RSI: Loaded 34908 existing records from primary storage. [2025-09-14T20:59:10.041548] [INFO ] [MAIN ] RSI: Loaded 34908 primary data records. [2025-09-14T20:59:10.161739] [DEBUG] [LOCAL ] RSKD: Loaded 25033 existing records from primary storage. [2025-09-14T20:59:10.172855] [INFO ] [MAIN ] RSKD: Loaded 25033 primary data records. [2025-09-14T20:59:10.461748] [DEBUG] [LOCAL ] RTO: Loaded 29502 existing records from primary storage. [2025-09-14T20:59:10.489362] [INFO ] [MAIN ] RTO: Loaded 29502 primary data records. [2025-09-14T20:59:10.966713] [DEBUG] [MAIN ] RSI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:10.967854] [INFO ] [MAIN ] RSI: Generated 1352 derivative records from 34908 primary records. [2025-09-14T20:59:10.967970] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-14T20:59:10.996106] [DEBUG] [LOCAL ] RSI: Derivative data saved (1352 records). [2025-09-14T20:59:10.996493] [DEBUG] [MAIN ] RSKD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:10.996705] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-14T20:59:10.997496] [INFO ] [MAIN ] RSKD: Generated 1352 derivative records from 25033 primary records. [2025-09-14T20:59:10.999470] [INFO ] [MAIN ] Derivative Progress: 1723/2226 symbols completed. RSI took 1.1s. Estimated remaining: 2m 57s. Rate: 170.7 symbols/min [2025-09-14T20:59:10.999738] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-14T20:59:11.012188] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1352 records). [2025-09-14T20:59:11.012927] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-14T20:59:11.015287] [INFO ] [MAIN ] Derivative Progress: 1724/2226 symbols completed. RSKD took 1.0s. Estimated remaining: 2m 56s. Rate: 170.8 symbols/min [2025-09-14T20:59:11.026851] [DEBUG] [MAIN ] RTO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:11.027449] [INFO ] [MAIN ] RTO: Generated 1352 derivative records from 29502 primary records. [2025-09-14T20:59:11.027522] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-14T20:59:11.039413] [DEBUG] [LOCAL ] RTO: Derivative data saved (1352 records). [2025-09-14T20:59:11.039488] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-14T20:59:11.042281] [INFO ] [MAIN ] Derivative Progress: 1725/2226 symbols completed. RTO took 1.0s. Estimated remaining: 2m 56s. Rate: 170.9 symbols/min [2025-09-14T20:59:11.042737] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:11.042886] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:11.042935] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:11.083298] [DEBUG] [LOCAL ] RVT: Loaded 19660 existing records from primary storage. [2025-09-14T20:59:11.083553] [INFO ] [MAIN ] RVT: Loaded 19660 primary data records. [2025-09-14T20:59:11.214396] [DEBUG] [LOCAL ] RTX: Loaded 40455 existing records from primary storage. [2025-09-14T20:59:11.214475] [DEBUG] [LOCAL ] RVLV: Loaded 35712 existing records from primary storage. [2025-09-14T20:59:11.220188] [INFO ] [MAIN ] RTX: Loaded 40455 primary data records. [2025-09-14T20:59:11.235565] [INFO ] [MAIN ] RVLV: Loaded 35712 primary data records. [2025-09-14T20:59:11.990798] [DEBUG] [MAIN ] RVT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:11.991764] [INFO ] [MAIN ] RVT: Generated 1352 derivative records from 19660 primary records. [2025-09-14T20:59:11.992851] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-14T20:59:12.017477] [DEBUG] [MAIN ] RTX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:12.016276] [DEBUG] [LOCAL ] RVT: Derivative data saved (1352 records). [2025-09-14T20:59:12.018989] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-14T20:59:12.019619] [INFO ] [MAIN ] RTX: Generated 1352 derivative records from 40455 primary records. [2025-09-14T20:59:12.021304] [INFO ] [MAIN ] Derivative Progress: 1726/2226 symbols completed. RVT took 1.0s. Estimated remaining: 2m 56s. Rate: 170.7 symbols/min [2025-09-14T20:59:12.021690] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:12.021871] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-14T20:59:12.047121] [DEBUG] [MAIN ] RVLV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:12.050437] [INFO ] [MAIN ] RVLV: Generated 1352 derivative records from 35712 primary records. [2025-09-14T20:59:12.052445] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-14T20:59:12.052391] [DEBUG] [LOCAL ] RTX: Derivative data saved (1352 records). [2025-09-14T20:59:12.053688] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-14T20:59:12.057272] [INFO ] [MAIN ] Derivative Progress: 1727/2226 symbols completed. RTX took 1.0s. Estimated remaining: 2m 55s. Rate: 170.8 symbols/min [2025-09-14T20:59:12.068967] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:12.070135] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1352 records). [2025-09-14T20:59:12.070701] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-14T20:59:12.073083] [INFO ] [MAIN ] Derivative Progress: 1728/2226 symbols completed. RVLV took 1.0s. Estimated remaining: 2m 55s. Rate: 170.9 symbols/min [2025-09-14T20:59:12.073567] [INFO ] [MAIN ] RWTP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:12.079707] [DEBUG] [LOCAL ] RWTP: Loaded 2038 existing records from primary storage. [2025-09-14T20:59:12.079915] [INFO ] [MAIN ] RWTP: Loaded 2038 primary data records. [2025-09-14T20:59:12.282850] [DEBUG] [LOCAL ] RVTY: Loaded 35767 existing records from primary storage. [2025-09-14T20:59:12.289721] [DEBUG] [LOCAL ] RWT: Loaded 30008 existing records from primary storage. [2025-09-14T20:59:12.305589] [INFO ] [MAIN ] RVTY: Loaded 35767 primary data records. [2025-09-14T20:59:12.398698] [INFO ] [MAIN ] RWT: Loaded 30008 primary data records. [2025-09-14T20:59:13.098450] [DEBUG] [MAIN ] RWTP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:13.099954] [INFO ] [MAIN ] RWTP: Generated 1352 derivative records from 2038 primary records. [2025-09-14T20:59:13.100301] [DEBUG] [LOCAL ] RWTP: Saving derivative data. [2025-09-14T20:59:13.115189] [DEBUG] [LOCAL ] RWTP: Derivative data saved (1352 records). [2025-09-14T20:59:13.115449] [INFO ] [MAIN ] RWTP: Successfully saved derivative data. [2025-09-14T20:59:13.118786] [INFO ] [MAIN ] Derivative Progress: 1729/2226 symbols completed. RWTP took 1.0s. Estimated remaining: 2m 55s. Rate: 170.7 symbols/min [2025-09-14T20:59:13.119511] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:13.134600] [DEBUG] [MAIN ] RVTY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:13.135845] [INFO ] [MAIN ] RVTY: Generated 1352 derivative records from 35767 primary records. [2025-09-14T20:59:13.136127] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-14T20:59:13.150885] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1352 records). [2025-09-14T20:59:13.152709] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-14T20:59:13.155735] [INFO ] [MAIN ] Derivative Progress: 1730/2226 symbols completed. RVTY took 1.1s. Estimated remaining: 2m 54s. Rate: 170.8 symbols/min [2025-09-14T20:59:13.166164] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:13.167162] [DEBUG] [MAIN ] RWT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:13.168447] [INFO ] [MAIN ] RWT: Generated 1352 derivative records from 30008 primary records. [2025-09-14T20:59:13.168555] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-14T20:59:13.181722] [DEBUG] [LOCAL ] RWT: Derivative data saved (1352 records). [2025-09-14T20:59:13.191213] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-14T20:59:13.193278] [INFO ] [MAIN ] Derivative Progress: 1731/2226 symbols completed. RWT took 1.1s. Estimated remaining: 2m 54s. Rate: 170.8 symbols/min [2025-09-14T20:59:13.193712] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:13.211129] [DEBUG] [LOCAL ] RXO: Loaded 35965 existing records from primary storage. [2025-09-14T20:59:13.211319] [INFO ] [MAIN ] RXO: Loaded 35965 primary data records. [2025-09-14T20:59:13.354519] [DEBUG] [LOCAL ] RY: Loaded 35706 existing records from primary storage. [2025-09-14T20:59:13.355015] [DEBUG] [LOCAL ] RYAM: Loaded 26099 existing records from primary storage. [2025-09-14T20:59:13.355636] [INFO ] [MAIN ] RY: Loaded 35706 primary data records. [2025-09-14T20:59:13.381634] [INFO ] [MAIN ] RYAM: Loaded 26099 primary data records. [2025-09-14T20:59:14.142287] [DEBUG] [MAIN ] RXO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:14.145246] [INFO ] [MAIN ] RXO: Generated 1352 derivative records from 35965 primary records. [2025-09-14T20:59:14.145773] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-14T20:59:14.162875] [DEBUG] [LOCAL ] RXO: Derivative data saved (1352 records). [2025-09-14T20:59:14.174679] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-14T20:59:14.174486] [DEBUG] [MAIN ] RY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:14.177376] [INFO ] [MAIN ] Derivative Progress: 1732/2226 symbols completed. RXO took 1.1s. Estimated remaining: 2m 54s. Rate: 170.7 symbols/min [2025-09-14T20:59:14.179126] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:14.179846] [INFO ] [MAIN ] RY: Generated 1352 derivative records from 35706 primary records. [2025-09-14T20:59:14.180531] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-14T20:59:14.192985] [DEBUG] [MAIN ] RYAM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:14.203078] [INFO ] [MAIN ] RYAM: Generated 1352 derivative records from 26099 primary records. [2025-09-14T20:59:14.206730] [DEBUG] [LOCAL ] RY: Derivative data saved (1352 records). [2025-09-14T20:59:14.206812] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-14T20:59:14.207018] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-14T20:59:14.210323] [INFO ] [MAIN ] Derivative Progress: 1733/2226 symbols completed. RY took 1.0s. Estimated remaining: 2m 53s. Rate: 170.8 symbols/min [2025-09-14T20:59:14.211005] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:14.222761] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1352 records). [2025-09-14T20:59:14.223099] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-14T20:59:14.225434] [INFO ] [MAIN ] Derivative Progress: 1734/2226 symbols completed. RYAM took 1.0s. Estimated remaining: 2m 53s. Rate: 170.8 symbols/min [2025-09-14T20:59:14.225921] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:14.249994] [DEBUG] [LOCAL ] RYI: Loaded 16156 existing records from primary storage. [2025-09-14T20:59:14.250163] [INFO ] [MAIN ] RYI: Loaded 16156 primary data records. [2025-09-14T20:59:14.373786] [DEBUG] [LOCAL ] RYAN: Loaded 32666 existing records from primary storage. [2025-09-14T20:59:14.384905] [INFO ] [MAIN ] RYAN: Loaded 32666 primary data records. [2025-09-14T20:59:14.519445] [DEBUG] [LOCAL ] RYN: Loaded 34168 existing records from primary storage. [2025-09-14T20:59:14.626308] [INFO ] [MAIN ] RYN: Loaded 34168 primary data records. [2025-09-14T20:59:15.125012] [DEBUG] [MAIN ] RYI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:15.126747] [INFO ] [MAIN ] RYI: Generated 1352 derivative records from 16156 primary records. [2025-09-14T20:59:15.127409] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-14T20:59:15.142259] [DEBUG] [LOCAL ] RYI: Derivative data saved (1352 records). [2025-09-14T20:59:15.144626] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-14T20:59:15.147985] [INFO ] [MAIN ] Derivative Progress: 1735/2226 symbols completed. RYI took 0.9s. Estimated remaining: 2m 53s. Rate: 170.7 symbols/min [2025-09-14T20:59:15.159264] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:15.159701] [DEBUG] [MAIN ] RYAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:15.160601] [INFO ] [MAIN ] RYAN: Generated 1352 derivative records from 32666 primary records. [2025-09-14T20:59:15.160854] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-14T20:59:15.179749] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1352 records). [2025-09-14T20:59:15.183418] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-14T20:59:15.186078] [INFO ] [MAIN ] Derivative Progress: 1736/2226 symbols completed. RYAN took 1.0s. Estimated remaining: 2m 52s. Rate: 170.8 symbols/min [2025-09-14T20:59:15.183198] [DEBUG] [LOCAL ] RZB: Loaded 4775 existing records from primary storage. [2025-09-14T20:59:15.186514] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:15.192821] [INFO ] [MAIN ] RZB: Loaded 4775 primary data records. [2025-09-14T20:59:15.197366] [DEBUG] [MAIN ] RYN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:15.234922] [INFO ] [MAIN ] RYN: Generated 1352 derivative records from 34168 primary records. [2025-09-14T20:59:15.269688] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-14T20:59:15.304851] [DEBUG] [LOCAL ] RZC: Loaded 5053 existing records from primary storage. [2025-09-14T20:59:15.309221] [INFO ] [MAIN ] RZC: Loaded 5053 primary data records. [2025-09-14T20:59:15.643435] [DEBUG] [LOCAL ] RYN: Derivative data saved (1352 records). [2025-09-14T20:59:15.698510] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-14T20:59:15.814741] [INFO ] [MAIN ] Derivative Progress: 1737/2226 symbols completed. RYN took 1.6s. Estimated remaining: 2m 52s. Rate: 170.7 symbols/min [2025-09-14T20:59:15.816390] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:15.840729] [DEBUG] [MAIN ] RZB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:15.842788] [INFO ] [MAIN ] RZB: Generated 1352 derivative records from 4775 primary records. [2025-09-14T20:59:15.844572] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-14T20:59:15.878211] [DEBUG] [MAIN ] RZC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:15.880334] [INFO ] [MAIN ] RZC: Generated 1352 derivative records from 5053 primary records. [2025-09-14T20:59:15.880612] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-14T20:59:15.879493] [DEBUG] [LOCAL ] RZB: Derivative data saved (1352 records). [2025-09-14T20:59:15.881874] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-14T20:59:15.893867] [DEBUG] [LOCAL ] RZC: Derivative data saved (1352 records). [2025-09-14T20:59:15.895134] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-14T20:59:15.897387] [INFO ] [MAIN ] Derivative Progress: 1738/2226 symbols completed. RZB took 0.7s. Estimated remaining: 2m 51s. Rate: 170.8 symbols/min [2025-09-14T20:59:15.915263] [INFO ] [MAIN ] Derivative Progress: 1739/2226 symbols completed. RZC took 0.7s. Estimated remaining: 2m 51s. Rate: 170.9 symbols/min [2025-09-14T20:59:15.917173] [DEBUG] [LOCAL ] S: Loaded 40297 existing records from primary storage. [2025-09-14T20:59:15.917319] [INFO ] [MAIN ] S: Loaded 40297 primary data records. [2025-09-14T20:59:16.203615] [DEBUG] [MAIN ] S: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:16.204395] [INFO ] [MAIN ] S: Generated 1352 derivative records from 40297 primary records. [2025-09-14T20:59:16.204485] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-14T20:59:16.216712] [DEBUG] [LOCAL ] S: Derivative data saved (1352 records). [2025-09-14T20:59:16.216816] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-14T20:59:16.218654] [INFO ] [MAIN ] Derivative Progress: 1740/2226 symbols completed. S took 0.4s. Estimated remaining: 2m 51s. Rate: 170.9 symbols/min [2025-09-14T20:59:16.219907] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:16.220083] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:16.220280] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:16.231875] [DEBUG] [LOCAL ] SABA: Loaded 6842 existing records from primary storage. [2025-09-14T20:59:16.232126] [INFO ] [MAIN ] SABA: Loaded 6842 primary data records. [2025-09-14T20:59:16.375032] [DEBUG] [LOCAL ] SAFE: Loaded 22773 existing records from primary storage. [2025-09-14T20:59:16.381300] [INFO ] [MAIN ] SAFE: Loaded 22773 primary data records. [2025-09-14T20:59:16.489344] [DEBUG] [LOCAL ] SA: Loaded 32071 existing records from primary storage. [2025-09-14T20:59:16.601265] [INFO ] [MAIN ] SA: Loaded 32071 primary data records. [2025-09-14T20:59:17.172237] [DEBUG] [MAIN ] SABA: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:59:17.174126] [INFO ] [MAIN ] SABA: Generated 1351 derivative records from 6842 primary records. [2025-09-14T20:59:17.174396] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-14T20:59:17.189930] [DEBUG] [LOCAL ] SABA: Derivative data saved (1351 records). [2025-09-14T20:59:17.190393] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-14T20:59:17.193459] [INFO ] [MAIN ] Derivative Progress: 1741/2226 symbols completed. SABA took 1.0s. Estimated remaining: 2m 50s. Rate: 170.7 symbols/min [2025-09-14T20:59:17.194365] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:17.209979] [DEBUG] [MAIN ] SAFE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:17.211462] [INFO ] [MAIN ] SAFE: Generated 1352 derivative records from 22773 primary records. [2025-09-14T20:59:17.212000] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-14T20:59:17.234384] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1352 records). [2025-09-14T20:59:17.235804] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-14T20:59:17.238656] [INFO ] [MAIN ] Derivative Progress: 1742/2226 symbols completed. SAFE took 1.0s. Estimated remaining: 2m 50s. Rate: 170.8 symbols/min [2025-09-14T20:59:17.251938] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:17.256787] [DEBUG] [LOCAL ] SAH: Loaded 15981 existing records from primary storage. [2025-09-14T20:59:17.257636] [INFO ] [MAIN ] SAH: Loaded 15981 primary data records. [2025-09-14T20:59:17.258035] [DEBUG] [MAIN ] SA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:17.281931] [INFO ] [MAIN ] SA: Generated 1352 derivative records from 32071 primary records. [2025-09-14T20:59:17.298298] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-14T20:59:17.432977] [DEBUG] [LOCAL ] SAM: Loaded 16280 existing records from primary storage. [2025-09-14T20:59:17.455735] [DEBUG] [LOCAL ] SA: Derivative data saved (1352 records). [2025-09-14T20:59:17.455624] [INFO ] [MAIN ] SAM: Loaded 16280 primary data records. [2025-09-14T20:59:17.478248] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-14T20:59:17.564092] [INFO ] [MAIN ] Derivative Progress: 1743/2226 symbols completed. SA took 1.3s. Estimated remaining: 2m 50s. Rate: 170.8 symbols/min [2025-09-14T20:59:17.651609] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:17.964510] [DEBUG] [LOCAL ] SAN: Loaded 39900 existing records from primary storage. [2025-09-14T20:59:17.965336] [DEBUG] [MAIN ] SAH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:17.965691] [INFO ] [MAIN ] SAN: Loaded 39900 primary data records. [2025-09-14T20:59:17.966527] [INFO ] [MAIN ] SAH: Generated 1352 derivative records from 15981 primary records. [2025-09-14T20:59:17.967586] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-14T20:59:18.021977] [DEBUG] [LOCAL ] SAH: Derivative data saved (1352 records). [2025-09-14T20:59:18.043792] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-14T20:59:18.046234] [INFO ] [MAIN ] Derivative Progress: 1744/2226 symbols completed. SAH took 0.9s. Estimated remaining: 2m 49s. Rate: 170.8 symbols/min [2025-09-14T20:59:18.057038] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:18.194910] [DEBUG] [MAIN ] SAM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:18.291412] [INFO ] [MAIN ] SAM: Generated 1352 derivative records from 16280 primary records. [2025-09-14T20:59:18.300985] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-14T20:59:18.321527] [DEBUG] [LOCAL ] SAM: Derivative data saved (1352 records). [2025-09-14T20:59:18.321789] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-14T20:59:18.335634] [INFO ] [MAIN ] Derivative Progress: 1745/2226 symbols completed. SAM took 1.1s. Estimated remaining: 2m 49s. Rate: 170.8 symbols/min [2025-09-14T20:59:18.336019] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:18.337943] [DEBUG] [LOCAL ] SAND: Loaded 38913 existing records from primary storage. [2025-09-14T20:59:18.339129] [INFO ] [MAIN ] SAND: Loaded 38913 primary data records. [2025-09-14T20:59:18.636742] [DEBUG] [MAIN ] SAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:18.638855] [INFO ] [MAIN ] SAN: Generated 1352 derivative records from 39900 primary records. [2025-09-14T20:59:18.649799] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-14T20:59:18.651857] [DEBUG] [LOCAL ] SAP: Loaded 37315 existing records from primary storage. [2025-09-14T20:59:18.653721] [INFO ] [MAIN ] SAP: Loaded 37315 primary data records. [2025-09-14T20:59:18.699117] [DEBUG] [LOCAL ] SAN: Derivative data saved (1352 records). [2025-09-14T20:59:18.723957] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-14T20:59:18.726178] [INFO ] [MAIN ] Derivative Progress: 1746/2226 symbols completed. SAN took 1.1s. Estimated remaining: 2m 49s. Rate: 170.8 symbols/min [2025-09-14T20:59:18.770766] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:18.972829] [DEBUG] [LOCAL ] SAR: Loaded 12203 existing records from primary storage. [2025-09-14T20:59:18.973124] [DEBUG] [MAIN ] SAND: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:18.974475] [INFO ] [MAIN ] SAR: Loaded 12203 primary data records. [2025-09-14T20:59:18.975269] [INFO ] [MAIN ] SAND: Generated 1352 derivative records from 38913 primary records. [2025-09-14T20:59:18.997443] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-14T20:59:19.079099] [DEBUG] [LOCAL ] SAND: Derivative data saved (1352 records). [2025-09-14T20:59:19.103972] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-14T20:59:19.106610] [INFO ] [MAIN ] Derivative Progress: 1747/2226 symbols completed. SAND took 1.0s. Estimated remaining: 2m 48s. Rate: 170.8 symbols/min [2025-09-14T20:59:19.117781] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:19.287953] [DEBUG] [MAIN ] SAP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:19.289941] [INFO ] [MAIN ] SAP: Generated 1352 derivative records from 37315 primary records. [2025-09-14T20:59:19.290993] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-14T20:59:19.307568] [DEBUG] [LOCAL ] SAP: Derivative data saved (1352 records). [2025-09-14T20:59:19.308164] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-14T20:59:19.310169] [INFO ] [MAIN ] Derivative Progress: 1748/2226 symbols completed. SAP took 1.0s. Estimated remaining: 2m 48s. Rate: 170.8 symbols/min [2025-09-14T20:59:19.310749] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:19.344493] [DEBUG] [LOCAL ] SARO: Loaded 36248 existing records from primary storage. [2025-09-14T20:59:19.348981] [DEBUG] [MAIN ] SAR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:19.349146] [INFO ] [MAIN ] SARO: Loaded 36248 primary data records. [2025-09-14T20:59:19.356562] [INFO ] [MAIN ] SAR: Generated 1352 derivative records from 12203 primary records. [2025-09-14T20:59:19.388062] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-14T20:59:19.454081] [DEBUG] [LOCAL ] SB: Loaded 24605 existing records from primary storage. [2025-09-14T20:59:19.488932] [DEBUG] [LOCAL ] SAR: Derivative data saved (1352 records). [2025-09-14T20:59:19.509576] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-14T20:59:19.489048] [INFO ] [MAIN ] SB: Loaded 24605 primary data records. [2025-09-14T20:59:19.527135] [INFO ] [MAIN ] Derivative Progress: 1749/2226 symbols completed. SAR took 0.8s. Estimated remaining: 2m 48s. Rate: 170.8 symbols/min [2025-09-14T20:59:19.535799] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:19.969115] [DEBUG] [LOCAL ] SBH: Loaded 37080 existing records from primary storage. [2025-09-14T20:59:19.970176] [INFO ] [MAIN ] SBH: Loaded 37080 primary data records. [2025-09-14T20:59:20.148882] [DEBUG] [MAIN ] SARO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:20.183738] [INFO ] [MAIN ] SARO: Generated 1352 derivative records from 36248 primary records. [2025-09-14T20:59:20.330051] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-14T20:59:20.343389] [DEBUG] [MAIN ] SB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:20.350394] [INFO ] [MAIN ] SB: Generated 1352 derivative records from 24605 primary records. [2025-09-14T20:59:20.351132] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-14T20:59:20.359868] [DEBUG] [LOCAL ] SARO: Derivative data saved (1352 records). [2025-09-14T20:59:20.372542] [DEBUG] [LOCAL ] SB: Derivative data saved (1352 records). [2025-09-14T20:59:20.370457] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-14T20:59:20.373491] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-14T20:59:20.375995] [INFO ] [MAIN ] Derivative Progress: 1750/2226 symbols completed. SARO took 1.3s. Estimated remaining: 2m 47s. Rate: 170.7 symbols/min [2025-09-14T20:59:20.378705] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:20.379295] [INFO ] [MAIN ] Derivative Progress: 1751/2226 symbols completed. SB took 1.1s. Estimated remaining: 2m 47s. Rate: 170.8 symbols/min [2025-09-14T20:59:20.379825] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:20.388894] [DEBUG] [LOCAL ] SBI: Loaded 5659 existing records from primary storage. [2025-09-14T20:59:20.389908] [INFO ] [MAIN ] SBI: Loaded 5659 primary data records. [2025-09-14T20:59:20.468471] [DEBUG] [LOCAL ] SBR: Loaded 5266 existing records from primary storage. [2025-09-14T20:59:20.513309] [INFO ] [MAIN ] SBR: Loaded 5266 primary data records. [2025-09-14T20:59:20.621473] [DEBUG] [MAIN ] SBH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:20.788098] [INFO ] [MAIN ] SBH: Generated 1352 derivative records from 37080 primary records. [2025-09-14T20:59:20.832836] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-14T20:59:21.055401] [DEBUG] [LOCAL ] SBH: Derivative data saved (1352 records). [2025-09-14T20:59:21.055945] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-14T20:59:21.057561] [INFO ] [MAIN ] Derivative Progress: 1752/2226 symbols completed. SBH took 1.5s. Estimated remaining: 2m 47s. Rate: 170.7 symbols/min [2025-09-14T20:59:21.058922] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:21.079729] [DEBUG] [MAIN ] SBI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:21.081545] [INFO ] [MAIN ] SBI: Generated 1352 derivative records from 5659 primary records. [2025-09-14T20:59:21.082159] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-14T20:59:21.105551] [DEBUG] [LOCAL ] SBI: Derivative data saved (1352 records). [2025-09-14T20:59:21.107012] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-14T20:59:21.110605] [INFO ] [MAIN ] Derivative Progress: 1753/2226 symbols completed. SBI took 0.7s. Estimated remaining: 2m 46s. Rate: 170.8 symbols/min [2025-09-14T20:59:21.121981] [DEBUG] [MAIN ] SBR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:21.122829] [INFO ] [MAIN ] SBR: Generated 1352 derivative records from 5266 primary records. [2025-09-14T20:59:21.123671] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-14T20:59:21.146610] [DEBUG] [LOCAL ] SBS: Loaded 37095 existing records from primary storage. [2025-09-14T20:59:21.149927] [DEBUG] [LOCAL ] SBR: Derivative data saved (1352 records). [2025-09-14T20:59:21.150055] [INFO ] [MAIN ] SBS: Loaded 37095 primary data records. [2025-09-14T20:59:21.150260] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-14T20:59:21.152715] [INFO ] [MAIN ] Derivative Progress: 1754/2226 symbols completed. SBR took 0.8s. Estimated remaining: 2m 46s. Rate: 170.9 symbols/min [2025-09-14T20:59:21.451106] [DEBUG] [MAIN ] SBS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:21.451881] [INFO ] [MAIN ] SBS: Generated 1352 derivative records from 37095 primary records. [2025-09-14T20:59:21.451962] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-14T20:59:21.463920] [DEBUG] [LOCAL ] SBS: Derivative data saved (1352 records). [2025-09-14T20:59:21.463994] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-14T20:59:21.465968] [INFO ] [MAIN ] Derivative Progress: 1755/2226 symbols completed. SBS took 0.4s. Estimated remaining: 2m 45s. Rate: 170.9 symbols/min [2025-09-14T20:59:21.466965] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:21.466838] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:21.467141] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:21.481962] [DEBUG] [LOCAL ] SBSI: Loaded 10587 existing records from primary storage. [2025-09-14T20:59:21.482141] [INFO ] [MAIN ] SBSI: Loaded 10587 primary data records. [2025-09-14T20:59:21.697674] [DEBUG] [LOCAL ] SCCO: Loaded 36751 existing records from primary storage. [2025-09-14T20:59:21.714193] [DEBUG] [LOCAL ] SBSW: Loaded 39957 existing records from primary storage. [2025-09-14T20:59:21.751842] [INFO ] [MAIN ] SCCO: Loaded 36751 primary data records. [2025-09-14T20:59:21.827276] [INFO ] [MAIN ] SBSW: Loaded 39957 primary data records. [2025-09-14T20:59:22.428662] [DEBUG] [MAIN ] SBSI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:22.430208] [INFO ] [MAIN ] SBSI: Generated 1352 derivative records from 10587 primary records. [2025-09-14T20:59:22.430324] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-14T20:59:22.447136] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1352 records). [2025-09-14T20:59:22.447710] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-14T20:59:22.449536] [INFO ] [MAIN ] Derivative Progress: 1756/2226 symbols completed. SBSI took 1.0s. Estimated remaining: 2m 45s. Rate: 170.7 symbols/min [2025-09-14T20:59:22.449939] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:22.466744] [DEBUG] [LOCAL ] SCD: Loaded 10340 existing records from primary storage. [2025-09-14T20:59:22.473634] [INFO ] [MAIN ] SCD: Loaded 10340 primary data records. [2025-09-14T20:59:22.488123] [DEBUG] [MAIN ] SCCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:22.500663] [INFO ] [MAIN ] SCCO: Generated 1352 derivative records from 36751 primary records. [2025-09-14T20:59:22.510921] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-14T20:59:22.487712] [DEBUG] [MAIN ] SBSW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:22.527320] [INFO ] [MAIN ] SBSW: Generated 1352 derivative records from 39957 primary records. [2025-09-14T20:59:22.573005] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-14T20:59:22.641140] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1352 records). [2025-09-14T20:59:22.695719] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-14T20:59:22.700972] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1352 records). [2025-09-14T20:59:22.703985] [INFO ] [MAIN ] Derivative Progress: 1757/2226 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 45s. Rate: 170.7 symbols/min [2025-09-14T20:59:22.704500] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-14T20:59:22.842522] [INFO ] [MAIN ] Derivative Progress: 1758/2226 symbols completed. SBSW took 1.4s. Estimated remaining: 2m 44s. Rate: 170.8 symbols/min [2025-09-14T20:59:22.831629] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:22.844489] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:22.869976] [DEBUG] [MAIN ] SCD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:22.870873] [INFO ] [MAIN ] SCD: Generated 1352 derivative records from 10340 primary records. [2025-09-14T20:59:22.870951] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-14T20:59:22.883557] [DEBUG] [LOCAL ] SCD: Derivative data saved (1352 records). [2025-09-14T20:59:22.892403] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-14T20:59:22.894485] [INFO ] [MAIN ] Derivative Progress: 1759/2226 symbols completed. SCD took 0.4s. Estimated remaining: 2m 44s. Rate: 170.9 symbols/min [2025-09-14T20:59:22.894933] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:22.922278] [DEBUG] [LOCAL ] SCI: Loaded 35142 existing records from primary storage. [2025-09-14T20:59:22.922539] [INFO ] [MAIN ] SCI: Loaded 35142 primary data records. [2025-09-14T20:59:22.995108] [DEBUG] [LOCAL ] SCL: Loaded 10822 existing records from primary storage. [2025-09-14T20:59:23.022022] [DEBUG] [LOCAL ] SCHW: Loaded 40425 existing records from primary storage. [2025-09-14T20:59:23.033244] [INFO ] [MAIN ] SCL: Loaded 10822 primary data records. [2025-09-14T20:59:23.050332] [INFO ] [MAIN ] SCHW: Loaded 40425 primary data records. [2025-09-14T20:59:23.854345] [DEBUG] [MAIN ] SCI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:23.855936] [INFO ] [MAIN ] SCI: Generated 1352 derivative records from 35142 primary records. [2025-09-14T20:59:23.856282] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-14T20:59:23.870741] [DEBUG] [LOCAL ] SCI: Derivative data saved (1352 records). [2025-09-14T20:59:23.870979] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-14T20:59:23.873767] [INFO ] [MAIN ] Derivative Progress: 1760/2226 symbols completed. SCI took 1.0s. Estimated remaining: 2m 44s. Rate: 170.7 symbols/min [2025-09-14T20:59:23.874658] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:23.888029] [DEBUG] [MAIN ] SCL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:23.899231] [INFO ] [MAIN ] SCL: Generated 1352 derivative records from 10822 primary records. [2025-09-14T20:59:23.899552] [DEBUG] [MAIN ] SCHW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:23.899765] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-14T20:59:23.901439] [INFO ] [MAIN ] SCHW: Generated 1352 derivative records from 40425 primary records. [2025-09-14T20:59:23.901557] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-14T20:59:23.924515] [DEBUG] [LOCAL ] SCL: Derivative data saved (1352 records). [2025-09-14T20:59:23.928165] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-14T20:59:23.929863] [INFO ] [MAIN ] Derivative Progress: 1761/2226 symbols completed. SCL took 1.0s. Estimated remaining: 2m 43s. Rate: 170.8 symbols/min [2025-09-14T20:59:23.931905] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:23.933990] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1352 records). [2025-09-14T20:59:23.934896] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-14T20:59:23.943665] [INFO ] [MAIN ] Derivative Progress: 1762/2226 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 43s. Rate: 170.9 symbols/min [2025-09-14T20:59:23.944239] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:23.945039] [DEBUG] [LOCAL ] SCM: Loaded 13776 existing records from primary storage. [2025-09-14T20:59:23.945865] [INFO ] [MAIN ] SCM: Loaded 13776 primary data records. [2025-09-14T20:59:24.153237] [DEBUG] [LOCAL ] SD: Loaded 21092 existing records from primary storage. [2025-09-14T20:59:24.166724] [INFO ] [MAIN ] SD: Loaded 21092 primary data records. [2025-09-14T20:59:24.167833] [DEBUG] [LOCAL ] SCS: Loaded 31859 existing records from primary storage. [2025-09-14T20:59:24.304866] [INFO ] [MAIN ] SCS: Loaded 31859 primary data records. [2025-09-14T20:59:24.856878] [DEBUG] [MAIN ] SCM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:24.858719] [INFO ] [MAIN ] SCM: Generated 1352 derivative records from 13776 primary records. [2025-09-14T20:59:24.859189] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-14T20:59:24.873529] [DEBUG] [LOCAL ] SCM: Derivative data saved (1352 records). [2025-09-14T20:59:24.873733] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-14T20:59:24.875626] [INFO ] [MAIN ] Derivative Progress: 1763/2226 symbols completed. SCM took 1.0s. Estimated remaining: 2m 43s. Rate: 170.7 symbols/min [2025-09-14T20:59:24.876247] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:24.895746] [DEBUG] [MAIN ] SD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:24.900598] [DEBUG] [LOCAL ] SDHC: Loaded 7254 existing records from primary storage. [2025-09-14T20:59:24.903460] [INFO ] [MAIN ] SD: Generated 1352 derivative records from 21092 primary records. [2025-09-14T20:59:24.904049] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-14T20:59:24.903529] [INFO ] [MAIN ] SDHC: Loaded 7254 primary data records. [2025-09-14T20:59:24.966776] [DEBUG] [MAIN ] SCS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:25.001846] [DEBUG] [LOCAL ] SD: Derivative data saved (1352 records). [2025-09-14T20:59:25.023287] [INFO ] [MAIN ] SCS: Generated 1352 derivative records from 31859 primary records. [2025-09-14T20:59:25.023410] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-14T20:59:25.050565] [INFO ] [MAIN ] Derivative Progress: 1764/2226 symbols completed. SD took 1.1s. Estimated remaining: 2m 42s. Rate: 170.8 symbols/min [2025-09-14T20:59:25.050684] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-14T20:59:25.067190] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:25.147655] [DEBUG] [LOCAL ] SCS: Derivative data saved (1352 records). [2025-09-14T20:59:25.281054] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-14T20:59:25.283583] [INFO ] [MAIN ] Derivative Progress: 1765/2226 symbols completed. SCS took 1.4s. Estimated remaining: 2m 42s. Rate: 170.8 symbols/min [2025-09-14T20:59:25.288443] [DEBUG] [LOCAL ] SDHY: Loaded 7727 existing records from primary storage. [2025-09-14T20:59:25.288673] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:25.289603] [INFO ] [MAIN ] SDHY: Loaded 7727 primary data records. [2025-09-14T20:59:25.614685] [DEBUG] [LOCAL ] SDRL: Loaded 30940 existing records from primary storage. [2025-09-14T20:59:25.617716] [INFO ] [MAIN ] SDRL: Loaded 30940 primary data records. [2025-09-14T20:59:25.629064] [DEBUG] [MAIN ] SDHC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:25.702848] [INFO ] [MAIN ] SDHC: Generated 1352 derivative records from 7254 primary records. [2025-09-14T20:59:25.720190] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-14T20:59:25.829258] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1352 records). [2025-09-14T20:59:25.832726] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-14T20:59:25.927750] [INFO ] [MAIN ] Derivative Progress: 1766/2226 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 42s. Rate: 170.7 symbols/min [2025-09-14T20:59:25.928567] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:25.941159] [DEBUG] [MAIN ] SDHY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:25.943226] [INFO ] [MAIN ] SDHY: Generated 1352 derivative records from 7727 primary records. [2025-09-14T20:59:25.943597] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-14T20:59:25.957289] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1352 records). [2025-09-14T20:59:25.957374] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-14T20:59:25.959819] [INFO ] [MAIN ] Derivative Progress: 1767/2226 symbols completed. SDHY took 0.9s. Estimated remaining: 2m 41s. Rate: 170.8 symbols/min [2025-09-14T20:59:25.962126] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:25.990015] [DEBUG] [MAIN ] SDRL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:25.990919] [INFO ] [MAIN ] SDRL: Generated 1352 derivative records from 30940 primary records. [2025-09-14T20:59:25.991145] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-14T20:59:26.004892] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1352 records). [2025-09-14T20:59:26.024999] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-14T20:59:26.027008] [INFO ] [MAIN ] Derivative Progress: 1768/2226 symbols completed. SDRL took 0.7s. Estimated remaining: 2m 41s. Rate: 170.9 symbols/min [2025-09-14T20:59:26.028553] [DEBUG] [LOCAL ] SE: Loaded 40176 existing records from primary storage. [2025-09-14T20:59:26.029101] [INFO ] [MAIN ] SE: Loaded 40176 primary data records. [2025-09-14T20:59:26.148362] [DEBUG] [LOCAL ] SEE: Loaded 35894 existing records from primary storage. [2025-09-14T20:59:26.165501] [INFO ] [MAIN ] SEE: Loaded 35894 primary data records. [2025-09-14T20:59:26.654070] [DEBUG] [MAIN ] SE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:26.656050] [INFO ] [MAIN ] SE: Generated 1352 derivative records from 40176 primary records. [2025-09-14T20:59:26.656449] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-09-14T20:59:26.687767] [DEBUG] [LOCAL ] SE: Derivative data saved (1352 records). [2025-09-14T20:59:26.687948] [DEBUG] [MAIN ] SEE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:26.688143] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-14T20:59:26.688899] [INFO ] [MAIN ] SEE: Generated 1352 derivative records from 35894 primary records. [2025-09-14T20:59:26.690559] [INFO ] [MAIN ] Derivative Progress: 1769/2226 symbols completed. SE took 0.8s. Estimated remaining: 2m 41s. Rate: 170.8 symbols/min [2025-09-14T20:59:26.690941] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-14T20:59:26.704816] [DEBUG] [LOCAL ] SEE: Derivative data saved (1352 records). [2025-09-14T20:59:26.705052] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-14T20:59:26.707848] [INFO ] [MAIN ] Derivative Progress: 1770/2226 symbols completed. SEE took 0.7s. Estimated remaining: 2m 40s. Rate: 170.9 symbols/min [2025-09-14T20:59:26.708909] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:26.708629] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:26.709062] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:26.723510] [DEBUG] [LOCAL ] SEG: Loaded 9710 existing records from primary storage. [2025-09-14T20:59:26.723752] [INFO ] [MAIN ] SEG: Loaded 9710 primary data records. [2025-09-14T20:59:26.938495] [DEBUG] [LOCAL ] SEI: Loaded 36952 existing records from primary storage. [2025-09-14T20:59:26.958351] [INFO ] [MAIN ] SEI: Loaded 36952 primary data records. [2025-09-14T20:59:26.959031] [DEBUG] [LOCAL ] SEM: Loaded 32787 existing records from primary storage. [2025-09-14T20:59:27.062501] [INFO ] [MAIN ] SEM: Loaded 32787 primary data records. [2025-09-14T20:59:27.695314] [DEBUG] [MAIN ] SEG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:27.696872] [INFO ] [MAIN ] SEG: Generated 1352 derivative records from 9710 primary records. [2025-09-14T20:59:27.697336] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-14T20:59:27.714028] [DEBUG] [LOCAL ] SEG: Derivative data saved (1352 records). [2025-09-14T20:59:27.715414] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-14T20:59:27.717138] [INFO ] [MAIN ] Derivative Progress: 1771/2226 symbols completed. SEG took 1.0s. Estimated remaining: 2m 40s. Rate: 170.7 symbols/min [2025-09-14T20:59:27.719685] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:27.732157] [DEBUG] [MAIN ] SEI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:27.733046] [INFO ] [MAIN ] SEI: Generated 1352 derivative records from 36952 primary records. [2025-09-14T20:59:27.733157] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-14T20:59:27.748993] [DEBUG] [LOCAL ] SEI: Derivative data saved (1352 records). [2025-09-14T20:59:27.749414] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-14T20:59:27.761275] [INFO ] [MAIN ] Derivative Progress: 1772/2226 symbols completed. SEI took 1.1s. Estimated remaining: 2m 39s. Rate: 170.8 symbols/min [2025-09-14T20:59:27.762120] [DEBUG] [MAIN ] SEM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:27.762380] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:27.764045] [INFO ] [MAIN ] SEM: Generated 1352 derivative records from 32787 primary records. [2025-09-14T20:59:27.764126] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-14T20:59:27.786393] [DEBUG] [LOCAL ] SEM: Derivative data saved (1352 records). [2025-09-14T20:59:27.786718] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-14T20:59:27.788333] [INFO ] [MAIN ] Derivative Progress: 1773/2226 symbols completed. SEM took 1.1s. Estimated remaining: 2m 39s. Rate: 170.9 symbols/min [2025-09-14T20:59:27.789302] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:27.800061] [DEBUG] [LOCAL ] SEMR: Loaded 31104 existing records from primary storage. [2025-09-14T20:59:27.800242] [INFO ] [MAIN ] SEMR: Loaded 31104 primary data records. [2025-09-14T20:59:27.985242] [DEBUG] [LOCAL ] SES: Loaded 38498 existing records from primary storage. [2025-09-14T20:59:28.002189] [INFO ] [MAIN ] SES: Loaded 38498 primary data records. [2025-09-14T20:59:28.099796] [DEBUG] [LOCAL ] SF: Loaded 30808 existing records from primary storage. [2025-09-14T20:59:28.215064] [INFO ] [MAIN ] SF: Loaded 30808 primary data records. [2025-09-14T20:59:28.702772] [DEBUG] [MAIN ] SEMR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:28.704872] [INFO ] [MAIN ] SEMR: Generated 1352 derivative records from 31104 primary records. [2025-09-14T20:59:28.707051] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-14T20:59:28.729555] [DEBUG] [MAIN ] SES: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:28.734190] [INFO ] [MAIN ] SES: Generated 1352 derivative records from 38498 primary records. [2025-09-14T20:59:28.737702] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-14T20:59:28.737573] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1352 records). [2025-09-14T20:59:28.739453] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-14T20:59:28.742210] [INFO ] [MAIN ] Derivative Progress: 1774/2226 symbols completed. SEMR took 1.0s. Estimated remaining: 2m 39s. Rate: 170.7 symbols/min [2025-09-14T20:59:28.765117] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:28.766455] [DEBUG] [MAIN ] SF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:28.768328] [INFO ] [MAIN ] SF: Generated 1352 derivative records from 30808 primary records. [2025-09-14T20:59:28.769520] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-14T20:59:28.769452] [DEBUG] [LOCAL ] SES: Derivative data saved (1352 records). [2025-09-14T20:59:28.770579] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-14T20:59:28.773554] [INFO ] [MAIN ] Derivative Progress: 1775/2226 symbols completed. SES took 1.0s. Estimated remaining: 2m 38s. Rate: 170.8 symbols/min [2025-09-14T20:59:28.780771] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:28.785562] [DEBUG] [LOCAL ] SFB: Loaded 2633 existing records from primary storage. [2025-09-14T20:59:28.786574] [INFO ] [MAIN ] SFB: Loaded 2633 primary data records. [2025-09-14T20:59:28.837005] [DEBUG] [LOCAL ] SF: Derivative data saved (1352 records). [2025-09-14T20:59:28.862981] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-14T20:59:28.905055] [INFO ] [MAIN ] Derivative Progress: 1776/2226 symbols completed. SF took 1.1s. Estimated remaining: 2m 38s. Rate: 170.9 symbols/min [2025-09-14T20:59:28.926702] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:28.953574] [DEBUG] [LOCAL ] SFBS: Loaded 15651 existing records from primary storage. [2025-09-14T20:59:28.991602] [INFO ] [MAIN ] SFBS: Loaded 15651 primary data records. [2025-09-14T20:59:29.421201] [DEBUG] [LOCAL ] SFL: Loaded 33415 existing records from primary storage. [2025-09-14T20:59:29.433602] [INFO ] [MAIN ] SFL: Loaded 33415 primary data records. [2025-09-14T20:59:29.565884] [DEBUG] [MAIN ] SFB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:29.567784] [INFO ] [MAIN ] SFB: Generated 1352 derivative records from 2633 primary records. [2025-09-14T20:59:29.578957] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-14T20:59:29.658212] [DEBUG] [LOCAL ] SFB: Derivative data saved (1352 records). [2025-09-14T20:59:29.748265] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-14T20:59:29.752081] [INFO ] [MAIN ] Derivative Progress: 1777/2226 symbols completed. SFB took 1.0s. Estimated remaining: 2m 38s. Rate: 170.7 symbols/min [2025-09-14T20:59:29.764075] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:29.764371] [DEBUG] [MAIN ] SFBS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:29.765243] [INFO ] [MAIN ] SFBS: Generated 1352 derivative records from 15651 primary records. [2025-09-14T20:59:29.766024] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-14T20:59:29.782983] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1352 records). [2025-09-14T20:59:29.783411] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-14T20:59:29.785685] [INFO ] [MAIN ] Derivative Progress: 1778/2226 symbols completed. SFBS took 1.0s. Estimated remaining: 2m 37s. Rate: 170.8 symbols/min [2025-09-14T20:59:29.786355] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:29.813952] [DEBUG] [MAIN ] SFL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:29.814790] [INFO ] [MAIN ] SFL: Generated 1352 derivative records from 33415 primary records. [2025-09-14T20:59:29.814949] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-14T20:59:29.828584] [DEBUG] [LOCAL ] SFL: Derivative data saved (1352 records). [2025-09-14T20:59:29.836375] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-14T20:59:29.850984] [INFO ] [MAIN ] Derivative Progress: 1779/2226 symbols completed. SFL took 0.9s. Estimated remaining: 2m 37s. Rate: 170.9 symbols/min [2025-09-14T20:59:29.851469] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:29.852678] [DEBUG] [LOCAL ] SG: Loaded 40295 existing records from primary storage. [2025-09-14T20:59:29.853401] [INFO ] [MAIN ] SG: Loaded 40295 primary data records. [2025-09-14T20:59:29.987044] [DEBUG] [LOCAL ] SGHC: Loaded 34823 existing records from primary storage. [2025-09-14T20:59:29.991435] [INFO ] [MAIN ] SGHC: Loaded 34823 primary data records. [2025-09-14T20:59:29.991266] [DEBUG] [LOCAL ] SGU: Loaded 5139 existing records from primary storage. [2025-09-14T20:59:30.009287] [INFO ] [MAIN ] SGU: Loaded 5139 primary data records. [2025-09-14T20:59:30.784823] [DEBUG] [MAIN ] SG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:30.786703] [INFO ] [MAIN ] SG: Generated 1352 derivative records from 40295 primary records. [2025-09-14T20:59:30.787271] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-14T20:59:30.822871] [DEBUG] [MAIN ] SGU: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T20:59:30.828550] [INFO ] [MAIN ] SGU: Generated 1350 derivative records from 5139 primary records. [2025-09-14T20:59:30.828943] [DEBUG] [MAIN ] SGHC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:30.827371] [DEBUG] [LOCAL ] SG: Derivative data saved (1352 records). [2025-09-14T20:59:30.829218] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-14T20:59:30.829752] [INFO ] [MAIN ] SGHC: Generated 1352 derivative records from 34823 primary records. [2025-09-14T20:59:30.829892] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-14T20:59:30.830769] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-14T20:59:30.832687] [INFO ] [MAIN ] Derivative Progress: 1780/2226 symbols completed. SG took 1.1s. Estimated remaining: 2m 37s. Rate: 170.7 symbols/min [2025-09-14T20:59:30.852584] [DEBUG] [LOCAL ] SGU: Derivative data saved (1350 records). [2025-09-14T20:59:30.843856] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:30.853034] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-14T20:59:30.856054] [INFO ] [MAIN ] Derivative Progress: 1781/2226 symbols completed. SGU took 1.0s. Estimated remaining: 2m 36s. Rate: 170.8 symbols/min [2025-09-14T20:59:30.858510] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:30.865505] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1352 records). [2025-09-14T20:59:30.865795] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-14T20:59:30.868244] [INFO ] [MAIN ] Derivative Progress: 1782/2226 symbols completed. SGHC took 1.1s. Estimated remaining: 2m 36s. Rate: 170.9 symbols/min [2025-09-14T20:59:30.873603] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:30.883123] [DEBUG] [LOCAL ] SHCO: Loaded 18424 existing records from primary storage. [2025-09-14T20:59:30.883300] [INFO ] [MAIN ] SHCO: Loaded 18424 primary data records. [2025-09-14T20:59:31.070632] [DEBUG] [LOCAL ] SHAK: Loaded 36751 existing records from primary storage. [2025-09-14T20:59:31.097445] [INFO ] [MAIN ] SHAK: Loaded 36751 primary data records. [2025-09-14T20:59:31.288309] [DEBUG] [LOCAL ] SHEL: Loaded 40417 existing records from primary storage. [2025-09-14T20:59:31.306487] [INFO ] [MAIN ] SHEL: Loaded 40417 primary data records. [2025-09-14T20:59:31.728169] [DEBUG] [MAIN ] SHCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:31.822895] [INFO ] [MAIN ] SHCO: Generated 1352 derivative records from 18424 primary records. [2025-09-14T20:59:31.825006] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-14T20:59:31.841317] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1352 records). [2025-09-14T20:59:31.842402] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-14T20:59:31.845794] [INFO ] [MAIN ] Derivative Progress: 1783/2226 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 36s. Rate: 170.7 symbols/min [2025-09-14T20:59:31.860845] [DEBUG] [MAIN ] SHAK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:31.861670] [INFO ] [MAIN ] SHAK: Generated 1352 derivative records from 36751 primary records. [2025-09-14T20:59:31.861834] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-14T20:59:31.875657] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1352 records). [2025-09-14T20:59:31.876436] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-14T20:59:31.879472] [INFO ] [MAIN ] Derivative Progress: 1784/2226 symbols completed. SHAK took 1.0s. Estimated remaining: 2m 35s. Rate: 170.8 symbols/min [2025-09-14T20:59:31.890936] [DEBUG] [MAIN ] SHEL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:31.891715] [INFO ] [MAIN ] SHEL: Generated 1352 derivative records from 40417 primary records. [2025-09-14T20:59:31.891814] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-14T20:59:31.904350] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1352 records). [2025-09-14T20:59:31.904551] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-14T20:59:31.906551] [INFO ] [MAIN ] Derivative Progress: 1785/2226 symbols completed. SHEL took 1.0s. Estimated remaining: 2m 35s. Rate: 170.9 symbols/min [2025-09-14T20:59:31.907336] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:31.907601] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:31.907482] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:31.915032] [DEBUG] [LOCAL ] SHOC: Loaded 2100 existing records from primary storage. [2025-09-14T20:59:31.915211] [INFO ] [MAIN ] SHOC: Loaded 2100 primary data records. [2025-09-14T20:59:32.039360] [DEBUG] [LOCAL ] SHG: Loaded 19301 existing records from primary storage. [2025-09-14T20:59:32.039948] [INFO ] [MAIN ] SHG: Loaded 19301 primary data records. [2025-09-14T20:59:32.405316] [DEBUG] [LOCAL ] SHO: Loaded 37266 existing records from primary storage. [2025-09-14T20:59:32.465940] [INFO ] [MAIN ] SHO: Loaded 37266 primary data records. [2025-09-14T20:59:32.880374] [DEBUG] [MAIN ] SHOC: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:59:32.882806] [INFO ] [MAIN ] SHOC: Generated 1351 derivative records from 2100 primary records. [2025-09-14T20:59:32.885735] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-14T20:59:32.910076] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1351 records). [2025-09-14T20:59:32.910746] [DEBUG] [MAIN ] SHG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:32.912557] [INFO ] [MAIN ] SHG: Generated 1352 derivative records from 19301 primary records. [2025-09-14T20:59:32.911319] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-14T20:59:32.912750] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-14T20:59:32.914914] [INFO ] [MAIN ] Derivative Progress: 1786/2226 symbols completed. SHOC took 1.0s. Estimated remaining: 2m 35s. Rate: 170.7 symbols/min [2025-09-14T20:59:32.916629] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:32.931099] [DEBUG] [LOCAL ] SHG: Derivative data saved (1352 records). [2025-09-14T20:59:32.931422] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-14T20:59:32.934111] [INFO ] [MAIN ] Derivative Progress: 1787/2226 symbols completed. SHG took 1.0s. Estimated remaining: 2m 34s. Rate: 170.8 symbols/min [2025-09-14T20:59:32.934610] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:32.951451] [DEBUG] [MAIN ] SHO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:32.952261] [INFO ] [MAIN ] SHO: Generated 1352 derivative records from 37266 primary records. [2025-09-14T20:59:32.952536] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-14T20:59:32.978088] [DEBUG] [LOCAL ] SHO: Derivative data saved (1352 records). [2025-09-14T20:59:32.985925] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-14T20:59:32.987984] [INFO ] [MAIN ] Derivative Progress: 1788/2226 symbols completed. SHO took 1.1s. Estimated remaining: 2m 34s. Rate: 170.9 symbols/min [2025-09-14T20:59:32.988574] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:33.014416] [DEBUG] [LOCAL ] SID: Loaded 31896 existing records from primary storage. [2025-09-14T20:59:33.015199] [DEBUG] [LOCAL ] SHW: Loaded 37713 existing records from primary storage. [2025-09-14T20:59:33.015506] [INFO ] [MAIN ] SID: Loaded 31896 primary data records. [2025-09-14T20:59:33.015750] [INFO ] [MAIN ] SHW: Loaded 37713 primary data records. [2025-09-14T20:59:33.696630] [DEBUG] [LOCAL ] SIG: Loaded 34498 existing records from primary storage. [2025-09-14T20:59:33.697552] [INFO ] [MAIN ] SIG: Loaded 34498 primary data records. [2025-09-14T20:59:34.130927] [DEBUG] [MAIN ] SID: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:34.132893] [INFO ] [MAIN ] SID: Generated 1352 derivative records from 31896 primary records. [2025-09-14T20:59:34.137672] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-14T20:59:34.162248] [DEBUG] [MAIN ] SHW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:34.170005] [INFO ] [MAIN ] SHW: Generated 1352 derivative records from 37713 primary records. [2025-09-14T20:59:34.174406] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-14T20:59:34.175063] [DEBUG] [LOCAL ] SID: Derivative data saved (1352 records). [2025-09-14T20:59:34.192130] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-14T20:59:34.202576] [DEBUG] [LOCAL ] SHW: Derivative data saved (1352 records). [2025-09-14T20:59:34.203335] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-14T20:59:34.200718] [INFO ] [MAIN ] Derivative Progress: 1789/2226 symbols completed. SID took 1.3s. Estimated remaining: 2m 34s. Rate: 170.7 symbols/min [2025-09-14T20:59:34.208304] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:34.208417] [INFO ] [MAIN ] Derivative Progress: 1790/2226 symbols completed. SHW took 1.3s. Estimated remaining: 2m 33s. Rate: 170.8 symbols/min [2025-09-14T20:59:34.210988] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:34.227513] [DEBUG] [MAIN ] SIG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:34.228594] [INFO ] [MAIN ] SIG: Generated 1352 derivative records from 34498 primary records. [2025-09-14T20:59:34.228977] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-14T20:59:34.268142] [DEBUG] [LOCAL ] SII: Loaded 17573 existing records from primary storage. [2025-09-14T20:59:34.269427] [INFO ] [MAIN ] SII: Loaded 17573 primary data records. [2025-09-14T20:59:34.273770] [DEBUG] [LOCAL ] SIG: Derivative data saved (1352 records). [2025-09-14T20:59:34.309130] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-14T20:59:34.341990] [INFO ] [MAIN ] Derivative Progress: 1791/2226 symbols completed. SIG took 1.4s. Estimated remaining: 2m 33s. Rate: 170.8 symbols/min [2025-09-14T20:59:34.392272] [DEBUG] [LOCAL ] SILA: Loaded 23103 existing records from primary storage. [2025-09-14T20:59:34.379617] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:34.409435] [INFO ] [MAIN ] SILA: Loaded 23103 primary data records. [2025-09-14T20:59:35.039998] [DEBUG] [LOCAL ] SITC: Loaded 30807 existing records from primary storage. [2025-09-14T20:59:35.041548] [INFO ] [MAIN ] SITC: Loaded 30807 primary data records. [2025-09-14T20:59:35.351118] [DEBUG] [MAIN ] SII: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:35.354589] [INFO ] [MAIN ] SII: Generated 1352 derivative records from 17573 primary records. [2025-09-14T20:59:35.354855] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-14T20:59:35.366300] [DEBUG] [MAIN ] SILA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:35.373606] [INFO ] [MAIN ] SILA: Generated 1352 derivative records from 23103 primary records. [2025-09-14T20:59:35.376666] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-14T20:59:35.388025] [DEBUG] [LOCAL ] SII: Derivative data saved (1352 records). [2025-09-14T20:59:35.390217] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-14T20:59:35.395321] [INFO ] [MAIN ] Derivative Progress: 1792/2226 symbols completed. SII took 1.2s. Estimated remaining: 2m 33s. Rate: 170.6 symbols/min [2025-09-14T20:59:35.393502] [DEBUG] [LOCAL ] SILA: Derivative data saved (1352 records). [2025-09-14T20:59:35.395779] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-14T20:59:35.398192] [INFO ] [MAIN ] Derivative Progress: 1793/2226 symbols completed. SILA took 1.2s. Estimated remaining: 2m 32s. Rate: 170.7 symbols/min [2025-09-14T20:59:35.395724] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:35.398675] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:35.413589] [DEBUG] [MAIN ] SITC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:35.414613] [INFO ] [MAIN ] SITC: Generated 1352 derivative records from 30807 primary records. [2025-09-14T20:59:35.414796] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-14T20:59:35.436806] [DEBUG] [LOCAL ] SITC: Derivative data saved (1352 records). [2025-09-14T20:59:35.437113] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-14T20:59:35.439129] [INFO ] [MAIN ] Derivative Progress: 1794/2226 symbols completed. SITC took 1.1s. Estimated remaining: 2m 32s. Rate: 170.8 symbols/min [2025-09-14T20:59:35.439596] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:35.466046] [DEBUG] [LOCAL ] SITE: Loaded 26142 existing records from primary storage. [2025-09-14T20:59:35.466426] [INFO ] [MAIN ] SITE: Loaded 26142 primary data records. [2025-09-14T20:59:35.578593] [DEBUG] [LOCAL ] SJT: Loaded 16927 existing records from primary storage. [2025-09-14T20:59:35.600313] [INFO ] [MAIN ] SJT: Loaded 16927 primary data records. [2025-09-14T20:59:35.611289] [DEBUG] [LOCAL ] SJM: Loaded 37734 existing records from primary storage. [2025-09-14T20:59:35.649436] [INFO ] [MAIN ] SJM: Loaded 37734 primary data records. [2025-09-14T20:59:36.349750] [DEBUG] [MAIN ] SITE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:36.351482] [INFO ] [MAIN ] SITE: Generated 1352 derivative records from 26142 primary records. [2025-09-14T20:59:36.351618] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-14T20:59:36.369211] [DEBUG] [LOCAL ] SITE: Derivative data saved (1352 records). [2025-09-14T20:59:36.384871] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-14T20:59:36.387475] [INFO ] [MAIN ] Derivative Progress: 1795/2226 symbols completed. SITE took 1.0s. Estimated remaining: 2m 32s. Rate: 170.6 symbols/min [2025-09-14T20:59:36.388972] [DEBUG] [MAIN ] SJT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:36.391937] [INFO ] [MAIN ] SJT: Generated 1352 derivative records from 16927 primary records. [2025-09-14T20:59:36.390908] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:36.392258] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-14T20:59:36.411409] [DEBUG] [MAIN ] SJM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:36.416751] [INFO ] [MAIN ] SJM: Generated 1352 derivative records from 37734 primary records. [2025-09-14T20:59:36.418229] [DEBUG] [LOCAL ] SJT: Derivative data saved (1352 records). [2025-09-14T20:59:36.418447] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-14T20:59:36.419462] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-14T20:59:36.422727] [INFO ] [MAIN ] Derivative Progress: 1796/2226 symbols completed. SJT took 1.0s. Estimated remaining: 2m 31s. Rate: 170.7 symbols/min [2025-09-14T20:59:36.433927] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:36.444533] [DEBUG] [LOCAL ] SJM: Derivative data saved (1352 records). [2025-09-14T20:59:36.445954] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-14T20:59:36.448137] [INFO ] [MAIN ] Derivative Progress: 1797/2226 symbols completed. SJM took 1.0s. Estimated remaining: 2m 31s. Rate: 170.8 symbols/min [2025-09-14T20:59:36.448556] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:36.452340] [DEBUG] [LOCAL ] SKIL: Loaded 4455 existing records from primary storage. [2025-09-14T20:59:36.452668] [INFO ] [MAIN ] SKIL: Loaded 4455 primary data records. [2025-09-14T20:59:36.573821] [DEBUG] [LOCAL ] SKLZ: Loaded 8626 existing records from primary storage. [2025-09-14T20:59:36.574729] [DEBUG] [LOCAL ] SKE: Loaded 26035 existing records from primary storage. [2025-09-14T20:59:36.575024] [INFO ] [MAIN ] SKE: Loaded 26035 primary data records. [2025-09-14T20:59:36.575454] [INFO ] [MAIN ] SKLZ: Loaded 8626 primary data records. [2025-09-14T20:59:37.375565] [DEBUG] [MAIN ] SKIL: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T20:59:37.376877] [INFO ] [MAIN ] SKIL: Generated 1351 derivative records from 4455 primary records. [2025-09-14T20:59:37.377266] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-14T20:59:37.392200] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1351 records). [2025-09-14T20:59:37.415212] [DEBUG] [MAIN ] SKLZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:37.404825] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-14T20:59:37.417695] [INFO ] [MAIN ] Derivative Progress: 1798/2226 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 30s. Rate: 170.7 symbols/min [2025-09-14T20:59:37.415799] [DEBUG] [MAIN ] SKE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:37.418542] [INFO ] [MAIN ] SKLZ: Generated 1352 derivative records from 8626 primary records. [2025-09-14T20:59:37.419300] [INFO ] [MAIN ] SKE: Generated 1352 derivative records from 26035 primary records. [2025-09-14T20:59:37.419454] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-14T20:59:37.420250] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-14T20:59:37.443965] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1352 records). [2025-09-14T20:59:37.444168] [DEBUG] [LOCAL ] SKE: Derivative data saved (1352 records). [2025-09-14T20:59:37.444302] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-14T20:59:37.444351] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-14T20:59:37.446126] [INFO ] [MAIN ] Derivative Progress: 1799/2226 symbols completed. SKLZ took 1.0s. Estimated remaining: 2m 30s. Rate: 170.7 symbols/min [2025-09-14T20:59:37.448830] [INFO ] [MAIN ] Derivative Progress: 1800/2226 symbols completed. SKE took 1.1s. Estimated remaining: 2m 30s. Rate: 170.8 symbols/min [2025-09-14T20:59:37.449227] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:37.449351] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:37.449396] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:37.491456] [DEBUG] [LOCAL ] SKM: Loaded 26547 existing records from primary storage. [2025-09-14T20:59:37.501440] [INFO ] [MAIN ] SKM: Loaded 26547 primary data records. [2025-09-14T20:59:37.510166] [DEBUG] [LOCAL ] SKT: Loaded 31692 existing records from primary storage. [2025-09-14T20:59:37.515833] [DEBUG] [LOCAL ] SKY: Loaded 28735 existing records from primary storage. [2025-09-14T20:59:37.553199] [INFO ] [MAIN ] SKT: Loaded 31692 primary data records. [2025-09-14T20:59:37.563579] [INFO ] [MAIN ] SKY: Loaded 28735 primary data records. [2025-09-14T20:59:38.392737] [DEBUG] [MAIN ] SKT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:38.393740] [INFO ] [MAIN ] SKT: Generated 1352 derivative records from 31692 primary records. [2025-09-14T20:59:38.394215] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-14T20:59:38.410911] [DEBUG] [LOCAL ] SKT: Derivative data saved (1352 records). [2025-09-14T20:59:38.411838] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-14T20:59:38.413705] [INFO ] [MAIN ] Derivative Progress: 1801/2226 symbols completed. SKT took 1.0s. Estimated remaining: 2m 29s. Rate: 170.7 symbols/min [2025-09-14T20:59:38.414022] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:38.434299] [DEBUG] [MAIN ] SKM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:38.433590] [DEBUG] [MAIN ] SKY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:38.435097] [INFO ] [MAIN ] SKY: Generated 1352 derivative records from 28735 primary records. [2025-09-14T20:59:38.436030] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-14T20:59:38.435874] [INFO ] [MAIN ] SKM: Generated 1352 derivative records from 26547 primary records. [2025-09-14T20:59:38.436818] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-14T20:59:38.461939] [DEBUG] [LOCAL ] SKM: Derivative data saved (1352 records). [2025-09-14T20:59:38.463806] [DEBUG] [LOCAL ] SKY: Derivative data saved (1352 records). [2025-09-14T20:59:38.463967] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-14T20:59:38.464070] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-14T20:59:38.466500] [INFO ] [MAIN ] Derivative Progress: 1802/2226 symbols completed. SKM took 1.0s. Estimated remaining: 2m 29s. Rate: 170.8 symbols/min [2025-09-14T20:59:38.468875] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:38.468693] [INFO ] [MAIN ] Derivative Progress: 1803/2226 symbols completed. SKY took 1.0s. Estimated remaining: 2m 29s. Rate: 170.8 symbols/min [2025-09-14T20:59:38.473999] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:38.474255] [DEBUG] [LOCAL ] SKYH: Loaded 11692 existing records from primary storage. [2025-09-14T20:59:38.474782] [INFO ] [MAIN ] SKYH: Loaded 11692 primary data records. [2025-09-14T20:59:38.817772] [DEBUG] [LOCAL ] SLF: Loaded 29232 existing records from primary storage. [2025-09-14T20:59:38.829312] [INFO ] [MAIN ] SLF: Loaded 29232 primary data records. [2025-09-14T20:59:38.863944] [DEBUG] [LOCAL ] SLB: Loaded 40437 existing records from primary storage. [2025-09-14T20:59:38.913467] [INFO ] [MAIN ] SLB: Loaded 40437 primary data records. [2025-09-14T20:59:39.408543] [DEBUG] [MAIN ] SKYH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:39.410046] [INFO ] [MAIN ] SKYH: Generated 1352 derivative records from 11692 primary records. [2025-09-14T20:59:39.410236] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-14T20:59:39.426949] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1352 records). [2025-09-14T20:59:39.427728] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-14T20:59:39.430278] [INFO ] [MAIN ] Derivative Progress: 1804/2226 symbols completed. SKYH took 1.0s. Estimated remaining: 2m 28s. Rate: 170.7 symbols/min [2025-09-14T20:59:39.430730] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:39.446967] [DEBUG] [MAIN ] SLF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:39.448108] [INFO ] [MAIN ] SLF: Generated 1352 derivative records from 29232 primary records. [2025-09-14T20:59:39.448397] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-14T20:59:39.463298] [DEBUG] [LOCAL ] SLF: Derivative data saved (1352 records). [2025-09-14T20:59:39.464746] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-14T20:59:39.468479] [INFO ] [MAIN ] Derivative Progress: 1805/2226 symbols completed. SLF took 1.0s. Estimated remaining: 2m 28s. Rate: 170.8 symbols/min [2025-09-14T20:59:39.483839] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:39.488969] [DEBUG] [MAIN ] SLB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:39.490402] [INFO ] [MAIN ] SLB: Generated 1352 derivative records from 40437 primary records. [2025-09-14T20:59:39.490616] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-14T20:59:39.504423] [DEBUG] [LOCAL ] SLB: Derivative data saved (1352 records). [2025-09-14T20:59:39.522956] [DEBUG] [LOCAL ] SLG: Loaded 34484 existing records from primary storage. [2025-09-14T20:59:39.521655] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-14T20:59:39.525181] [INFO ] [MAIN ] Derivative Progress: 1806/2226 symbols completed. SLB took 1.1s. Estimated remaining: 2m 28s. Rate: 170.8 symbols/min [2025-09-14T20:59:39.525520] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:39.525672] [INFO ] [MAIN ] SLG: Loaded 34484 primary data records. [2025-09-14T20:59:39.758200] [DEBUG] [LOCAL ] SLGN: Loaded 29671 existing records from primary storage. [2025-09-14T20:59:39.883588] [INFO ] [MAIN ] SLGN: Loaded 29671 primary data records. [2025-09-14T20:59:39.897121] [DEBUG] [LOCAL ] SLQT: Loaded 33229 existing records from primary storage. [2025-09-14T20:59:39.935708] [INFO ] [MAIN ] SLQT: Loaded 33229 primary data records. [2025-09-14T20:59:40.476979] [DEBUG] [MAIN ] SLG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:40.478365] [INFO ] [MAIN ] SLG: Generated 1352 derivative records from 34484 primary records. [2025-09-14T20:59:40.479505] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-14T20:59:40.494187] [DEBUG] [LOCAL ] SLG: Derivative data saved (1352 records). [2025-09-14T20:59:40.494376] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-14T20:59:40.496690] [INFO ] [MAIN ] Derivative Progress: 1807/2226 symbols completed. SLG took 1.1s. Estimated remaining: 2m 27s. Rate: 170.7 symbols/min [2025-09-14T20:59:40.497679] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:40.521177] [DEBUG] [MAIN ] SLGN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:40.522364] [INFO ] [MAIN ] SLGN: Generated 1352 derivative records from 29671 primary records. [2025-09-14T20:59:40.522689] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-14T20:59:40.554402] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1352 records). [2025-09-14T20:59:40.553662] [DEBUG] [MAIN ] SLQT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:40.554583] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-14T20:59:40.557585] [INFO ] [MAIN ] Derivative Progress: 1808/2226 symbols completed. SLGN took 1.1s. Estimated remaining: 2m 27s. Rate: 170.8 symbols/min [2025-09-14T20:59:40.555109] [DEBUG] [LOCAL ] SLVM: Loaded 20614 existing records from primary storage. [2025-09-14T20:59:40.555839] [INFO ] [MAIN ] SLQT: Generated 1352 derivative records from 33229 primary records. [2025-09-14T20:59:40.557920] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:40.558048] [INFO ] [MAIN ] SLVM: Loaded 20614 primary data records. [2025-09-14T20:59:40.558138] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-14T20:59:40.632678] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1352 records). [2025-09-14T20:59:40.679578] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-14T20:59:40.777313] [INFO ] [MAIN ] Derivative Progress: 1809/2226 symbols completed. SLQT took 1.3s. Estimated remaining: 2m 26s. Rate: 170.8 symbols/min [2025-09-14T20:59:40.781883] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:40.868882] [DEBUG] [LOCAL ] SM: Loaded 39255 existing records from primary storage. [2025-09-14T20:59:40.869505] [INFO ] [MAIN ] SM: Loaded 39255 primary data records. [2025-09-14T20:59:40.982798] [DEBUG] [LOCAL ] SMBK: Loaded 6091 existing records from primary storage. [2025-09-14T20:59:41.032518] [INFO ] [MAIN ] SMBK: Loaded 6091 primary data records. [2025-09-14T20:59:41.438442] [DEBUG] [MAIN ] SLVM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:41.440250] [INFO ] [MAIN ] SLVM: Generated 1352 derivative records from 20614 primary records. [2025-09-14T20:59:41.440747] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-14T20:59:41.455886] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1352 records). [2025-09-14T20:59:41.456721] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-14T20:59:41.458730] [INFO ] [MAIN ] Derivative Progress: 1810/2226 symbols completed. SLVM took 1.0s. Estimated remaining: 2m 26s. Rate: 170.7 symbols/min [2025-09-14T20:59:41.460655] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:41.473157] [DEBUG] [MAIN ] SM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:41.474097] [INFO ] [MAIN ] SM: Generated 1352 derivative records from 39255 primary records. [2025-09-14T20:59:41.476700] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-14T20:59:41.490237] [DEBUG] [LOCAL ] SMC: Loaded 7971 existing records from primary storage. [2025-09-14T20:59:41.490370] [INFO ] [MAIN ] SMC: Loaded 7971 primary data records. [2025-09-14T20:59:41.505495] [DEBUG] [LOCAL ] SM: Derivative data saved (1352 records). [2025-09-14T20:59:41.525737] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-14T20:59:41.541561] [INFO ] [MAIN ] Derivative Progress: 1811/2226 symbols completed. SM took 1.0s. Estimated remaining: 2m 26s. Rate: 170.8 symbols/min [2025-09-14T20:59:41.568522] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:41.630850] [DEBUG] [MAIN ] SMBK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:41.673805] [INFO ] [MAIN ] SMBK: Generated 1352 derivative records from 6091 primary records. [2025-09-14T20:59:41.784674] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-14T20:59:41.808441] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1352 records). [2025-09-14T20:59:41.809740] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-14T20:59:41.812095] [INFO ] [MAIN ] Derivative Progress: 1812/2226 symbols completed. SMBK took 1.0s. Estimated remaining: 2m 25s. Rate: 170.8 symbols/min [2025-09-14T20:59:41.813377] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:41.827384] [DEBUG] [LOCAL ] SMFG: Loaded 36185 existing records from primary storage. [2025-09-14T20:59:41.827800] [INFO ] [MAIN ] SMFG: Loaded 36185 primary data records. [2025-09-14T20:59:42.057117] [DEBUG] [LOCAL ] SMG: Loaded 32743 existing records from primary storage. [2025-09-14T20:59:42.061575] [INFO ] [MAIN ] SMG: Loaded 32743 primary data records. [2025-09-14T20:59:42.061489] [DEBUG] [MAIN ] SMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:42.203467] [INFO ] [MAIN ] SMC: Generated 1352 derivative records from 7971 primary records. [2025-09-14T20:59:42.221366] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-14T20:59:42.369983] [DEBUG] [LOCAL ] SMC: Derivative data saved (1352 records). [2025-09-14T20:59:42.398016] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-14T20:59:42.433837] [INFO ] [MAIN ] Derivative Progress: 1813/2226 symbols completed. SMC took 1.0s. Estimated remaining: 2m 25s. Rate: 170.7 symbols/min [2025-09-14T20:59:42.541505] [DEBUG] [MAIN ] SMFG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:42.542577] [INFO ] [MAIN ] SMFG: Generated 1352 derivative records from 36185 primary records. [2025-09-14T20:59:42.542705] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-14T20:59:42.556552] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1352 records). [2025-09-14T20:59:42.556872] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-14T20:59:42.559192] [INFO ] [MAIN ] Derivative Progress: 1814/2226 symbols completed. SMFG took 1.0s. Estimated remaining: 2m 25s. Rate: 170.8 symbols/min [2025-09-14T20:59:42.573008] [DEBUG] [MAIN ] SMG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:42.573668] [INFO ] [MAIN ] SMG: Generated 1352 derivative records from 32743 primary records. [2025-09-14T20:59:42.573745] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-14T20:59:42.585349] [DEBUG] [LOCAL ] SMG: Derivative data saved (1352 records). [2025-09-14T20:59:42.585425] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-14T20:59:42.587218] [INFO ] [MAIN ] Derivative Progress: 1815/2226 symbols completed. SMG took 0.8s. Estimated remaining: 2m 24s. Rate: 170.9 symbols/min [2025-09-14T20:59:42.587618] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:42.587857] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:42.587763] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:42.603817] [DEBUG] [LOCAL ] SMHI: Loaded 9825 existing records from primary storage. [2025-09-14T20:59:42.603997] [INFO ] [MAIN ] SMHI: Loaded 9825 primary data records. [2025-09-14T20:59:42.684165] [DEBUG] [LOCAL ] SMP: Loaded 14146 existing records from primary storage. [2025-09-14T20:59:42.728626] [INFO ] [MAIN ] SMP: Loaded 14146 primary data records. [2025-09-14T20:59:42.904556] [DEBUG] [LOCAL ] SMR: Loaded 40540 existing records from primary storage. [2025-09-14T20:59:43.009216] [INFO ] [MAIN ] SMR: Loaded 40540 primary data records. [2025-09-14T20:59:43.491666] [DEBUG] [MAIN ] SMHI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:43.493799] [INFO ] [MAIN ] SMHI: Generated 1352 derivative records from 9825 primary records. [2025-09-14T20:59:43.496836] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-14T20:59:43.518809] [DEBUG] [MAIN ] SMP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:43.522728] [INFO ] [MAIN ] SMP: Generated 1352 derivative records from 14146 primary records. [2025-09-14T20:59:43.524699] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-14T20:59:43.521882] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1352 records). [2025-09-14T20:59:43.525322] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-14T20:59:43.528263] [INFO ] [MAIN ] Derivative Progress: 1816/2226 symbols completed. SMHI took 0.9s. Estimated remaining: 2m 24s. Rate: 170.7 symbols/min [2025-09-14T20:59:43.534682] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:43.550760] [DEBUG] [MAIN ] SMR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:43.554339] [DEBUG] [LOCAL ] SMP: Derivative data saved (1352 records). [2025-09-14T20:59:43.554635] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-14T20:59:43.555346] [INFO ] [MAIN ] SMR: Generated 1352 derivative records from 40540 primary records. [2025-09-14T20:59:43.558053] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-09-14T20:59:43.557797] [INFO ] [MAIN ] Derivative Progress: 1817/2226 symbols completed. SMP took 1.0s. Estimated remaining: 2m 24s. Rate: 170.8 symbols/min [2025-09-14T20:59:43.558930] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:43.572874] [DEBUG] [LOCAL ] SMR: Derivative data saved (1352 records). [2025-09-14T20:59:43.573411] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-14T20:59:43.575373] [INFO ] [MAIN ] Derivative Progress: 1818/2226 symbols completed. SMR took 1.0s. Estimated remaining: 2m 23s. Rate: 170.9 symbols/min [2025-09-14T20:59:43.585118] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:43.614447] [DEBUG] [LOCAL ] SMWB: Loaded 25149 existing records from primary storage. [2025-09-14T20:59:43.613916] [DEBUG] [LOCAL ] SMRT: Loaded 33340 existing records from primary storage. [2025-09-14T20:59:43.614627] [INFO ] [MAIN ] SMRT: Loaded 33340 primary data records. [2025-09-14T20:59:43.614721] [INFO ] [MAIN ] SMWB: Loaded 25149 primary data records. [2025-09-14T20:59:43.897018] [DEBUG] [LOCAL ] SN: Loaded 37572 existing records from primary storage. [2025-09-14T20:59:43.990395] [INFO ] [MAIN ] SN: Loaded 37572 primary data records. [2025-09-14T20:59:44.566417] [DEBUG] [MAIN ] SMRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:44.567854] [INFO ] [MAIN ] SMRT: Generated 1352 derivative records from 33340 primary records. [2025-09-14T20:59:44.568040] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-14T20:59:44.578849] [DEBUG] [MAIN ] SMWB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:44.580181] [INFO ] [MAIN ] SMWB: Generated 1352 derivative records from 25149 primary records. [2025-09-14T20:59:44.580563] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-14T20:59:44.602036] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1352 records). [2025-09-14T20:59:44.604978] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-14T20:59:44.605308] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1352 records). [2025-09-14T20:59:44.607302] [INFO ] [MAIN ] Derivative Progress: 1819/2226 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 23s. Rate: 170.7 symbols/min [2025-09-14T20:59:44.607633] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-14T20:59:44.607965] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:44.610524] [INFO ] [MAIN ] Derivative Progress: 1820/2226 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 23s. Rate: 170.8 symbols/min [2025-09-14T20:59:44.611537] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:44.626676] [DEBUG] [MAIN ] SN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:44.627618] [INFO ] [MAIN ] SN: Generated 1352 derivative records from 37572 primary records. [2025-09-14T20:59:44.627768] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-14T20:59:44.647598] [DEBUG] [LOCAL ] SN: Derivative data saved (1352 records). [2025-09-14T20:59:44.647840] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-14T20:59:44.650098] [INFO ] [MAIN ] Derivative Progress: 1821/2226 symbols completed. SN took 1.1s. Estimated remaining: 2m 22s. Rate: 170.9 symbols/min [2025-09-14T20:59:44.650916] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:44.659541] [DEBUG] [LOCAL ] SNA: Loaded 18915 existing records from primary storage. [2025-09-14T20:59:44.659924] [INFO ] [MAIN ] SNA: Loaded 18915 primary data records. [2025-09-14T20:59:44.759690] [DEBUG] [LOCAL ] SNDA: Loaded 3402 existing records from primary storage. [2025-09-14T20:59:44.801125] [INFO ] [MAIN ] SNDA: Loaded 3402 primary data records. [2025-09-14T20:59:45.017868] [DEBUG] [LOCAL ] SNAP: Loaded 40536 existing records from primary storage. [2025-09-14T20:59:45.124398] [INFO ] [MAIN ] SNAP: Loaded 40536 primary data records. [2025-09-14T20:59:45.598965] [DEBUG] [MAIN ] SNA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:45.601308] [INFO ] [MAIN ] SNA: Generated 1352 derivative records from 18915 primary records. [2025-09-14T20:59:45.601960] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-14T20:59:45.620786] [DEBUG] [LOCAL ] SNA: Derivative data saved (1352 records). [2025-09-14T20:59:45.621362] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-14T20:59:45.633367] [INFO ] [MAIN ] Derivative Progress: 1822/2226 symbols completed. SNA took 1.0s. Estimated remaining: 2m 22s. Rate: 170.7 symbols/min [2025-09-14T20:59:45.634198] [DEBUG] [MAIN ] SNDA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:45.634549] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:45.635458] [INFO ] [MAIN ] SNDA: Generated 1352 derivative records from 3402 primary records. [2025-09-14T20:59:45.635781] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-14T20:59:45.652352] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1352 records). [2025-09-14T20:59:45.652548] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-14T20:59:45.655425] [INFO ] [MAIN ] Derivative Progress: 1823/2226 symbols completed. SNDA took 1.0s. Estimated remaining: 2m 22s. Rate: 170.8 symbols/min [2025-09-14T20:59:45.661862] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:45.666974] [DEBUG] [MAIN ] SNAP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:45.667859] [INFO ] [MAIN ] SNAP: Generated 1352 derivative records from 40536 primary records. [2025-09-14T20:59:45.668049] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-14T20:59:45.681780] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1352 records). [2025-09-14T20:59:45.689714] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-14T20:59:45.691509] [INFO ] [MAIN ] Derivative Progress: 1824/2226 symbols completed. SNAP took 1.1s. Estimated remaining: 2m 21s. Rate: 170.9 symbols/min [2025-09-14T20:59:45.691978] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:45.708448] [DEBUG] [LOCAL ] SNDR: Loaded 30052 existing records from primary storage. [2025-09-14T20:59:45.715979] [INFO ] [MAIN ] SNDR: Loaded 30052 primary data records. [2025-09-14T20:59:45.841839] [DEBUG] [LOCAL ] SNN: Loaded 33604 existing records from primary storage. [2025-09-14T20:59:45.890632] [INFO ] [MAIN ] SNN: Loaded 33604 primary data records. [2025-09-14T20:59:46.056989] [DEBUG] [LOCAL ] SNOW: Loaded 40348 existing records from primary storage. [2025-09-14T20:59:46.087268] [INFO ] [MAIN ] SNOW: Loaded 40348 primary data records. [2025-09-14T20:59:46.598743] [DEBUG] [MAIN ] SNDR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:46.599811] [INFO ] [MAIN ] SNDR: Generated 1352 derivative records from 30052 primary records. [2025-09-14T20:59:46.600324] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-14T20:59:46.633682] [DEBUG] [MAIN ] SNN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:46.635194] [INFO ] [MAIN ] SNN: Generated 1352 derivative records from 33604 primary records. [2025-09-14T20:59:46.633275] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1352 records). [2025-09-14T20:59:46.635360] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-14T20:59:46.637897] [INFO ] [MAIN ] Derivative Progress: 1825/2226 symbols completed. SNDR took 1.0s. Estimated remaining: 2m 21s. Rate: 170.7 symbols/min [2025-09-14T20:59:46.635411] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-14T20:59:46.639401] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:46.660069] [DEBUG] [MAIN ] SNOW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:46.665971] [INFO ] [MAIN ] SNOW: Generated 1352 derivative records from 40348 primary records. [2025-09-14T20:59:46.667446] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-14T20:59:46.667807] [DEBUG] [LOCAL ] SNN: Derivative data saved (1352 records). [2025-09-14T20:59:46.668912] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-14T20:59:46.671212] [INFO ] [MAIN ] Derivative Progress: 1826/2226 symbols completed. SNN took 1.0s. Estimated remaining: 2m 21s. Rate: 170.8 symbols/min [2025-09-14T20:59:46.671934] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:46.697186] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1352 records). [2025-09-14T20:59:46.697415] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-14T20:59:46.699752] [INFO ] [MAIN ] Derivative Progress: 1827/2226 symbols completed. SNOW took 1.0s. Estimated remaining: 2m 20s. Rate: 170.9 symbols/min [2025-09-14T20:59:46.701026] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:46.712945] [DEBUG] [LOCAL ] SNV: Loaded 36219 existing records from primary storage. [2025-09-14T20:59:46.713215] [INFO ] [MAIN ] SNV: Loaded 36219 primary data records. [2025-09-14T20:59:46.909773] [DEBUG] [LOCAL ] SNX: Loaded 28354 existing records from primary storage. [2025-09-14T20:59:46.932109] [INFO ] [MAIN ] SNX: Loaded 28354 primary data records. [2025-09-14T20:59:47.134413] [DEBUG] [LOCAL ] SO: Loaded 40357 existing records from primary storage. [2025-09-14T20:59:47.167445] [INFO ] [MAIN ] SO: Loaded 40357 primary data records. [2025-09-14T20:59:47.672674] [DEBUG] [MAIN ] SNV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:47.674222] [INFO ] [MAIN ] SNV: Generated 1352 derivative records from 36219 primary records. [2025-09-14T20:59:47.674456] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-14T20:59:47.689064] [DEBUG] [LOCAL ] SNV: Derivative data saved (1352 records). [2025-09-14T20:59:47.689431] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-14T20:59:47.691840] [INFO ] [MAIN ] Derivative Progress: 1828/2226 symbols completed. SNV took 1.1s. Estimated remaining: 2m 20s. Rate: 170.7 symbols/min [2025-09-14T20:59:47.706547] [DEBUG] [MAIN ] SNX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:47.707732] [INFO ] [MAIN ] SNX: Generated 1352 derivative records from 28354 primary records. [2025-09-14T20:59:47.707944] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-14T20:59:47.732011] [DEBUG] [MAIN ] SO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:47.734073] [DEBUG] [LOCAL ] SNX: Derivative data saved (1352 records). [2025-09-14T20:59:47.734234] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-14T20:59:47.735046] [INFO ] [MAIN ] SO: Generated 1352 derivative records from 40357 primary records. [2025-09-14T20:59:47.736952] [INFO ] [MAIN ] Derivative Progress: 1829/2226 symbols completed. SNX took 1.1s. Estimated remaining: 2m 19s. Rate: 170.8 symbols/min [2025-09-14T20:59:47.737076] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-09-14T20:59:47.749517] [DEBUG] [LOCAL ] SO: Derivative data saved (1352 records). [2025-09-14T20:59:47.749699] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-09-14T20:59:47.751751] [INFO ] [MAIN ] Derivative Progress: 1830/2226 symbols completed. SO took 1.1s. Estimated remaining: 2m 19s. Rate: 170.9 symbols/min [2025-09-14T20:59:47.752423] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:47.752631] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:47.752729] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:47.759719] [DEBUG] [LOCAL ] SOJC: Loaded 3322 existing records from primary storage. [2025-09-14T20:59:47.759896] [INFO ] [MAIN ] SOJC: Loaded 3322 primary data records. [2025-09-14T20:59:48.068764] [DEBUG] [LOCAL ] SOBO: Loaded 29189 existing records from primary storage. [2025-09-14T20:59:48.080428] [INFO ] [MAIN ] SOBO: Loaded 29189 primary data records. [2025-09-14T20:59:48.067539] [DEBUG] [LOCAL ] SOC: Loaded 38142 existing records from primary storage. [2025-09-14T20:59:48.080842] [INFO ] [MAIN ] SOC: Loaded 38142 primary data records. [2025-09-14T20:59:48.673824] [DEBUG] [MAIN ] SOJC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:48.675790] [INFO ] [MAIN ] SOJC: Generated 1352 derivative records from 3322 primary records. [2025-09-14T20:59:48.676469] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-14T20:59:48.693426] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1352 records). [2025-09-14T20:59:48.694028] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-14T20:59:48.697417] [INFO ] [MAIN ] Derivative Progress: 1831/2226 symbols completed. SOJC took 0.9s. Estimated remaining: 2m 19s. Rate: 170.7 symbols/min [2025-09-14T20:59:48.698065] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:48.715458] [DEBUG] [MAIN ] SOC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:48.719094] [INFO ] [MAIN ] SOC: Generated 1352 derivative records from 38142 primary records. [2025-09-14T20:59:48.720082] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-14T20:59:48.735033] [DEBUG] [LOCAL ] SOC: Derivative data saved (1352 records). [2025-09-14T20:59:48.750726] [DEBUG] [LOCAL ] SOJD: Loaded 9332 existing records from primary storage. [2025-09-14T20:59:48.751047] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-14T20:59:48.751685] [INFO ] [MAIN ] SOJD: Loaded 9332 primary data records. [2025-09-14T20:59:48.751443] [DEBUG] [MAIN ] SOBO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:48.754162] [INFO ] [MAIN ] Derivative Progress: 1832/2226 symbols completed. SOC took 1.0s. Estimated remaining: 2m 18s. Rate: 170.8 symbols/min [2025-09-14T20:59:48.767544] [INFO ] [MAIN ] SOBO: Generated 1352 derivative records from 29189 primary records. [2025-09-14T20:59:48.786502] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:48.800906] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-14T20:59:48.874343] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1352 records). [2025-09-14T20:59:48.879405] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-14T20:59:48.883177] [DEBUG] [LOCAL ] SOJE: Loaded 6732 existing records from primary storage. [2025-09-14T20:59:48.885696] [INFO ] [MAIN ] Derivative Progress: 1833/2226 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 18s. Rate: 170.9 symbols/min [2025-09-14T20:59:48.886739] [INFO ] [MAIN ] SOJF: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:48.892189] [INFO ] [MAIN ] SOJE: Loaded 6732 primary data records. [2025-09-14T20:59:49.170960] [DEBUG] [LOCAL ] SOJF: Loaded 6057 existing records from primary storage. [2025-09-14T20:59:49.177662] [INFO ] [MAIN ] SOJF: Loaded 6057 primary data records. [2025-09-14T20:59:49.701611] [DEBUG] [MAIN ] SOJD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:49.703552] [INFO ] [MAIN ] SOJD: Generated 1352 derivative records from 9332 primary records. [2025-09-14T20:59:49.704201] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-14T20:59:49.722299] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1352 records). [2025-09-14T20:59:49.722531] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-14T20:59:49.726244] [INFO ] [MAIN ] Derivative Progress: 1834/2226 symbols completed. SOJD took 1.0s. Estimated remaining: 2m 18s. Rate: 170.7 symbols/min [2025-09-14T20:59:49.726849] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:49.741472] [DEBUG] [MAIN ] SOJE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:49.746116] [INFO ] [MAIN ] SOJE: Generated 1352 derivative records from 6732 primary records. [2025-09-14T20:59:49.746339] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-14T20:59:49.753135] [DEBUG] [LOCAL ] SOL: Loaded 9735 existing records from primary storage. [2025-09-14T20:59:49.763786] [INFO ] [MAIN ] SOL: Loaded 9735 primary data records. [2025-09-14T20:59:49.766633] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1352 records). [2025-09-14T20:59:49.798493] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-14T20:59:49.862325] [INFO ] [MAIN ] Derivative Progress: 1835/2226 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 17s. Rate: 170.8 symbols/min [2025-09-14T20:59:49.859330] [DEBUG] [MAIN ] SOJF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:49.884520] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:49.896288] [INFO ] [MAIN ] SOJF: Generated 1352 derivative records from 6057 primary records. [2025-09-14T20:59:49.936978] [DEBUG] [LOCAL ] SOJF: Saving derivative data. [2025-09-14T20:59:50.068426] [DEBUG] [LOCAL ] SOJF: Derivative data saved (1352 records). [2025-09-14T20:59:50.069275] [INFO ] [MAIN ] SOJF: Successfully saved derivative data. [2025-09-14T20:59:50.072051] [INFO ] [MAIN ] Derivative Progress: 1836/2226 symbols completed. SOJF took 1.2s. Estimated remaining: 2m 17s. Rate: 170.8 symbols/min [2025-09-14T20:59:50.083750] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:50.105780] [DEBUG] [LOCAL ] SOLV: Loaded 32609 existing records from primary storage. [2025-09-14T20:59:50.106315] [INFO ] [MAIN ] SOLV: Loaded 32609 primary data records. [2025-09-14T20:59:50.258621] [DEBUG] [MAIN ] SOL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:50.287192] [INFO ] [MAIN ] SOL: Generated 1352 derivative records from 9735 primary records. [2025-09-14T20:59:50.336461] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-14T20:59:50.338267] [DEBUG] [LOCAL ] SON: Loaded 31881 existing records from primary storage. [2025-09-14T20:59:50.364221] [INFO ] [MAIN ] SON: Loaded 31881 primary data records. [2025-09-14T20:59:50.557916] [DEBUG] [LOCAL ] SOL: Derivative data saved (1352 records). [2025-09-14T20:59:50.565707] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-14T20:59:50.569939] [INFO ] [MAIN ] Derivative Progress: 1837/2226 symbols completed. SOL took 0.8s. Estimated remaining: 2m 17s. Rate: 170.8 symbols/min [2025-09-14T20:59:50.573428] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:50.847923] [DEBUG] [LOCAL ] SONY: Loaded 40174 existing records from primary storage. [2025-09-14T20:59:50.859082] [DEBUG] [MAIN ] SOLV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:50.859191] [INFO ] [MAIN ] SONY: Loaded 40174 primary data records. [2025-09-14T20:59:50.866405] [INFO ] [MAIN ] SOLV: Generated 1352 derivative records from 32609 primary records. [2025-09-14T20:59:50.872924] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-14T20:59:50.971815] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1352 records). [2025-09-14T20:59:50.983713] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-14T20:59:50.987057] [INFO ] [MAIN ] Derivative Progress: 1838/2226 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 16s. Rate: 170.8 symbols/min [2025-09-14T20:59:50.993055] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:51.164045] [DEBUG] [LOCAL ] SOR: Loaded 2202 existing records from primary storage. [2025-09-14T20:59:51.190998] [INFO ] [MAIN ] SOR: Loaded 2202 primary data records. [2025-09-14T20:59:51.198001] [DEBUG] [MAIN ] SON: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:51.237840] [INFO ] [MAIN ] SON: Generated 1352 derivative records from 31881 primary records. [2025-09-14T20:59:51.283666] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-14T20:59:51.406024] [DEBUG] [LOCAL ] SON: Derivative data saved (1352 records). [2025-09-14T20:59:51.406235] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-14T20:59:51.503927] [INFO ] [MAIN ] Derivative Progress: 1839/2226 symbols completed. SON took 1.4s. Estimated remaining: 2m 16s. Rate: 170.7 symbols/min [2025-09-14T20:59:51.504671] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:51.517862] [DEBUG] [LOCAL ] SOS: Loaded 6662 existing records from primary storage. [2025-09-14T20:59:51.521574] [INFO ] [MAIN ] SOS: Loaded 6662 primary data records. [2025-09-14T20:59:51.582352] [DEBUG] [MAIN ] SONY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:51.637317] [INFO ] [MAIN ] SONY: Generated 1352 derivative records from 40174 primary records. [2025-09-14T20:59:51.641210] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-14T20:59:51.806465] [DEBUG] [LOCAL ] SONY: Derivative data saved (1352 records). [2025-09-14T20:59:51.816915] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-14T20:59:51.903909] [INFO ] [MAIN ] Derivative Progress: 1840/2226 symbols completed. SONY took 1.3s. Estimated remaining: 2m 16s. Rate: 170.7 symbols/min [2025-09-14T20:59:51.931392] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:51.932505] [DEBUG] [MAIN ] SOR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:51.934100] [INFO ] [MAIN ] SOR: Generated 1352 derivative records from 2202 primary records. [2025-09-14T20:59:51.934511] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-14T20:59:51.955692] [DEBUG] [LOCAL ] SOR: Derivative data saved (1352 records). [2025-09-14T20:59:51.956602] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-14T20:59:51.959873] [INFO ] [MAIN ] Derivative Progress: 1841/2226 symbols completed. SOR took 1.0s. Estimated remaining: 2m 15s. Rate: 170.8 symbols/min [2025-09-14T20:59:51.960635] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:51.990726] [DEBUG] [LOCAL ] SPB: Loaded 26486 existing records from primary storage. [2025-09-14T20:59:52.000509] [INFO ] [MAIN ] SPB: Loaded 26486 primary data records. [2025-09-14T20:59:52.010907] [DEBUG] [MAIN ] SOS: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T20:59:52.043853] [INFO ] [MAIN ] SOS: Generated 1349 derivative records from 6662 primary records. [2025-09-14T20:59:52.078804] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-14T20:59:52.184277] [DEBUG] [LOCAL ] SOS: Derivative data saved (1349 records). [2025-09-14T20:59:52.214728] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-14T20:59:52.240964] [DEBUG] [LOCAL ] SPCE: Loaded 37283 existing records from primary storage. [2025-09-14T20:59:52.248406] [INFO ] [MAIN ] SPCE: Loaded 37283 primary data records. [2025-09-14T20:59:52.327910] [INFO ] [MAIN ] Derivative Progress: 1842/2226 symbols completed. SOS took 0.8s. Estimated remaining: 2m 15s. Rate: 170.8 symbols/min [2025-09-14T20:59:52.388989] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:52.488766] [DEBUG] [LOCAL ] SPE: Loaded 4408 existing records from primary storage. [2025-09-14T20:59:52.532747] [INFO ] [MAIN ] SPE: Loaded 4408 primary data records. [2025-09-14T20:59:52.922037] [DEBUG] [MAIN ] SPB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:53.001083] [INFO ] [MAIN ] SPB: Generated 1352 derivative records from 26486 primary records. [2025-09-14T20:59:53.001665] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-14T20:59:53.019376] [DEBUG] [LOCAL ] SPB: Derivative data saved (1352 records). [2025-09-14T20:59:53.020350] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-14T20:59:53.023560] [INFO ] [MAIN ] Derivative Progress: 1843/2226 symbols completed. SPB took 1.1s. Estimated remaining: 2m 15s. Rate: 170.7 symbols/min [2025-09-14T20:59:53.043185] [DEBUG] [MAIN ] SPCE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:53.044117] [INFO ] [MAIN ] SPCE: Generated 1352 derivative records from 37283 primary records. [2025-09-14T20:59:53.044379] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-14T20:59:53.059374] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1352 records). [2025-09-14T20:59:53.060984] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-14T20:59:53.063927] [INFO ] [MAIN ] Derivative Progress: 1844/2226 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 14s. Rate: 170.8 symbols/min [2025-09-14T20:59:53.079664] [DEBUG] [MAIN ] SPE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:53.080871] [INFO ] [MAIN ] SPE: Generated 1352 derivative records from 4408 primary records. [2025-09-14T20:59:53.080973] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-14T20:59:53.094285] [DEBUG] [LOCAL ] SPE: Derivative data saved (1352 records). [2025-09-14T20:59:53.094386] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-14T20:59:53.097114] [INFO ] [MAIN ] Derivative Progress: 1845/2226 symbols completed. SPE took 0.7s. Estimated remaining: 2m 14s. Rate: 170.9 symbols/min [2025-09-14T20:59:53.098201] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:53.098600] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:53.098417] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:53.118537] [DEBUG] [LOCAL ] SPH: Loaded 12937 existing records from primary storage. [2025-09-14T20:59:53.123056] [INFO ] [MAIN ] SPH: Loaded 12937 primary data records. [2025-09-14T20:59:53.293530] [DEBUG] [LOCAL ] SPG: Loaded 37747 existing records from primary storage. [2025-09-14T20:59:53.341530] [INFO ] [MAIN ] SPG: Loaded 37747 primary data records. [2025-09-14T20:59:53.357834] [DEBUG] [LOCAL ] SPGI: Loaded 33520 existing records from primary storage. [2025-09-14T20:59:53.445411] [INFO ] [MAIN ] SPGI: Loaded 33520 primary data records. [2025-09-14T20:59:54.126103] [DEBUG] [MAIN ] SPH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:54.128950] [INFO ] [MAIN ] SPH: Generated 1352 derivative records from 12937 primary records. [2025-09-14T20:59:54.129721] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-14T20:59:54.145125] [DEBUG] [LOCAL ] SPH: Derivative data saved (1352 records). [2025-09-14T20:59:54.145557] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-14T20:59:54.148179] [INFO ] [MAIN ] Derivative Progress: 1846/2226 symbols completed. SPH took 1.0s. Estimated remaining: 2m 14s. Rate: 170.7 symbols/min [2025-09-14T20:59:54.149187] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:54.178306] [DEBUG] [MAIN ] SPG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:54.178808] [DEBUG] [MAIN ] SPGI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:54.181034] [INFO ] [MAIN ] SPG: Generated 1352 derivative records from 37747 primary records. [2025-09-14T20:59:54.181212] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-14T20:59:54.179968] [INFO ] [MAIN ] SPGI: Generated 1352 derivative records from 33520 primary records. [2025-09-14T20:59:54.182471] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-14T20:59:54.206042] [DEBUG] [LOCAL ] SPG: Derivative data saved (1352 records). [2025-09-14T20:59:54.215946] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-14T20:59:54.219113] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1352 records). [2025-09-14T20:59:54.221720] [INFO ] [MAIN ] Derivative Progress: 1847/2226 symbols completed. SPG took 1.1s. Estimated remaining: 2m 13s. Rate: 170.8 symbols/min [2025-09-14T20:59:54.222937] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-14T20:59:54.223076] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:54.225228] [INFO ] [MAIN ] Derivative Progress: 1848/2226 symbols completed. SPGI took 1.1s. Estimated remaining: 2m 13s. Rate: 170.9 symbols/min [2025-09-14T20:59:54.234857] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:54.236360] [DEBUG] [LOCAL ] SPHR: Loaded 29000 existing records from primary storage. [2025-09-14T20:59:54.236804] [INFO ] [MAIN ] SPHR: Loaded 29000 primary data records. [2025-09-14T20:59:54.309218] [DEBUG] [LOCAL ] SPMC: Loaded 3882 existing records from primary storage. [2025-09-14T20:59:54.324164] [INFO ] [MAIN ] SPMC: Loaded 3882 primary data records. [2025-09-14T20:59:54.571372] [DEBUG] [LOCAL ] SPIR: Loaded 28150 existing records from primary storage. [2025-09-14T20:59:54.676693] [INFO ] [MAIN ] SPIR: Loaded 28150 primary data records. [2025-09-14T20:59:55.149890] [DEBUG] [MAIN ] SPHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:55.152579] [INFO ] [MAIN ] SPHR: Generated 1352 derivative records from 29000 primary records. [2025-09-14T20:59:55.155184] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-14T20:59:55.173483] [DEBUG] [MAIN ] SPMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:55.180161] [INFO ] [MAIN ] SPMC: Generated 1352 derivative records from 3882 primary records. [2025-09-14T20:59:55.180989] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-14T20:59:55.182290] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1352 records). [2025-09-14T20:59:55.184555] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-14T20:59:55.188592] [INFO ] [MAIN ] Derivative Progress: 1849/2226 symbols completed. SPHR took 1.0s. Estimated remaining: 2m 13s. Rate: 170.7 symbols/min [2025-09-14T20:59:55.199723] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1352 records). [2025-09-14T20:59:55.206472] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-14T20:59:55.206600] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:55.213335] [INFO ] [MAIN ] Derivative Progress: 1850/2226 symbols completed. SPMC took 1.0s. Estimated remaining: 2m 12s. Rate: 170.8 symbols/min [2025-09-14T20:59:55.214186] [DEBUG] [MAIN ] SPIR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:55.215716] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:55.215440] [INFO ] [MAIN ] SPIR: Generated 1352 derivative records from 28150 primary records. [2025-09-14T20:59:55.216543] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-14T20:59:55.231189] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1352 records). [2025-09-14T20:59:55.231454] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-14T20:59:55.233444] [INFO ] [MAIN ] Derivative Progress: 1851/2226 symbols completed. SPIR took 1.0s. Estimated remaining: 2m 12s. Rate: 170.9 symbols/min [2025-09-14T20:59:55.233841] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:55.256941] [DEBUG] [LOCAL ] SPNT: Loaded 25918 existing records from primary storage. [2025-09-14T20:59:55.257116] [INFO ] [MAIN ] SPNT: Loaded 25918 primary data records. [2025-09-14T20:59:55.440734] [DEBUG] [LOCAL ] SPR: Loaded 30220 existing records from primary storage. [2025-09-14T20:59:55.479517] [INFO ] [MAIN ] SPR: Loaded 30220 primary data records. [2025-09-14T20:59:55.567920] [DEBUG] [LOCAL ] SPOT: Loaded 38128 existing records from primary storage. [2025-09-14T20:59:55.568459] [INFO ] [MAIN ] SPOT: Loaded 38128 primary data records. [2025-09-14T20:59:56.187053] [DEBUG] [MAIN ] SPNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:56.190407] [INFO ] [MAIN ] SPNT: Generated 1352 derivative records from 25918 primary records. [2025-09-14T20:59:56.192681] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-14T20:59:56.209399] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1352 records). [2025-09-14T20:59:56.210508] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-14T20:59:56.213031] [INFO ] [MAIN ] Derivative Progress: 1852/2226 symbols completed. SPNT took 1.0s. Estimated remaining: 2m 11s. Rate: 170.7 symbols/min [2025-09-14T20:59:56.213606] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:56.241767] [DEBUG] [MAIN ] SPOT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:56.243739] [INFO ] [MAIN ] SPOT: Generated 1352 derivative records from 38128 primary records. [2025-09-14T20:59:56.246623] [DEBUG] [MAIN ] SPR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:56.246949] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-14T20:59:56.248047] [INFO ] [MAIN ] SPR: Generated 1352 derivative records from 30220 primary records. [2025-09-14T20:59:56.248884] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-14T20:59:56.274164] [DEBUG] [LOCAL ] SPRU: Loaded 6819 existing records from primary storage. [2025-09-14T20:59:56.277555] [DEBUG] [LOCAL ] SPR: Derivative data saved (1352 records). [2025-09-14T20:59:56.281148] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1352 records). [2025-09-14T20:59:56.281622] [INFO ] [MAIN ] SPRU: Loaded 6819 primary data records. [2025-09-14T20:59:56.281843] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-14T20:59:56.306942] [INFO ] [MAIN ] Derivative Progress: 1853/2226 symbols completed. SPR took 1.1s. Estimated remaining: 2m 11s. Rate: 170.8 symbols/min [2025-09-14T20:59:56.307077] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-14T20:59:56.346127] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:56.348215] [INFO ] [MAIN ] Derivative Progress: 1854/2226 symbols completed. SPOT took 1.1s. Estimated remaining: 2m 11s. Rate: 170.9 symbols/min [2025-09-14T20:59:56.357079] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:56.483715] [DEBUG] [LOCAL ] SPXX: Loaded 6007 existing records from primary storage. [2025-09-14T20:59:56.487881] [INFO ] [MAIN ] SPXX: Loaded 6007 primary data records. [2025-09-14T20:59:56.621176] [DEBUG] [LOCAL ] SPXC: Loaded 17225 existing records from primary storage. [2025-09-14T20:59:56.634671] [INFO ] [MAIN ] SPXC: Loaded 17225 primary data records. [2025-09-14T20:59:57.212055] [DEBUG] [MAIN ] SPRU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:57.214162] [INFO ] [MAIN ] SPRU: Generated 1352 derivative records from 6819 primary records. [2025-09-14T20:59:57.214923] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-14T20:59:57.230487] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1352 records). [2025-09-14T20:59:57.231011] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-14T20:59:57.233495] [INFO ] [MAIN ] Derivative Progress: 1855/2226 symbols completed. SPRU took 1.0s. Estimated remaining: 2m 10s. Rate: 170.7 symbols/min [2025-09-14T20:59:57.234002] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:57.254660] [DEBUG] [MAIN ] SPXX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:57.255973] [INFO ] [MAIN ] SPXX: Generated 1352 derivative records from 6007 primary records. [2025-09-14T20:59:57.256261] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-14T20:59:57.268601] [DEBUG] [MAIN ] SPXC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:57.271086] [INFO ] [MAIN ] SPXC: Generated 1352 derivative records from 17225 primary records. [2025-09-14T20:59:57.271532] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-14T20:59:57.305564] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1352 records). [2025-09-14T20:59:57.318018] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-14T20:59:57.321112] [DEBUG] [LOCAL ] SQM: Loaded 36523 existing records from primary storage. [2025-09-14T20:59:57.324302] [INFO ] [MAIN ] Derivative Progress: 1856/2226 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 10s. Rate: 170.8 symbols/min [2025-09-14T20:59:57.325016] [INFO ] [MAIN ] SQM: Loaded 36523 primary data records. [2025-09-14T20:59:57.324372] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1352 records). [2025-09-14T20:59:57.324912] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:57.325431] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-14T20:59:57.372469] [INFO ] [MAIN ] Derivative Progress: 1857/2226 symbols completed. SPXC took 1.0s. Estimated remaining: 2m 10s. Rate: 170.9 symbols/min [2025-09-14T20:59:57.409629] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:57.627964] [DEBUG] [LOCAL ] SQNS: Loaded 22731 existing records from primary storage. [2025-09-14T20:59:57.628465] [INFO ] [MAIN ] SQNS: Loaded 22731 primary data records. [2025-09-14T20:59:57.743456] [DEBUG] [LOCAL ] SR: Loaded 24495 existing records from primary storage. [2025-09-14T20:59:57.744147] [INFO ] [MAIN ] SR: Loaded 24495 primary data records. [2025-09-14T20:59:58.207131] [DEBUG] [MAIN ] SQM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:58.208506] [INFO ] [MAIN ] SQM: Generated 1352 derivative records from 36523 primary records. [2025-09-14T20:59:58.208620] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-14T20:59:58.224262] [DEBUG] [LOCAL ] SQM: Derivative data saved (1352 records). [2025-09-14T20:59:58.224857] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-14T20:59:58.227286] [INFO ] [MAIN ] Derivative Progress: 1858/2226 symbols completed. SQM took 1.0s. Estimated remaining: 2m 9s. Rate: 170.7 symbols/min [2025-09-14T20:59:58.252360] [DEBUG] [MAIN ] SQNS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:58.252575] [DEBUG] [MAIN ] SR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:58.253409] [INFO ] [MAIN ] SQNS: Generated 1352 derivative records from 22731 primary records. [2025-09-14T20:59:58.254012] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-14T20:59:58.253926] [INFO ] [MAIN ] SR: Generated 1352 derivative records from 24495 primary records. [2025-09-14T20:59:58.254110] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-14T20:59:58.276437] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1352 records). [2025-09-14T20:59:58.277494] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-14T20:59:58.280604] [INFO ] [MAIN ] Derivative Progress: 1859/2226 symbols completed. SQNS took 1.0s. Estimated remaining: 2m 9s. Rate: 170.8 symbols/min [2025-09-14T20:59:58.280683] [DEBUG] [LOCAL ] SR: Derivative data saved (1352 records). [2025-09-14T20:59:58.280927] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-14T20:59:58.283620] [INFO ] [MAIN ] Derivative Progress: 1860/2226 symbols completed. SR took 0.9s. Estimated remaining: 2m 8s. Rate: 170.9 symbols/min [2025-09-14T20:59:58.284289] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:58.284120] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:58.284390] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:58.297959] [DEBUG] [LOCAL ] SREA: Loaded 7599 existing records from primary storage. [2025-09-14T20:59:58.298286] [INFO ] [MAIN ] SREA: Loaded 7599 primary data records. [2025-09-14T20:59:58.509513] [DEBUG] [LOCAL ] SRFM: Loaded 28759 existing records from primary storage. [2025-09-14T20:59:58.611312] [INFO ] [MAIN ] SRFM: Loaded 28759 primary data records. [2025-09-14T20:59:58.626770] [DEBUG] [LOCAL ] SRE: Loaded 40187 existing records from primary storage. [2025-09-14T20:59:58.665049] [INFO ] [MAIN ] SRE: Loaded 40187 primary data records. [2025-09-14T20:59:59.268758] [DEBUG] [MAIN ] SREA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:59.270029] [INFO ] [MAIN ] SREA: Generated 1352 derivative records from 7599 primary records. [2025-09-14T20:59:59.270414] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-14T20:59:59.287270] [DEBUG] [LOCAL ] SREA: Derivative data saved (1352 records). [2025-09-14T20:59:59.287941] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-14T20:59:59.290681] [INFO ] [MAIN ] Derivative Progress: 1861/2226 symbols completed. SREA took 1.0s. Estimated remaining: 2m 8s. Rate: 170.7 symbols/min [2025-09-14T20:59:59.291143] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:59.313293] [DEBUG] [MAIN ] SRFM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:59.324219] [INFO ] [MAIN ] SRFM: Generated 1352 derivative records from 28759 primary records. [2025-09-14T20:59:59.324410] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-14T20:59:59.326146] [DEBUG] [MAIN ] SRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T20:59:59.338460] [INFO ] [MAIN ] SRE: Generated 1352 derivative records from 40187 primary records. [2025-09-14T20:59:59.338588] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-14T20:59:59.345013] [DEBUG] [LOCAL ] SRG: Loaded 11020 existing records from primary storage. [2025-09-14T20:59:59.345244] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1352 records). [2025-09-14T20:59:59.345783] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-14T20:59:59.345842] [INFO ] [MAIN ] SRG: Loaded 11020 primary data records. [2025-09-14T20:59:59.348916] [INFO ] [MAIN ] Derivative Progress: 1862/2226 symbols completed. SRFM took 1.1s. Estimated remaining: 2m 8s. Rate: 170.8 symbols/min [2025-09-14T20:59:59.383146] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:59.445219] [DEBUG] [LOCAL ] SRE: Derivative data saved (1352 records). [2025-09-14T20:59:59.482213] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-14T20:59:59.495415] [INFO ] [MAIN ] Derivative Progress: 1863/2226 symbols completed. SRE took 1.2s. Estimated remaining: 2m 7s. Rate: 170.9 symbols/min [2025-09-14T20:59:59.567732] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-14T20:59:59.581223] [DEBUG] [LOCAL ] SRI: Loaded 20709 existing records from primary storage. [2025-09-14T20:59:59.584984] [INFO ] [MAIN ] SRI: Loaded 20709 primary data records. [2025-09-14T20:59:59.764919] [DEBUG] [LOCAL ] SRV: Loaded 5408 existing records from primary storage. [2025-09-14T20:59:59.788138] [INFO ] [MAIN ] SRV: Loaded 5408 primary data records. [2025-09-14T21:00:00.293632] [DEBUG] [MAIN ] SRG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:00.295915] [INFO ] [MAIN ] SRG: Generated 1352 derivative records from 11020 primary records. [2025-09-14T21:00:00.296234] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-14T21:00:00.312426] [DEBUG] [LOCAL ] SRG: Derivative data saved (1352 records). [2025-09-14T21:00:00.313006] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-14T21:00:00.315397] [INFO ] [MAIN ] Derivative Progress: 1864/2226 symbols completed. SRG took 1.0s. Estimated remaining: 2m 7s. Rate: 170.7 symbols/min [2025-09-14T21:00:00.316149] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:00.331970] [DEBUG] [MAIN ] SRI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:00.333627] [INFO ] [MAIN ] SRI: Generated 1352 derivative records from 20709 primary records. [2025-09-14T21:00:00.336369] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-14T21:00:00.367329] [DEBUG] [MAIN ] SRV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:00.369212] [INFO ] [MAIN ] SRV: Generated 1352 derivative records from 5408 primary records. [2025-09-14T21:00:00.380320] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-14T21:00:00.382484] [DEBUG] [LOCAL ] SRI: Derivative data saved (1352 records). [2025-09-14T21:00:00.383860] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-14T21:00:00.387550] [INFO ] [MAIN ] Derivative Progress: 1865/2226 symbols completed. SRI took 1.0s. Estimated remaining: 2m 7s. Rate: 170.8 symbols/min [2025-09-14T21:00:00.388740] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:00.403750] [DEBUG] [LOCAL ] SRV: Derivative data saved (1352 records). [2025-09-14T21:00:00.415169] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-14T21:00:00.418468] [DEBUG] [LOCAL ] SSB: Loaded 32376 existing records from primary storage. [2025-09-14T21:00:00.417355] [INFO ] [MAIN ] Derivative Progress: 1866/2226 symbols completed. SRV took 0.9s. Estimated remaining: 2m 6s. Rate: 170.9 symbols/min [2025-09-14T21:00:00.419290] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:00.419397] [INFO ] [MAIN ] SSB: Loaded 32376 primary data records. [2025-09-14T21:00:00.583537] [DEBUG] [LOCAL ] SSD: Loaded 16821 existing records from primary storage. [2025-09-14T21:00:00.590483] [INFO ] [MAIN ] SSD: Loaded 16821 primary data records. [2025-09-14T21:00:00.832809] [DEBUG] [LOCAL ] SSL: Loaded 30733 existing records from primary storage. [2025-09-14T21:00:00.871788] [INFO ] [MAIN ] SSL: Loaded 30733 primary data records. [2025-09-14T21:00:01.493947] [DEBUG] [MAIN ] SSB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:01.495874] [INFO ] [MAIN ] SSB: Generated 1352 derivative records from 32376 primary records. [2025-09-14T21:00:01.496333] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-14T21:00:01.514657] [DEBUG] [LOCAL ] SSB: Derivative data saved (1352 records). [2025-09-14T21:00:01.525413] [DEBUG] [MAIN ] SSD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:01.525121] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-14T21:00:01.528203] [INFO ] [MAIN ] Derivative Progress: 1867/2226 symbols completed. SSB took 1.2s. Estimated remaining: 2m 6s. Rate: 170.7 symbols/min [2025-09-14T21:00:01.529133] [INFO ] [MAIN ] SSD: Generated 1352 derivative records from 16821 primary records. [2025-09-14T21:00:01.529499] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-14T21:00:01.530329] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:01.546634] [DEBUG] [LOCAL ] SSD: Derivative data saved (1352 records). [2025-09-14T21:00:01.547025] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-14T21:00:01.564087] [INFO ] [MAIN ] Derivative Progress: 1868/2226 symbols completed. SSD took 1.2s. Estimated remaining: 2m 6s. Rate: 170.8 symbols/min [2025-09-14T21:00:01.565046] [DEBUG] [MAIN ] SSL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:01.565316] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:01.567000] [INFO ] [MAIN ] SSL: Generated 1352 derivative records from 30733 primary records. [2025-09-14T21:00:01.567150] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-14T21:00:01.574192] [DEBUG] [LOCAL ] SST: Loaded 9946 existing records from primary storage. [2025-09-14T21:00:01.583962] [INFO ] [MAIN ] SST: Loaded 9946 primary data records. [2025-09-14T21:00:01.679468] [DEBUG] [LOCAL ] SSL: Derivative data saved (1352 records). [2025-09-14T21:00:01.715357] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-14T21:00:01.772385] [INFO ] [MAIN ] Derivative Progress: 1869/2226 symbols completed. SSL took 1.4s. Estimated remaining: 2m 5s. Rate: 170.8 symbols/min [2025-09-14T21:00:01.742558] [DEBUG] [LOCAL ] SSTK: Loaded 18357 existing records from primary storage. [2025-09-14T21:00:01.803274] [INFO ] [MAIN ] SSTK: Loaded 18357 primary data records. [2025-09-14T21:00:01.807226] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:02.302842] [DEBUG] [LOCAL ] ST: Loaded 37314 existing records from primary storage. [2025-09-14T21:00:02.305980] [INFO ] [MAIN ] ST: Loaded 37314 primary data records. [2025-09-14T21:00:02.381278] [DEBUG] [MAIN ] SST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:02.416510] [INFO ] [MAIN ] SST: Generated 1352 derivative records from 9946 primary records. [2025-09-14T21:00:02.435721] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-14T21:00:02.543003] [DEBUG] [LOCAL ] SST: Derivative data saved (1352 records). [2025-09-14T21:00:02.550607] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-14T21:00:02.651041] [INFO ] [MAIN ] Derivative Progress: 1870/2226 symbols completed. SST took 1.1s. Estimated remaining: 2m 5s. Rate: 170.7 symbols/min [2025-09-14T21:00:02.671267] [DEBUG] [MAIN ] SSTK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:02.671464] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:02.672778] [INFO ] [MAIN ] SSTK: Generated 1352 derivative records from 18357 primary records. [2025-09-14T21:00:02.674069] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-14T21:00:02.691052] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1352 records). [2025-09-14T21:00:02.692261] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-14T21:00:02.695762] [INFO ] [MAIN ] Derivative Progress: 1871/2226 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 5s. Rate: 170.8 symbols/min [2025-09-14T21:00:02.696165] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:02.741666] [DEBUG] [LOCAL ] STC: Loaded 13380 existing records from primary storage. [2025-09-14T21:00:02.741416] [DEBUG] [MAIN ] ST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:02.741936] [INFO ] [MAIN ] STC: Loaded 13380 primary data records. [2025-09-14T21:00:02.743085] [INFO ] [MAIN ] ST: Generated 1352 derivative records from 37314 primary records. [2025-09-14T21:00:02.744376] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-14T21:00:02.851324] [DEBUG] [LOCAL ] STAG: Loaded 37366 existing records from primary storage. [2025-09-14T21:00:02.885290] [INFO ] [MAIN ] STAG: Loaded 37366 primary data records. [2025-09-14T21:00:02.889325] [DEBUG] [LOCAL ] ST: Derivative data saved (1352 records). [2025-09-14T21:00:02.937812] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-14T21:00:03.024531] [INFO ] [MAIN ] Derivative Progress: 1872/2226 symbols completed. ST took 1.2s. Estimated remaining: 2m 4s. Rate: 170.8 symbols/min [2025-09-14T21:00:03.080626] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:03.388571] [DEBUG] [LOCAL ] STE: Loaded 26441 existing records from primary storage. [2025-09-14T21:00:03.389368] [INFO ] [MAIN ] STE: Loaded 26441 primary data records. [2025-09-14T21:00:03.512675] [DEBUG] [MAIN ] STC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:03.539914] [INFO ] [MAIN ] STC: Generated 1352 derivative records from 13380 primary records. [2025-09-14T21:00:03.565484] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-14T21:00:03.692935] [DEBUG] [MAIN ] STAG: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:00:03.715312] [INFO ] [MAIN ] STAG: Generated 1351 derivative records from 37366 primary records. [2025-09-14T21:00:03.719049] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-14T21:00:03.734792] [DEBUG] [LOCAL ] STAG: Derivative data saved (1351 records). [2025-09-14T21:00:03.735060] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-14T21:00:03.738223] [INFO ] [MAIN ] Derivative Progress: 1873/2226 symbols completed. STAG took 1.1s. Estimated remaining: 2m 4s. Rate: 170.7 symbols/min [2025-09-14T21:00:03.743732] [DEBUG] [LOCAL ] STC: Derivative data saved (1352 records). [2025-09-14T21:00:03.744143] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-14T21:00:03.746517] [INFO ] [MAIN ] Derivative Progress: 1874/2226 symbols completed. STC took 1.1s. Estimated remaining: 2m 4s. Rate: 170.8 symbols/min [2025-09-14T21:00:03.761790] [DEBUG] [MAIN ] STE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:03.762658] [INFO ] [MAIN ] STE: Generated 1352 derivative records from 26441 primary records. [2025-09-14T21:00:03.762741] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-14T21:00:03.775427] [DEBUG] [LOCAL ] STE: Derivative data saved (1352 records). [2025-09-14T21:00:03.775507] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-14T21:00:03.777539] [INFO ] [MAIN ] Derivative Progress: 1875/2226 symbols completed. STE took 0.7s. Estimated remaining: 2m 3s. Rate: 170.8 symbols/min [2025-09-14T21:00:03.778260] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:03.778531] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:03.778794] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:03.793260] [DEBUG] [LOCAL ] STEW: Loaded 11387 existing records from primary storage. [2025-09-14T21:00:03.793555] [INFO ] [MAIN ] STEW: Loaded 11387 primary data records. [2025-09-14T21:00:03.936513] [DEBUG] [LOCAL ] STEL: Loaded 16772 existing records from primary storage. [2025-09-14T21:00:03.979788] [INFO ] [MAIN ] STEL: Loaded 16772 primary data records. [2025-09-14T21:00:03.979955] [DEBUG] [LOCAL ] STEM: Loaded 29074 existing records from primary storage. [2025-09-14T21:00:04.019957] [INFO ] [MAIN ] STEM: Loaded 29074 primary data records. [2025-09-14T21:00:04.771383] [DEBUG] [MAIN ] STEW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:04.772729] [INFO ] [MAIN ] STEW: Generated 1352 derivative records from 11387 primary records. [2025-09-14T21:00:04.773515] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-14T21:00:04.798690] [DEBUG] [LOCAL ] STEW: Derivative data saved (1352 records). [2025-09-14T21:00:04.817822] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-14T21:00:04.818613] [DEBUG] [MAIN ] STEM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:04.818212] [DEBUG] [MAIN ] STEL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:04.820580] [INFO ] [MAIN ] Derivative Progress: 1876/2226 symbols completed. STEW took 1.0s. Estimated remaining: 2m 3s. Rate: 170.7 symbols/min [2025-09-14T21:00:04.821995] [INFO ] [MAIN ] STEM: Generated 1352 derivative records from 29074 primary records. [2025-09-14T21:00:04.823012] [INFO ] [MAIN ] STEL: Generated 1352 derivative records from 16772 primary records. [2025-09-14T21:00:04.823086] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-14T21:00:04.822078] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:04.823215] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-14T21:00:04.851382] [DEBUG] [LOCAL ] STEM: Derivative data saved (1352 records). [2025-09-14T21:00:04.852608] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-14T21:00:04.857502] [INFO ] [MAIN ] Derivative Progress: 1877/2226 symbols completed. STEM took 1.1s. Estimated remaining: 2m 3s. Rate: 170.7 symbols/min [2025-09-14T21:00:04.860261] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:04.860727] [DEBUG] [LOCAL ] STEL: Derivative data saved (1352 records). [2025-09-14T21:00:04.861205] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-14T21:00:04.868280] [INFO ] [MAIN ] Derivative Progress: 1878/2226 symbols completed. STEL took 1.1s. Estimated remaining: 2m 2s. Rate: 170.8 symbols/min [2025-09-14T21:00:04.868682] [DEBUG] [LOCAL ] STK: Loaded 6539 existing records from primary storage. [2025-09-14T21:00:04.869379] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:04.869542] [INFO ] [MAIN ] STK: Loaded 6539 primary data records. [2025-09-14T21:00:05.203082] [DEBUG] [LOCAL ] STLA: Loaded 40314 existing records from primary storage. [2025-09-14T21:00:05.204080] [DEBUG] [LOCAL ] STM: Loaded 40340 existing records from primary storage. [2025-09-14T21:00:05.204997] [INFO ] [MAIN ] STM: Loaded 40340 primary data records. [2025-09-14T21:00:05.204812] [INFO ] [MAIN ] STLA: Loaded 40314 primary data records. [2025-09-14T21:00:05.850005] [DEBUG] [MAIN ] STK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:05.851406] [INFO ] [MAIN ] STK: Generated 1352 derivative records from 6539 primary records. [2025-09-14T21:00:05.851920] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-14T21:00:05.868941] [DEBUG] [LOCAL ] STK: Derivative data saved (1352 records). [2025-09-14T21:00:05.869496] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-14T21:00:05.872672] [INFO ] [MAIN ] Derivative Progress: 1879/2226 symbols completed. STK took 1.1s. Estimated remaining: 2m 2s. Rate: 170.7 symbols/min [2025-09-14T21:00:05.874223] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:05.899344] [DEBUG] [MAIN ] STM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:05.899149] [DEBUG] [MAIN ] STLA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:05.900221] [INFO ] [MAIN ] STM: Generated 1352 derivative records from 40340 primary records. [2025-09-14T21:00:05.901021] [INFO ] [MAIN ] STLA: Generated 1352 derivative records from 40314 primary records. [2025-09-14T21:00:05.901155] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-14T21:00:05.901672] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-14T21:00:05.928357] [DEBUG] [LOCAL ] STLA: Derivative data saved (1352 records). [2025-09-14T21:00:05.928986] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-14T21:00:05.936423] [INFO ] [MAIN ] Derivative Progress: 1880/2226 symbols completed. STLA took 1.1s. Estimated remaining: 2m 2s. Rate: 170.7 symbols/min [2025-09-14T21:00:05.938271] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:05.939417] [DEBUG] [LOCAL ] STN: Loaded 17137 existing records from primary storage. [2025-09-14T21:00:05.941030] [DEBUG] [LOCAL ] STM: Derivative data saved (1352 records). [2025-09-14T21:00:05.941119] [INFO ] [MAIN ] STN: Loaded 17137 primary data records. [2025-09-14T21:00:05.941248] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-14T21:00:05.954840] [INFO ] [MAIN ] Derivative Progress: 1881/2226 symbols completed. STM took 1.1s. Estimated remaining: 2m 1s. Rate: 170.8 symbols/min [2025-09-14T21:00:06.014190] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:06.144249] [DEBUG] [LOCAL ] STRV: Loaded 7828 existing records from primary storage. [2025-09-14T21:00:06.153839] [INFO ] [MAIN ] STRV: Loaded 7828 primary data records. [2025-09-14T21:00:06.277160] [DEBUG] [LOCAL ] STNG: Loaded 32791 existing records from primary storage. [2025-09-14T21:00:06.313083] [INFO ] [MAIN ] STNG: Loaded 32791 primary data records. [2025-09-14T21:00:06.871838] [DEBUG] [MAIN ] STN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:06.873730] [INFO ] [MAIN ] STN: Generated 1352 derivative records from 17137 primary records. [2025-09-14T21:00:06.874419] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-14T21:00:06.893155] [DEBUG] [LOCAL ] STN: Derivative data saved (1352 records). [2025-09-14T21:00:06.893762] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-14T21:00:06.896242] [INFO ] [MAIN ] Derivative Progress: 1882/2226 symbols completed. STN took 1.0s. Estimated remaining: 2m 1s. Rate: 170.7 symbols/min [2025-09-14T21:00:06.897334] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:06.914212] [DEBUG] [MAIN ] STRV: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:00:06.915712] [INFO ] [MAIN ] STRV: Generated 1351 derivative records from 7828 primary records. [2025-09-14T21:00:06.916153] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-14T21:00:06.941900] [DEBUG] [MAIN ] STNG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:06.942095] [DEBUG] [LOCAL ] STRV: Derivative data saved (1351 records). [2025-09-14T21:00:06.942910] [INFO ] [MAIN ] STNG: Generated 1352 derivative records from 32791 primary records. [2025-09-14T21:00:06.943028] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-14T21:00:06.943210] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-14T21:00:06.956499] [INFO ] [MAIN ] Derivative Progress: 1883/2226 symbols completed. STRV took 1.0s. Estimated remaining: 2m 1s. Rate: 170.7 symbols/min [2025-09-14T21:00:06.962988] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:06.970194] [DEBUG] [LOCAL ] STNG: Derivative data saved (1352 records). [2025-09-14T21:00:06.970395] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-14T21:00:06.973660] [INFO ] [MAIN ] Derivative Progress: 1884/2226 symbols completed. STNG took 1.0s. Estimated remaining: 2m 0s. Rate: 170.8 symbols/min [2025-09-14T21:00:06.974060] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:06.996178] [DEBUG] [LOCAL ] STT: Loaded 38482 existing records from primary storage. [2025-09-14T21:00:06.996708] [INFO ] [MAIN ] STT: Loaded 38482 primary data records. [2025-09-14T21:00:07.150863] [DEBUG] [LOCAL ] STVN: Loaded 19718 existing records from primary storage. [2025-09-14T21:00:07.177615] [INFO ] [MAIN ] STVN: Loaded 19718 primary data records. [2025-09-14T21:00:07.275474] [DEBUG] [LOCAL ] STWD: Loaded 38914 existing records from primary storage. [2025-09-14T21:00:07.315225] [INFO ] [MAIN ] STWD: Loaded 38914 primary data records. [2025-09-14T21:00:07.912861] [DEBUG] [MAIN ] STT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:07.914631] [INFO ] [MAIN ] STT: Generated 1352 derivative records from 38482 primary records. [2025-09-14T21:00:07.914821] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-14T21:00:07.931047] [DEBUG] [LOCAL ] STT: Derivative data saved (1352 records). [2025-09-14T21:00:07.941055] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-14T21:00:07.941407] [DEBUG] [MAIN ] STVN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:07.943388] [INFO ] [MAIN ] Derivative Progress: 1885/2226 symbols completed. STT took 1.0s. Estimated remaining: 1m 60s. Rate: 170.7 symbols/min [2025-09-14T21:00:07.944136] [INFO ] [MAIN ] STVN: Generated 1352 derivative records from 19718 primary records. [2025-09-14T21:00:07.944477] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:07.944934] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-14T21:00:07.959392] [DEBUG] [LOCAL ] STXD: Loaded 838 existing records from primary storage. [2025-09-14T21:00:07.961196] [INFO ] [MAIN ] STXD: Loaded 838 primary data records. [2025-09-14T21:00:07.972172] [DEBUG] [LOCAL ] STVN: Derivative data saved (1352 records). [2025-09-14T21:00:08.004094] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-14T21:00:08.009761] [DEBUG] [MAIN ] STWD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:08.032310] [INFO ] [MAIN ] Derivative Progress: 1886/2226 symbols completed. STVN took 1.1s. Estimated remaining: 1m 59s. Rate: 170.7 symbols/min [2025-09-14T21:00:08.047755] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:08.047447] [INFO ] [MAIN ] STWD: Generated 1352 derivative records from 38914 primary records. [2025-09-14T21:00:08.072353] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-14T21:00:08.092160] [DEBUG] [LOCAL ] STXE: Loaded 1470 existing records from primary storage. [2025-09-14T21:00:08.113474] [INFO ] [MAIN ] STXE: Loaded 1470 primary data records. [2025-09-14T21:00:08.364221] [DEBUG] [LOCAL ] STWD: Derivative data saved (1352 records). [2025-09-14T21:00:08.388127] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-14T21:00:08.390977] [INFO ] [MAIN ] Derivative Progress: 1887/2226 symbols completed. STWD took 1.4s. Estimated remaining: 1m 59s. Rate: 170.7 symbols/min [2025-09-14T21:00:08.408608] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:08.565987] [DEBUG] [LOCAL ] STXG: Loaded 1621 existing records from primary storage. [2025-09-14T21:00:08.568004] [INFO ] [MAIN ] STXG: Loaded 1621 primary data records. [2025-09-14T21:00:08.838667] [DEBUG] [MAIN ] STXD: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:00:08.924795] [INFO ] [MAIN ] STXD: Generated 1351 derivative records from 838 primary records. [2025-09-14T21:00:08.927798] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-14T21:00:08.944923] [DEBUG] [MAIN ] STXE: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:00:08.949574] [DEBUG] [LOCAL ] STXD: Derivative data saved (1351 records). [2025-09-14T21:00:08.950957] [INFO ] [MAIN ] STXE: Generated 1351 derivative records from 1470 primary records. [2025-09-14T21:00:08.951008] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-14T21:00:08.951412] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-14T21:00:08.953488] [INFO ] [MAIN ] Derivative Progress: 1888/2226 symbols completed. STXD took 1.0s. Estimated remaining: 1m 59s. Rate: 170.7 symbols/min [2025-09-14T21:00:08.966090] [DEBUG] [LOCAL ] STXE: Derivative data saved (1351 records). [2025-09-14T21:00:08.966440] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-14T21:00:08.968914] [INFO ] [MAIN ] Derivative Progress: 1889/2226 symbols completed. STXE took 0.9s. Estimated remaining: 1m 58s. Rate: 170.8 symbols/min [2025-09-14T21:00:08.983339] [DEBUG] [MAIN ] STXG: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:00:08.983994] [INFO ] [MAIN ] STXG: Generated 1351 derivative records from 1621 primary records. [2025-09-14T21:00:08.984074] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-14T21:00:08.994950] [DEBUG] [LOCAL ] STXG: Derivative data saved (1351 records). [2025-09-14T21:00:08.995027] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-14T21:00:08.996910] [INFO ] [MAIN ] Derivative Progress: 1890/2226 symbols completed. STXG took 0.6s. Estimated remaining: 1m 58s. Rate: 170.9 symbols/min [2025-09-14T21:00:08.997466] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:08.997418] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:08.997688] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:09.002739] [DEBUG] [LOCAL ] STXK: Loaded 998 existing records from primary storage. [2025-09-14T21:00:09.004315] [DEBUG] [LOCAL ] STXV: Loaded 1125 existing records from primary storage. [2025-09-14T21:00:09.006283] [INFO ] [MAIN ] STXV: Loaded 1125 primary data records. [2025-09-14T21:00:09.006394] [INFO ] [MAIN ] STXK: Loaded 998 primary data records. [2025-09-14T21:00:09.006188] [DEBUG] [LOCAL ] STXT: Loaded 1916 existing records from primary storage. [2025-09-14T21:00:09.094400] [INFO ] [MAIN ] STXT: Loaded 1916 primary data records. [2025-09-14T21:00:09.873432] [DEBUG] [MAIN ] STXK: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:00:09.875276] [INFO ] [MAIN ] STXK: Generated 1351 derivative records from 998 primary records. [2025-09-14T21:00:09.887423] [DEBUG] [MAIN ] STXV: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T21:00:09.881291] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-14T21:00:09.894473] [INFO ] [MAIN ] STXV: Generated 1350 derivative records from 1125 primary records. [2025-09-14T21:00:09.899322] [DEBUG] [MAIN ] STXT: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:00:09.899408] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-14T21:00:09.910905] [DEBUG] [LOCAL ] STXK: Derivative data saved (1351 records). [2025-09-14T21:00:09.908244] [INFO ] [MAIN ] STXT: Generated 1351 derivative records from 1916 primary records. [2025-09-14T21:00:09.911891] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-14T21:00:09.911947] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-14T21:00:09.915497] [INFO ] [MAIN ] Derivative Progress: 1891/2226 symbols completed. STXK took 0.9s. Estimated remaining: 1m 58s. Rate: 170.7 symbols/min [2025-09-14T21:00:09.925290] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:09.928058] [DEBUG] [LOCAL ] STXV: Derivative data saved (1350 records). [2025-09-14T21:00:09.935251] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-14T21:00:09.943703] [INFO ] [MAIN ] Derivative Progress: 1892/2226 symbols completed. STXV took 0.9s. Estimated remaining: 1m 57s. Rate: 170.8 symbols/min [2025-09-14T21:00:09.946084] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:09.947979] [DEBUG] [LOCAL ] STXT: Derivative data saved (1351 records). [2025-09-14T21:00:09.948375] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-14T21:00:09.951067] [INFO ] [MAIN ] Derivative Progress: 1893/2226 symbols completed. STXT took 1.0s. Estimated remaining: 1m 57s. Rate: 170.9 symbols/min [2025-09-14T21:00:09.951411] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:10.018776] [DEBUG] [LOCAL ] STZ: Loaded 39284 existing records from primary storage. [2025-09-14T21:00:10.018974] [INFO ] [MAIN ] STZ: Loaded 39284 primary data records. [2025-09-14T21:00:10.019601] [DEBUG] [LOCAL ] SU: Loaded 40234 existing records from primary storage. [2025-09-14T21:00:10.041467] [INFO ] [MAIN ] SU: Loaded 40234 primary data records. [2025-09-14T21:00:10.228229] [DEBUG] [LOCAL ] SUI: Loaded 31838 existing records from primary storage. [2025-09-14T21:00:10.265304] [INFO ] [MAIN ] SUI: Loaded 31838 primary data records. [2025-09-14T21:00:10.920203] [DEBUG] [MAIN ] SU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:10.922502] [INFO ] [MAIN ] SU: Generated 1352 derivative records from 40234 primary records. [2025-09-14T21:00:10.921028] [DEBUG] [MAIN ] STZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:10.923392] [INFO ] [MAIN ] STZ: Generated 1352 derivative records from 39284 primary records. [2025-09-14T21:00:10.922742] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-14T21:00:10.923787] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-14T21:00:10.960335] [DEBUG] [LOCAL ] SU: Derivative data saved (1352 records). [2025-09-14T21:00:10.959447] [DEBUG] [LOCAL ] STZ: Derivative data saved (1352 records). [2025-09-14T21:00:10.965162] [DEBUG] [MAIN ] SUI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:10.965385] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-14T21:00:10.965278] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-14T21:00:10.966667] [INFO ] [MAIN ] SUI: Generated 1352 derivative records from 31838 primary records. [2025-09-14T21:00:10.968453] [INFO ] [MAIN ] Derivative Progress: 1894/2226 symbols completed. SU took 1.0s. Estimated remaining: 1m 57s. Rate: 170.7 symbols/min [2025-09-14T21:00:10.968719] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-14T21:00:10.971694] [INFO ] [MAIN ] Derivative Progress: 1895/2226 symbols completed. STZ took 1.0s. Estimated remaining: 1m 56s. Rate: 170.8 symbols/min [2025-09-14T21:00:10.972615] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:10.982728] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:10.986059] [DEBUG] [LOCAL ] SUI: Derivative data saved (1352 records). [2025-09-14T21:00:10.986978] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-14T21:00:10.990028] [INFO ] [MAIN ] Derivative Progress: 1896/2226 symbols completed. SUI took 1.0s. Estimated remaining: 1m 56s. Rate: 170.9 symbols/min [2025-09-14T21:00:10.990893] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:11.043370] [DEBUG] [LOCAL ] SUN: Loaded 28696 existing records from primary storage. [2025-09-14T21:00:11.055706] [DEBUG] [LOCAL ] SUZ: Loaded 34309 existing records from primary storage. [2025-09-14T21:00:11.054737] [INFO ] [MAIN ] SUN: Loaded 28696 primary data records. [2025-09-14T21:00:11.066137] [INFO ] [MAIN ] SUZ: Loaded 34309 primary data records. [2025-09-14T21:00:11.066893] [DEBUG] [LOCAL ] SUPV: Loaded 35455 existing records from primary storage. [2025-09-14T21:00:11.084314] [INFO ] [MAIN ] SUPV: Loaded 35455 primary data records. [2025-09-14T21:00:12.001760] [DEBUG] [MAIN ] SUZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:12.004682] [INFO ] [MAIN ] SUZ: Generated 1352 derivative records from 34309 primary records. [2025-09-14T21:00:12.006886] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-14T21:00:12.024862] [DEBUG] [MAIN ] SUN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:12.040196] [INFO ] [MAIN ] SUN: Generated 1352 derivative records from 28696 primary records. [2025-09-14T21:00:12.040477] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-14T21:00:12.042924] [DEBUG] [MAIN ] SUPV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:12.042632] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1352 records). [2025-09-14T21:00:12.044971] [INFO ] [MAIN ] SUPV: Generated 1352 derivative records from 35455 primary records. [2025-09-14T21:00:12.051173] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-14T21:00:12.045365] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-14T21:00:12.056396] [INFO ] [MAIN ] Derivative Progress: 1897/2226 symbols completed. SUZ took 1.1s. Estimated remaining: 1m 56s. Rate: 170.7 symbols/min [2025-09-14T21:00:12.061011] [DEBUG] [LOCAL ] SUN: Derivative data saved (1352 records). [2025-09-14T21:00:12.061126] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:12.061586] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-14T21:00:12.069851] [INFO ] [MAIN ] Derivative Progress: 1898/2226 symbols completed. SUN took 1.1s. Estimated remaining: 1m 55s. Rate: 170.8 symbols/min [2025-09-14T21:00:12.071466] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:12.077816] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1352 records). [2025-09-14T21:00:12.078205] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-14T21:00:12.080505] [INFO ] [MAIN ] Derivative Progress: 1899/2226 symbols completed. SUPV took 1.1s. Estimated remaining: 1m 55s. Rate: 170.9 symbols/min [2025-09-14T21:00:12.081341] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:12.112929] [DEBUG] [LOCAL ] SVV: Loaded 28889 existing records from primary storage. [2025-09-14T21:00:12.113148] [INFO ] [MAIN ] SVV: Loaded 28889 primary data records. [2025-09-14T21:00:12.300557] [DEBUG] [LOCAL ] SW: Loaded 39955 existing records from primary storage. [2025-09-14T21:00:12.321182] [INFO ] [MAIN ] SW: Loaded 39955 primary data records. [2025-09-14T21:00:12.318106] [DEBUG] [LOCAL ] SWK: Loaded 39632 existing records from primary storage. [2025-09-14T21:00:12.377436] [INFO ] [MAIN ] SWK: Loaded 39632 primary data records. [2025-09-14T21:00:13.073694] [DEBUG] [MAIN ] SVV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:13.075084] [INFO ] [MAIN ] SVV: Generated 1352 derivative records from 28889 primary records. [2025-09-14T21:00:13.075834] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-14T21:00:13.104028] [DEBUG] [LOCAL ] SVV: Derivative data saved (1352 records). [2025-09-14T21:00:13.105973] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-14T21:00:13.104565] [DEBUG] [MAIN ] SW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:13.108353] [INFO ] [MAIN ] Derivative Progress: 1900/2226 symbols completed. SVV took 1.0s. Estimated remaining: 1m 55s. Rate: 170.7 symbols/min [2025-09-14T21:00:13.109727] [INFO ] [MAIN ] SW: Generated 1352 derivative records from 39955 primary records. [2025-09-14T21:00:13.112075] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:13.112625] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-14T21:00:13.131964] [DEBUG] [MAIN ] SWK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:13.139740] [INFO ] [MAIN ] SWK: Generated 1352 derivative records from 39632 primary records. [2025-09-14T21:00:13.142016] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-14T21:00:13.142131] [DEBUG] [LOCAL ] SW: Derivative data saved (1352 records). [2025-09-14T21:00:13.143482] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-14T21:00:13.146176] [INFO ] [MAIN ] Derivative Progress: 1901/2226 symbols completed. SW took 1.1s. Estimated remaining: 1m 54s. Rate: 170.8 symbols/min [2025-09-14T21:00:13.166460] [DEBUG] [LOCAL ] SWK: Derivative data saved (1352 records). [2025-09-14T21:00:13.166598] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:13.167466] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-14T21:00:13.169848] [INFO ] [MAIN ] Derivative Progress: 1902/2226 symbols completed. SWK took 1.1s. Estimated remaining: 1m 54s. Rate: 170.9 symbols/min [2025-09-14T21:00:13.171934] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:13.183516] [DEBUG] [LOCAL ] SWX: Loaded 23449 existing records from primary storage. [2025-09-14T21:00:13.184360] [INFO ] [MAIN ] SWX: Loaded 23449 primary data records. [2025-09-14T21:00:13.189131] [DEBUG] [LOCAL ] SWZ: Loaded 4684 existing records from primary storage. [2025-09-14T21:00:13.189399] [INFO ] [MAIN ] SWZ: Loaded 4684 primary data records. [2025-09-14T21:00:13.596757] [DEBUG] [LOCAL ] SXC: Loaded 30976 existing records from primary storage. [2025-09-14T21:00:13.715921] [INFO ] [MAIN ] SXC: Loaded 30976 primary data records. [2025-09-14T21:00:14.166879] [DEBUG] [MAIN ] SWX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:14.167535] [DEBUG] [MAIN ] SWZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:14.170524] [INFO ] [MAIN ] SWZ: Generated 1352 derivative records from 4684 primary records. [2025-09-14T21:00:14.168900] [INFO ] [MAIN ] SWX: Generated 1352 derivative records from 23449 primary records. [2025-09-14T21:00:14.170753] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-14T21:00:14.170865] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-14T21:00:14.196747] [DEBUG] [LOCAL ] SWX: Derivative data saved (1352 records). [2025-09-14T21:00:14.197971] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-14T21:00:14.200976] [INFO ] [MAIN ] Derivative Progress: 1903/2226 symbols completed. SWX took 1.1s. Estimated remaining: 1m 54s. Rate: 170.7 symbols/min [2025-09-14T21:00:14.201095] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1352 records). [2025-09-14T21:00:14.201769] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-14T21:00:14.204418] [INFO ] [MAIN ] Derivative Progress: 1904/2226 symbols completed. SWZ took 1.0s. Estimated remaining: 1m 53s. Rate: 170.8 symbols/min [2025-09-14T21:00:14.219029] [DEBUG] [MAIN ] SXC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:14.219895] [INFO ] [MAIN ] SXC: Generated 1352 derivative records from 30976 primary records. [2025-09-14T21:00:14.219997] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-14T21:00:14.233962] [DEBUG] [LOCAL ] SXC: Derivative data saved (1352 records). [2025-09-14T21:00:14.234153] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-14T21:00:14.236297] [INFO ] [MAIN ] Derivative Progress: 1905/2226 symbols completed. SXC took 1.1s. Estimated remaining: 1m 53s. Rate: 170.9 symbols/min [2025-09-14T21:00:14.236877] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:14.237186] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:14.237520] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:14.250463] [DEBUG] [LOCAL ] SXI: Loaded 8735 existing records from primary storage. [2025-09-14T21:00:14.251249] [INFO ] [MAIN ] SXI: Loaded 8735 primary data records. [2025-09-14T21:00:14.420726] [DEBUG] [LOCAL ] SXT: Loaded 21970 existing records from primary storage. [2025-09-14T21:00:14.458144] [INFO ] [MAIN ] SXT: Loaded 21970 primary data records. [2025-09-14T21:00:14.575705] [DEBUG] [LOCAL ] SYF: Loaded 40224 existing records from primary storage. [2025-09-14T21:00:14.617722] [INFO ] [MAIN ] SYF: Loaded 40224 primary data records. [2025-09-14T21:00:15.146305] [DEBUG] [MAIN ] SXI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:15.148961] [INFO ] [MAIN ] SXI: Generated 1352 derivative records from 8735 primary records. [2025-09-14T21:00:15.150592] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-14T21:00:15.167664] [DEBUG] [LOCAL ] SXI: Derivative data saved (1352 records). [2025-09-14T21:00:15.169543] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-14T21:00:15.172345] [INFO ] [MAIN ] Derivative Progress: 1906/2226 symbols completed. SXI took 0.9s. Estimated remaining: 1m 52s. Rate: 170.7 symbols/min [2025-09-14T21:00:15.173011] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:15.184175] [DEBUG] [MAIN ] SXT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:15.188703] [INFO ] [MAIN ] SXT: Generated 1352 derivative records from 21970 primary records. [2025-09-14T21:00:15.189747] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-14T21:00:15.208095] [DEBUG] [MAIN ] SYF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:15.214995] [DEBUG] [LOCAL ] SXT: Derivative data saved (1352 records). [2025-09-14T21:00:15.215947] [INFO ] [MAIN ] SYF: Generated 1352 derivative records from 40224 primary records. [2025-09-14T21:00:15.216590] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-14T21:00:15.216506] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-14T21:00:15.219809] [INFO ] [MAIN ] Derivative Progress: 1907/2226 symbols completed. SXT took 1.0s. Estimated remaining: 1m 52s. Rate: 170.8 symbols/min [2025-09-14T21:00:15.227897] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:15.233753] [DEBUG] [LOCAL ] SYF: Derivative data saved (1352 records). [2025-09-14T21:00:15.234731] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-14T21:00:15.237367] [INFO ] [MAIN ] Derivative Progress: 1908/2226 symbols completed. SYF took 1.0s. Estimated remaining: 1m 52s. Rate: 170.9 symbols/min [2025-09-14T21:00:15.237912] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:15.269019] [DEBUG] [LOCAL ] SYK: Loaded 34829 existing records from primary storage. [2025-09-14T21:00:15.269439] [INFO ] [MAIN ] SYK: Loaded 34829 primary data records. [2025-09-14T21:00:15.488372] [DEBUG] [LOCAL ] SYY: Loaded 40074 existing records from primary storage. [2025-09-14T21:00:15.493562] [INFO ] [MAIN ] SYY: Loaded 40074 primary data records. [2025-09-14T21:00:15.633949] [DEBUG] [LOCAL ] T: Loaded 40538 existing records from primary storage. [2025-09-14T21:00:15.686808] [INFO ] [MAIN ] T: Loaded 40538 primary data records. [2025-09-14T21:00:16.243959] [DEBUG] [MAIN ] SYK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:16.246102] [INFO ] [MAIN ] SYK: Generated 1352 derivative records from 34829 primary records. [2025-09-14T21:00:16.247405] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-14T21:00:16.266154] [DEBUG] [LOCAL ] SYK: Derivative data saved (1352 records). [2025-09-14T21:00:16.276527] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-14T21:00:16.277273] [DEBUG] [MAIN ] SYY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:16.279910] [INFO ] [MAIN ] Derivative Progress: 1909/2226 symbols completed. SYK took 1.1s. Estimated remaining: 1m 51s. Rate: 170.7 symbols/min [2025-09-14T21:00:16.282121] [INFO ] [MAIN ] SYY: Generated 1352 derivative records from 40074 primary records. [2025-09-14T21:00:16.281297] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:16.282329] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-14T21:00:16.297907] [DEBUG] [LOCAL ] SYY: Derivative data saved (1352 records). [2025-09-14T21:00:16.308020] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-14T21:00:16.310709] [INFO ] [MAIN ] Derivative Progress: 1910/2226 symbols completed. SYY took 1.1s. Estimated remaining: 1m 51s. Rate: 170.8 symbols/min [2025-09-14T21:00:16.311059] [DEBUG] [MAIN ] T: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:16.312387] [INFO ] [MAIN ] T: Generated 1352 derivative records from 40538 primary records. [2025-09-14T21:00:16.311484] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:16.312593] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-14T21:00:16.339237] [DEBUG] [LOCAL ] T: Derivative data saved (1352 records). [2025-09-14T21:00:16.339425] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-14T21:00:16.342027] [INFO ] [MAIN ] Derivative Progress: 1911/2226 symbols completed. T took 1.1s. Estimated remaining: 1m 51s. Rate: 170.9 symbols/min [2025-09-14T21:00:16.342379] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:16.355819] [DEBUG] [LOCAL ] TAC: Loaded 31713 existing records from primary storage. [2025-09-14T21:00:16.356022] [INFO ] [MAIN ] TAC: Loaded 31713 primary data records. [2025-09-14T21:00:16.558121] [DEBUG] [LOCAL ] TAK: Loaded 37882 existing records from primary storage. [2025-09-14T21:00:16.590168] [INFO ] [MAIN ] TAK: Loaded 37882 primary data records. [2025-09-14T21:00:16.738033] [DEBUG] [LOCAL ] TAL: Loaded 39020 existing records from primary storage. [2025-09-14T21:00:16.779693] [INFO ] [MAIN ] TAL: Loaded 39020 primary data records. [2025-09-14T21:00:17.268161] [DEBUG] [MAIN ] TAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:17.270452] [INFO ] [MAIN ] TAC: Generated 1352 derivative records from 31713 primary records. [2025-09-14T21:00:17.271494] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-14T21:00:17.289073] [DEBUG] [LOCAL ] TAC: Derivative data saved (1352 records). [2025-09-14T21:00:17.290950] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-14T21:00:17.293723] [INFO ] [MAIN ] Derivative Progress: 1912/2226 symbols completed. TAC took 1.0s. Estimated remaining: 1m 50s. Rate: 170.7 symbols/min [2025-09-14T21:00:17.294323] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:17.306354] [DEBUG] [MAIN ] TAK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:17.309269] [INFO ] [MAIN ] TAK: Generated 1352 derivative records from 37882 primary records. [2025-09-14T21:00:17.309721] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-14T21:00:17.331727] [DEBUG] [MAIN ] TAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:17.334301] [INFO ] [MAIN ] TAL: Generated 1352 derivative records from 39020 primary records. [2025-09-14T21:00:17.334984] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-14T21:00:17.337605] [DEBUG] [LOCAL ] TAK: Derivative data saved (1352 records). [2025-09-14T21:00:17.347656] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-14T21:00:17.350135] [INFO ] [MAIN ] Derivative Progress: 1913/2226 symbols completed. TAK took 1.0s. Estimated remaining: 1m 50s. Rate: 170.8 symbols/min [2025-09-14T21:00:17.353737] [DEBUG] [LOCAL ] TAL: Derivative data saved (1352 records). [2025-09-14T21:00:17.354018] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:17.354141] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-14T21:00:17.368011] [INFO ] [MAIN ] Derivative Progress: 1914/2226 symbols completed. TAL took 1.0s. Estimated remaining: 1m 50s. Rate: 170.9 symbols/min [2025-09-14T21:00:17.368440] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:17.400059] [DEBUG] [LOCAL ] TALO: Loaded 38386 existing records from primary storage. [2025-09-14T21:00:17.403625] [INFO ] [MAIN ] TALO: Loaded 38386 primary data records. [2025-09-14T21:00:17.478165] [DEBUG] [LOCAL ] TBB: Loaded 8605 existing records from primary storage. [2025-09-14T21:00:17.500860] [INFO ] [MAIN ] TBB: Loaded 8605 primary data records. [2025-09-14T21:00:17.738815] [DEBUG] [LOCAL ] TAP: Loaded 39854 existing records from primary storage. [2025-09-14T21:00:17.839249] [INFO ] [MAIN ] TAP: Loaded 39854 primary data records. [2025-09-14T21:00:18.384079] [DEBUG] [MAIN ] TALO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:18.385624] [INFO ] [MAIN ] TALO: Generated 1352 derivative records from 38386 primary records. [2025-09-14T21:00:18.386479] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-14T21:00:18.404287] [DEBUG] [LOCAL ] TALO: Derivative data saved (1352 records). [2025-09-14T21:00:18.404602] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-14T21:00:18.407012] [INFO ] [MAIN ] Derivative Progress: 1915/2226 symbols completed. TALO took 1.1s. Estimated remaining: 1m 49s. Rate: 170.7 symbols/min [2025-09-14T21:00:18.418694] [DEBUG] [MAIN ] TBB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:18.420473] [INFO ] [MAIN ] TBB: Generated 1352 derivative records from 8605 primary records. [2025-09-14T21:00:18.419074] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:18.423409] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-14T21:00:18.445410] [DEBUG] [MAIN ] TAP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:18.448579] [DEBUG] [LOCAL ] TBB: Derivative data saved (1352 records). [2025-09-14T21:00:18.449583] [INFO ] [MAIN ] TAP: Generated 1352 derivative records from 39854 primary records. [2025-09-14T21:00:18.449700] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-14T21:00:18.453001] [INFO ] [MAIN ] Derivative Progress: 1916/2226 symbols completed. TBB took 1.1s. Estimated remaining: 1m 49s. Rate: 170.8 symbols/min [2025-09-14T21:00:18.450150] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-14T21:00:18.454996] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:18.477917] [DEBUG] [LOCAL ] TAP: Derivative data saved (1352 records). [2025-09-14T21:00:18.490072] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-14T21:00:18.494286] [INFO ] [MAIN ] Derivative Progress: 1917/2226 symbols completed. TAP took 1.1s. Estimated remaining: 1m 49s. Rate: 170.8 symbols/min [2025-09-14T21:00:18.495093] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:18.497262] [DEBUG] [LOCAL ] TBBB: Loaded 26664 existing records from primary storage. [2025-09-14T21:00:18.503621] [INFO ] [MAIN ] TBBB: Loaded 26664 primary data records. [2025-09-14T21:00:18.563050] [DEBUG] [LOCAL ] TBN: Loaded 2041 existing records from primary storage. [2025-09-14T21:00:18.592270] [DEBUG] [LOCAL ] TBI: Loaded 16675 existing records from primary storage. [2025-09-14T21:00:18.608459] [INFO ] [MAIN ] TBN: Loaded 2041 primary data records. [2025-09-14T21:00:18.619637] [INFO ] [MAIN ] TBI: Loaded 16675 primary data records. [2025-09-14T21:00:19.434131] [DEBUG] [MAIN ] TBBB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:19.435287] [INFO ] [MAIN ] TBBB: Generated 1352 derivative records from 26664 primary records. [2025-09-14T21:00:19.435781] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-14T21:00:19.454461] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1352 records). [2025-09-14T21:00:19.456823] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-14T21:00:19.458599] [INFO ] [MAIN ] Derivative Progress: 1918/2226 symbols completed. TBBB took 1.0s. Estimated remaining: 1m 48s. Rate: 170.7 symbols/min [2025-09-14T21:00:19.481015] [DEBUG] [MAIN ] TBI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:19.486581] [INFO ] [MAIN ] TBI: Generated 1352 derivative records from 16675 primary records. [2025-09-14T21:00:19.487102] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-14T21:00:19.486942] [DEBUG] [MAIN ] TBN: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:00:19.488446] [INFO ] [MAIN ] TBN: Generated 1351 derivative records from 2041 primary records. [2025-09-14T21:00:19.488846] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-14T21:00:19.511667] [DEBUG] [LOCAL ] TBI: Derivative data saved (1352 records). [2025-09-14T21:00:19.511977] [DEBUG] [LOCAL ] TBN: Derivative data saved (1351 records). [2025-09-14T21:00:19.512142] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-14T21:00:19.512291] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-14T21:00:19.514829] [INFO ] [MAIN ] Derivative Progress: 1919/2226 symbols completed. TBI took 1.1s. Estimated remaining: 1m 48s. Rate: 170.8 symbols/min [2025-09-14T21:00:19.517174] [INFO ] [MAIN ] Derivative Progress: 1920/2226 symbols completed. TBN took 1.0s. Estimated remaining: 1m 47s. Rate: 170.9 symbols/min [2025-09-14T21:00:19.518217] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:19.518134] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:19.519364] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:19.527666] [DEBUG] [LOCAL ] TDF: Loaded 4207 existing records from primary storage. [2025-09-14T21:00:19.527853] [INFO ] [MAIN ] TDF: Loaded 4207 primary data records. [2025-09-14T21:00:19.768017] [DEBUG] [LOCAL ] TDC: Loaded 34553 existing records from primary storage. [2025-09-14T21:00:19.853629] [INFO ] [MAIN ] TDC: Loaded 34553 primary data records. [2025-09-14T21:00:19.854831] [DEBUG] [LOCAL ] TD: Loaded 39289 existing records from primary storage. [2025-09-14T21:00:19.887214] [INFO ] [MAIN ] TD: Loaded 39289 primary data records. [2025-09-14T21:00:20.465494] [DEBUG] [MAIN ] TDF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:20.467599] [INFO ] [MAIN ] TDF: Generated 1352 derivative records from 4207 primary records. [2025-09-14T21:00:20.467875] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-14T21:00:20.483901] [DEBUG] [LOCAL ] TDF: Derivative data saved (1352 records). [2025-09-14T21:00:20.484207] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-14T21:00:20.486332] [INFO ] [MAIN ] Derivative Progress: 1921/2226 symbols completed. TDF took 1.0s. Estimated remaining: 1m 47s. Rate: 170.7 symbols/min [2025-09-14T21:00:20.486738] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:20.512465] [DEBUG] [MAIN ] TD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:20.517185] [DEBUG] [MAIN ] TDC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:20.518056] [INFO ] [MAIN ] TD: Generated 1352 derivative records from 39289 primary records. [2025-09-14T21:00:20.518587] [INFO ] [MAIN ] TDC: Generated 1352 derivative records from 34553 primary records. [2025-09-14T21:00:20.518802] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-14T21:00:20.519571] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-14T21:00:20.547323] [DEBUG] [LOCAL ] TD: Derivative data saved (1352 records). [2025-09-14T21:00:20.548763] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-14T21:00:20.550964] [INFO ] [MAIN ] Derivative Progress: 1922/2226 symbols completed. TD took 1.0s. Estimated remaining: 1m 47s. Rate: 170.8 symbols/min [2025-09-14T21:00:20.551379] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:20.549161] [DEBUG] [LOCAL ] TDG: Loaded 16298 existing records from primary storage. [2025-09-14T21:00:20.553025] [INFO ] [MAIN ] TDG: Loaded 16298 primary data records. [2025-09-14T21:00:20.553078] [DEBUG] [LOCAL ] TDC: Derivative data saved (1352 records). [2025-09-14T21:00:20.585414] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-14T21:00:20.611593] [INFO ] [MAIN ] Derivative Progress: 1923/2226 symbols completed. TDC took 1.1s. Estimated remaining: 1m 46s. Rate: 170.8 symbols/min [2025-09-14T21:00:20.649339] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:20.895671] [DEBUG] [LOCAL ] TDOC: Loaded 40156 existing records from primary storage. [2025-09-14T21:00:20.896626] [INFO ] [MAIN ] TDOC: Loaded 40156 primary data records. [2025-09-14T21:00:21.008702] [DEBUG] [LOCAL ] TDS: Loaded 32088 existing records from primary storage. [2025-09-14T21:00:21.021059] [INFO ] [MAIN ] TDS: Loaded 32088 primary data records. [2025-09-14T21:00:21.407682] [DEBUG] [MAIN ] TDG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:21.408770] [INFO ] [MAIN ] TDG: Generated 1352 derivative records from 16298 primary records. [2025-09-14T21:00:21.484902] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-14T21:00:21.517542] [DEBUG] [LOCAL ] TDG: Derivative data saved (1352 records). [2025-09-14T21:00:21.529811] [DEBUG] [MAIN ] TDOC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:21.530008] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-14T21:00:21.532453] [INFO ] [MAIN ] Derivative Progress: 1924/2226 symbols completed. TDG took 1.0s. Estimated remaining: 1m 46s. Rate: 170.7 symbols/min [2025-09-14T21:00:21.533305] [INFO ] [MAIN ] TDOC: Generated 1352 derivative records from 40156 primary records. [2025-09-14T21:00:21.534011] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-14T21:00:21.533951] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:21.551008] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1352 records). [2025-09-14T21:00:21.557292] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-14T21:00:21.562798] [INFO ] [MAIN ] Derivative Progress: 1925/2226 symbols completed. TDOC took 1.0s. Estimated remaining: 1m 46s. Rate: 170.8 symbols/min [2025-09-14T21:00:21.563311] [DEBUG] [MAIN ] TDS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:21.563669] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:21.564568] [INFO ] [MAIN ] TDS: Generated 1352 derivative records from 32088 primary records. [2025-09-14T21:00:21.564971] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-14T21:00:21.594061] [DEBUG] [LOCAL ] TDS: Derivative data saved (1352 records). [2025-09-14T21:00:21.594261] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-14T21:00:21.596202] [INFO ] [MAIN ] Derivative Progress: 1926/2226 symbols completed. TDS took 0.9s. Estimated remaining: 1m 45s. Rate: 170.9 symbols/min [2025-09-14T21:00:21.596573] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:21.604422] [DEBUG] [LOCAL ] TDY: Loaded 17017 existing records from primary storage. [2025-09-14T21:00:21.604664] [INFO ] [MAIN ] TDY: Loaded 17017 primary data records. [2025-09-14T21:00:21.651558] [DEBUG] [LOCAL ] TDW: Loaded 33675 existing records from primary storage. [2025-09-14T21:00:21.681777] [INFO ] [MAIN ] TDW: Loaded 33675 primary data records. [2025-09-14T21:00:21.770021] [DEBUG] [LOCAL ] TEAF: Loaded 5161 existing records from primary storage. [2025-09-14T21:00:21.850935] [INFO ] [MAIN ] TEAF: Loaded 5161 primary data records. [2025-09-14T21:00:22.517525] [DEBUG] [MAIN ] TDY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:22.519162] [INFO ] [MAIN ] TDY: Generated 1352 derivative records from 17017 primary records. [2025-09-14T21:00:22.519610] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-14T21:00:22.541907] [DEBUG] [MAIN ] TDW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:22.544185] [INFO ] [MAIN ] TDW: Generated 1352 derivative records from 33675 primary records. [2025-09-14T21:00:22.546534] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-14T21:00:22.547795] [DEBUG] [LOCAL ] TDY: Derivative data saved (1352 records). [2025-09-14T21:00:22.548471] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-14T21:00:22.569209] [INFO ] [MAIN ] Derivative Progress: 1927/2226 symbols completed. TDY took 1.0s. Estimated remaining: 1m 45s. Rate: 170.7 symbols/min [2025-09-14T21:00:22.569682] [DEBUG] [MAIN ] TEAF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:22.572314] [INFO ] [MAIN ] TEAF: Generated 1352 derivative records from 5161 primary records. [2025-09-14T21:00:22.572394] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:22.572839] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-14T21:00:22.574111] [DEBUG] [LOCAL ] TDW: Derivative data saved (1352 records). [2025-09-14T21:00:22.574552] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-14T21:00:22.577550] [INFO ] [MAIN ] Derivative Progress: 1928/2226 symbols completed. TDW took 1.0s. Estimated remaining: 1m 45s. Rate: 170.8 symbols/min [2025-09-14T21:00:22.586931] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:22.590236] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1352 records). [2025-09-14T21:00:22.592451] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-14T21:00:22.594681] [INFO ] [MAIN ] Derivative Progress: 1929/2226 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 44s. Rate: 170.9 symbols/min [2025-09-14T21:00:22.595018] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:22.619022] [DEBUG] [LOCAL ] TEI: Loaded 15336 existing records from primary storage. [2025-09-14T21:00:22.619226] [INFO ] [MAIN ] TEI: Loaded 15336 primary data records. [2025-09-14T21:00:22.749604] [DEBUG] [LOCAL ] TEF: Loaded 27245 existing records from primary storage. [2025-09-14T21:00:22.776609] [INFO ] [MAIN ] TEF: Loaded 27245 primary data records. [2025-09-14T21:00:22.807415] [DEBUG] [LOCAL ] TECK: Loaded 40206 existing records from primary storage. [2025-09-14T21:00:22.861073] [INFO ] [MAIN ] TECK: Loaded 40206 primary data records. [2025-09-14T21:00:23.527920] [DEBUG] [MAIN ] TEI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:23.529881] [INFO ] [MAIN ] TEI: Generated 1352 derivative records from 15336 primary records. [2025-09-14T21:00:23.530318] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-14T21:00:23.544162] [DEBUG] [LOCAL ] TEI: Derivative data saved (1352 records). [2025-09-14T21:00:23.546082] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-14T21:00:23.548337] [INFO ] [MAIN ] Derivative Progress: 1930/2226 symbols completed. TEI took 1.0s. Estimated remaining: 1m 44s. Rate: 170.7 symbols/min [2025-09-14T21:00:23.559304] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:23.560555] [DEBUG] [MAIN ] TEF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:23.562285] [INFO ] [MAIN ] TEF: Generated 1352 derivative records from 27245 primary records. [2025-09-14T21:00:23.562568] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-14T21:00:23.573288] [DEBUG] [MAIN ] TECK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:23.580670] [INFO ] [MAIN ] TECK: Generated 1352 derivative records from 40206 primary records. [2025-09-14T21:00:23.583362] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-14T21:00:23.599696] [DEBUG] [LOCAL ] TEF: Derivative data saved (1352 records). [2025-09-14T21:00:23.599562] [DEBUG] [LOCAL ] TECK: Derivative data saved (1352 records). [2025-09-14T21:00:23.599888] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-14T21:00:23.600108] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-14T21:00:23.601978] [INFO ] [MAIN ] Derivative Progress: 1931/2226 symbols completed. TEF took 1.0s. Estimated remaining: 1m 44s. Rate: 170.8 symbols/min [2025-09-14T21:00:23.604472] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:23.604533] [INFO ] [MAIN ] Derivative Progress: 1932/2226 symbols completed. TECK took 1.0s. Estimated remaining: 1m 43s. Rate: 170.9 symbols/min [2025-09-14T21:00:23.605122] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:23.650658] [DEBUG] [LOCAL ] TEL: Loaded 38555 existing records from primary storage. [2025-09-14T21:00:23.651077] [INFO ] [MAIN ] TEL: Loaded 38555 primary data records. [2025-09-14T21:00:23.760489] [DEBUG] [LOCAL ] TEN: Loaded 22644 existing records from primary storage. [2025-09-14T21:00:23.760110] [DEBUG] [LOCAL ] TEO: Loaded 16351 existing records from primary storage. [2025-09-14T21:00:23.771430] [INFO ] [MAIN ] TEN: Loaded 22644 primary data records. [2025-09-14T21:00:23.771557] [INFO ] [MAIN ] TEO: Loaded 16351 primary data records. [2025-09-14T21:00:24.537688] [DEBUG] [MAIN ] TEL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:24.538882] [INFO ] [MAIN ] TEL: Generated 1352 derivative records from 38555 primary records. [2025-09-14T21:00:24.539395] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-14T21:00:24.560635] [DEBUG] [LOCAL ] TEL: Derivative data saved (1352 records). [2025-09-14T21:00:24.561108] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-14T21:00:24.563357] [INFO ] [MAIN ] Derivative Progress: 1933/2226 symbols completed. TEL took 1.0s. Estimated remaining: 1m 43s. Rate: 170.7 symbols/min [2025-09-14T21:00:24.585295] [DEBUG] [MAIN ] TEO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:24.587018] [INFO ] [MAIN ] TEO: Generated 1352 derivative records from 16351 primary records. [2025-09-14T21:00:24.586194] [DEBUG] [MAIN ] TEN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:24.587207] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-14T21:00:24.587762] [INFO ] [MAIN ] TEN: Generated 1352 derivative records from 22644 primary records. [2025-09-14T21:00:24.588227] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-14T21:00:24.617461] [DEBUG] [LOCAL ] TEN: Derivative data saved (1352 records). [2025-09-14T21:00:24.617607] [DEBUG] [LOCAL ] TEO: Derivative data saved (1352 records). [2025-09-14T21:00:24.617921] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-14T21:00:24.618104] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-14T21:00:24.620239] [INFO ] [MAIN ] Derivative Progress: 1934/2226 symbols completed. TEN took 1.0s. Estimated remaining: 1m 43s. Rate: 170.8 symbols/min [2025-09-14T21:00:24.622691] [INFO ] [MAIN ] Derivative Progress: 1935/2226 symbols completed. TEO took 1.0s. Estimated remaining: 1m 42s. Rate: 170.9 symbols/min [2025-09-14T21:00:24.623553] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:24.623683] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:24.623844] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:24.678887] [DEBUG] [LOCAL ] TEX: Loaded 33110 existing records from primary storage. [2025-09-14T21:00:24.679143] [INFO ] [MAIN ] TEX: Loaded 33110 primary data records. [2025-09-14T21:00:24.772781] [DEBUG] [LOCAL ] TEVA: Loaded 40377 existing records from primary storage. [2025-09-14T21:00:24.797201] [DEBUG] [LOCAL ] TFC: Loaded 40407 existing records from primary storage. [2025-09-14T21:00:24.816707] [INFO ] [MAIN ] TEVA: Loaded 40377 primary data records. [2025-09-14T21:00:24.816625] [INFO ] [MAIN ] TFC: Loaded 40407 primary data records. [2025-09-14T21:00:25.636782] [DEBUG] [MAIN ] TEX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:25.639767] [INFO ] [MAIN ] TEX: Generated 1352 derivative records from 33110 primary records. [2025-09-14T21:00:25.639894] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-14T21:00:25.664244] [DEBUG] [LOCAL ] TEX: Derivative data saved (1352 records). [2025-09-14T21:00:25.664373] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-14T21:00:25.666773] [INFO ] [MAIN ] Derivative Progress: 1936/2226 symbols completed. TEX took 1.0s. Estimated remaining: 1m 42s. Rate: 170.7 symbols/min [2025-09-14T21:00:25.668680] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:25.668461] [DEBUG] [MAIN ] TEVA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:25.670686] [INFO ] [MAIN ] TEVA: Generated 1352 derivative records from 40377 primary records. [2025-09-14T21:00:25.671096] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-14T21:00:25.691409] [DEBUG] [MAIN ] TFC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:25.694129] [INFO ] [MAIN ] TFC: Generated 1352 derivative records from 40407 primary records. [2025-09-14T21:00:25.694617] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-14T21:00:25.695926] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1352 records). [2025-09-14T21:00:25.697286] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-14T21:00:25.713374] [INFO ] [MAIN ] Derivative Progress: 1937/2226 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 42s. Rate: 170.8 symbols/min [2025-09-14T21:00:25.714821] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:25.717605] [DEBUG] [LOCAL ] TFC: Derivative data saved (1352 records). [2025-09-14T21:00:25.726386] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-14T21:00:25.726939] [DEBUG] [LOCAL ] TFII: Loaded 24515 existing records from primary storage. [2025-09-14T21:00:25.729080] [INFO ] [MAIN ] Derivative Progress: 1938/2226 symbols completed. TFC took 1.1s. Estimated remaining: 1m 41s. Rate: 170.9 symbols/min [2025-09-14T21:00:25.729211] [INFO ] [MAIN ] TFII: Loaded 24515 primary data records. [2025-09-14T21:00:25.729598] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:25.864970] [DEBUG] [LOCAL ] TFIN: Loaded 17488 existing records from primary storage. [2025-09-14T21:00:25.894228] [INFO ] [MAIN ] TFIN: Loaded 17488 primary data records. [2025-09-14T21:00:26.171215] [DEBUG] [LOCAL ] TFPM: Loaded 28963 existing records from primary storage. [2025-09-14T21:00:26.206266] [INFO ] [MAIN ] TFPM: Loaded 28963 primary data records. [2025-09-14T21:00:26.628716] [DEBUG] [MAIN ] TFII: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:26.631276] [INFO ] [MAIN ] TFII: Generated 1352 derivative records from 24515 primary records. [2025-09-14T21:00:26.631599] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-14T21:00:26.652352] [DEBUG] [LOCAL ] TFII: Derivative data saved (1352 records). [2025-09-14T21:00:26.654225] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-14T21:00:26.656489] [INFO ] [MAIN ] Derivative Progress: 1939/2226 symbols completed. TFII took 1.0s. Estimated remaining: 1m 41s. Rate: 170.7 symbols/min [2025-09-14T21:00:26.656879] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:26.669218] [DEBUG] [MAIN ] TFIN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:26.670453] [INFO ] [MAIN ] TFIN: Generated 1352 derivative records from 17488 primary records. [2025-09-14T21:00:26.670834] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-14T21:00:26.686056] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1352 records). [2025-09-14T21:00:26.688584] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-14T21:00:26.690734] [INFO ] [MAIN ] Derivative Progress: 1940/2226 symbols completed. TFIN took 1.0s. Estimated remaining: 1m 40s. Rate: 170.8 symbols/min [2025-09-14T21:00:26.691148] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:26.713161] [DEBUG] [MAIN ] TFPM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:26.714239] [INFO ] [MAIN ] TFPM: Generated 1352 derivative records from 28963 primary records. [2025-09-14T21:00:26.716284] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-14T21:00:26.731594] [DEBUG] [LOCAL ] TG: Loaded 7504 existing records from primary storage. [2025-09-14T21:00:26.750022] [INFO ] [MAIN ] TG: Loaded 7504 primary data records. [2025-09-14T21:00:26.765777] [DEBUG] [LOCAL ] TFX: Loaded 26318 existing records from primary storage. [2025-09-14T21:00:26.799308] [INFO ] [MAIN ] TFX: Loaded 26318 primary data records. [2025-09-14T21:00:26.786271] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1352 records). [2025-09-14T21:00:26.876536] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-14T21:00:26.934637] [INFO ] [MAIN ] Derivative Progress: 1941/2226 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 40s. Rate: 170.8 symbols/min [2025-09-14T21:00:26.957537] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:27.328715] [DEBUG] [LOCAL ] TGLS: Loaded 20497 existing records from primary storage. [2025-09-14T21:00:27.330048] [INFO ] [MAIN ] TGLS: Loaded 20497 primary data records. [2025-09-14T21:00:27.548499] [DEBUG] [MAIN ] TG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:27.557986] [INFO ] [MAIN ] TG: Generated 1352 derivative records from 7504 primary records. [2025-09-14T21:00:27.659733] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-14T21:00:27.660256] [DEBUG] [MAIN ] TFX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:27.661986] [INFO ] [MAIN ] TFX: Generated 1352 derivative records from 26318 primary records. [2025-09-14T21:00:27.662868] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-14T21:00:27.677507] [DEBUG] [LOCAL ] TG: Derivative data saved (1352 records). [2025-09-14T21:00:27.683686] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-14T21:00:27.686560] [INFO ] [MAIN ] Derivative Progress: 1942/2226 symbols completed. TG took 1.0s. Estimated remaining: 1m 40s. Rate: 170.7 symbols/min [2025-09-14T21:00:27.689588] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:27.693619] [DEBUG] [LOCAL ] TFX: Derivative data saved (1352 records). [2025-09-14T21:00:27.693725] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-14T21:00:27.695781] [INFO ] [MAIN ] Derivative Progress: 1943/2226 symbols completed. TFX took 1.0s. Estimated remaining: 1m 39s. Rate: 170.8 symbols/min [2025-09-14T21:00:27.696250] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:27.714425] [DEBUG] [MAIN ] TGLS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:27.715214] [INFO ] [MAIN ] TGLS: Generated 1352 derivative records from 20497 primary records. [2025-09-14T21:00:27.721553] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-14T21:00:27.734406] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1352 records). [2025-09-14T21:00:27.734691] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-14T21:00:27.752012] [INFO ] [MAIN ] Derivative Progress: 1944/2226 symbols completed. TGLS took 0.8s. Estimated remaining: 1m 39s. Rate: 170.9 symbols/min [2025-09-14T21:00:27.753573] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:27.754287] [DEBUG] [LOCAL ] TGS: Loaded 24046 existing records from primary storage. [2025-09-14T21:00:27.754994] [INFO ] [MAIN ] TGS: Loaded 24046 primary data records. [2025-09-14T21:00:27.880944] [DEBUG] [LOCAL ] TGNA: Loaded 36312 existing records from primary storage. [2025-09-14T21:00:27.902439] [INFO ] [MAIN ] TGNA: Loaded 36312 primary data records. [2025-09-14T21:00:28.304631] [DEBUG] [LOCAL ] TGT: Loaded 40518 existing records from primary storage. [2025-09-14T21:00:28.310235] [INFO ] [MAIN ] TGT: Loaded 40518 primary data records. [2025-09-14T21:00:28.728972] [DEBUG] [MAIN ] TGS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:28.730162] [INFO ] [MAIN ] TGS: Generated 1352 derivative records from 24046 primary records. [2025-09-14T21:00:28.730470] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-14T21:00:28.743169] [DEBUG] [MAIN ] TGNA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:28.755689] [INFO ] [MAIN ] TGNA: Generated 1352 derivative records from 36312 primary records. [2025-09-14T21:00:28.757085] [DEBUG] [LOCAL ] TGS: Derivative data saved (1352 records). [2025-09-14T21:00:28.757270] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-14T21:00:28.757153] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-14T21:00:28.760462] [INFO ] [MAIN ] Derivative Progress: 1945/2226 symbols completed. TGS took 1.1s. Estimated remaining: 1m 39s. Rate: 170.7 symbols/min [2025-09-14T21:00:28.760984] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:28.774388] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1352 records). [2025-09-14T21:00:28.774700] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-14T21:00:28.776900] [INFO ] [MAIN ] Derivative Progress: 1946/2226 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 38s. Rate: 170.8 symbols/min [2025-09-14T21:00:28.777480] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:28.792838] [DEBUG] [MAIN ] TGT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:28.793679] [INFO ] [MAIN ] TGT: Generated 1352 derivative records from 40518 primary records. [2025-09-14T21:00:28.797268] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-14T21:00:28.830668] [DEBUG] [LOCAL ] THG: Loaded 16010 existing records from primary storage. [2025-09-14T21:00:28.832316] [DEBUG] [LOCAL ] TGT: Derivative data saved (1352 records). [2025-09-14T21:00:28.832440] [INFO ] [MAIN ] THG: Loaded 16010 primary data records. [2025-09-14T21:00:28.832608] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-14T21:00:28.846585] [INFO ] [MAIN ] Derivative Progress: 1947/2226 symbols completed. TGT took 1.1s. Estimated remaining: 1m 38s. Rate: 170.9 symbols/min [2025-09-14T21:00:28.880005] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:28.963468] [DEBUG] [LOCAL ] THC: Loaded 36123 existing records from primary storage. [2025-09-14T21:00:29.007801] [INFO ] [MAIN ] THC: Loaded 36123 primary data records. [2025-09-14T21:00:29.030110] [DEBUG] [LOCAL ] THIR: Loaded 1798 existing records from primary storage. [2025-09-14T21:00:29.150060] [INFO ] [MAIN ] THIR: Loaded 1798 primary data records. [2025-09-14T21:00:29.706966] [DEBUG] [MAIN ] THG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:29.708404] [INFO ] [MAIN ] THG: Generated 1352 derivative records from 16010 primary records. [2025-09-14T21:00:29.708821] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-14T21:00:29.739326] [DEBUG] [MAIN ] THC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:29.739982] [DEBUG] [LOCAL ] THG: Derivative data saved (1352 records). [2025-09-14T21:00:29.741218] [INFO ] [MAIN ] THC: Generated 1352 derivative records from 36123 primary records. [2025-09-14T21:00:29.741435] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-14T21:00:29.742615] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-14T21:00:29.745954] [INFO ] [MAIN ] Derivative Progress: 1948/2226 symbols completed. THG took 1.0s. Estimated remaining: 1m 38s. Rate: 170.8 symbols/min [2025-09-14T21:00:29.763512] [DEBUG] [MAIN ] THIR: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T21:00:29.766272] [INFO ] [MAIN ] THIR: Generated 1349 derivative records from 1798 primary records. [2025-09-14T21:00:29.768250] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-14T21:00:29.769839] [DEBUG] [LOCAL ] THC: Derivative data saved (1352 records). [2025-09-14T21:00:29.769933] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-14T21:00:29.772098] [INFO ] [MAIN ] Derivative Progress: 1949/2226 symbols completed. THC took 1.0s. Estimated remaining: 1m 37s. Rate: 170.8 symbols/min [2025-09-14T21:00:29.781896] [DEBUG] [LOCAL ] THIR: Derivative data saved (1349 records). [2025-09-14T21:00:29.781969] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-14T21:00:29.784051] [INFO ] [MAIN ] Derivative Progress: 1950/2226 symbols completed. THIR took 0.9s. Estimated remaining: 1m 37s. Rate: 170.9 symbols/min [2025-09-14T21:00:29.784555] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:29.784680] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:29.784831] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:29.789212] [DEBUG] [LOCAL ] THLV: Loaded 1122 existing records from primary storage. [2025-09-14T21:00:29.789390] [INFO ] [MAIN ] THLV: Loaded 1122 primary data records. [2025-09-14T21:00:29.974746] [DEBUG] [LOCAL ] THQ: Loaded 19489 existing records from primary storage. [2025-09-14T21:00:29.997063] [INFO ] [MAIN ] THQ: Loaded 19489 primary data records. [2025-09-14T21:00:30.208440] [DEBUG] [LOCAL ] THO: Loaded 30981 existing records from primary storage. [2025-09-14T21:00:30.209565] [INFO ] [MAIN ] THO: Loaded 30981 primary data records. [2025-09-14T21:00:30.604608] [DEBUG] [MAIN ] THLV: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T21:00:30.638546] [INFO ] [MAIN ] THLV: Generated 1350 derivative records from 1122 primary records. [2025-09-14T21:00:30.720370] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-14T21:00:30.744675] [DEBUG] [LOCAL ] THLV: Derivative data saved (1350 records). [2025-09-14T21:00:30.745248] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-14T21:00:30.747759] [INFO ] [MAIN ] Derivative Progress: 1951/2226 symbols completed. THLV took 1.0s. Estimated remaining: 1m 37s. Rate: 170.8 symbols/min [2025-09-14T21:00:30.751125] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:30.768311] [DEBUG] [MAIN ] THQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:30.769423] [INFO ] [MAIN ] THQ: Generated 1352 derivative records from 19489 primary records. [2025-09-14T21:00:30.769587] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-14T21:00:30.788464] [DEBUG] [LOCAL ] THQ: Derivative data saved (1352 records). [2025-09-14T21:00:30.794741] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-14T21:00:30.795095] [DEBUG] [LOCAL ] THR: Loaded 14571 existing records from primary storage. [2025-09-14T21:00:30.798363] [INFO ] [MAIN ] Derivative Progress: 1952/2226 symbols completed. THQ took 1.0s. Estimated remaining: 1m 36s. Rate: 170.8 symbols/min [2025-09-14T21:00:30.799513] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:30.799811] [INFO ] [MAIN ] THR: Loaded 14571 primary data records. [2025-09-14T21:00:30.821955] [DEBUG] [MAIN ] THO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:30.868220] [INFO ] [MAIN ] THO: Generated 1352 derivative records from 30981 primary records. [2025-09-14T21:00:30.883455] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-14T21:00:31.023512] [DEBUG] [LOCAL ] THO: Derivative data saved (1352 records). [2025-09-14T21:00:31.031743] [DEBUG] [LOCAL ] THS: Loaded 28643 existing records from primary storage. [2025-09-14T21:00:31.041679] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-14T21:00:31.055213] [INFO ] [MAIN ] THS: Loaded 28643 primary data records. [2025-09-14T21:00:31.057291] [INFO ] [MAIN ] Derivative Progress: 1953/2226 symbols completed. THO took 1.3s. Estimated remaining: 1m 36s. Rate: 170.9 symbols/min [2025-09-14T21:00:31.061175] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:31.337232] [DEBUG] [LOCAL ] THW: Loaded 15000 existing records from primary storage. [2025-09-14T21:00:31.364683] [INFO ] [MAIN ] THW: Loaded 15000 primary data records. [2025-09-14T21:00:31.772256] [DEBUG] [MAIN ] THR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:31.773346] [INFO ] [MAIN ] THR: Generated 1352 derivative records from 14571 primary records. [2025-09-14T21:00:31.774107] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-14T21:00:31.792554] [DEBUG] [LOCAL ] THR: Derivative data saved (1352 records). [2025-09-14T21:00:31.795244] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-14T21:00:31.798216] [INFO ] [MAIN ] Derivative Progress: 1954/2226 symbols completed. THR took 1.0s. Estimated remaining: 1m 36s. Rate: 170.8 symbols/min [2025-09-14T21:00:31.810794] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:31.811259] [DEBUG] [MAIN ] THS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:31.812471] [INFO ] [MAIN ] THS: Generated 1352 derivative records from 28643 primary records. [2025-09-14T21:00:31.813267] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-14T21:00:31.828326] [DEBUG] [LOCAL ] THS: Derivative data saved (1352 records). [2025-09-14T21:00:31.829515] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-14T21:00:31.833225] [INFO ] [MAIN ] Derivative Progress: 1955/2226 symbols completed. THS took 1.0s. Estimated remaining: 1m 35s. Rate: 170.8 symbols/min [2025-09-14T21:00:31.833831] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:31.845106] [DEBUG] [MAIN ] THW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:31.854133] [INFO ] [MAIN ] THW: Generated 1352 derivative records from 15000 primary records. [2025-09-14T21:00:31.854931] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-14T21:00:31.858006] [DEBUG] [LOCAL ] TISI: Loaded 2342 existing records from primary storage. [2025-09-14T21:00:31.858357] [INFO ] [MAIN ] TISI: Loaded 2342 primary data records. [2025-09-14T21:00:31.936590] [DEBUG] [LOCAL ] THW: Derivative data saved (1352 records). [2025-09-14T21:00:31.968553] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-14T21:00:31.987247] [DEBUG] [LOCAL ] TIMB: Loaded 27077 existing records from primary storage. [2025-09-14T21:00:32.000514] [INFO ] [MAIN ] TIMB: Loaded 27077 primary data records. [2025-09-14T21:00:31.989446] [INFO ] [MAIN ] Derivative Progress: 1956/2226 symbols completed. THW took 0.9s. Estimated remaining: 1m 35s. Rate: 170.9 symbols/min [2025-09-14T21:00:32.000952] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:32.462027] [DEBUG] [LOCAL ] TIXT: Loaded 24115 existing records from primary storage. [2025-09-14T21:00:32.463022] [INFO ] [MAIN ] TIXT: Loaded 24115 primary data records. [2025-09-14T21:00:32.822350] [DEBUG] [MAIN ] TISI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:32.822168] [DEBUG] [MAIN ] TIMB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:32.823905] [INFO ] [MAIN ] TISI: Generated 1352 derivative records from 2342 primary records. [2025-09-14T21:00:32.824137] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-14T21:00:32.824004] [INFO ] [MAIN ] TIMB: Generated 1352 derivative records from 27077 primary records. [2025-09-14T21:00:32.825201] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-14T21:00:32.847884] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1352 records). [2025-09-14T21:00:32.849079] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-14T21:00:32.851741] [INFO ] [MAIN ] Derivative Progress: 1957/2226 symbols completed. TIMB took 1.0s. Estimated remaining: 1m 35s. Rate: 170.8 symbols/min [2025-09-14T21:00:32.852544] [DEBUG] [LOCAL ] TISI: Derivative data saved (1352 records). [2025-09-14T21:00:32.853305] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-14T21:00:32.855064] [INFO ] [MAIN ] Derivative Progress: 1958/2226 symbols completed. TISI took 1.0s. Estimated remaining: 1m 34s. Rate: 170.9 symbols/min [2025-09-14T21:00:32.852072] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:32.855483] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:32.885923] [DEBUG] [MAIN ] TIXT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:32.886930] [INFO ] [MAIN ] TIXT: Generated 1352 derivative records from 24115 primary records. [2025-09-14T21:00:32.887095] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-14T21:00:32.909702] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1352 records). [2025-09-14T21:00:32.910592] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-14T21:00:32.910442] [DEBUG] [LOCAL ] TK: Loaded 30001 existing records from primary storage. [2025-09-14T21:00:32.912573] [INFO ] [MAIN ] Derivative Progress: 1959/2226 symbols completed. TIXT took 0.9s. Estimated remaining: 1m 34s. Rate: 170.9 symbols/min [2025-09-14T21:00:32.912885] [INFO ] [MAIN ] TK: Loaded 30001 primary data records. [2025-09-14T21:00:32.913132] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:33.061335] [DEBUG] [LOCAL ] TJX: Loaded 40417 existing records from primary storage. [2025-09-14T21:00:33.088364] [INFO ] [MAIN ] TJX: Loaded 40417 primary data records. [2025-09-14T21:00:33.400088] [DEBUG] [LOCAL ] TKC: Loaded 28785 existing records from primary storage. [2025-09-14T21:00:33.442312] [INFO ] [MAIN ] TKC: Loaded 28785 primary data records. [2025-09-14T21:00:33.855554] [DEBUG] [MAIN ] TK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:33.857765] [INFO ] [MAIN ] TK: Generated 1352 derivative records from 30001 primary records. [2025-09-14T21:00:33.858455] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-14T21:00:33.874679] [DEBUG] [LOCAL ] TK: Derivative data saved (1352 records). [2025-09-14T21:00:33.874951] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-14T21:00:33.878043] [INFO ] [MAIN ] Derivative Progress: 1960/2226 symbols completed. TK took 1.0s. Estimated remaining: 1m 33s. Rate: 170.8 symbols/min [2025-09-14T21:00:33.880134] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:33.894366] [DEBUG] [MAIN ] TJX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:33.895767] [INFO ] [MAIN ] TJX: Generated 1352 derivative records from 40417 primary records. [2025-09-14T21:00:33.896109] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-14T21:00:33.908971] [DEBUG] [MAIN ] TKC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:33.909927] [INFO ] [MAIN ] TKC: Generated 1352 derivative records from 28785 primary records. [2025-09-14T21:00:33.910565] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-14T21:00:33.934699] [DEBUG] [LOCAL ] TJX: Derivative data saved (1352 records). [2025-09-14T21:00:33.934766] [DEBUG] [LOCAL ] TKC: Derivative data saved (1352 records). [2025-09-14T21:00:33.935060] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-14T21:00:33.935005] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-14T21:00:33.937204] [INFO ] [MAIN ] Derivative Progress: 1961/2226 symbols completed. TKC took 1.0s. Estimated remaining: 1m 33s. Rate: 170.9 symbols/min [2025-09-14T21:00:33.937543] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:33.939821] [INFO ] [MAIN ] Derivative Progress: 1962/2226 symbols completed. TJX took 1.1s. Estimated remaining: 1m 33s. Rate: 170.9 symbols/min [2025-09-14T21:00:33.940367] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:33.975262] [DEBUG] [LOCAL ] TKO: Loaded 32011 existing records from primary storage. [2025-09-14T21:00:33.982816] [INFO ] [MAIN ] TKO: Loaded 32011 primary data records. [2025-09-14T21:00:34.116355] [DEBUG] [LOCAL ] TKR: Loaded 29166 existing records from primary storage. [2025-09-14T21:00:34.116433] [DEBUG] [LOCAL ] TLK: Loaded 29077 existing records from primary storage. [2025-09-14T21:00:34.137491] [INFO ] [MAIN ] TLK: Loaded 29077 primary data records. [2025-09-14T21:00:34.132284] [INFO ] [MAIN ] TKR: Loaded 29166 primary data records. [2025-09-14T21:00:34.947174] [DEBUG] [MAIN ] TKO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:34.949311] [INFO ] [MAIN ] TKO: Generated 1352 derivative records from 32011 primary records. [2025-09-14T21:00:34.949810] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-14T21:00:34.971117] [DEBUG] [LOCAL ] TKO: Derivative data saved (1352 records). [2025-09-14T21:00:34.971991] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-14T21:00:34.983142] [DEBUG] [MAIN ] TLK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:34.983925] [INFO ] [MAIN ] TLK: Generated 1352 derivative records from 29077 primary records. [2025-09-14T21:00:34.985708] [INFO ] [MAIN ] Derivative Progress: 1963/2226 symbols completed. TKO took 1.1s. Estimated remaining: 1m 32s. Rate: 170.8 symbols/min [2025-09-14T21:00:34.986015] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-14T21:00:35.001095] [DEBUG] [MAIN ] TKR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:35.012356] [INFO ] [MAIN ] TKR: Generated 1352 derivative records from 29166 primary records. [2025-09-14T21:00:35.013707] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-14T21:00:35.024751] [DEBUG] [LOCAL ] TLK: Derivative data saved (1352 records). [2025-09-14T21:00:35.027445] [DEBUG] [LOCAL ] TKR: Derivative data saved (1352 records). [2025-09-14T21:00:35.027635] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-14T21:00:35.027546] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-14T21:00:35.030376] [INFO ] [MAIN ] Derivative Progress: 1964/2226 symbols completed. TLK took 1.1s. Estimated remaining: 1m 32s. Rate: 170.8 symbols/min [2025-09-14T21:00:35.032428] [INFO ] [MAIN ] Derivative Progress: 1965/2226 symbols completed. TKR took 1.1s. Estimated remaining: 1m 32s. Rate: 170.9 symbols/min [2025-09-14T21:00:35.032941] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:35.033117] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:35.033033] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:35.052122] [DEBUG] [LOCAL ] TLYS: Loaded 14208 existing records from primary storage. [2025-09-14T21:00:35.052418] [INFO ] [MAIN ] TLYS: Loaded 14208 primary data records. [2025-09-14T21:00:35.182614] [DEBUG] [LOCAL ] TM: Loaded 27875 existing records from primary storage. [2025-09-14T21:00:35.242326] [INFO ] [MAIN ] TM: Loaded 27875 primary data records. [2025-09-14T21:00:35.219440] [DEBUG] [LOCAL ] TME: Loaded 40007 existing records from primary storage. [2025-09-14T21:00:35.267482] [INFO ] [MAIN ] TME: Loaded 40007 primary data records. [2025-09-14T21:00:35.920540] [DEBUG] [MAIN ] TLYS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:35.922403] [INFO ] [MAIN ] TLYS: Generated 1352 derivative records from 14208 primary records. [2025-09-14T21:00:35.923194] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-14T21:00:35.940197] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1352 records). [2025-09-14T21:00:35.951173] [DEBUG] [MAIN ] TM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:35.950900] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-14T21:00:35.952519] [INFO ] [MAIN ] TM: Generated 1352 derivative records from 27875 primary records. [2025-09-14T21:00:35.954688] [INFO ] [MAIN ] Derivative Progress: 1966/2226 symbols completed. TLYS took 0.9s. Estimated remaining: 1m 31s. Rate: 170.8 symbols/min [2025-09-14T21:00:35.954997] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-14T21:00:35.955326] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:35.973049] [DEBUG] [LOCAL ] TM: Derivative data saved (1352 records). [2025-09-14T21:00:35.973454] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-14T21:00:35.982895] [INFO ] [MAIN ] Derivative Progress: 1967/2226 symbols completed. TM took 0.9s. Estimated remaining: 1m 31s. Rate: 170.9 symbols/min [2025-09-14T21:00:35.988453] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:35.988210] [DEBUG] [MAIN ] TME: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:35.989949] [INFO ] [MAIN ] TME: Generated 1352 derivative records from 40007 primary records. [2025-09-14T21:00:35.990589] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-14T21:00:36.005400] [DEBUG] [LOCAL ] TME: Derivative data saved (1352 records). [2025-09-14T21:00:36.005693] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-14T21:00:36.008696] [INFO ] [MAIN ] Derivative Progress: 1968/2226 symbols completed. TME took 1.0s. Estimated remaining: 1m 31s. Rate: 170.9 symbols/min [2025-09-14T21:00:36.009140] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:36.043257] [DEBUG] [LOCAL ] TMHC: Loaded 34007 existing records from primary storage. [2025-09-14T21:00:36.060770] [INFO ] [MAIN ] TMHC: Loaded 34007 primary data records. [2025-09-14T21:00:36.061344] [DEBUG] [LOCAL ] TNC: Loaded 10792 existing records from primary storage. [2025-09-14T21:00:36.131131] [INFO ] [MAIN ] TNC: Loaded 10792 primary data records. [2025-09-14T21:00:36.235030] [DEBUG] [LOCAL ] TMO: Loaded 39523 existing records from primary storage. [2025-09-14T21:00:36.312476] [INFO ] [MAIN ] TMO: Loaded 39523 primary data records. [2025-09-14T21:00:36.947485] [DEBUG] [MAIN ] TMHC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:36.949910] [INFO ] [MAIN ] TMHC: Generated 1352 derivative records from 34007 primary records. [2025-09-14T21:00:36.950355] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-14T21:00:36.965474] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1352 records). [2025-09-14T21:00:36.965729] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-14T21:00:36.968062] [INFO ] [MAIN ] Derivative Progress: 1969/2226 symbols completed. TMHC took 1.0s. Estimated remaining: 1m 30s. Rate: 170.8 symbols/min [2025-09-14T21:00:36.970688] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:36.988284] [DEBUG] [MAIN ] TNC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:36.998135] [DEBUG] [MAIN ] TMO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:36.999194] [INFO ] [MAIN ] TNC: Generated 1352 derivative records from 10792 primary records. [2025-09-14T21:00:36.999852] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-14T21:00:36.999736] [INFO ] [MAIN ] TMO: Generated 1352 derivative records from 39523 primary records. [2025-09-14T21:00:37.001306] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-14T21:00:37.014973] [DEBUG] [LOCAL ] TNC: Derivative data saved (1352 records). [2025-09-14T21:00:37.023773] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-14T21:00:37.040288] [INFO ] [MAIN ] Derivative Progress: 1970/2226 symbols completed. TNC took 1.0s. Estimated remaining: 1m 30s. Rate: 170.9 symbols/min [2025-09-14T21:00:37.036319] [DEBUG] [LOCAL ] TMO: Derivative data saved (1352 records). [2025-09-14T21:00:37.048928] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-14T21:00:37.049286] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:37.052022] [INFO ] [MAIN ] Derivative Progress: 1971/2226 symbols completed. TMO took 1.1s. Estimated remaining: 1m 30s. Rate: 170.9 symbols/min [2025-09-14T21:00:37.052635] [DEBUG] [LOCAL ] TNET: Loaded 21396 existing records from primary storage. [2025-09-14T21:00:37.053633] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:37.054096] [INFO ] [MAIN ] TNET: Loaded 21396 primary data records. [2025-09-14T21:00:37.284426] [DEBUG] [LOCAL ] TNL: Loaded 31415 existing records from primary storage. [2025-09-14T21:00:37.410709] [INFO ] [MAIN ] TNL: Loaded 31415 primary data records. [2025-09-14T21:00:37.400038] [DEBUG] [LOCAL ] TNK: Loaded 26640 existing records from primary storage. [2025-09-14T21:00:37.434086] [INFO ] [MAIN ] TNK: Loaded 26640 primary data records. [2025-09-14T21:00:38.023407] [DEBUG] [MAIN ] TNET: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:38.026204] [INFO ] [MAIN ] TNET: Generated 1352 derivative records from 21396 primary records. [2025-09-14T21:00:38.026350] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-14T21:00:38.051081] [DEBUG] [LOCAL ] TNET: Derivative data saved (1352 records). [2025-09-14T21:00:38.051380] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-14T21:00:38.053883] [INFO ] [MAIN ] Derivative Progress: 1972/2226 symbols completed. TNET took 1.1s. Estimated remaining: 1m 29s. Rate: 170.8 symbols/min [2025-09-14T21:00:38.054455] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:38.071981] [DEBUG] [MAIN ] TNK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:38.073211] [INFO ] [MAIN ] TNK: Generated 1352 derivative records from 26640 primary records. [2025-09-14T21:00:38.083480] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-14T21:00:38.084441] [DEBUG] [MAIN ] TNL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:38.087296] [INFO ] [MAIN ] TNL: Generated 1352 derivative records from 31415 primary records. [2025-09-14T21:00:38.087881] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-14T21:00:38.114613] [DEBUG] [LOCAL ] TNK: Derivative data saved (1352 records). [2025-09-14T21:00:38.128371] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-14T21:00:38.128504] [DEBUG] [LOCAL ] TNL: Derivative data saved (1352 records). [2025-09-14T21:00:38.131178] [INFO ] [MAIN ] Derivative Progress: 1973/2226 symbols completed. TNK took 1.1s. Estimated remaining: 1m 29s. Rate: 170.9 symbols/min [2025-09-14T21:00:38.132186] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:38.131843] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-14T21:00:38.134463] [INFO ] [MAIN ] Derivative Progress: 1974/2226 symbols completed. TNL took 1.1s. Estimated remaining: 1m 28s. Rate: 170.9 symbols/min [2025-09-14T21:00:38.135368] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:38.153002] [DEBUG] [LOCAL ] TOL: Loaded 38231 existing records from primary storage. [2025-09-14T21:00:38.153633] [INFO ] [MAIN ] TOL: Loaded 38231 primary data records. [2025-09-14T21:00:38.314224] [DEBUG] [LOCAL ] TPB: Loaded 19050 existing records from primary storage. [2025-09-14T21:00:38.356599] [INFO ] [MAIN ] TPB: Loaded 19050 primary data records. [2025-09-14T21:00:38.539519] [DEBUG] [LOCAL ] TOST: Loaded 40430 existing records from primary storage. [2025-09-14T21:00:38.562197] [INFO ] [MAIN ] TOST: Loaded 40430 primary data records. [2025-09-14T21:00:39.086881] [DEBUG] [MAIN ] TOL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:39.090145] [INFO ] [MAIN ] TOL: Generated 1352 derivative records from 38231 primary records. [2025-09-14T21:00:39.090577] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-14T21:00:39.106835] [DEBUG] [LOCAL ] TOL: Derivative data saved (1352 records). [2025-09-14T21:00:39.108239] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-14T21:00:39.111080] [INFO ] [MAIN ] Derivative Progress: 1975/2226 symbols completed. TOL took 1.1s. Estimated remaining: 1m 28s. Rate: 170.8 symbols/min [2025-09-14T21:00:39.111924] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:39.133059] [DEBUG] [MAIN ] TPB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:39.144598] [INFO ] [MAIN ] TPB: Generated 1352 derivative records from 19050 primary records. [2025-09-14T21:00:39.145527] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-14T21:00:39.145434] [DEBUG] [MAIN ] TOST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:39.147602] [INFO ] [MAIN ] TOST: Generated 1352 derivative records from 40430 primary records. [2025-09-14T21:00:39.148393] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-14T21:00:39.177706] [DEBUG] [LOCAL ] TOST: Derivative data saved (1352 records). [2025-09-14T21:00:39.178549] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-14T21:00:39.180848] [DEBUG] [LOCAL ] TPB: Derivative data saved (1352 records). [2025-09-14T21:00:39.183015] [INFO ] [MAIN ] Derivative Progress: 1976/2226 symbols completed. TOST took 1.1s. Estimated remaining: 1m 28s. Rate: 170.9 symbols/min [2025-09-14T21:00:39.183528] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:39.183291] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-14T21:00:39.186224] [INFO ] [MAIN ] Derivative Progress: 1977/2226 symbols completed. TPB took 1.1s. Estimated remaining: 1m 27s. Rate: 170.9 symbols/min [2025-09-14T21:00:39.186720] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:39.198944] [DEBUG] [LOCAL ] TPC: Loaded 29823 existing records from primary storage. [2025-09-14T21:00:39.199511] [INFO ] [MAIN ] TPC: Loaded 29823 primary data records. [2025-09-14T21:00:39.298423] [DEBUG] [LOCAL ] TPL: Loaded 9241 existing records from primary storage. [2025-09-14T21:00:39.316849] [INFO ] [MAIN ] TPL: Loaded 9241 primary data records. [2025-09-14T21:00:39.452751] [DEBUG] [LOCAL ] TPH: Loaded 33799 existing records from primary storage. [2025-09-14T21:00:39.513315] [INFO ] [MAIN ] TPH: Loaded 33799 primary data records. [2025-09-14T21:00:40.185748] [DEBUG] [MAIN ] TPC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:40.187663] [INFO ] [MAIN ] TPC: Generated 1352 derivative records from 29823 primary records. [2025-09-14T21:00:40.198514] [DEBUG] [MAIN ] TPL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:40.198612] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-14T21:00:40.201025] [INFO ] [MAIN ] TPL: Generated 1352 derivative records from 9241 primary records. [2025-09-14T21:00:40.201138] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-14T21:00:40.229374] [DEBUG] [LOCAL ] TPL: Derivative data saved (1352 records). [2025-09-14T21:00:40.231209] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-14T21:00:40.235702] [DEBUG] [LOCAL ] TPC: Derivative data saved (1352 records). [2025-09-14T21:00:40.240047] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-14T21:00:40.239871] [INFO ] [MAIN ] Derivative Progress: 1978/2226 symbols completed. TPL took 1.1s. Estimated remaining: 1m 27s. Rate: 170.8 symbols/min [2025-09-14T21:00:40.243676] [INFO ] [MAIN ] Derivative Progress: 1979/2226 symbols completed. TPC took 1.1s. Estimated remaining: 1m 27s. Rate: 170.9 symbols/min [2025-09-14T21:00:40.261010] [DEBUG] [MAIN ] TPH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:40.262056] [INFO ] [MAIN ] TPH: Generated 1352 derivative records from 33799 primary records. [2025-09-14T21:00:40.262140] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-14T21:00:40.275575] [DEBUG] [LOCAL ] TPH: Derivative data saved (1352 records). [2025-09-14T21:00:40.275766] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-14T21:00:40.277893] [INFO ] [MAIN ] Derivative Progress: 1980/2226 symbols completed. TPH took 1.1s. Estimated remaining: 1m 26s. Rate: 170.9 symbols/min [2025-09-14T21:00:40.278762] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:40.278579] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:40.279067] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:40.296759] [DEBUG] [LOCAL ] TPYP: Loaded 5927 existing records from primary storage. [2025-09-14T21:00:40.297016] [INFO ] [MAIN ] TPYP: Loaded 5927 primary data records. [2025-09-14T21:00:40.398100] [DEBUG] [LOCAL ] TPVG: Loaded 19289 existing records from primary storage. [2025-09-14T21:00:40.415517] [INFO ] [MAIN ] TPVG: Loaded 19289 primary data records. [2025-09-14T21:00:40.724888] [DEBUG] [LOCAL ] TPR: Loaded 40259 existing records from primary storage. [2025-09-14T21:00:40.741823] [INFO ] [MAIN ] TPR: Loaded 40259 primary data records. [2025-09-14T21:00:41.229089] [DEBUG] [MAIN ] TPYP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:41.231004] [INFO ] [MAIN ] TPYP: Generated 1352 derivative records from 5927 primary records. [2025-09-14T21:00:41.229774] [DEBUG] [MAIN ] TPVG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:41.231535] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-14T21:00:41.233492] [INFO ] [MAIN ] TPVG: Generated 1352 derivative records from 19289 primary records. [2025-09-14T21:00:41.242584] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-14T21:00:41.258402] [DEBUG] [MAIN ] TPR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:41.260315] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1352 records). [2025-09-14T21:00:41.261204] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-14T21:00:41.262389] [INFO ] [MAIN ] TPR: Generated 1352 derivative records from 40259 primary records. [2025-09-14T21:00:41.270205] [INFO ] [MAIN ] Derivative Progress: 1981/2226 symbols completed. TPYP took 1.0s. Estimated remaining: 1m 26s. Rate: 170.8 symbols/min [2025-09-14T21:00:41.276688] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1352 records). [2025-09-14T21:00:41.277277] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-14T21:00:41.276870] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-14T21:00:41.279761] [INFO ] [MAIN ] Derivative Progress: 1982/2226 symbols completed. TPVG took 1.0s. Estimated remaining: 1m 26s. Rate: 170.9 symbols/min [2025-09-14T21:00:41.279875] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:41.281658] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:41.298836] [DEBUG] [LOCAL ] TPR: Derivative data saved (1352 records). [2025-09-14T21:00:41.299149] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-14T21:00:41.301568] [INFO ] [MAIN ] Derivative Progress: 1983/2226 symbols completed. TPR took 1.0s. Estimated remaining: 1m 25s. Rate: 170.9 symbols/min [2025-09-14T21:00:41.304694] [DEBUG] [LOCAL ] TPZ: Loaded 3453 existing records from primary storage. [2025-09-14T21:00:41.305078] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:41.305283] [INFO ] [MAIN ] TPZ: Loaded 3453 primary data records. [2025-09-14T21:00:41.429420] [DEBUG] [LOCAL ] TRAK: Loaded 6788 existing records from primary storage. [2025-09-14T21:00:41.429594] [DEBUG] [LOCAL ] TR: Loaded 14756 existing records from primary storage. [2025-09-14T21:00:41.448234] [INFO ] [MAIN ] TRAK: Loaded 6788 primary data records. [2025-09-14T21:00:41.458815] [INFO ] [MAIN ] TR: Loaded 14756 primary data records. [2025-09-14T21:00:42.335109] [DEBUG] [MAIN ] TPZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:42.337678] [INFO ] [MAIN ] TPZ: Generated 1352 derivative records from 3453 primary records. [2025-09-14T21:00:42.337899] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-14T21:00:42.351499] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1352 records). [2025-09-14T21:00:42.352082] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-14T21:00:42.354005] [INFO ] [MAIN ] Derivative Progress: 1984/2226 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 25s. Rate: 170.8 symbols/min [2025-09-14T21:00:42.354365] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:42.376571] [DEBUG] [MAIN ] TR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:42.384323] [INFO ] [MAIN ] TR: Generated 1352 derivative records from 14756 primary records. [2025-09-14T21:00:42.388572] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-14T21:00:42.394156] [DEBUG] [LOCAL ] TRC: Loaded 11739 existing records from primary storage. [2025-09-14T21:00:42.394700] [DEBUG] [MAIN ] TRAK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:42.395141] [INFO ] [MAIN ] TRC: Loaded 11739 primary data records. [2025-09-14T21:00:42.402196] [INFO ] [MAIN ] TRAK: Generated 1352 derivative records from 6788 primary records. [2025-09-14T21:00:42.405229] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-14T21:00:42.475022] [DEBUG] [LOCAL ] TR: Derivative data saved (1352 records). [2025-09-14T21:00:42.478125] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1352 records). [2025-09-14T21:00:42.478253] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-14T21:00:42.478321] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-14T21:00:42.491785] [INFO ] [MAIN ] Derivative Progress: 1985/2226 symbols completed. TRAK took 1.2s. Estimated remaining: 1m 25s. Rate: 170.8 symbols/min [2025-09-14T21:00:42.513404] [INFO ] [MAIN ] Derivative Progress: 1986/2226 symbols completed. TR took 1.2s. Estimated remaining: 1m 24s. Rate: 170.9 symbols/min [2025-09-14T21:00:42.513553] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:42.551444] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:42.788248] [DEBUG] [LOCAL ] TREX: Loaded 37191 existing records from primary storage. [2025-09-14T21:00:42.789076] [INFO ] [MAIN ] TREX: Loaded 37191 primary data records. [2025-09-14T21:00:42.941304] [DEBUG] [MAIN ] TRC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:42.942588] [DEBUG] [LOCAL ] TRGP: Loaded 38197 existing records from primary storage. [2025-09-14T21:00:42.942785] [INFO ] [MAIN ] TRGP: Loaded 38197 primary data records. [2025-09-14T21:00:42.950951] [INFO ] [MAIN ] TRC: Generated 1352 derivative records from 11739 primary records. [2025-09-14T21:00:43.063392] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-14T21:00:43.248765] [DEBUG] [LOCAL ] TRC: Derivative data saved (1352 records). [2025-09-14T21:00:43.266558] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-14T21:00:43.330416] [INFO ] [MAIN ] Derivative Progress: 1987/2226 symbols completed. TRC took 1.0s. Estimated remaining: 1m 24s. Rate: 170.8 symbols/min [2025-09-14T21:00:43.338152] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:43.456866] [DEBUG] [MAIN ] TREX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:43.458316] [INFO ] [MAIN ] TREX: Generated 1352 derivative records from 37191 primary records. [2025-09-14T21:00:43.459027] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-14T21:00:43.484799] [DEBUG] [LOCAL ] TREX: Derivative data saved (1352 records). [2025-09-14T21:00:43.500008] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-14T21:00:43.503405] [INFO ] [MAIN ] Derivative Progress: 1988/2226 symbols completed. TREX took 1.0s. Estimated remaining: 1m 24s. Rate: 170.8 symbols/min [2025-09-14T21:00:43.500587] [DEBUG] [MAIN ] TRGP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:43.505020] [INFO ] [MAIN ] TRGP: Generated 1352 derivative records from 38197 primary records. [2025-09-14T21:00:43.516040] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-14T21:00:43.517908] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:43.519795] [DEBUG] [LOCAL ] TRN: Loaded 27878 existing records from primary storage. [2025-09-14T21:00:43.529420] [INFO ] [MAIN ] TRN: Loaded 27878 primary data records. [2025-09-14T21:00:43.532866] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1352 records). [2025-09-14T21:00:43.566490] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-14T21:00:43.595060] [INFO ] [MAIN ] Derivative Progress: 1989/2226 symbols completed. TRGP took 1.1s. Estimated remaining: 1m 23s. Rate: 170.9 symbols/min [2025-09-14T21:00:43.617043] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:43.833621] [DEBUG] [LOCAL ] TRNO: Loaded 33264 existing records from primary storage. [2025-09-14T21:00:43.834597] [INFO ] [MAIN ] TRNO: Loaded 33264 primary data records. [2025-09-14T21:00:43.996375] [DEBUG] [LOCAL ] TROX: Loaded 39171 existing records from primary storage. [2025-09-14T21:00:44.020533] [INFO ] [MAIN ] TROX: Loaded 39171 primary data records. [2025-09-14T21:00:44.462740] [DEBUG] [MAIN ] TRN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:44.466426] [INFO ] [MAIN ] TRN: Generated 1352 derivative records from 27878 primary records. [2025-09-14T21:00:44.467804] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-14T21:00:44.484171] [DEBUG] [LOCAL ] TRN: Derivative data saved (1352 records). [2025-09-14T21:00:44.484922] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-14T21:00:44.486971] [INFO ] [MAIN ] Derivative Progress: 1990/2226 symbols completed. TRN took 1.1s. Estimated remaining: 1m 23s. Rate: 170.8 symbols/min [2025-09-14T21:00:44.487779] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:44.504924] [DEBUG] [MAIN ] TRNO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:44.506688] [INFO ] [MAIN ] TRNO: Generated 1352 derivative records from 33264 primary records. [2025-09-14T21:00:44.507031] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-14T21:00:44.522723] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1352 records). [2025-09-14T21:00:44.524109] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-14T21:00:44.528789] [INFO ] [MAIN ] Derivative Progress: 1991/2226 symbols completed. TRNO took 1.0s. Estimated remaining: 1m 23s. Rate: 170.8 symbols/min [2025-09-14T21:00:44.529674] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:44.542278] [DEBUG] [MAIN ] TROX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:44.543323] [INFO ] [MAIN ] TROX: Generated 1352 derivative records from 39171 primary records. [2025-09-14T21:00:44.553161] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-14T21:00:44.566558] [DEBUG] [LOCAL ] TROX: Derivative data saved (1352 records). [2025-09-14T21:00:44.576752] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-14T21:00:44.580270] [INFO ] [MAIN ] Derivative Progress: 1992/2226 symbols completed. TROX took 1.0s. Estimated remaining: 1m 22s. Rate: 170.9 symbols/min [2025-09-14T21:00:44.580573] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:44.581974] [DEBUG] [LOCAL ] TRP: Loaded 39171 existing records from primary storage. [2025-09-14T21:00:44.590208] [INFO ] [MAIN ] TRP: Loaded 39171 primary data records. [2025-09-14T21:00:44.725029] [DEBUG] [LOCAL ] TRTX: Loaded 27077 existing records from primary storage. [2025-09-14T21:00:44.750554] [INFO ] [MAIN ] TRTX: Loaded 27077 primary data records. [2025-09-14T21:00:45.123871] [DEBUG] [LOCAL ] TRU: Loaded 38342 existing records from primary storage. [2025-09-14T21:00:45.163747] [INFO ] [MAIN ] TRU: Loaded 38342 primary data records. [2025-09-14T21:00:45.470937] [DEBUG] [MAIN ] TRP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:45.560957] [INFO ] [MAIN ] TRP: Generated 1352 derivative records from 39171 primary records. [2025-09-14T21:00:45.561671] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-14T21:00:45.578874] [DEBUG] [LOCAL ] TRP: Derivative data saved (1352 records). [2025-09-14T21:00:45.581826] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-14T21:00:45.586416] [INFO ] [MAIN ] Derivative Progress: 1993/2226 symbols completed. TRP took 1.1s. Estimated remaining: 1m 22s. Rate: 170.8 symbols/min [2025-09-14T21:00:45.598754] [DEBUG] [MAIN ] TRTX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:45.599737] [INFO ] [MAIN ] TRTX: Generated 1352 derivative records from 27077 primary records. [2025-09-14T21:00:45.599984] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-14T21:00:45.613324] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1352 records). [2025-09-14T21:00:45.613540] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-14T21:00:45.615692] [INFO ] [MAIN ] Derivative Progress: 1994/2226 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 21s. Rate: 170.8 symbols/min [2025-09-14T21:00:45.630801] [DEBUG] [MAIN ] TRU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:45.631499] [INFO ] [MAIN ] TRU: Generated 1352 derivative records from 38342 primary records. [2025-09-14T21:00:45.631583] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-14T21:00:45.643799] [DEBUG] [LOCAL ] TRU: Derivative data saved (1352 records). [2025-09-14T21:00:45.643880] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-14T21:00:45.645959] [INFO ] [MAIN ] Derivative Progress: 1995/2226 symbols completed. TRU took 1.1s. Estimated remaining: 1m 21s. Rate: 170.9 symbols/min [2025-09-14T21:00:45.646664] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:45.647394] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:45.647500] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:45.689230] [DEBUG] [LOCAL ] TSE: Loaded 21419 existing records from primary storage. [2025-09-14T21:00:45.689738] [INFO ] [MAIN ] TSE: Loaded 21419 primary data records. [2025-09-14T21:00:45.826326] [DEBUG] [LOCAL ] TS: Loaded 38831 existing records from primary storage. [2025-09-14T21:00:45.852536] [INFO ] [MAIN ] TS: Loaded 38831 primary data records. [2025-09-14T21:00:45.907580] [DEBUG] [LOCAL ] TRV: Loaded 35927 existing records from primary storage. [2025-09-14T21:00:45.942335] [INFO ] [MAIN ] TRV: Loaded 35927 primary data records. [2025-09-14T21:00:46.669924] [DEBUG] [MAIN ] TSE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:46.671490] [INFO ] [MAIN ] TSE: Generated 1352 derivative records from 21419 primary records. [2025-09-14T21:00:46.672193] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-14T21:00:46.695329] [DEBUG] [LOCAL ] TSE: Derivative data saved (1352 records). [2025-09-14T21:00:46.695942] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-14T21:00:46.698493] [INFO ] [MAIN ] Derivative Progress: 1996/2226 symbols completed. TSE took 1.1s. Estimated remaining: 1m 21s. Rate: 170.7 symbols/min [2025-09-14T21:00:46.699410] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:46.711761] [DEBUG] [MAIN ] TS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:46.714029] [INFO ] [MAIN ] TS: Generated 1352 derivative records from 38831 primary records. [2025-09-14T21:00:46.716233] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-14T21:00:46.744730] [DEBUG] [MAIN ] TRV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:46.749090] [DEBUG] [LOCAL ] TSI: Loaded 5477 existing records from primary storage. [2025-09-14T21:00:46.754588] [INFO ] [MAIN ] TRV: Generated 1352 derivative records from 35927 primary records. [2025-09-14T21:00:46.753306] [DEBUG] [LOCAL ] TS: Derivative data saved (1352 records). [2025-09-14T21:00:46.755168] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-14T21:00:46.755260] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-14T21:00:46.754983] [INFO ] [MAIN ] TSI: Loaded 5477 primary data records. [2025-09-14T21:00:46.758339] [INFO ] [MAIN ] Derivative Progress: 1997/2226 symbols completed. TS took 1.1s. Estimated remaining: 1m 20s. Rate: 170.8 symbols/min [2025-09-14T21:00:46.760480] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:46.878601] [DEBUG] [LOCAL ] TRV: Derivative data saved (1352 records). [2025-09-14T21:00:46.914145] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-14T21:00:46.930356] [INFO ] [MAIN ] Derivative Progress: 1998/2226 symbols completed. TRV took 1.3s. Estimated remaining: 1m 20s. Rate: 170.9 symbols/min [2025-09-14T21:00:46.959514] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:47.045138] [DEBUG] [LOCAL ] TSLX: Loaded 25877 existing records from primary storage. [2025-09-14T21:00:47.098978] [INFO ] [MAIN ] TSLX: Loaded 25877 primary data records. [2025-09-14T21:00:47.494695] [DEBUG] [LOCAL ] TSM: Loaded 40559 existing records from primary storage. [2025-09-14T21:00:47.495828] [DEBUG] [MAIN ] TSI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:47.510891] [INFO ] [MAIN ] TSM: Loaded 40559 primary data records. [2025-09-14T21:00:47.512324] [INFO ] [MAIN ] TSI: Generated 1352 derivative records from 5477 primary records. [2025-09-14T21:00:47.558702] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-14T21:00:47.786601] [DEBUG] [LOCAL ] TSI: Derivative data saved (1352 records). [2025-09-14T21:00:47.874765] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-14T21:00:48.038848] [INFO ] [MAIN ] Derivative Progress: 1999/2226 symbols completed. TSI took 1.3s. Estimated remaining: 1m 20s. Rate: 170.7 symbols/min [2025-09-14T21:00:48.137922] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:48.197140] [DEBUG] [MAIN ] TSLX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:48.201517] [INFO ] [MAIN ] TSLX: Generated 1352 derivative records from 25877 primary records. [2025-09-14T21:00:48.201936] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-14T21:00:48.229388] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1352 records). [2025-09-14T21:00:48.229820] [DEBUG] [MAIN ] TSM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:48.245445] [INFO ] [MAIN ] TSM: Generated 1352 derivative records from 40559 primary records. [2025-09-14T21:00:48.245608] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-14T21:00:48.246740] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-14T21:00:48.246657] [DEBUG] [LOCAL ] TSN: Loaded 39921 existing records from primary storage. [2025-09-14T21:00:48.249144] [INFO ] [MAIN ] Derivative Progress: 2000/2226 symbols completed. TSLX took 1.5s. Estimated remaining: 1m 19s. Rate: 170.7 symbols/min [2025-09-14T21:00:48.250568] [INFO ] [MAIN ] TSN: Loaded 39921 primary data records. [2025-09-14T21:00:48.265532] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:48.286846] [DEBUG] [LOCAL ] TSM: Derivative data saved (1352 records). [2025-09-14T21:00:48.333683] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-14T21:00:48.366105] [INFO ] [MAIN ] Derivative Progress: 2001/2226 symbols completed. TSM took 1.4s. Estimated remaining: 1m 19s. Rate: 170.8 symbols/min [2025-09-14T21:00:48.383036] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:48.440537] [DEBUG] [LOCAL ] TSQ: Loaded 9524 existing records from primary storage. [2025-09-14T21:00:48.472148] [INFO ] [MAIN ] TSQ: Loaded 9524 primary data records. [2025-09-14T21:00:48.897178] [DEBUG] [LOCAL ] TT: Loaded 35423 existing records from primary storage. [2025-09-14T21:00:48.897442] [INFO ] [MAIN ] TT: Loaded 35423 primary data records. [2025-09-14T21:00:49.087291] [DEBUG] [MAIN ] TSN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:49.119632] [INFO ] [MAIN ] TSN: Generated 1352 derivative records from 39921 primary records. [2025-09-14T21:00:49.209006] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-14T21:00:49.239068] [DEBUG] [MAIN ] TSQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:49.240795] [INFO ] [MAIN ] TSQ: Generated 1352 derivative records from 9524 primary records. [2025-09-14T21:00:49.241374] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-14T21:00:49.243704] [DEBUG] [LOCAL ] TSN: Derivative data saved (1352 records). [2025-09-14T21:00:49.250340] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-14T21:00:49.254269] [INFO ] [MAIN ] Derivative Progress: 2002/2226 symbols completed. TSN took 1.1s. Estimated remaining: 1m 19s. Rate: 170.6 symbols/min [2025-09-14T21:00:49.254538] [INFO ] [MAIN ] TTAM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:49.258302] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1352 records). [2025-09-14T21:00:49.258977] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-14T21:00:49.261843] [INFO ] [MAIN ] Derivative Progress: 2003/2226 symbols completed. TSQ took 1.0s. Estimated remaining: 1m 18s. Rate: 170.7 symbols/min [2025-09-14T21:00:49.262806] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:49.279279] [DEBUG] [MAIN ] TT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:49.280132] [INFO ] [MAIN ] TT: Generated 1352 derivative records from 35423 primary records. [2025-09-14T21:00:49.280277] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-14T21:00:49.302658] [DEBUG] [LOCAL ] TT: Derivative data saved (1352 records). [2025-09-14T21:00:49.309880] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-14T21:00:49.312197] [INFO ] [MAIN ] Derivative Progress: 2004/2226 symbols completed. TT took 0.9s. Estimated remaining: 1m 18s. Rate: 170.8 symbols/min [2025-09-14T21:00:49.312866] [DEBUG] [LOCAL ] TTAM: Loaded 20642 existing records from primary storage. [2025-09-14T21:00:49.322332] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:49.322774] [INFO ] [MAIN ] TTAM: Loaded 20642 primary data records. [2025-09-14T21:00:49.458592] [DEBUG] [LOCAL ] TTC: Loaded 31494 existing records from primary storage. [2025-09-14T21:00:49.459418] [INFO ] [MAIN ] TTC: Loaded 31494 primary data records. [2025-09-14T21:00:49.775485] [DEBUG] [LOCAL ] TTE: Loaded 38684 existing records from primary storage. [2025-09-14T21:00:49.792796] [INFO ] [MAIN ] TTE: Loaded 38684 primary data records. [2025-09-14T21:00:50.307731] [DEBUG] [MAIN ] TTAM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:50.309102] [INFO ] [MAIN ] TTAM: Generated 1352 derivative records from 20642 primary records. [2025-09-14T21:00:50.309379] [DEBUG] [LOCAL ] TTAM: Saving derivative data. [2025-09-14T21:00:50.334344] [DEBUG] [MAIN ] TTC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:50.338635] [INFO ] [MAIN ] TTC: Generated 1352 derivative records from 31494 primary records. [2025-09-14T21:00:50.339714] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-14T21:00:50.339508] [DEBUG] [LOCAL ] TTAM: Derivative data saved (1352 records). [2025-09-14T21:00:50.340728] [INFO ] [MAIN ] TTAM: Successfully saved derivative data. [2025-09-14T21:00:50.349497] [INFO ] [MAIN ] Derivative Progress: 2005/2226 symbols completed. TTAM took 1.1s. Estimated remaining: 1m 18s. Rate: 170.6 symbols/min [2025-09-14T21:00:50.355460] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:50.365862] [DEBUG] [LOCAL ] TTC: Derivative data saved (1352 records). [2025-09-14T21:00:50.370695] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-14T21:00:50.370511] [DEBUG] [MAIN ] TTE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:50.371493] [INFO ] [MAIN ] TTE: Generated 1352 derivative records from 38684 primary records. [2025-09-14T21:00:50.373750] [INFO ] [MAIN ] Derivative Progress: 2006/2226 symbols completed. TTC took 1.1s. Estimated remaining: 1m 17s. Rate: 170.7 symbols/min [2025-09-14T21:00:50.374083] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:50.374264] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-14T21:00:50.388052] [DEBUG] [LOCAL ] TTE: Derivative data saved (1352 records). [2025-09-14T21:00:50.388284] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-14T21:00:50.390934] [INFO ] [MAIN ] Derivative Progress: 2007/2226 symbols completed. TTE took 1.1s. Estimated remaining: 1m 17s. Rate: 170.8 symbols/min [2025-09-14T21:00:50.391681] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:50.418572] [DEBUG] [LOCAL ] TTI: Loaded 34355 existing records from primary storage. [2025-09-14T21:00:50.418955] [INFO ] [MAIN ] TTI: Loaded 34355 primary data records. [2025-09-14T21:00:50.631688] [DEBUG] [LOCAL ] TU: Loaded 37254 existing records from primary storage. [2025-09-14T21:00:50.638767] [DEBUG] [LOCAL ] TUYA: Loaded 34593 existing records from primary storage. [2025-09-14T21:00:50.655722] [INFO ] [MAIN ] TU: Loaded 37254 primary data records. [2025-09-14T21:00:50.658579] [INFO ] [MAIN ] TUYA: Loaded 34593 primary data records. [2025-09-14T21:00:51.361809] [DEBUG] [MAIN ] TTI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:51.363338] [INFO ] [MAIN ] TTI: Generated 1352 derivative records from 34355 primary records. [2025-09-14T21:00:51.363707] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-14T21:00:51.390295] [DEBUG] [LOCAL ] TTI: Derivative data saved (1352 records). [2025-09-14T21:00:51.392009] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-14T21:00:51.394664] [INFO ] [MAIN ] Derivative Progress: 2008/2226 symbols completed. TTI took 1.0s. Estimated remaining: 1m 17s. Rate: 170.6 symbols/min [2025-09-14T21:00:51.391914] [DEBUG] [MAIN ] TU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:51.396759] [INFO ] [MAIN ] TU: Generated 1352 derivative records from 37254 primary records. [2025-09-14T21:00:51.397520] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-14T21:00:51.408799] [DEBUG] [MAIN ] TUYA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:51.419042] [INFO ] [MAIN ] TUYA: Generated 1352 derivative records from 34593 primary records. [2025-09-14T21:00:51.421696] [DEBUG] [LOCAL ] TU: Derivative data saved (1352 records). [2025-09-14T21:00:51.421798] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-14T21:00:51.421933] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-14T21:00:51.424794] [INFO ] [MAIN ] Derivative Progress: 2009/2226 symbols completed. TU took 1.1s. Estimated remaining: 1m 16s. Rate: 170.7 symbols/min [2025-09-14T21:00:51.436562] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1352 records). [2025-09-14T21:00:51.436735] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-14T21:00:51.438624] [INFO ] [MAIN ] Derivative Progress: 2010/2226 symbols completed. TUYA took 1.0s. Estimated remaining: 1m 16s. Rate: 170.8 symbols/min [2025-09-14T21:00:51.439366] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:51.439308] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:51.439177] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:51.447406] [DEBUG] [LOCAL ] TVC: Loaded 2461 existing records from primary storage. [2025-09-14T21:00:51.447704] [INFO ] [MAIN ] TVC: Loaded 2461 primary data records. [2025-09-14T21:00:51.471840] [DEBUG] [LOCAL ] TVE: Loaded 1916 existing records from primary storage. [2025-09-14T21:00:51.501282] [INFO ] [MAIN ] TVE: Loaded 1916 primary data records. [2025-09-14T21:00:51.943181] [DEBUG] [LOCAL ] TV: Loaded 32076 existing records from primary storage. [2025-09-14T21:00:51.979900] [INFO ] [MAIN ] TV: Loaded 32076 primary data records. [2025-09-14T21:00:52.439082] [DEBUG] [MAIN ] TVC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:52.441380] [INFO ] [MAIN ] TVC: Generated 1352 derivative records from 2461 primary records. [2025-09-14T21:00:52.443205] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-14T21:00:52.465118] [DEBUG] [MAIN ] TVE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:52.467677] [DEBUG] [LOCAL ] TVC: Derivative data saved (1352 records). [2025-09-14T21:00:52.468535] [INFO ] [MAIN ] TVE: Generated 1352 derivative records from 1916 primary records. [2025-09-14T21:00:52.469098] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-14T21:00:52.469002] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-14T21:00:52.470840] [INFO ] [MAIN ] Derivative Progress: 2011/2226 symbols completed. TVC took 1.0s. Estimated remaining: 1m 16s. Rate: 170.6 symbols/min [2025-09-14T21:00:52.472405] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:52.483464] [DEBUG] [LOCAL ] TVE: Derivative data saved (1352 records). [2025-09-14T21:00:52.484043] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-14T21:00:52.486631] [INFO ] [MAIN ] Derivative Progress: 2012/2226 symbols completed. TVE took 1.0s. Estimated remaining: 1m 15s. Rate: 170.7 symbols/min [2025-09-14T21:00:52.487208] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:52.501201] [DEBUG] [MAIN ] TV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:52.502082] [INFO ] [MAIN ] TV: Generated 1352 derivative records from 32076 primary records. [2025-09-14T21:00:52.502206] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-14T21:00:52.527505] [DEBUG] [LOCAL ] TV: Derivative data saved (1352 records). [2025-09-14T21:00:52.528034] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-14T21:00:52.530530] [INFO ] [MAIN ] Derivative Progress: 2013/2226 symbols completed. TV took 1.1s. Estimated remaining: 1m 15s. Rate: 170.8 symbols/min [2025-09-14T21:00:52.531431] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:52.546823] [DEBUG] [LOCAL ] TWI: Loaded 24960 existing records from primary storage. [2025-09-14T21:00:52.547123] [INFO ] [MAIN ] TWI: Loaded 24960 primary data records. [2025-09-14T21:00:52.549394] [DEBUG] [LOCAL ] TWN: Loaded 2087 existing records from primary storage. [2025-09-14T21:00:52.555054] [INFO ] [MAIN ] TWN: Loaded 2087 primary data records. [2025-09-14T21:00:52.816204] [DEBUG] [LOCAL ] TWLO: Loaded 39700 existing records from primary storage. [2025-09-14T21:00:52.871065] [INFO ] [MAIN ] TWLO: Loaded 39700 primary data records. [2025-09-14T21:00:53.461359] [DEBUG] [MAIN ] TWI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:53.464503] [INFO ] [MAIN ] TWI: Generated 1352 derivative records from 24960 primary records. [2025-09-14T21:00:53.471045] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-14T21:00:53.476670] [DEBUG] [MAIN ] TWN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:53.478065] [INFO ] [MAIN ] TWN: Generated 1352 derivative records from 2087 primary records. [2025-09-14T21:00:53.490301] [DEBUG] [LOCAL ] TWI: Derivative data saved (1352 records). [2025-09-14T21:00:53.490417] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-14T21:00:53.491787] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-14T21:00:53.494042] [INFO ] [MAIN ] Derivative Progress: 2014/2226 symbols completed. TWI took 1.0s. Estimated remaining: 1m 15s. Rate: 170.6 symbols/min [2025-09-14T21:00:53.507697] [DEBUG] [LOCAL ] TWN: Derivative data saved (1352 records). [2025-09-14T21:00:53.507865] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-14T21:00:53.505800] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:53.510834] [INFO ] [MAIN ] Derivative Progress: 2015/2226 symbols completed. TWN took 1.0s. Estimated remaining: 1m 14s. Rate: 170.7 symbols/min [2025-09-14T21:00:53.511225] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:53.522558] [DEBUG] [MAIN ] TWLO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:53.523500] [INFO ] [MAIN ] TWLO: Generated 1352 derivative records from 39700 primary records. [2025-09-14T21:00:53.523619] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-14T21:00:53.537371] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1352 records). [2025-09-14T21:00:53.541997] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-14T21:00:53.544093] [INFO ] [MAIN ] Derivative Progress: 2016/2226 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 14s. Rate: 170.8 symbols/min [2025-09-14T21:00:53.544523] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:53.552346] [DEBUG] [LOCAL ] TX: Loaded 17265 existing records from primary storage. [2025-09-14T21:00:53.552497] [INFO ] [MAIN ] TX: Loaded 17265 primary data records. [2025-09-14T21:00:53.754807] [DEBUG] [LOCAL ] TWO: Loaded 36371 existing records from primary storage. [2025-09-14T21:00:53.871784] [INFO ] [MAIN ] TWO: Loaded 36371 primary data records. [2025-09-14T21:00:53.899156] [DEBUG] [LOCAL ] TXNM: Loaded 32680 existing records from primary storage. [2025-09-14T21:00:53.938232] [INFO ] [MAIN ] TXNM: Loaded 32680 primary data records. [2025-09-14T21:00:54.507192] [DEBUG] [MAIN ] TX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:54.510100] [INFO ] [MAIN ] TX: Generated 1352 derivative records from 17265 primary records. [2025-09-14T21:00:54.511143] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-14T21:00:54.531994] [DEBUG] [LOCAL ] TX: Derivative data saved (1352 records). [2025-09-14T21:00:54.532949] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-14T21:00:54.535812] [INFO ] [MAIN ] Derivative Progress: 2017/2226 symbols completed. TX took 1.0s. Estimated remaining: 1m 13s. Rate: 170.6 symbols/min [2025-09-14T21:00:54.537552] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:54.564261] [DEBUG] [MAIN ] TWO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:54.569382] [DEBUG] [MAIN ] TXNM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:54.569026] [INFO ] [MAIN ] TWO: Generated 1352 derivative records from 36371 primary records. [2025-09-14T21:00:54.570186] [INFO ] [MAIN ] TXNM: Generated 1352 derivative records from 32680 primary records. [2025-09-14T21:00:54.570597] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-14T21:00:54.570718] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-14T21:00:54.599827] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1352 records). [2025-09-14T21:00:54.603588] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-14T21:00:54.605751] [INFO ] [MAIN ] Derivative Progress: 2018/2226 symbols completed. TXNM took 1.1s. Estimated remaining: 1m 13s. Rate: 170.7 symbols/min [2025-09-14T21:00:54.606146] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:54.602943] [DEBUG] [LOCAL ] TWO: Derivative data saved (1352 records). [2025-09-14T21:00:54.614836] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-14T21:00:54.615284] [DEBUG] [LOCAL ] TXO: Loaded 15084 existing records from primary storage. [2025-09-14T21:00:54.618160] [INFO ] [MAIN ] Derivative Progress: 2019/2226 symbols completed. TWO took 1.1s. Estimated remaining: 1m 13s. Rate: 170.8 symbols/min [2025-09-14T21:00:54.618698] [INFO ] [MAIN ] TXO: Loaded 15084 primary data records. [2025-09-14T21:00:54.632790] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:54.785888] [DEBUG] [LOCAL ] TY: Loaded 5557 existing records from primary storage. [2025-09-14T21:00:54.821568] [INFO ] [MAIN ] TY: Loaded 5557 primary data records. [2025-09-14T21:00:55.083104] [DEBUG] [LOCAL ] TXT: Loaded 37229 existing records from primary storage. [2025-09-14T21:00:55.108398] [INFO ] [MAIN ] TXT: Loaded 37229 primary data records. [2025-09-14T21:00:55.605504] [DEBUG] [MAIN ] TXO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:55.607902] [INFO ] [MAIN ] TXO: Generated 1352 derivative records from 15084 primary records. [2025-09-14T21:00:55.608293] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-14T21:00:55.623456] [DEBUG] [LOCAL ] TXO: Derivative data saved (1352 records). [2025-09-14T21:00:55.624611] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-14T21:00:55.627046] [INFO ] [MAIN ] Derivative Progress: 2020/2226 symbols completed. TXO took 1.1s. Estimated remaining: 1m 12s. Rate: 170.6 symbols/min [2025-09-14T21:00:55.629283] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:55.641950] [DEBUG] [MAIN ] TY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:55.643081] [INFO ] [MAIN ] TY: Generated 1352 derivative records from 5557 primary records. [2025-09-14T21:00:55.645820] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-14T21:00:55.654281] [DEBUG] [LOCAL ] TYG: Loaded 10517 existing records from primary storage. [2025-09-14T21:00:55.673112] [INFO ] [MAIN ] TYG: Loaded 10517 primary data records. [2025-09-14T21:00:55.674253] [DEBUG] [MAIN ] TXT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:55.688541] [INFO ] [MAIN ] TXT: Generated 1352 derivative records from 37229 primary records. [2025-09-14T21:00:55.699203] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-14T21:00:55.724839] [DEBUG] [LOCAL ] TY: Derivative data saved (1352 records). [2025-09-14T21:00:55.730862] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-14T21:00:55.764251] [INFO ] [MAIN ] Derivative Progress: 2021/2226 symbols completed. TY took 1.1s. Estimated remaining: 1m 12s. Rate: 170.7 symbols/min [2025-09-14T21:00:55.806293] [DEBUG] [LOCAL ] TXT: Derivative data saved (1352 records). [2025-09-14T21:00:55.801896] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:55.806498] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-14T21:00:55.809246] [INFO ] [MAIN ] Derivative Progress: 2022/2226 symbols completed. TXT took 1.2s. Estimated remaining: 1m 12s. Rate: 170.7 symbols/min [2025-09-14T21:00:55.810917] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:55.999436] [DEBUG] [LOCAL ] TYL: Loaded 16551 existing records from primary storage. [2025-09-14T21:00:56.000119] [INFO ] [MAIN ] TYL: Loaded 16551 primary data records. [2025-09-14T21:00:56.233142] [DEBUG] [LOCAL ] U: Loaded 40539 existing records from primary storage. [2025-09-14T21:00:56.327415] [INFO ] [MAIN ] U: Loaded 40539 primary data records. [2025-09-14T21:00:56.338341] [DEBUG] [MAIN ] TYG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:56.362405] [INFO ] [MAIN ] TYG: Generated 1352 derivative records from 10517 primary records. [2025-09-14T21:00:56.414805] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-14T21:00:56.645923] [DEBUG] [LOCAL ] TYG: Derivative data saved (1352 records). [2025-09-14T21:00:56.646096] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-14T21:00:56.648156] [INFO ] [MAIN ] Derivative Progress: 2023/2226 symbols completed. TYG took 1.0s. Estimated remaining: 1m 11s. Rate: 170.6 symbols/min [2025-09-14T21:00:56.663981] [DEBUG] [MAIN ] TYL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:56.664837] [INFO ] [MAIN ] TYL: Generated 1352 derivative records from 16551 primary records. [2025-09-14T21:00:56.665915] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-14T21:00:56.679452] [DEBUG] [LOCAL ] TYL: Derivative data saved (1352 records). [2025-09-14T21:00:56.679701] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-14T21:00:56.683239] [INFO ] [MAIN ] Derivative Progress: 2024/2226 symbols completed. TYL took 0.9s. Estimated remaining: 1m 11s. Rate: 170.7 symbols/min [2025-09-14T21:00:56.694290] [DEBUG] [MAIN ] U: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:56.695072] [INFO ] [MAIN ] U: Generated 1352 derivative records from 40539 primary records. [2025-09-14T21:00:56.695148] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-14T21:00:56.707546] [DEBUG] [LOCAL ] U: Derivative data saved (1352 records). [2025-09-14T21:00:56.707680] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-14T21:00:56.710586] [INFO ] [MAIN ] Derivative Progress: 2025/2226 symbols completed. U took 0.9s. Estimated remaining: 1m 11s. Rate: 170.8 symbols/min [2025-09-14T21:00:56.711259] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:56.711303] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:56.711133] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:56.739735] [DEBUG] [LOCAL ] UAN: Loaded 3947 existing records from primary storage. [2025-09-14T21:00:56.740019] [INFO ] [MAIN ] UAN: Loaded 3947 primary data records. [2025-09-14T21:00:57.056502] [DEBUG] [LOCAL ] UAA: Loaded 40267 existing records from primary storage. [2025-09-14T21:00:57.057314] [INFO ] [MAIN ] UAA: Loaded 40267 primary data records. [2025-09-14T21:00:57.143444] [DEBUG] [LOCAL ] UA: Loaded 37590 existing records from primary storage. [2025-09-14T21:00:57.179534] [INFO ] [MAIN ] UA: Loaded 37590 primary data records. [2025-09-14T21:00:57.720236] [DEBUG] [MAIN ] UAN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:57.734407] [INFO ] [MAIN ] UAN: Generated 1352 derivative records from 3947 primary records. [2025-09-14T21:00:57.734746] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-14T21:00:57.749489] [DEBUG] [LOCAL ] UAN: Derivative data saved (1352 records). [2025-09-14T21:00:57.750011] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-14T21:00:57.753250] [INFO ] [MAIN ] Derivative Progress: 2026/2226 symbols completed. UAN took 1.0s. Estimated remaining: 1m 10s. Rate: 170.6 symbols/min [2025-09-14T21:00:57.754046] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:57.774340] [DEBUG] [MAIN ] UAA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:57.775558] [INFO ] [MAIN ] UAA: Generated 1352 derivative records from 40267 primary records. [2025-09-14T21:00:57.775723] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-14T21:00:57.799340] [DEBUG] [LOCAL ] UAA: Derivative data saved (1352 records). [2025-09-14T21:00:57.810038] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-14T21:00:57.810699] [DEBUG] [MAIN ] UA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:57.812723] [INFO ] [MAIN ] Derivative Progress: 2027/2226 symbols completed. UAA took 1.1s. Estimated remaining: 1m 10s. Rate: 170.7 symbols/min [2025-09-14T21:00:57.813830] [INFO ] [MAIN ] UA: Generated 1352 derivative records from 37590 primary records. [2025-09-14T21:00:57.814254] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:57.823845] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-14T21:00:57.837840] [DEBUG] [LOCAL ] UA: Derivative data saved (1352 records). [2025-09-14T21:00:57.838145] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-14T21:00:57.840294] [INFO ] [MAIN ] Derivative Progress: 2028/2226 symbols completed. UA took 1.1s. Estimated remaining: 1m 10s. Rate: 170.8 symbols/min [2025-09-14T21:00:57.840918] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:57.856583] [DEBUG] [LOCAL ] UBER: Loaded 40546 existing records from primary storage. [2025-09-14T21:00:57.857075] [INFO ] [MAIN ] UBER: Loaded 40546 primary data records. [2025-09-14T21:00:58.157953] [DEBUG] [LOCAL ] UBS: Loaded 39338 existing records from primary storage. [2025-09-14T21:00:58.168940] [INFO ] [MAIN ] UBS: Loaded 39338 primary data records. [2025-09-14T21:00:58.181122] [DEBUG] [LOCAL ] UCB: Loaded 27887 existing records from primary storage. [2025-09-14T21:00:58.214294] [INFO ] [MAIN ] UCB: Loaded 27887 primary data records. [2025-09-14T21:00:58.786995] [DEBUG] [MAIN ] UBER: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:58.788385] [INFO ] [MAIN ] UBER: Generated 1352 derivative records from 40546 primary records. [2025-09-14T21:00:58.789384] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-14T21:00:58.821837] [DEBUG] [LOCAL ] UBER: Derivative data saved (1352 records). [2025-09-14T21:00:58.822724] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-14T21:00:58.822607] [DEBUG] [MAIN ] UBS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:58.826195] [INFO ] [MAIN ] Derivative Progress: 2029/2226 symbols completed. UBER took 1.1s. Estimated remaining: 1m 9s. Rate: 170.6 symbols/min [2025-09-14T21:00:58.828580] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:58.828313] [INFO ] [MAIN ] UBS: Generated 1352 derivative records from 39338 primary records. [2025-09-14T21:00:58.830946] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-14T21:00:58.851874] [DEBUG] [MAIN ] UCB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:58.857422] [DEBUG] [LOCAL ] UBS: Derivative data saved (1352 records). [2025-09-14T21:00:58.858577] [INFO ] [MAIN ] UCB: Generated 1352 derivative records from 27887 primary records. [2025-09-14T21:00:58.858770] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-14T21:00:58.859025] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-14T21:00:58.861272] [INFO ] [MAIN ] Derivative Progress: 2030/2226 symbols completed. UBS took 1.0s. Estimated remaining: 1m 9s. Rate: 170.7 symbols/min [2025-09-14T21:00:58.863033] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:58.875790] [DEBUG] [LOCAL ] UCB: Derivative data saved (1352 records). [2025-09-14T21:00:58.876196] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-14T21:00:58.881185] [INFO ] [MAIN ] Derivative Progress: 2031/2226 symbols completed. UCB took 1.0s. Estimated remaining: 1m 9s. Rate: 170.8 symbols/min [2025-09-14T21:00:58.881776] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:58.900019] [DEBUG] [LOCAL ] UFI: Loaded 5775 existing records from primary storage. [2025-09-14T21:00:58.900314] [INFO ] [MAIN ] UFI: Loaded 5775 primary data records. [2025-09-14T21:00:59.071280] [DEBUG] [LOCAL ] UE: Loaded 32294 existing records from primary storage. [2025-09-14T21:00:59.094157] [DEBUG] [LOCAL ] UDR: Loaded 39067 existing records from primary storage. [2025-09-14T21:00:59.103004] [INFO ] [MAIN ] UE: Loaded 32294 primary data records. [2025-09-14T21:00:59.140541] [INFO ] [MAIN ] UDR: Loaded 39067 primary data records. [2025-09-14T21:00:59.898767] [DEBUG] [MAIN ] UFI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:59.901103] [INFO ] [MAIN ] UFI: Generated 1352 derivative records from 5775 primary records. [2025-09-14T21:00:59.903442] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-14T21:00:59.923679] [DEBUG] [MAIN ] UE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:59.927778] [DEBUG] [LOCAL ] UFI: Derivative data saved (1352 records). [2025-09-14T21:00:59.929304] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-14T21:00:59.929020] [INFO ] [MAIN ] UE: Generated 1352 derivative records from 32294 primary records. [2025-09-14T21:00:59.931244] [INFO ] [MAIN ] Derivative Progress: 2032/2226 symbols completed. UFI took 1.0s. Estimated remaining: 1m 8s. Rate: 170.6 symbols/min [2025-09-14T21:00:59.932550] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:59.933911] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-14T21:00:59.960392] [DEBUG] [LOCAL ] UE: Derivative data saved (1352 records). [2025-09-14T21:00:59.961653] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-14T21:00:59.961244] [DEBUG] [MAIN ] UDR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:00:59.964373] [INFO ] [MAIN ] Derivative Progress: 2033/2226 symbols completed. UE took 1.1s. Estimated remaining: 1m 8s. Rate: 170.7 symbols/min [2025-09-14T21:00:59.965574] [INFO ] [MAIN ] UDR: Generated 1352 derivative records from 39067 primary records. [2025-09-14T21:00:59.966014] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:00:59.966101] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-14T21:00:59.981039] [DEBUG] [LOCAL ] UDR: Derivative data saved (1352 records). [2025-09-14T21:00:59.981300] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-14T21:00:59.983386] [INFO ] [MAIN ] Derivative Progress: 2034/2226 symbols completed. UDR took 1.2s. Estimated remaining: 1m 7s. Rate: 170.8 symbols/min [2025-09-14T21:00:59.983920] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:00.032416] [DEBUG] [LOCAL ] UHAL: Loaded 12351 existing records from primary storage. [2025-09-14T21:01:00.034489] [INFO ] [MAIN ] UHAL: Loaded 12351 primary data records. [2025-09-14T21:01:00.033720] [DEBUG] [LOCAL ] UGI: Loaded 37909 existing records from primary storage. [2025-09-14T21:01:00.060343] [INFO ] [MAIN ] UGI: Loaded 37909 primary data records. [2025-09-14T21:01:00.085380] [DEBUG] [LOCAL ] UGP: Loaded 32057 existing records from primary storage. [2025-09-14T21:01:00.168513] [INFO ] [MAIN ] UGP: Loaded 32057 primary data records. [2025-09-14T21:01:00.955694] [DEBUG] [MAIN ] UHAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:00.959230] [INFO ] [MAIN ] UHAL: Generated 1352 derivative records from 12351 primary records. [2025-09-14T21:01:00.967800] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-14T21:01:00.982999] [DEBUG] [MAIN ] UGP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:00.982473] [DEBUG] [MAIN ] UGI: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:01:00.984471] [INFO ] [MAIN ] UGP: Generated 1352 derivative records from 32057 primary records. [2025-09-14T21:01:00.985313] [INFO ] [MAIN ] UGI: Generated 1351 derivative records from 37909 primary records. [2025-09-14T21:01:00.992162] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-14T21:01:00.994579] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-14T21:01:01.000226] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1352 records). [2025-09-14T21:01:01.006260] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-14T21:01:01.021107] [INFO ] [MAIN ] Derivative Progress: 2035/2226 symbols completed. UHAL took 1.0s. Estimated remaining: 1m 7s. Rate: 170.6 symbols/min [2025-09-14T21:01:01.025103] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:01.027739] [DEBUG] [LOCAL ] UGI: Derivative data saved (1351 records). [2025-09-14T21:01:01.027927] [DEBUG] [LOCAL ] UGP: Derivative data saved (1352 records). [2025-09-14T21:01:01.028316] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-14T21:01:01.028405] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-14T21:01:01.030545] [INFO ] [MAIN ] Derivative Progress: 2036/2226 symbols completed. UGP took 1.1s. Estimated remaining: 1m 7s. Rate: 170.7 symbols/min [2025-09-14T21:01:01.033856] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:01.033914] [INFO ] [MAIN ] Derivative Progress: 2037/2226 symbols completed. UGI took 1.1s. Estimated remaining: 1m 6s. Rate: 170.8 symbols/min [2025-09-14T21:01:01.034295] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:01.044457] [DEBUG] [LOCAL ] UHT: Loaded 7207 existing records from primary storage. [2025-09-14T21:01:01.047448] [INFO ] [MAIN ] UHT: Loaded 7207 primary data records. [2025-09-14T21:01:01.105631] [DEBUG] [LOCAL ] UI: Loaded 9559 existing records from primary storage. [2025-09-14T21:01:01.148391] [INFO ] [MAIN ] UI: Loaded 9559 primary data records. [2025-09-14T21:01:01.278452] [DEBUG] [LOCAL ] UHS: Loaded 30491 existing records from primary storage. [2025-09-14T21:01:01.335319] [INFO ] [MAIN ] UHS: Loaded 30491 primary data records. [2025-09-14T21:01:01.990610] [DEBUG] [MAIN ] UHT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:01.991708] [INFO ] [MAIN ] UHT: Generated 1352 derivative records from 7207 primary records. [2025-09-14T21:01:01.993002] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-14T21:01:02.015353] [DEBUG] [MAIN ] UI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:02.017058] [INFO ] [MAIN ] UI: Generated 1352 derivative records from 9559 primary records. [2025-09-14T21:01:02.018008] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-14T21:01:02.021629] [DEBUG] [LOCAL ] UHT: Derivative data saved (1352 records). [2025-09-14T21:01:02.022876] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-14T21:01:02.034241] [INFO ] [MAIN ] Derivative Progress: 2038/2226 symbols completed. UHT took 1.0s. Estimated remaining: 1m 6s. Rate: 170.6 symbols/min [2025-09-14T21:01:02.048385] [DEBUG] [LOCAL ] UI: Derivative data saved (1352 records). [2025-09-14T21:01:02.048590] [DEBUG] [MAIN ] UHS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:02.048821] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-14T21:01:02.049478] [INFO ] [MAIN ] UHS: Generated 1352 derivative records from 30491 primary records. [2025-09-14T21:01:02.051962] [INFO ] [MAIN ] Derivative Progress: 2039/2226 symbols completed. UI took 1.0s. Estimated remaining: 1m 6s. Rate: 170.7 symbols/min [2025-09-14T21:01:02.052199] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-14T21:01:02.064298] [DEBUG] [LOCAL ] UHS: Derivative data saved (1352 records). [2025-09-14T21:01:02.064385] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-14T21:01:02.066224] [INFO ] [MAIN ] Derivative Progress: 2040/2226 symbols completed. UHS took 1.0s. Estimated remaining: 1m 5s. Rate: 170.8 symbols/min [2025-09-14T21:01:02.066840] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:02.066803] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:02.066881] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:02.124383] [DEBUG] [LOCAL ] UIS: Loaded 27885 existing records from primary storage. [2025-09-14T21:01:02.126025] [INFO ] [MAIN ] UIS: Loaded 27885 primary data records. [2025-09-14T21:01:02.126692] [DEBUG] [LOCAL ] ULS: Loaded 29571 existing records from primary storage. [2025-09-14T21:01:02.212959] [INFO ] [MAIN ] ULS: Loaded 29571 primary data records. [2025-09-14T21:01:02.264571] [DEBUG] [LOCAL ] UL: Loaded 39887 existing records from primary storage. [2025-09-14T21:01:02.357070] [INFO ] [MAIN ] UL: Loaded 39887 primary data records. [2025-09-14T21:01:03.085699] [DEBUG] [MAIN ] UIS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:03.088207] [INFO ] [MAIN ] UIS: Generated 1352 derivative records from 27885 primary records. [2025-09-14T21:01:03.088412] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-14T21:01:03.105322] [DEBUG] [LOCAL ] UIS: Derivative data saved (1352 records). [2025-09-14T21:01:03.116389] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-14T21:01:03.118970] [INFO ] [MAIN ] Derivative Progress: 2041/2226 symbols completed. UIS took 1.1s. Estimated remaining: 1m 5s. Rate: 170.6 symbols/min [2025-09-14T21:01:03.116278] [DEBUG] [MAIN ] ULS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:03.119359] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:03.120198] [INFO ] [MAIN ] ULS: Generated 1352 derivative records from 29571 primary records. [2025-09-14T21:01:03.121452] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-14T21:01:03.146607] [DEBUG] [LOCAL ] ULS: Derivative data saved (1352 records). [2025-09-14T21:01:03.144244] [DEBUG] [MAIN ] UL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:03.146949] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-14T21:01:03.150690] [INFO ] [MAIN ] Derivative Progress: 2042/2226 symbols completed. ULS took 1.1s. Estimated remaining: 1m 5s. Rate: 170.7 symbols/min [2025-09-14T21:01:03.148126] [INFO ] [MAIN ] UL: Generated 1352 derivative records from 39887 primary records. [2025-09-14T21:01:03.151096] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:03.151437] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-14T21:01:03.165167] [DEBUG] [LOCAL ] UL: Derivative data saved (1352 records). [2025-09-14T21:01:03.165566] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-14T21:01:03.167731] [INFO ] [MAIN ] Derivative Progress: 2043/2226 symbols completed. UL took 1.1s. Estimated remaining: 1m 4s. Rate: 170.7 symbols/min [2025-09-14T21:01:03.180037] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:03.212875] [DEBUG] [LOCAL ] UMC: Loaded 39585 existing records from primary storage. [2025-09-14T21:01:03.211279] [DEBUG] [LOCAL ] UMH: Loaded 24551 existing records from primary storage. [2025-09-14T21:01:03.216918] [INFO ] [MAIN ] UMC: Loaded 39585 primary data records. [2025-09-14T21:01:03.217060] [INFO ] [MAIN ] UMH: Loaded 24551 primary data records. [2025-09-14T21:01:03.217705] [DEBUG] [LOCAL ] UNF: Loaded 7992 existing records from primary storage. [2025-09-14T21:01:03.265955] [INFO ] [MAIN ] UNF: Loaded 7992 primary data records. [2025-09-14T21:01:04.142283] [DEBUG] [MAIN ] UNF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:04.142606] [DEBUG] [MAIN ] UMH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:04.145213] [INFO ] [MAIN ] UNF: Generated 1352 derivative records from 7992 primary records. [2025-09-14T21:01:04.145669] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-14T21:01:04.154504] [INFO ] [MAIN ] UMH: Generated 1352 derivative records from 24551 primary records. [2025-09-14T21:01:04.154712] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-14T21:01:04.171435] [DEBUG] [MAIN ] UMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:04.171511] [DEBUG] [LOCAL ] UNF: Derivative data saved (1352 records). [2025-09-14T21:01:04.172687] [INFO ] [MAIN ] UMC: Generated 1352 derivative records from 39585 primary records. [2025-09-14T21:01:04.178686] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-14T21:01:04.181390] [INFO ] [MAIN ] Derivative Progress: 2044/2226 symbols completed. UNF took 1.0s. Estimated remaining: 1m 4s. Rate: 170.6 symbols/min [2025-09-14T21:01:04.182403] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-14T21:01:04.187824] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:04.196305] [DEBUG] [LOCAL ] UMH: Derivative data saved (1352 records). [2025-09-14T21:01:04.198801] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-14T21:01:04.200856] [INFO ] [MAIN ] Derivative Progress: 2045/2226 symbols completed. UMH took 1.0s. Estimated remaining: 1m 4s. Rate: 170.7 symbols/min [2025-09-14T21:01:04.201341] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:04.205536] [DEBUG] [LOCAL ] UMC: Derivative data saved (1352 records). [2025-09-14T21:01:04.205983] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-14T21:01:04.208617] [INFO ] [MAIN ] Derivative Progress: 2046/2226 symbols completed. UMC took 1.1s. Estimated remaining: 1m 3s. Rate: 170.8 symbols/min [2025-09-14T21:01:04.209262] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:04.244354] [DEBUG] [LOCAL ] UNFI: Loaded 31533 existing records from primary storage. [2025-09-14T21:01:04.244543] [INFO ] [MAIN ] UNFI: Loaded 31533 primary data records. [2025-09-14T21:01:04.411749] [DEBUG] [LOCAL ] UNM: Loaded 36281 existing records from primary storage. [2025-09-14T21:01:04.455522] [INFO ] [MAIN ] UNM: Loaded 36281 primary data records. [2025-09-14T21:01:04.488271] [DEBUG] [LOCAL ] UNH: Loaded 40559 existing records from primary storage. [2025-09-14T21:01:04.588287] [INFO ] [MAIN ] UNH: Loaded 40559 primary data records. [2025-09-14T21:01:05.241017] [DEBUG] [MAIN ] UNFI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:05.243222] [INFO ] [MAIN ] UNFI: Generated 1352 derivative records from 31533 primary records. [2025-09-14T21:01:05.243456] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-14T21:01:05.260558] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1352 records). [2025-09-14T21:01:05.261250] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-14T21:01:05.263166] [INFO ] [MAIN ] Derivative Progress: 2047/2226 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 3s. Rate: 170.6 symbols/min [2025-09-14T21:01:05.264543] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:05.274317] [DEBUG] [LOCAL ] UNMA: Loaded 2618 existing records from primary storage. [2025-09-14T21:01:05.295210] [DEBUG] [MAIN ] UNH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:05.295702] [DEBUG] [MAIN ] UNM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:05.295300] [INFO ] [MAIN ] UNMA: Loaded 2618 primary data records. [2025-09-14T21:01:05.296500] [INFO ] [MAIN ] UNH: Generated 1352 derivative records from 40559 primary records. [2025-09-14T21:01:05.297191] [INFO ] [MAIN ] UNM: Generated 1352 derivative records from 36281 primary records. [2025-09-14T21:01:05.297381] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-14T21:01:05.330040] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-14T21:01:05.432094] [DEBUG] [LOCAL ] UNH: Derivative data saved (1352 records). [2025-09-14T21:01:05.439223] [DEBUG] [LOCAL ] UNM: Derivative data saved (1352 records). [2025-09-14T21:01:05.450168] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-14T21:01:05.465970] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-14T21:01:05.468434] [INFO ] [MAIN ] Derivative Progress: 2048/2226 symbols completed. UNH took 1.3s. Estimated remaining: 1m 3s. Rate: 170.6 symbols/min [2025-09-14T21:01:05.505475] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:05.505303] [INFO ] [MAIN ] Derivative Progress: 2049/2226 symbols completed. UNM took 1.3s. Estimated remaining: 1m 2s. Rate: 170.7 symbols/min [2025-09-14T21:01:05.529481] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:05.672199] [DEBUG] [MAIN ] UNMA: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:01:05.683497] [INFO ] [MAIN ] UNMA: Generated 1351 derivative records from 2618 primary records. [2025-09-14T21:01:05.691831] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-14T21:01:05.705055] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1351 records). [2025-09-14T21:01:05.705916] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-14T21:01:05.707718] [INFO ] [MAIN ] Derivative Progress: 2050/2226 symbols completed. UNMA took 0.4s. Estimated remaining: 1m 2s. Rate: 170.7 symbols/min [2025-09-14T21:01:05.718306] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:05.732116] [DEBUG] [LOCAL ] UNP: Loaded 40169 existing records from primary storage. [2025-09-14T21:01:05.733029] [DEBUG] [LOCAL ] UP: Loaded 32128 existing records from primary storage. [2025-09-14T21:01:05.733371] [INFO ] [MAIN ] UNP: Loaded 40169 primary data records. [2025-09-14T21:01:05.733307] [INFO ] [MAIN ] UP: Loaded 32128 primary data records. [2025-09-14T21:01:06.327924] [DEBUG] [LOCAL ] UPS: Loaded 40461 existing records from primary storage. [2025-09-14T21:01:06.328911] [INFO ] [MAIN ] UPS: Loaded 40461 primary data records. [2025-09-14T21:01:06.662301] [DEBUG] [MAIN ] UP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:06.673217] [INFO ] [MAIN ] UP: Generated 1352 derivative records from 32128 primary records. [2025-09-14T21:01:06.672211] [DEBUG] [MAIN ] UNP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:06.673806] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-14T21:01:06.674466] [INFO ] [MAIN ] UNP: Generated 1352 derivative records from 40169 primary records. [2025-09-14T21:01:06.675628] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-14T21:01:06.701839] [DEBUG] [LOCAL ] UP: Derivative data saved (1352 records). [2025-09-14T21:01:06.703105] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-14T21:01:06.705737] [INFO ] [MAIN ] Derivative Progress: 2051/2226 symbols completed. UP took 1.2s. Estimated remaining: 1m 2s. Rate: 170.6 symbols/min [2025-09-14T21:01:06.706558] [DEBUG] [LOCAL ] UNP: Derivative data saved (1352 records). [2025-09-14T21:01:06.706678] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-14T21:01:06.707052] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:06.708665] [INFO ] [MAIN ] Derivative Progress: 2052/2226 symbols completed. UNP took 1.2s. Estimated remaining: 1m 1s. Rate: 170.7 symbols/min [2025-09-14T21:01:06.709195] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:06.724894] [DEBUG] [MAIN ] UPS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:06.725832] [INFO ] [MAIN ] UPS: Generated 1352 derivative records from 40461 primary records. [2025-09-14T21:01:06.725949] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-14T21:01:06.739073] [DEBUG] [LOCAL ] UPS: Derivative data saved (1352 records). [2025-09-14T21:01:06.739275] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-14T21:01:06.741313] [INFO ] [MAIN ] Derivative Progress: 2053/2226 symbols completed. UPS took 1.0s. Estimated remaining: 1m 1s. Rate: 170.7 symbols/min [2025-09-14T21:01:06.768801] [DEBUG] [LOCAL ] USA: Loaded 26260 existing records from primary storage. [2025-09-14T21:01:06.769028] [INFO ] [MAIN ] USA: Loaded 26260 primary data records. [2025-09-14T21:01:06.865009] [DEBUG] [LOCAL ] URI: Loaded 26247 existing records from primary storage. [2025-09-14T21:01:06.890876] [INFO ] [MAIN ] URI: Loaded 26247 primary data records. [2025-09-14T21:01:07.431034] [DEBUG] [MAIN ] USA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:07.432547] [INFO ] [MAIN ] USA: Generated 1352 derivative records from 26260 primary records. [2025-09-14T21:01:07.432896] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-14T21:01:07.448322] [DEBUG] [LOCAL ] USA: Derivative data saved (1352 records). [2025-09-14T21:01:07.448524] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-14T21:01:07.450672] [INFO ] [MAIN ] Derivative Progress: 2054/2226 symbols completed. USA took 0.7s. Estimated remaining: 1m 0s. Rate: 170.6 symbols/min [2025-09-14T21:01:07.461476] [DEBUG] [MAIN ] URI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:07.462368] [INFO ] [MAIN ] URI: Generated 1352 derivative records from 26247 primary records. [2025-09-14T21:01:07.462461] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-14T21:01:07.475330] [DEBUG] [LOCAL ] URI: Derivative data saved (1352 records). [2025-09-14T21:01:07.475463] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-14T21:01:07.477793] [INFO ] [MAIN ] Derivative Progress: 2055/2226 symbols completed. URI took 0.8s. Estimated remaining: 1m 0s. Rate: 170.7 symbols/min [2025-09-14T21:01:07.478757] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:07.478949] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:07.479042] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:07.506478] [DEBUG] [LOCAL ] USAC: Loaded 15690 existing records from primary storage. [2025-09-14T21:01:07.506734] [INFO ] [MAIN ] USAC: Loaded 15690 primary data records. [2025-09-14T21:01:07.676457] [DEBUG] [LOCAL ] USB: Loaded 40428 existing records from primary storage. [2025-09-14T21:01:07.741091] [INFO ] [MAIN ] USB: Loaded 40428 primary data records. [2025-09-14T21:01:07.745301] [DEBUG] [LOCAL ] USFD: Loaded 38536 existing records from primary storage. [2025-09-14T21:01:07.842184] [INFO ] [MAIN ] USFD: Loaded 38536 primary data records. [2025-09-14T21:01:08.465753] [DEBUG] [MAIN ] USAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:08.467616] [INFO ] [MAIN ] USAC: Generated 1352 derivative records from 15690 primary records. [2025-09-14T21:01:08.469901] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-14T21:01:08.488330] [DEBUG] [LOCAL ] USAC: Derivative data saved (1352 records). [2025-09-14T21:01:08.491732] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-14T21:01:08.493965] [INFO ] [MAIN ] Derivative Progress: 2056/2226 symbols completed. USAC took 1.0s. Estimated remaining: 59.8s. Rate: 170.6 symbols/min [2025-09-14T21:01:08.506335] [DEBUG] [MAIN ] USB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:08.508321] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:08.508104] [INFO ] [MAIN ] USB: Generated 1352 derivative records from 40428 primary records. [2025-09-14T21:01:08.508504] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-14T21:01:08.519983] [DEBUG] [MAIN ] USFD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:08.521539] [INFO ] [MAIN ] USFD: Generated 1352 derivative records from 38536 primary records. [2025-09-14T21:01:08.521664] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-14T21:01:08.552967] [DEBUG] [LOCAL ] USB: Derivative data saved (1352 records). [2025-09-14T21:01:08.555754] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-14T21:01:08.558875] [INFO ] [MAIN ] Derivative Progress: 2057/2226 symbols completed. USB took 1.1s. Estimated remaining: 59.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:08.560125] [DEBUG] [LOCAL ] USFD: Derivative data saved (1352 records). [2025-09-14T21:01:08.567076] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:08.567461] [DEBUG] [LOCAL ] USNA: Loaded 13115 existing records from primary storage. [2025-09-14T21:01:08.567618] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-14T21:01:08.570541] [INFO ] [MAIN ] Derivative Progress: 2058/2226 symbols completed. USFD took 1.1s. Estimated remaining: 59.0s. Rate: 170.7 symbols/min [2025-09-14T21:01:08.570748] [INFO ] [MAIN ] USNA: Loaded 13115 primary data records. [2025-09-14T21:01:08.570899] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:08.722024] [DEBUG] [LOCAL ] USPH: Loaded 12705 existing records from primary storage. [2025-09-14T21:01:08.748810] [INFO ] [MAIN ] USPH: Loaded 12705 primary data records. [2025-09-14T21:01:08.885703] [DEBUG] [LOCAL ] UTF: Loaded 20046 existing records from primary storage. [2025-09-14T21:01:09.008787] [INFO ] [MAIN ] UTF: Loaded 20046 primary data records. [2025-09-14T21:01:09.548060] [DEBUG] [MAIN ] USNA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:09.549261] [INFO ] [MAIN ] USNA: Generated 1352 derivative records from 13115 primary records. [2025-09-14T21:01:09.550602] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-14T21:01:09.570714] [DEBUG] [LOCAL ] USNA: Derivative data saved (1352 records). [2025-09-14T21:01:09.577555] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-14T21:01:09.584430] [DEBUG] [MAIN ] USPH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:09.586870] [INFO ] [MAIN ] Derivative Progress: 2059/2226 symbols completed. USNA took 1.1s. Estimated remaining: 58.7s. Rate: 170.6 symbols/min [2025-09-14T21:01:09.588972] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:09.588378] [INFO ] [MAIN ] USPH: Generated 1352 derivative records from 12705 primary records. [2025-09-14T21:01:09.589960] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-14T21:01:09.609821] [DEBUG] [LOCAL ] USPH: Derivative data saved (1352 records). [2025-09-14T21:01:09.610067] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-14T21:01:09.613121] [INFO ] [MAIN ] Derivative Progress: 2060/2226 symbols completed. USPH took 1.0s. Estimated remaining: 58.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:09.615326] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:09.639715] [DEBUG] [MAIN ] UTF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:09.640946] [INFO ] [MAIN ] UTF: Generated 1352 derivative records from 20046 primary records. [2025-09-14T21:01:09.641418] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-14T21:01:09.671550] [DEBUG] [LOCAL ] UTL: Loaded 8454 existing records from primary storage. [2025-09-14T21:01:09.665447] [DEBUG] [LOCAL ] UTF: Derivative data saved (1352 records). [2025-09-14T21:01:09.672368] [DEBUG] [LOCAL ] UTI: Loaded 30337 existing records from primary storage. [2025-09-14T21:01:09.672721] [INFO ] [MAIN ] UTI: Loaded 30337 primary data records. [2025-09-14T21:01:09.672554] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-14T21:01:09.675779] [INFO ] [MAIN ] Derivative Progress: 2061/2226 symbols completed. UTF took 1.1s. Estimated remaining: 58.0s. Rate: 170.7 symbols/min [2025-09-14T21:01:09.672880] [INFO ] [MAIN ] UTL: Loaded 8454 primary data records. [2025-09-14T21:01:09.713301] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:10.328882] [DEBUG] [LOCAL ] UTZ: Loaded 33624 existing records from primary storage. [2025-09-14T21:01:10.330401] [INFO ] [MAIN ] UTZ: Loaded 33624 primary data records. [2025-09-14T21:01:10.636564] [DEBUG] [MAIN ] UTI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:10.640453] [INFO ] [MAIN ] UTI: Generated 1352 derivative records from 30337 primary records. [2025-09-14T21:01:10.641394] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-14T21:01:10.653566] [DEBUG] [MAIN ] UTL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:10.656904] [INFO ] [MAIN ] UTL: Generated 1352 derivative records from 8454 primary records. [2025-09-14T21:01:10.666862] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-14T21:01:10.670964] [DEBUG] [LOCAL ] UTI: Derivative data saved (1352 records). [2025-09-14T21:01:10.671271] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-14T21:01:10.680246] [INFO ] [MAIN ] Derivative Progress: 2062/2226 symbols completed. UTI took 1.1s. Estimated remaining: 57.7s. Rate: 170.6 symbols/min [2025-09-14T21:01:10.686267] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:10.688813] [DEBUG] [LOCAL ] UTL: Derivative data saved (1352 records). [2025-09-14T21:01:10.689934] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-14T21:01:10.692817] [INFO ] [MAIN ] Derivative Progress: 2063/2226 symbols completed. UTL took 1.1s. Estimated remaining: 57.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:10.693304] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:10.715069] [DEBUG] [MAIN ] UTZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:10.720898] [INFO ] [MAIN ] UTZ: Generated 1352 derivative records from 33624 primary records. [2025-09-14T21:01:10.728251] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-14T21:01:10.728790] [DEBUG] [LOCAL ] UVE: Loaded 17083 existing records from primary storage. [2025-09-14T21:01:10.730966] [INFO ] [MAIN ] UVE: Loaded 17083 primary data records. [2025-09-14T21:01:10.738678] [DEBUG] [LOCAL ] UVV: Loaded 17608 existing records from primary storage. [2025-09-14T21:01:10.786728] [INFO ] [MAIN ] UVV: Loaded 17608 primary data records. [2025-09-14T21:01:10.944381] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1352 records). [2025-09-14T21:01:10.967232] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-14T21:01:11.004995] [INFO ] [MAIN ] Derivative Progress: 2064/2226 symbols completed. UTZ took 1.3s. Estimated remaining: 57.0s. Rate: 170.6 symbols/min [2025-09-14T21:01:11.021808] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:11.380382] [DEBUG] [LOCAL ] UWMC: Loaded 39753 existing records from primary storage. [2025-09-14T21:01:11.381441] [INFO ] [MAIN ] UWMC: Loaded 39753 primary data records. [2025-09-14T21:01:11.561600] [DEBUG] [MAIN ] UVE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:11.573096] [INFO ] [MAIN ] UVE: Generated 1352 derivative records from 17083 primary records. [2025-09-14T21:01:11.607171] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-14T21:01:11.660392] [DEBUG] [MAIN ] UVV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:11.729447] [INFO ] [MAIN ] UVV: Generated 1352 derivative records from 17608 primary records. [2025-09-14T21:01:11.737182] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-14T21:01:11.741351] [DEBUG] [LOCAL ] UVE: Derivative data saved (1352 records). [2025-09-14T21:01:11.743740] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-14T21:01:11.758007] [DEBUG] [LOCAL ] UVV: Derivative data saved (1352 records). [2025-09-14T21:01:11.760781] [INFO ] [MAIN ] Derivative Progress: 2065/2226 symbols completed. UVE took 1.1s. Estimated remaining: 56.6s. Rate: 170.5 symbols/min [2025-09-14T21:01:11.760924] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-14T21:01:11.762300] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:11.764930] [INFO ] [MAIN ] Derivative Progress: 2066/2226 symbols completed. UVV took 1.1s. Estimated remaining: 56.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:11.766258] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:11.775141] [DEBUG] [LOCAL ] UZD: Loaded 4769 existing records from primary storage. [2025-09-14T21:01:11.775939] [INFO ] [MAIN ] UZD: Loaded 4769 primary data records. [2025-09-14T21:01:11.852327] [DEBUG] [LOCAL ] UZE: Loaded 5661 existing records from primary storage. [2025-09-14T21:01:11.869763] [INFO ] [MAIN ] UZE: Loaded 5661 primary data records. [2025-09-14T21:01:12.033635] [DEBUG] [MAIN ] UWMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:12.079179] [INFO ] [MAIN ] UWMC: Generated 1352 derivative records from 39753 primary records. [2025-09-14T21:01:12.096134] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-14T21:01:12.439209] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1352 records). [2025-09-14T21:01:12.442300] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-14T21:01:12.444857] [INFO ] [MAIN ] Derivative Progress: 2067/2226 symbols completed. UWMC took 1.4s. Estimated remaining: 55.9s. Rate: 170.5 symbols/min [2025-09-14T21:01:12.445797] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:12.458850] [DEBUG] [LOCAL ] UZF: Loaded 4716 existing records from primary storage. [2025-09-14T21:01:12.460850] [INFO ] [MAIN ] UZF: Loaded 4716 primary data records. [2025-09-14T21:01:12.545228] [DEBUG] [MAIN ] UZD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:12.586877] [INFO ] [MAIN ] UZD: Generated 1352 derivative records from 4769 primary records. [2025-09-14T21:01:12.599819] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-14T21:01:12.626862] [DEBUG] [MAIN ] UZE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:12.671465] [INFO ] [MAIN ] UZE: Generated 1352 derivative records from 5661 primary records. [2025-09-14T21:01:12.701129] [DEBUG] [LOCAL ] UZD: Derivative data saved (1352 records). [2025-09-14T21:01:12.705095] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-14T21:01:12.710768] [INFO ] [MAIN ] Derivative Progress: 2068/2226 symbols completed. UZD took 0.9s. Estimated remaining: 55.6s. Rate: 170.6 symbols/min [2025-09-14T21:01:12.703965] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-14T21:01:12.819329] [DEBUG] [LOCAL ] UZE: Derivative data saved (1352 records). [2025-09-14T21:01:12.819622] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-14T21:01:12.822658] [INFO ] [MAIN ] Derivative Progress: 2069/2226 symbols completed. UZE took 1.1s. Estimated remaining: 55.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:12.837174] [DEBUG] [MAIN ] UZF: Filtered 5251 bins outside market hours, 5865 incomplete bins [2025-09-14T21:01:12.837829] [INFO ] [MAIN ] UZF: Generated 1349 derivative records from 4716 primary records. [2025-09-14T21:01:12.837907] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-14T21:01:12.849079] [DEBUG] [LOCAL ] UZF: Derivative data saved (1349 records). [2025-09-14T21:01:12.849196] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-14T21:01:12.850973] [INFO ] [MAIN ] Derivative Progress: 2070/2226 symbols completed. UZF took 0.4s. Estimated remaining: 54.8s. Rate: 170.7 symbols/min [2025-09-14T21:01:12.851867] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:12.852013] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:12.852134] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:12.881234] [DEBUG] [LOCAL ] VAC: Loaded 25513 existing records from primary storage. [2025-09-14T21:01:12.881428] [INFO ] [MAIN ] VAC: Loaded 25513 primary data records. [2025-09-14T21:01:13.041451] [DEBUG] [LOCAL ] VAL: Loaded 37832 existing records from primary storage. [2025-09-14T21:01:13.070138] [INFO ] [MAIN ] VAL: Loaded 37832 primary data records. [2025-09-14T21:01:13.218177] [DEBUG] [LOCAL ] V: Loaded 40504 existing records from primary storage. [2025-09-14T21:01:13.242136] [INFO ] [MAIN ] V: Loaded 40504 primary data records. [2025-09-14T21:01:13.788709] [DEBUG] [MAIN ] VAC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:13.790706] [INFO ] [MAIN ] VAC: Generated 1352 derivative records from 25513 primary records. [2025-09-14T21:01:13.791385] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-14T21:01:13.807657] [DEBUG] [LOCAL ] VAC: Derivative data saved (1352 records). [2025-09-14T21:01:13.808064] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-14T21:01:13.810516] [INFO ] [MAIN ] Derivative Progress: 2071/2226 symbols completed. VAC took 1.0s. Estimated remaining: 54.5s. Rate: 170.6 symbols/min [2025-09-14T21:01:13.811824] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:13.826099] [DEBUG] [MAIN ] V: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:13.827774] [INFO ] [MAIN ] V: Generated 1352 derivative records from 40504 primary records. [2025-09-14T21:01:13.829425] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-14T21:01:13.855996] [DEBUG] [LOCAL ] V: Derivative data saved (1352 records). [2025-09-14T21:01:13.856737] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-14T21:01:13.856498] [DEBUG] [MAIN ] VAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:13.862284] [INFO ] [MAIN ] Derivative Progress: 2072/2226 symbols completed. V took 1.0s. Estimated remaining: 54.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:13.864069] [INFO ] [MAIN ] VAL: Generated 1352 derivative records from 37832 primary records. [2025-09-14T21:01:13.864539] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:13.864735] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-14T21:01:13.891929] [DEBUG] [LOCAL ] VAL: Derivative data saved (1352 records). [2025-09-14T21:01:13.892329] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-14T21:01:13.895273] [INFO ] [MAIN ] Derivative Progress: 2073/2226 symbols completed. VAL took 1.0s. Estimated remaining: 53.8s. Rate: 170.7 symbols/min [2025-09-14T21:01:13.898814] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:13.899581] [DEBUG] [LOCAL ] VATE: Loaded 3658 existing records from primary storage. [2025-09-14T21:01:13.899897] [INFO ] [MAIN ] VATE: Loaded 3658 primary data records. [2025-09-14T21:01:14.017099] [DEBUG] [LOCAL ] VBF: Loaded 5020 existing records from primary storage. [2025-09-14T21:01:14.017208] [DEBUG] [LOCAL ] VALE: Loaded 40435 existing records from primary storage. [2025-09-14T21:01:14.028789] [INFO ] [MAIN ] VALE: Loaded 40435 primary data records. [2025-09-14T21:01:14.028938] [INFO ] [MAIN ] VBF: Loaded 5020 primary data records. [2025-09-14T21:01:14.895185] [DEBUG] [MAIN ] VATE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:14.897535] [INFO ] [MAIN ] VATE: Generated 1352 derivative records from 3658 primary records. [2025-09-14T21:01:14.899254] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-14T21:01:14.913964] [DEBUG] [LOCAL ] VATE: Derivative data saved (1352 records). [2025-09-14T21:01:14.924274] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-14T21:01:14.924790] [DEBUG] [MAIN ] VALE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:14.929870] [INFO ] [MAIN ] Derivative Progress: 2074/2226 symbols completed. VATE took 1.1s. Estimated remaining: 53.5s. Rate: 170.5 symbols/min [2025-09-14T21:01:14.931920] [INFO ] [MAIN ] VALE: Generated 1352 derivative records from 40435 primary records. [2025-09-14T21:01:14.932502] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:14.932539] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-14T21:01:14.956463] [DEBUG] [MAIN ] VBF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:14.959910] [DEBUG] [LOCAL ] VALE: Derivative data saved (1352 records). [2025-09-14T21:01:14.960250] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-14T21:01:14.963680] [INFO ] [MAIN ] VBF: Generated 1352 derivative records from 5020 primary records. [2025-09-14T21:01:14.966324] [INFO ] [MAIN ] Derivative Progress: 2075/2226 symbols completed. VALE took 1.2s. Estimated remaining: 53.1s. Rate: 170.6 symbols/min [2025-09-14T21:01:14.966589] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-14T21:01:14.967102] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:14.985218] [DEBUG] [LOCAL ] VCV: Loaded 10312 existing records from primary storage. [2025-09-14T21:01:14.990062] [DEBUG] [LOCAL ] VBF: Derivative data saved (1352 records). [2025-09-14T21:01:14.990226] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-14T21:01:14.989993] [INFO ] [MAIN ] VCV: Loaded 10312 primary data records. [2025-09-14T21:01:14.993219] [INFO ] [MAIN ] Derivative Progress: 2076/2226 symbols completed. VBF took 1.1s. Estimated remaining: 52.7s. Rate: 170.7 symbols/min [2025-09-14T21:01:15.026391] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:15.175277] [DEBUG] [LOCAL ] VEL: Loaded 9000 existing records from primary storage. [2025-09-14T21:01:15.225295] [INFO ] [MAIN ] VEL: Loaded 9000 primary data records. [2025-09-14T21:01:15.315704] [DEBUG] [LOCAL ] VEEV: Loaded 35561 existing records from primary storage. [2025-09-14T21:01:15.338808] [INFO ] [MAIN ] VEEV: Loaded 35561 primary data records. [2025-09-14T21:01:15.932888] [DEBUG] [MAIN ] VCV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:15.935141] [INFO ] [MAIN ] VCV: Generated 1352 derivative records from 10312 primary records. [2025-09-14T21:01:15.936070] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-14T21:01:15.950993] [DEBUG] [LOCAL ] VCV: Derivative data saved (1352 records). [2025-09-14T21:01:15.951831] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-14T21:01:15.954766] [INFO ] [MAIN ] Derivative Progress: 2077/2226 symbols completed. VCV took 1.0s. Estimated remaining: 52.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:15.955119] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:15.973974] [DEBUG] [MAIN ] VEL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:15.977435] [INFO ] [MAIN ] VEL: Generated 1352 derivative records from 9000 primary records. [2025-09-14T21:01:15.977557] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-14T21:01:15.995093] [DEBUG] [MAIN ] VEEV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:15.999885] [INFO ] [MAIN ] VEEV: Generated 1352 derivative records from 35561 primary records. [2025-09-14T21:01:16.003841] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-14T21:01:16.003763] [DEBUG] [LOCAL ] VEL: Derivative data saved (1352 records). [2025-09-14T21:01:16.004730] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-14T21:01:16.007574] [INFO ] [MAIN ] Derivative Progress: 2078/2226 symbols completed. VEL took 1.0s. Estimated remaining: 52.0s. Rate: 170.6 symbols/min [2025-09-14T21:01:16.008185] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:16.020532] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1352 records). [2025-09-14T21:01:16.020871] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-14T21:01:16.023358] [INFO ] [MAIN ] Derivative Progress: 2079/2226 symbols completed. VEEV took 1.1s. Estimated remaining: 51.7s. Rate: 170.7 symbols/min [2025-09-14T21:01:16.023869] [INFO ] [MAIN ] VG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:16.051763] [DEBUG] [LOCAL ] VET: Loaded 32812 existing records from primary storage. [2025-09-14T21:01:16.051971] [INFO ] [MAIN ] VET: Loaded 32812 primary data records. [2025-09-14T21:01:16.289198] [DEBUG] [LOCAL ] VG: Loaded 40214 existing records from primary storage. [2025-09-14T21:01:16.376840] [INFO ] [MAIN ] VG: Loaded 40214 primary data records. [2025-09-14T21:01:16.377703] [DEBUG] [LOCAL ] VFC: Loaded 40360 existing records from primary storage. [2025-09-14T21:01:16.399204] [INFO ] [MAIN ] VFC: Loaded 40360 primary data records. [2025-09-14T21:01:17.080672] [DEBUG] [MAIN ] VET: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:17.084409] [INFO ] [MAIN ] VET: Generated 1352 derivative records from 32812 primary records. [2025-09-14T21:01:17.084690] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-14T21:01:17.100398] [DEBUG] [LOCAL ] VET: Derivative data saved (1352 records). [2025-09-14T21:01:17.100682] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-14T21:01:17.104092] [INFO ] [MAIN ] Derivative Progress: 2080/2226 symbols completed. VET took 1.1s. Estimated remaining: 51.4s. Rate: 170.5 symbols/min [2025-09-14T21:01:17.105241] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:17.125985] [DEBUG] [MAIN ] VG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:17.139259] [DEBUG] [LOCAL ] VGI: Loaded 3911 existing records from primary storage. [2025-09-14T21:01:17.140326] [INFO ] [MAIN ] VG: Generated 1352 derivative records from 40214 primary records. [2025-09-14T21:01:17.140741] [DEBUG] [MAIN ] VFC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:17.140914] [INFO ] [MAIN ] VGI: Loaded 3911 primary data records. [2025-09-14T21:01:17.140976] [DEBUG] [LOCAL ] VG: Saving derivative data. [2025-09-14T21:01:17.173452] [INFO ] [MAIN ] VFC: Generated 1352 derivative records from 40360 primary records. [2025-09-14T21:01:17.232484] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-14T21:01:17.255904] [DEBUG] [LOCAL ] VG: Derivative data saved (1352 records). [2025-09-14T21:01:17.268694] [INFO ] [MAIN ] VG: Successfully saved derivative data. [2025-09-14T21:01:17.271742] [INFO ] [MAIN ] Derivative Progress: 2081/2226 symbols completed. VG took 1.2s. Estimated remaining: 51.0s. Rate: 170.6 symbols/min [2025-09-14T21:01:17.293609] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:17.368115] [DEBUG] [LOCAL ] VFC: Derivative data saved (1352 records). [2025-09-14T21:01:17.457296] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-14T21:01:17.459880] [INFO ] [MAIN ] Derivative Progress: 2082/2226 symbols completed. VFC took 1.5s. Estimated remaining: 50.6s. Rate: 170.6 symbols/min [2025-09-14T21:01:17.461007] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:17.471144] [DEBUG] [LOCAL ] VHI: Loaded 2034 existing records from primary storage. [2025-09-14T21:01:17.471525] [INFO ] [MAIN ] VHI: Loaded 2034 primary data records. [2025-09-14T21:01:17.522131] [DEBUG] [LOCAL ] VGM: Loaded 14522 existing records from primary storage. [2025-09-14T21:01:17.548325] [INFO ] [MAIN ] VGM: Loaded 14522 primary data records. [2025-09-14T21:01:17.996416] [DEBUG] [MAIN ] VGI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:18.087510] [INFO ] [MAIN ] VGI: Generated 1352 derivative records from 3911 primary records. [2025-09-14T21:01:18.089268] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-14T21:01:18.104024] [DEBUG] [LOCAL ] VGI: Derivative data saved (1352 records). [2025-09-14T21:01:18.104666] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-14T21:01:18.107472] [INFO ] [MAIN ] Derivative Progress: 2083/2226 symbols completed. VGI took 1.0s. Estimated remaining: 50.3s. Rate: 170.5 symbols/min [2025-09-14T21:01:18.126632] [DEBUG] [MAIN ] VHI: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T21:01:18.127773] [INFO ] [MAIN ] VHI: Generated 1350 derivative records from 2034 primary records. [2025-09-14T21:01:18.128023] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-14T21:01:18.142128] [DEBUG] [LOCAL ] VHI: Derivative data saved (1350 records). [2025-09-14T21:01:18.142432] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-14T21:01:18.144964] [INFO ] [MAIN ] Derivative Progress: 2084/2226 symbols completed. VHI took 0.7s. Estimated remaining: 49.9s. Rate: 170.6 symbols/min [2025-09-14T21:01:18.155491] [DEBUG] [MAIN ] VGM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:18.156378] [INFO ] [MAIN ] VGM: Generated 1352 derivative records from 14522 primary records. [2025-09-14T21:01:18.156522] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-14T21:01:18.169413] [DEBUG] [LOCAL ] VGM: Derivative data saved (1352 records). [2025-09-14T21:01:18.169498] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-14T21:01:18.171772] [INFO ] [MAIN ] Derivative Progress: 2085/2226 symbols completed. VGM took 0.9s. Estimated remaining: 49.6s. Rate: 170.7 symbols/min [2025-09-14T21:01:18.172836] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:18.172949] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:18.173173] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:18.250684] [DEBUG] [LOCAL ] VIK: Loaded 39526 existing records from primary storage. [2025-09-14T21:01:18.250926] [INFO ] [MAIN ] VIK: Loaded 39526 primary data records. [2025-09-14T21:01:18.380784] [DEBUG] [LOCAL ] VICI: Loaded 40397 existing records from primary storage. [2025-09-14T21:01:18.381513] [DEBUG] [LOCAL ] VIPS: Loaded 38450 existing records from primary storage. [2025-09-14T21:01:18.402775] [INFO ] [MAIN ] VICI: Loaded 40397 primary data records. [2025-09-14T21:01:18.408079] [INFO ] [MAIN ] VIPS: Loaded 38450 primary data records. [2025-09-14T21:01:19.145194] [DEBUG] [MAIN ] VIK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:19.147493] [INFO ] [MAIN ] VIK: Generated 1352 derivative records from 39526 primary records. [2025-09-14T21:01:19.147832] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-14T21:01:19.164563] [DEBUG] [LOCAL ] VIK: Derivative data saved (1352 records). [2025-09-14T21:01:19.175948] [DEBUG] [MAIN ] VICI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:19.175195] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-14T21:01:19.176730] [INFO ] [MAIN ] VICI: Generated 1352 derivative records from 40397 primary records. [2025-09-14T21:01:19.179582] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-14T21:01:19.179216] [INFO ] [MAIN ] Derivative Progress: 2086/2226 symbols completed. VIK took 1.0s. Estimated remaining: 49.3s. Rate: 170.5 symbols/min [2025-09-14T21:01:19.182420] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:19.205796] [DEBUG] [MAIN ] VIPS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:19.207257] [DEBUG] [LOCAL ] VICI: Derivative data saved (1352 records). [2025-09-14T21:01:19.207953] [INFO ] [MAIN ] VIPS: Generated 1352 derivative records from 38450 primary records. [2025-09-14T21:01:19.208137] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-14T21:01:19.210261] [INFO ] [MAIN ] Derivative Progress: 2087/2226 symbols completed. VICI took 1.0s. Estimated remaining: 48.9s. Rate: 170.6 symbols/min [2025-09-14T21:01:19.210620] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:19.210367] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-14T21:01:19.226129] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1352 records). [2025-09-14T21:01:19.226342] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-14T21:01:19.229452] [INFO ] [MAIN ] Derivative Progress: 2088/2226 symbols completed. VIPS took 1.1s. Estimated remaining: 48.5s. Rate: 170.7 symbols/min [2025-09-14T21:01:19.230120] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:19.270066] [DEBUG] [LOCAL ] VIRT: Loaded 35002 existing records from primary storage. [2025-09-14T21:01:19.270408] [INFO ] [MAIN ] VIRT: Loaded 35002 primary data records. [2025-09-14T21:01:19.388834] [DEBUG] [LOCAL ] VIST: Loaded 34464 existing records from primary storage. [2025-09-14T21:01:19.409824] [INFO ] [MAIN ] VIST: Loaded 34464 primary data records. [2025-09-14T21:01:19.442840] [DEBUG] [LOCAL ] VIV: Loaded 34128 existing records from primary storage. [2025-09-14T21:01:19.555397] [INFO ] [MAIN ] VIV: Loaded 34128 primary data records. [2025-09-14T21:01:20.244790] [DEBUG] [MAIN ] VIRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:20.247371] [INFO ] [MAIN ] VIRT: Generated 1352 derivative records from 35002 primary records. [2025-09-14T21:01:20.247908] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-14T21:01:20.269724] [DEBUG] [MAIN ] VIST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:20.277544] [INFO ] [MAIN ] VIST: Generated 1352 derivative records from 34464 primary records. [2025-09-14T21:01:20.281609] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-14T21:01:20.283439] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1352 records). [2025-09-14T21:01:20.290397] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-14T21:01:20.304046] [DEBUG] [MAIN ] VIV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:20.307796] [INFO ] [MAIN ] VIV: Generated 1352 derivative records from 34128 primary records. [2025-09-14T21:01:20.306952] [INFO ] [MAIN ] Derivative Progress: 2089/2226 symbols completed. VIRT took 1.1s. Estimated remaining: 48.2s. Rate: 170.5 symbols/min [2025-09-14T21:01:20.309909] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-14T21:01:20.310170] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:20.310263] [DEBUG] [LOCAL ] VIST: Derivative data saved (1352 records). [2025-09-14T21:01:20.312057] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-14T21:01:20.320313] [INFO ] [MAIN ] Derivative Progress: 2090/2226 symbols completed. VIST took 1.1s. Estimated remaining: 47.8s. Rate: 170.6 symbols/min [2025-09-14T21:01:20.324786] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:20.332330] [DEBUG] [LOCAL ] VIV: Derivative data saved (1352 records). [2025-09-14T21:01:20.332735] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-14T21:01:20.335434] [INFO ] [MAIN ] Derivative Progress: 2091/2226 symbols completed. VIV took 1.1s. Estimated remaining: 47.5s. Rate: 170.7 symbols/min [2025-09-14T21:01:20.336245] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:20.344793] [DEBUG] [LOCAL ] VKQ: Loaded 13602 existing records from primary storage. [2025-09-14T21:01:20.345084] [INFO ] [MAIN ] VKQ: Loaded 13602 primary data records. [2025-09-14T21:01:20.556707] [DEBUG] [LOCAL ] VLN: Loaded 22236 existing records from primary storage. [2025-09-14T21:01:20.562478] [INFO ] [MAIN ] VLN: Loaded 22236 primary data records. [2025-09-14T21:01:20.781667] [DEBUG] [LOCAL ] VLO: Loaded 39975 existing records from primary storage. [2025-09-14T21:01:20.791688] [INFO ] [MAIN ] VLO: Loaded 39975 primary data records. [2025-09-14T21:01:21.166381] [DEBUG] [MAIN ] VKQ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:21.249660] [INFO ] [MAIN ] VKQ: Generated 1352 derivative records from 13602 primary records. [2025-09-14T21:01:21.262292] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-14T21:01:21.276280] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1352 records). [2025-09-14T21:01:21.276574] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-14T21:01:21.278451] [INFO ] [MAIN ] Derivative Progress: 2092/2226 symbols completed. VKQ took 1.0s. Estimated remaining: 47.1s. Rate: 170.5 symbols/min [2025-09-14T21:01:21.278880] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:21.297542] [DEBUG] [MAIN ] VLN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:21.298896] [INFO ] [MAIN ] VLN: Generated 1352 derivative records from 22236 primary records. [2025-09-14T21:01:21.299263] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-14T21:01:21.320523] [DEBUG] [LOCAL ] VLN: Derivative data saved (1352 records). [2025-09-14T21:01:21.320993] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-14T21:01:21.323767] [INFO ] [MAIN ] Derivative Progress: 2093/2226 symbols completed. VLN took 1.0s. Estimated remaining: 46.8s. Rate: 170.6 symbols/min [2025-09-14T21:01:21.325797] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:21.347245] [DEBUG] [MAIN ] VLO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:21.346772] [DEBUG] [LOCAL ] VLRS: Loaded 30025 existing records from primary storage. [2025-09-14T21:01:21.348109] [INFO ] [MAIN ] VLO: Generated 1352 derivative records from 39975 primary records. [2025-09-14T21:01:21.349194] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-14T21:01:21.349127] [INFO ] [MAIN ] VLRS: Loaded 30025 primary data records. [2025-09-14T21:01:21.393719] [DEBUG] [LOCAL ] VLT: Loaded 3117 existing records from primary storage. [2025-09-14T21:01:21.409635] [DEBUG] [LOCAL ] VLO: Derivative data saved (1352 records). [2025-09-14T21:01:21.415087] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-14T21:01:21.415014] [INFO ] [MAIN ] VLT: Loaded 3117 primary data records. [2025-09-14T21:01:21.493633] [INFO ] [MAIN ] Derivative Progress: 2094/2226 symbols completed. VLO took 1.2s. Estimated remaining: 46.4s. Rate: 170.7 symbols/min [2025-09-14T21:01:21.567497] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:21.999799] [DEBUG] [LOCAL ] VLTO: Loaded 34339 existing records from primary storage. [2025-09-14T21:01:22.000361] [INFO ] [MAIN ] VLTO: Loaded 34339 primary data records. [2025-09-14T21:01:22.127280] [DEBUG] [MAIN ] VLRS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:22.149247] [INFO ] [MAIN ] VLRS: Generated 1352 derivative records from 30025 primary records. [2025-09-14T21:01:22.160607] [DEBUG] [MAIN ] VLT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:22.193297] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-14T21:01:22.194006] [INFO ] [MAIN ] VLT: Generated 1352 derivative records from 3117 primary records. [2025-09-14T21:01:22.225325] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-14T21:01:22.357151] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1352 records). [2025-09-14T21:01:22.360695] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-14T21:01:22.360603] [DEBUG] [LOCAL ] VLT: Derivative data saved (1352 records). [2025-09-14T21:01:22.363918] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-14T21:01:22.363366] [INFO ] [MAIN ] Derivative Progress: 2095/2226 symbols completed. VLRS took 1.1s. Estimated remaining: 46.1s. Rate: 170.5 symbols/min [2025-09-14T21:01:22.366866] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:22.366968] [INFO ] [MAIN ] Derivative Progress: 2096/2226 symbols completed. VLT took 1.0s. Estimated remaining: 45.7s. Rate: 170.6 symbols/min [2025-09-14T21:01:22.369159] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:22.387235] [DEBUG] [LOCAL ] VMI: Loaded 11398 existing records from primary storage. [2025-09-14T21:01:22.397554] [INFO ] [MAIN ] VMI: Loaded 11398 primary data records. [2025-09-14T21:01:22.398506] [DEBUG] [MAIN ] VLTO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:22.439150] [INFO ] [MAIN ] VLTO: Generated 1352 derivative records from 34339 primary records. [2025-09-14T21:01:22.500742] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-14T21:01:22.617206] [DEBUG] [LOCAL ] VMC: Loaded 32290 existing records from primary storage. [2025-09-14T21:01:22.630618] [INFO ] [MAIN ] VMC: Loaded 32290 primary data records. [2025-09-14T21:01:22.637709] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1352 records). [2025-09-14T21:01:22.766999] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-14T21:01:22.815031] [INFO ] [MAIN ] Derivative Progress: 2097/2226 symbols completed. VLTO took 1.3s. Estimated remaining: 45.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:22.833895] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:23.034768] [DEBUG] [LOCAL ] VMO: Loaded 15554 existing records from primary storage. [2025-09-14T21:01:23.036485] [INFO ] [MAIN ] VMO: Loaded 15554 primary data records. [2025-09-14T21:01:23.122482] [DEBUG] [MAIN ] VMI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:23.161023] [INFO ] [MAIN ] VMI: Generated 1352 derivative records from 11398 primary records. [2025-09-14T21:01:23.184030] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-14T21:01:23.367979] [DEBUG] [MAIN ] VMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:23.367080] [DEBUG] [LOCAL ] VMI: Derivative data saved (1352 records). [2025-09-14T21:01:23.370001] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-14T21:01:23.369890] [INFO ] [MAIN ] VMC: Generated 1352 derivative records from 32290 primary records. [2025-09-14T21:01:23.372573] [INFO ] [MAIN ] Derivative Progress: 2098/2226 symbols completed. VMI took 1.0s. Estimated remaining: 45.0s. Rate: 170.5 symbols/min [2025-09-14T21:01:23.373223] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-14T21:01:23.388486] [DEBUG] [LOCAL ] VMC: Derivative data saved (1352 records). [2025-09-14T21:01:23.388720] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-14T21:01:23.391346] [INFO ] [MAIN ] Derivative Progress: 2099/2226 symbols completed. VMC took 1.0s. Estimated remaining: 44.7s. Rate: 170.6 symbols/min [2025-09-14T21:01:23.405380] [DEBUG] [MAIN ] VMO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:23.406205] [INFO ] [MAIN ] VMO: Generated 1352 derivative records from 15554 primary records. [2025-09-14T21:01:23.406288] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-14T21:01:23.424485] [DEBUG] [LOCAL ] VMO: Derivative data saved (1352 records). [2025-09-14T21:01:23.424765] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-14T21:01:23.427741] [INFO ] [MAIN ] Derivative Progress: 2100/2226 symbols completed. VMO took 0.6s. Estimated remaining: 44.3s. Rate: 170.7 symbols/min [2025-09-14T21:01:23.428767] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:23.428662] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:23.428905] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:23.437732] [DEBUG] [LOCAL ] VNCE: Loaded 4525 existing records from primary storage. [2025-09-14T21:01:23.438068] [INFO ] [MAIN ] VNCE: Loaded 4525 primary data records. [2025-09-14T21:01:23.745366] [DEBUG] [LOCAL ] VNT: Loaded 32897 existing records from primary storage. [2025-09-14T21:01:23.788488] [INFO ] [MAIN ] VNT: Loaded 32897 primary data records. [2025-09-14T21:01:23.791540] [DEBUG] [LOCAL ] VNO: Loaded 36851 existing records from primary storage. [2025-09-14T21:01:23.815017] [INFO ] [MAIN ] VNO: Loaded 36851 primary data records. [2025-09-14T21:01:24.493059] [DEBUG] [MAIN ] VNCE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:24.495618] [INFO ] [MAIN ] VNCE: Generated 1352 derivative records from 4525 primary records. [2025-09-14T21:01:24.498792] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-14T21:01:24.515476] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1352 records). [2025-09-14T21:01:24.515748] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-14T21:01:24.517950] [INFO ] [MAIN ] Derivative Progress: 2101/2226 symbols completed. VNCE took 1.1s. Estimated remaining: 44.0s. Rate: 170.5 symbols/min [2025-09-14T21:01:24.519132] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:24.541991] [DEBUG] [LOCAL ] VOC: Loaded 6988 existing records from primary storage. [2025-09-14T21:01:24.542685] [INFO ] [MAIN ] VOC: Loaded 6988 primary data records. [2025-09-14T21:01:24.544441] [DEBUG] [MAIN ] VNT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:24.581786] [INFO ] [MAIN ] VNT: Generated 1352 derivative records from 32897 primary records. [2025-09-14T21:01:24.617017] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-14T21:01:24.658106] [DEBUG] [MAIN ] VNO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:24.703344] [INFO ] [MAIN ] VNO: Generated 1352 derivative records from 36851 primary records. [2025-09-14T21:01:24.708920] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-14T21:01:24.708684] [DEBUG] [LOCAL ] VNT: Derivative data saved (1352 records). [2025-09-14T21:01:24.750191] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-14T21:01:24.783737] [INFO ] [MAIN ] Derivative Progress: 2102/2226 symbols completed. VNT took 1.4s. Estimated remaining: 43.6s. Rate: 170.5 symbols/min [2025-09-14T21:01:24.871828] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:24.879422] [DEBUG] [LOCAL ] VNO: Derivative data saved (1352 records). [2025-09-14T21:01:24.880956] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-14T21:01:24.883705] [INFO ] [MAIN ] Derivative Progress: 2103/2226 symbols completed. VNO took 1.5s. Estimated remaining: 43.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:24.884849] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:24.905296] [DEBUG] [LOCAL ] VPG: Loaded 12834 existing records from primary storage. [2025-09-14T21:01:24.907306] [INFO ] [MAIN ] VPG: Loaded 12834 primary data records. [2025-09-14T21:01:25.044574] [DEBUG] [LOCAL ] VOYA: Loaded 31474 existing records from primary storage. [2025-09-14T21:01:25.055923] [INFO ] [MAIN ] VOYA: Loaded 31474 primary data records. [2025-09-14T21:01:25.365860] [DEBUG] [MAIN ] VOC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:25.429270] [INFO ] [MAIN ] VOC: Generated 1352 derivative records from 6988 primary records. [2025-09-14T21:01:25.433405] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-14T21:01:25.545477] [DEBUG] [LOCAL ] VOC: Derivative data saved (1352 records). [2025-09-14T21:01:25.546964] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-14T21:01:25.550613] [INFO ] [MAIN ] Derivative Progress: 2104/2226 symbols completed. VOC took 1.0s. Estimated remaining: 42.9s. Rate: 170.5 symbols/min [2025-09-14T21:01:25.551793] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:25.567794] [DEBUG] [LOCAL ] VPV: Loaded 3672 existing records from primary storage. [2025-09-14T21:01:25.572960] [INFO ] [MAIN ] VPV: Loaded 3672 primary data records. [2025-09-14T21:01:25.572526] [DEBUG] [MAIN ] VPG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:25.579454] [INFO ] [MAIN ] VPG: Generated 1352 derivative records from 12834 primary records. [2025-09-14T21:01:25.625083] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-14T21:01:25.734431] [DEBUG] [LOCAL ] VPG: Derivative data saved (1352 records). [2025-09-14T21:01:25.755912] [DEBUG] [MAIN ] VOYA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:25.791233] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-14T21:01:25.792631] [INFO ] [MAIN ] VOYA: Generated 1352 derivative records from 31474 primary records. [2025-09-14T21:01:25.798539] [INFO ] [MAIN ] Derivative Progress: 2105/2226 symbols completed. VPG took 0.9s. Estimated remaining: 42.6s. Rate: 170.6 symbols/min [2025-09-14T21:01:25.859779] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:25.859309] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-14T21:01:25.919534] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1352 records). [2025-09-14T21:01:25.920929] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-14T21:01:25.924157] [INFO ] [MAIN ] Derivative Progress: 2106/2226 symbols completed. VOYA took 1.1s. Estimated remaining: 42.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:25.924777] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:25.950345] [DEBUG] [LOCAL ] VRE: Loaded 26058 existing records from primary storage. [2025-09-14T21:01:25.951035] [INFO ] [MAIN ] VRE: Loaded 26058 primary data records. [2025-09-14T21:01:25.998180] [DEBUG] [MAIN ] VPV: Filtered 5251 bins outside market hours, 5864 incomplete bins [2025-09-14T21:01:26.028263] [INFO ] [MAIN ] VPV: Generated 1350 derivative records from 3672 primary records. [2025-09-14T21:01:26.083962] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-14T21:01:26.194380] [DEBUG] [LOCAL ] VPV: Derivative data saved (1350 records). [2025-09-14T21:01:26.195845] [DEBUG] [LOCAL ] VRT: Loaded 40495 existing records from primary storage. [2025-09-14T21:01:26.293735] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-14T21:01:26.294005] [INFO ] [MAIN ] VRT: Loaded 40495 primary data records. [2025-09-14T21:01:26.296776] [INFO ] [MAIN ] Derivative Progress: 2107/2226 symbols completed. VPV took 0.7s. Estimated remaining: 41.9s. Rate: 170.6 symbols/min [2025-09-14T21:01:26.297399] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:26.458144] [DEBUG] [LOCAL ] VRTS: Loaded 7402 existing records from primary storage. [2025-09-14T21:01:26.493839] [INFO ] [MAIN ] VRTS: Loaded 7402 primary data records. [2025-09-14T21:01:26.753561] [DEBUG] [MAIN ] VRE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:26.807838] [INFO ] [MAIN ] VRE: Generated 1352 derivative records from 26058 primary records. [2025-09-14T21:01:26.945490] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-14T21:01:26.962078] [DEBUG] [LOCAL ] VRE: Derivative data saved (1352 records). [2025-09-14T21:01:26.963097] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-14T21:01:26.966090] [INFO ] [MAIN ] Derivative Progress: 2108/2226 symbols completed. VRE took 1.1s. Estimated remaining: 41.5s. Rate: 170.5 symbols/min [2025-09-14T21:01:26.966912] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:26.984554] [DEBUG] [MAIN ] VRT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:26.986127] [INFO ] [MAIN ] VRT: Generated 1352 derivative records from 40495 primary records. [2025-09-14T21:01:26.986675] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-14T21:01:27.003859] [DEBUG] [LOCAL ] VRT: Derivative data saved (1352 records). [2025-09-14T21:01:27.005165] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-14T21:01:27.007293] [INFO ] [MAIN ] Derivative Progress: 2109/2226 symbols completed. VRT took 1.1s. Estimated remaining: 41.1s. Rate: 170.6 symbols/min [2025-09-14T21:01:27.013894] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:27.028136] [DEBUG] [MAIN ] VRTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:27.029464] [INFO ] [MAIN ] VRTS: Generated 1352 derivative records from 7402 primary records. [2025-09-14T21:01:27.029740] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-14T21:01:27.043223] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1352 records). [2025-09-14T21:01:27.043387] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-14T21:01:27.045764] [INFO ] [MAIN ] Derivative Progress: 2110/2226 symbols completed. VRTS took 0.7s. Estimated remaining: 40.8s. Rate: 170.7 symbols/min [2025-09-14T21:01:27.046147] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:27.060141] [DEBUG] [LOCAL ] VSCO: Loaded 39691 existing records from primary storage. [2025-09-14T21:01:27.060445] [INFO ] [MAIN ] VSCO: Loaded 39691 primary data records. [2025-09-14T21:01:27.330189] [DEBUG] [LOCAL ] VSH: Loaded 36374 existing records from primary storage. [2025-09-14T21:01:27.375427] [INFO ] [MAIN ] VSH: Loaded 36374 primary data records. [2025-09-14T21:01:27.492818] [DEBUG] [LOCAL ] VST: Loaded 40466 existing records from primary storage. [2025-09-14T21:01:27.506493] [INFO ] [MAIN ] VST: Loaded 40466 primary data records. [2025-09-14T21:01:27.980272] [DEBUG] [MAIN ] VSCO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:27.981555] [INFO ] [MAIN ] VSCO: Generated 1352 derivative records from 39691 primary records. [2025-09-14T21:01:27.982888] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-14T21:01:27.997186] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1352 records). [2025-09-14T21:01:28.000016] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-14T21:01:28.003279] [INFO ] [MAIN ] Derivative Progress: 2111/2226 symbols completed. VSCO took 1.0s. Estimated remaining: 40.5s. Rate: 170.5 symbols/min [2025-09-14T21:01:28.003719] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:28.015086] [DEBUG] [MAIN ] VSH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:28.016340] [INFO ] [MAIN ] VSH: Generated 1352 derivative records from 36374 primary records. [2025-09-14T21:01:28.016772] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-14T21:01:28.041462] [DEBUG] [MAIN ] VST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:28.043186] [INFO ] [MAIN ] VST: Generated 1352 derivative records from 40466 primary records. [2025-09-14T21:01:28.043366] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-14T21:01:28.055452] [DEBUG] [LOCAL ] VSH: Derivative data saved (1352 records). [2025-09-14T21:01:28.066376] [DEBUG] [LOCAL ] VST: Derivative data saved (1352 records). [2025-09-14T21:01:28.066549] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-14T21:01:28.066679] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-14T21:01:28.068373] [INFO ] [MAIN ] Derivative Progress: 2112/2226 symbols completed. VSH took 1.1s. Estimated remaining: 40.1s. Rate: 170.6 symbols/min [2025-09-14T21:01:28.071223] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:28.071265] [INFO ] [MAIN ] Derivative Progress: 2113/2226 symbols completed. VST took 1.0s. Estimated remaining: 39.7s. Rate: 170.7 symbols/min [2025-09-14T21:01:28.086711] [DEBUG] [LOCAL ] VSTS: Loaded 36722 existing records from primary storage. [2025-09-14T21:01:28.087100] [INFO ] [MAIN ] VSTS: Loaded 36722 primary data records. [2025-09-14T21:01:28.388407] [DEBUG] [LOCAL ] VTEX: Loaded 32608 existing records from primary storage. [2025-09-14T21:01:28.399574] [INFO ] [MAIN ] VTEX: Loaded 32608 primary data records. [2025-09-14T21:01:28.695377] [DEBUG] [MAIN ] VSTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:28.700347] [INFO ] [MAIN ] VSTS: Generated 1352 derivative records from 36722 primary records. [2025-09-14T21:01:28.700902] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-14T21:01:28.726867] [DEBUG] [MAIN ] VTEX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:28.728594] [INFO ] [MAIN ] VTEX: Generated 1352 derivative records from 32608 primary records. [2025-09-14T21:01:28.728845] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-14T21:01:28.728696] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1352 records). [2025-09-14T21:01:28.729691] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-14T21:01:28.731653] [INFO ] [MAIN ] Derivative Progress: 2114/2226 symbols completed. VSTS took 0.7s. Estimated remaining: 39.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:28.743312] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1352 records). [2025-09-14T21:01:28.743489] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-14T21:01:28.745854] [INFO ] [MAIN ] Derivative Progress: 2115/2226 symbols completed. VTEX took 0.7s. Estimated remaining: 39.0s. Rate: 170.7 symbols/min [2025-09-14T21:01:28.746326] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:28.746626] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:28.746448] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:28.755354] [DEBUG] [LOCAL ] VTN: Loaded 5097 existing records from primary storage. [2025-09-14T21:01:28.755744] [INFO ] [MAIN ] VTN: Loaded 5097 primary data records. [2025-09-14T21:01:28.859023] [DEBUG] [LOCAL ] VTMX: Loaded 13126 existing records from primary storage. [2025-09-14T21:01:28.881895] [INFO ] [MAIN ] VTMX: Loaded 13126 primary data records. [2025-09-14T21:01:29.086131] [DEBUG] [LOCAL ] VTLE: Loaded 36568 existing records from primary storage. [2025-09-14T21:01:29.165320] [INFO ] [MAIN ] VTLE: Loaded 36568 primary data records. [2025-09-14T21:01:29.711578] [DEBUG] [MAIN ] VTN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:29.713233] [INFO ] [MAIN ] VTN: Generated 1352 derivative records from 5097 primary records. [2025-09-14T21:01:29.713339] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-14T21:01:29.727479] [DEBUG] [LOCAL ] VTN: Derivative data saved (1352 records). [2025-09-14T21:01:29.727726] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-14T21:01:29.730350] [INFO ] [MAIN ] Derivative Progress: 2116/2226 symbols completed. VTN took 1.0s. Estimated remaining: 38.7s. Rate: 170.5 symbols/min [2025-09-14T21:01:29.730943] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:29.744034] [DEBUG] [MAIN ] VTMX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:29.744798] [INFO ] [MAIN ] VTMX: Generated 1352 derivative records from 13126 primary records. [2025-09-14T21:01:29.744941] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-14T21:01:29.772881] [DEBUG] [MAIN ] VTLE: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:29.774136] [INFO ] [MAIN ] VTLE: Generated 1352 derivative records from 36568 primary records. [2025-09-14T21:01:29.781854] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-14T21:01:29.783999] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1352 records). [2025-09-14T21:01:29.784354] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-14T21:01:29.786729] [INFO ] [MAIN ] Derivative Progress: 2117/2226 symbols completed. VTMX took 1.0s. Estimated remaining: 38.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:29.793665] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:29.787739] [DEBUG] [LOCAL ] VTOL: Loaded 14897 existing records from primary storage. [2025-09-14T21:01:29.800321] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1352 records). [2025-09-14T21:01:29.800460] [INFO ] [MAIN ] VTOL: Loaded 14897 primary data records. [2025-09-14T21:01:29.801092] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-14T21:01:29.803735] [INFO ] [MAIN ] Derivative Progress: 2118/2226 symbols completed. VTLE took 1.1s. Estimated remaining: 38.0s. Rate: 170.7 symbols/min [2025-09-14T21:01:29.804224] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:30.099628] [DEBUG] [LOCAL ] VTS: Loaded 21907 existing records from primary storage. [2025-09-14T21:01:30.100601] [INFO ] [MAIN ] VTS: Loaded 21907 primary data records. [2025-09-14T21:01:30.163127] [DEBUG] [LOCAL ] VTR: Loaded 39710 existing records from primary storage. [2025-09-14T21:01:30.176956] [INFO ] [MAIN ] VTR: Loaded 39710 primary data records. [2025-09-14T21:01:30.724490] [DEBUG] [MAIN ] VTOL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:30.726809] [INFO ] [MAIN ] VTOL: Generated 1352 derivative records from 14897 primary records. [2025-09-14T21:01:30.727063] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-14T21:01:30.747481] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1352 records). [2025-09-14T21:01:30.763469] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-14T21:01:30.770318] [DEBUG] [MAIN ] VTR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:30.769868] [INFO ] [MAIN ] Derivative Progress: 2119/2226 symbols completed. VTOL took 1.0s. Estimated remaining: 37.6s. Rate: 170.5 symbols/min [2025-09-14T21:01:30.771138] [INFO ] [MAIN ] VTR: Generated 1352 derivative records from 39710 primary records. [2025-09-14T21:01:30.771814] [DEBUG] [MAIN ] VTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:30.772828] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-14T21:01:30.772630] [INFO ] [MAIN ] VTS: Generated 1352 derivative records from 21907 primary records. [2025-09-14T21:01:30.773041] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:30.773564] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-14T21:01:30.797923] [DEBUG] [LOCAL ] VTS: Derivative data saved (1352 records). [2025-09-14T21:01:30.798311] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-14T21:01:30.800367] [INFO ] [MAIN ] Derivative Progress: 2120/2226 symbols completed. VTS took 1.0s. Estimated remaining: 37.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:30.801260] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:30.803741] [DEBUG] [LOCAL ] VTR: Derivative data saved (1352 records). [2025-09-14T21:01:30.809320] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-14T21:01:30.811886] [INFO ] [MAIN ] Derivative Progress: 2121/2226 symbols completed. VTR took 1.0s. Estimated remaining: 36.9s. Rate: 170.7 symbols/min [2025-09-14T21:01:30.812271] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:30.823773] [DEBUG] [LOCAL ] VVR: Loaded 21767 existing records from primary storage. [2025-09-14T21:01:30.823964] [INFO ] [MAIN ] VVR: Loaded 21767 primary data records. [2025-09-14T21:01:30.953067] [DEBUG] [LOCAL ] VVX: Loaded 17239 existing records from primary storage. [2025-09-14T21:01:30.953785] [INFO ] [MAIN ] VVX: Loaded 17239 primary data records. [2025-09-14T21:01:31.119185] [DEBUG] [LOCAL ] VVV: Loaded 37851 existing records from primary storage. [2025-09-14T21:01:31.248593] [INFO ] [MAIN ] VVV: Loaded 37851 primary data records. [2025-09-14T21:01:31.793361] [DEBUG] [MAIN ] VVR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:31.795157] [INFO ] [MAIN ] VVR: Generated 1352 derivative records from 21767 primary records. [2025-09-14T21:01:31.795624] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-14T21:01:31.812488] [DEBUG] [LOCAL ] VVR: Derivative data saved (1352 records). [2025-09-14T21:01:31.815252] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-14T21:01:31.818548] [INFO ] [MAIN ] Derivative Progress: 2122/2226 symbols completed. VVR took 1.0s. Estimated remaining: 36.6s. Rate: 170.5 symbols/min [2025-09-14T21:01:31.829620] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:31.830336] [DEBUG] [MAIN ] VVX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:31.831545] [INFO ] [MAIN ] VVX: Generated 1352 derivative records from 17239 primary records. [2025-09-14T21:01:31.832487] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-14T21:01:31.845954] [DEBUG] [LOCAL ] VVX: Derivative data saved (1352 records). [2025-09-14T21:01:31.846406] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-14T21:01:31.850086] [INFO ] [MAIN ] Derivative Progress: 2123/2226 symbols completed. VVX took 1.0s. Estimated remaining: 36.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:31.850422] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:31.864383] [DEBUG] [MAIN ] VVV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:31.865280] [INFO ] [MAIN ] VVV: Generated 1352 derivative records from 37851 primary records. [2025-09-14T21:01:31.865474] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-14T21:01:31.890305] [DEBUG] [LOCAL ] VVV: Derivative data saved (1352 records). [2025-09-14T21:01:31.890551] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-14T21:01:31.893105] [INFO ] [MAIN ] Derivative Progress: 2124/2226 symbols completed. VVV took 1.1s. Estimated remaining: 35.9s. Rate: 170.7 symbols/min [2025-09-14T21:01:31.904120] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:31.905075] [DEBUG] [LOCAL ] VYX: Loaded 36678 existing records from primary storage. [2025-09-14T21:01:31.905670] [INFO ] [MAIN ] VYX: Loaded 36678 primary data records. [2025-09-14T21:01:32.074831] [DEBUG] [LOCAL ] VZ: Loaded 40531 existing records from primary storage. [2025-09-14T21:01:32.118819] [INFO ] [MAIN ] VZ: Loaded 40531 primary data records. [2025-09-14T21:01:32.361420] [DEBUG] [LOCAL ] W: Loaded 40310 existing records from primary storage. [2025-09-14T21:01:32.362442] [INFO ] [MAIN ] W: Loaded 40310 primary data records. [2025-09-14T21:01:32.838156] [DEBUG] [MAIN ] VYX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:32.839722] [INFO ] [MAIN ] VYX: Generated 1352 derivative records from 36678 primary records. [2025-09-14T21:01:32.840827] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-14T21:01:32.854658] [DEBUG] [LOCAL ] VYX: Derivative data saved (1352 records). [2025-09-14T21:01:32.856007] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-14T21:01:32.858426] [INFO ] [MAIN ] Derivative Progress: 2125/2226 symbols completed. VYX took 1.0s. Estimated remaining: 35.5s. Rate: 170.5 symbols/min [2025-09-14T21:01:32.861050] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:32.872409] [DEBUG] [MAIN ] VZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:32.873385] [INFO ] [MAIN ] VZ: Generated 1352 derivative records from 40531 primary records. [2025-09-14T21:01:32.873795] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-14T21:01:32.887749] [DEBUG] [LOCAL ] VZ: Derivative data saved (1352 records). [2025-09-14T21:01:32.888079] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-14T21:01:32.890452] [INFO ] [MAIN ] Derivative Progress: 2126/2226 symbols completed. VZ took 1.0s. Estimated remaining: 35.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:32.890770] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:32.907953] [DEBUG] [MAIN ] W: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:32.910017] [INFO ] [MAIN ] W: Generated 1352 derivative records from 40310 primary records. [2025-09-14T21:01:32.910296] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-14T21:01:32.932046] [DEBUG] [LOCAL ] W: Derivative data saved (1352 records). [2025-09-14T21:01:32.932352] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-14T21:01:32.934914] [INFO ] [MAIN ] Derivative Progress: 2127/2226 symbols completed. W took 1.0s. Estimated remaining: 34.8s. Rate: 170.7 symbols/min [2025-09-14T21:01:32.935348] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:32.956289] [DEBUG] [LOCAL ] WAB: Loaded 32859 existing records from primary storage. [2025-09-14T21:01:32.956552] [INFO ] [MAIN ] WAB: Loaded 32859 primary data records. [2025-09-14T21:01:33.090257] [DEBUG] [LOCAL ] WAL: Loaded 33483 existing records from primary storage. [2025-09-14T21:01:33.155956] [DEBUG] [LOCAL ] WAT: Loaded 26456 existing records from primary storage. [2025-09-14T21:01:33.156121] [INFO ] [MAIN ] WAL: Loaded 33483 primary data records. [2025-09-14T21:01:33.159445] [INFO ] [MAIN ] WAT: Loaded 26456 primary data records. [2025-09-14T21:01:33.919495] [DEBUG] [MAIN ] WAB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:33.922110] [INFO ] [MAIN ] WAB: Generated 1352 derivative records from 32859 primary records. [2025-09-14T21:01:33.922850] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-14T21:01:33.995045] [DEBUG] [LOCAL ] WAB: Derivative data saved (1352 records). [2025-09-14T21:01:33.996475] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-14T21:01:33.998932] [INFO ] [MAIN ] Derivative Progress: 2128/2226 symbols completed. WAB took 1.1s. Estimated remaining: 34.5s. Rate: 170.5 symbols/min [2025-09-14T21:01:34.023489] [DEBUG] [MAIN ] WAT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:34.023929] [DEBUG] [MAIN ] WAL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:34.024730] [INFO ] [MAIN ] WAT: Generated 1352 derivative records from 26456 primary records. [2025-09-14T21:01:34.025408] [INFO ] [MAIN ] WAL: Generated 1352 derivative records from 33483 primary records. [2025-09-14T21:01:34.025483] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-14T21:01:34.025617] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-14T21:01:34.047835] [DEBUG] [LOCAL ] WAT: Derivative data saved (1352 records). [2025-09-14T21:01:34.050811] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-14T21:01:34.050740] [DEBUG] [LOCAL ] WAL: Derivative data saved (1352 records). [2025-09-14T21:01:34.053532] [INFO ] [MAIN ] Derivative Progress: 2129/2226 symbols completed. WAT took 1.1s. Estimated remaining: 34.1s. Rate: 170.6 symbols/min [2025-09-14T21:01:34.053744] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-14T21:01:34.056685] [INFO ] [MAIN ] Derivative Progress: 2130/2226 symbols completed. WAL took 1.2s. Estimated remaining: 33.7s. Rate: 170.7 symbols/min [2025-09-14T21:01:34.057479] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:34.057773] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:34.057918] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:34.069206] [DEBUG] [LOCAL ] WBX: Loaded 7656 existing records from primary storage. [2025-09-14T21:01:34.069527] [INFO ] [MAIN ] WBX: Loaded 7656 primary data records. [2025-09-14T21:01:34.267701] [DEBUG] [LOCAL ] WCC: Loaded 29398 existing records from primary storage. [2025-09-14T21:01:34.272780] [INFO ] [MAIN ] WCC: Loaded 29398 primary data records. [2025-09-14T21:01:34.300404] [DEBUG] [LOCAL ] WBS: Loaded 36429 existing records from primary storage. [2025-09-14T21:01:34.313928] [INFO ] [MAIN ] WBS: Loaded 36429 primary data records. [2025-09-14T21:01:34.978167] [DEBUG] [MAIN ] WBX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:34.980034] [INFO ] [MAIN ] WBX: Generated 1352 derivative records from 7656 primary records. [2025-09-14T21:01:34.981958] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-14T21:01:34.996604] [DEBUG] [LOCAL ] WBX: Derivative data saved (1352 records). [2025-09-14T21:01:34.998300] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-14T21:01:35.001775] [INFO ] [MAIN ] Derivative Progress: 2131/2226 symbols completed. WBX took 0.9s. Estimated remaining: 33.4s. Rate: 170.5 symbols/min [2025-09-14T21:01:35.002774] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:35.014408] [DEBUG] [MAIN ] WCC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:35.017235] [INFO ] [MAIN ] WCC: Generated 1352 derivative records from 29398 primary records. [2025-09-14T21:01:35.017854] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-14T21:01:35.028982] [DEBUG] [MAIN ] WBS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:35.030258] [INFO ] [MAIN ] WBS: Generated 1352 derivative records from 36429 primary records. [2025-09-14T21:01:35.030622] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-14T21:01:35.055318] [DEBUG] [LOCAL ] WBS: Derivative data saved (1352 records). [2025-09-14T21:01:35.057538] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-14T21:01:35.057311] [DEBUG] [LOCAL ] WCC: Derivative data saved (1352 records). [2025-09-14T21:01:35.057730] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-14T21:01:35.059782] [INFO ] [MAIN ] Derivative Progress: 2132/2226 symbols completed. WBS took 1.0s. Estimated remaining: 33.1s. Rate: 170.6 symbols/min [2025-09-14T21:01:35.062765] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:35.062845] [INFO ] [MAIN ] Derivative Progress: 2133/2226 symbols completed. WCC took 1.0s. Estimated remaining: 32.7s. Rate: 170.7 symbols/min [2025-09-14T21:01:35.072982] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:35.096609] [DEBUG] [LOCAL ] WCN: Loaded 35964 existing records from primary storage. [2025-09-14T21:01:35.097047] [INFO ] [MAIN ] WCN: Loaded 35964 primary data records. [2025-09-14T21:01:35.202215] [DEBUG] [LOCAL ] WDH: Loaded 11802 existing records from primary storage. [2025-09-14T21:01:35.201884] [DEBUG] [LOCAL ] WD: Loaded 17418 existing records from primary storage. [2025-09-14T21:01:35.213583] [INFO ] [MAIN ] WDH: Loaded 11802 primary data records. [2025-09-14T21:01:35.236091] [INFO ] [MAIN ] WD: Loaded 17418 primary data records. [2025-09-14T21:01:35.980634] [DEBUG] [MAIN ] WCN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:35.982195] [INFO ] [MAIN ] WCN: Generated 1352 derivative records from 35964 primary records. [2025-09-14T21:01:35.982766] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-14T21:01:36.007605] [DEBUG] [MAIN ] WDH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:36.011921] [INFO ] [MAIN ] WDH: Generated 1352 derivative records from 11802 primary records. [2025-09-14T21:01:36.012825] [DEBUG] [LOCAL ] WCN: Derivative data saved (1352 records). [2025-09-14T21:01:36.012953] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-14T21:01:36.014182] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-14T21:01:36.018048] [INFO ] [MAIN ] Derivative Progress: 2134/2226 symbols completed. WCN took 1.0s. Estimated remaining: 32.4s. Rate: 170.5 symbols/min [2025-09-14T21:01:36.027690] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:36.041337] [DEBUG] [LOCAL ] WDH: Derivative data saved (1352 records). [2025-09-14T21:01:36.048271] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-14T21:01:36.047853] [DEBUG] [MAIN ] WD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:36.051484] [INFO ] [MAIN ] Derivative Progress: 2135/2226 symbols completed. WDH took 1.0s. Estimated remaining: 32.0s. Rate: 170.6 symbols/min [2025-09-14T21:01:36.052373] [INFO ] [MAIN ] WD: Generated 1352 derivative records from 17418 primary records. [2025-09-14T21:01:36.052813] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:36.052941] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-14T21:01:36.073324] [DEBUG] [LOCAL ] WD: Derivative data saved (1352 records). [2025-09-14T21:01:36.073608] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-14T21:01:36.075966] [INFO ] [MAIN ] Derivative Progress: 2136/2226 symbols completed. WD took 1.0s. Estimated remaining: 31.6s. Rate: 170.7 symbols/min [2025-09-14T21:01:36.077145] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:36.084033] [DEBUG] [LOCAL ] WDI: Loaded 15725 existing records from primary storage. [2025-09-14T21:01:36.084487] [INFO ] [MAIN ] WDI: Loaded 15725 primary data records. [2025-09-14T21:01:36.219231] [DEBUG] [LOCAL ] WEA: Loaded 6074 existing records from primary storage. [2025-09-14T21:01:36.219624] [INFO ] [MAIN ] WEA: Loaded 6074 primary data records. [2025-09-14T21:01:36.403916] [DEBUG] [LOCAL ] WDS: Loaded 32037 existing records from primary storage. [2025-09-14T21:01:36.429696] [INFO ] [MAIN ] WDS: Loaded 32037 primary data records. [2025-09-14T21:01:37.049066] [DEBUG] [MAIN ] WDI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:37.050489] [INFO ] [MAIN ] WDI: Generated 1352 derivative records from 15725 primary records. [2025-09-14T21:01:37.050984] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-14T21:01:37.065360] [DEBUG] [MAIN ] WEA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:37.078275] [DEBUG] [LOCAL ] WDI: Derivative data saved (1352 records). [2025-09-14T21:01:37.079160] [INFO ] [MAIN ] WEA: Generated 1352 derivative records from 6074 primary records. [2025-09-14T21:01:37.080893] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-14T21:01:37.083455] [INFO ] [MAIN ] Derivative Progress: 2137/2226 symbols completed. WDI took 1.1s. Estimated remaining: 31.3s. Rate: 170.5 symbols/min [2025-09-14T21:01:37.083729] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-14T21:01:37.084929] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:37.096907] [DEBUG] [MAIN ] WDS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:37.098985] [INFO ] [MAIN ] WDS: Generated 1352 derivative records from 32037 primary records. [2025-09-14T21:01:37.107959] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-14T21:01:37.110920] [DEBUG] [LOCAL ] WEA: Derivative data saved (1352 records). [2025-09-14T21:01:37.112107] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-14T21:01:37.114888] [INFO ] [MAIN ] Derivative Progress: 2138/2226 symbols completed. WEA took 1.0s. Estimated remaining: 30.9s. Rate: 170.6 symbols/min [2025-09-14T21:01:37.121380] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:37.128293] [DEBUG] [LOCAL ] WDS: Derivative data saved (1352 records). [2025-09-14T21:01:37.128524] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-14T21:01:37.131463] [INFO ] [MAIN ] Derivative Progress: 2139/2226 symbols completed. WDS took 1.1s. Estimated remaining: 30.6s. Rate: 170.7 symbols/min [2025-09-14T21:01:37.140684] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:37.157994] [DEBUG] [LOCAL ] WEAV: Loaded 31291 existing records from primary storage. [2025-09-14T21:01:37.158573] [INFO ] [MAIN ] WEAV: Loaded 31291 primary data records. [2025-09-14T21:01:37.487004] [DEBUG] [LOCAL ] WELL: Loaded 39252 existing records from primary storage. [2025-09-14T21:01:37.504997] [INFO ] [MAIN ] WELL: Loaded 39252 primary data records. [2025-09-14T21:01:37.544764] [DEBUG] [LOCAL ] WEC: Loaded 39283 existing records from primary storage. [2025-09-14T21:01:37.571573] [INFO ] [MAIN ] WEC: Loaded 39283 primary data records. [2025-09-14T21:01:38.134347] [DEBUG] [MAIN ] WEAV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:38.137395] [INFO ] [MAIN ] WEAV: Generated 1352 derivative records from 31291 primary records. [2025-09-14T21:01:38.137633] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-14T21:01:38.154863] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1352 records). [2025-09-14T21:01:38.156077] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-14T21:01:38.159454] [INFO ] [MAIN ] Derivative Progress: 2140/2226 symbols completed. WEAV took 1.1s. Estimated remaining: 30.3s. Rate: 170.5 symbols/min [2025-09-14T21:01:38.160128] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:38.173762] [DEBUG] [MAIN ] WELL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:38.174944] [INFO ] [MAIN ] WELL: Generated 1352 derivative records from 39252 primary records. [2025-09-14T21:01:38.181013] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-14T21:01:38.185314] [DEBUG] [MAIN ] WEC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:38.186774] [INFO ] [MAIN ] WEC: Generated 1352 derivative records from 39283 primary records. [2025-09-14T21:01:38.187143] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-14T21:01:38.200262] [DEBUG] [LOCAL ] WELL: Derivative data saved (1352 records). [2025-09-14T21:01:38.200803] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-14T21:01:38.208510] [INFO ] [MAIN ] Derivative Progress: 2141/2226 symbols completed. WELL took 1.1s. Estimated remaining: 29.9s. Rate: 170.6 symbols/min [2025-09-14T21:01:38.212323] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:38.226689] [DEBUG] [LOCAL ] WEC: Derivative data saved (1352 records). [2025-09-14T21:01:38.227564] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-14T21:01:38.231368] [INFO ] [MAIN ] Derivative Progress: 2142/2226 symbols completed. WEC took 1.1s. Estimated remaining: 29.5s. Rate: 170.7 symbols/min [2025-09-14T21:01:38.243558] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:38.244369] [DEBUG] [LOCAL ] WES: Loaded 36046 existing records from primary storage. [2025-09-14T21:01:38.250416] [INFO ] [MAIN ] WES: Loaded 36046 primary data records. [2025-09-14T21:01:38.377816] [DEBUG] [LOCAL ] WEX: Loaded 24622 existing records from primary storage. [2025-09-14T21:01:38.382514] [DEBUG] [LOCAL ] WF: Loaded 8185 existing records from primary storage. [2025-09-14T21:01:38.398506] [INFO ] [MAIN ] WF: Loaded 8185 primary data records. [2025-09-14T21:01:38.382610] [INFO ] [MAIN ] WEX: Loaded 24622 primary data records. [2025-09-14T21:01:39.201572] [DEBUG] [MAIN ] WES: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:39.204711] [INFO ] [MAIN ] WES: Generated 1352 derivative records from 36046 primary records. [2025-09-14T21:01:39.205885] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-14T21:01:39.223406] [DEBUG] [LOCAL ] WES: Derivative data saved (1352 records). [2025-09-14T21:01:39.230790] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-14T21:01:39.239264] [INFO ] [MAIN ] Derivative Progress: 2143/2226 symbols completed. WES took 1.1s. Estimated remaining: 29.2s. Rate: 170.5 symbols/min [2025-09-14T21:01:39.236663] [DEBUG] [MAIN ] WF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:39.241013] [INFO ] [MAIN ] WF: Generated 1352 derivative records from 8185 primary records. [2025-09-14T21:01:39.241158] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-14T21:01:39.260739] [DEBUG] [MAIN ] WEX: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:39.262154] [INFO ] [MAIN ] WEX: Generated 1352 derivative records from 24622 primary records. [2025-09-14T21:01:39.262685] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-14T21:01:39.274091] [DEBUG] [LOCAL ] WF: Derivative data saved (1352 records). [2025-09-14T21:01:39.274835] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-14T21:01:39.277873] [INFO ] [MAIN ] Derivative Progress: 2144/2226 symbols completed. WF took 1.0s. Estimated remaining: 28.8s. Rate: 170.6 symbols/min [2025-09-14T21:01:39.280325] [DEBUG] [LOCAL ] WEX: Derivative data saved (1352 records). [2025-09-14T21:01:39.280410] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-14T21:01:39.282566] [INFO ] [MAIN ] Derivative Progress: 2145/2226 symbols completed. WEX took 1.1s. Estimated remaining: 28.5s. Rate: 170.7 symbols/min [2025-09-14T21:01:39.283053] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:39.283140] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:39.283596] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:39.326949] [DEBUG] [LOCAL ] WFG: Loaded 18099 existing records from primary storage. [2025-09-14T21:01:39.328348] [INFO ] [MAIN ] WFG: Loaded 18099 primary data records. [2025-09-14T21:01:39.328988] [DEBUG] [LOCAL ] WGO: Loaded 28363 existing records from primary storage. [2025-09-14T21:01:39.386174] [INFO ] [MAIN ] WGO: Loaded 28363 primary data records. [2025-09-14T21:01:39.572517] [DEBUG] [LOCAL ] WFC: Loaded 40488 existing records from primary storage. [2025-09-14T21:01:39.656467] [INFO ] [MAIN ] WFC: Loaded 40488 primary data records. [2025-09-14T21:01:40.497473] [DEBUG] [MAIN ] WGO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:40.520245] [INFO ] [MAIN ] WGO: Generated 1352 derivative records from 28363 primary records. [2025-09-14T21:01:40.533676] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-14T21:01:40.533462] [DEBUG] [MAIN ] WFG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:40.536589] [INFO ] [MAIN ] WFG: Generated 1352 derivative records from 18099 primary records. [2025-09-14T21:01:40.547949] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-14T21:01:40.559908] [DEBUG] [LOCAL ] WGO: Derivative data saved (1352 records). [2025-09-14T21:01:40.571515] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-14T21:01:40.577852] [INFO ] [MAIN ] Derivative Progress: 2146/2226 symbols completed. WGO took 1.3s. Estimated remaining: 28.2s. Rate: 170.5 symbols/min [2025-09-14T21:01:40.579987] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:40.580603] [DEBUG] [LOCAL ] WFG: Derivative data saved (1352 records). [2025-09-14T21:01:40.581897] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-14T21:01:40.585453] [INFO ] [MAIN ] Derivative Progress: 2147/2226 symbols completed. WFG took 1.3s. Estimated remaining: 27.8s. Rate: 170.6 symbols/min [2025-09-14T21:01:40.587172] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:40.608707] [DEBUG] [MAIN ] WFC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:40.609749] [INFO ] [MAIN ] WFC: Generated 1352 derivative records from 40488 primary records. [2025-09-14T21:01:40.609887] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-14T21:01:40.671442] [DEBUG] [LOCAL ] WFC: Derivative data saved (1352 records). [2025-09-14T21:01:40.671704] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-14T21:01:40.670552] [DEBUG] [LOCAL ] WH: Loaded 34303 existing records from primary storage. [2025-09-14T21:01:40.674537] [INFO ] [MAIN ] Derivative Progress: 2148/2226 symbols completed. WFC took 1.4s. Estimated remaining: 27.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:40.674701] [INFO ] [MAIN ] WH: Loaded 34303 primary data records. [2025-09-14T21:01:40.675843] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:40.710831] [DEBUG] [LOCAL ] WHD: Loaded 29778 existing records from primary storage. [2025-09-14T21:01:40.747588] [INFO ] [MAIN ] WHD: Loaded 29778 primary data records. [2025-09-14T21:01:40.867974] [DEBUG] [LOCAL ] WHG: Loaded 2644 existing records from primary storage. [2025-09-14T21:01:40.921274] [INFO ] [MAIN ] WHG: Loaded 2644 primary data records. [2025-09-14T21:01:41.663937] [DEBUG] [MAIN ] WH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:41.665102] [INFO ] [MAIN ] WH: Generated 1352 derivative records from 34303 primary records. [2025-09-14T21:01:41.665448] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-14T21:01:41.701857] [DEBUG] [MAIN ] WHD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:41.702543] [DEBUG] [MAIN ] WHG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:41.704008] [INFO ] [MAIN ] WHD: Generated 1352 derivative records from 29778 primary records. [2025-09-14T21:01:41.703945] [INFO ] [MAIN ] WHG: Generated 1352 derivative records from 2644 primary records. [2025-09-14T21:01:41.704693] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-14T21:01:41.705037] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-14T21:01:41.706721] [DEBUG] [LOCAL ] WH: Derivative data saved (1352 records). [2025-09-14T21:01:41.707146] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-14T21:01:41.709235] [INFO ] [MAIN ] Derivative Progress: 2149/2226 symbols completed. WH took 1.1s. Estimated remaining: 27.1s. Rate: 170.5 symbols/min [2025-09-14T21:01:41.717283] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:41.729744] [DEBUG] [LOCAL ] WHG: Derivative data saved (1352 records). [2025-09-14T21:01:41.731818] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-14T21:01:41.734969] [INFO ] [MAIN ] Derivative Progress: 2150/2226 symbols completed. WHG took 1.1s. Estimated remaining: 26.7s. Rate: 170.5 symbols/min [2025-09-14T21:01:41.732771] [DEBUG] [LOCAL ] WHD: Derivative data saved (1352 records). [2025-09-14T21:01:41.735352] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:41.735484] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-14T21:01:41.738498] [INFO ] [MAIN ] Derivative Progress: 2151/2226 symbols completed. WHD took 1.2s. Estimated remaining: 26.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:41.738813] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:41.744045] [DEBUG] [LOCAL ] WIA: Loaded 3550 existing records from primary storage. [2025-09-14T21:01:41.744390] [INFO ] [MAIN ] WIA: Loaded 3550 primary data records. [2025-09-14T21:01:41.871949] [DEBUG] [LOCAL ] WINN: Loaded 8241 existing records from primary storage. [2025-09-14T21:01:41.872152] [INFO ] [MAIN ] WINN: Loaded 8241 primary data records. [2025-09-14T21:01:42.164473] [DEBUG] [LOCAL ] WHR: Loaded 36666 existing records from primary storage. [2025-09-14T21:01:42.185801] [INFO ] [MAIN ] WHR: Loaded 36666 primary data records. [2025-09-14T21:01:42.636857] [DEBUG] [MAIN ] WIA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:42.640187] [INFO ] [MAIN ] WIA: Generated 1352 derivative records from 3550 primary records. [2025-09-14T21:01:42.641168] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-14T21:01:42.661976] [DEBUG] [MAIN ] WINN: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:01:42.664240] [INFO ] [MAIN ] WINN: Generated 1351 derivative records from 8241 primary records. [2025-09-14T21:01:42.663295] [DEBUG] [LOCAL ] WIA: Derivative data saved (1352 records). [2025-09-14T21:01:42.664474] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-14T21:01:42.664403] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-14T21:01:42.672081] [INFO ] [MAIN ] Derivative Progress: 2152/2226 symbols completed. WIA took 0.9s. Estimated remaining: 26.0s. Rate: 170.5 symbols/min [2025-09-14T21:01:42.672902] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:42.687717] [DEBUG] [LOCAL ] WINN: Derivative data saved (1351 records). [2025-09-14T21:01:42.689603] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-14T21:01:42.692161] [INFO ] [MAIN ] Derivative Progress: 2153/2226 symbols completed. WINN took 1.0s. Estimated remaining: 25.7s. Rate: 170.6 symbols/min [2025-09-14T21:01:42.692598] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:42.704634] [DEBUG] [MAIN ] WHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:42.705714] [INFO ] [MAIN ] WHR: Generated 1352 derivative records from 36666 primary records. [2025-09-14T21:01:42.705902] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-14T21:01:42.720004] [DEBUG] [LOCAL ] WHR: Derivative data saved (1352 records). [2025-09-14T21:01:42.732937] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-14T21:01:42.735844] [INFO ] [MAIN ] Derivative Progress: 2154/2226 symbols completed. WHR took 1.0s. Estimated remaining: 25.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:42.736331] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:42.745330] [DEBUG] [LOCAL ] WIW: Loaded 15541 existing records from primary storage. [2025-09-14T21:01:42.745571] [INFO ] [MAIN ] WIW: Loaded 15541 primary data records. [2025-09-14T21:01:42.873708] [DEBUG] [LOCAL ] WIT: Loaded 39402 existing records from primary storage. [2025-09-14T21:01:42.878117] [INFO ] [MAIN ] WIT: Loaded 39402 primary data records. [2025-09-14T21:01:43.033278] [DEBUG] [LOCAL ] WK: Loaded 26892 existing records from primary storage. [2025-09-14T21:01:43.141456] [INFO ] [MAIN ] WK: Loaded 26892 primary data records. [2025-09-14T21:01:43.663304] [DEBUG] [MAIN ] WIW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:43.664772] [INFO ] [MAIN ] WIW: Generated 1352 derivative records from 15541 primary records. [2025-09-14T21:01:43.664995] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-14T21:01:43.680531] [DEBUG] [LOCAL ] WIW: Derivative data saved (1352 records). [2025-09-14T21:01:43.681287] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-14T21:01:43.683194] [INFO ] [MAIN ] Derivative Progress: 2155/2226 symbols completed. WIW took 1.0s. Estimated remaining: 25.0s. Rate: 170.5 symbols/min [2025-09-14T21:01:43.689698] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:43.694127] [DEBUG] [MAIN ] WIT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:43.695121] [INFO ] [MAIN ] WIT: Generated 1352 derivative records from 39402 primary records. [2025-09-14T21:01:43.695390] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-14T21:01:43.708540] [DEBUG] [LOCAL ] WIT: Derivative data saved (1352 records). [2025-09-14T21:01:43.710409] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-14T21:01:43.713580] [INFO ] [MAIN ] Derivative Progress: 2156/2226 symbols completed. WIT took 1.0s. Estimated remaining: 24.6s. Rate: 170.6 symbols/min [2025-09-14T21:01:43.713911] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:43.732278] [DEBUG] [MAIN ] WK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:43.733284] [INFO ] [MAIN ] WK: Generated 1352 derivative records from 26892 primary records. [2025-09-14T21:01:43.733487] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-14T21:01:43.754437] [DEBUG] [LOCAL ] WK: Derivative data saved (1352 records). [2025-09-14T21:01:43.754916] [DEBUG] [LOCAL ] WKC: Loaded 26041 existing records from primary storage. [2025-09-14T21:01:43.755084] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-14T21:01:43.755160] [INFO ] [MAIN ] WKC: Loaded 26041 primary data records. [2025-09-14T21:01:43.757545] [INFO ] [MAIN ] Derivative Progress: 2157/2226 symbols completed. WK took 1.0s. Estimated remaining: 24.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:43.757953] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:43.877750] [DEBUG] [LOCAL ] WLKP: Loaded 4996 existing records from primary storage. [2025-09-14T21:01:43.888701] [INFO ] [MAIN ] WLKP: Loaded 4996 primary data records. [2025-09-14T21:01:44.013005] [DEBUG] [LOCAL ] WLK: Loaded 34554 existing records from primary storage. [2025-09-14T21:01:44.039085] [INFO ] [MAIN ] WLK: Loaded 34554 primary data records. [2025-09-14T21:01:44.686565] [DEBUG] [MAIN ] WKC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:44.687517] [INFO ] [MAIN ] WKC: Generated 1352 derivative records from 26041 primary records. [2025-09-14T21:01:44.687821] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-14T21:01:44.705192] [DEBUG] [LOCAL ] WKC: Derivative data saved (1352 records). [2025-09-14T21:01:44.707710] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-14T21:01:44.720663] [INFO ] [MAIN ] Derivative Progress: 2158/2226 symbols completed. WKC took 1.0s. Estimated remaining: 23.9s. Rate: 170.5 symbols/min [2025-09-14T21:01:44.721302] [DEBUG] [MAIN ] WLKP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:44.722518] [INFO ] [MAIN ] WLKP: Generated 1352 derivative records from 4996 primary records. [2025-09-14T21:01:44.722836] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-14T21:01:44.733340] [DEBUG] [MAIN ] WLK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:44.734131] [INFO ] [MAIN ] WLK: Generated 1352 derivative records from 34554 primary records. [2025-09-14T21:01:44.739537] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-14T21:01:44.759020] [DEBUG] [LOCAL ] WLK: Derivative data saved (1352 records). [2025-09-14T21:01:44.759137] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1352 records). [2025-09-14T21:01:44.759419] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-14T21:01:44.759348] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-14T21:01:44.762774] [INFO ] [MAIN ] Derivative Progress: 2159/2226 symbols completed. WLKP took 1.0s. Estimated remaining: 23.6s. Rate: 170.6 symbols/min [2025-09-14T21:01:44.765620] [INFO ] [MAIN ] Derivative Progress: 2160/2226 symbols completed. WLK took 1.1s. Estimated remaining: 23.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:44.766321] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:44.766422] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:44.766548] [INFO ] [MAIN ] WLTG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:44.771344] [DEBUG] [LOCAL ] WLTG: Loaded 898 existing records from primary storage. [2025-09-14T21:01:44.771516] [INFO ] [MAIN ] WLTG: Loaded 898 primary data records. [2025-09-14T21:01:44.907783] [DEBUG] [LOCAL ] WLY: Loaded 22672 existing records from primary storage. [2025-09-14T21:01:44.947950] [INFO ] [MAIN ] WLY: Loaded 22672 primary data records. [2025-09-14T21:01:45.186119] [DEBUG] [LOCAL ] WM: Loaded 38369 existing records from primary storage. [2025-09-14T21:01:45.203075] [INFO ] [MAIN ] WM: Loaded 38369 primary data records. [2025-09-14T21:01:45.695011] [DEBUG] [MAIN ] WLTG: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:01:45.696416] [INFO ] [MAIN ] WLTG: Generated 1351 derivative records from 898 primary records. [2025-09-14T21:01:45.696679] [DEBUG] [LOCAL ] WLTG: Saving derivative data. [2025-09-14T21:01:45.711881] [DEBUG] [LOCAL ] WLTG: Derivative data saved (1351 records). [2025-09-14T21:01:45.712535] [INFO ] [MAIN ] WLTG: Successfully saved derivative data. [2025-09-14T21:01:45.715389] [INFO ] [MAIN ] Derivative Progress: 2161/2226 symbols completed. WLTG took 0.9s. Estimated remaining: 22.9s. Rate: 170.5 symbols/min [2025-09-14T21:01:45.716341] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:45.738819] [DEBUG] [MAIN ] WLY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:45.750164] [INFO ] [MAIN ] WLY: Generated 1352 derivative records from 22672 primary records. [2025-09-14T21:01:45.749243] [DEBUG] [MAIN ] WM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:45.750823] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-14T21:01:45.750882] [INFO ] [MAIN ] WM: Generated 1352 derivative records from 38369 primary records. [2025-09-14T21:01:45.751155] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-14T21:01:45.774305] [DEBUG] [LOCAL ] WM: Derivative data saved (1352 records). [2025-09-14T21:01:45.774844] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-14T21:01:45.777564] [INFO ] [MAIN ] Derivative Progress: 2162/2226 symbols completed. WM took 1.0s. Estimated remaining: 22.5s. Rate: 170.6 symbols/min [2025-09-14T21:01:45.778315] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:45.789300] [DEBUG] [LOCAL ] WLY: Derivative data saved (1352 records). [2025-09-14T21:01:45.789706] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-14T21:01:45.792322] [INFO ] [MAIN ] Derivative Progress: 2163/2226 symbols completed. WLY took 1.0s. Estimated remaining: 22.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:45.792940] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:45.805055] [DEBUG] [LOCAL ] WMK: Loaded 10865 existing records from primary storage. [2025-09-14T21:01:45.805435] [INFO ] [MAIN ] WMK: Loaded 10865 primary data records. [2025-09-14T21:01:45.877078] [DEBUG] [LOCAL ] WMB: Loaded 40413 existing records from primary storage. [2025-09-14T21:01:45.934598] [INFO ] [MAIN ] WMB: Loaded 40413 primary data records. [2025-09-14T21:01:46.116234] [DEBUG] [LOCAL ] WMS: Loaded 29750 existing records from primary storage. [2025-09-14T21:01:46.226454] [INFO ] [MAIN ] WMS: Loaded 29750 primary data records. [2025-09-14T21:01:46.744865] [DEBUG] [MAIN ] WMK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:46.746042] [INFO ] [MAIN ] WMK: Generated 1352 derivative records from 10865 primary records. [2025-09-14T21:01:46.747855] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-14T21:01:46.772202] [DEBUG] [MAIN ] WMB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:46.773394] [DEBUG] [LOCAL ] WMK: Derivative data saved (1352 records). [2025-09-14T21:01:46.773500] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-14T21:01:46.775390] [INFO ] [MAIN ] Derivative Progress: 2164/2226 symbols completed. WMK took 1.0s. Estimated remaining: 21.8s. Rate: 170.5 symbols/min [2025-09-14T21:01:46.776250] [INFO ] [MAIN ] WMB: Generated 1352 derivative records from 40413 primary records. [2025-09-14T21:01:46.776607] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:46.776824] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-14T21:01:46.799431] [DEBUG] [LOCAL ] WMB: Derivative data saved (1352 records). [2025-09-14T21:01:46.803883] [DEBUG] [MAIN ] WMS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:46.803946] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-14T21:01:46.807932] [INFO ] [MAIN ] Derivative Progress: 2165/2226 symbols completed. WMB took 1.1s. Estimated remaining: 21.5s. Rate: 170.6 symbols/min [2025-09-14T21:01:46.804790] [INFO ] [MAIN ] WMS: Generated 1352 derivative records from 29750 primary records. [2025-09-14T21:01:46.808338] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:46.808384] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-14T21:01:46.825067] [DEBUG] [LOCAL ] WMS: Derivative data saved (1352 records). [2025-09-14T21:01:46.825278] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-14T21:01:46.827784] [INFO ] [MAIN ] Derivative Progress: 2166/2226 symbols completed. WMS took 1.0s. Estimated remaining: 21.1s. Rate: 170.6 symbols/min [2025-09-14T21:01:46.828259] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:46.874456] [DEBUG] [LOCAL ] WNC: Loaded 29515 existing records from primary storage. [2025-09-14T21:01:46.886657] [INFO ] [MAIN ] WNC: Loaded 29515 primary data records. [2025-09-14T21:01:46.900327] [DEBUG] [LOCAL ] WMT: Loaded 40540 existing records from primary storage. [2025-09-14T21:01:46.926580] [INFO ] [MAIN ] WMT: Loaded 40540 primary data records. [2025-09-14T21:01:46.957550] [DEBUG] [LOCAL ] WNS: Loaded 30428 existing records from primary storage. [2025-09-14T21:01:47.045682] [INFO ] [MAIN ] WNS: Loaded 30428 primary data records. [2025-09-14T21:01:47.794251] [DEBUG] [MAIN ] WMT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:47.793757] [DEBUG] [MAIN ] WNC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:47.797284] [INFO ] [MAIN ] WNC: Generated 1352 derivative records from 29515 primary records. [2025-09-14T21:01:47.798115] [INFO ] [MAIN ] WMT: Generated 1352 derivative records from 40540 primary records. [2025-09-14T21:01:47.798476] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-14T21:01:47.798617] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-14T21:01:47.814481] [DEBUG] [MAIN ] WNS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:47.832804] [INFO ] [MAIN ] WNS: Generated 1352 derivative records from 30428 primary records. [2025-09-14T21:01:47.837630] [DEBUG] [LOCAL ] WMT: Derivative data saved (1352 records). [2025-09-14T21:01:47.839493] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-14T21:01:47.841121] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-14T21:01:47.841044] [DEBUG] [LOCAL ] WNC: Derivative data saved (1352 records). [2025-09-14T21:01:47.844230] [INFO ] [MAIN ] Derivative Progress: 2167/2226 symbols completed. WMT took 1.1s. Estimated remaining: 20.8s. Rate: 170.5 symbols/min [2025-09-14T21:01:47.844511] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-14T21:01:47.844793] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:47.848353] [INFO ] [MAIN ] Derivative Progress: 2168/2226 symbols completed. WNC took 1.0s. Estimated remaining: 20.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:47.861976] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:47.862874] [DEBUG] [LOCAL ] WNS: Derivative data saved (1352 records). [2025-09-14T21:01:47.863300] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-14T21:01:47.866139] [INFO ] [MAIN ] Derivative Progress: 2169/2226 symbols completed. WNS took 1.0s. Estimated remaining: 20.0s. Rate: 170.7 symbols/min [2025-09-14T21:01:47.866705] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:47.907908] [DEBUG] [LOCAL ] WOR: Loaded 16996 existing records from primary storage. [2025-09-14T21:01:47.908172] [INFO ] [MAIN ] WOR: Loaded 16996 primary data records. [2025-09-14T21:01:48.024439] [DEBUG] [LOCAL ] WOLF: Loaded 40278 existing records from primary storage. [2025-09-14T21:01:48.030370] [DEBUG] [LOCAL ] WOW: Loaded 21967 existing records from primary storage. [2025-09-14T21:01:48.041517] [INFO ] [MAIN ] WOLF: Loaded 40278 primary data records. [2025-09-14T21:01:48.041605] [INFO ] [MAIN ] WOW: Loaded 21967 primary data records. [2025-09-14T21:01:48.848673] [DEBUG] [MAIN ] WOR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:48.859903] [INFO ] [MAIN ] WOR: Generated 1352 derivative records from 16996 primary records. [2025-09-14T21:01:48.862600] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-14T21:01:48.861894] [DEBUG] [MAIN ] WOW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:48.864487] [INFO ] [MAIN ] WOW: Generated 1352 derivative records from 21967 primary records. [2025-09-14T21:01:48.865069] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-14T21:01:48.894023] [DEBUG] [MAIN ] WOLF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:48.897772] [INFO ] [MAIN ] WOLF: Generated 1352 derivative records from 40278 primary records. [2025-09-14T21:01:48.898386] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-14T21:01:48.902904] [DEBUG] [LOCAL ] WOR: Derivative data saved (1352 records). [2025-09-14T21:01:48.903702] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-14T21:01:48.916245] [INFO ] [MAIN ] Derivative Progress: 2170/2226 symbols completed. WOR took 1.1s. Estimated remaining: 19.7s. Rate: 170.5 symbols/min [2025-09-14T21:01:48.918241] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:48.919235] [DEBUG] [LOCAL ] WOW: Derivative data saved (1352 records). [2025-09-14T21:01:48.919608] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-14T21:01:48.918177] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1352 records). [2025-09-14T21:01:48.922231] [INFO ] [MAIN ] Derivative Progress: 2171/2226 symbols completed. WOW took 1.1s. Estimated remaining: 19.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:48.922679] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-14T21:01:48.923976] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:48.926811] [INFO ] [MAIN ] Derivative Progress: 2172/2226 symbols completed. WOLF took 1.1s. Estimated remaining: 19.0s. Rate: 170.7 symbols/min [2025-09-14T21:01:48.927430] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:48.970340] [DEBUG] [LOCAL ] WPP: Loaded 24946 existing records from primary storage. [2025-09-14T21:01:48.990354] [INFO ] [MAIN ] WPP: Loaded 24946 primary data records. [2025-09-14T21:01:48.991239] [DEBUG] [LOCAL ] WPC: Loaded 36364 existing records from primary storage. [2025-09-14T21:01:49.013295] [INFO ] [MAIN ] WPC: Loaded 36364 primary data records. [2025-09-14T21:01:49.186777] [DEBUG] [LOCAL ] WPM: Loaded 39617 existing records from primary storage. [2025-09-14T21:01:49.276908] [INFO ] [MAIN ] WPM: Loaded 39617 primary data records. [2025-09-14T21:01:49.878876] [DEBUG] [MAIN ] WPP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:49.881331] [INFO ] [MAIN ] WPP: Generated 1352 derivative records from 24946 primary records. [2025-09-14T21:01:49.882197] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-14T21:01:49.894208] [DEBUG] [MAIN ] WPC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:49.900749] [INFO ] [MAIN ] WPC: Generated 1352 derivative records from 36364 primary records. [2025-09-14T21:01:49.904756] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-14T21:01:49.920225] [DEBUG] [LOCAL ] WPP: Derivative data saved (1352 records). [2025-09-14T21:01:49.921479] [DEBUG] [LOCAL ] WPC: Derivative data saved (1352 records). [2025-09-14T21:01:49.923603] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-14T21:01:49.923345] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-14T21:01:49.935354] [INFO ] [MAIN ] Derivative Progress: 2173/2226 symbols completed. WPP took 1.0s. Estimated remaining: 18.7s. Rate: 170.5 symbols/min [2025-09-14T21:01:49.938837] [DEBUG] [MAIN ] WPM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:49.938892] [INFO ] [MAIN ] Derivative Progress: 2174/2226 symbols completed. WPC took 1.0s. Estimated remaining: 18.3s. Rate: 170.6 symbols/min [2025-09-14T21:01:49.940316] [INFO ] [MAIN ] WPM: Generated 1352 derivative records from 39617 primary records. [2025-09-14T21:01:49.940601] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-14T21:01:49.956200] [DEBUG] [LOCAL ] WPM: Derivative data saved (1352 records). [2025-09-14T21:01:49.956353] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-14T21:01:49.958843] [INFO ] [MAIN ] Derivative Progress: 2175/2226 symbols completed. WPM took 1.0s. Estimated remaining: 17.9s. Rate: 170.7 symbols/min [2025-09-14T21:01:49.959510] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:49.959678] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:49.959740] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:49.978497] [DEBUG] [LOCAL ] WS: Loaded 16988 existing records from primary storage. [2025-09-14T21:01:49.978885] [INFO ] [MAIN ] WS: Loaded 16988 primary data records. [2025-09-14T21:01:50.137849] [DEBUG] [LOCAL ] WRB: Loaded 37918 existing records from primary storage. [2025-09-14T21:01:50.176204] [INFO ] [MAIN ] WRB: Loaded 37918 primary data records. [2025-09-14T21:01:50.225800] [DEBUG] [LOCAL ] WRBY: Loaded 38047 existing records from primary storage. [2025-09-14T21:01:50.346752] [INFO ] [MAIN ] WRBY: Loaded 38047 primary data records. [2025-09-14T21:01:50.909817] [DEBUG] [MAIN ] WS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:50.910750] [INFO ] [MAIN ] WS: Generated 1352 derivative records from 16988 primary records. [2025-09-14T21:01:50.911391] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-14T21:01:50.932730] [DEBUG] [LOCAL ] WS: Derivative data saved (1352 records). [2025-09-14T21:01:50.933873] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-14T21:01:50.938165] [INFO ] [MAIN ] Derivative Progress: 2176/2226 symbols completed. WS took 1.0s. Estimated remaining: 17.6s. Rate: 170.5 symbols/min [2025-09-14T21:01:50.950148] [DEBUG] [MAIN ] WRB: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:50.949880] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:50.961593] [DEBUG] [MAIN ] WRBY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:50.960985] [INFO ] [MAIN ] WRB: Generated 1352 derivative records from 37918 primary records. [2025-09-14T21:01:50.961840] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-14T21:01:50.963339] [INFO ] [MAIN ] WRBY: Generated 1352 derivative records from 38047 primary records. [2025-09-14T21:01:50.963636] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-14T21:01:50.986132] [DEBUG] [LOCAL ] WRB: Derivative data saved (1352 records). [2025-09-14T21:01:50.988749] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-14T21:01:50.992071] [INFO ] [MAIN ] Derivative Progress: 2177/2226 symbols completed. WRB took 1.0s. Estimated remaining: 17.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:50.993043] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:50.994194] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1352 records). [2025-09-14T21:01:50.994420] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-14T21:01:50.996949] [INFO ] [MAIN ] Derivative Progress: 2178/2226 symbols completed. WRBY took 1.0s. Estimated remaining: 16.9s. Rate: 170.7 symbols/min [2025-09-14T21:01:50.997672] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:51.033706] [DEBUG] [LOCAL ] WSO: Loaded 18603 existing records from primary storage. [2025-09-14T21:01:51.033932] [INFO ] [MAIN ] WSO: Loaded 18603 primary data records. [2025-09-14T21:01:51.161452] [DEBUG] [LOCAL ] WSM: Loaded 37328 existing records from primary storage. [2025-09-14T21:01:51.161531] [DEBUG] [LOCAL ] WSR: Loaded 16972 existing records from primary storage. [2025-09-14T21:01:51.177994] [INFO ] [MAIN ] WSR: Loaded 16972 primary data records. [2025-09-14T21:01:51.177741] [INFO ] [MAIN ] WSM: Loaded 37328 primary data records. [2025-09-14T21:01:51.942578] [DEBUG] [MAIN ] WSO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:51.943847] [INFO ] [MAIN ] WSO: Generated 1352 derivative records from 18603 primary records. [2025-09-14T21:01:51.944209] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-14T21:01:51.968176] [DEBUG] [LOCAL ] WSO: Derivative data saved (1352 records). [2025-09-14T21:01:51.972511] [DEBUG] [MAIN ] WSR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:51.972694] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-14T21:01:51.984269] [INFO ] [MAIN ] Derivative Progress: 2179/2226 symbols completed. WSO took 1.0s. Estimated remaining: 16.5s. Rate: 170.5 symbols/min [2025-09-14T21:01:51.985994] [DEBUG] [MAIN ] WSM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:51.985682] [INFO ] [MAIN ] WSR: Generated 1352 derivative records from 16972 primary records. [2025-09-14T21:01:51.986730] [INFO ] [MAIN ] WSM: Generated 1352 derivative records from 37328 primary records. [2025-09-14T21:01:51.987025] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-14T21:01:51.986907] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:51.987199] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-14T21:01:52.018768] [DEBUG] [LOCAL ] WSM: Derivative data saved (1352 records). [2025-09-14T21:01:52.018832] [DEBUG] [LOCAL ] WSR: Derivative data saved (1352 records). [2025-09-14T21:01:52.019073] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-14T21:01:52.021342] [INFO ] [MAIN ] Derivative Progress: 2180/2226 symbols completed. WSR took 1.0s. Estimated remaining: 16.2s. Rate: 170.6 symbols/min [2025-09-14T21:01:52.019109] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-14T21:01:52.024123] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:52.024244] [INFO ] [MAIN ] Derivative Progress: 2181/2226 symbols completed. WSM took 1.1s. Estimated remaining: 15.8s. Rate: 170.7 symbols/min [2025-09-14T21:01:52.024839] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:52.046361] [DEBUG] [LOCAL ] WST: Loaded 27474 existing records from primary storage. [2025-09-14T21:01:52.046589] [INFO ] [MAIN ] WST: Loaded 27474 primary data records. [2025-09-14T21:01:52.275186] [DEBUG] [LOCAL ] WT: Loaded 35535 existing records from primary storage. [2025-09-14T21:01:52.252925] [DEBUG] [LOCAL ] WTI: Loaded 33126 existing records from primary storage. [2025-09-14T21:01:52.361867] [INFO ] [MAIN ] WTI: Loaded 33126 primary data records. [2025-09-14T21:01:52.361986] [INFO ] [MAIN ] WT: Loaded 35535 primary data records. [2025-09-14T21:01:52.953253] [DEBUG] [MAIN ] WST: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:52.955201] [INFO ] [MAIN ] WST: Generated 1352 derivative records from 27474 primary records. [2025-09-14T21:01:52.955851] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-14T21:01:52.970321] [DEBUG] [LOCAL ] WST: Derivative data saved (1352 records). [2025-09-14T21:01:52.970681] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-14T21:01:52.972582] [INFO ] [MAIN ] Derivative Progress: 2182/2226 symbols completed. WST took 1.0s. Estimated remaining: 15.5s. Rate: 170.5 symbols/min [2025-09-14T21:01:52.973214] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:52.991006] [DEBUG] [MAIN ] WT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:52.992758] [INFO ] [MAIN ] WT: Generated 1352 derivative records from 35535 primary records. [2025-09-14T21:01:52.993108] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-14T21:01:53.004295] [DEBUG] [MAIN ] WTI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:53.005555] [INFO ] [MAIN ] WTI: Generated 1352 derivative records from 33126 primary records. [2025-09-14T21:01:53.005954] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-14T21:01:53.020237] [DEBUG] [LOCAL ] WT: Derivative data saved (1352 records). [2025-09-14T21:01:53.020588] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-14T21:01:53.035627] [DEBUG] [LOCAL ] WTI: Derivative data saved (1352 records). [2025-09-14T21:01:53.032024] [INFO ] [MAIN ] Derivative Progress: 2183/2226 symbols completed. WT took 1.0s. Estimated remaining: 15.1s. Rate: 170.6 symbols/min [2025-09-14T21:01:53.045079] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-14T21:01:53.045218] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:53.047763] [INFO ] [MAIN ] Derivative Progress: 2184/2226 symbols completed. WTI took 1.0s. Estimated remaining: 14.8s. Rate: 170.7 symbols/min [2025-09-14T21:01:53.048540] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:53.066127] [DEBUG] [LOCAL ] WTRG: Loaded 38237 existing records from primary storage. [2025-09-14T21:01:53.066578] [INFO ] [MAIN ] WTRG: Loaded 38237 primary data records. [2025-09-14T21:01:53.195038] [DEBUG] [LOCAL ] WTS: Loaded 13781 existing records from primary storage. [2025-09-14T21:01:53.216698] [INFO ] [MAIN ] WTS: Loaded 13781 primary data records. [2025-09-14T21:01:53.474385] [DEBUG] [LOCAL ] WTTR: Loaded 32906 existing records from primary storage. [2025-09-14T21:01:53.521129] [INFO ] [MAIN ] WTTR: Loaded 32906 primary data records. [2025-09-14T21:01:53.989128] [DEBUG] [MAIN ] WTRG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:53.990906] [INFO ] [MAIN ] WTRG: Generated 1352 derivative records from 38237 primary records. [2025-09-14T21:01:53.991216] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-14T21:01:54.007107] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1352 records). [2025-09-14T21:01:54.013255] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-14T21:01:54.018969] [INFO ] [MAIN ] Derivative Progress: 2185/2226 symbols completed. WTRG took 1.0s. Estimated remaining: 14.4s. Rate: 170.5 symbols/min [2025-09-14T21:01:54.019791] [DEBUG] [MAIN ] WTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:54.020016] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:54.020878] [INFO ] [MAIN ] WTS: Generated 1352 derivative records from 13781 primary records. [2025-09-14T21:01:54.022085] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-14T21:01:54.047971] [DEBUG] [MAIN ] WTTR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:54.052333] [INFO ] [MAIN ] WTTR: Generated 1352 derivative records from 32906 primary records. [2025-09-14T21:01:54.051442] [DEBUG] [LOCAL ] WTS: Derivative data saved (1352 records). [2025-09-14T21:01:54.052705] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-14T21:01:54.052503] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-14T21:01:54.055403] [INFO ] [MAIN ] Derivative Progress: 2186/2226 symbols completed. WTS took 1.0s. Estimated remaining: 14.1s. Rate: 170.6 symbols/min [2025-09-14T21:01:54.056854] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:54.070839] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1352 records). [2025-09-14T21:01:54.071391] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-14T21:01:54.074049] [INFO ] [MAIN ] Derivative Progress: 2187/2226 symbols completed. WTTR took 1.0s. Estimated remaining: 13.7s. Rate: 170.7 symbols/min [2025-09-14T21:01:54.074472] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:54.103216] [DEBUG] [LOCAL ] WU: Loaded 40254 existing records from primary storage. [2025-09-14T21:01:54.103427] [INFO ] [MAIN ] WU: Loaded 40254 primary data records. [2025-09-14T21:01:54.262042] [DEBUG] [LOCAL ] WWW: Loaded 36903 existing records from primary storage. [2025-09-14T21:01:54.334009] [INFO ] [MAIN ] WWW: Loaded 36903 primary data records. [2025-09-14T21:01:54.425558] [DEBUG] [LOCAL ] WY: Loaded 40009 existing records from primary storage. [2025-09-14T21:01:54.463148] [INFO ] [MAIN ] WY: Loaded 40009 primary data records. [2025-09-14T21:01:55.000836] [DEBUG] [MAIN ] WU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:55.002524] [INFO ] [MAIN ] WU: Generated 1352 derivative records from 40254 primary records. [2025-09-14T21:01:55.002660] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-14T21:01:55.017027] [DEBUG] [LOCAL ] WU: Derivative data saved (1352 records). [2025-09-14T21:01:55.019020] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-14T21:01:55.023293] [INFO ] [MAIN ] Derivative Progress: 2188/2226 symbols completed. WU took 1.0s. Estimated remaining: 13.4s. Rate: 170.5 symbols/min [2025-09-14T21:01:55.034692] [DEBUG] [MAIN ] WWW: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:55.035412] [INFO ] [MAIN ] WWW: Generated 1352 derivative records from 36903 primary records. [2025-09-14T21:01:55.035686] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-14T21:01:55.049394] [DEBUG] [LOCAL ] WWW: Derivative data saved (1352 records). [2025-09-14T21:01:55.050968] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-14T21:01:55.053192] [INFO ] [MAIN ] Derivative Progress: 2189/2226 symbols completed. WWW took 1.0s. Estimated remaining: 13.0s. Rate: 170.6 symbols/min [2025-09-14T21:01:55.063718] [DEBUG] [MAIN ] WY: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:55.064450] [INFO ] [MAIN ] WY: Generated 1352 derivative records from 40009 primary records. [2025-09-14T21:01:55.064532] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-14T21:01:55.076978] [DEBUG] [LOCAL ] WY: Derivative data saved (1352 records). [2025-09-14T21:01:55.077077] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-14T21:01:55.079486] [INFO ] [MAIN ] Derivative Progress: 2190/2226 symbols completed. WY took 1.0s. Estimated remaining: 12.7s. Rate: 170.7 symbols/min [2025-09-14T21:01:55.080217] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:55.080153] [INFO ] [MAIN ] XIFR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:55.080338] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:55.104887] [DEBUG] [LOCAL ] XFLT: Loaded 21846 existing records from primary storage. [2025-09-14T21:01:55.119536] [INFO ] [MAIN ] XFLT: Loaded 21846 primary data records. [2025-09-14T21:01:55.251369] [DEBUG] [LOCAL ] XIFR: Loaded 33416 existing records from primary storage. [2025-09-14T21:01:55.252121] [DEBUG] [LOCAL ] XHR: Loaded 33041 existing records from primary storage. [2025-09-14T21:01:55.273422] [INFO ] [MAIN ] XIFR: Loaded 33416 primary data records. [2025-09-14T21:01:55.283827] [INFO ] [MAIN ] XHR: Loaded 33041 primary data records. [2025-09-14T21:01:56.101141] [DEBUG] [MAIN ] XFLT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:56.103118] [INFO ] [MAIN ] XFLT: Generated 1352 derivative records from 21846 primary records. [2025-09-14T21:01:56.103760] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-14T21:01:56.126729] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1352 records). [2025-09-14T21:01:56.137456] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-14T21:01:56.139779] [INFO ] [MAIN ] Derivative Progress: 2191/2226 symbols completed. XFLT took 1.1s. Estimated remaining: 12.3s. Rate: 170.5 symbols/min [2025-09-14T21:01:56.140168] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:56.140564] [DEBUG] [MAIN ] XHR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:56.144711] [INFO ] [MAIN ] XHR: Generated 1352 derivative records from 33041 primary records. [2025-09-14T21:01:56.146090] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-14T21:01:56.172688] [DEBUG] [MAIN ] XIFR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:56.183150] [INFO ] [MAIN ] XIFR: Generated 1352 derivative records from 33416 primary records. [2025-09-14T21:01:56.183787] [DEBUG] [LOCAL ] XHR: Derivative data saved (1352 records). [2025-09-14T21:01:56.183892] [DEBUG] [LOCAL ] XIFR: Saving derivative data. [2025-09-14T21:01:56.185300] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-14T21:01:56.188376] [INFO ] [MAIN ] Derivative Progress: 2192/2226 symbols completed. XHR took 1.1s. Estimated remaining: 12.0s. Rate: 170.6 symbols/min [2025-09-14T21:01:56.202132] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:56.218555] [DEBUG] [LOCAL ] XIFR: Derivative data saved (1352 records). [2025-09-14T21:01:56.218831] [INFO ] [MAIN ] XIFR: Successfully saved derivative data. [2025-09-14T21:01:56.221732] [INFO ] [MAIN ] Derivative Progress: 2193/2226 symbols completed. XIFR took 1.1s. Estimated remaining: 11.6s. Rate: 170.7 symbols/min [2025-09-14T21:01:56.222275] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:56.245460] [DEBUG] [LOCAL ] XOM: Loaded 40533 existing records from primary storage. [2025-09-14T21:01:56.245866] [INFO ] [MAIN ] XOM: Loaded 40533 primary data records. [2025-09-14T21:01:56.375204] [DEBUG] [LOCAL ] XPER: Loaded 22174 existing records from primary storage. [2025-09-14T21:01:56.381321] [INFO ] [MAIN ] XPER: Loaded 22174 primary data records. [2025-09-14T21:01:56.564931] [DEBUG] [LOCAL ] XPEV: Loaded 40389 existing records from primary storage. [2025-09-14T21:01:56.681976] [INFO ] [MAIN ] XPEV: Loaded 40389 primary data records. [2025-09-14T21:01:57.161966] [DEBUG] [MAIN ] XOM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:57.164424] [INFO ] [MAIN ] XOM: Generated 1352 derivative records from 40533 primary records. [2025-09-14T21:01:57.165611] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-14T21:01:57.188920] [DEBUG] [MAIN ] XPER: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:57.190872] [INFO ] [MAIN ] XPER: Generated 1352 derivative records from 22174 primary records. [2025-09-14T21:01:57.193194] [DEBUG] [LOCAL ] XOM: Derivative data saved (1352 records). [2025-09-14T21:01:57.193320] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-14T21:01:57.193817] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-14T21:01:57.196425] [INFO ] [MAIN ] Derivative Progress: 2194/2226 symbols completed. XOM took 1.1s. Estimated remaining: 11.3s. Rate: 170.5 symbols/min [2025-09-14T21:01:57.196977] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:57.211460] [DEBUG] [LOCAL ] XPER: Derivative data saved (1352 records). [2025-09-14T21:01:57.211970] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-14T21:01:57.214925] [INFO ] [MAIN ] Derivative Progress: 2195/2226 symbols completed. XPER took 1.0s. Estimated remaining: 10.9s. Rate: 170.6 symbols/min [2025-09-14T21:01:57.225267] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:57.226377] [DEBUG] [MAIN ] XPEV: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:57.227687] [INFO ] [MAIN ] XPEV: Generated 1352 derivative records from 40389 primary records. [2025-09-14T21:01:57.227986] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-14T21:01:57.242236] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1352 records). [2025-09-14T21:01:57.242591] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-14T21:01:57.245328] [INFO ] [MAIN ] Derivative Progress: 2196/2226 symbols completed. XPEV took 1.0s. Estimated remaining: 10.5s. Rate: 170.7 symbols/min [2025-09-14T21:01:57.246025] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:57.284375] [DEBUG] [LOCAL ] XPOF: Loaded 28475 existing records from primary storage. [2025-09-14T21:01:57.284625] [INFO ] [MAIN ] XPOF: Loaded 28475 primary data records. [2025-09-14T21:01:57.405145] [DEBUG] [LOCAL ] XPO: Loaded 35942 existing records from primary storage. [2025-09-14T21:01:57.431556] [INFO ] [MAIN ] XPO: Loaded 35942 primary data records. [2025-09-14T21:01:57.453362] [DEBUG] [LOCAL ] XPRO: Loaded 34357 existing records from primary storage. [2025-09-14T21:01:57.512043] [INFO ] [MAIN ] XPRO: Loaded 34357 primary data records. [2025-09-14T21:01:58.275484] [DEBUG] [MAIN ] XPOF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:58.277149] [INFO ] [MAIN ] XPOF: Generated 1352 derivative records from 28475 primary records. [2025-09-14T21:01:58.278093] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-14T21:01:58.294489] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1352 records). [2025-09-14T21:01:58.295288] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-14T21:01:58.303059] [INFO ] [MAIN ] Derivative Progress: 2197/2226 symbols completed. XPOF took 1.1s. Estimated remaining: 10.2s. Rate: 170.5 symbols/min [2025-09-14T21:01:58.314769] [DEBUG] [MAIN ] XPO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:58.315269] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:58.326380] [INFO ] [MAIN ] XPO: Generated 1352 derivative records from 35942 primary records. [2025-09-14T21:01:58.327710] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-14T21:01:58.327399] [DEBUG] [MAIN ] XPRO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:58.329345] [INFO ] [MAIN ] XPRO: Generated 1352 derivative records from 34357 primary records. [2025-09-14T21:01:58.335956] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-14T21:01:58.353378] [DEBUG] [LOCAL ] XPO: Derivative data saved (1352 records). [2025-09-14T21:01:58.356505] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1352 records). [2025-09-14T21:01:58.356674] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-14T21:01:58.359474] [INFO ] [MAIN ] Derivative Progress: 2198/2226 symbols completed. XPO took 1.2s. Estimated remaining: 9.8s. Rate: 170.6 symbols/min [2025-09-14T21:01:58.365173] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:58.364824] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-14T21:01:58.368099] [INFO ] [MAIN ] Derivative Progress: 2199/2226 symbols completed. XPRO took 1.1s. Estimated remaining: 9.5s. Rate: 170.7 symbols/min [2025-09-14T21:01:58.368824] [INFO ] [MAIN ] XYZ: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:58.381283] [DEBUG] [LOCAL ] XYF: Loaded 21847 existing records from primary storage. [2025-09-14T21:01:58.381910] [INFO ] [MAIN ] XYF: Loaded 21847 primary data records. [2025-09-14T21:01:58.658358] [DEBUG] [LOCAL ] XYZ: Loaded 40494 existing records from primary storage. [2025-09-14T21:01:58.721728] [INFO ] [MAIN ] XYZ: Loaded 40494 primary data records. [2025-09-14T21:01:58.722984] [DEBUG] [LOCAL ] XYL: Loaded 35621 existing records from primary storage. [2025-09-14T21:01:58.736954] [INFO ] [MAIN ] XYL: Loaded 35621 primary data records. [2025-09-14T21:01:59.345792] [DEBUG] [MAIN ] XYF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:59.347144] [INFO ] [MAIN ] XYF: Generated 1352 derivative records from 21847 primary records. [2025-09-14T21:01:59.347352] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-14T21:01:59.364748] [DEBUG] [LOCAL ] XYF: Derivative data saved (1352 records). [2025-09-14T21:01:59.365169] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-14T21:01:59.367995] [INFO ] [MAIN ] Derivative Progress: 2200/2226 symbols completed. XYF took 1.1s. Estimated remaining: 9.1s. Rate: 170.5 symbols/min [2025-09-14T21:01:59.369253] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:59.411666] [DEBUG] [MAIN ] XYL: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:59.418935] [INFO ] [MAIN ] XYL: Generated 1352 derivative records from 35621 primary records. [2025-09-14T21:01:59.419706] [DEBUG] [MAIN ] XYZ: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:01:59.428756] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-14T21:01:59.428677] [INFO ] [MAIN ] XYZ: Generated 1352 derivative records from 40494 primary records. [2025-09-14T21:01:59.432129] [DEBUG] [LOCAL ] XYZ: Saving derivative data. [2025-09-14T21:01:59.434457] [DEBUG] [LOCAL ] YALA: Loaded 29139 existing records from primary storage. [2025-09-14T21:01:59.435617] [INFO ] [MAIN ] YALA: Loaded 29139 primary data records. [2025-09-14T21:01:59.456550] [DEBUG] [LOCAL ] XYL: Derivative data saved (1352 records). [2025-09-14T21:01:59.468503] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-14T21:01:59.497083] [DEBUG] [LOCAL ] XYZ: Derivative data saved (1352 records). [2025-09-14T21:01:59.518525] [INFO ] [MAIN ] Derivative Progress: 2201/2226 symbols completed. XYL took 1.2s. Estimated remaining: 8.8s. Rate: 170.6 symbols/min [2025-09-14T21:01:59.544459] [INFO ] [MAIN ] XYZ: Successfully saved derivative data. [2025-09-14T21:01:59.568898] [INFO ] [MAIN ] Derivative Progress: 2202/2226 symbols completed. XYZ took 1.2s. Estimated remaining: 8.4s. Rate: 170.6 symbols/min [2025-09-14T21:01:59.569118] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:59.570178] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:01:59.796211] [DEBUG] [LOCAL ] YELP: Loaded 33791 existing records from primary storage. [2025-09-14T21:01:59.797222] [INFO ] [MAIN ] YELP: Loaded 33791 primary data records. [2025-09-14T21:01:59.911984] [DEBUG] [LOCAL ] YETI: Loaded 39768 existing records from primary storage. [2025-09-14T21:01:59.916066] [INFO ] [MAIN ] YETI: Loaded 39768 primary data records. [2025-09-14T21:02:00.222976] [DEBUG] [MAIN ] YALA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:00.241092] [INFO ] [MAIN ] YALA: Generated 1352 derivative records from 29139 primary records. [2025-09-14T21:02:00.241424] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-14T21:02:00.425510] [DEBUG] [LOCAL ] YALA: Derivative data saved (1352 records). [2025-09-14T21:02:00.432861] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-14T21:02:00.436085] [INFO ] [MAIN ] Derivative Progress: 2203/2226 symbols completed. YALA took 1.1s. Estimated remaining: 8.1s. Rate: 170.5 symbols/min [2025-09-14T21:02:00.460475] [DEBUG] [MAIN ] YELP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:00.461558] [INFO ] [MAIN ] YELP: Generated 1352 derivative records from 33791 primary records. [2025-09-14T21:02:00.461932] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-14T21:02:00.476708] [DEBUG] [LOCAL ] YELP: Derivative data saved (1352 records). [2025-09-14T21:02:00.478805] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-14T21:02:00.481381] [INFO ] [MAIN ] Derivative Progress: 2204/2226 symbols completed. YELP took 0.9s. Estimated remaining: 7.7s. Rate: 170.6 symbols/min [2025-09-14T21:02:00.491895] [DEBUG] [MAIN ] YETI: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:00.492877] [INFO ] [MAIN ] YETI: Generated 1352 derivative records from 39768 primary records. [2025-09-14T21:02:00.492964] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-14T21:02:00.505956] [DEBUG] [LOCAL ] YETI: Derivative data saved (1352 records). [2025-09-14T21:02:00.506099] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-14T21:02:00.509948] [INFO ] [MAIN ] Derivative Progress: 2205/2226 symbols completed. YETI took 0.9s. Estimated remaining: 7.4s. Rate: 170.7 symbols/min [2025-09-14T21:02:00.511200] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:00.511432] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:00.511693] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:00.584819] [DEBUG] [LOCAL ] YEXT: Loaded 31890 existing records from primary storage. [2025-09-14T21:02:00.586875] [INFO ] [MAIN ] YEXT: Loaded 31890 primary data records. [2025-09-14T21:02:00.587754] [DEBUG] [LOCAL ] YOU: Loaded 37275 existing records from primary storage. [2025-09-14T21:02:00.593114] [INFO ] [MAIN ] YOU: Loaded 37275 primary data records. [2025-09-14T21:02:00.774810] [DEBUG] [LOCAL ] YMM: Loaded 39592 existing records from primary storage. [2025-09-14T21:02:00.813494] [INFO ] [MAIN ] YMM: Loaded 39592 primary data records. [2025-09-14T21:02:01.489248] [DEBUG] [MAIN ] YEXT: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:01.490959] [INFO ] [MAIN ] YEXT: Generated 1352 derivative records from 31890 primary records. [2025-09-14T21:02:01.492727] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-14T21:02:01.515331] [DEBUG] [MAIN ] YOU: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:01.527423] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1352 records). [2025-09-14T21:02:01.528873] [DEBUG] [MAIN ] YMM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:01.528160] [INFO ] [MAIN ] YOU: Generated 1352 derivative records from 37275 primary records. [2025-09-14T21:02:01.529081] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-14T21:02:01.528945] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-14T21:02:01.530895] [INFO ] [MAIN ] Derivative Progress: 2206/2226 symbols completed. YEXT took 1.0s. Estimated remaining: 7.0s. Rate: 170.5 symbols/min [2025-09-14T21:02:01.531581] [INFO ] [MAIN ] YMM: Generated 1352 derivative records from 39592 primary records. [2025-09-14T21:02:01.532578] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:01.532706] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-14T21:02:01.557828] [DEBUG] [LOCAL ] YOU: Derivative data saved (1352 records). [2025-09-14T21:02:01.559062] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-14T21:02:01.561551] [INFO ] [MAIN ] Derivative Progress: 2207/2226 symbols completed. YOU took 1.1s. Estimated remaining: 6.7s. Rate: 170.6 symbols/min [2025-09-14T21:02:01.562130] [DEBUG] [LOCAL ] YMM: Derivative data saved (1352 records). [2025-09-14T21:02:01.562396] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:01.562571] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-14T21:02:01.565666] [INFO ] [MAIN ] Derivative Progress: 2208/2226 symbols completed. YMM took 1.1s. Estimated remaining: 6.3s. Rate: 170.7 symbols/min [2025-09-14T21:02:01.566097] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:01.578329] [DEBUG] [LOCAL ] YRD: Loaded 8071 existing records from primary storage. [2025-09-14T21:02:01.578687] [INFO ] [MAIN ] YRD: Loaded 8071 primary data records. [2025-09-14T21:02:01.772199] [DEBUG] [LOCAL ] YSG: Loaded 19819 existing records from primary storage. [2025-09-14T21:02:01.802354] [INFO ] [MAIN ] YSG: Loaded 19819 primary data records. [2025-09-14T21:02:01.802180] [DEBUG] [LOCAL ] YPF: Loaded 37780 existing records from primary storage. [2025-09-14T21:02:01.887899] [INFO ] [MAIN ] YPF: Loaded 37780 primary data records. [2025-09-14T21:02:02.473283] [DEBUG] [MAIN ] YRD: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:02.477797] [INFO ] [MAIN ] YRD: Generated 1352 derivative records from 8071 primary records. [2025-09-14T21:02:02.480008] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-14T21:02:02.498146] [DEBUG] [LOCAL ] YRD: Derivative data saved (1352 records). [2025-09-14T21:02:02.498788] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-14T21:02:02.500948] [INFO ] [MAIN ] Derivative Progress: 2209/2226 symbols completed. YRD took 0.9s. Estimated remaining: 6.0s. Rate: 170.5 symbols/min [2025-09-14T21:02:02.501266] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:02.516892] [DEBUG] [MAIN ] YSG: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:02.517824] [INFO ] [MAIN ] YSG: Generated 1352 derivative records from 19819 primary records. [2025-09-14T21:02:02.518030] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-14T21:02:02.541144] [DEBUG] [MAIN ] YPF: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:02.544867] [INFO ] [MAIN ] YPF: Generated 1352 derivative records from 37780 primary records. [2025-09-14T21:02:02.545435] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-14T21:02:02.545336] [DEBUG] [LOCAL ] YSG: Derivative data saved (1352 records). [2025-09-14T21:02:02.546542] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-14T21:02:02.548938] [INFO ] [MAIN ] Derivative Progress: 2210/2226 symbols completed. YSG took 1.0s. Estimated remaining: 5.6s. Rate: 170.6 symbols/min [2025-09-14T21:02:02.558569] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:02.572914] [DEBUG] [LOCAL ] YPF: Derivative data saved (1352 records). [2025-09-14T21:02:02.573121] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-14T21:02:02.575968] [INFO ] [MAIN ] Derivative Progress: 2211/2226 symbols completed. YPF took 1.0s. Estimated remaining: 5.3s. Rate: 170.7 symbols/min [2025-09-14T21:02:02.576337] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:02.593569] [DEBUG] [LOCAL ] YUM: Loaded 38411 existing records from primary storage. [2025-09-14T21:02:02.594105] [INFO ] [MAIN ] YUM: Loaded 38411 primary data records. [2025-09-14T21:02:02.839596] [DEBUG] [LOCAL ] YUMC: Loaded 39581 existing records from primary storage. [2025-09-14T21:02:02.931096] [INFO ] [MAIN ] YUMC: Loaded 39581 primary data records. [2025-09-14T21:02:02.923539] [DEBUG] [LOCAL ] ZBH: Loaded 38460 existing records from primary storage. [2025-09-14T21:02:02.944594] [INFO ] [MAIN ] ZBH: Loaded 38460 primary data records. [2025-09-14T21:02:03.616476] [DEBUG] [MAIN ] YUM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:03.618347] [INFO ] [MAIN ] YUM: Generated 1352 derivative records from 38411 primary records. [2025-09-14T21:02:03.619008] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-14T21:02:03.637506] [DEBUG] [LOCAL ] YUM: Derivative data saved (1352 records). [2025-09-14T21:02:03.638000] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-14T21:02:03.640195] [INFO ] [MAIN ] Derivative Progress: 2212/2226 symbols completed. YUM took 1.1s. Estimated remaining: 4.9s. Rate: 170.5 symbols/min [2025-09-14T21:02:03.641107] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:03.658603] [DEBUG] [MAIN ] ZBH: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:03.666239] [INFO ] [MAIN ] ZBH: Generated 1352 derivative records from 38460 primary records. [2025-09-14T21:02:03.666611] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-14T21:02:03.694961] [DEBUG] [LOCAL ] ZEPP: Loaded 14319 existing records from primary storage. [2025-09-14T21:02:03.688501] [DEBUG] [MAIN ] YUMC: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:03.697342] [INFO ] [MAIN ] YUMC: Generated 1352 derivative records from 39581 primary records. [2025-09-14T21:02:03.698100] [INFO ] [MAIN ] ZEPP: Loaded 14319 primary data records. [2025-09-14T21:02:03.698866] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1352 records). [2025-09-14T21:02:03.698917] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-14T21:02:03.699137] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-14T21:02:03.732970] [INFO ] [MAIN ] Derivative Progress: 2213/2226 symbols completed. ZBH took 1.2s. Estimated remaining: 4.6s. Rate: 170.6 symbols/min [2025-09-14T21:02:03.785042] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:03.820899] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1352 records). [2025-09-14T21:02:03.848966] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-14T21:02:03.898218] [INFO ] [MAIN ] Derivative Progress: 2214/2226 symbols completed. YUMC took 1.3s. Estimated remaining: 4.2s. Rate: 170.6 symbols/min [2025-09-14T21:02:03.903280] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:04.047851] [DEBUG] [LOCAL ] ZETA: Loaded 40363 existing records from primary storage. [2025-09-14T21:02:04.051710] [DEBUG] [LOCAL ] ZGN: Loaded 30541 existing records from primary storage. [2025-09-14T21:02:04.052510] [INFO ] [MAIN ] ZETA: Loaded 40363 primary data records. [2025-09-14T21:02:04.052825] [INFO ] [MAIN ] ZGN: Loaded 30541 primary data records. [2025-09-14T21:02:04.174882] [DEBUG] [MAIN ] ZEPP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:04.256425] [INFO ] [MAIN ] ZEPP: Generated 1352 derivative records from 14319 primary records. [2025-09-14T21:02:04.297676] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-14T21:02:04.467524] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1352 records). [2025-09-14T21:02:04.651886] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-14T21:02:04.656487] [INFO ] [MAIN ] Derivative Progress: 2215/2226 symbols completed. ZEPP took 1.0s. Estimated remaining: 3.9s. Rate: 170.5 symbols/min [2025-09-14T21:02:04.657802] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:04.686603] [DEBUG] [MAIN ] ZGN: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:04.697188] [INFO ] [MAIN ] ZGN: Generated 1352 derivative records from 30541 primary records. [2025-09-14T21:02:04.696488] [DEBUG] [MAIN ] ZETA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:04.707968] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-14T21:02:04.709067] [INFO ] [MAIN ] ZETA: Generated 1352 derivative records from 40363 primary records. [2025-09-14T21:02:04.709197] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-14T21:02:04.731633] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1352 records). [2025-09-14T21:02:04.732710] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-14T21:02:04.736571] [INFO ] [MAIN ] Derivative Progress: 2216/2226 symbols completed. ZETA took 1.0s. Estimated remaining: 3.5s. Rate: 170.6 symbols/min [2025-09-14T21:02:04.749241] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:04.750561] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1352 records). [2025-09-14T21:02:04.750713] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-14T21:02:04.752722] [INFO ] [MAIN ] Derivative Progress: 2217/2226 symbols completed. ZGN took 0.8s. Estimated remaining: 3.2s. Rate: 170.7 symbols/min [2025-09-14T21:02:04.753324] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:04.754594] [DEBUG] [LOCAL ] ZIM: Loaded 40307 existing records from primary storage. [2025-09-14T21:02:04.755132] [INFO ] [MAIN ] ZIM: Loaded 40307 primary data records. [2025-09-14T21:02:05.063447] [DEBUG] [LOCAL ] ZK: Loaded 28834 existing records from primary storage. [2025-09-14T21:02:05.063328] [DEBUG] [LOCAL ] ZIP: Loaded 32834 existing records from primary storage. [2025-09-14T21:02:05.063901] [INFO ] [MAIN ] ZK: Loaded 28834 primary data records. [2025-09-14T21:02:05.063833] [INFO ] [MAIN ] ZIP: Loaded 32834 primary data records. [2025-09-14T21:02:05.695187] [DEBUG] [MAIN ] ZIM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:05.696317] [INFO ] [MAIN ] ZIM: Generated 1352 derivative records from 40307 primary records. [2025-09-14T21:02:05.696667] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-14T21:02:05.711526] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1352 records). [2025-09-14T21:02:05.713466] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-14T21:02:05.715774] [INFO ] [MAIN ] Derivative Progress: 2218/2226 symbols completed. ZIM took 1.1s. Estimated remaining: 2.8s. Rate: 170.5 symbols/min [2025-09-14T21:02:05.726300] [DEBUG] [MAIN ] ZIP: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:05.726976] [INFO ] [MAIN ] ZIP: Generated 1352 derivative records from 32834 primary records. [2025-09-14T21:02:05.727059] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-14T21:02:05.750827] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1352 records). [2025-09-14T21:02:05.749880] [DEBUG] [MAIN ] ZK: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:05.751542] [INFO ] [MAIN ] ZK: Generated 1352 derivative records from 28834 primary records. [2025-09-14T21:02:05.751604] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-14T21:02:05.753830] [INFO ] [MAIN ] Derivative Progress: 2219/2226 symbols completed. ZIP took 1.0s. Estimated remaining: 2.5s. Rate: 170.6 symbols/min [2025-09-14T21:02:05.753902] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-14T21:02:05.766336] [DEBUG] [LOCAL ] ZK: Derivative data saved (1352 records). [2025-09-14T21:02:05.766433] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-14T21:02:05.768857] [INFO ] [MAIN ] Derivative Progress: 2220/2226 symbols completed. ZK took 1.0s. Estimated remaining: 2.1s. Rate: 170.7 symbols/min [2025-09-14T21:02:05.769745] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:05.769569] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:05.769473] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:05.785145] [DEBUG] [LOCAL ] ZKH: Loaded 5850 existing records from primary storage. [2025-09-14T21:02:05.785772] [INFO ] [MAIN ] ZKH: Loaded 5850 primary data records. [2025-09-14T21:02:05.895559] [DEBUG] [LOCAL ] ZTR: Loaded 12420 existing records from primary storage. [2025-09-14T21:02:05.906407] [INFO ] [MAIN ] ZTR: Loaded 12420 primary data records. [2025-09-14T21:02:06.070824] [DEBUG] [LOCAL ] ZTO: Loaded 37359 existing records from primary storage. [2025-09-14T21:02:06.102134] [INFO ] [MAIN ] ZTO: Loaded 37359 primary data records. [2025-09-14T21:02:06.656778] [DEBUG] [MAIN ] ZKH: Filtered 5251 bins outside market hours, 5863 incomplete bins [2025-09-14T21:02:06.657937] [INFO ] [MAIN ] ZKH: Generated 1351 derivative records from 5850 primary records. [2025-09-14T21:02:06.658655] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-14T21:02:06.673980] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1351 records). [2025-09-14T21:02:06.674294] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-14T21:02:06.686442] [INFO ] [MAIN ] Derivative Progress: 2221/2226 symbols completed. ZKH took 0.9s. Estimated remaining: 1.8s. Rate: 170.5 symbols/min [2025-09-14T21:02:06.687283] [DEBUG] [MAIN ] ZTR: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:06.687363] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:06.688671] [INFO ] [MAIN ] ZTR: Generated 1352 derivative records from 12420 primary records. [2025-09-14T21:02:06.688904] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-14T21:02:06.709381] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1352 records). [2025-09-14T21:02:06.712269] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-14T21:02:06.715310] [INFO ] [MAIN ] Derivative Progress: 2222/2226 symbols completed. ZTR took 0.9s. Estimated remaining: 1.4s. Rate: 170.6 symbols/min [2025-09-14T21:02:06.715829] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:06.729867] [DEBUG] [MAIN ] ZTO: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:06.731308] [INFO ] [MAIN ] ZTO: Generated 1352 derivative records from 37359 primary records. [2025-09-14T21:02:06.731452] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-14T21:02:06.764037] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1352 records). [2025-09-14T21:02:06.764491] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-14T21:02:06.774793] [INFO ] [MAIN ] Derivative Progress: 2223/2226 symbols completed. ZTO took 1.0s. Estimated remaining: 1.1s. Rate: 170.7 symbols/min [2025-09-14T21:02:06.775700] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-14T21:02:06.802483] [DEBUG] [LOCAL ] ZVIA: Loaded 27034 existing records from primary storage. [2025-09-14T21:02:06.802764] [INFO ] [MAIN ] ZVIA: Loaded 27034 primary data records. [2025-09-14T21:02:06.809267] [DEBUG] [LOCAL ] ZTS: Loaded 39998 existing records from primary storage. [2025-09-14T21:02:06.832931] [INFO ] [MAIN ] ZTS: Loaded 39998 primary data records. [2025-09-14T21:02:07.100293] [DEBUG] [LOCAL ] ZWS: Loaded 31369 existing records from primary storage. [2025-09-14T21:02:07.147629] [INFO ] [MAIN ] ZWS: Loaded 31369 primary data records. [2025-09-14T21:02:07.746350] [DEBUG] [MAIN ] ZVIA: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:07.748330] [INFO ] [MAIN ] ZVIA: Generated 1352 derivative records from 27034 primary records. [2025-09-14T21:02:07.748796] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-14T21:02:07.759371] [DEBUG] [MAIN ] ZTS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:07.766035] [INFO ] [MAIN ] ZTS: Generated 1352 derivative records from 39998 primary records. [2025-09-14T21:02:07.771719] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-14T21:02:07.775162] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1352 records). [2025-09-14T21:02:07.776835] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-14T21:02:07.778991] [INFO ] [MAIN ] Derivative Progress: 2224/2226 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.7s. Rate: 170.5 symbols/min [2025-09-14T21:02:07.799847] [DEBUG] [MAIN ] ZWS: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-14T21:02:07.801859] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1352 records). [2025-09-14T21:02:07.802079] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-14T21:02:07.802943] [INFO ] [MAIN ] ZWS: Generated 1352 derivative records from 31369 primary records. [2025-09-14T21:02:07.804990] [INFO ] [MAIN ] Derivative Progress: 2225/2226 symbols completed. ZTS took 1.1s. Estimated remaining: 0.4s. Rate: 170.6 symbols/min [2025-09-14T21:02:07.805081] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-14T21:02:07.818377] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1352 records). [2025-09-14T21:02:07.818473] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-14T21:02:07.820877] [INFO ] [MAIN ] Derivative Progress: 2226/2226 symbols completed. ZWS took 1.0s. Estimated remaining: 0.0s. Rate: 170.7 symbols/min [2025-09-14T21:02:07.822010] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 3s [2025-09-14T21:02:07.822370] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2226/2226 symbols) [2025-09-14T21:02:08.315405] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2226/2226 @ 100.00%)' [2025-09-14T21:02:08.317096] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-14T21:02:08.317387] [INFO ] [STATE ] Last completion updated: 2025-09-14T21:02:08.317199